03.12.2012 Views

2007 ANNUAL REPORT - cosmos - Bowling Green State University

2007 ANNUAL REPORT - cosmos - Bowling Green State University

2007 ANNUAL REPORT - cosmos - Bowling Green State University

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

Surveys: Teacher Beliefs Inventory<br />

Data Collection Strategies and Procedures<br />

The TBI was administered to most of the NWO participants by the NWO staff at two points in<br />

time during the academic year (AY) – in the fall of 2006 (this excludes TEAMS) and in the spring<br />

of <strong>2007</strong> (this includes all the participants). The fall administration of the TBI was in the paperand-pencil<br />

format and was carried out during the Blast-off NWO Center event in September.<br />

The spring administration of the TBI was done on-line after the Summit NWO Center event in<br />

April. A total of 69 responses were received in the fall (this excludes TEAMS) and 80 were<br />

received in the spring (43 TEAMS, 8 TeachOhio and 29 other NWO/COSMOS participants – a<br />

57% response rate). In addition to these data collection events, the TeachOhio participants were<br />

surveyed twice in the summer of 2006 using the paper-and-pencil format - in June (pre) and in<br />

August (post) after the methods class. All the TeachOhio participants completed the pre- and<br />

post-surveys in summer. However, slightly more than 50% of the TeachOhio participants<br />

completed the TBI survey on-line in April <strong>2007</strong>. The TEAMS participants were also surveyed<br />

twice in summer of 2006 using the paper-and-pencil format. There were 62 usable TEAMS<br />

responses from the pre-survey (84% response rate) and 59 from the post-survey (80%<br />

response rate).<br />

Interviews: NWO Teacher Interview<br />

The teacher interview data were collected and transcribed by the NWO staff throughout the<br />

academic year. The data came from a sample of the NWO participants who were also observed<br />

in their classrooms. A total of 39 interviews were conducted: 10 for TEAMS, 20 for TeachOhio<br />

(10 pre and 10 post), 7 for Other NWO participants (PRISM, MAT, and In-Service), and 2 from<br />

control group teachers (as part of TEAMS evaluation).<br />

Interviews: Higher Education Faculty E-Mail Interview<br />

The faculty interviews were conducted by MetriKs in May - June of <strong>2007</strong> using an e-mail<br />

interview method (vs. telephone interviews that were done previously). As previously mentioned,<br />

this was preferred over telephone interview for the following reasons: no costs associated with<br />

transcription, opportunity for the respondents to revisit their responses and check them for<br />

accuracy; a more naturalistic interview process that leads to increased richness of narratives;<br />

and greater ownership of the narratives by the respondents. These characteristics of email<br />

interviews along with probing enhance credibility (reliability) and establish authenticity (validity)<br />

of the evaluation (James & Busher, 2006). A total of 20 (compared to 6 last year) faculty<br />

responded (69% response rate).<br />

Session Evaluations: NWO Participant Session Evaluation<br />

Session evaluations data were collected, entered and summarized by the NWO staff after each<br />

session using the NWO Participant Session Evaluation Protocol.<br />

Observations: Horizon’s Professional Development Protocol<br />

A total of nine AY sessions were observed by five trained observers in 2006-<strong>2007</strong> across all<br />

NWO projects.

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!