2007 ANNUAL REPORT - cosmos - Bowling Green State University
2007 ANNUAL REPORT - cosmos - Bowling Green State University
2007 ANNUAL REPORT - cosmos - Bowling Green State University
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
Surveys: Teacher Beliefs Inventory<br />
Data Collection Strategies and Procedures<br />
The TBI was administered to most of the NWO participants by the NWO staff at two points in<br />
time during the academic year (AY) – in the fall of 2006 (this excludes TEAMS) and in the spring<br />
of <strong>2007</strong> (this includes all the participants). The fall administration of the TBI was in the paperand-pencil<br />
format and was carried out during the Blast-off NWO Center event in September.<br />
The spring administration of the TBI was done on-line after the Summit NWO Center event in<br />
April. A total of 69 responses were received in the fall (this excludes TEAMS) and 80 were<br />
received in the spring (43 TEAMS, 8 TeachOhio and 29 other NWO/COSMOS participants – a<br />
57% response rate). In addition to these data collection events, the TeachOhio participants were<br />
surveyed twice in the summer of 2006 using the paper-and-pencil format - in June (pre) and in<br />
August (post) after the methods class. All the TeachOhio participants completed the pre- and<br />
post-surveys in summer. However, slightly more than 50% of the TeachOhio participants<br />
completed the TBI survey on-line in April <strong>2007</strong>. The TEAMS participants were also surveyed<br />
twice in summer of 2006 using the paper-and-pencil format. There were 62 usable TEAMS<br />
responses from the pre-survey (84% response rate) and 59 from the post-survey (80%<br />
response rate).<br />
Interviews: NWO Teacher Interview<br />
The teacher interview data were collected and transcribed by the NWO staff throughout the<br />
academic year. The data came from a sample of the NWO participants who were also observed<br />
in their classrooms. A total of 39 interviews were conducted: 10 for TEAMS, 20 for TeachOhio<br />
(10 pre and 10 post), 7 for Other NWO participants (PRISM, MAT, and In-Service), and 2 from<br />
control group teachers (as part of TEAMS evaluation).<br />
Interviews: Higher Education Faculty E-Mail Interview<br />
The faculty interviews were conducted by MetriKs in May - June of <strong>2007</strong> using an e-mail<br />
interview method (vs. telephone interviews that were done previously). As previously mentioned,<br />
this was preferred over telephone interview for the following reasons: no costs associated with<br />
transcription, opportunity for the respondents to revisit their responses and check them for<br />
accuracy; a more naturalistic interview process that leads to increased richness of narratives;<br />
and greater ownership of the narratives by the respondents. These characteristics of email<br />
interviews along with probing enhance credibility (reliability) and establish authenticity (validity)<br />
of the evaluation (James & Busher, 2006). A total of 20 (compared to 6 last year) faculty<br />
responded (69% response rate).<br />
Session Evaluations: NWO Participant Session Evaluation<br />
Session evaluations data were collected, entered and summarized by the NWO staff after each<br />
session using the NWO Participant Session Evaluation Protocol.<br />
Observations: Horizon’s Professional Development Protocol<br />
A total of nine AY sessions were observed by five trained observers in 2006-<strong>2007</strong> across all<br />
NWO projects.