Presentation slides - Harvard Graduate School of Education

More documents

Recommendations

Info

What do we mean by reliable and valid? • Score validity ▫ Construct validity • Face validity • Factor analyses or other construct identification procedures • Criterion-related validity ▫ Consequential validity • Both for the individuals in the system • And for the system itself – are there positive or negative unintended consequences?
What do states mean for scores to be reliable and valid? • 9 states responded • The most common answer (3 states) was to see congruence between observation and studentassessment-based metrics • Two answers focused on elements <strong>of</strong> the system that would improve validity and reliability ▫ a distribution <strong>of</strong> scores that better reflects reality ▫ raters who are more grounded in benchmarks and evidence • Some answers were very vague, only loosely related to standards for validity and reliability
Page 1 and 2: State and Local Efforts to Investig
Page 3 and 4: Purpose • We examine states’ ef
Page 5 and 6: Methods • Document collection and
Page 10 and 11: What efforts are underway to ensure
Page 12 and 13: What would you like to see in order
Page 14 and 15: Questions about the evaluators •
Page 16 and 17: Evaluators Who is required to condu
Page 18 and 19: Evaluators Who is responsible for t
Page 20 and 21: What we learned about instruments
Page 22 and 23: What we learned about instruments
Page 24 and 25: What we learned about sampling of l
Page 26 and 27: Are there plans to report the relia
Page 28 and 29: What purposes will the overall teac
Page 30 and 31: Are there efforts to ensure those d
Page 32 and 33: What kinds of PD are teachers recei
Page 34 and 35: Do you think the evaluation system
Page 36: If you have questions or would like

Presentation slides - Harvard Graduate School of Education

Create successful ePaper yourself

Delete template?

Save as template?