The Promise and Potential Pitfalls of Value-Added Assessment

More documents

Recommendations

Info

What We Do Know About VAMs?• Relatively few teacher effects are statistically different frommean effect• Year-to-year correlation of teacher effects is in the range of.2 to .3• VAM models accurately estimate teacher performance inthe absence of detailed student background information, butonly if there is significant mixing of students across teachers(McCaffrey et al., 2004)• VAMs fail various falsification tests (Rothstein, 2008)• Experimental VAM estimates look similar tononexperimental estimates with particular specifications(Kane and Staiger, 2008)12
Tradeoffs• Multiple years of job performance data certainlyimproves reliability of estimates– More information & ability to use more sophisticatedstatistical approaches• But, no VAM information on first-year teachers & potentialdampening of performance incentives• Comparisons within and between schools• May be few good within district comparisons (in small districts)but allows districts to implement policies (sample issue)• Within and between school comparisons conflate school andteacher effects but effective teacher in one school might havebeen ineffective in another (statistical approach issue)– Decisions about comparisons have potentially importantpolicy implications for level of policy implementation• States could assist by estimating VAMs, but leaving it up tolocalities to decide how to use the estimates13
Page 1 and 2: The Promise and Potential Pitfallso
Page 3 and 4: A Simple Observation• Opposition
Page 5 and 6: Gateway vs. Workforce PoliciesEmpir
Page 7 and 8: Logistical Issues• Timing of test
Page 9 and 10: Test Measurement Issues• Vertical
Page 11: Defining the Counterfactual• We n
Page 15 and 16: Current Salary Structure Isn’t Wo
Page 17 and 18: Why VAM?Devil You Don’t Know Is P
Page 19 and 20: Hypothetical Relationship Between T
Page 21 and 22: Comparison of Teacher Effects in Ma
Page 23 and 24: Degree LevelsDifference in means: .
Page 25 and 26: Individual & Institutional SAT Scor
Page 27: Pay Structure Outside Education•

The Promise and Potential Pitfalls of Value-Added Assessment

Create successful ePaper yourself

Delete template?

Save as template?