Technical Manual - Renaissance Learning

ValidityMeta-Analyses of the Validation Study Validity DataTable 23:Predictive Validity Data: STAR Early Literacy Predicting Later Performancefor Grades Pre-K–3 (Continued)Predictor Date Criterion Date a Pre-K b K 1 2 3n r n r n r n r n rSTAR ReadingFall 03 Fall 05 P – – 671 0.49* 698 0.58* 194 0.65* – –Win 04 Fall 05 P – – 671 0.54* 698 0.62* 194 0.61* – –Spr 04 Fall 05 P – – 671 0.73* 698 0.67* 194 0.65* – –Fall 03 Win 06 P – – 552 0.43* 653 0.56* 469 0.64* – –Win 04 Win 06 P – – 858 0.55* 772 0.61* 227 0.57* – –Spr 04 Win 06 P – – 639 0.51* 551 0.66* 254 0.59* – –Fall 03 Spr 06 P – – 282 0.47* 376 0.61* 291 0.62* – –Win 04 Spr 06 P – – 497 0.56* 428 0.59* 167 0.59* – –Spr 04 Spr 06 P – – 480 0.55* 343 0.58* 195 0.57* – –SummaryGrades All Pre-K K 1 2 3Number of students 61,443 557 30,423 24,525 5,370 558Number ofcoefficients51 4 15 15 15 2Average validity – 0.57 0.52 0.62 0.67 0.77Overall average 0.58a. P indicates a criterion measure was given in a subsequent grade from the predictor.b. Grade given in the column signifies the grade within the Predictor variable was given (as some validity estimates span contiguousgrades).* Denotes significant correlation (p < 0.05).Meta-Analyses of the Validation Study Validity DataMeta-analysis is a set of statistical procedures that combines results from differentsources or studies. When applied to a set of correlation coefficients that estimatetest validity, meta-analysis combines the observed correlations and sample sizesto yield estimates of overall validity, as well as standard errors and confidenceintervals, both overall and within grades. To conduct a meta-analysis of the STAREarly Literacy validation study data, the 63 correlations observed in the STAR EarlyLiteracy 2001 validation study and documented in previous editions of thetechnical manual were analyzed using a fixed effects model and rescaled using theSTAR Early LiteracyTechnical Manual65