Technical Manual - Renaissance Learning

Reliability and Measurement PrecisionSTAR Early Literacy Enterprise Equivalence Study Dataconsistency reliability using two different approaches: generic and split-halfreliability estimation. Score data from the two STAR Early Literacy versions wereused to calculate correlation coefficients between them—estimates of test-retestor, more correctly, alternate test reliability.Table 14 lists the generic, split-half, and alternate test reliability estimates for theoverall sample of students, and for each grade separately. The within-gradereliability estimates compare closely to those reported earlier in Table 13 for STAREarly Literacy. The reliability estimates for all grades combined are somewhatlower; this is consistent with range restriction in the SEL Enterprise sample, whichdid not include any pre-Kindergarten students.Table 14:STAR Early Literacy Enterprise Scaled Score Reliability Estimates by GradeGradeNInternal Consistency EstimatesGeneric ReliabilitySplit-HalfReliabilityAlternate TestsReliabilityAll Grades 7,124 0.86 0.85 0.78K 2,177 0.78 0.75 0.631 2,679 0.83 0.82 0.752 1,355 0.83 0.84 0.713 913 0.84 0.84 0.67Table 15 below lists the split-half reliability coefficients obtained from theanalyses of each of the ten Sub-Domain scores. Sub-Domain Score reliability dataare presented overall and by grade. Table 16 lists similar data for the Skill SetScores.Table 15:Sub-Domain Score Split-Half Reliability, Overall and by GradeGradesSub-Domain ScoreOverall K 1 2 3Alphabetic Principle 0.84 0.76 0.82 0.85 0.86Concept of Word 0.84 0.77 0.83 0.85 0.87Early Numeracy 0.84 0.76 0.82 0.84 0.86Paragraph-Level Comprehension 0.85 0.74 0.81 0.83 0.82Phonemic Awareness 0.85 0.74 0.81 0.83 0.83Phonics 0.85 0.75 0.81 0.84 0.84Sentence-Level Comprehension 0.85 0.74 0.81 0.83 0.84Structural Analysis 0.85 0.74 0.81 0.83 0.83Visual Discrimination 0.84 0.78 0.83 0.85 0.87STAR Early LiteracyTechnical Manual50