Technical Manual - Renaissance Learning

ValidityRelationship of STAR Early Literacy Enterprise Scores to Common Core State Standards Skills RatingsPsychometric Properties of the CCSS Skills RatingsThe rating worksheet was scored for each student by assigning one point for eachperformance task marked by the teacher. The range of possible scores was 0 to 10.Teachers completed skills ratings for 6,708 of the students in the EnterpriseEquivalence Study. Table 45 lists data about the psychometric properties of theten item rating scale, overall and by grade, including the correlations betweenskills ratings and Scaled Scores. The internal consistency reliability of the skillsratings was 0.84, as estimated by coefficient alpha.Table 45:Teachers’ Ratings of Their Students’ Common Core StateStandards-Aligned Skills, by GradeGradeNMeanRatingsStandardDeviationScaled ScoresMeanStandardDeviationCorrelation of SkillsRatings with ScaledScoresK 2,039 7.5 2.4 687 99 0.471 2,552 8.7 2.0 749 98 0.582 1,243 9.0 1.9 818 69 0.463 874 9.5 1.3 839 59 0.60Relationship of Scaled Scores to Skills RatingsAs the data in Table 45 show, the mean skills rating increased directly with grade,from 7.48 at kindergarten to 9.48 at grade 3. Thus, teachers rated kindergartenstudents as possessing fewer than eight of the ten skills on average. In contrast,the average third grader was rated as possessing almost all of the ten skills. Thecorrelation between the skills ratings and STAR Early Literacy Enterprise ScaledScores was significant at every grade level. The overall correlation was 0.58,indicating a substantial degree of relationship between the STAR Early LiteracyEnterprise test and teachers’ ratings of their students’ CCSS literacy skills.Within-grade correlations ranged from 0.46 to 0.60.Figure 13 displays the relationships of each of the ten rating scale items to STAREarly Enterprise Literacy Scaled Scores. These relationships were obtained byfitting mathematical models to the response data for each of the ten rating items.Each of the curves in the figure is a graphical depiction of the respective model. Asthe curves show, the proportion of students rated as possessing each of the tenrated skills increases with Scaled Score.STAR Early LiteracyTechnical Manual97