Pearson Successmaker Math Efficacy Study 2009-10 Final Report

SuccessMaker Math RCT Gatti Evaluation Inc. 9-15-10100%80%Figure 7: Do you like it when the characters sing and dance?% Like% Neither Like Nor Dislike75.8%% Dislike60%40%41.0%31.5% 31.5% 33.1%27.5%35.4%20%15.5%8.7%0%3rd Grade 5th Grade 7th GradeStudent SuccessMaker Math AttitudesSuccessMaker students were surveyed at the end of the school year as to their opinions onseveral aspects of the program (i.e., 3 rd = 268, 5 th = 200, and 7 th = 127 responses). Figures 4 and5 show students’ reactions to the math program. The overwhelming majority of 3 rd gradestudents (i.e., 70%) indicated they liked using the program, and only 21% of 5 th grade and 12%of 7 th grade students indicated they disliked using the program. Similarly, 3 rd grade studentsresponded most positively to the characters and animation, and found the learning activitiesengaging with 90% reporting they liked the characters and 76% reported liking the animation.Not as many older students found the characters and animation engaging. Of 5 th graders, 18%disliked the learning activities and 28% disliked the animation. Increasingly at 7 th grade, 25% ofstudents reported disliking the learning activities and 35% indicated they disliked the charactersand animation.Teacher SuccessMaker AttitudesOpinions about the SuccessMaker program were systematically collected from teachers duringfocus group sessions. Focus groups were conducted at each school during site visits betweenApril and early June. These sessions provided a forum for teachers and administrators to answerspecific questions as well as express their professional and personal opinions regarding theprogram. The teachers were encouraged to speak without hesitation or inhibition, and to be ascandid as possible. The focus group sessions provided extensive insight into teacher and studentexperiences with, and attitudes about, the SuccessMaker Math program. This information wassupplemented with opinions gained from students when students were observed using theprogram.The focus group results describe what teachers and students liked about theSuccessMaker program, how the program could be improved, and how teachersare using specific features of the system.- 53 -