Concrete_21st Century Grant_Year 3_Evaluation2021

More documents

Recommendations

Info

Beginning with the 2019-2020 school year, each program site worked to create a LogicModel to support their vision and help drive decision making. Program leaders and sitestaff worked with the external evaluator to discuss the current and future needs ofstudents and community members. An example of Concrete’s 2020-2021 logic model isincluded in Appendix A. This process will be conducted with evaluation teams for allfuture years of the grant. Evaluation DesignResearchers used a multiple measure, mixed methodology approach to conduct thisevaluation. The collection of both quantitative and qualitative data adds scope andbreadth to the study in addition to providing the ability to triangulate findings (Creswell,1994). During the 2020-2021 school year, school closures and COVID restrictionsimpacted the ability to collect quantitative data from program sites, as state assessmentswere cancelled. As a result, the Year 3 report will look different than prior and futurereports. Program leaders were asked to provide their perceptions of the impact of COVIDon programming and student outcomes. Those perspectives are included in the evaluationnarrative. Despite school closures, researchers followed a utilization-focused model of evaluation.This model of evaluation is intended to provide useful feedback that can be implementedin real time (Patton, 2013). As such, The BERC Group worked closely with programleaders to develop evaluation questions and design. Qualitative data was gathered duringprogram observations, interviews with staff, and document review. The Boys and GirlsClub provided a database of student attendance for analysis by researchers. Evaluation QuestionsTo address program goals and grant objectives, researchers collaborated with the programleader to assure alignment of evaluation questions with the goals and requirements of thegrant. The evaluation questions were designed to provide program leaders formativefeedback for continuous improvement, as well as summative feedback about progresstoward grant goals. The questions align with OSPI’s local evaluation guidelines for 21 stCCLC programs. The evaluation questions are:1. What strategies and activities support project goals?THE BERC GROUP3
2. What contextual factors influence program implementation?3. To what extent does the program reach the target population?4. To what extent do students persist in the program?5. Outcome Questions:a. To what extent does the program contribute to improved math and readingscores?b. To what extent is attendance at the program correlated with academicachievement?c. To what extent does the program enrich students’ learning experiences?d. To what extent do families engage with the program?As a result of COVID school closures, question 5 parts a and b were not addressed duringthis Year 3 evaluation. Researchers did ask program participants to share theirperspectives of student outcomes during the 2020-2021 school year. These perspectivesare discussed throughout the report. Data SourcesTo address these questions researchers gathered data from multiple sources throughoutthe evaluation cycle. BGCSC provided a database of student attendance. Additionally,BERC researchers conducted • Program interviews with staff and leadership• Program observation• A review of initiative documents and materialsOverall FindingsEQ1. What strategies and activities support project goals?During Year 3, the Concrete 21 st CCLC met on-site, utilizing a 1:10 staff to student ratioto cohort students. Compared to prior years, attendance was low, with approximately8-12 students participating regularly between the elementary and secondary cohorts. Bothgroups met in the BGCSC trailer, utilizing separate rooms. The program director sharedthat they were trying to maintain consistency with prior years, but the poor attendance4THE BERC GROUP
Page 1 and 2: EVALUATION REPORT 2021Concrete Scho
Page 3 and 4: Table of ContentsConcrete School Di
Page 5: Table 1 Demographics of 21 st Centu
Page 9 and 10: In response to COVID and overall st
Page 11 and 12: Average Days of A-endenceElementary
Page 13 and 14: observations from the Power Hour, P
Page 15 and 16: Concrete Elementary School SA-PQ Se
Page 17 and 18: Recommendations Year 3 results prov
Page 19 and 20: Appendix A2019-2020 Logic Model16TH
Page 21: The BERC Group, Inc.P.O. Box 3552Re

Concrete_21st Century Grant_Year 3_Evaluation2021

You also want an ePaper? Increase the reach of your titles

Delete template?

Save as template?