Concrete_21st Century Grant_Year 3_Evaluation2021

Beginning with the 2019-2020 school year, each program site worked to create a Logic
Model to support their vision and help drive decision making. Program leaders and site
staff worked with the external evaluator to discuss the current and future needs of
students and community members. An example of Concrete’s 2020-2021 logic model is
included in Appendix A. This process will be conducted with evaluation teams for all
future years of the grant.
Evaluation Design
Researchers used a multiple measure, mixed methodology approach to conduct this
evaluation. The collection of both quantitative and qualitative data adds scope and
breadth to the study in addition to providing the ability to triangulate findings (Creswell,
1994). During the 2020-2021 school year, school closures and COVID restrictions
impacted the ability to collect quantitative data from program sites, as state assessments
were cancelled. As a result, the Year 3 report will look different than prior and future
reports. Program leaders were asked to provide their perceptions of the impact of COVID
on programming and student outcomes. Those perspectives are included in the evaluation
narrative.
Despite school closures, researchers followed a utilization-focused model of evaluation.
This model of evaluation is intended to provide useful feedback that can be implemented
in real time (Patton, 2013). As such, The BERC Group worked closely with program
leaders to develop evaluation questions and design. Qualitative data was gathered during
program observations, interviews with staff, and document review. The Boys and Girls
Club provided a database of student attendance for analysis by researchers.
Evaluation Questions
To address program goals and grant objectives, researchers collaborated with the program
leader to assure alignment of evaluation questions with the goals and requirements of the
grant. The evaluation questions were designed to provide program leaders formative
feedback for continuous improvement, as well as summative feedback about progress
toward grant goals. The questions align with OSPI’s local evaluation guidelines for 21 st
CCLC programs. The evaluation questions are:
1. What strategies and activities support project goals?
THE BERC GROUP
3