After-School Initiative's Toolkit for Evaluating

More documents

Recommendations

Info

Toolkit for Evaluating Positive Youth Development 98 Outcome Domain Post-Only Question Pre-Post Question Scale I am better at standing up for what I believe. I stand up for what I believe. Frequency I tell the truth more often even when it is hard. I tell the truth more often even when it is hard. Frequency I am better at taking responsibility for my actions. I take responsibility for my actions. Frequency I am more interested in community and world I am interested in community and world problems. Frequency Positive Life Choices problems. I am better at speaking up for people who have been treated unfairly. Coming to [this program] has helped me to… I speak up for people who have been treated unfairly. Frequency Better say “no” to things I know are wrong. I say “no” to things I know are wrong. Frequency Stay out of trouble. I stay out of trouble. Frequency Stay away from tobacco. I stay away from tobacco. Frequency Stay away from alcohol. I stay away from alcohol. Frequency Stay away from drugs. I stay away from drugs. Frequency Stay away from sex. I stay away from sex. Frequency Stay away from violence and fighting. I stay away from violence and fighting. Frequency Sense of Self Coming to [this program] has helped me to… Feel better about myself. I feel good about myself. Frequency Feel I have more control over things that happen to I feel I have control over things that happen to me. Frequency me. Feel that I can make more of a difference. I feel that I can make a difference. Frequency Learn I can do things I didn’t think I could do I am good at learning new things. Frequency before. Feel better about my future. I feel good about my future. Frequency Feel I am better at handling whatever comes my way. I am good at handling whatever comes my way. Frequency
Appendix XI. Complete Pre-Post Toolkit Survey Question Set The pre-post survey question sets ask youth participants to rate themselves on their current status. This rating is made twice – once at program start (pre-program) and once at program end (post-program). This method of questioning varies from the post-only question sets wherein youth participants are asked at program end to rate the amount of change they have made from program start to program end. An example question asked in each format is presented in the following table: Pre-Post Version (Administered at onset of program) Pre: I feel a strong connection to my community All of the time Most of the time Some of the time Never (Administered at end of program) Post: I feel a strong connection to my community All of the time Most of the time Some of the time Never Analysis: Post-test rating is compared to pre-test rating to see if any movement occurred. Post-Only Version (Administered at end of program) Post: Coming to this program has helped me to feel a stronger connection to my community Yes Kind of Not Really The pre-post version is generally considered a stronger method for evaluating youth participants; however, it has a couple of limitations. The pre-post versions of the toolkit question sets are appropriate for youth participants with higher levels of literacy because it uses more expansive question scales (shifting from 3-point scale to 4- and 5-point scales). In addition, special care is needed when planning the administration because the pre-test surveys must be administered as close to program start as possible in order to be as accurate as possible (i.e., the participant may have experienced change within the first few weeks of the program). Appendix X provides an in-depth comparison of the pre-post survey to the post-only survey. The pre-post questions are only available for measuring outcomes. Program satisfaction can only be collected in the post-only format. Reliability testing was not conducted on the pre-post survey question set due to the limited sample size available at the time of publication. Toolkit for Evaluating Positive Youth Development 99
Page 1 and 2:
THE AFTER-SCHOOL INITIATIVE’S Too
Page 3 and 4:
Table of Contents INTRODUCTION ....
Page 5 and 6:
Introduction The After-School Initi
Page 7 and 8:
Mitigation of burden on participant
Page 9 and 10:
Using This Toolkit As part of their
Page 11 and 12:
Guarantee anonymity or confidential
Page 13 and 14:
• Who is responsible for gatherin
Page 15 and 16:
The following is a checklist of tas
Page 17 and 18:
The Survey Administration The surve
Page 19 and 20:
Problem situations during survey ad
Page 21 and 22:
Outcome Domain Outcome Indicators A
Page 23 and 24:
Academic Success Many after-school
Page 25 and 26:
Arts and Recreation Many youth prog
Page 27 and 28:
Cultural Competency As communities
Page 29 and 30:
Life Skills Life skills are profici
Page 31 and 32:
Positive Life Choices Although the
Page 33 and 34:
Section 2: Program Quality Toolkit
Page 35 and 36:
ASI requirement: All program qualit
Page 37 and 38:
Section 3: Youth Background and Pro
Page 39 and 40:
Section 4: Alternative to Post-only
Page 41 and 42:
Review of positive youth developmen
Page 43 and 44:
Reliability of Toolkit Domains Doma
Page 45 and 46:
Appendix III. The Use of Incentives
Page 47 and 48:
[ASI program staff may delete some
Page 49 and 50:
Child Assent to Participate in the
Page 51 and 52: [ASI program staff may delete some
Page 53 and 54: Asentimiento de jovenes para partic
Page 55 and 56: Outcome Domain Community Involvemen
Page 57 and 58: Outcome Domain English Post-only Qu
Page 59 and 60: Outcome Domain Sense of Self Englis
Page 61 and 62: 7) Who will assist the survey admin
Page 63 and 64: Toolkit Outcome Domains Toolkit Out
Page 65 and 66: Toolkit Outcome Domains Toolkit Out
Page 67 and 68: Toolkit Domains Toolkit Outcome Ind
Page 69 and 70: TABLE 3 - Toolkit Outcome Domains L
Page 71 and 72: Toolkit Domains Toolkit Outcome Ind
Page 73 and 74: Outcome Domain Advanced Question a
Page 75 and 76: Outcome Domain Advanced Question I
Page 77 and 78: Background Information Advanced Que
Page 79 and 80: CSAP Tracking Form Student ID Readi
Page 81 and 82: Attendance Tracking Form Student ID
Page 83 and 84: Appendix IX. Complete Post-only Too
Page 85 and 86: [Academic Success - For ASI grantee
Page 87 and 88: [Life Skills - For ASI grantees cho
Page 89 and 90: 17) What grade are you in? ________
Page 93 and 94: [Life Skills - For ASI grantees cho
Page 95 and 96: 17) ¿En qué grado estás? _______
Page 97 and 98: Flowchart for Selecting Post-only o
Page 99 and 100: Outcome Domain Post-Only Question P
Page 101: Outcome Domain Post-Only Question P
Page 107 and 108: [Positive Core Values - All questio
Page 109 and 110: [NAME OF ASI PROGRAM/AGENCY] ENCUES
Page 111 and 112: [Cultural Competency - For ASI gran
Page 113 and 114: [Questions a and b are required if
Page 115 and 116: REFERENCES 1 The International Coun
show all

After-School Initiative's Toolkit for Evaluating

You also want an ePaper? Increase the reach of your titles

Delete template?

Save as template?