ARE YOU ON THE RIGHT TRACK? - Rutgers WPF

More documents

Recommendations

Info

M&E design 2. Pre-test and post-testIn the analysis you compare pre-test data with post-test dataand see whether the post-test data show better results thanthe pre-test.For example, in the pre-test 100 young people (out of thetotal number of 300 respondents) gave the correct answer toa knowledge question. In the post-test 150 gave the correctanswer. This means that 50 more young people did well.Of course you have to take into account the total number ofrespondents, so you will get percentages:No (correct answer)Yes (incorrect answer)TotalPre-test100 (33%)200 (67%)300 (100%)Post-test150 (60%)100 (40%)250 (100%)Concluding: 33% gave a correct answer in the pre-test, and60% gave correct answer in the post-test. And we see that thenumber of respondents decreased from 300 to 250. The 50 mayhave dropped out of the group or school, or just have missedthe completion of the post-test. You can do these calculationsfor each question in the questionnaire. And you can do thesecalculations for sub-groups, for example for boys and girls.In a graph 10 it looks like this:100806040200PretestIntervention groupM&E design 3. Pre-test and post-test,including a comparison groupIf you also include a comparison group, you want to findout whether the group that had received the interventionhas actually improved more than the comparison group.The comparison between pre-test and post-test is done forboth groups. See the table below.Correct answerIncorrect answerTotalINTERVENTI<strong>ON</strong>Pre-test Post-test100 (33%) 150 (60%)200 (67%) 100 (40%)300 (100%) 250 (100%)PosttestCOMPARIS<strong>ON</strong>Pre-test Post-test100 (33%) 125 (50%)200 (67%) 125 (50%)300 (100%) 250 (100%)Ideally, the scores on the pre-test are the same for interventionand comparison groups. This means that you have selected agood match of both groups. They all have equal starting points.In reality this is not always the case, but by careful (random)selection of the respondents, you can influence this.Monitoring & Evaluation ToolAppendices 84
The table above shows that the score for the post-test is higherfor the intervention group than for the comparison group.This means that the programme has influenced the youngpeople who have participated in the programme. This resultsin the following graph.100806040200PretestIntervention groupComparison groupPosttestNote that the results from this kind of analysis (without doingsignificance tests and with a small sample not larger than100 respondents) have to be interpreted very carefully, andeffectiveness cannot simply be claimed if you find a 10%increase in knowledge or skills.If there are hardly any results or if the comparison groupchanges more positively than the intervention group, oneshould analyse why this is the case. Some reasons can bethat the design of the study was not good enough, or that theimplementation of the programme was not of good quality,or influences from the social environment were so strong thatlittle change was possible in the target group.Monitoring & Evaluation ToolAppendices 85
Page 1 and 2:
ARE YOUON THERIGHTTRACK?SIX STEPS T
Page 3:
ARE YOU ON THERIGHT TRACK?SIX STEPS
Page 7 and 8:
ACKNOWLEDGEMENTSThis workbook was d
Page 9:
HOW TO USETHIS WORKBOOKDo you work
Page 13 and 14:
Ethical aspects of outcome M&EWhen
Page 15 and 16:
7. SKILLSAll skills that are needed
Page 17:
A process evaluation can be done fr
Page 20 and 21:
WorksheetSix steps to design your o
Page 22 and 23:
BEHAVIOUR(B)Intention(I)KNOWLEDGE(K
Page 24 and 25:
Step 3: What questions do youselect
Page 26 and 27:
Step 5: How will youdraw your concl
Page 28:
Extra information you would like to
Page 31 and 32:
BEHAVIOUR(B)KNOWLEDGE(K)RISK PERCEP
Page 33 and 34:
The pre-test can best be done two t
Page 35 and 36: Select the respondentsIf you implem
Page 37 and 38: Capicity inorganisationPretest /Pos
Page 39 and 40: 1.Qualitative/quantitative datacoll
Page 41 and 42: Tool 4: Observation FormThe Observa
Page 43 and 44: Step 4: How will the databe collect
Page 45 and 46: Step 5: How will youdraw your concl
Page 47 and 48: Checking validity and reliabilityWh
Page 49: In a meeting, the findings and conc
Page 52 and 53: Appendix 1: Determinant objectivesB
Page 54 and 55: BEHAVIOUR(B)INTENTION(I)KNOWLEDGE(K
Page 56 and 57: BEHAVIOUR(B)INTENTION(I)KNOWLEDGE(K
Page 58 and 59: QUESTIONSRATINGnot at all not reall
Page 60 and 61: General questions1. Age of all resp
Page 62 and 63: Tool 2 - Interview guide for young
Page 64 and 65: Attitude38. Do you think it is poss
Page 66 and 67: Tool 3 - Interview/focus group disc
Page 68 and 69: Questions about the educators30. Wa
Page 70 and 71: 14. Identify the teaching strategy
Page 72 and 73: Appendix 3b: Quantitative data coll
Page 74 and 75: 9. Is homosexuality a disease?YesNo
Page 76 and 77: 28. How can one avoid situations wh
Page 78 and 79: Completing this questionnaire is en
Page 80 and 81: To what extent do you agree with th
Page 82 and 83: How confident do you feel about doi
Page 84 and 85: Appendix 4: Suggestions for entry a
Page 88 and 89: Appendix 5: Outline for a reportThe
Page 90 and 91: REFERENCES1 International Planned P
Page 92: Do you work for an organisation in
show all

ARE YOU ON THE RIGHT TRACK? - Rutgers WPF

You also want an ePaper? Increase the reach of your titles

Delete template?

Save as template?