How to Evaluate - York Consulting

Oldham and Rochdale HMREvaluation Techniques “How to Evaluate”Diagram 4: Evaluation MethodologiesHighCOSTFOCUS GROUP group discussion co-ordinated byan experienced facilitator using atopic guide ideal for getting under thornyissues and working with vulnerablegroups usually last about 45–90 minutes require careful unbiased analysisand reporting mood board sessions and scenariotesting can be incorporated withintheseCONSULTATIONIn-depth interviews, usuallyaround a topic guideAllow flexibility and iterativelearning through theresearchBest suited for companies ofpartner organisationsBENCHMARKING Method of comparingprojects or organisations Requires careful thoughtabout what is beingcompared Can help to generatenew ideas or confirmexisting practiceFACE TO FACE SURVEYDetailed interview based around closedand open questions open questions can be more difficult toanalyse Ideal for exploring complicated orsensitive issues e.g. individualperceptions and experiences Work best with individuals length between 15 & 45 minutes Very expensiveTELEPHONE SURVEY Less detailed than face to faceinterviews, mainly closedquestions Popular and cost effectivemethod of achieving a robustsample Length approx 15-20 minutes Works best with individualswith limited time, but who areuseful to have engaged in theevaluationCASE STUDIESA researcher gains a detailed understanding of aspecific case by talking to the individual andthrough wider researchA useful approach to gaining an understanding ofspecific issuesHighly qualitative but provides specific examplesAn alternative to this is ‘story-telling’ where anindividual or beneficiary is asked to describe intheir own words their experiencePOSTAL SURVEYQuality of information sometimespoorresponse rates can be as low as5% if no prior contact withrespondents best used when a relationshipalready exists with respondent quality of self completionquestionnaire is very importantLowQualitativeRESEARCH APPROACHQuantitative27