PPDVP Evaluation Report - Pacific Prevention of Domestic Violence ...

More documents

Recommendations

Info

efficiency, and sustainability. It will also address whether the activity provided value for money, andpotential savings through different design, methodology, and resource allocation.Exclusions: The evaluation will not consider impact as it is too soon to assess programme impacts.The non-participating PlCs are largely excluded from the focus of this evaluation (apart from anassessment in relation to overall value for money) as the PPDVP has primarily focused on 5participating PlCs and assessments of the other 14 PlCs would require a more expensive and timeconsumingevaluation.Stakeholders:This programme has a large number of primary stakeholders who have been directly involved with,or benefitted from, the implementation of the project. These include the donor (MFAT); thecontract holder (NZ Police); PPDVP programme staff (including mentors); police services in each ofthe participating & linked countries, and the additional countries under Objective 1; and the PacificIslands Chiefs of Police; victims of domestic violence (note: these benefit primarily from theprogramme's outcomes rather than its activities).The programme also has a large number of secondaw stakeholders at national and regional levelwho have been involved or benefitted, less directly. These include: victims of domestic violence (seenote in previous paragraph); in-country and regional organisations working with victims of domesticviolence, or undertaking advocacy on domestic violence; other bilateral and regional policingprogrammes in the PICs; police services in non-participating countries; judiciary and legal professioni n-country; other regional and bilateral law &justice sector programmes; other donors.Methodology:The evaluation will be primarily desk-based, with a short field visit to one country, and standardevaluation and social science techniques will be used. The main methods used in the evaluation willbe the review of existing project documentation and other relevant documents; and qualitativemethods such semi-structured interviews with key informants and/or electronic surveys. (Both openand closed questions will be used for gathering information as this will enable many of the responsesto be easily coded and analysed but still make allowance for a range of responses.) The interviewtopics cover the same areas as the questionnaire but enable the evaluator to interact with therespondent and probe for more in-depth responses. Where possible, the evaluation will also utilisestatistical data (for example from in-country CMlS reports).ldentiflcation of specific respondents for interviews and questionnaires will be done in consultationwith MFAT's programme manager, PPDVP Programme Manager, NZ Police mentors, MFATIPoststaff.The priority in-country contacts for phone calls will be: Police Commissioner; Head of DV Unit; and avictim support organisation, For face-to-face interviews in the Cook Islands this list will be expandedto include some of the following the Police Commissioner (who is also a member of the bilatera! CIPolice project management committee), Senior Sponsor of the PPDVP, police training officer orequivalent, government agency with lead role on DV, one or more other police personnel, anotherNGO or church/community representative with active engagement in victim support or addressingdomestic violence. While in Cook Islands there will also be face-to-face interviews with PIC judiciarymembers from 4 of the PPDVP participating countries (aside from Kiribati), who are attending a PJDPmeeting. Regional priorities for phone contact will be RRRT or FWCC, and AFP-PPDP.Questionnaires will be sent to this group of respondents, and to a second group. The second groupof PIC respondents will be selected from: another member of DVU, Senior Sponsor of the PPDVP orPPDVP Evaluation Report Page 45
other Senior Police, Police Training Officer or equivalent; member of the NDVPC or ExternalStakeholders Group; other victim support NGOs; relevant government agencies; the Solicitor-General and/or Attorney-General; other regional agencies especially those represented on PPDVPRAt, and/or which are implementing complementary projects.Q~stionnaires will also be sent to a selection of NZ-based respondents: NZ Police, PPDVP staff, NZPrnentors for the PPDVP, PlCP Secretariat, and several MFAT staff who have had close engagementwith the PPDVP eg DPM, M&E Advisor, Finance & Budget Manager. There will also be face-to-face ortelephone interviews with a number of these NZ-based respondents.Data /information collection methods1: Review of a range of existing data sources (including Project Design Document, Annual WorkPlans & Reports, mentors' visit reports, RAC minutes, MOUs, policy documents, baseline studies andupdates, and other published research eg SPC studies, NCWC reviews).2. Semi-structured, face-to-face or phone interviews using a set of key questions to guide theinterview. These will be preceded by initial email contact explaining the purpose of interview andhow the information will be used, the topics to be discussed, and attaching an edited TOR".a: Face-to-face or telephone interviews with relevant MFAT/Post staffb: Face to face or telephone interviews with PPDVP personnel (including staff,mentors, some RAC members) and with relevant NZ Police & PlCP personnel and AFP (CBA)personnelc: Telephone and face-to-face interviews with a sample of Pacific-based stakeholders(estimated 20 persons)d: Face-to-face interviews with members of PJDPfs PEC during evaluator's field trip toCook Islands, which coincides with PEC meetinge: Cook Islands staff (see 2a above)3. Electronic questionnaire to the people identified for interview plus an additional group of upto 20 other stakeholders. The questionnaire will be accompanied by an explanation of the purposeof the questionnaire and how the information will be used, and an edited TOR will be attached.Cross-checking of informationInformation will be gathered from document review, questionnaires, and semi-structuredinterviews. This will be assessed to see the extent to which the information coincides or differs. Inaddition, material from a selection of documents for the same time period will be cross-checked,and assessed to see the extent to which it coincides or differs.Where it seems necessary -check back with relevant MFAT and/or PPDVP stakeholders to clarifyissues or discuss the evaluator's understandings and findings, and verify the correctness ofassumptions or judgements made by cross-checking with other sources (including primary sources),during analysis phase after information collection.Data analvsisInterview notes and questionnaire responses will be collated in a series of matrices, and much of thedata gathered through qualitative methods will be quantified during the analysis. Material fromdocuments will be compared across a sample of years, and across a sample of documents from thesame year, using a matrix.his was discussed with MFAT's programme manager. The TOR were shortened for ease of electronictransferPPDVP Evaluation Report Page 46
Page 1 and 2:
Independent Evaluation ReportPacifi
Page 3 and 4:
I(EXECuTIVE SUMMARYBackground1. The
Page 6 and 7: Cook Islands:18. Evidence from the
Page 8 and 9: In-Cduntry Governance Systemsso. Th
Page 11 and 12: ContentsWECUTIVE SUMMARY ..........
Page 13 and 14: to the effectiveness of the partici
Page 15 and 16: for studies on the economic and dev
Page 17 and 18: this point." Expectations in the PP
Page 19 and 20: the development of the national pol
Page 21 and 22: Samoa52. The PPDVP has played a men
Page 23 and 24: e reported because of extensive edu
Page 25 and 26: Summy from questionnaires:Effectrve
Page 27 and 28: some countries supporting NGOs to i
Page 29 and 30: 112. Police Commissioners have stat
Page 31 and 32: I-earning. The regional work has be
Page 33 and 34: 133. The PPDVP is considered, by a
Page 35 and 36: 1 inked countries, and with regiona
Page 37 and 38: to family violence and other forms
Page 39 and 40: Outline Desinn for Follow-up PhaseG
Page 41 and 42: @Innex One:Glossary of acronymsAFP
Page 43 and 44: Annex Three: Summary of Questionnai
Page 45 and 46: Annex Four:Goal & Objectives of the
Page 47 and 48: eport to the NZ Police contract man
Page 49 and 50: Relevance:2. Is the PPD'J'P and the
Page 51 and 52: adviser. This will involve approval
Page 53 and 54: ComponentObjective1234To increase p
Page 55: Annex Six:Evaluation PlanBackground
Page 59 and 60: The Screening Guide for Mainstreame
Page 61 and 62: Does your countv have a National Do
Page 63 and 64: Effectiveness:5 What changes have y
Page 65 and 66: violence in the participating count
Page 67 and 68: Lina ChangMaara TetavaManakovi Pahu
show all

PPDVP Evaluation Report - Pacific Prevention of Domestic Violence ...

Create successful ePaper yourself

Delete template?

Save as template?