Monitoring and Evaluation Modules - Global HIV M&E Information

More documents

Recommendations

Info

Ensure the system is tested, refined and fully implemented. The consultant will work with NAC to field-test and refine the entire M&E system. He/she will then ensure that the systems are fully implemented for at least three months before NAC assumes sole responsibility for coordinating M&E. Specify next steps. The consultant will then present a detailed plan outlining further steps that NAC must take in order to continue to consolidate M&E, including mechanisms that NAC can use to ensure that the plan is updated through regular feedback and consultative processes, as required. 4.3. Terms of reference for specialized programme activity monitoring entity 4 • Prepare an overall, annual monitoring and evaluation plan • Prepare technical specifications for each monitoring and evaluation component and contract external agencies to manage each component MODULE Monitoring & Evaluation Management Tools • Collect, enter and analyse implementing partner programme monitoring data on a regular basis • Supervise the quality and timeliness of contracted monitoring and evaluation products • Review contracted monitoring and evaluation products, distil and communicate their implications for programme implementation, including modifications in geographic priorities, target groups, interventions and implementing partners • Verify the internal consistency and validity of service delivery data reported by NAC implementing partners, through at least six-monthly visits • Assess the quality of implementing partners’ services, using agreed quality assurance checklists, through at least six-monthly visits • Cross-validate programme and financial data, to increase confidence in both data sources • Develop a simple, management Access database, that can be shared widely and used for further analyses • Assist NAC in identifying implementing partners whose performance is exemplary and may serve as a positive example, and implementing partners who are underperforming, for whom corrective actions will be suggested • Prepare six-monthly programme monitoring reports, containing summary data, reviewing overall performance against targets and making overall programme recommendations, including recommendations to improve both programme performance and programme monitoring and evaluation. 4.4. Outline evaluation plan This outline is meant to assist programme managers in preparing terms of reference for different types of evaluations: process evaluations or mid-term reviews, outcome evaluations, and institutional evaluations. 30
4.4.1. Background The background section should include: • the purpose of the programme/project • the target audience: primary and secondary beneficiaries • the geographical areas covered by the programme/project 4.4.2. Objectives and scope of the evaluation It is recommended that evaluations be guided by the Development Assistance Committee (DAC) criteria of relevance, effectiveness, efficiency and sustainability stated in the DAC principles for evaluation of development assistance 1 . Depending on the type of evaluations, not all the principles need to be applied. However, all evaluations should make recommendations on issues covered for improved performance as well as providing details of key lessons learnt for future similar projects. • Relevance: The extent to which the objectives of a programme/project are consistent with country and direct beneficiaries’ needs. (1) To what extent were/are the objectives of the programme/project (still) valid? (Relevance of the programme/project to the country’s needs and target group.) (2) Are the activities of the programme/project consistent with the overall goal and the attainment of its objectives? (3) Are the activities of the programme/project consistent with the intended impacts and effects? • Effectiveness: The extent to which a programme/project has achieved its objectives. (1) To what extent did the project meet its stated objectives? (2) What were the major factors influencing the achievements or non-achievement of the objectives? (Barriers to implementation, and facilitating factors.) • Efficiency: The extent to which the inputs (funds, expertise, time, etc.) were converted to outputs economically. It looks at the least costly resources possible to achieve the desired results. This generally requires comparing alternative approaches to achieving the same outputs to see whether the most efficient process has been adopted. (1) Were activities cost-efficient? (Direct support versus outsourcing; relevance of skills required for a given activity.) (2) Were objectives achieved on time? (3) Was the programme/project implemented in the most efficient way, compared to alternatives? 4 MODULE Monitoring & Evaluation Management Tools • Impact: The positive and negative changes produced by a programme/project directly or indirectly, intended or unintended. This involves the main impacts and effects resulting from the programme on the local social, economic, environmental and other development indicators. 1 The DAC Principles for the Evaluation of Development Assistance; OECD (1991) 31
Page 1 and 2: Monitoring and Evaluation Modules B
Page 3: Table of Contents Basic Monitoring
Page 7 and 8: This module introduces basic monito
Page 9 and 10: Table 2: M&E components Overall sys
Page 11 and 12: 1.5. Responsibilities of key M&E ac
Page 13: APPENDIX 1 USEFUL SOURCES FOR M&E G
Page 17 and 18: This module focuses on the steps to
Page 19 and 20: 2.3.2. Establish an M&E Reference G
Page 21 and 22: APPENDIX 1 ILLUSTRATIVE TIME FRAME
Page 23: Optimizing the Use of Monitoring an
Page 26 and 27: 3 (6) Data should be collected as f
Page 28 and 29: 3.3. Set up mechanisms for efficien
Page 31: Monitoring & Evaluation Management
Page 36 and 37: (1) What has happened as a result o
Page 38 and 39: APPENDIX 1: KEY M&E SOURCES The new
Page 41 and 42: This module informs the readers abo
Page 43 and 44: • The DoC is a unifying and motiv
Page 45 and 46: Two indicators on the prevalence of
Page 47 and 48: Conclusion Meeting the goals and ta
Page 49 and 50: APPENDIX 1 Core indicators for DoC
Page 51: National Composite Policy Index (Na
Page 55 and 56: The purpose of this module is to fa
Page 57 and 58: • mobilizing resources for M&E, e
Page 59 and 60: APPENDIX 1 UNAIDS MONITORING AND EV
Page 61: 11. In the event that a MERG member

Monitoring and Evaluation Modules - Global HIV M&E Information

Create successful ePaper yourself

Delete template?

Save as template?