Evaluating Country Programmes - OECD Online Bookshop

Evaluating Country Programmes
202
Box 8.3. Basic evaluation issues
It is essential to define the questions which will be addressed in the evaluation –
these are often referred to as the “issues” of the evaluation. The issues will provide a
manageable framework for the evaluation process and the basis for a clear set of conclusions
and recommendations. The following are basic groups of evaluation issues:
Rationale. Does the undertaking make sense? Are the objectives relevant and
realisable? Should alternative objectives be considered?
Objectives achievement. Evaluation is very difficult unless the objectives which the
evaluated project/programme was to achieve have been clearly defined and the
project agreements and operational plans and arrangements for obtaining relevant
baseline data have been made. To what extent were the original objectives
achieved? Or are likely to be achieved? What were the major factors influencing the
achievement or non-achievement of objectives? Should objectives not have been
stated clearly enough to allow for an evaluation of goal achievement, an assessment
of impact and effects of the activities undertaken should still be attempted.
Impacts and effects. What has happened as a result of the project/programme?
This involves not only direct outputs but, very importantly, the basic impacts and
effects on the social, economic, environmental and other development indicators
resulting from the activity. The examination should be concerned with both
intended and unintended results, and must also explain the positive and negative
impact of external factors, such as changes in basic policy environments, general
economic and financial conditions.
The aim of asking these questions is to ensure that the evaluator can assess the
information and formulate conclusions and recommendations concerning:
The overall results. How successful was the undertaking? Why? Do impacts and
effects justify costs? Were the objectives achieved within time and within the budget?
Were there any major shortcomings? Were there major achievements?
Sustainability. The question of whether achievements are sustainable in the
longer run is of critical importance.
Alternatives. Are there better ways of achieving the results?
Lessons learned. What are the general lessons which can be drawn and which
should be borne in mind when embarking on future programmes?
Source: OECD, Development Assistance Manual, DAC Principles for Effective Aid, Paris 1992,
pp. 136-137.
of country programmes of German development co-operation can be specified as
follows:
– Rationale of the country programme: One of the main tasks of the BMZ’s country
concepts is to formulate the rationale of the engagement of German development
co-operation in a partner country or, more precisely, in the priority
OECD 1999