Evaluating Country Programmes - OECD Online Bookshop

OECD 1999
Country Assistance Evaluation in the Multilateral Development Banks
Box 5.4. “Evaluability” of strategies
In examining a number of IDB country strategies, the Evaluation Office study
attempted to determine whether:
1. The strategy contained the necessary measurable indicators of implementation
and performance results.
2. The development challenges identified in each strategy were supported by
current economic and social indicators.
3. The bank’s project responded to the development challenges identified in the
strategy; and whetherThe bank duly consulted with authorities of the borrowing
countries.
An “evaluability” profile was prepared addressing seven areas of issues:
1. The strategic goal and operational objectives of the strategy.
2. The focus of the strategy.
3. Developmental challenges identified for the country.
4. The consultative process.
5. Risks associated with the strategy.
6. Linkages with other activities in the institution and with other donors; and
7. Lessons learned.
forward-looking self-evaluation can complement the more traditional retrospective
ex-post evaluation. The key ingredient is the development of operationally
meaningful, easily monitorable indicators and progress benchmarks that can be
assessed on a regular basis. The first stage in this framework is ex-post evaluation in
the preparation of the new strategy. This involves examining the institution’s track
record in implementing previous strategies, drawing from past lessons learned, and
building specific targets, benchmarks and indicators for measuring both the country’s
and the Bank’s progress in meeting the goals and objectives. The second stage
involves ongoing monitoring and assessment by both the client and the institution
of the extent to which country performance is in line with agreed targets and benchmarks.
This could be part of the portfolio monitoring process. The third stage
involves traditional retrospective evaluation of the strategy after its completion via
the institution’s normal evaluation process.
Institutions need to enhance the monitoring of strategy progress and forward-looking selfevaluation
in the course of carrying out its country programme so as to complement its retrospective
evaluation, to strengthen the strategy and programme process and to facilitate adjustments in their
lending and non-lending programmes.
153