Evaluation of the Maghreb Regional Training Programme - Indevelop

2 Methodology
The evaluation methodology has followed the five evaluation criteria as prescribed by
the ToR, including the specific questions: i) Efficiency, ii) Effectiveness, iii) Ownership,
including project management, iv) Cross cutting issues and sustainability, and v)
Main lessons learned and continued cooperation. For an overview of the ToR see annex
1. These five evaluation criteria also constitute the outline of the report.
The methodology consisted of six logical steps in order to collect information,
cross examine data and analyse the results of the assistance to the public employment
services (PES) in the three countries. The analysis also includes an overall judgement
of the regional character of the training programme.
Step 1: Inception phase: document review, interviews with representatives of Sida
and AF in Stockholm. Preparation of the field work, including development of a
questionnaire.
Step 2: Country field visits. Meetings with PES representatives in Tunisia and Morocco,
donors and international organisations in country as well as in their respective
headquarters.
Step 3: Analysis and data review based on step 1 and 2 in order to prepare the first
draft of the report.
Step 4: Sida and other stakeholders provided comments after which the team will
draft the final report.
Step 5: The final report will be submitted to Sida for approval after which the team
will translate the report into French.
Step 6: A workshop in Sweden with representatives of the three PES and other interested
stakeholders will be organised to discuss future cooperation. The evaluation
report will be used as a point of departure for the discussions.
The team prepared an evaluation matrix and included several questions on relevance
which were not part of the ToR. This would permit the team to evaluate the
programme based on the five OECD-DAC criteria. The matrix was translated into
French. The team started with interviewing representatives of Sida and Arbetsförmedlingen
based on this matrix and the ToR questions. In addition, the team
started preparation for field visits and made contact with the different representatives
in the three countries to agree on a time schedule for the visits and identify persons to
be interviewed.
Both team members visited Tunisia and met with beneficiaries, government officials
and donors. One team member continued the field work in Morocco and met
with beneficiaries and government officials. A third country visit to Algeria was prepared
but the administrative procedures to obtain a visa took longer than expected and
8