Primary Education Survey Evaluation Report Somalia - Somali - JNA

PES Evaluation Report, 2008
In addition, the performance of enumerators and supervisors should be evaluated during the data
collection phase by independent assessors, a report given to the staff member and this used as a basis for
reemployment in the process the following year. One zone moved data collecting teams across regions
where they were supervised by a different REO each year. In this way a more independent system of
monitoring was created since over familiarity and old friendships could not influence work practice.
Such a system could be considered by other zones.
In undertaking the above recommendation it is necessary to remember the recommendation made above
of conducting the data collection in a supportive environment. It needs to be remembered that these
people are working in an environment where capacity is low and a major focus of the work is to develop
that capacity. Hence, in implementing these proposals it is necessary to ensure that all staff are supported
to develop the necessary skills and attitudes, are given support when needed and are encouraged to seek
advice and support without fear of dismissal. Thus, it is imperative that a fine balance is recognised
between commitment to quality and commitment to capacity development.
It is worthwhile to make a note with regard to the future use of enumerators and supervisors as they are
currently conceived. The more standard process for collecting data in an EMIS process is for head
teachers to take responsibility for completing data forms and returning them to district/regional office.
Currently this would be difficult to achieve due to the poor communication and transport infrastructure in
many areas of Somalia. As noted in an earlier section, a quality assurance and systematic monitoring
structure has to be established before such data collection strategies can be used effectively. As capacity
is developed and infrastructure built it is suggested that a more economic data collection system be
developed. This could be achieved by abolishing the enumerator/supervisor structure and replacing it with
an EMIS officer located in each regional office and head teachers be empowered to complete update of
data forms along with subsequent data collection processes in the form of term or semester reports.
3.2 Recommendations
a. That the enumerators/supervisor position be competitively attained. It would be advisable to
include more than the required number in the training process and only the best included in the
data collection phase.
b. That the performance of enumerators and supervisors be evaluated during the data collection
phase by independent assessors using predefined competencies.
c. That REOs be rotated across data collecting teams and thus create a more independent system of
monitoring.
d. That a fine balance is recognised between commitment to quality and commitment to capacity
development.
e. That as capacity is developed and infrastructure built the enumerator/supervisor structure be
abolished and replaced with an EMIS officer located in each regional office and head teachers be
empowered to complete update of data forms along with subsequent data collection processes in
the form of term or semester reports.
4 Timing
4.1 Findings and Analysis
In making comments with regard to the timing of data collection there are two areas in which
considerations need to be made. One is the impact of timing on the data collection process, and the
second is the suitability of timing of data collection for the process of collecting data and providing
reports in a timely manner to ensure the maximum use of the data can be made and to help in avoiding the
necessity for data duplication. By data duplication it is meant the need for people to pick up data in a
parallel system that is also collected in the PES. Firstly, the impact of timing on the data collection
process is considered. While it might not be possible to avoid all data duplication, a well designed EMIS
process will attempt to minimise the need for data duplication.
The current data collection process is undertaken in late April and May. The plan is for data to be
collected over a two week period, but there are often delays and disruption to the process. This results in
20