Primary Education Survey Evaluation Report Somalia - Somali - JNA

PES Evaluation Report, 2008
1.2 Recommendations
a. That expansion of the data collected take place to provide for a full set of EFA and MDG
indicators.
b. That systematic recording of school outcome data should be undertaken to facilitate judgments
about school quality.
c. That a criterion referenced approach to school outcomes be adopted that allows the recording of
the percentage of students who have achieved a set of defined outcomes.
d. That the number of grade 1 enrolments who have attended Qur’anic school and ECD be recorded.
e. That Qur’anic status of Qur’anic schools offering an integrated hybrid curriculum be recorded.
f. That a more precise analysis of out of school children be undertaken to investigate the underlying
issues of out of school children. This should be a study separate from the EMIS.
g. That school condition data be collected with the caveat that it will need to be interpreted with
caution.
h. That proxy indicators such as lesson types used regularly, or use of corporal punishment in last
month that reflect degree of child friendliness be considered.
i. That some key resources that are commonly available and for which there is money or a donor
ready to provide be recorded.
j. That the data collected include an expanded view of non-formal curriculum components.
k. That a data on emergency risk and emergency preparedness be considered.
l. That the priority list for data expansion be adopted.
m. That NGOs and other agencies be given regular opportunities to contribute to the data design
process.
2 Reporting
2.1 Findings and Analysis
In this section comment will be made with regard to two separate aspects of reporting. The first is
comment with regard to the Draft report from the 2006/2007 survey, which has not as yet been published.
The second draws upon findings with regard to the use of the Data and the EMIS conceptual framework
that indicated the EMIS is a process that requires movement of information both up and down within the
system. A significant development this year has been the use of Access data base to store the data. This
will improve flexibility and accessibility for investigating emerging issues and challenges. More comment
on the potential of this data base in made below, but first the draft 2006/7 report is considered.
The nature of reporting from the survey has been explored. The draft PES report that has been analysed
seems to be opaque, poorly constructed and contains many inaccuracies. These inaccuracies have
occurred in the extraction of data from the data base and in the subsequent analysis. A few of the
apparent errors are listed here to illustrate the point.
• Paginations are not consistent with contents table
• Headings of unnumbered tables on pages 19 to 23 refer to the wrong year
• Total enrolment figure for North West region on page 19 is 124117. It should be 115999. 115999
is used elsewhere in the report and is consistent with the data in the Access data base.
• The difference above leads to inconsistent reporting of total enrolment figures across the report
(392101 versus 383983).
• Annex 7 uses a total enrolment of 318159, when a check reveals it should be 383983. (An earlier
version of annex 7 which had some major inaccuracies has, fortunately, been extensively
modified in the current draft of the report)
• Percentage change figures are sometimes incorrect or do not use a negative sign to differentiate
between directions of change
• Gross Intake Ratio is inappropriately defined
• Survival rates are not consistent with EFA definitions
32