The Matrix System at Work - Independent Evaluation Group - World ...
The Matrix System at Work - Independent Evaluation Group - World ...
The Matrix System at Work - Independent Evaluation Group - World ...
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
APPENDIX F<br />
FOCUS GROUP DISCUSSIONS: THE KEY FINDINGS<br />
5. Focus group participants expressed concern with the rel<strong>at</strong>ive isol<strong>at</strong>ion of country<br />
office-based staff and locally recruited staff in particular. Most strongly believe th<strong>at</strong><br />
“if you are based in a country office, you are on your own.”<br />
6. All agreed th<strong>at</strong> only a small fraction of the knowledge produced is actually<br />
relevant to and used in project design. Some suggested the sheer amount of<br />
inform<strong>at</strong>ion to process was to blame; others argued th<strong>at</strong> knowledge produced tends<br />
to be supply-driven, r<strong>at</strong>her than demand-driven, and rarely origin<strong>at</strong>es directly from<br />
the field. <strong>The</strong>re was broad consensus th<strong>at</strong> knowledge production in the field is<br />
underfunded and th<strong>at</strong> the need to rely on trust funds leads to a non-str<strong>at</strong>egic whole<br />
as well as major inefficiencies.<br />
STRATEGY<br />
7. According to the focus groups participants, Bank-wide str<strong>at</strong>egies play a limited<br />
to nonexistent role in analytical and advisory activities (AAA) and lending<br />
oper<strong>at</strong>ions. One noted th<strong>at</strong> he was unaware of the existence of his sector’s str<strong>at</strong>egy<br />
for years, yet prepared projects nonetheless. Another argued th<strong>at</strong> since str<strong>at</strong>egy<br />
papers reflect emerging Bank knowledge <strong>at</strong> the time they are drafted, their<br />
prescriptions simply cannot find their way into country programs either explicitly or<br />
implicitly.<br />
INCENTIVES AND ACCOUNTABILITY FOR QUALITY<br />
8. Regarding lending oper<strong>at</strong>ions, participants argued th<strong>at</strong> more should be done <strong>at</strong><br />
the concept note stage to address technical issues instead of focusing on the quality<br />
of documents and the ne<strong>at</strong>ness of procedures. Technical issues should in any case be<br />
addressed before the oper<strong>at</strong>ional committee (OC) or decision meeting stage since<br />
“once things are <strong>at</strong> the OC stage, (…) very little can be done.”<br />
9. Quality assurance for large economic and sector work (ESW) was described as<br />
strong and “rigorous <strong>at</strong> the concept note stage and <strong>at</strong> delivery.” <strong>The</strong>re are, however, no<br />
formal quality assurance systems for just-in-time notes and non-lending technical<br />
assistance (with the possible exception of those in place in Europe and Central Asia).<br />
Quality therefore varies widely: some products’ quality rivals th<strong>at</strong> of large ESW<br />
reports; others are produced in under a week, largely copying and pasting text from<br />
other sources.<br />
10. Senior staff insisted strengthening peer review processes should be the basis for<br />
improvements to quality assurance for small ESW reports and non-lending technical<br />
assistance. As is, peer reviewers are often selected by team leaders and they do not<br />
expect their suggestions (and criticisms in particular) to be taken on board.<br />
11. Also, according to focus group participants, concentr<strong>at</strong>ion of budget decisions<br />
with the country director sometimes conflicts with str<strong>at</strong>egic selection and quality of<br />
174