03.11.2014 Views

The Matrix System at Work - Independent Evaluation Group - World ...

The Matrix System at Work - Independent Evaluation Group - World ...

The Matrix System at Work - Independent Evaluation Group - World ...

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

APPENDIX F<br />

FOCUS GROUP DISCUSSIONS: THE KEY FINDINGS<br />

5. Focus group participants expressed concern with the rel<strong>at</strong>ive isol<strong>at</strong>ion of country<br />

office-based staff and locally recruited staff in particular. Most strongly believe th<strong>at</strong><br />

“if you are based in a country office, you are on your own.”<br />

6. All agreed th<strong>at</strong> only a small fraction of the knowledge produced is actually<br />

relevant to and used in project design. Some suggested the sheer amount of<br />

inform<strong>at</strong>ion to process was to blame; others argued th<strong>at</strong> knowledge produced tends<br />

to be supply-driven, r<strong>at</strong>her than demand-driven, and rarely origin<strong>at</strong>es directly from<br />

the field. <strong>The</strong>re was broad consensus th<strong>at</strong> knowledge production in the field is<br />

underfunded and th<strong>at</strong> the need to rely on trust funds leads to a non-str<strong>at</strong>egic whole<br />

as well as major inefficiencies.<br />

STRATEGY<br />

7. According to the focus groups participants, Bank-wide str<strong>at</strong>egies play a limited<br />

to nonexistent role in analytical and advisory activities (AAA) and lending<br />

oper<strong>at</strong>ions. One noted th<strong>at</strong> he was unaware of the existence of his sector’s str<strong>at</strong>egy<br />

for years, yet prepared projects nonetheless. Another argued th<strong>at</strong> since str<strong>at</strong>egy<br />

papers reflect emerging Bank knowledge <strong>at</strong> the time they are drafted, their<br />

prescriptions simply cannot find their way into country programs either explicitly or<br />

implicitly.<br />

INCENTIVES AND ACCOUNTABILITY FOR QUALITY<br />

8. Regarding lending oper<strong>at</strong>ions, participants argued th<strong>at</strong> more should be done <strong>at</strong><br />

the concept note stage to address technical issues instead of focusing on the quality<br />

of documents and the ne<strong>at</strong>ness of procedures. Technical issues should in any case be<br />

addressed before the oper<strong>at</strong>ional committee (OC) or decision meeting stage since<br />

“once things are <strong>at</strong> the OC stage, (…) very little can be done.”<br />

9. Quality assurance for large economic and sector work (ESW) was described as<br />

strong and “rigorous <strong>at</strong> the concept note stage and <strong>at</strong> delivery.” <strong>The</strong>re are, however, no<br />

formal quality assurance systems for just-in-time notes and non-lending technical<br />

assistance (with the possible exception of those in place in Europe and Central Asia).<br />

Quality therefore varies widely: some products’ quality rivals th<strong>at</strong> of large ESW<br />

reports; others are produced in under a week, largely copying and pasting text from<br />

other sources.<br />

10. Senior staff insisted strengthening peer review processes should be the basis for<br />

improvements to quality assurance for small ESW reports and non-lending technical<br />

assistance. As is, peer reviewers are often selected by team leaders and they do not<br />

expect their suggestions (and criticisms in particular) to be taken on board.<br />

11. Also, according to focus group participants, concentr<strong>at</strong>ion of budget decisions<br />

with the country director sometimes conflicts with str<strong>at</strong>egic selection and quality of<br />

174

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!