Measuring Achievements of Private Sector Development in ... - DCED

Measuring Achievements of Private Sector Development in Conflict-Affected Environments
means that selecting an appropriate sample can difficult. Census data must in some cases be collected
directly. Further, randomization can increase costs and complexity. In Liberia, for instance, random
selection of project sites requires the project to work across areas using two different languages and
with significant distances between sites. This is particularly an issue when seeking to measure changes in
conflict at a community level rather than an individual level: having a sufficiently large sample for
randomization would require working in several hundred villages. Another consideration in using a
randomization approach in CAEs is that making changes to project strategy – a more frequent necessity
in such environments – can compromise the findings of the RCT. There is also a risk that randomization
can exacerbate the conflict by creating resentment among control groups members of the treatment
group. IRC’s experience suggests that this latter challenge can be overcome by being open and
transparent about the process of selecting project clients. 63 Still, randomization approaches require
highly trained staff and high costs, and will not be realistic for most projects.
In summary, there are several approaches to assessing attribution. The most appropriate combination of
approaches will vary based on the nature of the intervention and capacity of the implementing team.
4.2 Key resources
Mayne, John. Contribution Analysis: An approach to exploring cause and effect, 2008.
introduction to Contribution Analysis.
A short
Catley, Andrew et al, Participatory Impact Assessment - A Guide for Practitioners, Feinstein
International Centre, 2008
OECD. Evaluating Peacebuilding Activities in Settings of Conflict and Fragility: Improving Learning for
Results. Provides guidance on assessing attribution in the evaluation of peacebuilding activities.
Sen, Nabanita. Attribution: Measuring Attributable Change Caused by a Programme. A brief,
accessible outline of how to estimate attribution when applying the DCED Standard.
Stern, Elliot et al. Broadening the Range of Designs and Methods for Impact Evaluations. Addresses
the issue of attribution in depth, looking at the role of mixed methods and theory-based approaches to
assessing attribution.
5 Capturing Wider Changes in the System or Market (Control Points
5.1)
Systemic change refers to “[c]hanges in market systems and the structures, such as government and civil
society, that support markets that cause sustainable shifts in the way those market systems and
structures operate, for example, changes in relationships within and among both private enterprises and
public agencies, in incentives and in market support structures. Systemic change causes widespread
indirect results such as crowding in, copying, enterprises shifting sectors and changes in enterprise start-
63 DFID, Interim Guidance Note: Measuring and Managing for Results in Fragile and Conflict-Affected States and
Situations, Undated, 38.
Practical Guidelines for Implementing the DCED Standard. Version 2, July 2013
36