Compendium of Country Examples and Lessons Learned from ...

Part II:Performance & compliance indicatorsPart II of the Methodology aims at measuring how well the established formal system works inpractice. It covers a set of suggested compliance/performance indicators (CPIs) that are associatedwith the baseline indicators in Part I.As there are no agreed standards for performance for each country, the short-term objective is to findout the degree to which the system is following its own regulations or what the perception ofcompliance is in those cases where data cannot be measured quantitatively. The CPIs help to identifyareas where compliance or performance is weak and when a more in-depth review of deficiencies andtheir likely causes may be warranted. No scoring of compliance is proposed at the time of writing. 14The application of the CPIs relies on data obtained from a representative sample of contracts andinformation obtained from surveys or questionnaires with stakeholders of the procurement system.Since data and information for the CPIs may not be available, the extent of application of the CPIs isto be decided at the country level between the government and interested development partners. TheUser‟s Guide highlights the following aspects of compliance and performance measurement: 15Sampling for performance assessment and data collectionSelecting an adequate sample of actual procurement processes for assessing performance isimportant for the credibility of the exercise.The reliability of information should be confirmed, based on reports or an evaluation of theinformation systems used to produce the reports.Assessor should disclose the sampling method used and the level of confidence with regardto the data collected or other techniques used to collect information such as surveys andinterviews.Planning and preparing the assessmentThe availability, reliability and integrity of records are issues that need careful considerationduring the planning phase, the absence of which could impede a full assessment of thesystem.Non-existence of reliable quantitative data is an issue that needs to be addressed as aweakness of the system that might impede adequate controls and monitoring or analysis ofthe system‟s performance.If the government carries out a self-assessment exercise, a verification process is needed.Part II of the Methodology provides a table that shows the compliance/performance indicator, therelated baseline indicator/sub-indicator, the suggested source of information and a column titled1415Methodology for Assessment of National Procurement Systems, Part II: Compliance and PerformanceIndicators, www.oecd.org/dac/effectiveness/procurement.Methodology for Assessment of National Procurement Systems, Section I: User‟s Guide,www.oecd.org/dac/effectiveness/procurement.30 COMPENDIUM OF COUNTRY EXAMPLES AND LESSONS LEARNED […] - OECD 2008