Standard CMMI Appraisal Method for Process Improvement (SCAMPI)

Before the appraisal begins, members of the appraised organization typically prepare objective
evidence. Objective evidence consists of qualitative or quantitative information, records,
or statements of fact pertaining to the characteristics of an item or service or to the existence
and implementation of a process element. It is based on observation, measurement, or test,
and can be verified. During an on-site period, the appraisal team verifies and validates the
objective evidence provided by the appraised organization to identify strengths and weaknesses
relative to the CMMI reference model. The information-processing engine is thus fueled
by the objective evidence already available, saving the appraisal team the time and effort
of a “discovery” process.
This preparation by the appraised organization is critical to the efficient execution of a
SCAMPI appraisal. Analysis of preliminary objective evidence provided by the appraised
organization plays a critical role in setting the stage for the appraisal execution. If substantial
data are missing at this point, subsequent appraisal activities can be delayed or even cancelled
if the judgment is made that continuing appraisal activities will not be sufficient to make up
for the deficiency.
The collection of objective evidence by the appraised organization in advance of the appraisal
not only improves appraisal team efficiency, but also offers several other benefits to the organization:
• improved accuracy in appraisal results delivered by external appraisal teams (i.e., clear
understanding of implemented processes, strengths, and weaknesses)
• detailed understanding of how each process instance has implemented appraisal reference
model practices, and the degree of compliance and tailoring of organizational standard
processes
• facilities for monitoring process compliance and process improvement progress
• residual appraisal assets that can be reused on subsequent appraisals, minimizing the effort
necessary for preparation
Phase 2: Conduct Appraisal
In phase 2, the appraisal team focuses on collecting data from the appraised organization to
judge the extent to which the model is implemented. Integral to this approach is the concept
of “coverage,” which implies (a) the collection of sufficient data for each model component
within the CMMI reference model scope selected by the sponsor, and (b) obtaining a representative
sample of ongoing processes (spanning the life-cycle phases that the appraised organization
is using in the development and delivery of its products and services). For a
benchmarking appraisal methodology, this means collecting data and information on all the
reference model practices for each process instantiation being appraised within the organizational
unit. The data collection plan developed in phase 1 undergoes continuous iteration and
refinement until sufficient coverage is achieved.
CMU/SEI-2001-HB-001 I-11