Standard CMMI Appraisal Method for Process Improvement (SCAMPI)

1.5.2 Prepare Data Collection Plan (continued)
Implementation
Guidance
Sources of objective evidence include instruments, documents, presentations,
and interviews (see process 2.1, Examine Objective Evidence). Objective
evidence is differentiated in terms of different types of PIIs (direct artifacts,
indirect artifacts, and affirmations), as described in activity 1.4.3, Obtain
Initial Objective Evidence. A combination of these indicator types is required
for corroboration (see activity 2.2.1, Verify Objective Evidence). The data
collection status is continually monitored during appraisal activities (see
process 2.3, Document Objective Evidence) to ensure that sufficient data
coverage is obtained. These are all key considerations that should be
understood and accounted for in the generation of the data collection plan.
Multiple types of interviews can be used to obtain face-to-face affirmations
(see activity 2.1.4, Examine Objective Evidence from Interviews):
• standard structured interviews scheduled in advance and using scripted
questions
• on-call interviews, scheduled in advance for calendar purposes, but held
only if it is determined they are necessary
• office hours interviews, for which interviewees are notified that they may
need to be available as a contingency during scheduled periods
A robust data collection plan will plan for interviews of all three types. Start
with a full set of scheduled interviews early in the planning phase, and
gradually add/eliminate/modify events as the inventory of initial objective
evidence indicates the need. The mini-teams may conduct office hours
interviews, even during team training, to more fully populate the inventory of
objective evidence prior to the start of the on-site data collection activities.
Planning for document reviews should include organizational-, project-, and
implementation-level artifacts, as described in activity 2.1.3, Examine
Objective Evidence from Documents.
Ultimately, the appraisal team will need to have data on each practice in the
CMMI model, for each organizational element in the appraisal scope. For PAs
addressing practices implemented at the project/program level (e.g., Project
Planning), this means that data on each instantiation of the practice will be
collected. For PAs addressing practices implemented at the organization level
(e.g., Organizational Training), only one instantiation of each practice may be
needed, depending on the way the organization chooses to implement such
practices.
Continued on next page
Page II-66
CMU/SEI-2001-HB-001