Analytic Culture in the U.S. Intelligence Community (PDF) - CIA

CHAPTER TEN
research methodologies. Additionally, ethnography is used to identify and
describe the influence of different variables on cultural phenomena, again
with a focus on developing testable theory. Unlike more quantitative disciplines,
cultural anthropology is not traditionally employed experimentally to
test theory or to generate predictive measures of statistical significance.
The findings in this work describe the data collected during this study, but
they do not indicate the weight or general statistical effect of any one variable
as opposed to any other variable. Although a single variable might have more
effect on the error or failure rate of intelligence analysis, further quantitative
research will be needed to determine those statistical values. Without additional
quantitative support, it may not be possible to generalize from these
findings.
Methodology
This study used an applied anthropological methodology for the collection
and analysis of qualitative data. 2 A traditional approach to ethnography, the
descriptive documentation of living cultures, was modified for use in postindustrial
organizational settings. 3 This method included conducting interviews,
directly observing analysts performing their jobs, participating in analytic
tasks and training, and conducting focus groups. The settings for this
research included the 14 members of the Intelligence Community, related
government agencies, universities, think tanks, national laboratories, the
National Archives and related presidential libraries, and private and corporate
locations.
The background data were collected using a Q-sort literature review method,
which is discussed in more detail in Chapters Three and Eleven. This procedure
was followed by semi-structured interviews, direct observation, participant
observation, and focus groups. The Q-sort method was employed specifically
because of its utility for developing taxonomic categories. 4
The identity of the research participants will not be revealed. Participant
responses and observational data gathered during the research process have
been tabulated and made anonymous or aggregated according to context and
2
Erve Chambers, Applied Anthropology: A Practical Guide; Alexander Ervin, Applied Anthropology:
Tools and Perspectives for Contemporary Practice.
3
Russell Bernard, Research Methods in Anthropology: Qualitative and Quantitative Approaches;
Robert Bogdan, Participant Observation in Organizational Settings; Norman Denzin and Yvonna
Lincoln, Handbook of Qualitative Research; Jean Schensul and Margaret LeCompte, Ethnographer’s
Toolkit. Vol. I - Vol. VII; James Spradley, Participant Observation; Robert Yin, Case
Study Research: Design and Methods.
4
William Stephenson, The Study of Behavior: Q-Technique and its Methodology.
120