Warning Analysis for the Information Age - Higgins Counterterrorism ...

More documents

Recommendations

Info

❏ Human intervention needed to verify model integrity — “Does it makesense?”❏ Multiple iterations to find good models■ A silver bullet❏ Data are not informative in and of themselves 62We can illustrate the difficulties in the current IC data-handling systems by followingthe steps an all-source analyst performs in converting data to assessmentusing the Hypothesis Testing Cycle. At each database (DB) step, there is an inputof data which then comprise the particular dataset in that DB, a processing step inwhich the DB tools perform specific tasks as specified by the analyst, and an outputstep in which new processed data is presented to the analyst. At each outputstep, the analyst performs the research tasks in hypothesis testing as outlinedabove and inputs the processed data into the next DB in much the same way he orshe formerly used the library, books, and 3x5 card files. [Several MDA projectshave been accomplished using MS Word and PowerPoint as data-manipulationtools because current IC IT systems are unsatisfactory for MDA, mainly due tolimitations in IT-human interfaces and data movement among database types.Specific comments on current IC limitations are noted below in brackets.]Data input to the analytical process is by way of GLOBAL databases (DBs)which are the libraries of the IC: SIGINT from NSA, HUMINT from CIA, OpenSource from Foreign Broadcast Information Service (FBIS), and summaries ofIMINT data from NIMA. These data represent published messages from the collectionagencies and are loaded in a standard TEXT format with a few meta-tagsfor identification (but not analysis).(1) GLOBAL DB (Library) = TEXT storage of published records.Input = Published records from Collectors at CIA, NSA, FBIS, NIMA(text not images).Processing = Filtering of DBs according to analyst-written Profile.Output = Presentation of filtered records to the analyst.As was done with the books in the library, the analyst then scans the presentedrecords from the GLOBAL DB and decides whether records are relevant/not relevantto task.The analyst then RETRIEVES relevant records and redirects them to the nextTEXT storage. In the past, every analyst had a “shoebox” that contained all the62Abbott.142
task-relevant documents in whatever format they were retrieved: books, articles,paper copies of intelligence reports. Hypothesis testing is built on doing keyexperiments based on assumptions of the hypothesis; as alternative hypothesesare tested, discarded, and reconsidered, the researcher needs a place to store andrecall the experimental result—the “lab notebook.” Since the all-source analystworks with experiments done by others, that is with data input by collectors, this“shoebox” represents the analyst notebook of relevant documents for future reference.This “shoebox” has huge value-added in that the analyst has looked at thedocument and assessed that the material contained within the document is relevantto the assessments he or she needs to make. [One of the major reasons mostIC analysts are prone to stay with their paper copies or MS Word electronic shoeboxesis that no current IT systems have any reasonable methods for buildingelectronic shoeboxes from heterogeneous data. This kind of DB currently doesnot exist in useable format; Pathfinder on JIVA at DIA is slated to serve this purpose,but available options for data-entry of relevant records by analysts remaintoo cumbersome to be of any use. A major goal in any IT system used for hypothesistesting or MDA is to be able to build an electronic “shoebox” rapidly andeasily.](2) DATA COLLECTION/SHOEBOX DB = TEXT storage of task-relevantrecords.Input = (1) First-pass analyst input of relevant records.(2) Feedback input through direct analyst query of or setup to datamining tool.Processing = TEXT data mining (such as Pathfinder and text-mining analyticaltools).Output = Presentation of filtered or data-mined records to all-source analysts.Analysts read the presented records from the SHOEBOX DB and:■ Analyze: Analyst evaluates data recalled from SHOEBOX DB byQUERY or by SHOEBOX DB TEXT data mining tool.■ Reformat: Analyst reformats important records into METATEXT forentry into ENTITY DB. These are used in build facility, organization,and project profiles, and personnel biographies.The data prep is most difficult to characterize. 63(3) ENTITY DB (Evidence File) = METATEXT storage of filtered/analyzedrecords.63 Abbott.143
Page 1 and 2:
Joint Military Intelligence College
Page 3 and 4:
The Joint Military Intelligence Col
Page 5 and 6:
CONTENTSAcknowledgements. . . . . .
Page 7 and 8:
appreciate other distinctive elemen
Page 9 and 10:
In addition to his promoting the in
Page 11 and 12:
ADDITIONAL COMMENTARIES:Warning Ana
Page 13 and 14:
“butter now” to build a strong
Page 15 and 16:
orist groups half-a-world away mean
Page 17 and 18:
intelligence and requires exhaustiv
Page 19 and 20:
Chapter 2FROM CURRENT INTELLIGENCE
Page 21 and 22:
decades before the conflict when a
Page 23 and 24:
or pieces of information which were
Page 25 and 26:
probably been given too little atte
Page 27 and 28:
warfare the army that could bring t
Page 29 and 30:
Chapter 4PARADIGM SHIFTS — WHEN T
Page 31 and 32:
NorthDakotaMoscowNow on the map bel
Page 33 and 34:
line proponent is likely to say,
Page 35 and 36:
In the Industrial Age we based our
Page 37 and 38:
Let me explain by comparing the New
Page 39 and 40:
ight now we have a position (potent
Page 41 and 42:
The take-home message here is that
Page 43 and 44:
degrees and one I took six minutes
Page 45 and 46:
MESSAGE■ Suppress tendency to bui
Page 47 and 48:
Example: I see a large mammal with
Page 49 and 50:
In WMD analysis, these distinctions
Page 51 and 52:
Chapter 6TOWARD NOVEL INTELLIGENCE
Page 53 and 54:
Example 1 — An 8th Grade Science
Page 55 and 56:
Information Retrieval is Built on L
Page 57 and 58:
to extract all the entities or a me
Page 59 and 60:
That means that unless own ship man
Page 61 and 62:
Chapter 7FROM CURRENT INTELLIGENCE
Page 63:
analysis. A bigger database full of
Page 66 and 67:
viduals subordinate their decisionm
Page 68 and 69:
environment. In a world of limited
Page 70 and 71:
account for any deviations from equ
Page 72 and 73:
In summary:■ When the world will
Page 74 and 75:
progress of that plan. If change is
Page 76 and 77:
have been reached. “If they do A,
Page 78 and 79:
Chapter 8MODELING THE DECISION CYCL
Page 80 and 81:
Efforts to date to use information
Page 82 and 83:
Assumptions—From Industrial-Age T
Page 84 and 85:
From Thinking Tactically to Thinkin
Page 86 and 87:
of enemy forces and that he prepare
Page 88 and 89:
Modeling Ourselves—How Can We Reo
Page 90 and 91:
Chapter 9MODELING THE TARGETHow do
Page 92 and 93:
systems is that they are organized
Page 94 and 95:
ing “power” plotted vertically
Page 96 and 97: Biological systems extract energy a
Page 98 and 99: NationalCommandAuthorityD ecision E
Page 100 and 101: ❏ Identifying and tracking the fi
Page 102 and 103: There are two basic kinds of method
Page 104 and 105: The two kinds of models are complem
Page 106 and 107: Nation A$$Nation BMAPWhere?How?Targ
Page 108 and 109: ORGANIZATION CHARTWho?Why?TARGET NA
Page 110 and 111: Med.line (med’lin) vt. -lined, -l
Page 112 and 113: Tracking a BW or Dual-Use Biotechno
Page 114 and 115: The redundancy of the detailed kind
Page 116 and 117: This followsStage of Weapon Life Cy
Page 118 and 119: ■ Ceremonial occasions can be ver
Page 120 and 121: Massive Data?” However, the Case
Page 122 and 123: When the first pass at the known en
Page 124 and 125: Multidimensional Analysis for Strat
Page 126 and 127: at an appropriate place in the time
Page 128 and 129: When Col Boyd formulated the Decisi
Page 130 and 131: problem, warning involves an in-dep
Page 132 and 133: ■ Observe the incoming reporting.
Page 134 and 135: In the past—through the Industria
Page 136 and 137: FROM HYPOTHESIS TO ASSESSMENTUsing
Page 138 and 139: evidence. n. ... 5. Grounds for bel
Page 140 and 141: suggested guidance and models of Ma
Page 142 and 143: Using Homology Searching in Intelli
Page 144 and 145: ways can be identified in this way
Page 148 and 149: Input = (1) Analyst Input of METATE
Page 150 and 151: Chapter 11MODELING OURSELVESHow can
Page 152 and 153: When young children play soccer, th
Page 154 and 155: To make matters worse, even the col
Page 156 and 157: VERY NICEBut, simply stated, what d
Page 158 and 159: From Software-Driven Tools Usage to
Page 160 and 161: The Physical WorldSense 1O O D AThe
Page 162 and 163: messenger to and from the edges of
Page 164 and 165: The organization of the IC in this
Page 166 and 167: Chapter 12GETTING THERE FROM HEREWe
Page 168 and 169: From...Bigger Faster Technology,Fig
Page 170 and 171: Chapter 13TOWARD AN INFORMATION-AGE
Page 172 and 173: Robert Fulton sailed the steamshipC
Page 174 and 175: tion, and it followed that they wer
Page 176 and 177: drawn from a generation that thinks
Page 178 and 179: mal or cultural population in terms
Page 180 and 181: ■ The IC needs to hire enough IT
Page 182 and 183: By learning the lessons of Cynthia
Page 184 and 185: INDEX3x5 card deck 51,134,137,142,1
Page 186 and 187: Heisenberg, Werner 21, 111Heisenber
Page 188 and 189: OODA Cycle 12, 38, 167Actor 62,102a
Page 190 and 191: WMD 14-15, 81CBRNE 81, 114dual use
Page 192 and 193: Other Books from the Joint Military
show all

Warning Analysis for the Information Age - Higgins Counterterrorism ...

You also want an ePaper? Increase the reach of your titles

Delete template?

Save as template?