monitoring
monitoring
monitoring
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
UNCLASSIFIED<br />
DEFENSE SCIENCE BOARD | DEPARTMENT OF DEFENSE<br />
that work together to accomplish the goals and objectives identified through<br />
examination of the problem space.<br />
• Third, there must be a Bridging Methodology which allows for the “back and forth”<br />
between requirements and objectives that any solution must meet, as dictated by the<br />
frameworks that describe the problem, and architecture features and assessments of<br />
the solution space that are mapped into the analyst’s understanding of the problem<br />
itself.<br />
• Finally, there must be a rigorous and repeatable portfolio decision methodology that<br />
allows for the values of the decision maker and his/her organization to be incorporated,<br />
and for defensible, tractable decisions to be made.<br />
Figure A‐1 Elements of an M&V Analytical Methodology<br />
A common issue in the development of analytical frameworks has been the tendency to frame<br />
the problem and solution together. The conflation of “problem space” and “solution space”<br />
brings with it several consequences. First, it tends to promote metrics and assessments that<br />
maximize elemental solution parameters such as detector performance, rather than system<br />
performance against the actual threat space, by assuming that they are proximate. Second, it<br />
tends to lead analysts to fixate on a narrower problem (such as detector performance) rather<br />
than assessing those issues in the context of the larger whole. Third, it does not enable a<br />
common understanding of the problem space itself, allowing solutions to be framed in<br />
whatever manner the solution proponent deems suitable. The entire set of symptoms run<br />
counter to enabling the decision maker to achieve his/her ultimate goal: rendering and<br />
defending a provably effective investment strategy for M&V capability development.<br />
Separating the “problem space” from the “solution space” and analyzing them independently<br />
can therefore yield benefits by eliminating or mitigating these issues.<br />
DSB TASK FORCE REPORT Appendix A: Unabridged Description | 79<br />
Nuclear Treaty Monitoring Verification Technologies<br />
UNCLASSIFIED