of findings if very short time-scales are involved.While the timely reporting of the findings of Fast OR studies remains of paramount importance,there is a need also to ascertain the veracity of the underpinning S&T work that led to thefindings. One approach is to negotiate with the requestor of the work a format for thedeliverables that meets their purpose but is also matched to the time frames of the study.For shorter time frames, more formal, peer-reviewed mechanisms would then become anadditional process undertaken after the delivery of the primary findings. This should, however,be viewed as a level of redundancy necessary to assure S&T quality of the work rather than aduplication of effort.Another issue with the reporting of Fast OR studies is the format of documents produced.Scientific papers and technical reports follow set pro forma, usually established by theorganisation publishing the work. For DSTO reports, this is laid out in the ‘Style Guidefor DSTO Authors’, whereby a report or paper typically has sections such as introduction,methods, results, discussion and conclusion. For Fast OR studies, however, the sections mayhave headings such as objectives, approach, analysis, findings and recommendations to betterreflect the purpose and nature of the S&T work undertaken and the need to align the resultsdirectly with the request for S&T support. In addition to providing more clarity of purpose andfocus for S&T activities, such structure can also assist the OR practitioner to achieve brevityin reporting.The way in which the results of an OR study are written is also important. As OR studies seemincreasingly to involve tackling ill-defined problems or complex issues, which can be highlydependent on the context or involve interpretation of only a subset of all relevant information,there is a danger in making assertions, sweeping statements and unconditional findings. Itis thus important to highlight main findings but explicitly note what assumptions have beenmade and clearly state any contentious aspects along with any recommendations. Developinga suitable style for OR reporting is sufficiently demanding when time is not of the essence.For the deployed OA team, the challenge is even greater. Again, some form of simple checklistmay aid the development of clear, concise reports and for reviewing them with respect to bothstyle and content.For deployed OA teams, and those back at DSTO directly supporting them, there may beinsufficient time to apply such processes during the study with pressures from a continualstream of new OA tasks restricting the time available for any post-activity evaluation of FastOR studies. Simple schema and tools for evaluation could help, as could support in this areafrom the wider DSTO OR community. The initial steps towards addressing this problem havebeen made through a workshop held as part of the <strong>Defence</strong> Operations Research Symposium2009. At the symposium, the DSTO CoBP was extensively reviewed with a view to revisingand incorporating some specific guidance in areas such as Fast OR. In the interim, some ofthe hallmarks and principles outlined in this paper may be of use for the quick evaluation ofcompleted Fast OR studies.68
ConclusionScience and technology support to ADF operations is DSTO’s highest priority and ischaracterised by the need for a rapid response within a framework which takes account ofthe operational context and the associated hazards. It is imperative that the ongoing DSTOresponse is both timely and of high quality so that it contributes to operational outcomes andADF force protection. For these reasons, DSTO has evolved a separate policy and governanceframework for support to operations as well as specialised training for the scientists involved.The military utility of DSTO’s support to operations is suitably captured by Lieutenant GeneralMark Evans in his preface to the ‘Joint Operations Command S&T Plan’ where he notes that‘operational decision-making can benefit from the scientific method through structuredoperations analysis’ and ‘converting hard-won operational experience to enhance jointcapabilities in a timely manner requires analysis and experimentation processes’.The techniques being developed for rapid-turnaround studies in support of current operationshave wider application to other areas of <strong>Defence</strong>, particularly where the time frames availablefor S&T work are comparable to those encountered in support to operations. What remains tobe done are explicating and codifying of the practices of Fast OR and the linking of the resultsfrom such studies to the program of more traditional OR studies. The linking of Fast OR withstudies undertaken over longer time frames would also reinforce the ‘learning organisation’culture of <strong>Defence</strong>.For the military consumers of such studies, it is perhaps useful to understand the broad natureof the scientific analyses undertaken, how they may differ from other sorts of professionalstudies and the competing, if not conflicting, demands placed on scientists attempting tobalance their clients’ expectations that studies will be fast, relevant and useful, with theneed to assure the scientific quality of the work undertaken. While the issue of scientificveracity, and hence credibility, of the work undertaken may not be foremost in the minds ofthose depending on S&T advice from DSTO, the confidence that they can place in such adviceultimately rests on achieving and maintaining a requisite level of scientific quality.Established principles and hallmarks of good OR provide a firm basis for assuring the scientificquality of Fast OR studies. But work is needed to establish simple checklists or other schemathat can be readily and quickly applied to evaluating the scientific quality of such studies.Additionally, there needs to be further development of tools and techniques for use bydeployed OA teams that sit within an accredited framework. Considering the gravity of FastOR studies in support of current operations, the issue of determining their scientific quality isof importance to all of <strong>Defence</strong> not just the scientists undertaking them.Dr Terry Moon has 35 years experience in research including 24 years in <strong>Defence</strong> Science. Duringhis time at DSTO, he has worked in a number of fields spanning electronic warfare technology,operations research, surveillance technology, systems analysis, capability engineering andnetwork-centric warfare studies. He has also worked on a number of major <strong>Australian</strong> <strong>Defence</strong>projects and DSTO-wide studies. Terry is currently working in Joint Operations Research with afocus on support to current and near-term operations.69
- Page 3 and 4:
Australian Defence ForceCONTENTSISS
- Page 5 and 6:
asics of the ADF’s approach to wa
- Page 7 and 8:
Oceanography and Force 2030: harnes
- Page 9 and 10:
The warm, relatively fresh waters o
- Page 11 and 12:
In a further example, the Australia
- Page 13 and 14:
Direct threats include maritime ter
- Page 15 and 16:
Commodore Rod Nairn is a career hyd
- Page 17 and 18:
Institute of Marine Science, $80m i
- Page 19 and 20: The nature of casualties presenting
- Page 21 and 22: Contracted solutions in less hostil
- Page 23 and 24: Planning implications of increased
- Page 25 and 26: When a nation is at war, it is acce
- Page 27 and 28: NOTES1. Doug Brooks, ‘Role of pri
- Page 29 and 30: the further from Stanley the landin
- Page 34 and 35: 20. Comisión de Análisis y Evalua
- Page 36 and 37: Coral Sea neighbours - then and now
- Page 38 and 39: sources. In contrast, such trade be
- Page 40 and 41: New Caledonia’s significance toda
- Page 42 and 43: years, it was often perceived—by
- Page 44 and 45: NOTES1. K. Mushakoji quoted in R. A
- Page 46 and 47: Lasers or Longbows? A Paradox of Mi
- Page 48 and 49: Military complexityAs military capa
- Page 50 and 51: accounts for 93 per cent of the pro
- Page 52 and 53: The paradox of military technology
- Page 54 and 55: fleet is massive, with sustainment
- Page 56 and 57: NOTES1. Benjamin Franklin, Poor Ric
- Page 58 and 59: 30. D. Korowicz, ‘Things Fall Apa
- Page 60 and 61: This new capability provides techni
- Page 62 and 63: ‘Reaching back’ for information
- Page 64 and 65: Figure 2. Chart summarising an exam
- Page 66 and 67: Fast OR typically uses established
- Page 68 and 69: the results produced. For example,
- Page 72 and 73: Dr Tim McKay is Head of the DSTO Op
- Page 74 and 75: strategic documents signed by the U
- Page 76 and 77: • Strategic Command (STRATCOM), t
- Page 78 and 79: Geographic Combatant Commands in th
- Page 80 and 81: 8. This evolution and expansion can
- Page 82 and 83: 27. In particular, in contrast to t
- Page 84 and 85: Nevertheless, it can be argued that
- Page 86 and 87: Proposed conceptThe proposed networ
- Page 88 and 89: organisations could deploy at short
- Page 91 and 92: The PacificHugh AmbroseText Publish
- Page 93 and 94: Bloody Victory: the sacrifice on th
- Page 95 and 96: Somme as critical to the forging of
- Page 97 and 98: Command and Control: the sociotechn
- Page 99 and 100: Human Factors Issues in Combat Iden
- Page 101 and 102: The Canadian paper on CAS (Chapter
- Page 103 and 104: The Ashgate Research Companion to M
- Page 105 and 106: There is also a chapter on early vo
- Page 107 and 108: The authors’ chief vulnerability
- Page 109 and 110: Books of this genre are intended to
- Page 111 and 112: The ninth chapter is entitled ‘To
- Page 113 and 114: Many members of the ADF may honestl
- Page 115: GUIDANCE FOR AUTHORSThe Australian