In Search of Evidence
jqluvth
jqluvth
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
Summary and General Discussion<br />
the problem and 5 minutes thinking about solutions.’ Most popular management<br />
books, however, seem to focus on <strong>of</strong>fering a quick solution instead <strong>of</strong> a thorough<br />
diagnosis <strong>of</strong> the problem. <strong>In</strong> addition, the number <strong>of</strong> scholarly articles on<br />
organizational problem diagnosis is limited. Research is needed to examine how<br />
reliable and accurate managers’ diagnoses are in general and whether an evidencebased<br />
approach will make a difference here, too.<br />
<strong>Evidence</strong>-Based Practice Tools<br />
<strong>Evidence</strong>-based practice tools can help practitioners to overcome limitations <strong>of</strong><br />
human judgment and thus help them to make better decisions. <strong>In</strong> fields where<br />
evidence-based practice is well established such tools are widely available in the form<br />
<strong>of</strong> checklists, decision aids, and even apps. Within the field <strong>of</strong> management only a few<br />
tools are available, and their validity and reliability are still unknown. For instance, the<br />
Center for <strong>Evidence</strong>-Based Management has developed an app that aims to help<br />
managers to critically evaluate the trustworthiness <strong>of</strong> scientific studies in order to<br />
answer practical questions about the effect <strong>of</strong> an intervention or success/risk factor on<br />
an outcome. For practical reasons the number <strong>of</strong> appraisal questions in this app is<br />
limited to three questions that cover the most important aspects <strong>of</strong> methodological<br />
quality. This limitation, however, may seriously affect the app’s reliability. The same is<br />
true <strong>of</strong> tools that are adapted from the field <strong>of</strong> medicine; future research has yet to<br />
evaluate their applicability to the field <strong>of</strong> management. The most important research<br />
question, however, concerns the effectiveness and impact <strong>of</strong> evidence-based practice<br />
tools in general: do they help managers make better decisions?<br />
Teaching <strong>Evidence</strong>-Based Practice<br />
A study by Charlier et al found that, using a very liberal operationalization <strong>of</strong><br />
evidence-based practice, only 25% <strong>of</strong> core MBA management courses utilize evidencebased<br />
practice in some form . Based on these findings we can safely assume that the<br />
number <strong>of</strong> management programs that have fully integrated the principles <strong>of</strong><br />
evidence-based practice into their curriculum is limited. Reason for this slow uptake<br />
may be partly due to the fact that there is no empirical evidence yet demonstrating the<br />
added value <strong>of</strong> teaching evidence-based practice as compared with traditional ways <strong>of</strong><br />
teaching management. This evidence, however, could be furnished by a randomized<br />
controlled study or a sufficiently powered stepped wedge design. <strong>In</strong> a stepped wedge<br />
design an evidence-based training program is rolled-out sequentially to groups <strong>of</strong><br />
students over a number <strong>of</strong> periods <strong>of</strong> time. The order in which the different groups<br />
receive the training is determined at random and a before-and-after measurement is