18.05.2015 Views

Health Information Management: Integrating Information Technology ...

Health Information Management: Integrating Information Technology ...

Health Information Management: Integrating Information Technology ...

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

STRATEGY, IMPLEMENTATION AND EVALUATION 205<br />

team (especially the doctors and nurses) were interested in the impact of<br />

the system on work practices and user satisfaction. As a result, the<br />

evaluation of the PDMS pilot consisted of different parts, each addressing<br />

different evaluation questions, requiring different methods and time scopes.<br />

In this step, different issues come to the fore and several challenges have to be<br />

faced:<br />

Issues<br />

■<br />

■<br />

Stakeholders may disagree on why an evaluation is needed, and it is not<br />

uncommon that some question if evaluation is necessary at all (i.e., whether<br />

doing an evaluation is not a waste of already scarce resources).<br />

Different stakeholders wish to evaluate for different reasons.<br />

Challenges<br />

■<br />

■<br />

■<br />

■<br />

Ensure that everyone fully understands the role and importance of evaluation.<br />

The project team responsible for conducting the evaluation needs to have<br />

enough knowledge about conducting an evaluation.<br />

Make clear how the evaluation results will be used, whether this is to inform<br />

and change the future direction of the project or to simply report and justify<br />

expenditure.<br />

Be aware of different stakeholders perspectives and agendas and make these<br />

explicit in the evaluation.<br />

Step 2<br />

Agree when to evaluate<br />

The question when an evaluation is appropriate depends on different matters.<br />

First, it depends on the aim of the evaluation. Formative evaluations are geared<br />

towards process indicators and/or preliminary outcome measurements and are<br />

performed before and during the implementation of an information system.<br />

Summative evaluations are geared towards outcome parameters and are often<br />

performed before and after the implementation process to be able to compare<br />

both situations. Typical summative evaluations are, for example, costeffectiveness<br />

or cost—benefit analyses.<br />

CASE STUDY<br />

In the UK EPR project, the evaluation was only commissioned after the<br />

start of the implementation, despite the fact that the commissioners of the<br />

work required the evaluation to demonstrate benefits in the post

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!