16.06.2016 Views

EVIDENCE

missingevidence-digitalpdf-singlepages_2016

missingevidence-digitalpdf-singlepages_2016

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

3.30 It has also been suggested that where civil servants are unfamiliar with research methods, this leads<br />

to frustrated communications and tensions with researchers, and ultimately to delay in publishing<br />

results. There is a great deal of research expertise across government; some of this was exhibited<br />

in the insightful responses to this inquiry. But, research is commissioned, overseen, received<br />

and communicated by a wide range of personnel.<br />

3.31 The government social research competency framework (an addendum to the civil service code)<br />

defines the professional competency for members of the social research profession within government<br />

and devolved governments. On reaching grade 5, chief research officer level, a civil servant is expected<br />

to have a thorough and detailed knowledge of research methodology and the evidence base in the field<br />

of policy they work in and to take responsibility for research publication.<br />

3.32 Government sometimes changes what it wants from the research in the course of the project.<br />

For instance, Dr Christian van Stolk of RAND explained that in evaluating a policy impact, departments<br />

may change the outcome measures because of changes in government policy moving or staff<br />

turnover (mainly in the civil service team directing the research), which can lead to shifting priorities.<br />

It can also happen that at the point of publication government changes the format it wants to publish<br />

results in, although according to van Stolk it is more usually the case that there has been little thought<br />

or discussion about that format until publication is imminent. Such changes to the research protocol can<br />

cause tension and delay, which could be avoided if commissioners of research and researchers worked<br />

closely at the outset not only to set the research question but to agree publication plans.<br />

Uncertainty over what counts as research<br />

and differences in the interpretation of rules<br />

3.33 This inquiry has considered how research, defined as the collection and evaluation of data, is published.<br />

It is necessary to bear in mind the distinction between strategic advice, which carries no expectation<br />

of publication, and the data and analysis that underpin it and ought ordinarily to come from or be put<br />

in the public domain.<br />

Jonathan Portes, said:<br />

“[NIESR does] research on the expectation it will be published. There might<br />

be an exemption for strategic advice, but all policy research and programme<br />

evaluations should be published.”<br />

Dr Sarah Wollaston MP, said:<br />

“Ministers need to ask for strategic advice, but the principle is that public funds<br />

pay for research that informs that advice, so should be publicly available.”<br />

3.34 It is evident from what the inquiry was told both by members of the research community and by civil<br />

servants that there is uncertainty about how evidence supplied by private consultancies is to be handled.<br />

Consultants may provide strategic advice but may also conduct research. There is no reason why this<br />

should create confusion between research and consultancy, even if there is some room for overlap.<br />

Where this might be applicable, civil servants should establish in advance that research findings<br />

and strategic advice will be provided in separate reports.<br />

3.35 There is further uncertainty over how other types of research, such as internal fact-finding or evaluation<br />

studies, fit into the publication rules. Case Study 9 shows that research into the effect of fracking<br />

on house prices was not published because Defra considered it to be an internal report. When it was<br />

released in response to an Environmental Information Request it<br />

was heavily redacted.<br />

There is uncertainty about<br />

how evidence supplied<br />

by private consultancies<br />

is to be handled.<br />

SECTION 3: REASONS FOR THE DELAYED PUBLICATION OR WITHHOLDING OF GOVERNMENT RESEARCH<br />

28

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!