16.11.2014 Views

European Peer Review Guide - European Science Foundation

European Peer Review Guide - European Science Foundation

European Peer Review Guide - European Science Foundation

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

Eligibility<br />

criteria<br />

Completeness<br />

of the application<br />

General fit of the<br />

proposal with<br />

the Instrument’s<br />

purpose<br />

Timeliness<br />

of the<br />

submission<br />

Institutional,<br />

regional, national<br />

affiliation<br />

of applicants<br />

Other<br />

Total of 19<br />

Respondents<br />

94.7%<br />

18/19<br />

78.9%<br />

15/19<br />

78.9%<br />

15/19<br />

73.7%<br />

14/19<br />

36.8%<br />

7/19<br />

• Evaluation of the leadership and management<br />

aspects;<br />

• It is good practice to include some form of assessment<br />

of:<br />

– added value: why is a collaborative approach<br />

necessary?<br />

– integration: how well do the teams devoted to<br />

various components and work packages link<br />

together?<br />

– synergy: is the proposed work likely to yield<br />

benefits greater than the sum of the parts?<br />

• In the specific case of National Collaborative<br />

Research Programmes the strategic and national<br />

importance of the proposed research should also<br />

be evaluated. However, this may be a task for the<br />

funding body rather than expert evaluators.<br />

6.3.3 Referee assessments<br />

As noted in Part I of this <strong>Guide</strong> (Chapter 4) it is<br />

recommended as good practice to use standard<br />

assessment forms and online procedures.<br />

The survey shows that 88.2% (15/17) of the<br />

organisations use online standard assessment forms<br />

for the reviews of International Collaborative Research<br />

proposals made by individual/remote reviewers and<br />

73.3% (11/15) for those used by panel reviewers 81 .<br />

6.4 Final selection and funding<br />

decisions<br />

Final decisions are usually taken by a committee<br />

or board within or on behalf of the organisation in<br />

charge of the programme.<br />

It is very important to set clear ground rules<br />

on the procedure for making final decisions, particularly<br />

in the case of transnational programmes.<br />

Even when the national organisations maintain the<br />

responsibility for final funding decisions nationally,<br />

there should be a strong expectation that the<br />

ranking established by the expert evaluators will<br />

be respected.<br />

In the case of proposals having an equal rank, it<br />

may be legitimate for the funding body to differentiate<br />

proposals, where necessary, using previously<br />

agreed methods. Here, diversity issues (e.g., gender)<br />

might be taken into account.<br />

According to the survey results, for International<br />

Collaborative Research Programmes the following<br />

practices have been stated:<br />

International<br />

Collaborative<br />

Research<br />

Programmes<br />

61<br />

<strong>European</strong> <strong>Peer</strong> <strong>Review</strong> <strong>Guide</strong><br />

Organisation’s own executive<br />

management decides on<br />

the basis of peer review<br />

recommendations<br />

A standing scientific committee<br />

composed of researchers<br />

decides on the basis of the peer<br />

review recommendations<br />

A board or committee<br />

composed of researchers,<br />

administrators and/or<br />

politicians decides on the<br />

basis of the peer review<br />

recommendations<br />

31.6%<br />

6/19<br />

31.6%<br />

6/19<br />

26.3%<br />

5/19<br />

81. See <strong>European</strong> <strong>Science</strong> <strong>Foundation</strong> (2010b), ESF Survey<br />

Analysis Report on <strong>Peer</strong> <strong>Review</strong> Practices, in particular Section 4.9,<br />

Table 4.22.<br />

The review panel decides 10.5%<br />

2/19

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!