18.01.2013 Views

Four Essays on University Economics - KOPS - Universität Konstanz

Four Essays on University Economics - KOPS - Universität Konstanz

Four Essays on University Economics - KOPS - Universität Konstanz

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

Ec<strong>on</strong>omic research in Switzerland<br />

focus <strong>on</strong> efficiency enhancing measures such as the increased use of incentive compatible<br />

management instruments. Given this focus, it is of utmost importance to be in a positi<strong>on</strong><br />

to identify good and poor performances. The arguably most helpful instruments in this<br />

c<strong>on</strong>text are suitable research rankings.<br />

The hitherto available research rankings of Swiss universities are hardly suited to serve<br />

as management instruments. The Swissup ranking, 3 but also the research ranking provided<br />

by the German CHE, 4 nowadays a partner of Swissup and the Swiss university rectors’<br />

c<strong>on</strong>ference, are based <strong>on</strong> (dubious) questi<strong>on</strong>naire surveys or assess research quality by<br />

measuring inputs such as research grants or the scientific pers<strong>on</strong>nel instead of output. 5<br />

Interestingly, Swissup originally made an attempt to underpin its ranking with a biblio-<br />

metric analysis, but the collected data has not been analyzed. 6 As it is, the ranking is<br />

based <strong>on</strong> questi<strong>on</strong>able criteria such as the number of doctorates. This number is easy to<br />

acquire but does not really measure research activity because the quality of doctoral theses<br />

is very heterogeneous. Moreover, wr<strong>on</strong>g incentives are set: Departments that substitute<br />

research quality by quantity fare better in this kind of ranking than departments dedicated<br />

to quality. 7 Such rankings are clearly unsuitable for management purposes.<br />

The method employed by CEST is well-founded from a bibliometric point of view.<br />

However, it is not designed as a management instrument but as a means to identify the<br />

leading research units in the world. 8 To do so CEST <strong>on</strong>ly counts publicati<strong>on</strong>s in journals<br />

that are listed in the Social Science Citati<strong>on</strong> Index (SSCI), and ranks <strong>on</strong>ly those ec<strong>on</strong>omic<br />

research units that have published at least 50 SSCI publicati<strong>on</strong>s in the survey period. If<br />

this method were used as a management instrument, unintenti<strong>on</strong>al incentive effects would<br />

again result. The objective to “maximize the number of SSCI publicati<strong>on</strong>s” would replace<br />

high quality research by inferior research that is still publishable in sec<strong>on</strong>d rate SSCI<br />

journals. Hein and Ursprung (2004) have referred to this effect as “Gresham’s law” of<br />

research evaluati<strong>on</strong>. 9<br />

3 http://www.swissupranking.com.<br />

4 The new CHE Ranking, in which also Swiss universities are evaluated was published <strong>on</strong> 19. May 2005<br />

( http://www.che-ranking.de/news.php?id=304).<br />

5 A critique of the Swissup/CHE Ratings can be found in Leu (2005).<br />

6 see http://www.swissupranking.com/pdf/methodo_PDF_DEF_D.pdf<br />

7 see Fabel et al. (2003)<br />

8 see Da Pozzo and Roulin Perriard (2004)<br />

9 The Champi<strong>on</strong>s League of Research also lists the average citati<strong>on</strong> incidence of the publicati<strong>on</strong>s (in relati<strong>on</strong><br />

to the global field specific citati<strong>on</strong> incidence). However, it is unclear whether quality differences can be<br />

identified by this method because the citati<strong>on</strong> success of most of the ec<strong>on</strong>omic publicati<strong>on</strong>s is relatively<br />

6

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!