Four Essays on University Economics - KOPS - Universität Konstanz
Four Essays on University Economics - KOPS - Universität Konstanz
Four Essays on University Economics - KOPS - Universität Konstanz
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
Ec<strong>on</strong>omic research in Switzerland<br />
focus <strong>on</strong> efficiency enhancing measures such as the increased use of incentive compatible<br />
management instruments. Given this focus, it is of utmost importance to be in a positi<strong>on</strong><br />
to identify good and poor performances. The arguably most helpful instruments in this<br />
c<strong>on</strong>text are suitable research rankings.<br />
The hitherto available research rankings of Swiss universities are hardly suited to serve<br />
as management instruments. The Swissup ranking, 3 but also the research ranking provided<br />
by the German CHE, 4 nowadays a partner of Swissup and the Swiss university rectors’<br />
c<strong>on</strong>ference, are based <strong>on</strong> (dubious) questi<strong>on</strong>naire surveys or assess research quality by<br />
measuring inputs such as research grants or the scientific pers<strong>on</strong>nel instead of output. 5<br />
Interestingly, Swissup originally made an attempt to underpin its ranking with a biblio-<br />
metric analysis, but the collected data has not been analyzed. 6 As it is, the ranking is<br />
based <strong>on</strong> questi<strong>on</strong>able criteria such as the number of doctorates. This number is easy to<br />
acquire but does not really measure research activity because the quality of doctoral theses<br />
is very heterogeneous. Moreover, wr<strong>on</strong>g incentives are set: Departments that substitute<br />
research quality by quantity fare better in this kind of ranking than departments dedicated<br />
to quality. 7 Such rankings are clearly unsuitable for management purposes.<br />
The method employed by CEST is well-founded from a bibliometric point of view.<br />
However, it is not designed as a management instrument but as a means to identify the<br />
leading research units in the world. 8 To do so CEST <strong>on</strong>ly counts publicati<strong>on</strong>s in journals<br />
that are listed in the Social Science Citati<strong>on</strong> Index (SSCI), and ranks <strong>on</strong>ly those ec<strong>on</strong>omic<br />
research units that have published at least 50 SSCI publicati<strong>on</strong>s in the survey period. If<br />
this method were used as a management instrument, unintenti<strong>on</strong>al incentive effects would<br />
again result. The objective to “maximize the number of SSCI publicati<strong>on</strong>s” would replace<br />
high quality research by inferior research that is still publishable in sec<strong>on</strong>d rate SSCI<br />
journals. Hein and Ursprung (2004) have referred to this effect as “Gresham’s law” of<br />
research evaluati<strong>on</strong>. 9<br />
3 http://www.swissupranking.com.<br />
4 The new CHE Ranking, in which also Swiss universities are evaluated was published <strong>on</strong> 19. May 2005<br />
( http://www.che-ranking.de/news.php?id=304).<br />
5 A critique of the Swissup/CHE Ratings can be found in Leu (2005).<br />
6 see http://www.swissupranking.com/pdf/methodo_PDF_DEF_D.pdf<br />
7 see Fabel et al. (2003)<br />
8 see Da Pozzo and Roulin Perriard (2004)<br />
9 The Champi<strong>on</strong>s League of Research also lists the average citati<strong>on</strong> incidence of the publicati<strong>on</strong>s (in relati<strong>on</strong><br />
to the global field specific citati<strong>on</strong> incidence). However, it is unclear whether quality differences can be<br />
identified by this method because the citati<strong>on</strong> success of most of the ec<strong>on</strong>omic publicati<strong>on</strong>s is relatively<br />
6