Four Essays on University Economics - KOPS - Universität Konstanz
Four Essays on University Economics - KOPS - Universität Konstanz
Four Essays on University Economics - KOPS - Universität Konstanz
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
Ec<strong>on</strong>omic research in Switzerland<br />
Since an assessment of the quality of each single article is difficult and time-c<strong>on</strong>suming,<br />
it has become comm<strong>on</strong> practice in the evaluati<strong>on</strong> literature to use journal specific quality<br />
weights, i.e. the quality of an article is associated with the quality of the journal in which<br />
it is published. There are two ways of determining journal-specific quality weights. One<br />
possibility is to identify the quality of a journal with its impact factor based <strong>on</strong> citati<strong>on</strong><br />
incidence. However, such a weighting scheme results in perceived quality differences that<br />
are inappropriately large. 15 An alternative way of arriving at journal-specific quality<br />
weights is via a survey am<strong>on</strong>g experts. This method, of course, may also yield c<strong>on</strong>troversial<br />
results. Even though there are different methods of objectifying the opini<strong>on</strong>s of experts (for<br />
example by taking “impact factors” into account) the weighting always remains subjective<br />
and vulnerable to critique.<br />
In the literature different weighting schemes have been proposed. For our benchmark-<br />
ranking, we use the original weighting scheme proposed by Combes and Linnemer (2003). 16<br />
The CL weighting scheme reflects objective factors as well as expert opini<strong>on</strong>s. All journals<br />
listed in Ec<strong>on</strong>Lit are given a positive weight. The journal weights range between 1<br />
12 and<br />
1. Thus, it is assumed that 12 articles published in journals of the lowest category c<strong>on</strong>tain<br />
ceteris paribus the same research achievement as <strong>on</strong>e article which is published in <strong>on</strong>e of<br />
the leading journals. The CL scheme c<strong>on</strong>tains six categories with the weights 1<br />
12<br />
, 1<br />
6<br />
, 1<br />
3<br />
1 2 , 2 , 3<br />
and 1. The lower the category, the more journals it c<strong>on</strong>tains. Only five journals receive<br />
a weight of 1 (AER, Ec<strong>on</strong>ometrica, JPE, QJE, RES), but 138 journals a weight of 1<br />
6 .<br />
All journals that are not explicitly listed in <strong>on</strong>e of the first five categories that c<strong>on</strong>tain<br />
approximately 230 journals, fall into the last category and receive a weight of 1<br />
12 .<br />
The research activity of the universities is recorded <strong>on</strong> an annual basis. In order to<br />
compensate for accidental fluctuati<strong>on</strong>s between two c<strong>on</strong>secutive years, we however prefer<br />
to present moving two year averages. We chose this presentati<strong>on</strong> because we want the<br />
ranking to reflect the normal productivity of a university and not random events such as<br />
publicati<strong>on</strong> lags and faculty turnover.<br />
15 Kalaitzidakis et al. (2003) for example gave the Journal of Internati<strong>on</strong>al Ec<strong>on</strong>omics, which is a leading<br />
journal in its field, a quality weight which is 13 times smaller than that of the American Ec<strong>on</strong>omic<br />
Review; a paper in Kyklos is rated 110 times less valuable than a paper in the American Ec<strong>on</strong>omic<br />
Review.<br />
16 Our results are not very sensitive with respect to the weighting scheme. The rank correlati<strong>on</strong> coefficients<br />
between our benchmark ranking and rankings based <strong>on</strong> seven other weighting schemes are, in general,<br />
quite high (see the German working paper versi<strong>on</strong> of this paper, http://twi.ch.uni-k<strong>on</strong>stanz.de/<br />
twi_research.php).<br />
9