18.01.2013 Views

Four Essays on University Economics - KOPS - Universität Konstanz

Four Essays on University Economics - KOPS - Universität Konstanz

Four Essays on University Economics - KOPS - Universität Konstanz

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

Ec<strong>on</strong>omic research in Switzerland<br />

Since an assessment of the quality of each single article is difficult and time-c<strong>on</strong>suming,<br />

it has become comm<strong>on</strong> practice in the evaluati<strong>on</strong> literature to use journal specific quality<br />

weights, i.e. the quality of an article is associated with the quality of the journal in which<br />

it is published. There are two ways of determining journal-specific quality weights. One<br />

possibility is to identify the quality of a journal with its impact factor based <strong>on</strong> citati<strong>on</strong><br />

incidence. However, such a weighting scheme results in perceived quality differences that<br />

are inappropriately large. 15 An alternative way of arriving at journal-specific quality<br />

weights is via a survey am<strong>on</strong>g experts. This method, of course, may also yield c<strong>on</strong>troversial<br />

results. Even though there are different methods of objectifying the opini<strong>on</strong>s of experts (for<br />

example by taking “impact factors” into account) the weighting always remains subjective<br />

and vulnerable to critique.<br />

In the literature different weighting schemes have been proposed. For our benchmark-<br />

ranking, we use the original weighting scheme proposed by Combes and Linnemer (2003). 16<br />

The CL weighting scheme reflects objective factors as well as expert opini<strong>on</strong>s. All journals<br />

listed in Ec<strong>on</strong>Lit are given a positive weight. The journal weights range between 1<br />

12 and<br />

1. Thus, it is assumed that 12 articles published in journals of the lowest category c<strong>on</strong>tain<br />

ceteris paribus the same research achievement as <strong>on</strong>e article which is published in <strong>on</strong>e of<br />

the leading journals. The CL scheme c<strong>on</strong>tains six categories with the weights 1<br />

12<br />

, 1<br />

6<br />

, 1<br />

3<br />

1 2 , 2 , 3<br />

and 1. The lower the category, the more journals it c<strong>on</strong>tains. Only five journals receive<br />

a weight of 1 (AER, Ec<strong>on</strong>ometrica, JPE, QJE, RES), but 138 journals a weight of 1<br />

6 .<br />

All journals that are not explicitly listed in <strong>on</strong>e of the first five categories that c<strong>on</strong>tain<br />

approximately 230 journals, fall into the last category and receive a weight of 1<br />

12 .<br />

The research activity of the universities is recorded <strong>on</strong> an annual basis. In order to<br />

compensate for accidental fluctuati<strong>on</strong>s between two c<strong>on</strong>secutive years, we however prefer<br />

to present moving two year averages. We chose this presentati<strong>on</strong> because we want the<br />

ranking to reflect the normal productivity of a university and not random events such as<br />

publicati<strong>on</strong> lags and faculty turnover.<br />

15 Kalaitzidakis et al. (2003) for example gave the Journal of Internati<strong>on</strong>al Ec<strong>on</strong>omics, which is a leading<br />

journal in its field, a quality weight which is 13 times smaller than that of the American Ec<strong>on</strong>omic<br />

Review; a paper in Kyklos is rated 110 times less valuable than a paper in the American Ec<strong>on</strong>omic<br />

Review.<br />

16 Our results are not very sensitive with respect to the weighting scheme. The rank correlati<strong>on</strong> coefficients<br />

between our benchmark ranking and rankings based <strong>on</strong> seven other weighting schemes are, in general,<br />

quite high (see the German working paper versi<strong>on</strong> of this paper, http://twi.ch.uni-k<strong>on</strong>stanz.de/<br />

twi_research.php).<br />

9

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!