27.06.2013 Views

Proceedings of the 12th European Conference on Knowledge ...

Proceedings of the 12th European Conference on Knowledge ...

Proceedings of the 12th European Conference on Knowledge ...

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

Pavel Bogolyubov<br />

fields but year and names more <str<strong>on</strong>g>of</str<strong>on</strong>g>ten than not involved extensive search <strong>on</strong> o<str<strong>on</strong>g>the</str<strong>on</strong>g>r databases such as<br />

Emerald Insight and SpringerLink or using Google, since original records were <str<strong>on</strong>g>of</str<strong>on</strong>g>ten incomplete.<br />

Citati<strong>on</strong>s were taken exclusively from Google Scholar: in general, <str<strong>on</strong>g>the</str<strong>on</strong>g>re was a well pr<strong>on</strong>ounced<br />

disparity between <str<strong>on</strong>g>the</str<strong>on</strong>g> numbers <strong>on</strong> ABI and Google, sometimes by <str<strong>on</strong>g>the</str<strong>on</strong>g> factor <str<strong>on</strong>g>of</str<strong>on</strong>g> ten, and in all but two<br />

or three cases <str<strong>on</strong>g>the</str<strong>on</strong>g> citati<strong>on</strong> numbers <strong>on</strong> ABI were lower; at <str<strong>on</strong>g>the</str<strong>on</strong>g> same time, Google’s figures were<br />

c<strong>on</strong>sistent with o<str<strong>on</strong>g>the</str<strong>on</strong>g>r databases.<br />

Keywords, providing a basis for fur<str<strong>on</strong>g>the</str<strong>on</strong>g>r c<strong>on</strong>tents analysis, were predominantly ABIs for <str<strong>on</strong>g>the</str<strong>on</strong>g> sake <str<strong>on</strong>g>of</str<strong>on</strong>g><br />

c<strong>on</strong>sistency, however, in a limited number <str<strong>on</strong>g>of</str<strong>on</strong>g> cases <str<strong>on</strong>g>the</str<strong>on</strong>g>y had to be taken from o<str<strong>on</strong>g>the</str<strong>on</strong>g>r databases or<br />

suggested up<strong>on</strong> reading <str<strong>on</strong>g>the</str<strong>on</strong>g> papers.<br />

It is worth menti<strong>on</strong>ing that all figures discussed in this paper were valid in November 2010; <str<strong>on</strong>g>the</str<strong>on</strong>g>y tend<br />

to change fairly rapidly as I have seen several times during <str<strong>on</strong>g>the</str<strong>on</strong>g> few m<strong>on</strong>ths <str<strong>on</strong>g>of</str<strong>on</strong>g> working <strong>on</strong> <str<strong>on</strong>g>the</str<strong>on</strong>g> paper,<br />

and this is effectively a snapshot in time.<br />

As far as processing <str<strong>on</strong>g>the</str<strong>on</strong>g> numbers is c<strong>on</strong>cerned, <str<strong>on</strong>g>the</str<strong>on</strong>g> intenti<strong>on</strong> was to use <str<strong>on</strong>g>the</str<strong>on</strong>g> aforementi<strong>on</strong>ed paper by<br />

Serenko and B<strong>on</strong>tis dedicated to meta-analysis <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>the</str<strong>on</strong>g> literature <strong>on</strong> <strong>Knowledge</strong> Management and<br />

Intellectual Capital (Serenko and B<strong>on</strong>tis 2004) as a general template, hence <str<strong>on</strong>g>the</str<strong>on</strong>g> choice <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>the</str<strong>on</strong>g><br />

database. The fundamental principle <str<strong>on</strong>g>of</str<strong>on</strong>g> assessing <str<strong>on</strong>g>the</str<strong>on</strong>g> productivity and impact as key indicators<br />

remained in force, but a few things were d<strong>on</strong>e differently.<br />

First <str<strong>on</strong>g>of</str<strong>on</strong>g> all, instead <str<strong>on</strong>g>of</str<strong>on</strong>g> limiting <str<strong>on</strong>g>the</str<strong>on</strong>g> search to a number <str<strong>on</strong>g>of</str<strong>on</strong>g> leading journals, I have included all available<br />

records, for two reas<strong>on</strong>s: from a technical point <str<strong>on</strong>g>of</str<strong>on</strong>g> view, my set was <str<strong>on</strong>g>of</str<strong>on</strong>g> a manageable size, and<br />

besides, full search would provide a more comprehensive assessment <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>the</str<strong>on</strong>g> entire field.<br />

Sec<strong>on</strong>d, I have chosen a straight count method <str<strong>on</strong>g>of</str<strong>on</strong>g> calculating <str<strong>on</strong>g>the</str<strong>on</strong>g> productivity – in o<str<strong>on</strong>g>the</str<strong>on</strong>g>r words, every<br />

author gets a point for (co-) authoring a paper regardless <str<strong>on</strong>g>of</str<strong>on</strong>g> how many people are involved. It is worth<br />

menti<strong>on</strong>ing that <str<strong>on</strong>g>the</str<strong>on</strong>g>re are several o<str<strong>on</strong>g>the</str<strong>on</strong>g>r ways <str<strong>on</strong>g>of</str<strong>on</strong>g> doing it, such as based <strong>on</strong> author positi<strong>on</strong> <strong>on</strong> <str<strong>on</strong>g>the</str<strong>on</strong>g> list<br />

(<str<strong>on</strong>g>the</str<strong>on</strong>g> fur<str<strong>on</strong>g>the</str<strong>on</strong>g>r down, <str<strong>on</strong>g>the</str<strong>on</strong>g> lower <str<strong>on</strong>g>the</str<strong>on</strong>g> proporti<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> credit is attributed), equal credit (every<strong>on</strong>e gets an equal<br />

porti<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>the</str<strong>on</strong>g> total <str<strong>on</strong>g>of</str<strong>on</strong>g> <strong>on</strong>e point) and normalised page size (<str<strong>on</strong>g>the</str<strong>on</strong>g> bigger <str<strong>on</strong>g>the</str<strong>on</strong>g> paper, <str<strong>on</strong>g>the</str<strong>on</strong>g> better), all <str<strong>on</strong>g>of</str<strong>on</strong>g><br />

<str<strong>on</strong>g>the</str<strong>on</strong>g>m, however, with <str<strong>on</strong>g>the</str<strong>on</strong>g>ir own drawbacks and limitati<strong>on</strong>s. Fur<str<strong>on</strong>g>the</str<strong>on</strong>g>rmore, I believe that straight count<br />

provides an answer to <str<strong>on</strong>g>the</str<strong>on</strong>g> questi<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> how many research-active authors are in each instituti<strong>on</strong> and in<br />

each country - in o<str<strong>on</strong>g>the</str<strong>on</strong>g>r words, it helps to identify <str<strong>on</strong>g>the</str<strong>on</strong>g> research locale.<br />

Third, even though authors’ names were ga<str<strong>on</strong>g>the</str<strong>on</strong>g>red too, I have decided to discard <str<strong>on</strong>g>the</str<strong>on</strong>g>m at least for <str<strong>on</strong>g>the</str<strong>on</strong>g><br />

time being and not to calculate productivity and impact by name as adding little to answering <str<strong>on</strong>g>the</str<strong>on</strong>g> key<br />

questi<strong>on</strong>s.<br />

The citati<strong>on</strong> impact was calculated starting from straight count, however, bearing in mind that citati<strong>on</strong>s<br />

accumulate over <str<strong>on</strong>g>the</str<strong>on</strong>g> time, individual numbers were time-normalised to generate <str<strong>on</strong>g>the</str<strong>on</strong>g> Normalised<br />

Citati<strong>on</strong> Impact Index – NCII (Holsapple, Johns<strong>on</strong> et al. 1994) – simply put, <str<strong>on</strong>g>the</str<strong>on</strong>g> number <str<strong>on</strong>g>of</str<strong>on</strong>g> citati<strong>on</strong>s<br />

divided by <str<strong>on</strong>g>the</str<strong>on</strong>g> paper’s age in years. Naturally, <str<strong>on</strong>g>the</str<strong>on</strong>g> methods has its own weaknesses – for instance, a<br />

paper published in December 2009 would get twice less credit than <strong>on</strong>e published a m<strong>on</strong>th later,<br />

however, taking papers’ l<strong>on</strong>gevity into account in a more accurate way would be unrealistic given <str<strong>on</strong>g>the</str<strong>on</strong>g><br />

volume <str<strong>on</strong>g>of</str<strong>on</strong>g> data processed.<br />

Publicati<strong>on</strong> counts were added up by instituti<strong>on</strong> and country to generate total numbers, whereas total<br />

NCIIs were divided by corresp<strong>on</strong>ding total publicati<strong>on</strong> numbers to show average time-normalised<br />

number <str<strong>on</strong>g>of</str<strong>on</strong>g> citati<strong>on</strong>s per author per paper.<br />

As a final point, it is worth menti<strong>on</strong>ing that given <str<strong>on</strong>g>the</str<strong>on</strong>g> amount <str<strong>on</strong>g>of</str<strong>on</strong>g> manual data processing involved, <str<strong>on</strong>g>the</str<strong>on</strong>g><br />

analysis has proven to be not a pastime for <str<strong>on</strong>g>the</str<strong>on</strong>g> fain<str<strong>on</strong>g>the</str<strong>on</strong>g>arted. An extensive amount <str<strong>on</strong>g>of</str<strong>on</strong>g> pro<str<strong>on</strong>g>of</str<strong>on</strong>g>reading<br />

was involved to avoid duplicati<strong>on</strong>, especially in instituti<strong>on</strong>s’ names: for example, Oxford University<br />

could be listed in three different ways (Oxford University, University <str<strong>on</strong>g>of</str<strong>on</strong>g> Oxford and The University <str<strong>on</strong>g>of</str<strong>on</strong>g><br />

Oxford – all three appearing in different places <strong>on</strong> <str<strong>on</strong>g>the</str<strong>on</strong>g> lists), not to menti<strong>on</strong> <str<strong>on</strong>g>the</str<strong>on</strong>g> n<strong>on</strong>-English names<br />

that could be spelt differently in a number <str<strong>on</strong>g>of</str<strong>on</strong>g> languages. I regret to admit that despite multiple<br />

accuracy checks, some minor errors and omissi<strong>on</strong>s may still remain due to a high volume and varied<br />

format <str<strong>on</strong>g>of</str<strong>on</strong>g> data as well as <str<strong>on</strong>g>the</str<strong>on</strong>g> variety <str<strong>on</strong>g>of</str<strong>on</strong>g> sources involved. I would like to apologise in advance for any<br />

errors, should <str<strong>on</strong>g>the</str<strong>on</strong>g>y come to light.<br />

99

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!