Mapping Diversity: Developing a European Classification of ... - U-Map

56 Annex III: The pilot survey
Introduction
Purpose of the pilot survey
The main purpose of the pilot survey was to test the questionnaires that were to be sent out to a
larger group of higher education institutions. Identifi cation of fl aws in the questionnaires in the eyes
of respondents in higher education institutions and getting their suggestions for amendments to
the questionnaires were the major goals set for the pilot. A secondary purpose was to create a fi rst
version of a data base on the indicators and dimensions selected.
Set-up
In co-operation with the Advisory Board, eleven higher education institutions were identifi ed that
volunteered to be test cases for the pilot questionnaires. In July 2007 two questionnaires were sent
out to these higher education institutions; one questionnaire on the dimensions and one on the
indicators. By the end of August 2007 eight valid responses were received. These eight included
the two in-depth case study institutions presented in Annex II.
The questionnaires
Two questionnaires were sent out to the test case institutions. Both questionnaires were sent out as
on-line versions only.
In the questionnaire on dimensions two questions were asked (for each individual dimension):
1. is the dimension essential for profi ling your own higher education institution? (probing the
perceived relevance of the dimensions)
2. is the indicator described a valid indicator? (probing the validity of the indicators: do they
measure the phenomenon central to the dimension?)
Respondents had to use a slide bar to indicate to what extent they agreed or disagreed with the
statements given.
MAPPING DIVERSITY
In the questionnaire on the indicators respondents had to answer two blocks of questions. The fi rst
block referred to the actual data and information on reference data, like totals and reference years.
The second block referred to an assessment of the indicator in terms of feasibility and reliability.
Respondents were furthermore invited to comment on the choice of indicators and the way they
were measured.
The results
The dimensions
The classifi cation, phase I report concluded with 14 dimensions. Based on the discussions in
the Advisory Board and the Stakeholder Group (12 December 2006), the dimension ‘community
engagement’ was replaced by two other dimensions: ‘regional engagement’ and ‘cultural
engagement’.