Final Report Pilot Project - Phase 1

of seventeen competences out of the previous thirty rated bygraduates and employers, this ranking was created using asimilar transformation applied to a seventeen points scale:seventeen was assigned if the competence was chosen first,sixteen to the second competence, etc.5.7. ResultsGRADUATESIntracluster correlations (Table 1, Table 2) 18 indicate to what extentuniversities are different from each other and the effect of clusteredobservations on sampling errors. The highest intracluster correlation isfor Knowledge of a second language both as importance (0,2979) andachievement (0,2817). The next highest two are Elementary computingskills-Achievement (0,2413) and Ethical commitment-Importance(0,1853). From the list of items regarding importance, 21 out of 30show intracluster correlations lower than 0.1 and from the list of itemsregarding achievement the proportion goes to 10 out from 30. Resultsseem consistent: when graduates rate universities, they seem to bemore in terms of achievement than importance.Means for all items were calculated taking into account the intraclustercorrelation using multilevel models for each item with no explanatoryvariables and allowing a random intercept for each level. At this stagethree levels were considered: country, university and final respondent.Therefore the intercept in the model yielded the mean for each item withadequate estimates of the sampling error for each estimate.The results are shown in Table 3, Table 4 and Table 5. These resultswere displayed as confidence intervals (1 – a = 95 %) in Figure 1,Figure 2 and Figure 3.EMPLOYERSFor the data collected from employers a similar analysis was performed.Multilevel modelling showed that the country effect —employersbelonging to same country— seems stronger than the university effect—employers belonging to same university in the data collectionprocess— compared to graduates as it would be expected. Means for18For tables 1-8 See Tuning website: www.relint.deusto.es/TuningProject/index.html orwww.let.rug.nl/TuningProject/index.html or europa.eu.int/comm/education/tuning.html.81