13.07.2015 Views

Calibrating tests to the CEFR

Calibrating tests to the CEFR

Calibrating tests to the CEFR

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

The European Association for Quality Language Servicesdemonstrated above. And <strong>the</strong> extent <strong>to</strong> which two different measures correlate will always belimited. Correlations of 0.7-0.8 between two good, validated <strong>tests</strong> or examinations are normal.The equivalences published by Educational Testing Services on <strong>the</strong> equivalent scores for TOEFLand TOEIC were long based on a study showing a correlation of only 0.75 between <strong>the</strong> two<strong>tests</strong>. TOEFL and TOEIC have different styles and test language in different domains. O<strong>the</strong>rpairs of <strong>tests</strong> will use different item types. Performance <strong>tests</strong> (teacher rating of a sample)assess something different <strong>to</strong> knowledge <strong>tests</strong> (teacher marking of language items). Teachers –over a period of time – will see things that <strong>tests</strong> – taken one morning - do not.Apart from such “legitimate” reasons why results from different <strong>tests</strong> will only relate in a limitedfashion, <strong>the</strong>re are all sorts of o<strong>the</strong>r reasons. Testing is an imperfect science. Learners are notinvariable objects: atmosphere, emotional mood, amount of sleep, digestion – all contextualfac<strong>to</strong>rs affect assessment results.Therefore, if one can achieve a modest success in independently proving a statisticalrelationship between an assessment and <strong>the</strong> <strong>CEFR</strong> levels by following logical steps in aprincipled manner as suggested, <strong>the</strong>n one should be more than satisfied.© EAQUALS: The European Association for Quality Language Services:EAQUALS SECRETARIAT: P.O. Box 95, Budapest, H-1301 HungaryEmail: info@eaquals.org Internet: www.eaquals.orgRegistered Office: Via Torrebianca 18 34132 Trieste, Italy12

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!