ICCS 2009 Technical Report - IEA

Classroom observation recordThe classroom observation record was used to register the monitors’ observations of the ICCStesting session and interview with the school coordinator and/or test administrator. The recordwas organized into four sections (listed below) in order to facilitate accurate recording of thetest administration’s major activities:• Section A: Preliminary activities of the test administrator;• Section B: Survey administration activities during the testing session;• Section C: Summary observations;• Section D: Interview with the school coordinator and/or test administrator.Preliminary activities of the test administratorIQCMs registered, in the first section of the classroom observation record, their observationsof the condition of the survey materials, the test administrator’s level of preparation, and thesuitability of the testing room. Table 9.1 provides a summary of the entered information.In general, this information confirmed the very good quality of the preparations for testing.The IQCMs were able to provide reasonable explanations for the very few cases where theyobserved deviations from the correct preliminary procedures. For instance, they generallyattributed discrepancies between the student identification information on the instruments andthe student tracking form to new students having joined the class after the tracking form wascompleted or to typographical errors in the list that were then corrected.Although the IQCMs judged most test administrators as being familiar with the testadministration script, they reported some cases where delay in receiving the manuals affectedadministrators’ level of preparedness. The test administrators who did not have a watch witha second hand typically used a cell phone or classroom clock to accurately control the timeof the survey administration. In general, the monitors observed no procedural deviations inthe test preparations that they deemed severe enough to jeopardize the integrity of the testadministration.Table 9.1: Percentages of IQCM responses for preliminary activities of the test administratorQuestion Yes (%) No (%) Not Answered (%)Did the test administrator verify adequate supplies of the test booklets 94 5 1and questionnaires prior to the students’ arrival?Does the student identification information on the test booklets and 97 2 1student questionnaires correspond with the student tracking form?Did the test administrator familiarize himself or herself with the test 90 8 1administration script prior to the testing?Was there adequate seating space for the students to work without 95 5 0distractions?Was there adequate room for the test administrator to move around 96 4 1during the session to ensure that students were following directionscorrectly?Did the test administrator have a watch with a second hand 92 7 1(or stopwatch) for accurately timing the sessions?Note: Percentages given in tables are rounded.QUALITY ASSURANCE IN THE ICCS DATA COLLECTION105