ICCS 2009 Technical Report - IEA

They received an overview of the study, which included information about instrumentpreparation and requirements for implementation, as well as a number of documents to supporttheir work. This material comprised the following documents:• ICCS 2009 International Quality Control Monitor Manual (ICCS International Study Center,2008a);• The classroom observation record (on which the IQCMS registered their observations);• Relevant sections of the ICCS 2009 Survey Operations Procedures Units, 1–3 (ICCSInternational Study Center, 2008b, c, d);• The ICCS 2009 School Coordinator Manual (ICCS International Study Center, 2008e);• The ICCS 2009 Test Administrator Manual (ICCS International Study Center, 2008f ); and• A manual for the administration of a regional module, where applicable (see ICCSInternational Study Center, 2008g, h, i).The IQCMs received an honorarium for their work from the Secretariat, which also reimbursedIQCMs for travel expenses associated with international training and school and national centervisits.The main responsibilities for each IQCM involved consulting with the NRC to gather requiredinformation and documentation, observing and reporting on the selected survey administrationsessions, and reviewing use of the translation verification results (see Chapter 5 for informationon translation verification). The IQCMs were required to:• Become thoroughly familiar with the ICCS testing procedures;• Gather from the NRC a complete set of national survey instruments and manuals, thetranslation verification record, and tracking forms for the selected schools;• Select, in consultation with the NRC and according to specified guidelines, the schoolswhere the data collection sessions would be observed;• Contact the school coordinator and test administrator of each selected school to organizethe monitoring visit and arrange the interview;• Observe the selected survey administration sessions for their level of adherence tothe administration guidelines, in each case documenting each session’s activities on aclassroom observation record;• Verify the completeness and accuracy of the lists of participating classes, teachers, andstudents for each visited school;• Interview the school coordinator and test administrator, and record their responses on theclassroom observation record;• Review the national research instruments and use made of the translation verificationresults, and document whether the verifiers’ comments were addressed appropriately; and• Submit all collected national materials and completed observation records to the IEAsecretariat.The IEA Secretariat received documentation of the international quality assurance program from37 of the 38 participating ICCS countries. The IQCM from the Dominican Republic did notsubmit the required materials. The data from the classroom observation record presented in thissection thus pertains to 37 countries.104 ICCS 2009 technical report