Insight Psychometrics Technical Manual - Canadian Test Centre

More documents

Recommendations

Info

percentile is determined and this produces the frequency of occurrence andsignificance for reporting.The indications of Degree of Linguistic Demand and Degree of CulturalLoading are simply based on the numeric values of the correspondingstandard scores.13
Statistical analysesItem statisticsDuring the developmental steps of the <strong>Insight</strong> assessment, careful selectionwas given to classical item statistics—difficulty, discrimination, distracterfunctioning. Items that showed problems were rewritten or discarded andreplacement items were chosen. (As mentioned, the initial development poolswere much larger than needed for the final test.)In the final construction of the subtests, the principal goal was to put itemsin each subtest at each level that would provide appropriate accuracy overthe whole range for tests such as Gc, and especially at extremes for tests suchas Ga. The decisions about item selection were informed mainly by the itemdifficulty: the Rasch beta parameter.Further guidance was obtained from graphical regressions of the classicalitem difficulties (percent correct) on age, differentiated by level. A completeset of graphs for the Gc, Gv and Gf subtests is given in Appendix C, with onegraph for each item included in the final <strong>Insight</strong> assessment. An example ofa graph is given in Figure 15.Figure 15: Example of an item regressed on age and level14
Page 1 and 2: InsightTechnical ManualRichard Wolf
Page 3 and 4: Table of figuresFigure 1 Test level
Page 5 and 6: 29 in Level 2. Notice that some ite
Page 7 and 8: Development stepsThe items were wri
Page 9 and 10: Figure 11: Regional Anglophone popu
Page 11 and 12: Practically, this means that the Le
Page 13 and 14: Figure 13: Glr regression by age an
Page 15: 6) From the final scores, national
Page 19 and 20: of the correlations of the underlyi
Page 21 and 22: Validity analysesCheck on gender bi
Page 23 and 24: Figure 20: Insight compared to WISC
Page 25 and 26: Connection to Canadian Achievement
Page 27 and 28: Figure 25: Standard errors of measu
Page 29: Appendix A. Item locations and stan
Page 51: Appendix C. Item-age regressions fo

Insight Psychometrics Technical Manual - Canadian Test Centre

Create successful ePaper yourself

Delete template?

Save as template?