In-Basket Design: Developing and Implementing an On-Line ... - IPAC
In-Basket Design: Developing and Implementing an On-Line ... - IPAC
In-Basket Design: Developing and Implementing an On-Line ... - IPAC
You also want an ePaper? Increase the reach of your titles
YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.
Step 10: Conduct Key Clear<strong>an</strong>ce<br />
Questions we ask during key clear<strong>an</strong>ce:<br />
• Item difficulty (p-values)<br />
• What percent of c<strong><strong>an</strong>d</strong>idates select the keyed response<br />
• Is the item overly difficult or too easy<br />
• Item point biserial correlations<br />
• Does highest pbi correspond to the keyed response<br />
• Variation within the distribution of response options<br />
• How often is each response option being endorsed<br />
• Are ―top‖ c<strong><strong>an</strong>d</strong>idates endorsing the keyed response<br />
• Which response options are being endorsed by poorer<br />
performers<br />
• <strong>In</strong>ternal consistency reliability<br />
• What would happen if a low performing item was dropped<br />
<strong>IPAC</strong> Annual Conference 2011<br />
43
Change language