Preface to the Third Edition - Handbook of inter-rater reliability, 3rd ...
Preface to the Third Edition - Handbook of inter-rater reliability, 3rd ...
Preface to the Third Edition - Handbook of inter-rater reliability, 3rd ...
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
-x- Contents<br />
3.4 Generalizing Kappa, Pi, and BP Coefficients <strong>to</strong> Interval<br />
Data, and Multiple Raters .......................................57<br />
3.5 More Weighting Options for Agreement Coefficients ..............61<br />
Chapter 4<br />
AC1 and α Coefficients ...................................................69<br />
4.1 Overview ........................................................70<br />
4.2 Gwet’s AC1 and Aickin’s α for2Raters ..........................71<br />
4.3 Aickin’sTheory ..................................................75<br />
4.4 Gwet’sTheory ...................................................78<br />
4.5 Calculating AC1 for3RatersorMore ............................83<br />
4.6 AC2 :<strong>the</strong>AC1 CoefficientforOrdinalandIntervalData...........86 4.7 ConcludingRemarks .............................................91<br />
Chapter 5<br />
Agreement Coefficients and Statistical Inference .........................93<br />
5.1 Theproblem .................................................... 94<br />
5.2 Finite Population Inference in Inter-Rater Reliability Analysis . . . 97<br />
5.3 ConditionalInference ...........................................101<br />
5.4 UnconditionalInference .........................................115<br />
5.5 ConcludingRemarks ............................................119<br />
Chapter 6<br />
Benchmarking Inter-Rater Reliability Coefficients ......................121<br />
6.1 Overview .......................................................122<br />
6.2 Benchmarking<strong>the</strong>AgreementCoefficient ........................123<br />
6.3 TheProposedBenchmarkingMethod ...........................130<br />
6.4 CriticalValueCalculation .......................................135<br />
6.5 ConcludingRemarks ............................................139<br />
PART 3: Intraclass Correlation Coefficients<br />
Chapter 7<br />
Intraclass Correlation in One-Fac<strong>to</strong>r Studies............................151<br />
7.1 Whatis<strong>the</strong>Issue? ..............................................152<br />
7.2 TheDesign<strong>of</strong>ReliabilityStudies ................................152<br />
7.3 IntraclassCorrelationunderModel1A ..........................154<br />
7.4 IntraclassCorrelationunderModel1B ..........................160<br />
7.5 StatisticalInferenceaboutICCunderModels1Aand1B ........165