08.12.2012 Views

Preface to the Third Edition - Handbook of inter-rater reliability, 3rd ...

Preface to the Third Edition - Handbook of inter-rater reliability, 3rd ...

Preface to the Third Edition - Handbook of inter-rater reliability, 3rd ...

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

-x- Contents<br />

3.4 Generalizing Kappa, Pi, and BP Coefficients <strong>to</strong> Interval<br />

Data, and Multiple Raters .......................................57<br />

3.5 More Weighting Options for Agreement Coefficients ..............61<br />

Chapter 4<br />

AC1 and α Coefficients ...................................................69<br />

4.1 Overview ........................................................70<br />

4.2 Gwet’s AC1 and Aickin’s α for2Raters ..........................71<br />

4.3 Aickin’sTheory ..................................................75<br />

4.4 Gwet’sTheory ...................................................78<br />

4.5 Calculating AC1 for3RatersorMore ............................83<br />

4.6 AC2 :<strong>the</strong>AC1 CoefficientforOrdinalandIntervalData...........86 4.7 ConcludingRemarks .............................................91<br />

Chapter 5<br />

Agreement Coefficients and Statistical Inference .........................93<br />

5.1 Theproblem .................................................... 94<br />

5.2 Finite Population Inference in Inter-Rater Reliability Analysis . . . 97<br />

5.3 ConditionalInference ...........................................101<br />

5.4 UnconditionalInference .........................................115<br />

5.5 ConcludingRemarks ............................................119<br />

Chapter 6<br />

Benchmarking Inter-Rater Reliability Coefficients ......................121<br />

6.1 Overview .......................................................122<br />

6.2 Benchmarking<strong>the</strong>AgreementCoefficient ........................123<br />

6.3 TheProposedBenchmarkingMethod ...........................130<br />

6.4 CriticalValueCalculation .......................................135<br />

6.5 ConcludingRemarks ............................................139<br />

PART 3: Intraclass Correlation Coefficients<br />

Chapter 7<br />

Intraclass Correlation in One-Fac<strong>to</strong>r Studies............................151<br />

7.1 Whatis<strong>the</strong>Issue? ..............................................152<br />

7.2 TheDesign<strong>of</strong>ReliabilityStudies ................................152<br />

7.3 IntraclassCorrelationunderModel1A ..........................154<br />

7.4 IntraclassCorrelationunderModel1B ..........................160<br />

7.5 StatisticalInferenceaboutICCunderModels1Aand1B ........165

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!