Lecture 4: Principles of Psychometrics: Reliability II - jhsph ocw

More documents

Recommendations

Info

Reliability for Individual Ratings So far we’ve calculated reliability of the mean score for each TA. What is the average reliability of each individual rating of the TA?
Reliability of Individual Scores in Unique Rater Design MSB − MSW MSB + ( m −1) MSW Where m = number of raters per TA Continuing with our example: ( 12. 67 −1. 50) Re liability = = 12. 67 + ( 3−1) * 1. 50 . 7128
Page 1 and 2: This work is licensed under a Creat
Page 3 and 4: • Review of ANOVA Outline • Int
Page 5 and 6: Are the true means for each group d
Page 7 and 8: . oneway score1 group Analysis of V
Page 9 and 10: . oneway score13 group Analysis of
Page 11 and 12: Overview • Unique Design: Each of
Page 13 and 14: Fixed Design • Total Overlap of R
Page 15 and 16: Types of Reliability • There are
Page 17 and 18: Unique Rater Design ICC Equation to
Page 19 and 20: Between Mean Score Variance Degree
Page 21 and 22: Unique Rater Design (cont’d) 2) W
Page 23 and 24: Unique Rater Design Shortcut: Use p
Page 25: Important Note 1. Reliability is a
Page 29 and 30: Fixed Rater Design Recall that the
Page 31 and 32: 5 5.5 6 6.5 7 Rater Mean Variance 1
Page 33 and 34: Steps in Stata 1. Calculate overall
Page 35 and 36: Fixed Rater Design Equation to esti
Page 37 and 38: Random Rater Design: Reliability fo
Page 39 and 40: Summary 1. Unique Rater Design: Eac
Page 41 and 42: Question 1 State the conditions und
Page 43 and 44: Question 2 You have developed a new
Page 45 and 46: Question 3 Doesn’t high reliabili
Page 47 and 48: Question 4 Imagine two graphs, Figu
Page 49 and 50: Question 5 Using observed score as
Page 51 and 52: Question 6 Using observed score as
Page 53 and 54: Question 7 Scenario 1: Reported cor
Page 55 and 56: Question 8 A. How are the alpha and
Page 57 and 58: Question 9 For a ten-item scale wit
Page 59 and 60: Question 10 Two psychiatrists disag
Page 61 and 62: Question 11 Measures of self-report
Page 63 and 64: Question 12 An 10-item ASP measure
Page 65 and 66: 3. Determine how many items to add
Page 67 and 68: Fixed Effects (a) Set by experiment
Page 69: • We already saw an example of th

Lecture 4: Principles of Psychometrics: Reliability II - jhsph ocw

Create successful ePaper yourself

Delete template?

Save as template?