Lecture 4: Principles of Psychometrics: Reliability II - jhsph ocw

More documents

Recommendations

Info

Which ICC Is Most Appropriate? Scenario 1: A target child’s three best friends all report on the target child’s level of drug use. Scenario 2: You develop a screener to help identify victims of domestic abuse in emergency rooms; each patient is to be rated by three nurses at each hospital and you use the mean score in your analyses. a) Which ICC would give you the estimated reliability for the nurses at your one pilot hospital? b) Which ICC would give you an estimate of the reliability for the measure when used by different nurses at different hospitals? c) Which ICC would give you an estimate for the reliability of the measure if it were to be administered by only one nurse instead of three?
Question 1 State the conditions under which the Unique Rater ICC (for mean values of an item) is identical to the value of the Fixed Rater ICC (for mean values of an item)? Answer in terms of the variance of between, within, and rater sum of squares.
Page 1 and 2: This work is licensed under a Creat
Page 3 and 4: • Review of ANOVA Outline • Int
Page 5 and 6: Are the true means for each group d
Page 7 and 8: . oneway score1 group Analysis of V
Page 9 and 10: . oneway score13 group Analysis of
Page 11 and 12: Overview • Unique Design: Each of
Page 13 and 14: Fixed Design • Total Overlap of R
Page 15 and 16: Types of Reliability • There are
Page 17 and 18: Unique Rater Design ICC Equation to
Page 19 and 20: Between Mean Score Variance Degree
Page 21 and 22: Unique Rater Design (cont’d) 2) W
Page 23 and 24: Unique Rater Design Shortcut: Use p
Page 25 and 26: Important Note 1. Reliability is a
Page 27 and 28: Reliability of Individual Scores in
Page 29 and 30: Fixed Rater Design Recall that the
Page 31 and 32: 5 5.5 6 6.5 7 Rater Mean Variance 1
Page 33 and 34: Steps in Stata 1. Calculate overall
Page 35 and 36: Fixed Rater Design Equation to esti
Page 37 and 38: Random Rater Design: Reliability fo
Page 39: Summary 1. Unique Rater Design: Eac
Page 43 and 44: Question 2 You have developed a new
Page 45 and 46: Question 3 Doesn’t high reliabili
Page 47 and 48: Question 4 Imagine two graphs, Figu
Page 49 and 50: Question 5 Using observed score as
Page 51 and 52: Question 6 Using observed score as
Page 53 and 54: Question 7 Scenario 1: Reported cor
Page 55 and 56: Question 8 A. How are the alpha and
Page 57 and 58: Question 9 For a ten-item scale wit
Page 59 and 60: Question 10 Two psychiatrists disag
Page 61 and 62: Question 11 Measures of self-report
Page 63 and 64: Question 12 An 10-item ASP measure
Page 65 and 66: 3. Determine how many items to add
Page 67 and 68: Fixed Effects (a) Set by experiment
Page 69: • We already saw an example of th

Lecture 4: Principles of Psychometrics: Reliability II - jhsph ocw

You also want an ePaper? Increase the reach of your titles

Delete template?

Save as template?