Lecture 4: Principles of Psychometrics: Reliability II - jhsph ocw

More documents

Recommendations

Info

Unique Rater Design 1) Between Mean Score Variance, steps in Stata a) calculate mean scores for each individual *e.g. egen meanta = rmean(score1 score2 score3) b) calculate overall mean *e.g. egen grandmean = mean(meanta) c) calculate deviation of individual mean from group mean *e.g. gen bsquarei = 3*(meanta-grandmean)^2 d) add up all deviations in (c) *e.g. egen bsquare = sum(bsquarei) e) divide sum of squares by degrees of freedom *e.g. display bsquare/(10-1) =
Unique Rater Design (cont’d) 2) Within Mean Score Variance: Degree to which individual scores differ from a subject’s mean score 2 1 I m 2 = ∑ ∑ Y Y w ( 1) ij i I m i = 1 j = 1 ( ) 2 s − ≅ σ − Where: • I = number of individuals being rated (# of TAs) • R = number of raters •Yij = score of each individual rater Y • = mean score of each person rated i • m = number of raters for each mean Note: R=m w
Page 1 and 2: This work is licensed under a Creat
Page 3 and 4: • Review of ANOVA Outline • Int
Page 5 and 6: Are the true means for each group d
Page 7 and 8: . oneway score1 group Analysis of V
Page 9 and 10: . oneway score13 group Analysis of
Page 11 and 12: Overview • Unique Design: Each of
Page 13 and 14: Fixed Design • Total Overlap of R
Page 15 and 16: Types of Reliability • There are
Page 17 and 18: Unique Rater Design ICC Equation to
Page 19: Between Mean Score Variance Degree
Page 23 and 24: Unique Rater Design Shortcut: Use p
Page 25 and 26: Important Note 1. Reliability is a
Page 27 and 28: Reliability of Individual Scores in
Page 29 and 30: Fixed Rater Design Recall that the
Page 31 and 32: 5 5.5 6 6.5 7 Rater Mean Variance 1
Page 33 and 34: Steps in Stata 1. Calculate overall
Page 35 and 36: Fixed Rater Design Equation to esti
Page 37 and 38: Random Rater Design: Reliability fo
Page 39 and 40: Summary 1. Unique Rater Design: Eac
Page 41 and 42: Question 1 State the conditions und
Page 43 and 44: Question 2 You have developed a new
Page 45 and 46: Question 3 Doesn’t high reliabili
Page 47 and 48: Question 4 Imagine two graphs, Figu
Page 49 and 50: Question 5 Using observed score as
Page 51 and 52: Question 6 Using observed score as
Page 53 and 54: Question 7 Scenario 1: Reported cor
Page 55 and 56: Question 8 A. How are the alpha and
Page 57 and 58: Question 9 For a ten-item scale wit
Page 59 and 60: Question 10 Two psychiatrists disag
Page 61 and 62: Question 11 Measures of self-report
Page 63 and 64: Question 12 An 10-item ASP measure
Page 65 and 66: 3. Determine how many items to add
Page 67 and 68: Fixed Effects (a) Set by experiment
Page 69: • We already saw an example of th

Lecture 4: Principles of Psychometrics: Reliability II - jhsph ocw

You also want an ePaper? Increase the reach of your titles

Delete template?

Save as template?