The psychopathology of everyday art: a quantitative Study - World ...

Variable
name
Red
Yellow
Orange
Purple
Green
Blue
Brown
White
Black
Intensity
Paint-Line
Draw-Line
Space
Em-Tone
Form
Authorities differ on recommended methods of inter-rater reliability statistics,
and there are few previous good examples in this field 277 . A supporting equivalence test,
such as Cronbach's alpha, used to demonstrate internal consistency between items
measuring the same attribute is recommended 278 .
Table 17. to show means and standard deviations* of rater scores for each variable over
the sample of 7 pictures. There is a maximum of 20 point scores for each variable.
Simple counts are used.
Rater 1
5.29(4.31)
7.43(5.47)
3.57(7.16)
5.29(7.57)
6.86(4.88)
9.29(6.63)
5.28(5.50)
0.86(2.27)
12.14(6.31
)
15.38(4.46
)
5.62(4.41)
0.81(1.86)
8.46(5.36)
13.05(4.01
)
5.57(5.56)
*S.D. in parenthesis
Rater 2
6.86(5.52)
7.57(5.00)
3.57(6.88)
4.86(5.90)
6.86(4.95)
9.71(6.50)
3.43(4.58)
1.00(2.65)
11.86(6.31
)
14.48(2.57
)
7.19(4.64)
0.62(1.50)
8.11(4.79)
13.86(2.62
)
4.86(5.96)
Rater 3
6.14(4.88)
7.14(4.49)
3.71(6.97)
4.00(5.45)
6.29(4.96)
8.86(6.23)
3.00(5.20)
1.00(2.65)
11.43(6.21
)
16.19(4.03
)
6.19(3.80)
0.62(1.64)
8.49(4.97)
15.62(3.75
)
4.57(5.88)
Rater 4
6.86(4.26)
7.86(5.61)
2.71(7.18)
4.71(6.78)
5.57(4.04)
8.71(5.94)
4.86(5.43)
1.00(2.65)
12.14(6.54
)
16.33(3.41
)
7.19(4.84)
1.38(3.65)
7.00(3.96)
13.52(3.90
)
4.71(5.88)
225
Rater 5
5.00(4.00)
7.57(5.38)
3.14(7.08)
5.00(6.88)
6.29(4.54)
10.43(6.35
)
3.29(4.72)
0.57(1.51)
11.29(6.52
)
16.86(3.57
)
6.81(4.98)
0.81(2.14)
7.97(4.61)
12.52(4.94
)
4.71(5.88)
Rater 6
5.57(4.20)
7.57(5.88)
2.57(6.80)
3.57(4.79)
6.43(4.47)
10.00(6.35
)
5.43(6.40)
1.00(2.65)
11.71(6.45
)
14.67(4.23
)
6.29(3.82)
0.71(1.89)
7.94(4.66)
13.00(3.21
)
4.86(5.52)
Rater 7
6.43(5.16)
8.14(5.64)
3.14(7.08)
4.14(5.70)
5.86(4.45)
8.14(5.34)
3.14(5.40)
0.00(0.00)
11.86(6.59)
16.67(3.35)
7.76(4.74)
0.76(2.02)
7.34(4.11)
13.76(4.95)
4.57(5.88)
Table 19. Inter-rater reliability showing Cronbach alpha score for internal consistency
of scores between raters; and correlation coefficient for linear association between scores
of raters.
Variables Cronbach
Alpha
Red
Yellow
Orange
Purple
.987
.994
.995
.993
Intra-Class
.975
.988
.991
.986
277
Graham Dunn (1989), Design and Analysis of Reliability Studies: the statistical evaluation of
measurement errors , London: Arnold, recommends the correlation coefficient; Carol Taylor-Fitzgibbon &
Lynn Lyons-Morris (1987), How to analyse Data , Beverley Hills, CA: SAge, echo the concerns of Altman
that linear association does not imply agreement and suggest additional notes of discrepancies and
difference statistics.
278 Fitzgibbon & Morris (1987) op.cit.