12.01.2015 Views

RESEARCH METHOD COHEN ok

RESEARCH METHOD COHEN ok

RESEARCH METHOD COHEN ok

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

EFFECT SIZE 523<br />

Box 24.17<br />

The Levene test for equality of variances<br />

Levene’s test<br />

for equality<br />

of variances<br />

Independent samples test<br />

t-test for equality of means<br />

Chapter 24<br />

How well<br />

learners are<br />

cared for,<br />

guided and<br />

supported<br />

Equal variances<br />

assumed<br />

Equal variances<br />

not assumed<br />

95 % confidence<br />

interval of the<br />

difference<br />

Sig. Mean SE<br />

F Sig. t df (2-tailed) difference difference Lower Upper<br />

8.344 0.004 1.923 998 0.055 0.30 0.155 −0.006 0.603<br />

2.022 811.922 0.044 0.30 0.148 0.009 0.589<br />

The effect size can be worked out thus (using<br />

SPSS):<br />

t 2<br />

t 2 + (N 1 − 1) = 16.588 2<br />

16.588 2 + (1000 − 1)<br />

=<br />

275.162<br />

275.162 + 999 = 0.216<br />

In this example the effect size is 0.216, a very large<br />

effect, i.e. there was a very substantial difference<br />

between the scores of the two groups.<br />

For analysis of variance (discussed later) the<br />

effect size is calculated thus:<br />

Eta squared =<br />

Sum of squares between groups<br />

Total sum of squares<br />

In SPSS this is given as ‘partial eta squared’. For<br />

example, let us imagine that we wish to compute<br />

the effect size of the difference between four<br />

groups of schools on mathematics performance<br />

in a public examination. The four groups of<br />

schools are: rural primary; rural secondary; urban<br />

primary; urban secondary. Analysis of variance<br />

yields the result shown in Box 24.20.<br />

Working through the formula yields the<br />

following:<br />

Sum of squares between groups<br />

= 7078.619<br />

Total sum of squares<br />

344344.8 =0.021 alternative equations to take account of<br />

Box 24.18<br />

Mean and standard deviation in a paired sample<br />

test<br />

Paired samples statistics<br />

Mean N SD SE mean<br />

Pair Maths 81.71 1,000 23.412 0.740<br />

1 Science 67.26 1,000 27.369 0.865<br />

The figure of 0.021 indicates a small effect size, i.e.<br />

that there is a small difference between the four<br />

groups in their mathematics performance (note<br />

that this is a much smaller difference than that<br />

indicated by the significance level of 0.006, which<br />

suggests a statistically highly significant difference<br />

between the four groups of schools.<br />

In regression analysis (discussed later) the effect<br />

size of the predictor variables is given by the beta<br />

weightings. In interpreting effect size here Muijs<br />

(2004: 194) gives the following guidance:<br />

0–0.1 weak effect<br />

0.1–0.3 modest effect<br />

0.3–0.5 moderate effect<br />

>0.5 strong effect<br />

Hedges (1981) and Hunter et al. (1982) suggest

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!