09.12.2012 Views

I__. - International Military Testing Association

I__. - International Military Testing Association

I__. - International Military Testing Association

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

------ ---- __ ._ ._ -.._-_-- .--.<br />

- .<br />

large by research standards (r = .5252) was not statistically<br />

significant (p = .237).<br />

Difference Scores and Failure Rates. Using a 50th percentile<br />

personnel reading ability as a target base, the correlation of<br />

the RGL deficits with first time exam failure rate was .2117<br />

with a probability equal to . 101 -- not statistically significant.<br />

When a 15th percentile target base was used, the correlation<br />

of the deficits with first time failure rates was also<br />

not significant (r = .2459, p = .068). Similar analyses of .<br />

course failure rates yielded the same result.<br />

Conclusion<br />

FORCAST reading grade levels were not significantly associated<br />

with end-of-course test performance, reading grade level targets<br />

using the Air Force Reading Ability Test scale, or Flesch-<br />

Kincade reading difficulty obtained from a computer analysis.<br />

Additionally, FORCAST reading grade levels had not changed consistently<br />

over time. There was evidence that RGL had risen<br />

slightly sometime during the eight year period but it was unclear<br />

whether the rise was continuing.<br />

Careful examination of the summed evidence suggested, however,<br />

that the null outcomes were possibly due to an aggressive<br />

"clearly written text" program within ECI. This effort, which<br />

replaced FORCAST in the mid-1980s, introduced an ongoing conscious<br />

effort on the part of the text writers and reviewers to<br />

ensure the readability of the materials. Earlier information<br />

suggested that use of FORCAST was associated with a reduction in<br />

reading difficulties to the point where FORCAST was no longer<br />

predictive. Present data suggested that the "clearly written<br />

text" standard may continue to limit the value of FORCAST as a<br />

predictive indicator.<br />

Discussing more generally the issue of attention to RGL, it was<br />

noted that most ways of determining RGL and tests designed to<br />

assess the reading ability of students were highly correlated -often<br />

as highly intercorrelated as the validity coefficients of<br />

the individual measures. Differences in outcome Values were<br />

typically due to scale. The task of maintaining acceptably low<br />

reading difficulty within written materials was primarily one of<br />

maintained focus on the problem using any of several means. FOR-<br />

CAST was one means easily calculated by hand. The Flesch-<br />

Kincade RGL provided here by Right-Writer, although almost<br />

necessitating a computer, was a viable option especially when<br />

the written material was already in an acceptable word processing<br />

medium. The Right-Writer output in fact contained consider-<br />

I . ..1__<br />

II- -...<br />

130

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!