Research Matters

Table 4: Intra-rater reliability statistics for the 100-word sample
Variable Feature Type of Code Data Simple ICC
data range agreement
Stops Correct stops count ST1 1–9 0.75 0.95
Incorrect stops count ST2 0–1 0.87 0.60
Missing stops count ST3 0–6 0.82 0.95
Comma splices count ST4 0–4 0.86 0.79
Commas Correctly used count CO1 0–10 0.77 0.97
Omitted count CO2 0–5 0.61 0.69
Incorrectly used count CO3 0–2 0.91 0.71
Apostrophes Possession – correct count A1 0–1 1.00 1.00
Possession – incorrect count A2 0–0 1.00 1.00
Possession – omitted count A3 0–1 1.00 1.00
Abbreviation – correct count A4 0–4 0.84 0.94
Abbreviation – incorrect count A5 0–2 0.92 0.88
Other – Count count O1 0–10 0.64 0.89
punctuation Semicolon count O2 0–1 0.97 *
Colon count O3 0–1 1.00 1.00
Dash count O4 0–2 0.98 0.86
Hyphen count O5 0–1 0.93 *
Inverted commas count O6 0–5 0.80 0.82
Ampersand count O7 0–0 1.00 1.00
Ellipsis count O8 0–2 1.00 1.00
Brackets count O9 0–1 0.98 0.67
Other count O10 0–2 0.93 0.79
Capitalisation Sentence – correct count CA1 2–11 0.50 0.79
Sentence – omitted count CA2 0–3 0.77 0.58
Proper nouns – correct count CA3 0–12 0.75 0.90
Proper nouns – omitted count CA4 0–2 0.95 0.85
Non-proper nouns – incorrect count CA5 0–5 0.79 0.73
Grammar – Incorrect tense count G1 0–4 0.58 0.69
verbs Lack of subject-verb agreement count G2 0–1 0.90 *
Sentence Simple sentences count SS1 0–9 0.60 0.91
structure Multiple sentences count SS2 1–7 0.48 0.69
Coordination count SS3 0–8 0.38 0.83
Subordination count SS4 1–9 0.20 0.49
Vocabulary Sophistication of words scale V1 1–3 0.68 0.73
Informal language (count) count V2 0–5 0.39 0.34
Spelling Incorrect spellings (count) count SP1 0–7 0.54 0.78
18 | RESEARCH MATTERS – SPECIAL ISSUE 4: Aspects of Writing 1980–2014