Looking beyond <strong>the</strong> surface features <strong>of</strong> <strong>the</strong> students’ written responses, we next examined textprocessing patterns suggested by <strong>the</strong> nature <strong>of</strong> <strong>the</strong>ir answers. The transitional assessmentaddressed a number <strong>of</strong> reading comprehension skills including summarizing, identifying mainidea, and locating information in text. The items chosen for in-depth analysis, however, werethose that required more inferential responses, such as identifying character traits, notingcharacter development, determining <strong>the</strong> author’s purpose, and contrasting points <strong>of</strong> view. Asmentioned earlier, <strong>the</strong> distribution <strong>of</strong> holistic scores after <strong>the</strong> first test administration reflected <strong>the</strong>transitional students’ processing <strong>of</strong> English text primarily at <strong>the</strong> literal level, according to <strong>the</strong>district rubric. One might expect this for first year transition students, given <strong>the</strong>ir still-developingskills in decoding English. However, item analysis gave more specific information about whatstudents could do, what <strong>the</strong>y had difficulty doing, and <strong>the</strong> conditions under which students wereable to go beyond basic, literal answers to expand on text and make connections, generalizations,and extensions.Character traitsThe early items in <strong>the</strong> assessment required students to identify traits <strong>of</strong> <strong>the</strong> main characters and toprovide text-based justifications for <strong>the</strong>ir choice <strong>of</strong> adjectives. By requiring textual support, <strong>the</strong>item gave an indication <strong>of</strong> whe<strong>the</strong>r <strong>the</strong> adjectives used were meaningful to <strong>the</strong> students or weresimply copied from <strong>the</strong> text in a “match to sample” strategy (this strategy <strong>of</strong> lifting words from<strong>the</strong> text that match those in <strong>the</strong> comprehension questions has been identified as a commonapproach to comprehension test questions used by second language readers (Anderson & Roit,1996; Cole & Griffin, 1983). Three frequently occurring response patterns to this item wereidentified. <strong>In</strong> <strong>the</strong> first type <strong>of</strong> response, difficulty with text processing was evident from <strong>the</strong>mismatch <strong>of</strong> adjectives and textual support. <strong>In</strong> <strong>the</strong>se examples, students may have been able toidentify adjectives by lifting key words from <strong>the</strong> text but, when asked to justify <strong>the</strong>ir answers,were unable to do so. For example, <strong>the</strong> students might identify “stingy” as an appropriatedescription <strong>of</strong> a rich character in <strong>the</strong> story, and <strong>the</strong>n fail to use textual excerpts that demonstratethat <strong>the</strong>y understood <strong>the</strong> meaning <strong>of</strong> stingy and what actions proved <strong>the</strong> character deserved thatlabel.The second type <strong>of</strong> response involved <strong>the</strong> use <strong>of</strong> nonspecific adjectives coupled with appropriatetext support that would earn a 3 (adequate understanding) on <strong>the</strong> rubric. This could be <strong>the</strong> result<strong>of</strong> difficulty with text in-depth processing, suggesting that students got only a general idea <strong>of</strong> <strong>the</strong>character’s traits. However, as suggested above, <strong>the</strong> use <strong>of</strong> vague descriptors such as “nice,”“bad,” or “good” may also be a reflection <strong>of</strong> lim<strong>ited</strong> vocabulary ra<strong>the</strong>r than lim<strong>ited</strong> textprocessing. <strong>In</strong> describing one character, students used <strong>the</strong> vague descriptor “nice” in 20% <strong>of</strong> <strong>the</strong>responses. However, in 90%<strong>of</strong> those cases <strong>the</strong> students provided appropriate text support thatsuggests that <strong>the</strong>y did understand <strong>the</strong> basic description <strong>of</strong> <strong>the</strong> character and what evidence wasavailable to support that description. These three responses are illustrative examples <strong>of</strong> this type<strong>of</strong> response: “Nice”: (a) he was nice because he made a home fur <strong>the</strong>m; (b) because he helped <strong>the</strong>homeless by giving <strong>the</strong>m food; (c) when <strong>the</strong> señora gave her [referring to <strong>the</strong> beggar] <strong>the</strong> onionskins she humpbull [humbly]said muchas gracias.For <strong>the</strong> first two definitions, more specific adjectives that would have been appropriate include“helpful,” “generous,” or “kind,” but “nice” is not inappropriate, and <strong>the</strong> evidence given isaccurate. <strong>In</strong> <strong>the</strong> third definition, “nice” is used in <strong>the</strong> sense <strong>of</strong> “polite” and, again, <strong>the</strong> evidence isappropriate. The third definition gave <strong>the</strong> strongest suggestion <strong>of</strong> accurate text processing byindicating that students had understood <strong>the</strong> meaning <strong>of</strong> <strong>the</strong> adjectives <strong>the</strong>y used and chose <strong>the</strong>sedescriptors based on <strong>the</strong> text. The examples below demonstrate a clear match between specific,© 2008 Dr. Ca<strong>the</strong>rine CollierAll Rights Reserved172
a<strong>the</strong>r than generic adjectives and textual support, and would have received a 4 or 5 on <strong>the</strong>rubric—“clear” or “thorough” understanding <strong>of</strong> <strong>the</strong> text. Sixty-four percent <strong>of</strong> <strong>the</strong> studentsresponded with this type <strong>of</strong> response:‣ Greedy: Quickly <strong>the</strong> rich señora threw a cloth over her plate to hide <strong>the</strong> food piled.‣ Selfish: There were plenty <strong>of</strong> meat lots <strong>of</strong> corn and tortiallas. But <strong>the</strong> rich señora did not wantto waste such fine food on a beggar.‣ Stingy: Every day poor people came to her house to beg for food and every day she sent <strong>the</strong>maway with nothing.Some differences were noted in <strong>the</strong> responses to <strong>the</strong> character trait items for two characters. <strong>In</strong>one question students were asked to copy passages from <strong>the</strong> text that supported <strong>the</strong>ir adjectives,but for <strong>the</strong> o<strong>the</strong>r <strong>the</strong>y were asked to use <strong>the</strong>ir own words. The match-to-sample strategy forfinding textual support would not be as effective in <strong>the</strong> latter case. Perhaps as a result <strong>of</strong> beingfreed from copying exact information from <strong>the</strong> text, students used 18different adjectives todescribe <strong>the</strong> character in <strong>the</strong> second question, including sophisticated adjectives such asconvincing, successful, powerful, intelligent, active, and considerate, but only six differentadjectives to describe <strong>the</strong> character in <strong>the</strong> first question (stingy, bad, mean, selfish, greedy, rude).This stronger use <strong>of</strong> vocabulary in <strong>the</strong> second passage may also be a reflection <strong>of</strong> <strong>the</strong> text, whichprovided much more detail about <strong>the</strong> character than <strong>the</strong> fictional piece did about its two maincharacters. This level <strong>of</strong> analysis is important in <strong>the</strong> assessment <strong>of</strong> language learners where it is<strong>of</strong>ten difficult to ascertain which factors plays a role in <strong>the</strong> students’ responses.Character developmentSubsequent items required <strong>the</strong> students to expand on this basic sense <strong>of</strong> character to make morecomplex inferences. Asking students to write what <strong>the</strong> character is thinking about <strong>the</strong> things shedid in her life assessed understanding <strong>of</strong> character development. Asking students to imagine acharacter’s final thoughts as she drops into a sea <strong>of</strong> darkness required <strong>the</strong>m to attribute feelings,plans, motivations, and thoughts to <strong>the</strong> character. Two general types <strong>of</strong> responses wereidentified. <strong>In</strong> <strong>the</strong> first type, students inferred that <strong>the</strong> character regretted her actions because <strong>of</strong><strong>the</strong>ir impact on her. <strong>In</strong> <strong>the</strong> second type, students extended <strong>the</strong>ir understanding a bit by suggestingthat <strong>the</strong> character felt remorse for hurting o<strong>the</strong>r people. Both types <strong>of</strong> responses demonstrateinference and would have received scores <strong>of</strong> 3–5 on <strong>the</strong> rubric.Type 1 examples (regret):1. I tink tat she was tinking about tat she did not give food to <strong>the</strong> poor people and that she slamd<strong>the</strong> door to <strong>the</strong> old laydy, and god puneshd her becues she did not give food to <strong>the</strong> poor peopleand she was stingy2. If I have gave that old woman more that old onion, now I should be in heaven.<strong>In</strong> <strong>the</strong>se examples <strong>the</strong> students use details from <strong>the</strong> story to frame <strong>the</strong>ir answers, a response thatwould be considered a type <strong>of</strong> restatement <strong>of</strong> <strong>the</strong> text and thus earn a score <strong>of</strong> 3. Although thistype <strong>of</strong> response does reflect inference, it is a very basic level given <strong>the</strong> obvious result <strong>of</strong> heractions.Students who went beyond this level ascribed more complex motivations to <strong>the</strong> Rich Señora andby so doing, indicated <strong>the</strong>ir ability to go beyond literal thinking to, “understand connectionsamong story elements and overall meaning,” as level 4 <strong>of</strong> <strong>the</strong> rubric described, or “makeplausible interpretations or generalizations,” as characterized by <strong>the</strong> following examples.Type 2 examples (remorse):© 2008 Dr. Ca<strong>the</strong>rine CollierAll Rights Reserved173
- Page 2 and 3:
"Those who arrive by age 12 or 13 m
- Page 5:
Article I.2 Are Signed Languages "R
- Page 8 and 9:
Biological analyses of the status o
- Page 10 and 11:
and beyond, speaking and signing ch
- Page 12 and 13:
Conclusion: Are Signed Languages Re
- Page 14 and 15:
Article I.3 The Interpreter: Has a
- Page 16 and 17:
A few weeks earlier, I had called F
- Page 18 and 19:
“We struggled even getting to the
- Page 20 and 21:
herself by strapping a cassette rec
- Page 22 and 23:
In 1998, after nine years as the ch
- Page 24 and 25:
momentary burst of excitement that
- Page 26 and 27:
can shape core grammar. Because the
- Page 28 and 29:
The authors compared animal and hum
- Page 30 and 31:
monkey moved. He followed it with h
- Page 32 and 33:
delight, fear, laughter, and surpri
- Page 34 and 35:
Piipaío in a hut: Pirahã huts typ
- Page 36 and 37:
LEP students, and equitable organiz
- Page 38 and 39:
4. Second language development crea
- Page 41 and 42:
curriculum or "teaching to the test
- Page 43 and 44:
portfolio work was scanned and stor
- Page 45 and 46:
experiences of many groups of stude
- Page 47 and 48:
While not disagreeing that interpre
- Page 49 and 50:
sound educational practice, however
- Page 51 and 52:
arises from the efforts to abstract
- Page 53 and 54:
Article II.2 Cross-Cultural Communi
- Page 55 and 56:
males who can serve as positive rol
- Page 57 and 58:
Understanding another culture is a
- Page 59 and 60:
Pets and AnimalsWhich animals are v
- Page 61 and 62:
to teach standard English is reflec
- Page 63 and 64:
Asking personal questions of a pers
- Page 65 and 66:
Using Cross Cultural Communication
- Page 67 and 68:
Why Do Nonstandard English-Speaking
- Page 69 and 70:
Before beginning to teach standard
- Page 71 and 72:
• Negative attitudes toward low p
- Page 73 and 74:
New standardized tests and assessme
- Page 75 and 76:
Each of the behaviors listed above
- Page 77 and 78:
Article II.3 Hard Work Hypothesis:
- Page 79 and 80:
each point higher in SES, students
- Page 81 and 82:
This case does not provide strong s
- Page 83 and 84:
Article II.4 Language Acquisition a
- Page 85 and 86:
1992, p. XI). These researchers, wh
- Page 87 and 88:
comprehend a word within a specific
- Page 89 and 90:
more to the truthfulness of the chi
- Page 91 and 92:
This idea of “semilingualism” c
- Page 93 and 94:
Article III.1 A Brief Description o
- Page 95 and 96:
take different lengths of time to c
- Page 97 and 98:
example, should involve the same co
- Page 99 and 100:
As with all stages of BICS acquisit
- Page 101 and 102:
Assessment techniques at stage 3 ca
- Page 103 and 104:
different. Therefore, the social di
- Page 105:
integrative motivation. Basically,
- Page 109 and 110:
(Ellis, 1985; Hakuta, 1986). Howeve
- Page 111 and 112:
that sociocultural processes have o
- Page 113 and 114:
Article III.3 How Children Acquire
- Page 115 and 116:
phonetic units (unique to signed la
- Page 117 and 118:
Article III.4 Toward a Sociocultura
- Page 119 and 120:
emember is that the fundamental goa
- Page 121 and 122: The best practices models can be th
- Page 123 and 124: By focusing on the dialectic betwee
- Page 125 and 126: intergenerational wisdom shared by
- Page 127 and 128: Daily Realities RecappedThe above v
- Page 129 and 130: traditions. At a time in our histor
- Page 131 and 132: We will now look at two examples of
- Page 133 and 134: Speakers communicate fluently, main
- Page 135 and 136: question the effects of such attitu
- Page 137 and 138: Article IV.3 Culture Change: Effect
- Page 139 and 140: and psychological characteristics o
- Page 141 and 142: Contraryto what wewere expecting, t
- Page 143 and 144: Article V.1 Assessment in ESL & Bil
- Page 145 and 146: vocabulary does the student lack?Is
- Page 147 and 148: whether they are LEP and to provide
- Page 149 and 150: Fourth, ESL and bilingual program s
- Page 151 and 152: competent reader/writer. All versio
- Page 153 and 154: Table 1Comparison of Recent Accultu
- Page 155 and 156: unilinear model, which measures the
- Page 157 and 158: an English-only instructional progr
- Page 159 and 160: Article V.3 Assessment of English L
- Page 161 and 162: 8. Change answers only for a very g
- Page 163 and 164: Riles, 1979; Jose P. v Ambac, 1983)
- Page 165 and 166: proficiency is often underestimated
- Page 167 and 168: Finally, when second language reade
- Page 169 and 170: for their decisions, noting issues
- Page 171: As mentioned above, when the transi
- Page 175 and 176: their imagined points of view. Ther
- Page 177 and 178: English texts and demonstrate progr
- Page 179: using inter-district teams). In the