<strong>Art</strong>icle V.4 Alternative Assessment for TransitionalReadersBy Carol Beaumont, Julia Scherba de Valenzuela, Elise TrumbullBilingual Research Journal, 26: 2 Summer 2002 214Equitable assessment for English language learners remains one <strong>of</strong><strong>the</strong> gre<strong>ates</strong>t challenges <strong>of</strong> educational reform. The complexinteraction <strong>of</strong> language, culture, educational background, andopportunities to learn make equitable, large-scale assessmentsparticularly difficult to achieve (Figueroa, 1990; García & Pearson,1994; Solano-Flores & Nelson-Barber, 2001; Ulibarri, 1985). Often,English language learners (ELLs) are assessed through <strong>the</strong> samemechanisms as <strong>the</strong>ir English-only counterparts. This practicecompromises <strong>the</strong> accuracy <strong>of</strong> results and may lead to inappropriateinterpretations about English language learners’ pr<strong>of</strong>iciency inreading and academic content areas (García, 1991; Miramontes,Nadeau & Commins 1997; Valdés & Figueroa, 1994).The purpose <strong>of</strong> this paper is to describe student performance on a specially designed assessment<strong>of</strong> reading comprehension created for native Spanish-speaking students in <strong>the</strong>ir first year <strong>of</strong>English instruction. This study was guided by <strong>the</strong> following questions: (a) How do scoring andstudent evaluation practices in this assessment account for linguistic characteristics <strong>of</strong> first-yearEnglish language learners? (b) What evidence exists that reflects first-year English languagelearners’ ability to process English texts at an inferential level? (c) How can this transitionassessment inform curriculum and instruction for <strong>the</strong>se students?Assessment Reform and English Language Learners<strong>In</strong> <strong>the</strong> decade-long debate on school reform, some educators favor new methods <strong>of</strong> assessment toremedy persistent problems in <strong>the</strong> American schooling. They have suggested that complex,cognitively demanding assessments can drive improvements in curriculum and instruction (e.g.,Darling-Hammond, 1994; Mitchell, 1992; O’Day & Smith, 1993). They have also pointed out<strong>the</strong> overrepresentation <strong>of</strong> ELLs and o<strong>the</strong>r students from non-dominant cultures among poorperformers on standardized tests(Figueroa, 1990; Valdés & Figueroa, 1994; Williams, 1996) and<strong>the</strong> consequent reinforcement and extension <strong>of</strong> social and educational inequalities (Darling-Hammond, 1994, Durán, 1989; Oakes, 1985).ELLs’ lack <strong>of</strong> full English pr<strong>of</strong>iciency is an obvious reason for <strong>the</strong>ir poor performance onstandardized tests (LaCelle-Peterson & Rivera, 1994; Cummins,1989; Genesee & Hamayan,1994), but it reflects a lim<strong>ited</strong> understanding <strong>of</strong> <strong>the</strong> factors contributing to a student’sperformance on an assessment or standardized test. To begin to grasp <strong>the</strong> relationship betweenEnglish pr<strong>of</strong>iciency and test performance requires a deep understanding <strong>of</strong> <strong>the</strong> developmentalnature <strong>of</strong> second language acquisition, <strong>the</strong> difference between surface fluency and <strong>the</strong> ability toparticipate in content area instruction in English, <strong>the</strong> time required to achieve academic fluency,<strong>the</strong> kinds <strong>of</strong> language conventions used on typical assessments and tests, and <strong>the</strong> language skillsnecessary for success on standardized tests. Because <strong>the</strong> length <strong>of</strong> time required for full English© 2008 Dr. Ca<strong>the</strong>rine CollierAll Rights Reserved164
pr<strong>of</strong>iciency is <strong>of</strong>ten underestimated (Collier; 1988;Cummins, 1989; Valdés, 1998), and studentsmay appear to be more pr<strong>of</strong>icient with English than <strong>the</strong>y are, <strong>the</strong>y may be expected to take testsin English long before <strong>the</strong>y are fully pr<strong>of</strong>icient with <strong>the</strong> kind <strong>of</strong> academic language needed toperform well. All <strong>of</strong> <strong>the</strong>se factors should be considered in designing appropriate assessment andinstruction.<strong>Sta</strong>ndardization itself rules out any contextualization <strong>of</strong> assessment, meaning that linguisticdifferences among students cannot be accounted for adequately. The practice <strong>of</strong> assessingEnglish language learners with <strong>the</strong> same mechanisms as <strong>the</strong>ir English-only counterparts mayseriously compromise <strong>the</strong> validity <strong>of</strong> results and lead to misleading interpretations and unfairdecisions affecting <strong>the</strong>ir futures (August & Hakuta, 1997; García, 1991;LaCelle-Peterson &Rivera, 1994; Miramontes, Nadeau & Commins, 1997;Valdés & Figueroa, 1994).English-language assessment prompts that make extensive use <strong>of</strong> complex or idiomatic languagepenalize English language learners who may access important concepts in <strong>the</strong>ir first language,but not yet in English, or <strong>the</strong>y may access <strong>the</strong>m more slowly in English (Abedi, 2001; Abedi,Leon, & Mirocha,2001, Figueroa & García, 1994, García, 1991, Heubert & Hauser,1999).Misinterpretations <strong>of</strong> <strong>the</strong> directions or text <strong>of</strong> an assessment task can lead to flawedconceptualization <strong>of</strong> <strong>the</strong> problem to be solved and consequent failure to devise a correct solution(Durán, 1989). <strong>In</strong> such cases, teachers or o<strong>the</strong>rs who grade or score an English language learner’sperformance may falsely underestimate that student’s level <strong>of</strong> understanding or skill.A move to standards-based performance assessments and o<strong>the</strong>r forms <strong>of</strong> “au<strong>the</strong>ntic” assessment(Valencia, Hiebert, & Afflerbach, 1994; Wiggins, 1993)does not ensure assessment validity forELLs. These kinds <strong>of</strong> assessments are subject to <strong>the</strong> same sources <strong>of</strong> error, particularly given<strong>the</strong>ir increased language demand in comparison to multiple choice or short answer tests(August& Hakuta, 1997; Shepard, 1993). Farr and Trumbull (1997) point out that, “good instruction andassessment should look different in different environments, depending on <strong>the</strong> students served”(p. 2).Assessments designed for native English speakers will simply not meet standards <strong>of</strong> validity forEnglish language learners. According to <strong>the</strong> <strong>Sta</strong>ndards for Educational and PsychologicalTesting (American Educational Research Association, American Psychological Association, &National Council on Measurement in Education, 1999):For all test takers, any test that employslanguage is, in part, a measure <strong>of</strong> <strong>the</strong>ir language skills. . . . Language dominance is notnecessarilyan indicator <strong>of</strong> language competence in taking a test, and some accommodation may benecessary even when administering <strong>the</strong> test in <strong>the</strong> more familiar language. Therefore, it isimportant to consider language background in developing, selecting, and administering tests andin interpreting test performance. (p. 91)Specific research studies on <strong>the</strong> validity <strong>of</strong> performance-based assessments for ELLs havefocused primarily on accommodations (e.g., increasing <strong>the</strong> time allotted for completion, allowing<strong>the</strong> use <strong>of</strong> dictionaries, or modifying <strong>the</strong> language <strong>of</strong> test prompts) ra<strong>the</strong>r than on major changesin <strong>the</strong> instruments <strong>the</strong>mselves (Abedi, 1997; Abedi, Lord, H<strong>of</strong>stetter, & Baker,2000; Kiplinger,Haug, & Abedi, 2000; Kopriva, 1997; Olson & Goldstein,1997; Sweet, 1997). Some have madeefforts to make fairer <strong>the</strong> scoring <strong>of</strong> ELLs’ responses (Wong Fillmore & Lara, 1996). However,little research literature exists on performance assessments for English language learners.© 2008 Dr. Ca<strong>the</strong>rine CollierAll Rights Reserved165
- Page 2 and 3:
"Those who arrive by age 12 or 13 m
- Page 5:
Article I.2 Are Signed Languages "R
- Page 8 and 9:
Biological analyses of the status o
- Page 10 and 11:
and beyond, speaking and signing ch
- Page 12 and 13:
Conclusion: Are Signed Languages Re
- Page 14 and 15:
Article I.3 The Interpreter: Has a
- Page 16 and 17:
A few weeks earlier, I had called F
- Page 18 and 19:
“We struggled even getting to the
- Page 20 and 21:
herself by strapping a cassette rec
- Page 22 and 23:
In 1998, after nine years as the ch
- Page 24 and 25:
momentary burst of excitement that
- Page 26 and 27:
can shape core grammar. Because the
- Page 28 and 29:
The authors compared animal and hum
- Page 30 and 31:
monkey moved. He followed it with h
- Page 32 and 33:
delight, fear, laughter, and surpri
- Page 34 and 35:
Piipaío in a hut: Pirahã huts typ
- Page 36 and 37:
LEP students, and equitable organiz
- Page 38 and 39:
4. Second language development crea
- Page 41 and 42:
curriculum or "teaching to the test
- Page 43 and 44:
portfolio work was scanned and stor
- Page 45 and 46:
experiences of many groups of stude
- Page 47 and 48:
While not disagreeing that interpre
- Page 49 and 50:
sound educational practice, however
- Page 51 and 52:
arises from the efforts to abstract
- Page 53 and 54:
Article II.2 Cross-Cultural Communi
- Page 55 and 56:
males who can serve as positive rol
- Page 57 and 58:
Understanding another culture is a
- Page 59 and 60:
Pets and AnimalsWhich animals are v
- Page 61 and 62:
to teach standard English is reflec
- Page 63 and 64:
Asking personal questions of a pers
- Page 65 and 66:
Using Cross Cultural Communication
- Page 67 and 68:
Why Do Nonstandard English-Speaking
- Page 69 and 70:
Before beginning to teach standard
- Page 71 and 72:
• Negative attitudes toward low p
- Page 73 and 74:
New standardized tests and assessme
- Page 75 and 76:
Each of the behaviors listed above
- Page 77 and 78:
Article II.3 Hard Work Hypothesis:
- Page 79 and 80:
each point higher in SES, students
- Page 81 and 82:
This case does not provide strong s
- Page 83 and 84:
Article II.4 Language Acquisition a
- Page 85 and 86:
1992, p. XI). These researchers, wh
- Page 87 and 88:
comprehend a word within a specific
- Page 89 and 90:
more to the truthfulness of the chi
- Page 91 and 92:
This idea of “semilingualism” c
- Page 93 and 94:
Article III.1 A Brief Description o
- Page 95 and 96:
take different lengths of time to c
- Page 97 and 98:
example, should involve the same co
- Page 99 and 100:
As with all stages of BICS acquisit
- Page 101 and 102:
Assessment techniques at stage 3 ca
- Page 103 and 104:
different. Therefore, the social di
- Page 105:
integrative motivation. Basically,
- Page 109 and 110:
(Ellis, 1985; Hakuta, 1986). Howeve
- Page 111 and 112:
that sociocultural processes have o
- Page 113 and 114: Article III.3 How Children Acquire
- Page 115 and 116: phonetic units (unique to signed la
- Page 117 and 118: Article III.4 Toward a Sociocultura
- Page 119 and 120: emember is that the fundamental goa
- Page 121 and 122: The best practices models can be th
- Page 123 and 124: By focusing on the dialectic betwee
- Page 125 and 126: intergenerational wisdom shared by
- Page 127 and 128: Daily Realities RecappedThe above v
- Page 129 and 130: traditions. At a time in our histor
- Page 131 and 132: We will now look at two examples of
- Page 133 and 134: Speakers communicate fluently, main
- Page 135 and 136: question the effects of such attitu
- Page 137 and 138: Article IV.3 Culture Change: Effect
- Page 139 and 140: and psychological characteristics o
- Page 141 and 142: Contraryto what wewere expecting, t
- Page 143 and 144: Article V.1 Assessment in ESL & Bil
- Page 145 and 146: vocabulary does the student lack?Is
- Page 147 and 148: whether they are LEP and to provide
- Page 149 and 150: Fourth, ESL and bilingual program s
- Page 151 and 152: competent reader/writer. All versio
- Page 153 and 154: Table 1Comparison of Recent Accultu
- Page 155 and 156: unilinear model, which measures the
- Page 157 and 158: an English-only instructional progr
- Page 159 and 160: Article V.3 Assessment of English L
- Page 161 and 162: 8. Change answers only for a very g
- Page 163: Riles, 1979; Jose P. v Ambac, 1983)
- Page 167 and 168: Finally, when second language reade
- Page 169 and 170: for their decisions, noting issues
- Page 171 and 172: As mentioned above, when the transi
- Page 173 and 174: ather than generic adjectives and t
- Page 175 and 176: their imagined points of view. Ther
- Page 177 and 178: English texts and demonstrate progr
- Page 179: using inter-district teams). In the