students with two years less instruction in English and here we are not talking about advantagedmiddle class children did better in English than those who had two years more instruction in <strong>the</strong>U.S. Why should this be, and why should it be that, nationally, blacks consistently average belowHispanics in achievement scores, even though blacks are almost all native speakers <strong>of</strong> English?The answers are not simple to find, and we should beware <strong>of</strong> simplistic unidimensionalresponses. Educational programs for non- English-speaking students, whe<strong>the</strong>r bilingual or all-English, do not exist in isolation from <strong>the</strong> schools, school systems, and communities in which<strong>the</strong>y are embedded, any <strong>of</strong> which may exert more effects on program outcomes--for good or ill--than many <strong>of</strong> <strong>the</strong> efforts that are expended in instruction, curriculum design, or materialsdevelopment. Ogbu (1978) has argued that <strong>the</strong> long-term effects <strong>of</strong> social and economicdiscrimination may negatively affect <strong>the</strong> cultural attitudes and expectations <strong>of</strong> minoritycommunities. At <strong>the</strong> same time, research on school "climate" and <strong>the</strong> effects <strong>of</strong> educationalleadership at <strong>the</strong> school level show that <strong>the</strong>se influences are not wholly deterministic, and that<strong>the</strong> attitudes and behaviors <strong>of</strong> principals can affect academic results for an entire school. Thefindings <strong>of</strong> recent "school effectiveness” research (Rutter, 1983) indicate that whole-schooleffects do exist and maybe considerable.It is easy to take refuge in <strong>the</strong> "home-school discontinuity hypo<strong>the</strong>sis," or <strong>the</strong> "linguisticmismatch hypo<strong>the</strong>sis," to explain <strong>the</strong> educational problems <strong>of</strong> many <strong>of</strong> <strong>the</strong> non-English-speakingstudents in our schools. But <strong>the</strong>se simplistic answers--though <strong>the</strong>y are certainly relevant--do notaccount satisfactorily for <strong>the</strong> academic stratification <strong>of</strong> blacks and Hispanics in <strong>the</strong> U.S.--orAsians, for that matter. Here we are in a larger realm <strong>of</strong> <strong>the</strong> effect <strong>of</strong> attitudes on instruction,learning opportunities, motivation, and cognitive demands. Language does not exist in a vacuum,and how it is developed, and for what purposes, lies beyond but is inextricably intertwined withlanguage form and use. The recognition <strong>of</strong> <strong>the</strong>se issues helps frame <strong>the</strong> problem for any effort torelate language assessment to academic placement and achievement.Recent developments in <strong>the</strong> field <strong>of</strong> cognitive psychology have also begun to emphasizerecognition <strong>of</strong> <strong>the</strong> complexities <strong>of</strong> human knowledge and behavior. One <strong>of</strong> those working on <strong>the</strong>cutting edge <strong>of</strong> this field nationally is Rand Spiro (Spiro, Cousin, Feltovich and Anderson, 1988;Spiro, Vispoel, Schmitz, Samarapungavan and Boerger, 1987), who is challenging <strong>the</strong>oversimplification and lim<strong>ited</strong> scope <strong>of</strong> previous work in schema <strong>the</strong>ory and arguing that <strong>the</strong>reare many areas <strong>of</strong> knowledge which are best characterized as "ill-structured domains," andrequire a more complex approach to understand. He is proposing that we adopt Wittgenstein'smetaphor <strong>of</strong> landscapes in examining <strong>the</strong>se areas, since <strong>the</strong>y can be looked at from differentperspectives, and may look different depending on <strong>the</strong> perspective from which <strong>the</strong>y are observed.This view is consonant with o<strong>the</strong>r recent developments in science generally, which move awayfrom <strong>the</strong> older notion that <strong>the</strong> way to study a phenomenon is to artificially simplify it as much aspossible, and to abstract away from <strong>the</strong> complexities <strong>of</strong> natural contexts. While at an early stagein <strong>the</strong> development <strong>of</strong> a science this approach may have some heuristic value, <strong>the</strong>re is a seriousdanger that <strong>the</strong> understandings which result may in fact be an artifact <strong>of</strong> <strong>the</strong> simplification, andmay have to be rejected when an analysis is undertaken which more fully acknowledges <strong>the</strong>complexities. The danger is greater in that <strong>the</strong> illusion that we are dealing with a "well-structureddomain" contributes to development <strong>of</strong> overly rigid schemata, which have been shown to inhibittransfer and application <strong>of</strong> knowledge in an "ill-structured domain," such as education. Cziko(1989) has recently come to a similar conclusion, namely, that much <strong>of</strong> <strong>the</strong> failure <strong>of</strong> educationalresearch in particular, and <strong>the</strong> social sciences more generally, to arrive at valid generalizations© 2008 Dr. Ca<strong>the</strong>rine CollierAll Rights Reserved50
arises from <strong>the</strong> efforts to abstract, simplify, and analyze data indexically ra<strong>the</strong>r than in <strong>the</strong>fullness <strong>of</strong> <strong>the</strong>ir ecological context.Language AssessmentWhat <strong>the</strong>n <strong>of</strong> testing and assessment <strong>of</strong> LEP students for academic purposes? Languageassessment in <strong>the</strong> past, developed largely by linguists working with specialists in measurement,nei<strong>the</strong>r <strong>of</strong> whom have immediate experience in educational contexts, has generally followedpositivistic models and has been focused on language ra<strong>the</strong>r than on language in relation toacademic pr<strong>of</strong>iciency. If we ask, what is really important to assess in regard to a LEP student'schances for succeeding in a regular English-medium classroom?, we are posing a very differentkind <strong>of</strong> question than has been asked in <strong>the</strong> past, and one which, considering <strong>the</strong> complexities Ihave discussed, requires a very different answer.First <strong>of</strong> all, it is important to recognize that existing language assessment measures show a verylow productivity with regard to academic achievement, suggesting that <strong>the</strong>y measure <strong>the</strong> wrongthings from an educationally-significant perspective, and are largely irrelevant for academicpurposes. Such tests reflect <strong>the</strong> earlier simplistic view that language was <strong>the</strong> only, or principal,factor affecting academic achievement, so such results are not surprising, and indeed might havebeen expected. Given our present realization <strong>of</strong> <strong>the</strong> complexity <strong>of</strong> factors affecting achievement,what sort <strong>of</strong> assessment program might we need that would give due recognition to all <strong>of</strong> <strong>the</strong>sefactors? Since it is evident that different factors and diverse configurations <strong>of</strong> factors affectachievement <strong>of</strong> LEP students differently in various contexts, one approach which might beproposed would be to measure as many <strong>of</strong> <strong>the</strong>se factors as is feasible, and to examine <strong>the</strong>irrelation to academic achievement independently in each context. Before this can be done, it willbe necessary to carefully map <strong>the</strong> areas which are to be assessed. We cannot measure knowledgeor language pr<strong>of</strong>iciency directly, since we cannot simply insert electrodes into <strong>the</strong> brain to do so.Consequently we must construct maps representing <strong>the</strong> areas <strong>of</strong> <strong>the</strong> landscape to be assessed, and<strong>the</strong>n develop instruments which validly sample <strong>the</strong> maps.Assessment should be multidimensional. The multidimensionality <strong>of</strong> <strong>the</strong> aspects which need tobe considered move us beyond two- dimensional cubes to three-dimensionally interconnectedarrays <strong>of</strong> <strong>the</strong>se cubes in a model resembling Rubik's famous six-sided cube. Each <strong>of</strong> <strong>the</strong>se faceswould <strong>the</strong>n be divided into sub-areas: language, for instance, would include subdivisions fordifferent skills in both native and second languages, and academic achievement subdivisions forcognitive processing capacities, content knowledge, and performance skills. The main point <strong>of</strong>such a model is to recognize not only <strong>the</strong> complexity <strong>of</strong> <strong>the</strong> facets involved, but <strong>the</strong>irinterconnection as well. This obviously goes beyond what can be portrayed on a twodimensionalpage, but is quite feasible with computer-modeling capabilities. Ano<strong>the</strong>r approach isto consider what constitutes <strong>the</strong> ingredients <strong>of</strong> successful academic achievement among nativeEnglish-speaking children, and how <strong>the</strong> schools at present routinely measure student progressand use such information in <strong>the</strong>ir ongoing operations. Since reading ability in English is <strong>the</strong>single most important skill determining school achievement beyond <strong>the</strong> third grade, this is amajor criterion in measuring student progress, ei<strong>the</strong>r in <strong>the</strong> form <strong>of</strong> formal tests, or in informalteacher assessment. As has been well-known for a number <strong>of</strong> years, <strong>the</strong> most highly correlatedsub score within a reading test with <strong>the</strong> overall score is that for vocabulary knowledge, so muchso that <strong>the</strong> vocabulary subtest is <strong>of</strong>ten administered as a proxy for <strong>the</strong> full test. Thus we in ESLare rediscovering what educators have known for some time--that vocabulary knowledge is one<strong>of</strong> <strong>the</strong> most important determinants <strong>of</strong> academic achievement, and vocabulary tests provide one© 2008 Dr. Ca<strong>the</strong>rine CollierAll Rights Reserved51
- Page 2 and 3: "Those who arrive by age 12 or 13 m
- Page 5: Article I.2 Are Signed Languages "R
- Page 8 and 9: Biological analyses of the status o
- Page 10 and 11: and beyond, speaking and signing ch
- Page 12 and 13: Conclusion: Are Signed Languages Re
- Page 14 and 15: Article I.3 The Interpreter: Has a
- Page 16 and 17: A few weeks earlier, I had called F
- Page 18 and 19: “We struggled even getting to the
- Page 20 and 21: herself by strapping a cassette rec
- Page 22 and 23: In 1998, after nine years as the ch
- Page 24 and 25: momentary burst of excitement that
- Page 26 and 27: can shape core grammar. Because the
- Page 28 and 29: The authors compared animal and hum
- Page 30 and 31: monkey moved. He followed it with h
- Page 32 and 33: delight, fear, laughter, and surpri
- Page 34 and 35: Piipaío in a hut: Pirahã huts typ
- Page 36 and 37: LEP students, and equitable organiz
- Page 38 and 39: 4. Second language development crea
- Page 41 and 42: curriculum or "teaching to the test
- Page 43 and 44: portfolio work was scanned and stor
- Page 45 and 46: experiences of many groups of stude
- Page 47 and 48: While not disagreeing that interpre
- Page 49: sound educational practice, however
- Page 53 and 54: Article II.2 Cross-Cultural Communi
- Page 55 and 56: males who can serve as positive rol
- Page 57 and 58: Understanding another culture is a
- Page 59 and 60: Pets and AnimalsWhich animals are v
- Page 61 and 62: to teach standard English is reflec
- Page 63 and 64: Asking personal questions of a pers
- Page 65 and 66: Using Cross Cultural Communication
- Page 67 and 68: Why Do Nonstandard English-Speaking
- Page 69 and 70: Before beginning to teach standard
- Page 71 and 72: • Negative attitudes toward low p
- Page 73 and 74: New standardized tests and assessme
- Page 75 and 76: Each of the behaviors listed above
- Page 77 and 78: Article II.3 Hard Work Hypothesis:
- Page 79 and 80: each point higher in SES, students
- Page 81 and 82: This case does not provide strong s
- Page 83 and 84: Article II.4 Language Acquisition a
- Page 85 and 86: 1992, p. XI). These researchers, wh
- Page 87 and 88: comprehend a word within a specific
- Page 89 and 90: more to the truthfulness of the chi
- Page 91 and 92: This idea of “semilingualism” c
- Page 93 and 94: Article III.1 A Brief Description o
- Page 95 and 96: take different lengths of time to c
- Page 97 and 98: example, should involve the same co
- Page 99 and 100: As with all stages of BICS acquisit
- Page 101 and 102:
Assessment techniques at stage 3 ca
- Page 103 and 104:
different. Therefore, the social di
- Page 105:
integrative motivation. Basically,
- Page 109 and 110:
(Ellis, 1985; Hakuta, 1986). Howeve
- Page 111 and 112:
that sociocultural processes have o
- Page 113 and 114:
Article III.3 How Children Acquire
- Page 115 and 116:
phonetic units (unique to signed la
- Page 117 and 118:
Article III.4 Toward a Sociocultura
- Page 119 and 120:
emember is that the fundamental goa
- Page 121 and 122:
The best practices models can be th
- Page 123 and 124:
By focusing on the dialectic betwee
- Page 125 and 126:
intergenerational wisdom shared by
- Page 127 and 128:
Daily Realities RecappedThe above v
- Page 129 and 130:
traditions. At a time in our histor
- Page 131 and 132:
We will now look at two examples of
- Page 133 and 134:
Speakers communicate fluently, main
- Page 135 and 136:
question the effects of such attitu
- Page 137 and 138:
Article IV.3 Culture Change: Effect
- Page 139 and 140:
and psychological characteristics o
- Page 141 and 142:
Contraryto what wewere expecting, t
- Page 143 and 144:
Article V.1 Assessment in ESL & Bil
- Page 145 and 146:
vocabulary does the student lack?Is
- Page 147 and 148:
whether they are LEP and to provide
- Page 149 and 150:
Fourth, ESL and bilingual program s
- Page 151 and 152:
competent reader/writer. All versio
- Page 153 and 154:
Table 1Comparison of Recent Accultu
- Page 155 and 156:
unilinear model, which measures the
- Page 157 and 158:
an English-only instructional progr
- Page 159 and 160:
Article V.3 Assessment of English L
- Page 161 and 162:
8. Change answers only for a very g
- Page 163 and 164:
Riles, 1979; Jose P. v Ambac, 1983)
- Page 165 and 166:
proficiency is often underestimated
- Page 167 and 168:
Finally, when second language reade
- Page 169 and 170:
for their decisions, noting issues
- Page 171 and 172:
As mentioned above, when the transi
- Page 173 and 174:
ather than generic adjectives and t
- Page 175 and 176:
their imagined points of view. Ther
- Page 177 and 178:
English texts and demonstrate progr
- Page 179:
using inter-district teams). In the