02.06.2013 Views

BYRAM VERSUS BENNETT: DISCREPANCIES IN THE ... - CERCLL

BYRAM VERSUS BENNETT: DISCREPANCIES IN THE ... - CERCLL

BYRAM VERSUS BENNETT: DISCREPANCIES IN THE ... - CERCLL

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

Proceedings of Intercultural Competence Conference September, 2012, Vol. 2, pp. 11-33<br />

http://cercll.arizona.edu<br />

<strong>BYRAM</strong> <strong>VERSUS</strong> <strong>BENNETT</strong>: <strong>DISCREPANCIES</strong> <strong>IN</strong> <strong>THE</strong> ASSESSMENT OF<br />

LEARNERS’ IC DEVELOPMENT<br />

Paula Garrett-Rucks<br />

Georgia State University<br />

email: prucks@gsu.edu<br />

Researchers in pursuit of best practices to foster cultural understanding in instructed foreign<br />

language (FL) learning often measure changes in learners’ intercultural competence (IC) in<br />

response to pedagogical interventions. The purpose of this paper is to provide 1) a brief<br />

overview of different types of definitions of and assessment tools for intercultural<br />

competence found in the literature, 2) an argument for qualitative studies to investigate IC<br />

development and 3) a comparison of the merits of two of the most commonly cited IC<br />

models in the literature—Byram’s (1997) multimodal model of intercultural competence and<br />

Bennett’s (1993) Developmental Model of Intercultural Sensitivity. The findings I present<br />

here come from a larger study in which I used both models to analyze the changes in<br />

beginning French language learners’ worldviews in weekly online classroom discussions<br />

centering on the French cultural practices of greetings, education and family life over the<br />

course of a 16 week semester. I present the discrepancies I found post-hoc in my data<br />

analysis—the instances where the same learners’ worldviews were interpreted differently<br />

according to the criteria defined in Byram and Bennett’s models—and then I speak to the<br />

merits of each model within the limitations of my study.<br />

<strong>IN</strong>TRODUCTION<br />

The need to understand languages and cultures other than one's own has become of<br />

paramount importance in the increasingly multicultural nature of industrialized societies. As a<br />

profession, foreign language (FL) educators have responded to the need to prepare learners to<br />

understand languages, cultures and worldviews other than their own. The American Council on<br />

the Teaching of Foreign Languages emphasized the need for learners to consider target culture<br />

members’ perspectives as an outcome of their FL learning experience as evidenced in the<br />

addition of the Cultures Standards (2.1 and 2.2) to the National Standards for Foreign Language<br />

Learning (1999). In the European context, Byram (1997) also underscored the importance in FL<br />

education to move beyond an understanding of communication as an exchange of information<br />

but rather to “understand and relate to people from other countries” (p. 5). Researchers and<br />

educators in pursuit of best practices to promote cultural reflection in instructed FL learning<br />

often evaluate the effectiveness of pedagogical interventions by assessing the changes in<br />

learners’ intercultural competence (IC). Two theoretical approaches to assess learners’ IC<br />

development—Byram’s multimodal model of IC and Bennett’s Developmental Model of<br />

Intercultural Sensitivity (DMIS)—are widely cited across the literature in qualitative research. In<br />

this paper, I report the discrepancies between these two models that I found post-hoc of the<br />

data analysis of a larger study in which I investigated the changes in learners’ worldviews during<br />

online classroom discussions at the individual level with Byram’s framework and the group level<br />

with Bennett’s DMIS. By drawing attention to the discrepancies between these models—the<br />

instances where the same learners’ worldviews were interpreted to be at different levels of IC<br />

development according to the criteria defined in Byram and Bennett’s models—I reveal the<br />

subtle differences in what these expert IC theorists deem essential elements of learners’ IC.<br />

In this paper I first present several aspects of intercultural learning commonly investigated<br />

across the literature. Next, I provide an overview of many of the definitions for cross-cultural<br />

Copyright © 2012 11


Paula Garrett-Rucks Byram Versus Bennett<br />

understanding found in the literature that are similar to what I am describing as IC. I then focus<br />

on quantitative IC assessment tools followed by a review of comparative research that speaks<br />

to the merits of qualitative approaches over quantitative assessments alone to investigate the IC<br />

developmental process. After that, I review qualitative IC assessment methodologies and<br />

theories, emphasizing two of the most widely cited theoretical approaches—Byram’s multimodal<br />

model of IC and Bennett’s Developmental Model of Intercultural Sensitivity (DMIS). This leads<br />

to the focus of the paper—the discrepancies I found when using both models to assess the<br />

same learners’ worldviews expressed over the course of a 16-week semester with both<br />

Bennett’s and Byram’s theoretical lenses. To do so, I briefly present the larger study conducted<br />

in which I analyzed the experiences of learners’ discussing cultural practices in a computermediated<br />

environment. Subsequently, I present the discrepancies I found post-hoc in my data<br />

analysis—the instances where the same learners’ worldviews were interpreted to be at different<br />

levels of IC development according to the criteria defined in Byram and Bennett’s models. I<br />

conclude the paper with an overview of the advantages and disadvantages I found when<br />

working with both models to investigate learners’ IC development.<br />

The aim of this paper is twofold. Firstly, I hope to empower readers with a stronger<br />

understanding of the research instruments and assessment tools used to measure IC<br />

development to critically evaluate the effectiveness of the pedagogical interventions investigated<br />

in the literature. Secondly, I hope to pique FL educators’ interest to create, implement and<br />

evaluate their own projects intended to foster learners’ IC and to promote cross-cultural<br />

understanding in the FL classroom.<br />

REVIEW OF <strong>THE</strong> LITERATURE<br />

Numerous studies have investigated aspects of intercultural learning such as 1) how students in<br />

intercultural communication with target language speakers exchange perspectives, opinions,<br />

and views (e.g., Belz, 2002; Belz & Müller-Hartmann, 2003; Furstenberg et al., 2001; Hanna &<br />

de Nooy, 2003; O’Dowd, 2003; Wade, 2005); 2) how native speakers (NS) and non-native<br />

speakers (NNS) co-create cultural impressions in discussions (Byram, 1997; Duffy & Mayes,<br />

2001; Johnson, 2008; Müller-Hartmann, 2000; McBride & Wildner-Bassett, 2008; Woodin,<br />

2001); or 3) how learners reflect on their own cultural beliefs in cross-cultural projects<br />

(Furstenberg et al., 2001, Müller-Hartmann, 2000; O’Dowd, 2003; Savignon & Rothmeier, 2004;<br />

Ware, 2005). Yet with no common yardstick used to measure learners’ development of<br />

intercultural understanding in these projects, it is difficult for educators to discern the potential<br />

value of replicating these projects in their own classrooms. A deeper understanding of both the<br />

definitions used to detect changes in learners’ cultural understanding and a familiarity with<br />

different types of IC assessment tools used across studies can help maximize educators’<br />

interpretation of research findings to help determine the applicability of the pedagogical<br />

intervention investigated in their own unique learning situations.<br />

DEF<strong>IN</strong>ITIONS FOR LEARNERS’ CROSS-CULTURAL UNDERSTAND<strong>IN</strong>G<br />

The broad concept of intercultural competence has led to a range of definitions and models that<br />

have served as the basis for different approaches to its assessment. Fantini (2006) provided a<br />

comprehensive list of related terms used across the literature to describe intercultural<br />

competence including intercultural communicative competence (ICC), cross-cultural<br />

awareness, intercultural sensitivity, ethnorelativity, and global competencies which all<br />

essentially account for the ability to step beyond one’s own culture and function with individuals<br />

from linguistically and culturally diverse backgrounds. Torres and Rollock (2007) defined<br />

intercultural competence in cultural psychology as “proficiency regarding culturally relevant<br />

12 <strong>CERCLL</strong> ICC Proceedings


Paula Garrett-Rucks Byram Versus Bennett<br />

areas and group-specific skills that facilitate cultural interactions” (p. 11). Sercu (2005) defined<br />

intercultural communicative competence (ICC) in FL education as a learner’s ability to cope with<br />

intercultural experiences. She further described the intercultural competencies and<br />

characteristics as:<br />

the willingness to engage with foreign culture, self-awareness and the ability to<br />

look upon oneself from the outside, the ability to see the world through the<br />

others’ eyes, the ability to cope with uncertainty, the ability to act as a cultural<br />

mediator, the ability to evaluate others’ point of view, the ability to consciously<br />

use culture learning skills and to read the cultural context, and the understanding<br />

that individuals cannot be reduced to their collective identities. (p. 2)<br />

Byram (1997) underlined the importance in FL education to move beyond an understanding of<br />

communication as an exchange of information but rather to “understand and relate to people<br />

from other countries” (p. 5). He defined successful communication in FL learning as the ability<br />

of learners to “establish and maintain relationships” (p. 3). Byram (2000) described the<br />

attributes of a person with intercultural competence communicative competence as:<br />

…someone who is able to see relationships between different cultures—both<br />

internal and external to a society— and is able to mediate, that is interpret each<br />

in terms of the other, either for themselves or for other people. It is also someone<br />

who has a critical or analytical understanding of (parts of) their own and other<br />

cultures—someone who is conscious of their own perspective, of the way in<br />

which their thinking is culturally determined, rather than believing that their<br />

understanding and perspective is natural. (p. 9)<br />

Described by Hoyt (2012) as “a constellation of notions” (p. 94), Byram’s multimodal model<br />

contains prescriptive definitions and 28 performance assessment objectives centering on<br />

learners’ attitudes, knowledge, skills, and critical cultural awareness. Byram (2000) described<br />

successful intercultural learners as “conscious of their own perspective, of the way in which their<br />

thinking is culturally determined, rather than believing that their understanding and perspective<br />

is natural” (p. 10).<br />

Echoing Byram’s definition of a successful intercultural learning, Bennett underscores the<br />

importance of understanding and accepting diverse cultural perspectives in order for individuals<br />

to shift from ethnocentric to ethnorelative ways of responding to cultural differences in his<br />

Developmental Model of Intercultural Sensitivity (DMIS). Bennett (1993) defines intercultural<br />

sensitivity as individuals’ psychological ability to deal with cultural differences. Hammer and<br />

Bennett (2001) described learners with basic intercultural sensitivity as able to recognize and<br />

accept the complexity of cultural differences as “different constructions of reality” (p. 12). There<br />

currently exist a large number of practices that have been recommended and implemented for<br />

assessing intercultural competence depending on the particular definition or model of<br />

intercultural competence adopted. The following section presents a brief review of some of the<br />

most salient quantitative and qualitative practices I found to assess intercultural competence<br />

across the literature.<br />

EXAMPLES OF QUANTITATIVE IC ASSESSMENT TOOLS (BASIC, ICSI, CCAI, IDI, AND<br />

<strong>IN</strong>CA)<br />

Many of the aforementioned studies in the review of the literature used surveys and<br />

questionnaires that were either designed by the researchers, or adapted from pre-existing IC<br />

assessment tools. Four salient types of assessment tools in the professional literature are for<br />

observers’ assessment of others (BASIC), self-reports (ICSI, CCAI and IDI), or a combination of<br />

<strong>CERCLL</strong> ICC Proceedings 13


Paula Garrett-Rucks Byram Versus Bennett<br />

self and other-reports (<strong>IN</strong>CA) as described in detail below.<br />

The Behavioral Assessment Scale for Intercultural Competence (BASIC) was developed from<br />

behavioral approaches to ICC. The BASIC test originally used 4- and 5-point Likert scales for<br />

observers to assess individuals’ display of respect, interaction management, knowledge,<br />

empathy and tolerance for ambiguity. Ruben and Kealey (1979) adapted this scale to assess<br />

individuals and their spouses moving and living abroad for one year in both pre- and post-<br />

deployments (Ruben & Kealey, 1979). Koester and Olebe (1988) adopted and further<br />

developed the BASIC scales for university students living in dorms to evaluate their roommates<br />

instead of trained raters. Their study suggested that untrained individuals familiar with their<br />

peers’ behavior are capable of using the BASIC scale to provide a picture of their intercultural<br />

communicative effectiveness.<br />

Assessment tools used to self-report include the ICSI, CCAI and IDI. The Intercultural<br />

Sensitivity Inventory (ICSI) (Bhawuk & Brislin, 1992) was developed to measure an individual’s<br />

ability to adapt when living between an individualistic culture (United States) and a collectivistic<br />

culture (Japan). It was used on business graduate students living in international dormitories to<br />

self-report how they imagined living and working in the United States and Japan on the basis of<br />

what they believed to be socially acceptable as well as generic items on flexibility and openmindedness<br />

by responding to questions on a 7-point Likert scale. The Cross-Cultural<br />

Adaptability Inventory (CCAI) scales were also developed in the early 1990’s to provide<br />

information about an individual’s ability to adapt to different cultures based on four dimensions:<br />

(1) emotional resilience, (2) flexibility and openness, (3) perceptual acuity, and (4) personal<br />

autonomy (Kelley & Meyers, 1995). It is a self-report survey of 50-items using six-point Likert<br />

scale. It has been used to assess study abroad experiences (Williams, 2005; Zielinski, 2007)<br />

and sensitivity training for medical students (Majumdar, Keystone, & Cuttress; 2006). Davis and<br />

Finney (2006) have challenged this test stating that it is not statistically trustworthy. The<br />

Intercultural Development Inventory (IDI) is a six-stage developmental model based on<br />

Bennett’s Developmental Model of Intercultural Sensitivity (DMIS) and has been used to assess<br />

the changes in intercultural competence of high school students attending international schools<br />

(Straffon, 2003), university students who studied abroad (Engle & Engle, 2004; Jackson, 2010)<br />

and students exposed to intercultural training (Altshuler, Sussman, & Kachur, 2003). The IDI is<br />

a 50-item self-assessment with five-point Likert scales. Studies (Hammer et al., 2003; Paige et<br />

al., 2003) have provided support for the reliability and content/construct validity of this<br />

instrument by cross-referencing expert raters (Paige et al., 2003) and comparing the<br />

relationship between respondents’ scores on the IDI and their responses on two related scales,<br />

the Worldmindedness Scale and the Intercultural Anxiety scale (Hammer et al., 2003).<br />

Like Bennett, Byram’s model has served as the impetus for the creation of quantitative research<br />

instruments such as surveys and questionnaires. An example of a widely recognized combined<br />

IC assessment test came from the Intercultural Competence Assessment Project (<strong>IN</strong>CA),<br />

greatly influenced by the work of Byram (1997). The <strong>IN</strong>CA includes three assessment types<br />

that combine direct and indirect ways of measuring ICC: questionnaires, scenarios, and role<br />

plays. Although the <strong>IN</strong>CA includes self- and other- reported components in its design, it is not<br />

uncommon for IC researchers to use mixed methodologies of self- and other reports in addition<br />

to quantitative and qualitative methodologies (e.g. Jackson, 2010).<br />

It is important to note that quantitative IC assessment studies have been scrutinized by several<br />

researchers who have expressed concerns about the research instruments designed to assess<br />

participants’ IC. For example, Arasaratnam and Doerfel (2005) questioned the ability of<br />

participants who have little experience in intercultural situations to self-report behavioral choices<br />

14 <strong>CERCLL</strong> ICC Proceedings


Paula Garrett-Rucks Byram Versus Bennett<br />

in hypothetical intercultural situations. Nonetheless, self-report surveys remain a widely<br />

practiced form of indirect assessment. Qualitative assessment designs are not as common as<br />

quantitative assessments of IC development, perhaps due to the time-consuming nature of<br />

collecting and analyzing direct data. However, studies comparing quantitative and qualitative<br />

assessment (Fantini, 2006; Straffon, 2003) suggest that qualitative approaches can provide<br />

more personalized, detailed accounts of the process of IC development that cannot be<br />

assessed by quantitative assessments alone.<br />

EXAMPLES OF QUALITATIVE IC ASSESSMENT METHODOLOGIES AND <strong>THE</strong>ORIES<br />

Researchers interested in qualitative approaches to IC assessment have argued that IC<br />

competence development may be represented best in direct assessment situations such as<br />

performance assessment (Byram, 1997), portfolio assessment (Byram, 1997, Jacobson et al.,<br />

1999) or interviews (Fantini, 2006; Straffon, 2003). Performance assessment typically involves<br />

the elicitation of an individual’s ability to display IC in conversations with interlocutors. Portfolio<br />

assessment typically encourages students to reflect on their evolving intercultural competencies<br />

as represented in their work or personal documents. Interview assessment involves in-depth<br />

interviews in which researchers pose questions to elicit data on the nature and development of<br />

IC.<br />

One influential assessment of direct observation and research has been the Developmental<br />

Model of Intercultural Sensitivity (DMIS) created by Bennett (1993) as a framework to explain<br />

the experience of people he observed in intercultural workshops, classes, exchanges, and<br />

graduate programs over the course of months and sometimes years. The DMIS provides an<br />

assessment structure for explaining how the person assessed sees, thinks about, and interprets<br />

cultural events happening around them and how an individual’s perspective of cultural patterns<br />

both guide and limit his or her experience of cultural differences. Bennett claimed that the<br />

learners he observed confronted cultural difference in some predictable ways as they acquired<br />

more intercultural sensitivity. Drawing concepts from cognitive psychology and constructivism,<br />

Bennett categorized the behavior he had observed into six stages of increasing sensitivity to<br />

cultural differences purporting that certain kinds of cognitive processing, attitudes, and<br />

behaviors would typically be associated with each phase. The six stages of DMIS represent a<br />

set of perspectives with successively greater ability to understand and have a more complete<br />

experience of cultural difference. The first three stages (Acceptance Stage, Adaptation Stage<br />

and Integration Stage) are considered ethnocentric or monocultural in that one’s own culture is<br />

seen as the only culture or the “better” culture. The second three DMIS stages are ethnorelative<br />

(Acceptance Stage, Adaptation Stage and Integration Stage) where the individual’s culture is<br />

one of many equally valid worldviews. Bennett suggested that the development of intercultural<br />

sensitivity evolves linearly as individuals gained increased awareness and acceptance of the<br />

constructs and experiences of cultural differences. Although the DMIS was created from direct<br />

observations in the qualitative tradition, it has been most commonly used as a source of<br />

inspiration for the formation of indirect assessment measures such as the aforementioned IDI in<br />

the quantitative tradition.<br />

More recently, researchers from the qualitative tradition often draw from Byram’s (1997) widely<br />

accepted framework for the assessment of the intercultural dimensions of attitude, knowledge,<br />

skills of interaction/discovery and relating/interpreting, and critical awareness in learners’<br />

development of intercultural communicative competence. In Teaching and assessing<br />

intercultural communicative competence, Byram (1997) proposed this widely accepted fivefactor<br />

model of intercultural communicative competence that he designed to offer a general<br />

definition and description of IC applicable to multiple FL learning contexts. Byram has worked<br />

<strong>CERCLL</strong> ICC Proceedings 15


Paula Garrett-Rucks Byram Versus Bennett<br />

extensively with the Educational Council of Europe in the development of a portfolio assessment<br />

called “Autobiography of Intercultural Encounters” (Byram, 2008). Byram described the portfolio<br />

as, “focused entirely on helping learners to analyse encounters with otherness” (p. 222).<br />

However, to date there remains a lacuna of qualitative studies that provide empirical evidence of<br />

learners’ development within each of five dimensions in his model—attitudes, knowledge, skills<br />

of interaction/discovery, skills of relating/interpreting and critical awareness.<br />

<strong>THE</strong> IMPETUS OF <strong>THE</strong> STUDY: SITUAT<strong>IN</strong>G <strong>THE</strong> ROLE OF <strong>THE</strong> RESEARCHER<br />

Having taught introductory French language instruction for over a decade, I am concerned with<br />

the lack of attention to fostering beginning language learners’ understanding of the target<br />

culture. Information from my informal discussions with Teaching Assistants and other<br />

introductory level FL instructors corroborates Philips (2011) survey results where many<br />

instructors reported difficulty fitting extended cultural work into the curriculum, particularly at<br />

beginning levels of instruction. Fox and Diaz-Greenburg (2006) found that many introductory FL<br />

instructors still focus primarily on the mechanics of language skills, believing that students'<br />

understanding of the target culture will occur in advanced courses or during study abroad. Yet,<br />

the majority of American students do not continue FL study beyond institutional requirements<br />

(MLA report). Consequently, few Americans are exposed to the kind of cultural instruction that<br />

fosters learners’ understanding of target-culture members’ perspectives toward their cultural<br />

practices and products.<br />

My personal interest in this study was to integrate cultural projects reported to be successful at<br />

intermediate and advanced levels of instruction into the beginning FL curriculum. The three<br />

salient features of successful culture learning projects in advanced FL instruction in the<br />

professional literature I encountered were 1) exposure to differing cultural practices, 2) exposure<br />

to diverse target culture members’ perspectives and 3) personalized discussions comparing<br />

different perspectives toward cultural practices that recognize learner agency (Furstenberg et<br />

al., 2001; Johnson, 2008; McBride & Wildner-Bassett, 2008). Due to learners’ limited linguistic<br />

mastery at beginning levels of instruction, I felt it was important to support the use of English<br />

during cultural discussions. However, I strongly believe in target-language use in communicative<br />

based classroom instruction in order to foster learners’ linguistic development. Furthermore, I<br />

knew that I could not disrupt the instruction of a beginning French course with the typical<br />

overextended curriculum. For these reasons, I situated supplemental cultural instruction and<br />

peer discussions in a computer-mediated environment. The purpose of this paper is not to<br />

analyze the effectiveness of the pedagogical interventions investigated (Garrett-Rucks, 2010),<br />

but rather to provide readers with examples of the types of discrepancies I encountered after<br />

analyzing the data to detect the emergence of learners’ IC at the individual level using Byram’s<br />

models in case study paradigms and Bennett’s theories to detect the collective shifts in the<br />

classroom discussions from ethnocentric to ethnorelative thinking. For this reason, I provide<br />

only a brief overview of the study and data analysis.<br />

<strong>THE</strong> STUDY: A BRIEF OVERVIEW<br />

In the fall of 2008, 13 students enrolled in a second-semester French course at a Midwestern<br />

technical college participated in weekly online classroom discussions on BlackBoard for course<br />

credit. The class was a communicative language course taught primarily in the target language.<br />

Outside of the classroom instruction, there were online classroom discussions in English,<br />

centering on French greetings, French education, and French family life over the course of a 16week<br />

semester. Each of the three discussions lasted five weeks and consisted of two phases.<br />

For Phase 1 of each discussion, participants were required to access two sources of cultural<br />

16 <strong>CERCLL</strong> ICC Proceedings


Paula Garrett-Rucks Byram Versus Bennett<br />

instruction; 1) specific online cultural instruction designed to explicitly teach Americans about<br />

French cultural practices and 2) selected authentic texts written by French native speakers for<br />

French native speakers about the cultural practices found on the Internet (Appendix A).<br />

Students were required to post their reactions to online cultural materials during Week 1 of the<br />

discussion and then to respond to two of their peers’ postings on the discussion board during<br />

Week 2. For Phase 2 of each discussion, participants were required to access pre-recorded<br />

interviews with four diverse French informants (Appendix B) and then to post their reactions to<br />

the interviews on the discussion board during Week 3 and to respond to two of their peers’<br />

postings on the discussion board during Week 4. During Week 5 of each discussion,<br />

participants were instructed to reflect on all of the cultural materials and comments made on the<br />

discussion board and then to post their final impressions of the French cultural practices.<br />

For each of the three discussions, the discussion prompts instructed students how to make their<br />

weekly postings (where to find the cultural instruction, the posting word limit and the discussion<br />

questions) over the course of each five-week discussion. I developed the discussion prompt<br />

questions to promote students’ exploration of the relationships between the practices and<br />

products of French culture and the perspectives of the French people, in adherence to the goals<br />

of the National Standards for FL Learning (Standards 2.1, 2.2, and 4.2).<br />

Nine students, four females and five males, volunteered to be interviewed by the researcher at<br />

the close of each of the three discussions. Semi-structured interviews were intended to elicit<br />

learners’ impressions of French people and French culture and the influences on these<br />

impressions. Pre-and Post- semester questionnaires were also administered in an attempt to<br />

capture changes in learners’ thinking about cultural practices as well as changes in learners’<br />

impressions of French people and French culture.<br />

The two research questions I investigated were:<br />

RQ (1): In what ways do changes in learners’ intercultural competence (IC) correspond with<br />

changes in their impressions of French people and French culture?<br />

RQ (2): What factors in the discussions (e.g. the online cultural instruction, the authentic<br />

texts, the French informants, peer interactions, the instructor, textbook, prior experiences<br />

with native speakers) appear to influence collective shifts between learners’ ethnocentric<br />

and ethnorelative perspectives?<br />

DATA ANALYSIS<br />

In order to respond to RQ1, I identified the changes in the four focus participants’ impressions of<br />

French people and French cultural practices in relationship to their developmental trajectory of<br />

IC over the semester by using a case study paradigm. I analyzed focus participants’ statements<br />

from their questionnaires, the transcripts of the online discussions and the transcripts of the<br />

post-discussion interviews using an open coding technique (Berg). Using line by line coding, I<br />

first coded all statements learners’ made about French people and French culture. After I<br />

identified changes in participants’ statements about French people and French culture on a<br />

week by week basis, I then attempted to find influences on these changes. I then identified<br />

changes in four focus participants’ developmental level of IC by coding the data for instances<br />

where I could detect evidence of the participants’ intercultural attitudes, knowledge and skills for<br />

each of the two phases in each discussion based on Byram’s (1997) definitions. Because<br />

learners were speaking in English in intracultural discussions with their peers rather than<br />

intercultural exchanges, I followed Byram’s objectives for intercultural competence, rather than<br />

intercultural communicative competence. Byram claims, “omitting reference to communication, I<br />

<strong>CERCLL</strong> ICC Proceedings 17


Paula Garrett-Rucks Byram Versus Bennett<br />

want to indicate the emphasis on skills, knowledge and attitudes other than those which are<br />

primarily linguistic” (p. 49). Byram defines:<br />

(1) Intercultural Attitudes: “Curiosity and openness, of readiness to suspend disbelief<br />

about other cultures and belief about one’s own” (p. 50).<br />

(2) Intercultural Knowledge: “Knowledge of social groups and their products and<br />

practices in one’s own and in one’s interlocutor’s country, and of the general processes<br />

of societal and individual interactions” (p. 51).<br />

(3) Intercultural Skills: “Ability to interpret a document or event from another culture, to<br />

explain it and relate it to documents from one’s own” (p. 52).<br />

Byram provided 19 additional objectives (Appendix C) under each of these three broad<br />

definitions that he claims provide “a step towards describing teaching and assessment” (p. 50)<br />

of learners’ IC. These additional objectives guided my interpretation of the broader definitions in<br />

Byram’s multimodal model. I then reported changes in learners’ impressions of French people<br />

and French culture in relation to changes in their intercultural attitudes, knowledge and skills for<br />

each phase of each discussion.<br />

In order to respond to RQ2, the influences on the collective emergence of intercultural thinking<br />

for the class as a whole, I analyzed the transcripts of the discussions within a complex systems<br />

theoretical framework for the most salient cultural practice discussed. For example, in<br />

Discussion 1, French greetings, learners discussed shaking hands, smiling, la bise, and<br />

hugging. By using a line-by-line coding method (Charmaz, 2006), I identified smiling practices<br />

as the most salient cultural practice discussed. I then further analyzed all of the postings in the<br />

five week discussion that mentioned French or U.S. smiling practices to investigate shifts in<br />

learners’ worldviews toward differing smiling practices. I used the definitions provided within<br />

Bennett’s (1993) Developmental Model of Intercultural Sensitivity (DMIS) to categorize<br />

participants’ IC developmental stages based on their statements about the cultural practice in<br />

question in each posting. Bennett’s Developmental Model of Intercultural Sensitivity consists of<br />

six stages grouped into three Ethnocentric Stages (Denial Stage, Defense Stage, and<br />

Minimization Stage) where the individual’s culture is the central worldview. Each stage is<br />

defined as follows:<br />

Stage 1—Denial: The individual denies the difference or existence of other cultures by<br />

erecting psychological or physical barriers in the forms of isolation and<br />

separation from other cultures.<br />

Stage 2—Defense: The individual reacts against the threat of other cultures by<br />

denigrating the other cultures (negative stereotyping) and promoting the<br />

superiority of one’s own culture. *Reversal Phase—In some cases, the individual<br />

undergoes a reversal phase, during which the worldview shifts from one’s own<br />

culture to the other culture, and the own culture is subject to disparagement.<br />

Stage 3—Minimization: The individual acknowledges cultural differences on the surface<br />

but considers all cultures as fundamentally similar.<br />

Within the Ethnorelative Stages (Acceptance Stage, Adaptation Stage, and Integration Stage)<br />

where the individual has a more complex worldview in which cultures are understood relative to<br />

each other and actions are understood as culturally situated, Bennett further defined each stage<br />

as follows:<br />

Stage 4—Acceptance: The individual accepts and respects cultural differences with<br />

regard to behavior and values.<br />

18 <strong>CERCLL</strong> ICC Proceedings


Paula Garrett-Rucks Byram Versus Bennett<br />

Stage 5—Adaptation: The individual develops the ability to shift his frame of reference to<br />

other culturally diverse worldviews through empathy and pluralism.<br />

Stage 6—Integration: The individual expands and incorporates other worldviews into his<br />

own worldview.<br />

After assessing the participants’ developmental stage at the time of the each posting, I<br />

investigated collective shifts from learners’ ethnocentric thinking (stages 1-3) to enthorelative<br />

thinking (stages 4-6), or vice versa, for each week of the discussion. I also tracked changes in<br />

learners’ development between postings to further investigate peer influences on the shifts in<br />

worldviews in the discussions. In order to investigate the influence of the pedagogical<br />

interventions, I calculated the percentage of ethnocentric and ethnorelative postings for each<br />

phase of the discussion—OLI explicit cultural instruction and authentic texts for Phase 1 and<br />

French informant interviews for Phase 2—with attention to collective shifts between ethnocentric<br />

and ethnorelative thinking. I then situated the discussions within a complex systems theoretical<br />

framework in an attempt to identify the influences on collective shifts in learners’ thinking.<br />

After completing both analyses, I identified instances where learners who had attained threshold<br />

levels of IC within Byram’s model were considered to be using ethnocentric thinking by the<br />

definitions provided in Bennett’ DMIS. I report the types of discrepancies I found when<br />

assessing learners IC using these two different models in the next section.<br />

Discrepancy 1: Learners’ linear development of intercultural thinking<br />

Both Bennett and Byram’s theoretical frameworks speak to the occurrence of a shift in learners’<br />

worldviews. Byram described a threshold level based on learners’ performance of the<br />

objectives for knowledge, attitudes and skills. Bennett claimed that a shift occurs from<br />

ethnocentric to ethnorelative thinking as individuals gain increased awareness and acceptance<br />

of the constructs and experiences of cultural differences in a linear development across the six<br />

stages. Findings from the data analysis of both research questions provided support for<br />

Byram’s threshold hypothesis, but contradictory evidence to the linear nature of IC development<br />

that Bennett claimed in his DMIS. Specifically, when investigating IC emergence at the group<br />

level, I detected inconsistent fluctuations between learners’ ethnocentric to ethnorelative<br />

thinking across each Phase of the three discussions. I also detected nonlinear IC development<br />

at the individual level in my analysis. Within the selection criteria I established to identify<br />

participants’ comments about a specific cultural practice, I detected several instances where<br />

individual learners shifted back and forth from ethnorelative to ethnocentric thinking on a weekly<br />

basis within the discussions, as explained in detail later within this section. Contrary to the<br />

fluctuations that occurred in learners’ IC assessment within Bennett’s DMIS, Byram’s threshold<br />

hypothesis held true for three of the four case studies I conducted as explained below.<br />

Evidence to support Byram’s threshold description<br />

When I situated the data collected for the four focus participants’ experiences within Byram’s<br />

multimodal model of IC, three of the focus participants (Brad, Jack and Lauren) appeared to<br />

have a moment of epiphany when they attained a threshold level of all three components<br />

(attitudes, knowledge and skills) within Byram’s model. Although developmental fluctuations<br />

initially occurred for individual components, these three learners consistently displayed signs of<br />

developed IC after the threshold attainment of all three components. This trend did not hold<br />

true for the fourth focus participant (James), who did not appear to attain a threshold level of<br />

attainment in all three of the areas of intercultural attitudes, knowledge and skills. Interestingly,<br />

<strong>CERCLL</strong> ICC Proceedings 19


Paula Garrett-Rucks Byram Versus Bennett<br />

James was also less consistent than the three other focus participants with his participation in<br />

the discussions as well as his attendance and general performance in the classroom. For these<br />

reasons, I am not including information about the fourth participant’s experiences in this brief<br />

overview of the three case studies. For the three focus participants who attained a threshold<br />

level in all three IC components during the semester, intercultural knowledge of cultural<br />

differences was important, but intercultural skills to relate to diverse French perspectives toward<br />

cultural practices seemed pivotal in developing strong intercultural attitudes. Brad, James and<br />

Lauren each entered the discussions with differing initial levels of intercultural attitudes,<br />

knowledge and skills and each participant attained the threshold level if IC development at<br />

differing moments across the semester—Brad in Discussion 1, James in Discussion 2 and<br />

Lauren in Discussion 3 as described in detail for each participant in turn below.<br />

Brad entered the discussions with developed intercultural knowledge and skills as evidenced by<br />

his interest in French history and politics and his ability to relate to differing French and<br />

American perspectives toward striking. However, he appeared to have weak intercultural<br />

attitudes as evidenced by his monolithic image of the French as being superior on his initial<br />

questionnaire and the first part of Discussion 1 where he stated, “I rather like that they [the<br />

French] have rules for multiple greetings. […] social interactions in this country need more<br />

rules.” Brad’s moment of change occurred after exposure to the French informants in the first<br />

discussion concerning their different perspectives toward greetings when he stated:<br />

Discussion 1, Phase 2: The thing that most struck me about what we watched was the<br />

variety of [French informant] responses. There are clearly wide personal variations<br />

within the "traditional" French greeting (Brad, Week 5).<br />

It appeared that exposure to diverse French perspectives toward greetings broke Brad’s<br />

monolithic image he previously held of the French. He continued to display evidence of strong<br />

intercultural knowledge, attitudes and skills for the remainder of the discussions.<br />

Jack entered the discussions with weak intercultural skills and attitudes, but evidence of strong<br />

intercultural knowledge, as evidenced on his initial questionnaire where he described his first<br />

images of the French to come to his mind as “the common stereotype assigned to the French by<br />

Americans, that is that they are snobby, rude and ‘elitist,’ if you will. Of course I know that these<br />

are unfair generalizations, but you asked what came to mind immediately.” In the first phase of<br />

Discussion 2, Jack responded to information about the French education system stating that it<br />

might, “cripple a student’s ability to explore all of their interests by making school too practical.”<br />

However, in Phase 2 of the discussion, he wrote:<br />

Discussion 2, Phase 2: Based on the positive responses of the French students in the<br />

YouTube videos, one might assume that the French may have found that little niche<br />

between too much choice and too little choice (Jack, Week 5).<br />

He continued to display evidence of strong intercultural knowledge, attitudes and skills for the<br />

remainder of the discussions.<br />

The third focus participant, Lauren, entered the discussion with poor intercultural attitudes,<br />

knowledge and skills expressing on her initial questionnaire that she imagined the French as<br />

“either being well groomed and dressed nicely or looking unpresentable and smelling like<br />

garbage.” She claimed that the “only negative image” to come to her mind was that the French<br />

“are snobby and rude.” There was continual evidence of Lauren’s increasing intercultural<br />

knowledge, but fluctuations in her developing attitudes and consistent displays of her poor skills<br />

relating to French perspectives until Discussion 3. Once Lauren reached a threshold level of IC<br />

20 <strong>CERCLL</strong> ICC Proceedings


Paula Garrett-Rucks Byram Versus Bennett<br />

skills in Discussion 3, on family structure, she explicitly wrote that her opinion of the French had<br />

changed on her final questionnaire as follows.<br />

The only negative image I have of French people is that they rarely smile. However, I<br />

don’t think of them as rude or strict people anymore. I realize that I grew up thinking<br />

smiling at a person was a polite thing to do. They just grew up thinking the opposite way<br />

(that it was overbearing or flirtatious) (Lauren, Final questionnaire).<br />

Each of these three participants’ had a shift in worldviews occur in the second phase of a<br />

discussion, after personally relating to a French informant’s perspective toward differing cultural<br />

practices. Further evidence existed in the data to suggest that these three learners continued to<br />

display evidence of IC after the threshold moment of displaying fully developed intercultural<br />

attitudes, knowledge and skills. On the contrary, there were continual fluctuation between<br />

ethnocentric and ethnorelative thinking found when situating the transcripts of the discussions<br />

within Bennett’s DMIS.<br />

Evidence to question the linear nature of development proposed in Bennett’s DMIS<br />

In an attempt to capture the influences of the pedagogical interventions—explicit cultural<br />

instruction and authentic texts during Phase 1 and French informant interviews during Phase<br />

2—I compared the percentage of postings where participants’ worldviews were evaluated at<br />

ethnocentric levels (Stages 1-3) to ethnorelative levels (Stages 4-6) for each phase of the<br />

discussion in. Based on this criteria, I detected shifts in learners’ ethnocentric to ethnorelative<br />

worldviews toward French smiling practices in Discussion 1 and French educational practices in<br />

Discussion 2 after exposure to the French informants’ perspectives in Phase 2 of these<br />

discussions. However, Discussion 3 was different. The information in Phase 1 of Discussion 3<br />

described the French PACs—a form of civil marriage originally intended to support homosexual<br />

unions—as an increasingly accepted cultural practice among heterosexual and homosexual<br />

partners. However, the four French informants expressed a personal preference for traditional<br />

marriages in their own lives, and inadvertently discredited the status of PACs stating things like,<br />

“the PACs is an arrangement for convenience, like for tax breaks, not love” (Florence). Many<br />

participants in the discussion appeared disappointed by the French informants’ apparent lack of<br />

acceptance of the PACS stating things like, “the abuse of the PACS reminds me of the abuse of<br />

the welfare system here” (participant, week 5). Consequently, there was a shift from<br />

ethnorelative to ethnocentric thinking in Discussion 3 in Phase 2 of the discussion (see Figure<br />

1).<br />

<strong>CERCLL</strong> ICC Proceedings 21


Paula Garrett-Rucks Byram Versus Bennett<br />

Figure 1. A comparison of the percentage of postings assessed in ethnocentric or ethnorelative<br />

stages in the DMIS for each phase of each discussion.<br />

In addition to these findings which suggest the nonlinear nature of intercultural sensitivity<br />

development at the group level, further analysis of the weekly changes in individual participants’<br />

worldviews toward a specific cultural practice revealed the nonlinear nature of Bennett’s DMIS<br />

paradigm at the individual level as well. Individuals in this study often fluctuated inconsistently<br />

between ethnocentric and ethnorelative stages, particularly in peer response postings. For<br />

example, at the end of Discussion 1, I evaluated the following posting to be reflective of<br />

ethnorelative thinking.<br />

Discussion 1, Phase 2 … some of these practices (e.g. smiling) have so many different<br />

meanings and connotations by the manner, the way or in the environment in which they<br />

are done that it is difficult to make generalizations as Brad has indicated. (Tim, Week 5)<br />

I assessed Tim to be in the Adaptation Stage (Stage 5) of the DMIS due to his apparent ability<br />

to shift his frame of reference to other culturally diverse worldviews through empathy and<br />

pluralism, and categorized this posting as representative of ethnorelative thinking. However, in<br />

the next discussion, Tim’s response posting in the second week of Discussion 2 reflected<br />

ethnocentric thinking.<br />

Discussion 2, Phase 1: Forcing students to pick a career path while they are still<br />

teenagers is unjust and not psychologically sound. I wonder how often students change<br />

their career paths later in life? (Tim, Week 2)<br />

I evaluated Tim’s posting to be reflective of the Defense Stage of Bennett’s DMIS due to his<br />

strong negative description of French educational practices and his implication that U.S.<br />

educational practices are superior to French practices.<br />

The inconsistency between ethnorelative and ethnocentric worldviews was particularly prevalent<br />

in participants’ peer response postings (weeks two and four of discussions). Participants’<br />

response posting often appeared to reflect the same type of thinking of the person to whom they<br />

were responding, particularly when either agreeing or disagreeing with a peer who was<br />

previously assessed at a lower developmental stage. For example, in Discussion 1, James<br />

initially appeared to relate to a French informant’s description of French smiling practices.<br />

22 <strong>CERCLL</strong> ICC Proceedings


Paula Garrett-Rucks Byram Versus Bennett<br />

Discussion 1, Phase 2: I liked how Thomas was hesitant to use la bise or smiling. He<br />

preferred to wait until he knew you better. That seems reasonable to me…. I didn't<br />

agree with her [Aunt Anne] calling our smile artificial, but I do agree with a less often<br />

smile being more meaningful and spontaneous (James, Week 3).<br />

I evaluated this posting to be reflective of ethnorelative thinking, and categorized James to be in<br />

the Acceptance Stage of the DMIS model due to his apparent respect for cultural differences.<br />

However, James’ Week 4 response posting reflected ethnocentric thinking in regard to<br />

behaviors and values.<br />

Discussion 1, Phase 2: I also think it was weird that they [the French informants] called<br />

our smile phony. Smiling makes its way into my day quite often (James, week 4). [my<br />

emphasis]<br />

James altered the developmental flow occurring in the dynamics of the discussion by digressing<br />

from an Acceptance Stage in Week 3 to a Defensive Stage in Week 4, contradicting what he<br />

had stated five days earlier where he had written that he agreed with the French perspective of<br />

smiling that smiling less often would make it more meaningful. By the use of the word also in<br />

James’ response posting, it becomes apparent that he had appropriated the opinions previously<br />

expressed by his peer.<br />

I must emphasize that I was only evaluating statements participants made pertaining to the<br />

most salient cultural practice addressed in the discussions. Furthermore, I did not include<br />

information from the questionnaires or post discussion interviews with participants. The case<br />

studies of four participants had a wider lens to evaluate the holistic experiences of the learners<br />

as well as a different assessment model based on the definitions created in Byram’s multimodal<br />

model of IC development.<br />

Discrepancy 2: The role of the evaluator’s subjectivity<br />

As expressed in the previous section, the assessment of the focus participants’ intercultural<br />

attitudes, knowledge and skills was straightforward when situating learners’ comments within<br />

Byram’s multimodal model. When I was uncertain about evaluating the learners’ comments<br />

based on the general definitions provided, I referred to the additional objectives Byram provided<br />

for each of the three factors—5 objectives for Attitudes, 11 objectives for knowledge, and 3<br />

objectives for skills—for further clarification (Appendix C). These additional detailed<br />

performance objectives Byram outlined for each of these categories seemed to provide a larger<br />

net to detect changes in learners’ worldviews within each of the categories. However, my<br />

application of Bennett’s DMIS proved to be problematic when assessing individual learners IC<br />

assessment based on their comments toward a unique cultural practice. Using the criteria<br />

provided by Bennett was particularly difficult when assessing learners’ postings in which they<br />

made conflicting statements. For example, in Phase 2 of Discussion 2, learners accessed the<br />

French informant interviews where all four of the informants essentially had positive comments<br />

to make about the French education system.<br />

I think it’s very different that the French require high school students to select a<br />

"specialized area of focus" before their junior and senior years of high school. I suppose<br />

on one hand, it can be effective because it gives high school students a set path of how<br />

to become successful in a field of their choice. On the other hand, I feel that it could in<br />

some ways cripple a student’s ability to explore all of their interests by making school too<br />

practical (Jack, Week 1). [my emphasis]<br />

<strong>CERCLL</strong> ICC Proceedings 23


Paula Garrett-Rucks Byram Versus Bennett<br />

This learner seemed to be expressing acceptance (Stage 4) of the U.S. and French cultural<br />

differences in education practices in his statement that it can be effective for French schools to<br />

provide students focus, yet then immediately after, he stated that the same practice could<br />

cripple students’ ability to explore their interests. I interpreted the strong use of the word<br />

“cripple” to indicate that this learner was in a Defense Stage (Stage 2), promoting the superiority<br />

of his own culture’s education practices. After great consideration, I assigned the learner a<br />

developmental stage between the two assessable stages, Minimization (Stage 3), with much<br />

reluctance. His thinking did not appear to fall within the definitions provided for this stage, but<br />

the model was not sufficiently descriptive to measure the learners’ development based solely on<br />

the content of their postings on the discussion board. Using the diverse objectives provided in<br />

Byram’s model, I assessed this learner to have signs of intercultural attitudes by questioning the<br />

values in his own cultural practice, a lack of focus in choosing a career path in U.S. high<br />

schools, and knowledge about the processes and institutions of socializations in one’s own and<br />

one’s interlocutor’s country as well as skills in interpreting and relating French and American<br />

cultural practices.<br />

Discrepancy 3: Assessing learners’ curiosity about other cultures<br />

Another component in Byram’s attitudes factor is the objective “interest in discovering other<br />

perspectives on interpretation of familiar and unfamiliar phenomena both in one’s own and in<br />

other cultures and cultural practices” (p. 92). Yet within Bennett’s DMIS, there is no<br />

consideration for learners’ curiosity toward other cultures. For example, after exposure to the<br />

French informant perspectives concerning education, one participant wrote<br />

Aunt Annie holds the French education as sacred but I don't know why…I did notice that<br />

Sophie said that she specialized in literature with an emphasis in math… Apparently<br />

they can do this. How often is it done?<br />

Another student also expressed curiosity about French education in Phase 2 of Discussion 2.<br />

I am also very interested in what the entire process of students choosing a major in high<br />

school is like. I assume that there is some sort or preliminary test to take to gain<br />

admission into certain majors or fields…<br />

Similarly, another student had questions about the French perspectives toward PACS:<br />

On a sort-of-related note, I wondered what the significance of PACS is in France. What<br />

kinds of rights or responsibilities does a PAC confer on a couple? If they are intended to<br />

be in all ways equivalent to marriage for a homosexual couples, why are increasing<br />

numbers of heterosexual couples embracing the idea as well?<br />

I evaluated each of these passages using the definitions provided within the intercultural<br />

attitudes component of Byram’s model, but there were no criteria established to assess these<br />

statements within Bennett’s DMIS.<br />

Discrepancy 4: Assessing learners’ attitudes toward their own culture<br />

Among the five objectives Byram described as modes of assessment for learners’ intercultural<br />

attitudes is the demonstration of learners’ “willingness to question the values and<br />

presuppositions in cultural practices and products in one’s own environment” (p. 92). Byram<br />

further stated that the learners’ willingness to question phenomena fundamental to their society<br />

might involve viewing these aspects from “the other’s interpretation and evaluations” (p. 92). On<br />

the contrary, within Bennett’s DMIS, a world view shift from one’s own culture to the other<br />

culture, particularly when one’s own culture is subject to criticism, would indicate that the learner<br />

24 <strong>CERCLL</strong> ICC Proceedings


Paula Garrett-Rucks Byram Versus Bennett<br />

was demonstrating ethnocentric thinking. In the Stage 2 of the DMIS, the Defense Stage,<br />

Byram describes a Reversal Phase learners may undergo during which the worldview shifts<br />

from one’s own culture to the other culture, and their own culture is subject to disparagement.<br />

There were instances in all three discussions in my study where learners would have been<br />

categorized as demonstrating developed intercultural attitudes by Byram’s definition, but were<br />

considered to be ethnocentric thinkers (Reversal Phase of Stage 2—Defense) within Bennett’s<br />

DMIS based on their comments. After exposure to the French informants’ descriptions of<br />

French and American smiling practices, one learner stated:<br />

I like and agree with Florence's description of the Colgate smile of Americans and that at<br />

times the smile or the way it is done can be aggressive and artificial as Annie describes<br />

rather than spontaneous and natural (Discussion 1, Phase 2). [my emphasis]<br />

The learner here appears to have appropriated the French informant Florence’s perspective<br />

toward American smiling practices as being at times aggressive and artificial and the French<br />

informant Aunt Anne’s perspective toward French smiling as more spontaneous and natural. By<br />

questioning common smiling practices in his own culture when viewing it from the eyes of a<br />

French informant, the learner is demonstrating developed intercultural attitudes within Byram’s<br />

criteria. On the contrary, I assessed this learner to be at Stage 2 within Bennett’s model,<br />

because it appears the learner’s own culture is the subject of disparagement in this paradigm,<br />

and that the learner is in the ethnocentric Reversal Phase. Similarly, in Discussion 2,<br />

concerning education, another learner shifted his worldviews to a French perspective.<br />

I do agree with them when they say the French system is more specialized and in<br />

depth. American secondary education is designed to be a superficial smorgasbord of<br />

classes with rarely any depth of study (Discussion 2, Phase 2). [my emphasis]<br />

This learner appropriated French informants’ worldviews toward their education system, and<br />

reflected back on his own U.S. education by comparison, noting the negative aspects of his own<br />

culture’s practices, disparaging the lack of depth of study in his own country. There were<br />

several other examples in the transcripts similar to these two examples.<br />

DISCUSSION OF EACH MODEL’S MERITS WITH<strong>IN</strong> <strong>THE</strong> LIMITATIONS OF <strong>THE</strong> STUDY<br />

As Kauffmann, Martin, and Weaver (1992) noted, it is not surprising that different assessments<br />

of the same phenomena produce inconsistent results. However, as mentioned earlier, an<br />

understanding of the merits of the different assessments can empower researchers and<br />

educators to more accurately interpret results or to choose appropriate assessments for their<br />

own research. Both Bennett’s DMIS and Byram’s multimodal model have contributed<br />

enormously to the field of intercultural research in qualitative and quantitative research. For<br />

quantitative research, Bennett’s IDI remains one of the most commonly used research<br />

instruments to record changes in individuals’ worldviews. Likewise, Bennett’s <strong>IN</strong>CA model has<br />

provided a tremendous influence for mixed method paradigms. But the focus of this study was<br />

an application of Bennett and Byram’s paradigms to qualitative research.<br />

In theory, Bennett’s DMIS provides a means to measure incremental IC development, providing<br />

insight into the different stages of learners’ development. Byram’s model does not. Byram<br />

refers to a threshold level of IC development. In three of the four case studies I conducted,<br />

students fluctuated between showing signs of development for each of the domains—<br />

intercultural attitudes, knowledge and skills—but once all three levels had been attained, the<br />

students consistently displayed signs of developed IC. On the contrary, when I used Bennett’s<br />

DMIS assessment model to identify incremental changes in stages of learners’ IC development,<br />

particularly shifts between ethnocentric and ethnorelative perspectives, I noticed nonlinear<br />

<strong>CERCLL</strong> ICC Proceedings 25


Paula Garrett-Rucks Byram Versus Bennett<br />

developmental inconsistencies. There are factors within this study that may have contributed to<br />

these inconsistencies. Firstly, I only analyzed learners’ isolated statements made about a<br />

specific cultural topic. An analysis of learners’ postings in their entirety could have resulted in a<br />

different assessment of their developmental stages. It must also be noted that the subjective<br />

nature of the interpretation of the definitions provided by Bennett could have also influenced the<br />

developmental inconsistencies. It is possible that Bennett would have classified students’<br />

statements differently than I had due to his greater understanding of the definitions in his theory.<br />

As I mentioned in Discrepancy 2, I often found it difficult to assess learners’ conflicting<br />

statements pertaining to just one cultural topic using the criteria provided by Bennett. I believe it<br />

would be increasingly difficult to assess learners’ worldviews toward multiple cultural practices<br />

within the criteria defined in Bennett’s DMIS. Contrarily, Byram’s model limits subjective<br />

misinterpretation. Under each of Byram’s broad definitions for intercultural attitudes, knowledge<br />

and skills, he provided numerous objectives. As noted earlier under discrepancy four, these<br />

objectives provided further clarification, and as such reduced the subjectivity of interpretation of<br />

his broader objectives.<br />

Yet beyond the subjective limitations of my assessments, there were further limitations to the<br />

Bennett model. Bennett provides no recognition of individuals’ curiosity about other cultures<br />

and Bennett’s Reversal Phase in the Defense stage seemed to discredit learners’ ability to<br />

decentre themselves from their belief that their cultural practice is the correct way to behave.<br />

As FL educators, this ability to decentre is critical to instructed FL learning. Perhaps Bennett’s<br />

model is more suitable for an immersion context, or to measure long-term changes in an<br />

immersion environment. Bennett proposes that it takes at least 2 years of cross-cultural<br />

immersion for an individual to advance into the Integration Stage, the most advanced stage of<br />

his DMIS. Yet in the instructed FL learning environment, educators are limited to the time<br />

constraints determined by the academic calendar. Future research comparing learners’<br />

developmental assessment within both Bennett and Byram’s theoretical frameworks, particularly<br />

in target-culture immersion environments, would help elucidate the discrepancies and nuances<br />

found in the present study.<br />

Despite the inclusion of the Cultures Standards into the ACTFL National Standards for Foreign<br />

Language Learning, this study provides insight into the need for U.S. educators to develop a<br />

model to assess learners’ intercultural competence in the FL curriculum, similar to the way in<br />

which Byram has integrated his multimodal model into the European Framework.<br />

ABOUT <strong>THE</strong> AUTHOR<br />

Paula Garrett-Rucks (Ph.D., University of Wisconsin) is Assistant Professor of Second<br />

Language Acquisition (SLA) and Foreign Language (FL) Education at Georgia State University.<br />

She teaches courses in French, SLA and FL Education. Her research is focused on fostering<br />

intercultural competence in instructed FL learning.<br />

REFERENCES<br />

Altshuler, L., Sussman, N. M., & Kachur, E. (2003). Assessing changes in intercultural<br />

sensitivity among physican trainees using the intercultural development inventory.<br />

International Journal of Intercultural Relations, 27, 387-401.<br />

26 <strong>CERCLL</strong> ICC Proceedings


Paula Garrett-Rucks Byram Versus Bennett<br />

American Council on the Teaching of Foreign Languages (ACTFL). (1999). Revised Standards<br />

for foreign language learning. Yonkers, New York: ACTFL.<br />

Arasaratnam, L. A., & Doerfel, M. L. (2005). Intercultural communication competence:<br />

Identifying key components from multicultural perspectives. International Journal of<br />

Intercultural Relations, 29, 137-163.<br />

Belz, J. (2002). Social dimensions of telecollaborative foreign language study. Language<br />

Learning and Technology, 6(1), 60-81.<br />

Belz, J. (2005). Intercultural Questioning, Discovery and Tension in Internet-mediated Language<br />

Learning Partnerships. Language and Intercultural Communication 5, 3-37.<br />

Belz, J. & Müller–Hartmann, A. (2003). Teachers as intercultural learners: Negotiating German–<br />

American telecollaboration along the institutional fault line. Modern Language Journal,<br />

87(1), 71-89.<br />

Bennett, J. M. (1993). Toward ethnorelativism: A developmental model of intercultural<br />

sensitivity. In R. M. Paige (Ed.), Education for the intercultural experience (pp. 21-71).<br />

Yarmouth, ME: Intercultural.<br />

Bennett, M. (1998). Intercultural communication: A current perspective. In M. J. Bennett (Ed.),<br />

Basic concepts of intercultural communication (pp. 1–34). Yarmouth, ME: Intercultural<br />

Press.<br />

Bennett, J.M., & Bennett, M. J. (2004) Developing intercultural sensitivity: An integrative<br />

approach to global and domestic diversity. In D. Landis, J. Bennett & M. Bennett (Eds.),<br />

Handbook of intercultural training, 3rd Edition ( pp. 147–165). Thousand Oaks: Sage.<br />

Berg, B. (1998) Qualitative Research Methods for the Social Sciences. Allyn & Bacon, Boston,<br />

Mass.<br />

Bhawuk, D. P. S., & Brislin, R. (1992). The measurement of intercultural sensitivity using the<br />

concepts of individualism and collectivism. International Journal of Intercultural<br />

Relations, 16, 413-436.<br />

Byram, M. (1997). Teaching and assessing intercultural communicative competence. Bristol,<br />

PA: Multilingual Matters Ltd.<br />

Byram (2000). Assessing Intercultural Competence in Language Teaching. SPROGFORUM,<br />

18(6), 8-13 http://inet.dpb.dpu.dk/infodok/sprogforum/Espr18/byram.html [retrieved,<br />

June, 2009].<br />

Byram, M. (2008). From foreign language education to education for intercultural citizenship:<br />

Essays and reflections. Clevedon: Multilingual Matters.<br />

Charmaz, K. (2006). Constructing grounded theory: A practical guide through qualitative<br />

analysis. London & Thousand Oaks, CA: Sage.<br />

Davis, S. L., & Finney, S. J. (2006). A factor analytic study of the cross-cultural adaptability<br />

inventory. Educational and Psychological Measurement, 66, 318 - 330.<br />

<strong>CERCLL</strong> ICC Proceedings 27


Paula Garrett-Rucks Byram Versus Bennett<br />

Duffy, S., & Mayes, J. (2001). "Family life" and "regional identity" -- Comparative studies while<br />

learning French. In M. Byram, A. Nichols, & D. Stevens (Eds.), Developing intercultural<br />

competence in practice (pp. 93-111). Clevedon, England: Multilingual Matters.<br />

Engle, L., & Engle, J. (2004). Assessing language acquisition and intercultural sensitivity<br />

development in relation to study abroad program design. Frontiers: The Interdisciplinary<br />

Journal of Study Abroad, 10, 253–276.<br />

Fantini, A. E. (2006). Exploring and assessing intercultural competence. Retrieved June 8,<br />

2008, from http://www.sit.edu/publications/docs/feil_research_report.pdf<br />

Fox, R & Diaz-Greenberg, R. (2006). Culture, multiculturalism, and foreign/ world language<br />

standards in U.S. teacher preparation programs: toward a discourse of dissonance.<br />

European Journal of Teacher Education, 29 (3), 401-422.<br />

Furstenberg, G., Levet, S., English, K., & Maillet, K. (2001). Giving a virtual voice to the silent<br />

language of culture: The CULTURA Project. Language Learning and Technology, 5(1),<br />

55-102.<br />

Garrett-Rucks, P. (2010). The emergence of U.S. French language learners’ intercultural<br />

competence in online discussions. Doctoral dissertation. University of Wisconsin,<br />

Madison.<br />

Hammer, M. R., & Bennett, M. J. (2001). The Intercultural Development Inventory (IDI) Manual.<br />

Portland, OR: Intercultural Communication Institute.<br />

Hammer, M. R., Bennett, M. J., & Wiseman, R. (2003). Measuring intercultural sensitivity: The<br />

intercultural development inventory. International Journal of Intercultural Relations, 27,<br />

421–443.<br />

Hanna, B., & de Nooy, J. (2003). A funny thing happened on the way to the forum: Electronic<br />

discussion and foreign language learning. Language Learning & Technology, 7(1), 71-<br />

85.<br />

Hoyt, K. (2012 ). Developing intercultural competence via semi-directed cross-cultural<br />

interviews. NECTFL Review, 69(1), 94-117.<br />

Jackson, J. (2010). Intercultural Journeys: From Study to Residence Abroad, Basingstoke:<br />

Palgrave MacMillan.<br />

Jacobson, W., Schleicher, D., & Maureen, B. (1999). Portfolio assessment of intercultural<br />

competence. International Journal of Intercultural Relations, 23(3), 467-492.<br />

Johnson, N. (2008). Postcards from the (Turbulent) Edge (of Chaos): Complexity theory and<br />

Computer Mediated Communication. In S. Sieloff Magnan (Ed.), Mediating Discourse<br />

Online (pp. 73-92). Philadelphia, John Benjamins Publishing Co.<br />

Kauffmann, N. L., Martin, J. N., & Weaver, H. D. (1992). Students abroad: Strangers at home.<br />

Yarmouth, ME: Intercultural Press.<br />

28 <strong>CERCLL</strong> ICC Proceedings


Paula Garrett-Rucks Byram Versus Bennett<br />

Koester, J., & Olebe, M. (1988). The behavioral assessment scale for intercultural<br />

communication effectiveness. International Journal of Intercultural Relations, 12, 233-<br />

246.<br />

Majumdar, B., Keystone, J. S., & Cuttress, L. A. (1999). Cultural sensitivity training among<br />

foreign medical students. Medical Education, 33, 177-184.<br />

McBride, K. & Wildner-Basset, M. (2008). Interpersonal and intercultural understanding in a<br />

blended second culture classroom. In S. Sieloff Magnan (Ed.), Mediating Discourse<br />

Online (pp. 93-124). Philadelphia, John Benjamins Publishing Co.<br />

Müller-Hartmann, A. (2000). The role of tasks in promoting intercultural learning in electronic<br />

learning networks. Language Learning & Technology, 4 (2), 129-147.<br />

National Standards in Foreign Language Education Project. Standards for Foreign Language<br />

Learning in the 21st Century. Lawrence, KS: Allen Press, 1999, 2006.<br />

O'Dowd, R. (2003). Understanding the 'other side': Intercultural learning a Spanish-English email<br />

exchange. Language Learning and Technology, 7(2), 118-144.<br />

Paige, R. M., Jacobs-Cassuto, M., Yershova, Y. A., & DeJaeghere, J. (2003). Assessing<br />

intercultural sensitivity: An empirical analysis of the Intercultural Development Inventory.<br />

International Journal of Intercultural Relations, 27, 467–486.<br />

Phillips, June. “The Impact of the National Standards on Language Education & National<br />

Initiatives.” North East Conference on the Teaching of Foreign Languages. Baltimore<br />

Marriot Waterfront Hotel, 3 April 2011.<br />

Ruben, B. D., & Kealey, D. (1979). Behavioral assessment of communication competency and<br />

the prediction of cross-cultural adaptation. International Journal of Intercultural Relations,<br />

3, 15-48.<br />

Savignon S. & Rothmeier, W. (2004). Computer-mediated communication strategies. Calico<br />

Journal, 21 (2), 265-290.<br />

Sercu, L. (2005) Foreign Language Teachers and Intercultural Competence: An<br />

International Investigation. Clevedon: Multilingual Matters.<br />

Straffon, D. A. (2003). Assessing the intercultural sensitivity of high school students attending<br />

an international school. International Journal of Intercultural Relations, 27, 487–501.<br />

Torres, L., & Rollock, D. (2007). Acculturation and depression among Hispanics: The<br />

moderating effect of intercultural competence. Cultural Diversity & Ethnic Minority<br />

Psychology, 13, 10–17.<br />

Wade, E. (2005). Enhancing German language learners’ intercultural communicative<br />

competence through the on-line exchange project ICE. Doctoral dissertation. University<br />

of California, Santa Barbara.<br />

Ware, P. (2005). 'Missed' communication in online communication: Tensions in a German-<br />

American telecollaboration. Language Learning and Technology, 9(2), 64-89.<br />

<strong>CERCLL</strong> ICC Proceedings 29


Paula Garrett-Rucks Byram Versus Bennett<br />

Williams, T. R. (2005). Exploring the impact of study abroad on students’ intercultural<br />

communication skills: Adaptability and sensitivity. Journal of Studies in International<br />

Education, 9(4), 356-371.<br />

Woodin, J. (2001). Tandem Learning as an intercultural activity. In M. Byram, A. Nichols, & D.<br />

Stevens (Eds.), Developing intercultural competence in practice (pp. 189-202).<br />

Clevedon, England: Multilingual Matters.<br />

Zielinksi, B. A. Z. (2007). Study abroad length of program influence on cross-cultural<br />

adaptability. Unpublished master’s thesis, Virginia Polytechnic Institute and State<br />

University, Blacksburg, VA.<br />

30 <strong>CERCLL</strong> ICC Proceedings


Paula Garrett-Rucks Byram Versus Bennett<br />

APPENDIX A<br />

Authentic texts<br />

Discussion Description and URL Source<br />

Discussion<br />

1<br />

1. Smiles<br />

Diverse French perspectives toward<br />

smiling in France.<br />

*http://www.museedusourire.com/<br />

2. la bise Diverse French perspectives toward<br />

a type of kissing while greeting in<br />

France.<br />

*http://fr.answers.yahoo.com/<br />

Discussion<br />

2<br />

Secondary<br />

Education<br />

Discussion<br />

3<br />

Family<br />

Different educational paths French<br />

students can take after middle<br />

school.<br />

http://www.education.gouv.fr/<br />

Information concerning birthrates,<br />

life expectancy, marriage and the<br />

PACS.<br />

http://tempsreel.nouvelobs.com/<br />

Taken from an online museum<br />

which researches and<br />

publishes studies on smiling in<br />

France.<br />

Taken from a French Yahoo<br />

discussion forum.<br />

Francophone participants<br />

discuss whether or not they<br />

like la bise.<br />

Taken from the French Ministry<br />

of National Education website.<br />

Taken from March 28, 2008<br />

from Nouvel Observateur<br />

newspaper<br />

<strong>CERCLL</strong> ICC Proceedings 31


Paula Garrett-Rucks Byram Versus Bennett<br />

APPENDIX B<br />

French informant information<br />

Informant Gender/ Region in France Familiarity with life in the United<br />

Age<br />

States<br />

Thomas M/ 20 Grenoble Arrived in the United States 2 days<br />

prior to the interview for a year-long<br />

Sophie F/ 25 Mostly the south of<br />

France, 2 years in<br />

Tahiti (her Dad was<br />

in the French navy)<br />

university exchange program.<br />

Starting her second year of a French<br />

literature Master’s program in the<br />

United States.<br />

Florence F/31 Orleans Starting her 6 th year in the United<br />

States in a French literature Ph.D.<br />

program. She has been married to an<br />

American for 5 years.<br />

Aunt Anne F/ 60 Bordeaux She has never visited the United<br />

States. Her niece married an<br />

American and has been in the United<br />

States for 7 years.<br />

32 <strong>CERCLL</strong> ICC Proceedings


Paula Garrett-Rucks Byram Versus Bennett<br />

APPENDIX C<br />

Byram’s objectives (as cited in Hoyt, 2012, pp. 104-105)<br />

I. Attitudes (savoir-être): curiosity & openness, readiness to suspend disbelief about<br />

other cultures and belief about one’s own.<br />

Objectives:<br />

a. willingness to seek out or take up opportunities to engage with otherness in a relationship of equality,<br />

distinct from seeking out the exotic or to profit from others.<br />

b. interest in discovering other perspectives on interpretation of familiar and unfamiliar phenomena both in<br />

one’s own and in other cultures and cultural practices.<br />

c. willingness to question the values and presuppositions in cultural practices and products in one’s own<br />

environment.<br />

d. readiness to experience the different stages of adaptation to and interaction with another culture during<br />

a period of residence.<br />

e. Readiness to engage with the conventions and rites of verbal and non-verbal communication and<br />

interaction.<br />

II. Knowledge (savoirs): of social groups and their products and practices in one’s own<br />

and in one’s interlocutor’s country, and of the general processes of societal and<br />

individual interaction.<br />

Objectives (knowledge of/about):<br />

a. historical and contemporary relationships between one’s own and one’s interlocutor’s countries.<br />

b. the means of achieving contact with interlocutors from another country (at a distance or in proximity), of<br />

travel to and from, and the institutions which facilitate contact or help resolve problems.<br />

c. the types of cause and process of misunderstanding between interlocutors of different cultural origins.<br />

d. the national memory of one’s own country and how its events are related to and seen from the<br />

perspective of other countries.<br />

e. the national memory of one’s interlocutor’s country and the perspective on them from one’s own<br />

country.<br />

f. the national definitions of geographical space in one’s own country, and how these are perceived from<br />

the perspective of other countries.<br />

g. the national definitions of geographical space in one’s interlocutor’s country and the perspective on<br />

them from one’s own.<br />

h. the processes and institutions of socialisation in one’s own and in one’s interlocutor’s country.<br />

i. social distinctions and their principal markers, in one’s own country and one’s interlocutor’s.<br />

j. institutions, and perceptions of them, which impinge on daily life within one’s own and in one’s<br />

interlocutor’s country and which conduct and influence relationships between them.<br />

k. the process of social interaction in one’s interlocutor’s country.<br />

III. Skills of interpreting and relating (savoir comprendre): ability to interpret a<br />

document or event from another culture, to explain it and relate it to documents or<br />

events from one’s own.<br />

Objectives (ability to):<br />

a. identify ethnocentric perspectives in a document or event and explain their origins.<br />

b. identify areas of misunderstanding and dysfunction in an interaction and explain them in terms of each<br />

of the cultural systems present.<br />

c. mediate between conflicting interpretations of phenomena.<br />

<strong>CERCLL</strong> ICC Proceedings 33

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!