When Two Languages Compete: Evidence for Cross-language Activation in Bilingual Production Judith F. Kroll Department of Psychology Pennsylvania State University University Park, PA 16802 USA Acknowledgments Collaborators: • • • • • • • • • • • Teresa Bajo Susan Bobb Kate Cheng Ingrid Christoffels Dorothee Chwilla Albert Costa Annette De Groot Franziska Dietz Ton Dijkstra Giuli Dussias Chip Gerfen • • • • • • • • • • • • Tamar Gollan David Green Noriko Hoshino April Jacobs Niels Janssen Debra Jared Jared Linck Pedro Macizo Erica Michael Natasha Miller Maya Misra Scott Payne • • • • • • • • • • • Pilar Piñar Carmen Ruiz Nuria Sagarra Mikel Santesteban Herbert Schriefers Ana Schwartz Bianca Sumutka Gretchen Sunderman Natasha Tokowicz Janet Van Hell Zofia Wodniecka Research Support: • National Science Foundation Grants, BCS-0111734 and BCS-0418071 • NIH Grant RO1MH62479 • RGSO Grant, Penn State University • Language Science Research Group at Penn State University Cognitive research on bilingualism has increased dramatically in the past 10-15 years Experimental psycholinguistics contributes one approach to understanding the nature of bilingual experience Bilinguals provide a model for cognitive scientists interested in developing a universal account of how cognitive systems develop and interact with one another In this talk I focus on behavioral research methods that complement linguistic analyses and neuroimaging to illustrate this approach Amsterdam, Centraal Station Dutch-English speaker “bike” “fiets” Talk Outline Spoken production as a case to illustrate the logic of cognitive approaches to bilingualism What evidence suggests that both languages are active when even a single word is spoken? How deep into speech planning does that activation extend? How is the activity of the two languages resolved? Cues to language status Inhibition Questions for ongoing research Dutch-English speaker “bike” “fiets” How does a speaker of two languages select the words to produce? Selective access: The intention to speak in one language determines which candidates become active The two languages are functionally separate Non-selective access: Candidates in both languages become active in parallel and may compete for selection Distinct cues to language membership may eventually bias access for candidates in the intended language or allow those in the unintended language to be inhibited Selective access: Functional separation Dutch-English speaker “fiets” Non-selective access: Parallel activation and later selection Dutch-English speaker “bike” “fiets” Past bilingual production experiments converge on the conclusion of nonselective access but come to different conclusions regarding the locus of selection. Some argue that selection occurs at the level of the lemma or abstract lexical representation whereas other studies suggest that crosslanguage competition extends to the phonology Nonselective to the lemma level Nonselective to the phonology If highly proficient bilinguals cannot select the language they intend to speak in advance, then the problem becomes even more cognitively challenging for second language learners and unbalanced bilinguals for whom the first language is far more dominant and active than the second. Spoken production as a case to illustrate the logic of cognitive approaches to bilingualism What evidence suggests that both languages are active when even a single word is spoken? How deep into speech planning does that activation extend? How is the activity of the two languages resolved? Cues to language status Inhibition Questions for ongoing research Psycholinguistic Tools: Three Laboratory Production Tasks “fiets” picture naming word translation bike “fiets” word naming fiets “fiets” Exploit a classic interference task: Stroop (1935): Name the color of the ink: GREEN: “green” GREEN: “red” XXXXX: “blue” Variations of the Stroop Task Interference in picture naming coche How does the language of the distractor word affect the presence of semantic interference? If production is language selective, then only distractors in the language to be spoken should produce interference. Semantic interference does not depend on the language of the distractor! 50 40 * * 30 Magnitude of Semantic 20 Interference 10 0 -10 L1 L2 Language of Distractor Data from Costa & Caramazza (2000) for Spanish-English bilinguals naming pictures in Spanish (L1) with distractors in Spanish (L1) and in English (L2) Another approach: Effects of language mixture: If language production is fundamentally selective, then requiring both languages to be active should disrupt picture naming performance Cued Picture Naming: Language of naming depends on an auditory cue (Kroll, Dijkstra, Janssen, & Schriefers, in preparation) Logic of Cued Picture Naming: Mixed conditions: Name the picture in English if you hear the high tone and in Dutch if you hear the low tone Force activation of both languages Blocked conditions: Name the picture in English (or Dutch) if you hear the high tone and say “no” if you hear the low tone Activation of the nontarget language is optional Cost of Language Mixing in Cued Picture Naming: Dutch-English Bilinguals (Kroll et al., in preparation) Overall Mixed vs. Blocked Naming Latencies Mean Naming Latency (ms) 900 Mixed Blocked 850 800 750 700 650 600 L1 L2 Language These results suggest that L1 is normally active during lexicalization into the L2. Requiring L1 to be active does not affect L2 picture naming performance. The cost to L1 resembles the effects of language switching on L1. Miller (2001): What happens to picture naming when the language of a probe word naming task is in the L1 or L2? 1 . ? “frog” 2 . frog “frog” 3. kikker “kikker” Mean Picture Naming Latency (ms) Same basic result: Little effect on L2 when L1 is required to be used; performance appears nonselective in both cases. For L1, there is a significant cost when L2 is required to be active 800 L1 P robe L2 P robe 750 700 650 600 550 500 L1 Language of Picture Naming L2 Spoken production as a case to illustrate the logic of cognitive approaches to bilingualism What evidence suggests that both languages are active when even a single word is spoken? How deep into speech planning does that activation extend? How is the activity of the two languages resolved? Cues to language status Inhibition Questions for ongoing research How far into speech planning does parallel activation extend? cognate status of the picture’s name An indication of the level at which the nontarget alternative is active If the phonology of the target alternative is available, then we might predict facilitation in picture naming due to the overlap across languages Simple picture naming in L2 and by monolinguals: Costa, Caramazza, & Sebastián-Gallés (2000) cognate facilitation 710 700 690 680 Mean Naming 670 Latency (ms) 660 650 640 630 Cognates Noncognates Bilinguals Bilinguals: Monolinguals: Monolinguals Catalan-Spanish speakers naming in Spanish (L2) Native Spanish speakers naming in Spanish (L1) Cognate facilitation suggests that the other language is active to the level of the phonology Effect of Cognate Status in Cued Picture Naming: Dutch-English Bilinguals (Kroll et al., in preparation) Naming Pictures in L2 with Cognate Names in L1: Blocked vs. Mixed Conditions 100 Blocked L2 Cog interference Mixed L2 Cog 60 Magnitude of cognate facilitation in naming pictures in the L2 under mixed and blocked language conditions. 40 20 0 -20 facilitation Magnitude of Cognate Effect (ms) 80 -40 -60 -80 -100 0 500 1000 SOA For L2 there is very little consequence of whether language is mixed Spoken production as a case to illustrate the logic of cognitive approaches to bilingualism What evidence suggests that both languages are active when even a single word is spoken? How deep into speech planning does that activation extend? How is the activity of the two languages resolved? Cues to language status Inhibition Questions for ongoing research The results for naming cognate pictures suggest that the activity of the nontarget language reaches the level of the phonology. But can bilinguals exploit language cues in the nature of the event that initiates production to minimize cross-language influences? More likely to be a a fiets than a bike? Even more likely to be a fiets? Definitely Dutch! Bringing the problem into the lab… Compare translation to picture naming: In translation there is a cue to the language present in the nature of the input picture naming word translation “fiets” bike “fiets” don’t speak English! Miller & Kroll (2002): Translation Stroop: What happens when the distractor is in the language of the input? English Spanish If there is a cue in the event that initiates speech planning, then a distractor in the input language should not influence production. Stroop interference in translation only when the distractor appeared in the language of the word to be spoken, unlike the Stroop interference observed for picture naming 1450 1400 Mean Translation 1350 Latency (ms) 1300 Related Unrelated 1250 Output Input Language of the Distractor A cue in the language input allowed production to proceed selectively! Does the language of a sentence context function as a cue? Schwartz (2003): Take words that have been shown to elicit activation of both languages and put them in full sentence context. Cognates with identical/similar orthography but similar or different phonology: English piano base Spanish piano base Cross-language phonology Similar [+p] Different [-p] 620 +P -P 600 580 Mean Naming 560 Latency (ms) 540 520 500 Type of Cognate Out of context: Facilitation for naming cognates in L2 when the phonology converges from L1 to L2 RSVP: Method for naming words in sentence context (250ms/word) + home The boy Who ran home? ran Follow along with sentence. Say red word out loud. Answer questions when asked. RSVP: Rapid Serial Visual Presentation home for dinner. Schwartz (2003): Does the facilitation for naming cognates disappear in sentence context? If the sentence provides a cue to language membership, then no cognate effects should be observed +P -P 720 700 Type o f Sentence High cons traint Low con straint Example The co mposer sat at the b ench and began to p lay the piano as the lights dimm ed. High 680 Mean Naming Latency (ms) 660 640 620 Type of Cognate As we wa lked through the room we noticed there wa s a large piano by the window. 720 +P -P 700 Result: Sentence constraint but not language per se eliminates the cognate effect Low 680 Mean Naming Latency (ms) 660 640 620 Type of Cognate Naming in the L2 What cues effectively reduce cross-language competition? Language-specific information in the event that initiates speech planning (Miller & Kroll, 2002) Convergence between language-specific information and meaning (Schwartz, 2003, Van Hell, 1998) What cues do not reduce cross-language competition? The language of a sentence context itself (Schwartz, 2003; Van Hell, 1998) The intention to use one language only (Van Hell & Dijkstra, 2002) Instructions (Dijkstra et al., 2000) Cross-language script differences (Hoshino & Kroll, 2005) Spoken production as a case to illustrate the logic of cognitive approaches to bilingualism What evidence suggests that both languages are active when even a single word is spoken? How deep into speech planning does that activation extend? How is the activity of the two languages resolved? Cues to language status Inhibition Questions for ongoing research Inhibition: Do bilinguals inhibit one language to speak the other? Some recent research suggests not: Costa & Santesteban (2004): Highly balanced Spanish-Catalan bilinguals in Barcelona do not appear to require inhibition when switching between languages Three laboratory approaches to examine how inhibition may operate when L2 speakers are immersed in the L2 Simulated immersion in the lab Actual immersion in an L2 environment Forced L2 immersion within the L1 environment Simulated immersion in the laboratory Kroll, Michael, & Sankaranarayanan (1998): Attempted to simulate one aspect of an immersion environment in a training study in the laboratory by providing unique cues to the L2. What’s helpful about immersion? Suppression of L1 Unique cues to L2 Teach American college students who know no Dutch or German 40 new Dutch words by associating them to their English translations or to pictures of the objects to which they refer. Training conditions for monolingual English speakers: The twist: The pictures were sometimes shown in a noncanonical orientation The noncanonical orientation may: 1. Provide a unique cue to the L2 word and/or 2. Inhibit the process of retrieving the L1 name ? At test: Translate words from English to Dutch or name pictures in Dutch. There is typically a cost to naming pictures of noncanonical objects. The question here is whether that cost will be observed for learners who acquired the new L2 concepts by associating them to the noncanonical objects. What is the cost of noncanonicality at test? [noncanonical-normal orientation] 400 300 Cost of Noncanonical Pictures (ms) Word Training, Picture Test Picture Training, Picture Test Picture Training, Word Test 200 100 0 -100 -200 Canonicality Effect This is the remarkable result: Faster to later translate from English to Dutch if trained on the noncanonical pictures! Real L2 immersion during study abroad: Linck & Kroll (2005) Native English speakers at intermediate levels of Spanish spending a semester abroad in Salamanca compared to a control group of classroom learners with comparable L2 study Performed a translation recognition task (De Groot, 1992; Sunderman, 2002) in which they had to decide whether a word in English was the correct translation of a word in Spanish. hombre man ? “yes” Using materials from Sunderman (2002), the critical distractors in the experiment consisted of word pairs that were not the correct translation: mano-man: Critical items: lexical form related hambre-man: translation related mujer-man: semantically related Control items: casa-man: unrelated [Interference = Critical RT - Control RT] Results: Control learners show interference for all distractor types but immersed learners show only semantic interference 120 100 80 Magnitude of 60 Interference 40 (ms) 20 0 -20 Controls Immersed Lexical Form Translation Semantic Distractor Type In the immersion environment the L1 appears to be suppressed! Forced immersion in an L1 environment: Jacobs, Gerfen, & Kroll (2005) Native English speakers at intermediate levels of Spanish in a summer domestic immersion program or in classroom study only. The two groups appear similar in overall proficiency in Spanish as the L2: Self-assessed proficiency in L1 and L2 (10 pt. Scale): Classroom: L1 = 9.6 Immersed: L1 = 9.3 L2 = 6.3 L2 = 6.1 Percent correct rejections in Spanish lexical decision (is the string of letters a real word in Spanish?) Classroom: Immersed: 65.9% 68.7% Two groups performed a Spanish word naming experiment with cognates and lexically/phonetically matched controls Naming Latencies VOT 38 620 660 640 620 600 Cognates Controls Mean Duration (ms) 680 Mean VOT (ms) Mean Naming Latency (ms) 700 Articulatory Duration 34 30 26 Cognates Controls 580 22 Learners Learners Immersed 600 580 560 540 520 Learners Learners Immersed Cognates Controls Learners Learners Immersed Immersed learners are faster to name Spanish words and like proficient English speakers of Spanish, speak Spanish words as more Spanish-like than the classroom learners and show effects of cross-language cognate status in planning but not executing L2 speech. Again, in this immersion environment it appears that L1 is suppressed! Conclusions The results of these studies support recent claims that lexical access is language nonselective in spoken production. There is significant activation of the L1 when speaking L2 for even highly proficient bilinguals. That activation may produce crosslanguage competition. The ability to negotiate that competition may come in part from cues that reliably signal L2 and in part from the ability to inhibit irrelevant information. This work holds promise for developing a principled account of the factors that constrain cross-language activation to allow fluent performance in a single language but also code switching between languages. Questions for ongoing research How do language-specific factors influence the degree of cross-language activity? What are the implications of bilingual research for cross linguistic analyses? How is the L1 affected by proficiency in the L2? At the level of the lexicon, the phonology, and the syntax? How do the grammatical constraints that characterize codeswitching modulate cross-language activity? What are the consequences of age and context of acquisition and language maintenance? What are the cognitive consequences of cross-language competition? What is the neural basis of bilingual performance? Questions for ongoing research How do language-specific factors influence the degree of cross-language activity? What are the implications of bilingual research for cross linguistic analyses? How is the L1 affected by proficiency in the L2? At the level of the lexicon, the phonology, and the syntax? How do the grammatical constraints that characterize codeswitching modulate cross-language activity? What are the consequences of age and context of acquisition and language maintenance? What are the cognitive consequences of cross-language competition? What is the neural basis of bilingual performance? Questions for ongoing research How do language-specific factors influence the degree of cross-language activity? What are the implications of bilingual research for cross linguistic analyses? How is the L1 affected by proficiency in the L2? At the level of the lexicon, the phonology, and the syntax? How do the grammatical constraints that characterize codeswitching modulate cross-language activity? What are the consequences of age and context of acquisition and language maintenance? What are the cognitive consequences of cross-language competition? What is the neural basis of bilingual performance? Questions for ongoing research How do language-specific factors influence the degree of cross-language activity? What are the implications of bilingual research for cross linguistic analyses? How is the L1 affected by proficiency in the L2? At the level of the lexicon, the phonology, and the syntax? How do the grammatical constraints that characterize codeswitching modulate cross-language activity? What are the consequences of age and context of acquisition and language maintenance? What are the cognitive consequences of cross-language competition? What is the neural basis of bilingual performance? Questions for ongoing research How do language-specific factors influence the degree of cross-language activity? What are the implications of bilingual research for cross linguistic analyses? How is the L1 affected by proficiency in the L2? At the level of the lexicon, the phonology, and the syntax? How do the grammatical constraints that characterize codeswitching modulate cross-language activity? What are the consequences of age and context of acquisition and language maintenance? What are the cognitive consequences of cross-language competition? What is the neural basis of bilingual performance? Questions for ongoing research How do language-specific factors influence the degree of cross-language activity? What are the implications of bilingual research for cross linguistic analyses? How is the L1 affected by proficiency in the L2? At the level of the lexicon, the phonology, and the syntax? How do the grammatical constraints that characterize codeswitching modulate cross-language activity? What are the consequences of age and context of acquisition and language maintenance? What are the cognitive consequences of cross-language competition? What is the neural basis of bilingual performance? Questions for ongoing research How do language-specific factors influence the degree of cross-language activity? What are the implications of bilingual research for cross linguistic analyses? How is the L1 affected by proficiency in the L2? At the level of the lexicon, the phonology, and the syntax? How do the grammatical constraints that characterize codeswitching modulate cross-language activity? What are the consequences of age and context of acquisition and language maintenance? What are the cognitive consequences of cross-language competition? What is the neural basis of bilingual performance? Back to Amsterdam… Things could be worse in New York! Thank you!