An Electrophysiological Investigation of the Effects of Coreference on Word Repetition and Synonymy Jane E. Anderson & Phillip J. Holcomb 2005 Presented by Dora Lu for Psych593SG Coherent Speech… How to relate new and old information? (1a) The truck rolled into a ditch as the driver was flagging down a passing car. • Noun repetition (2a) The truck had a bad parking brake. • Synonym (2b) The vehicle had a bad parking brake. • Anaphors: pronouns (2c) It had a bad parking brake. Goals of this study • How the neural system underlying text comprehension use ‘noun repetition’ and ‘synonym’ to refer to a previously mentioned instance. - repetition and semantic priming effect (lexical/semantic memory effects or a discourse factor) - coreferential effect elicited by definite and indefinite article Repetition Effect • Robust in lexical decision, word identification and naming tasks -Behavioral: words are processed faster and more accurately when they are preceded by an earlier presentation of the same word From Scarborough et al. (1977) Repetition Effect: ERP Repeated items: • Attenuation of the N400 • The augmentation of a subsequent late positive component (LPC) LPC (Rugg 1987) Semantic Priming Effect • Behavioral: when a target word is preceded by a semantically related priming word, RTs are shorter dog……cat • ERP: - the N400 is attenuated if compared to an unrelated prime word preceding the same target word. dog……cat vs. pan……cat - Semantic priming does not results in an enhancement of the subsequent LPC Priming Effect • Why smaller N400? - Reflect the ease of integrating the semantic information activated by a primed word (Holcomb 1993) Priming Effect -The late positive component (LPC) reflects a larger discrepancy between the baseline familiarity of low frequency words and their high experimental familiarity (Rugg, 1990) Repetition Effect in longer texts • Van Petten et al (1991): reading texts from Readers’ Digest -Found ERP repetition effects during text processing. -Opposite results: Larger LPC for not repeated words N400 and global processing • St. George et al. (1989): N400 to content words was larger when the paragraph was not coherent (i.e. paragraph did not have a title) N400 and global processing • N400 for discourse anomalies (Van Berkum et al 1999) As agreed upon, Jane was to wake her sister and her brother at five o’clock. But the sister had already washed herself and the brother have even got dressed. a) discourse-coherent: Jane told the brother that he was exceptionally quick. b) discourse-anomalous: Jane told the brother that he was exceptionally slow. • The N400 to the discourse anomaly had a similar time course, distribution and morphology compared to the N400 elicited by a local anomaly. N400 and global processing • Subsequent definite noun elicited a more negative-going waveform compared to when there was only one potential referent (Van Berkum et al 1999). One referent: David had told the boy and the girl to clean up their room before lunch time. But the boy had stayed in bed all morning, and the girl had been on the phone all the time. Two referents: David had told two girls to clean up their room before lunch time. But one of the girls had stayed in bed all morning, and the other had been on the phone all the time. David told the girl that there will be some vistors. • These effect have been replicated in auditory modality as well (Van Berkum et al 2003) Processing of definite/indefinite noun phrases: • Behavioral: Irwin et al. (1982): -Repeated words were faster than not repeated words -Words preceded by the definite article were responded even faster definite article provides a cue for old information and this facilitates its processing Murphy (1984): -RTs for sentences containing definite article are faster than sentences containing indefinite article. Finding the antecedent for a definite reference is easier than establishing a new referent. However, these behavior studies cannot tell us… • On-line comprehension process. • Lexical decision task may encourage people to adopt unnatural sentence processing strategies. • Lexical decision task doesn’t allow people to examine the repetition and coreference effects in longer contexts. Current Study Repetition priming condition: Kathy sat nervously in the cab on her way to the airport. a) The cab came very close to hitting a car. b) A cab came very close to hitting a car. Synonym (semantic) priming condition: Kathy sat nervously in the taxi on her way to the airport. a) The cab came very close to hitting a car. b) A cab came very close to hitting a car. Kathy sat nervously in the cab on her way to the airport. a) The cab came very close to hitting a car. b) A cab came very close to hitting a car. Predictions If N400 is also sensitive to coreference (a discourse factor), then…. • For repetition priming condition: -stronger repetition effects for words preceded by the definite article. Greater attenuation of the N400 • For semantic priming condition: -similar as repetition effects but to a lesser degree Kathy sat nervously in the cab on her way to the airport. a) The cab came very close to hitting a car. b) A cab came very close to hitting a car. Predictions If N400 is primarily sensitive to lexical/sentential processes, then…. • Equivalent N400 attenuation for words following definite and indefinite articles. • May have other ERP components that are sensitive to coreference (i.e. LAN). repeated and synonym noun phrases following definite articles should produce a larger LAN. the indefinite noun phrases will have a larger LAN, because they are harder to integrate processing difficulties may be indexed by N400, LAN or other components Kathy sat nervously in the cab on her way to the airport. a) The cab came very close to hitting a car. b) A cab came very close to hitting a car. Predictions Sentence final words… Osterhout & Holcomb (1992): sentence final words from sentences that are semantically difficult to interpret have larger N400. sentences with indefinite article should have larger negativity. Kathy sat nervously in the cab on her way to the airport. a) The cab came very close to hitting a car. b) A cab came very close to hitting a car. Summary of predictions: Component Target Word The cab N400 discourse smaller A cab Larger Final word Larger lexical LAN WM load Same Larger amount of attenuation for indefinite sentences smaller Integration smaller Larger Others Processing difficulties could be indexed by both N400 + LAN Experiment 1 • A control study to verify… -the differences they found are not due to the inherent (physical/lexical) differences between ‘The’ and ‘A’ -determine the ‘carry-over’ effect Experiment 1: Stimuli Experimental (repetition) -Kathy sat nervously in the cab on her way to the airport. a) The cab came very close to hitting a car. b) A cab came very close to hitting a car. Experimental (synonym) -Kathy sat nervously in the taxi on her way to the airport. a) The cab came very close to hitting a car. b) A cab came very close to hitting a car. Filler: -Joanne had just won her bet at the horse races. She waited in line to get 75 dollars. Anomaly: -Joshua was riding on his bus to school one morning. A bus was stalled at the butter Experiment 1: Stimuli Experimental (120) -Kathy sat nervously in the cab on her way to the airport. a) The cab came very close to hitting a car. (60) b) A cab came very close to hitting a car. (60) Experimental (synonym) -Kathy sat nervously in the taxi on her way to the airport. a) The cab came very close to hitting a car. b) A cab came very close to hitting a car. Filler: (30) -Joanne had just won her bet at the horse races. She waited in line to get 75 dollars. Anomaly: (30) -Joshua was riding on his bus to school one morning. A bus was stalled at the butter Experiment 1 • Participants: 24 • Procedure: -central presentation, one word at a time -determine sentences are good or anomalous -A rest break after 30 trials. 4 true/false comprehension questions at each break. Experiment 1: procedure 500ms 500ms + 345ms 70ms The 345ms 70ms cab 70ms …… 1500ms 345ms car Yes or No Respond now Comprehension question 2000ms Respond now Yes or No Experiment 1: Data • Data recording: 13 locations, referenced to left mastoid. • Data analysis: -time locked to articles -time locked to the critical noun -time windows (P2, N280)(N400, N400-700) onset (critical word N400, LAN) 150ms 300 450 600 750 900 1050 1200 1350ms (400-700, 700-1100ms for final word) Experiment 1: Results a) The cab came very close to hitting a car. b) A cab came very close to hitting a car. Experiment 1: Results a) The cab came very close to hitting a car. b) A cab came very close to hitting a car. Experiment 1: Results a) The cab came very close to hitting a car. b) A cab came very close to hitting a car. Experiment 1: Results a) The cab came very close to hitting a car. b) A cab came very close to hitting a car. Experiment 1: Results • If time-locked to article: 150-300ms 300-600ms Indefinite Indefinite more more negative negative, anterior distribution 7151015ms Final word (400-700, 700-1100) No differences no differences • If time-locked to critical noun: Between 300-600ms, words following definite article were more negative Experiment 1: discussion • Both articles elicited N280 and N400700, typical pattern for closed class words. • Words following the indefinite article ‘A’ were more negative over the anterior cites. not coreference, but due to the lexical function of the articles. Why greater negativity for the indefinite article? • The indefinite article reflects the anticipation of ‘new’ information. This might relate to the contingent negative variation (CNV). (Van Petten and Kutas 1991) Contingent negative variation (CNV) • Chronometric paradigm: paired-stimulus. • CNV: a slow negative component that develops between a warning stimulus and a subsequent imperative stimulus. • Usually observed when subjects performed a task requiring motor responses. Reflecting the anticipation or preparation for incoming information. foreperiod Warning stimulus Imperative stimulus respond Why greater negativity for the indefinite article? • There is a preference for the definite article at the beginning of sentences and for the indefinite article in the object position (Yekovich et al. 1979) • The difference is due to the physical attributes of the articles. Word length is a predictor of negativity (Osterhout et al 2002). • Word length and CNV: indefinite article was accessed in less time, given more time to anticipate the next word, which results in an enhanced CNV. Experiment 1: discussion • Time locked to article, no differences in the ERPS to critical nouns following the articles no carry over • Conditions do not differ in final word article differences in the beginning of the sentence do not affect sentence wrap up effect Experiment 2: Stimuli Experimental (repetition) (60) -Kathy sat nervously in the cab on her way to the airport. a) The cab came very close to hitting a car. (30) b) A cab came very close to hitting a car. (30) Experimental (synonym) (60) -Kathy sat nervously in the taxi on her way to the airport. a) The cab came very close to hitting a car. (30) b) A cab came very close to hitting a car. (30) Filler: (30) -Joanne had just won her bet at the horse races. She waited in line to get 75 dollars. Anomaly: (30) -Joshua was riding on his bus to school one morning. A bus was stalled at the butter Experiment 2: procedure 500ms + 500ms 345ms 70ms The 345ms (SOA:415ms) 70ms cab 345ms 70ms …… 370ms car Next word (SOA:715ms) …… Last word Yes or No 1500ms Respond now Experiment 2 results: article effects (150-300ms) Kathy sat nervously in the cab on her way to the airport. a) The cab came very close to hitting a car. b) A cab came very close to hitting a car. Experiment 2 results: article effects (300-600ms) Kathy sat nervously in the cab on her way to the airport. a) The cab came very close to hitting a car. b) A cab came very close to hitting a car. Experiment 2 results: article effects (715-1015ms) Kathy sat nervously in the cab on her way to the airport. a) The cab came very close to hitting a car. b) A cab came very close to hitting a car. Experiment 2 results: article effects (715-1015ms) Kathy sat nervously in the cab on her way to the airport. a) The cab came very close to hitting a car. b) A cab came very close to hitting a car. Experiment 2: priming effect Kathy sat nervously in the cab on her way to the airport. (repetition) Kathy sat nervously in the taxi on her way to the airport. (synonym) A/The cab came very close to hitting a car. • Effects of repetition and semantic priming: repeated words are less negative. Experiment 2: priming effect Kathy sat nervously in the cab on her way to the airport. (antecedent) Kathy sat nervously in the taxi on her way to the airport. (antecedent) a) The cab came very close to hitting a car. (repetition) b) A cab came very close to hitting a car. (synonym) Experiment 2: Results • The N400 amplitude of content words declines with increasing sentence position, reflecting the build-up of contextual constraints. (Van Petten & Kutas 1990) • The declination has not been found with longer texts (Van Petten 1995) • So, what does the smaller N400 for repeated and synonym words mean? Larger build-up of context? Experiment 2: priming effect Joanne had just won her bet at the horse races. (filler) a) The cab came very close to hitting a car. (repetition) b) A cab came very close to hitting a car. (synonym) Experiment 2: results • The priming effect was not modulate by coreferential status. Experiment 2: results • Final word: negative-going component onset at about 300ms. Waveforms start diverging around 400ms and last throughout. • In 400-700ms window, main effect of coreferential status. Indefinite sentences more negative. Larger effect at central and posterior sites. Discussion: comparison of exp1 and exp2 • Indefinite article ‘A’ elicited a greater N400-700 than the definite article ‘The’ with (exp2) or without (exp1) context. processing differences even when the definite article ‘the’ does not explicitly refer to given information. • The greater negativity of indefinite article could be reflecting the anticipation of the upcoming noun. But not sure if this is due to discourse factors, word length or other factors. • No P2 found in exp2. This could be a carry-over effect in exp1, or this is an exogenous component related to word size. Subjects read a lead-in sentence in exp2. • Found repetition/semantic priming effects (N400 attenuation) across sentence boundary. Discussion • Priming effects were not modulated by the coreferential status. Why? -the priming effects are so strong that they obscure the weaker coreference effect. • Coreferential effect: different than N400 in: 1) distribution. Greater negativity over left anterior and temporal sites to coreferential words (definite). 2) Opposite polarity. Coreferential items have larger negativities. Coreferential effects elicited LAN. LAN • Elicited by syntactic violations (Osterhout & Holcomb 1992) But coreference is not a syntactic anomaly. • Elicited by the increasing demands on working memory. (King & Kutas 1995) • LAN to verbs in object relative sentences. Thematic role assignment is a harder process in object relative clauses. The head noun must be reactivated to be assigned and which increases working memory load. The reporter who the senator harshly attacked admitted the error. The reporter who harshly attacked the senator admitted the error. • For the definite article, the referential assignment causes an increase in the working memory load. Correferential effects: LAN in exp2 a) The cab came very close to hitting a car. b) A cab came very close to hitting a car. Final word effects a) The cab came very close to hitting a car. b) A cab came very close to hitting a car. Final word effect • Non-coreferential sentences are more negative. • Not shown on the critical noun, but could be a delayed effect, because they have similar distribution to the N400 (centralparietal). • This effect could reflect difficulty in integrating the meaning of sentences that began with indefinite article. Coreferential trials are more coherent than the noncoreferential ones. LPC • No LPC found. Why? -words in this study were not low in frequency -rapid presentation rate in this study precluded the presence of late positivity. Kathy sat nervously in the cab on her way to the airport. a) The cab came very close to hitting a car. b) A cab came very close to hitting a car. Summary: Component Target Word The cab N400 discourse smaller A cab Larger Final word Larger lexical LAN WM load Same Larger amount of attenuation for indefinite sentences smaller Repetition effect Integration Larger N400 smaller Larger for repeated words, and this effect extended to a discourse level. Thank you! Questions to Susan or me? Comments? Questions • Compare the repetition and synonym with the first content word of the fillers. No fixed position and word classes? • The ‘antecedents’ in the first sentence always preceded by the definite article. It somehow makes the indefinite NP in the beginning of the second sentence less preferable. Would it be better to manipulate the articles in the first sentence too?