Cognitive Neuroscience PSYC2025 – Lecture 11
Language
The anatomy of language
- Of all higher cognitive functions, language may be most important
- It is means by which we transit information about past, present, and future
- Other species have systems of communication, but language is uniquely human
-
-
-
-
-
-
Left perisylvian language network – language processing is left-lateralized around Sylvian
fissure
o Wernicke’s area – posterior end of superior temporal gyrus
o Inferior parietal lobe – including supramarginal gyrus and angular gyrus
o Inferior frontal cortex – includes Broca’s area and insular cortex
Aphasia – deficits in language comprehension and production that accompany neurological
damage
Aphasia may also be accompanied by
o Dysarthria – speech problems caused by loss of control over articulatory muscles
o Apraxia – deficits in the motor planning of articulations
Broca’s aphasia – speech difficulties in the absence of severe comprehension problems
Speech problems include
o Spontaneous speaking
o Repeating
o Listening for comprehension
Idea Broca’s area responsible for speech deficits in aphasia has been challenged
Dronkers (1996) found about half of Ps with lesions to Broca’s area had broca’s aphasia
Broca never dissected patient’s brain
Preserved them in Paris museum
Allowed for high resolution MRI of two of Broca’s patients
Lesions did not map onto modern conceptualizations of Broca’s area
Broca’s area = pars opercularis and pars triangularis of inferior frontal gyrus
o Leborgne’s brain – lesions went well beyond Broca’s area including insular cortex
and parts of basal ganglia
o Lelong’s brain – lesions affected half of pars opercularis (sparing pars triangularis)
Damage to Broca’s area may not be solely responsible for speech problems in Broca’s
aphasia
Wernicke’s aphasia – difficulty understanding written or spoken language. Although they can
produce grammatically correct speech it is often nonsense
Most severe forms of Wernicke’s aphasia are seen when the surrounding cortex in posterior
temporal lobe is also lesioned
The fundamentals of language in the human brain
- How does the brain deal with written, spoken, or gestured input to derive meaning?
- How does the brain produce written, spoken, or signed output to communicate meaning to
others?
-
-
-
To address these questions the brain must store representations of words and their
associated concepts
A word has two properties: Meaning +
o Spoken language: a phonological (sound-based) form
o Written language: an orthographic (vision-based) form
This information is stored in the mental lexicon
Mental lexicon – a mental store of information about words, includes:
o Semantic information – words meaning
o Syntactic information – how the words combine to form sentences
o Details of word forms – spelling and sound patterns
The mental lexicon is central to most language theories
Disagreement: are there separate lexicons for production and comprehension?
-
Once we have perceptually analyzed words (through sound, writing, or gesture) three
functions of the mental lexicon are hypothesised
1. Lexical access – output of percetual analysis activates word-form attributes in mental
lexicon
2. Lexical selection – representation that best matches input is identified
3. Lexical integration – final stage where words are integrated into full sentence or larger
context to understand meaning of whole message
-
There are 4 organising principles of metal lexicon
1. Morpheme – smallest unit of representation in mental lexicon
a. Example – word defroster has three morphemes
2. More frequently used words are accessed more quickly
a. Example – word people accessed more than word fledgling
3. Phoneme – smallest unit of sound that makes a difference in meaning. Words clustered
together in lexicon that differ by single eltter of phoneme (e.g. bat, cat, hat)
4. Representations in the mental lexicon are organised according to semantic relationships
between words
a. Ps are faster to identify target word (e.g. truck) after being primed with
semantically related word (e.g. car)
-
What are neural substrates of mental lexicon?
Martin et al. (1996) – separable brain networks for biological vs. human-made objects
o Biological – lateral fusiform gyrus, superior temporal sulcus, and areas implicated in
early visual processing (medial occipital lobe)
o Human-made – medial fusiform gyrus, middle temporal gyrus, premotor area
Other studies indicate a network that connects inferior temporal love to left anterior
temporal love
Tyler et al. (2011)
o Domain-specific level (Tiger or Knife)
o Domain-general (Living or Non-living)
Naming is faster for domain general – only need a subset of features
Similar results are observed in studies of neurologically intact participants
Domain-specific but not domain general naming modulates anterior temporal lobe activity
EEG and MEG studies show a time course where domain specific naming occurs at about
300ms after stimulus onset
-
-
Language Comprehension: Early Steps
- Brain uses some of same processes to understand spoken and written language
- Have different perceptual inputs
- What are earlier stages and what are their neural substrates
Spoken Input: Understanding Speech
- Listener must identify and distinguish relevant speech from other sounds
- There are +/- 40 phonemes in English
o From birth, infants can distinguish between any phoneme (in any language)
o Babbling has all phonemes but becomes more like native language over time
o After first year, production/perception of nonnative phonemes goes away
- Segmentation problem – how do we detect the breaks between phonemes in spoken
language?
- We use rhythm and pitch (i.e., prosodic information).
- We also use the stress placed on first vs. second syllable
- Speech is first processed in primary auditory cortex – high sensitivity to all auditory input
- Further away from primary auditory cortex the more specialised regions become to speech
- L. inferior temporal cortex – accessing and integrating semantic representations
Written Input: Reading Words
- When we learn to read, we are learning to link arbitrary visual symbols to meaningful words
- In order to read those visual symbols, we must be able to analyse the primitive features
- Selfridge (1959) proposed a highly influential model for visual stimulus processing
- Model was bottom up and implied we process each letter serially
- McClelland & Rumelhart (1981) proposed a top-down model
- Unlike Selfridge’s model, this model implies parallel processing
- The identification of orthographic units may take place in a part of the L. occipitotemporal
region. Called the visual word form are (VWFA)
- Its counterpart of the right side is the FFA
- Early PET studies showed the VWFA preferentially activated for word strings
- Puce et al. (1996 ) found regions in the L. occipitotemporal region were activated by letter
strings (vs. faces)
- Cohen et al. (2000) combined EEG and fMRI to map the spatial and temporal dynamics of
reading
- Showed Ps words and non-words and asked to repeat the word out loud
o 150-160 ms: words and non-words both produced a negative deflection contralateral
to hemifield
o 180-200 ms: left lateralized negativity driven by VWFA activation
o 240-360 ms: differences between words and non-words emerge driven by activity in
the L. temporal lobe
Language Comprehension: Later Steps
- We are now at the point where comprehension is similar across visual and auditory
modalities
- Does context influence word processing before or after lexical access and lexical selection?
The tall man planted a tree on the bank.
- When does the sentences context influence activation of the multiple meanings of the word
“bank”?
-
-
Do both the contextually inappropriate and appropriate become briefly activated, regardless
of context?
Does context constrain activation to contextually appropriate words?
Two types of representations are relevant to words in context
o Lower-level representations based on sensory input – identification of the word
“bank”
o higher-level representations – constructed from the context preceding the word
“bank”
both lower and higher-level representations are important and at some point, they must
interact
-
There are three types of models that explain how these lower and higher-level
representations influence word comprehension
1. Modular models – bottom up, no interaction between levels
2. Interactive models – both lower and higher-level representations can influence word
recognition in parallel. In these models, context can constrain the availability of wordform representations in the lexicon before sensory input
3. Hybrid models – sit in between modular and interactive models. Lexical access =
modular. Lexical selection = interactive
-
Zwitserlood (1989) – cross-modal lexical decision task
Target stimulus: auditorily presented word (e.g., general, generous)
During the auditory priming participants are also visually primed with a related or unrelated
word
The visual prime comes before or after the uniqueness point (i.e., vowel after “R”)
Before the uniqueness point both possibilities should be activated
After that point, visual priming of related words should facilitate word recognition
Zwitserlood (1989) – cross-modal lexical decision task in context of short passages of text
o Target word – Captain
o Auditory competitor – Capital
o Before uniqueness point, either target word or competitor is likely to occur
o Visual primes could be related to captain or unrelated to captain and related to
capital
o “With dampened spirits the men stood around the grave. They mourned the loss of
their captain”
Is visual prime a word?
Ps significantly faster to say ship is word even when whole word wasn’t spoken yet
-
-
-
fMRI studies show that lexical access and lexical selection involve
o superior temporal gyrus
o middle temporal gyrus
o dorsal IFG
MTG and STG also important for translating word sounds into meaning
Dorsal IFG becomes more important during lexical competition
How do we process the structure of a sentence?
Semantic processing helps us understand meaning of an ambiguous word like “bank” coming
at the end of a sentence
-
Every sentence has a syntactic structure: actor, action, object
o Syntactic parsing – we assign a word to a part of that syntactic structure
we will look at how cognitive neuroscientists have used EEG to uncover neural basis of
semantic and syntactic processing
Semantic Processing and N400 Wave
- EEG gas great temporal but poor spatial resolution
- What are the neural generators of the N400?
- N400 is reduced and delayed in those with left-hemisphere damage and severe
comprehension deficits
- Intracranial recordings from the temporal love find an N400 like component
- MEG and fMRI studies also suggest the left temporal love is the likely neural generator of the
semantic N400
Syntactic Processing
- PET and fMRI studies in healthy controls and aphasic patients highlight a syntactic processing
network
- This network includes left inferior frontal gyrus; bilateral superior temporal brain regions
Neural Models of Language Comprehension
- Memory-unification-control model (Hagoort, 2005)
- Divides language processing in three functional components
o Memory
o Unification
o Control
- Memory – language-specific knowledge that is encoded and consolidated in long-term
memory
- Knowledge about the building blocks of language (e.g., phonemes, morphemes)
- Unification – integration of retrieved phonological, semantic, and syntactic info into a
representation of an utterance
- Control – language in social situations (e.g., bilingualism, taking turns in a conversation)
- Temporal lobes are important for storage and retrieval of word representations (Memory) –
Wernicke’s area
- Left inferior frontal gyrus is important integrating info (Unification) – Broca’s area
- Control – ACC and DLPFC play big role during cognitive control in language comprehension
Left Perisylvian Language System
- Four major language comprehension pathways
- Ventral pathways important for comprehension word meanings
- Dorsal pathway that connects to the premotor cortex (speech prep)
- Dorsal pathway connects Broca’s area (esp. BA44) with the STG and STS (syntactic
processing)
Neural Models of Speech Production
- Step 1 – prepare the message
o Macroplanning – what you want to express
o Microplanning – how you plan to express it
- Step 2 – put the message in the grammatically and phonologically correct form
-
Step 3 – articulate the message
Hierarchical state feedback control (HSFC) model – combines motor and psycholinguistic
approaches to speech production
Begins with the activation of a conceptual representation
This activated a word representation
Then parallel processing in sensory and motor systems
Once a word is activated projections to the motor and sensory systesm occur in parallel
The highest level (syllables) – integration of motor programs in Broca’s area with the primary
auditory cortex
Lower level – articulation of speech. Motor production of phonemes integrated with
somatosensory information