Uploaded by propa

AttentionMemory HandbookChapter Final preprint

advertisement
Attention and Memory
Brynn E. Sherman1 (brynn.sherman@yale.edu)
Nicholas B. Turk-Browne1, 2 (nicholas.turk-browne@yale.edu)
1
Department of Psychology; 2Wu Tsai Institute, Yale University
To appear in: Oxford Handbook of Human Memory. M.J. Kahana & A.D. Wagner (Eds). Oxford
University Press.
Abstract
Attention plays an important and pervasive role in human perception, filtering complex sensory
input based on what is most salient or relevant, and gating the entry of this information into
conscious awareness. Beyond modulating processing of the current environment, the control of
attention over perception has downstream consequences for processing of the past and future,
determining what information is available for memory encoding and retrieval. This interaction
between attention and memory is bidirectional, as goals, episodes, and knowledge held in
memory in turn inform attentional selection and vigilance. These bidirectional interactions can
be found across different types of memory and their underlying brain systems. In this chapter, we
catalog the ways in which attention and memory interact, focusing on working memory, episodic
memory, and learning. By reviewing the neural and behavioral mechanisms underlying these
interactions, we reconceptualize attention as serving a broader role in the organization of the
mind, and memory as being fundamentally selective and interwoven with perception.
Keywords: cuing, selection, modulation, encoding, retrieval, hippocampus
Introduction
Various factors influence memory encoding and retrieval, including context, semantics,
emotion, and motivation — all of which and more are covered in the chapters of this book.
However, one of the strongest predictors of memory, and the focus of this chapter, is attention.
The term attention has many different meanings, but here we refer to how salience or goals
prioritize a subset of external inputs or internal states (Chun et al., 2011). This attentional
selection in turn leads to modulation — enhancing or facilitating processing of the targets of
attention and suppressing or inhibiting processing of distracting information.
By this definition, attention interacts with memory in several ways. Attention has a
powerful influence over what we perceive and thus necessarily influences what can be encoded
into memory (Uncapher et al., 2011). When oriented internally, attention helps select among
representations to be retrieved from memory (Chun & Johnson, 2011). Attentional priorities
themselves are often derived from memory, informed by when and where relevant information
was found in recent or long-past experiences (Hutchinson & Turk-Browne, 2012). The
interactions between attention and memory are thus bidirectional and recurrent, with attention
influencing which memories are formed, these memories guiding subsequent attention, and this
in turn impacting new encoding and retrieval.
Here we review evidence for interactions between attention and memory in behavior and
the brain, with an emphasis on how attentional selection operates during encoding and retrieval,
and how retrieval influences attentional selection. We highlight effects across a range of brain
systems for attention and memory (Figure 1), from shorter-term working memory, to longer-term
episodic memory, to more gradual forms of statistical learning. We consider both domaingeneral and specialized mechanisms, for example: evaluating whether attention and working
memory reflect a single flexible cognitive process versus two distinct processes, and dissociating
influences of attention on long-term memory that are a byproduct of modulation of sensory
systems versus a result of direct modulation of memory systems. Exploring this broad literature
leads to a comprehensive understanding of how attention and memory coordinate to support
cognition.
Figure 1. Summary of brain systems involved in attention and memory that are discussed
in this chapter. WM: working memory; LTM: long-term memory. The color shading
corresponds to the location of specific brain systems (purple: sensory visual cortices; blue:
frontoparietal networks; green: hippocampus; pink: neuromodulation stemming from
midbrain structures). Dashed lines indicate subcortical structures.
Attention and working memory
Attention is often thought of in terms of the external world — how we attend to the road
while driving or the professor giving a lecture. Yet we can also attend to our internal states. For
example, mind-wandering during a lecture involves orienting attention to unrelated thoughts in
mind rather than to the content of the lecture. A key insight in understanding the role of attention
in memory is that attention can be allocated to the contents of our memories, even when they are
not directly supported by stimuli in the current environment (Chun et al., 2011). This process of
internal attention dovetails with a conventional definition of working memory: the process by
which absent stimuli are actively held or maintained in mind (see Chapters 2.9 and 2.10). Indeed,
capacity limits in working memory are thought to emerge from the limitations of attentional
selection (Cowan, 1998; Cowan, 1999; Garavan, 1998; Oberauer, 2002). To what extent, though,
is internally oriented attention responsible for maintaining information in working memory?
Attention can be allocated to the contents of working memory
Traditional views of working memory suggest that maintenance is supported by two
modality-specific subsystems: a visuospatial sketchpad for holding and manipulating images in
mind, and a phonological loop for rehearsing auditory information (Baddeley, 1992). Although
these systems accord with intuitions about what it feels like to hold something in working
memory, subsequent research suggested that maintenance — particularly in the visuospatial
domain — can be understood as an allocation of attention. In a seminal behavioral study,
participants responded faster to an external stimulus presented at the same location as an item
held in working memory, and working memory accuracy was lower when external attention was
drawn away from a to-be-remembered location (Awh et al., 1998). These findings suggest that
working memory invokes attention, resulting in enhanced processing for locations currently held
in mind.
Attention can also be used to select among the contents of working memory. This has
been studied using the retro-cuing paradigm, in which participants are cued during a delay period
to one or more of several stimuli that are no longer physically present but are being held in
memory. Retro-cues provide similar performance benefits as pre-cues, resulting in enhanced
memory for retro-cued objects (Griffin & Nobre, 2003; Makovski & Jiang, 2007) and features
(Niklaus et al., 2017). This selection during working memory maintenance may boost memory
by protecting target items from delay-related degradation, rather than prioritizing the item for
retrieval. This interpretation is supported by the fact that switching the retro-cue (i.e., asking
participants to shift attention to previously unattended memory contents) does not provide any
benefit to memory, presumably because those contents have degraded since the original cue
(Matsukura et al., 2007). Indeed, information held outside the focus of attention in working
memory is remembered with less precision (LaRocque et al., 2015). Nevertheless, attention can
be allocated dynamically and flexibly over time during maintenance, including by relying on
temporal statistics to prioritize information likely to be probed at different timepoints (van Ede et
al., 2017). Taken together, these data suggest that attention plays an important role in keeping
representations active.
Neuroimaging studies provide further evidence for this role of attention in working
memory. Maintaining a spatial location in memory evokes similar activity patterns in visual
cortex as when attending to that location in external space (Awh & Jonides, 2001). This holds for
features such as orientation as well (Harrison & Tong, 2009; Serences et al., 2009). The fidelity
with which remembered information can be decoded in these cortical regions predicts the
precision of behavioral reports of these memories (Emrich et al., 2013). Furthermore, this
mirroring of attention and memory persists along the visual hierarchy: orienting attention to
maintained faces or scenes evokes patterns of activity in visual cortex analogous to external
visual attention to those categories (Lepsien & Nobre, 2006; Lepsien et al., 2011). Beyond
modulating sensory cortex, attention to perceived stimuli and attention to remembered stimuli
recruit a similar broad network of brain regions (e.g., Nobre et al., 2004; Lepsien et al., 2005;
Lepsien et al., 2011; see Corbetta & Shulman, 2002; Xu, 2017, 2018). These data suggest that
attention may act on working memory representations similarly to how it acts on perceptual
representations. Causal interventions using transcranial magnetic stimulation (TMS) further
support this view. TMS of both sensory cortex (Zokaei et al., 2014) and higher-order attentional
regions (Rose et al., 2016) can increase memory for an unattended stimulus. Stimulation in these
cases is thought to mimic attention, thus enhancing perceptual processing of the unattended
stimulus and rescuing memory degradation.
Common neural correlates between attention and working memory have been used to
argue that these processes are intricately related, if not two sides of the same coin. Yet, such
findings leave open important questions about the nature of the representations being measured:
To what extent does neural activity during a working memory delay reflect the contents of
attention, as opposed to the contents of memory (over which attention can operate)? In other
words, is it possible to actively maintain information (the hallmark of working memory) without
internally attending to it?
Converging studies utilizing fMRI (Lewis-Peacock et al., 2012) and EEG (LaRocque et
al., 2013) attempted to de-confound attention and memory, and found that delay period activity
reflects the contents of attention rather than memory more generally. When presented with
distractors during a delay period, patterns of brain activity contained information about the
category of the distractor image (which presumably had captured attention), rather than the
category of the to-be-remembered target image (Lewis-Peacock et al., 2012). Critically,
behavioral performance indicated that the target was still held in working memory, despite not
being decodable during the delay period. Relatedly, adding a distractor task or intervening items
during the delay period disrupts maintenance signals in visual cortex without impairing behavior
(Miller et al., 1993; Miller & Desimone, 1994; Miller et al., 1996; Bettencourt & Xu, 2015).
These findings reveal that neural representations thought to be related to working
memory per se may in fact reflect the allocation of attention, either internally (to memories) or
externally (to distractor stimuli). Of course, working memory can survive distraction, suggesting
that while visual areas may reflect the contents of attention rather than memory, other brain
regions that exhibit persistent delay period activity, such as prefrontal and posterior parietal
cortices (see Xu, 2017; Myers et al., 2017), may represent the contents of memory more
faithfully. These regions may better track working memory performance in the face of distraction
and may coordinate memory-related activity in other cortical regions, including sensory systems,
through top-down control.
Working memory influences attentional selection
The above section discussed how attention can be allocated in working memory, but the
reverse may also be true. Indeed, the contents of working memory can drive the allocation of
attention. Theories of attention posit that allocating attention voluntarily requires holding a target
in mind (see Desimone & Duncan, 1995), a process that fundamentally relies on working
memory. This endogenous or goal-directed attention differs from exogenous or stimulus-driven
control, in which attention is captured in an obligatory way by salient, bottom-up information,
such as abrupt onsets or stimulus changes (Chun et al., 2011). The link between endogenous
attention and working memory has been demonstrated by studies of task interference. When
working memory is placed under load, performance on a concurrent attention task suffers from
increased distractor interference (de Fockert et al., 2001). This is thought to reflect a diminished
ability to hold the attentional target in mind when working memory is otherwise consumed with
task-irrelevant information.
Working memory determines not only whether attention can be allocated, but also how it
is allocated. That is, even in cases when there is no direct competition between working memory
and attention, the contents of working memory can bias attention. This biasing can occur in
space: responses to an attention probe are faster when that probe is presented on the same side of
the screen as an object being held in working memory (Downing, 2000). The biasing can also
occur over features: visual search is facilitated when the search target matches the feature(s) of
an item being held in working memory (Soto et al., 2005). Subsequent work examined whether
this biasing of attention by memory is a consequence of the task design and explicit strategy, or
whether memory signals can automatically guide attention. Consistent with an automatic effect,
items held in memory facilitate search for a matching target even when such matches are
statistically improbable (Carlisle & Woodman, 2011), and even when other salient cues that
capture exogenous attention are present (Soto et al., 2006).
Interactions between working memory and attention can also be revealed by examining
how working memory influences physiological responses related to perception and attention. For
example, pupil size can be modulated by working memory demands (Unsworth & Robison,
2016b; Zokaei et al., 2019). Capitalizing on the fact that the pupil dilates to low light levels and
constricts to higher light levels, pupil response can be used as an index of what information is
being attended to in working memory (Figure 2A-B). Specifically, while maintaining an
orientation in working memory, the pupil is modulated by the brightness of the oriented grating
at encoding, despite the fact that the brightness is irrelevant to the memory task and will not be
probed at test. Further, pupil size provides a dynamic, online signature, as it changes when
attention is switched between items in working memory (Zokaei et al., 2019).
Working memory can also influence attentional guidance via direct influences on the
oculomotor system (Figure 2C-D). For example, when asked to report the color of a stimulus
from working memory, gaze is directed toward the spatial location in which the stimulus had
appeared (van Ede et al., 2019). These cases provide compelling evidence that working memory
can powerfully influence attentional selection. However, whether and how these pupillary and
oculomotor responses affect subsequent attentional, perceptual, and mnemonic processing
remains unstudied.
A
B
**
4
+
Memory array
Mean pupil size
3.5
+
Delay + Auditory
Cue
Probe
3
2.5
2
1.5
1
Adjustment Probe
0.5
Da rk Bri ght
C
D
+
Memory array
+
Delay
+
Probe
+
Adjustment Probe
Gaze position onxaxis (%, dva)
Cued it em
4
0.23
L item
R item
–4
–0.23
0
500
1,000
Time after probe (ms)
Figure 2. Working memory modulates physiological responses implicated in visual
attention. (A) Participants were shown two Gabor patches of different illumination and
different orientations. During the delay period, they were auditorily cued that one of the
patches would be probed for orientation report. (B) Pupil size during the delay period was
modulated by the task-irrelevant luminance of the to-be-reported item. For example, when
cued that the darker patch’s orientation would be probed, the size of the pupil was larger.
Adapted with permission from Zokaei et al. (2019). (C) Participants were shown two
oriented lines of different colors. At test, they were cued with the color of one of the lines,
indicating which orientation to report. (D) Gaze was biased towards the location of the tobe-reported item. Adapted with permission from van Ede et al. (2019).
Working memory as internal attention
In addition to bidirectional behavioral influences and shared neural substrates, working
memory and attention have also been tightly linked at the trait level (see Engle, 2002) and may
share cognitive resources (see Chun, 2011). Indeed, individuals with greater working memory
capacity perform better on attentional tasks (Kane et al., 2001), and attentional ability accounts
for a significant proportion of the variance in working memory capacity (Unsworth & Spillers,
2010; Unsworth et al., 2014). Low working memory capacity individuals demonstrate both more
interference from irrelevant distraction (Fukuda & Vogel, 2009; Fukuda & Vogel, 2011) and
more attentional lapses (Unsworth & Robison, 2016a). Attention and working memory also covary within an individual over time. Fluctuations in attentional control (Adam et al., 2015) and
attention lapses (Unsworth & Robison, 2016a) predict working memory performance on a trialby-trial basis.
Although these data implicate attentional mechanisms in working memory success, a
recent study with real-time manipulation and analysis of attention provided more direct evidence
(deBettencourt et al., 2019). Participants completed a sustained attention task in which colored
shapes appeared on the screen and participants reported the shape. The distribution of the shapes
over time was skewed such that certain shapes had a much higher probability than others, and
thus attentional vigilance was required to not miss rare shapes. Some trials were followed by a
working memory probe, in which participants reported the color at each location in an array.
This dual-task design allowed for trial-specific measures of attention (response time and
accuracy to classify the shape) and working memory (proportion correct on the probe). After
confirming a trial-by-trial correlation between these measures, the researchers sought a more
causal link. Specifically, they assessed attentional fluctuations in real-time by comparing the
response time (RT) from the most recent three sustained attention trials to the distribution of RTs
throughout the task. Memory probes were presented when the trailing window RT was either
faster than a threshold, related to attentional lapses (i.e., reduced vigilance/habitual responding),
or slower, as a control for better attention. Consistent with lapses of attention causing working
memory errors, performance was lower for memory probes triggered after a fast vs. slow trailing
RT, with fewer items stored and thus lower capacity.
Further evidence of shared resources comes from studies demonstrating competition
between attention and working memory. For example, when spatial information is held in
working memory, attention-demanding visual search is slowed (Woodman & Luck, 2004).
Similarly, increasing working memory load leads to more interference from distractors in an
attention task (de Fockert et al., 2001; Lavie et al., 2004). Together, these findings suggest that
increasing demand on working memory leaves fewer cognitive resources for effortful aspects of
attention, such as filtering out distraction or staying on task. Interestingly, such competition may
be modality-specific: loading up working memory with non-overlapping spatial information does
not impair visual search (Woodman et al., 2001), and interference is reduced when distractors are
more similar to the items in working memory (Park et al., 2007). The specificity of these
competitive effects suggests that the resources being shared are not generic (e.g., motivation,
control), but rather tied more closely to the sensory systems and constraints at play. Notably,
such results support the concept that there may be discrete working memory subsystems even
within the visual domain (Smith et al., 1995; Hakim et al., 2019), contrasting with prior work
that conceptualized two discrete, sensory-specific subsystems: one responsible for both visual
and spatial information (visuospatial sketchpad) and one for verbal information (phonological
loop; see Baddeley, 1992).
Although questions remain about the format of working memory, the body of work
demonstrating interactions between visual attention and visual memory has led to the suggestion
that working memory may in fact be a form of internal attention rather than a separate memory
system (e.g., Awh & Jonides, 2001; Postle, 2006; Chun et al., 2011). The depth of this analogy is
still debated (see Xu, 2017; Myers et al., 2017), but it may be most applicable to forms of
working memory without significant distraction (e.g., visual short-term memory and retro-cuing
tasks), whereas more complex and continuous tasks (e.g., n-back and AX-CPT) may recruit
additional processes and brain regions to prevent distraction. Moreover, internal attention itself
may not be a singular concept, and may instead depend on multiple attentional components, such
as for prioritizing locations and maintaining object information (Hakim et al., 2019).
This latter multi-component view of internal attention highlights an interesting fact about
the working memory literature: most of the studies described throughout this section focused on
the maintenance of either spatial locations or objects/features, but generally not both (c.f., Rao et
al., 1997; Postle & D’Esposito, 1999). Natural settings often demand that we integrate these
sources of information, in order to keep track of objects in particular locations. Given that such
integration has long been fundamental to theories of attention, as in the role of spatial maps in
feature integration theory (e.g., Treisman & Gelade, 1980), a fruitful avenue for further exploring
links between attention and working memory may be to address more configural, multidimensional forms of working memory.
Attention and long-term memory
Attention allows us to pursue goals and adapt behavior in the moment, and thus naturally
interacts with working memory as a short-term store of information that may be immediately
relevant. However, attention can also guide, and be guided by, long-term memory (Hutchinson &
Turk-Browne, 2012). To this end, attention helps determine not only which aspects of an
experience are encoded into episodic memory to influence future processing (including future
deployment of attention), but also which retrieval cues are selected, in turn impacting which
episodic memories are retrieved. Here, we describe different conceptions of attention and the
relationship of each to episodic memory, we distinguish effects related to encoding vs. retrieval,
and we consider how these effects manifest from the known neural mechanisms of attention.
Attention during episodic encoding
It may seem intuitive that if you pay attention to something, you are more likely to
remember it later. However, attention is not a singular construct: attention can operate in
different modalities, over objects, features, spatial locations, and points in time (Chun et al.,
2011). Further, as noted earlier, attentional selection is not only endogenous or goal-directed, but
can also be captured by salient environmental cues in an exogenous or stimulus-driven manner.
Thus, understanding how attention interacts with long-term memory requires considering the
possibility that different kinds of attention exhibit different interactions. Throughout this section,
we focus on various ways in which researchers have manipulated the allocation of attention to
memoranda in order to shed light on these complex interactions.
One task manipulation intended to broadly disrupt attention is to require processing of
two or more streams of information simultaneously. If attention is required for memory
encoding, then encoding should be worse under such conditions of divided attention (analogous
to the interference between working memory and attention discussed above). Indeed, across a
range of tasks, dividing attention during encoding impairs later memory performance (Craik et
al., 1996; Fernandes & Moscovitch, 2000; see Craik, 2001). Interestingly, divided attention only
modestly influences judgments of familiarity, whereas it more strongly disrupts recollection
(Gardiner & Parkin, 1990; see Chapter 5.6). Recollection is thought to reveal richer, more
contextual episodic memories that rely upon the hippocampus (see Yonelinas, 2002), suggesting
that attention may play a role in relational binding, rather than merely in memory for constituent
items. On the other hand, effects of divided attention on associative memory have been linked to
disrupted encoding of individual items (Naveh-Benjamin et al., 2003).
Converging evidence that attention influences episodic encoding comes from studies of
selective attention, a different kind of attention manipulation in which participants prioritize only
one of two or more streams of information while ignoring the other(s). For example, in a dichotic
listening paradigm with different auditory inputs in each ear, one of which is attended, only the
contents of the attended ear are later remembered (Moray, 1959). Likewise, when attending to
one category of composite face-scene images, only the image from the attended category is
remembered (Yi & Chun, 2005). Selective attention can also be manipulated on a trial-by-trial
basis with cuing tasks. For example, spatial cues enhance subsequent memory encoding for items
that occur at the cued locations (Uncapher et al., 2011; Turk-Browne et al., 2013). In all of these
cases, the impact of attention on memory may be a side effect of attentional modulation of
perception (Rees et al., 1999; Rees & Lavie, 2001). During a dichotic listening paradigm, for
example, if participants do not perceptually register the contents of the unattended ear, this
information may not persist far enough along the sensory processing hierarchy to be encoded
into memory systems.
Relatedly, selective attention is not all or none, but rather graded based on how deeply
stimuli must be processed to perform a task (Craik & Lockhart, 1972). These different levels of
processing have distinct mnemonic consequences: when oriented to the phonetic features of a
word (e.g., whether it rhymes with another word) vs. to its semantic features, participants
perform worse on a standard recognition memory test but better on a test where the words
rhymed with the encoded words (Morris et al., 1977).
Beyond conceiving of attention as a limited resource that must be divided or a selective
process that enhances relevant information and suppresses irrelevant information, sustaining a
consistent attentional state over long periods of time is itself effortful and tiring. Such vigilance
is also related to episodic memory. For example, lapses in sustained attention — reflected in
faster, habitual responses to stimuli over a period of time — are associated with worse
subsequent memory for those stimuli (deBettencourt et al., 2018).
Our ability to allocate attention is also influenced by the temporal structure of our
experience. Shifts in context, or event boundaries, can redirect attention (Zacks et al., 2007),
perhaps due to changes in low-level visual information (Huff et al., 2012) and autonomic arousal
(Clewett et al., 2020). Such event-based modulation of attention can result in a bias away from
associative processing and toward local details, resulting in enhancement of memory for items
occurring at the boundaries (Boltz, 1992; Gold et al., 2017; Heusser et al., 2018) and decreased
integration across events (Heusser et al., 2018; see Clewett et al., 2019). On the other hand,
promoting associative processing within an event (e.g., by encouraging participants to form links
between successive items) benefits temporal order memory, and shifting attention away from
associative processing (by inserting a distractor task between stimuli) reduces temporal memory
(DuBrow & Davachi, 2013). Nevertheless, even with an explicit associative encoding strategy,
event boundaries disrupt temporal order memory, suggesting that event boundaries may have
shifted attention away from or disrupted associative processing.
The studies above involve attention to neutral, innocuous stimuli, but psychological
factors such as stress and emotion also control attention (Anderson & Phelps, 2001; Öhman et
al., 2001; see Chapters 3.7 and 9.9). Exogenous attentional allocation to emotional stimuli can
enhance memory for the arousing stimulus, often at the cost of memory for surrounding (even if
relevant) details (see Mather & Sutherland, 2011). For instance, attentional capture by a weapon
can enhance memory for the weapon at the cost of memory for the perpetrator (Loftus et al.,
1987). Moreover, while the details of arousing stimuli are better remembered, the association
between arousing and neutral stimuli does not similarly benefit (Mather et al., 2009). Relatedly,
reward can shift attention (see Maunsell, 2004; Awh et al., 2012), perhaps in part explaining the
role of reward in episodic memory (e.g., Adcock et al., 2006; Wolosin et al., 2013; Clewett &
Mather, 2014; Mason et al., 2017).
The behavioral findings discussed above shed light on how differential allocation of
attention can influence memory, but are agnostic as to whether these effects result from feedforward modulation of sensory processing or direct modulation of episodic memory processes.
Understanding the neural mechanisms of these interactions between attention and memory sheds
light on this question.
The biased competition theory of attention is a prominent model of how attention
operates in sensory cortex (Desimone & Duncan, 1995). Visual environments contain multiple
features and objects at different locations, all vying for representation in stimulus-selective visual
areas. Attention to one of these objects modulates the amplitude of the neural response it evokes,
strengthening its representation relative to unattended objects. As these neural signals propagate
forward in the sensory hierarchy, competitive dynamics in each layer amplify this difference
between attended and unattended stimuli, resulting in an increasingly exclusive representation of
attended stimuli (see Kastner & Ungerleider, 2000). This attentional modulation is observed
across levels of the visual hierarchy, including in the cortical areas that directly feed into the
hippocampus (O’Craven et al., 1999; Uncapher & Rugg, 2009; Dudukovic et al., 2011; TurkBrowne et al., 2013).
Such modulation has also been observed in the hippocampus proper (Uncapher & Rugg,
2009; Carr et al., 2013), though not consistently (Yamaguchi et al., 2004), and may be dependent
upon whether attention is drawn to items or relations (Dudukovic et al., 2011; Córdova et al.,
2019). Regardless, hippocampal modulation may reflect a form of biased competition, whereby
attentionally modulated signals that emanate at earlier stages, perhaps in MTL cortex, propagate
downstream. This spreading is consistent with the fact that subsequent memory can be predicted
from attentional modulation in both MTL cortex and the hippocampus (Uncapher & Rugg, 2009;
Carr et al., 2013; Turk-Browne et al., 2013). Biased competition has also been invoked to explain
findings of how emotion influences memory, based on evidence that arousing stimuli are
prioritized in sensory processing, resulting in downstream memory enhancements (Mather &
Sutherland, 2011).
This account also relates to the role of repetition suppression in attention and memory.
Repeated stimuli evoke weaker responses in stimulus-selective sensory cortex relative to novel
stimuli. This disparity can tilt competition toward novel stimuli, enhancing their encoding into
episodic memory (Hutchinson et al., 2016). This would have the advantage of prioritizing the
encoding of novel information in memory. Indeed, repetition suppression for a stimulus has been
linked to both implicit (Maccotta & Buckner, 2004; Wig et al., 2005; Ward et al., 2013) and
explicit (Turk-Browne et al., 2006) memory (see Chapters 2.5 and 5.8). The fact that repetition
suppression only occurs for attended stimuli (Eger et al., 2004; Yi & Chun, 2005), combined
with the fact that attention enhances memory encoding, further suggests that repetition
suppression may be a neural marker of memory formation. Together, these findings are
consistent with an account of how attention and memory interact that is centered on biased
competition during sensory processing.
Beyond the visual system, several regions of frontoparietal cortex are thought to exert
attentional control over the way stimuli are represented and routed in the brain (see Noudoost et
al., 2010). It follows that these regions may also influence the way in which memories are
encoded. In particular, these regions are connected into two networks — the dorsal attention
network involved in top-down, goal-directed control and the ventral attention network involved
in stimulus-driven reorienting — and these networks can have opposite effects on memory.
During encoding, greater activity in dorsal attention regions such as intraparietal sulcus (IPS) is
associated with better memory (Uncapher et al., 2011), whereas greater activity in ventral
attention regions such as temporoparietal junction (TPJ) is associated with worse memory
(Uncapher et al., 2011; Turk-Browne et al., 2013). These networks may impact memory by
modulating stimulus representations and biasing competition in visual cortex: functional
connectivity between visual regions and IPS prior to encoding predicts better memory, whereas
functional connectivity between visual regions and TPJ during encoding predicts worse memory
(Uncapher et al., 2011). Thus, the dorsal attention network may facilitate visual processing to
enhance the information available for memory encoding, whereas the ventral attention network
may redirect processing away from relevant stimuli, reducing the information available.
In addition to shifting functional connectivity between visual and frontoparietal regions,
attention can also switch connectivity within the visual system. Specifically, attention may alter
the flow of information along the sensory hierarchy based on task goals (Al-Aidroos et al., 2012;
Bosman et al., 2012). For example, low-level visual regions show increased functional
connectivity with the fusiform face area (FFA) when attending to faces and with the
parahippocampal place area (PPA) when attending to scenes (Al-Aidroos et al., 2012). Similar
modulation has been observed in the MTL, with ventral visual cortex switching functional
connectivity between parahippocampal cortex and perirhinal cortex during scene vs. face
attention, respectively (Córdova et al., 2016). It remains an open question how these connectivity
patterns influence hippocampal representation and episodic memory encoding.
Indeed, the effects of attention on the hippocampus may be qualitatively different than
effects of attention on cortex. Studies of both animal (Kentros et al., 2004; Muzzio et al., 2009;
Fenton et al., 2010) and human (Aly & Turk-Browne, 2016a; Aly & Turk-Browne, 2016b;
Córdova et al., 2019) hippocampus suggest that, rather than increasing the amplitude of neural
activity, attention increases the stability of neural activity patterns. Specifically, the hippocampus
shows sensitivity to attentional state such that, for example, attending to spatial information
evokes similar patterns of activity in the hippocampus across trials, whereas attending to item
information evokes a different, yet reliable pattern of activity in the hippocampus (Muzzio et al.,
2009; Aly & Turk-Browne, 2016a). Furthermore, the stabilization of hippocampal
representations by attention is related to episodic memory encoding (Figure 3). Greater pattern
similarity to an attentional state template is associated with better subsequent memory for the
corresponding task-relevant features of a stimulus (Aly & Turk-Browne, 2016b).
Where does the attentional modulation of hippocampus originate? In other words, is
representational stability in the hippocampus merely a different manifestation of the feedforward
influence of attention on the sensory hierarchy, or does it reflect a more direct routing of
attentional signals to the hippocampus through neuromodulation? For example, reward and
arousal — which both bias attention — may act on the hippocampal system directly via
dopaminergic (Shohamy & Adcock, 2010) and noradrenergic (Mather et al., 2016)
neurotransmitter systems, respectively. The acetylcholine system has also been implicated in
both attention and memory (Newman et al., 2012). Future studies examining the timing of
attentional signals in sensory cortex, attentional control networks, and the hippocampus, as well
as signals relating to neuromodulation, will shed light on the nature of attentional modulation of
the hippocampus.
B
same - different template
pattern similarity r()
A
Figure 3. Hippocampal representations are modulated by attention in a way that supports
episodic memory encoding (Aly & Turk-Browne, 2016b). (A) Analysis approach and task
design. In phase 1, participants were presented with rendered images of rooms in an art
museum and instructed to attend either to the layout of the room or the style of the art.
Voxel patterns of fMRI activity in the hippocampus from this phase were used as
attentional templates for room and art attentional states, respectively. In phase 2,
participants incidentally encoded similar but trial-unique images while performing one of
two related attention tasks. In art blocks, participants detected one-back repetitions of
artwork in the same style/by the same artist (despite being different pieces). In room blocks,
participants detected one-back repetitions of the layouts (despite surface differences). The
pattern of hippocampal activity for each encoding trial was correlated with the attentional
templates for the same vs. different attentional states. In phase 3, participants completed a
surprise memory test for the images from phase 2. (B) Subsequently remembered items
exhibited greater pattern similarity to the template that matched during their attentional
state incidental encoding than to the other template. In other words, memory was enhanced
when the hippocampus was in the correct attentional state during encoding. Adapted with
permission from Aly & Turk-Browne (2016b).
Attention during episodic retrieval
The influence of attention on episodic memory arises not only at the time of encoding,
determining which information gets stored, but also at the time of retrieval, determining which
information gets accessed and reported (see Tarder-Stoll et al., 2020). Indeed, attention can be
oriented internally to long-term episodic memories, just as it can be allocated to the contents of
short-term, working memories (Chun & Johnson, 2011). This analogy is further supported by
findings that episodic memory retrieval can be impaired by the same kinds of distraction as
working memory (Fernandes & Moscovitch, 2000; Wais & Gazzaley, 2011), presumably
because the distractors compete with the contents of memory for attentional resources (Wais et
al., 2010), and by findings that eye movements are spontaneously biased toward the encoded
locations of retrieved information (Johansson et al., 2012; Johansson & Johansson, 2014).
Dividing attention at retrieval also reduces the likelihood that an item will be retrieved again in a
later test (Dudukovic et al., 2009), suggesting that attention also plays a role in reinforcing and/or
re-encoding memories at retrieval.
These combined effects on both encoding and retrieval position attention as important for
disambiguating novel from familiar inputs. This role is echoed by studies of attentional
modulation during hippocampal retrieval. Computational models (e.g., Lisman & Grace, 2005)
and fMRI evidence (Kumaran & Maguire, 2006; Kumaran & Maguire, 2007; Chen et al., 2011;
Duncan et al., 2012) implicate the hippocampus in mismatch detection, when a retrieved memory
(e.g., an expectation of familiarity) conflicts with current sensory experience (i.e., unexpected
novelty). Mismatch signals are sensitive to attentional demands. For example, MTL activity is
enhanced when judging the novelty but not the recency of an item (Dudukovic & Wagner, 2007).
Novelty signals in the hippocampus are also sensitive to attentional state, as demonstrated by
dissociations across recognition memory tasks involving old, similar, and new items (Hashimoto
et al., 2012). When attending to perceptual attributes, the hippocampus responds equivalently to
similar and new items (reflecting the need to classify similar items as “new”), whereas when
attending to semantic attributes, the hippocampus responds equivalently to similar and old items
(reflecting the need to classify similar items as “old”). This is consistent with findings from
intracranial EEG, in which hippocampal activity distinguishes similar vs. old items only when
the task required such a discrimination (Lohnas et al., 2018).
In addition to the hippocampus, the parietal cortex has been consistently implicated in
the retrieval of memories (Wagner et al., 2005; Kuhl & Chun, 2014). Given that the parietal
cortex is strongly implicated in attention (Corbetta & Shulman, 2002; Xu, 2018), the role of the
parietal regions in episodic retrieval was thought to be reflective of its role in attentional
selection (Cabeza et al., 2008; Ciaramelli et al., 2008). Notably, however, discrete anatomical
subregions of parietal cortex seem to support attention vs. memory retrieval (Hutchinson et al.,
2009). Indeed, separate functional subregions of the parietal cortex track successful memory
recollection vs. attentional benefits, with some subregions only tracking memory performance,
and others tracking attentional components of memory retrieval (Hutchinson et al., 2014).
Despite debate about the precise anatomical substrates of attention vs. memory functions
in parietal cortex, there is evidence of a unique role for parietal cortex in attention-like memory
selection (Figure 4). Specifically, attentional effects on retrieval in frontal and parietal regions
can be dissociated from effects in the MTL (Kuhl et al., 2013). In a study designed to tease apart
the contributions of these regions to memory retrieval, participants first learned associations
between a word and either a face or a scene that appeared on either the left or right of the screen.
During a subsequent test phase, participants were cued with a word and asked to report either the
category or the location of the associated image. Multi-voxel pattern analysis (MVPA) was
applied during the test trials to decode evidence for face vs. scene categories. Such category
information could be decoded reliably from frontoparietal regions, but not medial temporal lobe
regions, on trials that required category retrieval. However, on location retrieval trials, in which
the category information was retrieved incidentally (as assessed in a later post-test), medial
temporal lobe regions but not frontoparietal regions exhibited reliable category evidence.
A
B
Figure 4. Frontoparietal regions support goal-directed long-term memory retrieval. (A)
During study, participants were presented with word-face or word-scene pairings. After
each round of study, they were shown a word and asked to recall one of two source features,
either whether the word was presented with a face or a scene, or whether the word’s
associated face/scene was presented on the left of the right of the screen. Subsequently, in
a surprise post-test they were presented again with words and were asked to recall both the
associated category and location, regardless of which was tested initially. (B) Category
evidence from the initial test, as a function of post-test performance. On trials in which the
category association was tested initially, greater category evidence in prefrontal cortex
(PFC) and lateral parietal cortex (LPC) predicted better subsequent memory. In the MTL,
category evidence on trials in which the location association was tested initially predicted
subsequent memory. Adapted with permission from Kuhl et al. (2013).
These findings suggest that parietal cortex may be particularly important for
implementing task goals and selecting relevant content from memory. In particular, dorsal and
lateral parietal regions — implicated in top-down attentional control (see Corbetta & Shulman,
2002) — are sensitive to retrieval goals, such that the contents of memory representations reflect
which feature was cued (Favila et al., 2018). As further support for the role of parietal cortex in
memory retrieval, visual information is represented more strongly in lateral parietal regions
during memory retrieval than during perception, whereas the reverse is true in occipitotemporal
cortex (Xiao et al., 2017; Favila et al., 2018).
Although interpreting the role of the parietal cortex in memory retrieval as an attentional
selection mechanism is appealing, it is important to note that the evidence above demonstrates
that parietal representations can be modulated by attentional state or goal-relevance. Whether the
parietal cortex plays a critical role in the selection of memories at retrieval remains an open
question. Specifically, patients with parietal lesions do not exhibit profound deficits in memory
retrieval (see Cabeza et al., 2008); rather, when reported, the deficits are subtle, such as
decreased vividness of memory (Berryhill et al., 2007) and a reduced sense of recollection (as
opposed to general familiarity; Davidson et al., 2008). Nonetheless, regardless of the precise
neural substrates, considering memory retrieval as a form of attentional selection remains a
useful framework (e.g., Anderson & Spellman, 1995; Levy & Anderson, 2002), not only for
understanding the effects of attention on memory retrieval, but also for understanding the general
properties of memory retrieval across memory systems such as working memory and episodic
memory.
Guidance of attention by episodic memory
The previous section reviewed how attention can guide memory retrieval, but retrieved
memories in turn play an important role in guiding attention (see Desimone, 1996; Hutchinson &
Turk-Browne, 2012). An early demonstration of such memory-guided attention compared how
attention is cued by past experience vs. current sensory information (Summerfield et al., 2006).
In this study, participants were pre-exposed to visual scenes and tasked with finding a hidden key
target. One day later, participants returned to perform a covert (without eye movements) visual
search task in which they again had to find keys. Some of the scenes were familiar from the prior
day (memory cue) and other scenes were novel but presented with a brief additional stimulus that
oriented participants to the location of the target (visual cue). Each condition was contrasted
against a baseline of scenes with equal viewing time but no cue (i.e., familiar scenes that did not
have a learned target and novel scenes with a neutral cue, respectively). As expected, visual
search was facilitated for the visual-cue condition relative to baseline. However, visual search
was also facilitated in the memory-cue condition, even though the target location was only
indicated by episodic memory (with no explicit visual cues). Consistent with the role of longterm memory in guiding attention, activity in the hippocampus selectively predicted the
performance benefit on the memory-cue trials.
Subsequent work using a similar paradigm established that episodic memory guides
attention by modulating perceptual processing (Stokes et al., 2012). Both EEG and fMRI
correlates of neural responses in visual cortex were modulated by the presence of a memory cue.
This can be interpreted as a memory-driven preparatory response in visual cortex that facilitated
processing, analogous to the biasing signals observed in standard goal-directed attention (see
Noudoost et al., 2010). One key difference from goal-directed attention, however, is that
memory-guided attention may reflect hippocampal control over visual cortex, rather than
frontoparietal control. Indeed, memory-guided attention can affect processing without an explicit
instruction or orientation towards the target (i.e., in the absence of a visual search task), and even
after just a single encoding opportunity (Becker & Rasmussen, 2008; Ciaramelli et al., 2009).
The proposed role of episodic memory in guiding attention is further supported by
evidence that memory — and the hippocampus — are important for determining where we move
our eyes (see Meister & Buffalo, 2016). This observation has been exploited to study memory in
infants (see Chapter 8.2). For example, in the visual paired comparison task, infants tend to look
more to novel than familiar stimuli all else being equal (see Rose et al., 2004). Adults and nonhuman primates also exhibit preferences for novel stimuli (e.g., Manns et al., 2000; Zola et al.,
2000). Preferential looking towards novel stimuli is adaptive, as it allows an observer to
prioritize extracting new information from the world rather than perseverating on information
that is already known.
Relatedly, when a familiar stimulus has changed in some way, it would be adaptive to
update this representation. Indeed, participants also preferentially look to aspects of remembered
stimuli that have changed. This was demonstrated by an early study linking the hippocampus to
eye movements (Ryan et al., 2000). In this study, participants first encoded a set of scenes and
then were presented with the scenes again after they had been altered by changing the presence
or relations of objects in each scene. Healthy individuals tended to look more at the manipulated
region of the image, whereas patients with hippocampal damage and associated amnesia did not.
In other words, overt attention was guided by discrepancies between perception and memory, a
process which depended on the hippocampus. These results dovetail with the previously
discussed findings that the hippocampus is sensitive to mismatches between perceived and
remembered information (Lisman & Grace, 2005) and critically highlight how such mismatch
representations may be consequential for guiding attention.
Similar guidance by relational memory has been observed in other paradigms. For
example, when faces are superimposed on scenes during encoding, healthy individuals look
longer during test at a face that matches the current scene than at other, equally familiar faces
that had been paired with other scenes. This behavior is correlated with activation of the
hippocampus in fMRI (Hannula & Ranganath, 2009) and is eliminated in patients with
hippocampal damage (Hannula et al., 2007). These effects occur rapidly upon encountering
familiar stimuli, suggesting that memory interacts with attentional processes triggered by the
sensory stimulus itself (Ryan et al., 2007). Interestingly, hippocampal guidance of overt attention
can be detected even in the absence of explicit memory for the familiar stimulus (Hannula &
Ranganath, 2009; Ryals et al., 2015).
Notably, many of the studies above are interpreted as an eye-movement measure of
memory, rather than an effect of memory on attention. However, in the real-world, we are rarely
confronted with the task of merely retrieving memories. Rather, we use memory to guide future
behavior, and these memory-related eye movements may play an important role in guiding our
attention. This form of attention is overt, as compared to the guidance of covert attention that
occurs while, for example, fixating during visual search. Nevertheless, such overt attention can
have dramatic effects on how we select and represent the sensory environment, including
because foveal (vs. peripheral) vision is much higher fidelity. Given this attentional guidance by
memory, it seems that memory actually guides memory — we use memory to orient our attention
in the world, which in turn influences what we subsequently encode into memory.
Attention and learning
The sections above considered interactions between attention and memory formed after
one or a small number of exposures, as is typical for working memory and episodic memory.
However, we regularly encounter the same items over time, in similar or different viewpoints,
contexts, and tasks. This repeated and varied exposure can enrich our memories for objects,
places, or people, resulting in abstracted representations stripped of idiosyncratic features, which
generalize better to future experiences and are more useful for prediction and facilitating
processing (see Chapters 2.2, 2.8, 6.6, and 7.1). Such memories must be held separate from
representations of individual experiences in episodic memory, which depend critically on
idiosyncratic features to enable the retrieval of specific moments in time and space.
Generalized memory representations must be learned over multiple exposures in which
individual (episodic) experiences are integrated rapidly or gradually over time (McClelland et al.,
1995; Schapiro et al., 2017). Here, we focus on two such forms of memory integration —
statistical learning and category learning — though other forms of learning including
reinforcement learning (Mackintosh, 1975; Niv et al., 2015; see Chapter 4.4) and motor skill
learning (Nissen & Bullemer, 1987; Wulf et al., 1998; see Chapters 2.4 and 11.4) also have deep
interactions with attention.
Attention and statistical learning
To study how people learn regularities across repeated experiences, a process known as
statistical learning, participants are repeatedly presented with configurations (e.g., Fiser & Aslin,
2001) or sequences (e.g., Turk-Browne et al., 2005) of stimuli with hidden structure. For
example, shapes might appear sequentially over time in repeated groupings of three, where the
first shape (A) is always followed by the second (B) and then the third (C). What appears before
A and after C is random and there are no other indications of where the groupings begin and end,
necessitating the extraction of transition probabilities to find the boundaries.
The emerging picture about the role of attention in statistical learning is complex. On one
hand, it is impossible to know in advance, or even after a few experiences, which items will be
part of regularities, and thus it is important to track multiple sets of statistics in the environment.
On the other hand, truly tracking all possible regularities would subject the mind to
combinatorial explosion. The balance of evidence suggests that attention does constrain
statistical learning, determining the stimuli over which regularities can be extracted (Jiménez &
Méndez, 1999; Jiang & Chun, 2001; Baker et al., 2004; Toro et al., 2005; Turk-Browne et al.,
2005; Emberson et al., 2011; Campbell et al., 2012; cf. Saffran et al., 1997; Musz et al., 2015).
Whether attention is strictly required for any learning to take place or serves a more modulatory
role, whether the influence of attention on learning reflects limited constraints on processing
resources (Desimone & Duncan, 1995) or whether attention is selectively allocated in order to
uncover relevant structure (Dayan et al., 2000), and how effects differ across tasks (Vickery et
al., 2018) and modalities (Frost et al., 2015) remain important questions.
Similar to the bidirectional interactions between episodic memory and attention, not only
does attention influence statistical learning, but regularities also capture and guide attention. For
example, in a visual search task, if the configuration of distractors is repeated and fixed with
respect to the target location, participants get faster at responding to the target, an effect known
as contextual cuing (Chun & Jiang, 1998). Visual search is also facilitated when target location
or identity is paired to distractors that have a consistent identity, even if their locations are
variable across trials (Chun & Jiang, 1999; Endo & Takeda, 2004). This and other work suggest
that multiple aspects of visual context can guide attention. Such effects can be viewed as
resulting from spatial or object-based statistical learning (Orbán et al., 2008; Vickery & Jiang,
2009) and/or from gradual encoding of relational memory (Ryan et al., 2000; Summerfield et al.,
2006). Moreover, attention is not only guided towards regions of space that contain targets, but
also away from regions containing distracting information (Wang & Theeuwes, 2018).
Furthermore, attention can be biased by regularities even in cases where the regularities
do not provide predictive information useful for a task. This has been demonstrated by
presenting multiple task-irrelevant streams of shapes at the same time and interrupting the
streams occasionally with a visual search trial (Zhao et al., 2013). When one of the streams
contains regularities, visual search is facilitated at that location, suggesting that the stream had
drawn attention. Critically, the location of regularities was randomized with respect to the search
targets, so this attentional bias occurred automatically.
This was replicated in additional experiments where multiple shape streams differing in
color or orientation were interleaved at a single, central location. Regularities in one of those
streams induced attentional capture on the interspersed visual search trials for the corresponding
dimension. For example, if the sequence of green shapes contained embedded structure, then
visual search was faster when the target was green and slower when a distractor was green,
compared to a different color like red associated with a random stream. Thus, despite
competition amongst multiple streams of information, attention can be spontaneously biased
towards the information that contains reliable structure. This has also been demonstrated in
infants, who preferentially attend to sources of information with moderately complex regularities
that need to be learned (Kidd et al., 2012; Kidd et al., 2014), perhaps a mechanism that allows
infants to efficiently acquire the structure of their environment (Saffran et al., 1996; Kirkham et
al, 2002; Aslin, 2017; Saffran & Kirkham, 2018).
The guidance of attention by regularities can flexibly influence not only the locus but also
the spatial scale of attention. Regularities at a global scale drive more global allocation of
attention, whereas regularities at a local scale drive attention to local details (Zhao & Luo, 2017).
In addition, statistical learning induces object-based attention effects, such that presenting targets
at either side of two paired objects produced faster detection than presenting targets at either side
of two shapes which were not paired together in learning (Zhao et al., 2014). Thus, regularities
can also guide attention within objects learned from repeated conjunctions of features and parts.
Why is attention automatically drawn towards regularities? One reason is that structure
often conveys goal-relevant information, such as in contextual cuing where the learned structure
reliably predicts the target location. Attentional biases to structure may also serve an adaptive
purpose in facilitating additional or new learning (Kosie & Baldwin, 2019). There is a chickenand-egg problem, however, with attention needed for learning but learning helping to guide
attention. A potential solution could be that simple regularities (e.g., stimulus repetition) might
be detected without attention, but once learned, draw attention. This may in turn permit more
sophisticated learning, a greater attentional bias, etc., until sufficient learning has occurred and
attention can be redirected elsewhere. An alternative solution could be that attention is deployed
in an exploratory manner in novel environments, and when it happens to fall on a location or
feature with structure, rapid learning captures attention and reduces further exploration.
Consistent with this, attention remains biased towards locations that contained structure even
after the regularities are replaced by randomness or another unknown set of regularities (Yu &
Zhao, 2015). Another interpretation of this emerging literature is that attention is repelled away
from randomness rather than towards structure. Indeed, initially encountering random
information in a configuration or sequence prior to regularities prevents statistical learning of
structure that emerges later (Jungé et al., 2007; Gebhart et al., 2009). Future work is needed to
further clarify the nature and purpose of interactions between attention and statistical learning,
perhaps by distinguishing between different conceptions of attention and by comparing different
measures of statistical learning.
Attention and category learning
The term statistical learning is often applied to the learning of regularities in how
multiple objects are organized over space and time. However, there are also regularities across
experiences with individual objects, resulting in abstract categories that structure our world into
types and concepts. As with statistical learning, attention plays an important role in category
learning. Attention can alter how stimuli are represented in both the mind and brain, leading to
different patterns of category classification in different contexts (e.g., Nosofsky, 1986; Johansen
& Palmeri, 2002; Mack et al., 2016). Task context can in turn affect attention and influence
categorization. For example, interleaved study of two categories biases attention to features that
differentiate between the two categories, whereas blocked study of a single category results in
attention to features shared within the category (Carvalho & Goldstone, 2017). Furthermore,
researchers have distinguished between perceptual attention, which is driven by the physical
features of a stimulus such as salience and is correlated with the speed of processing, and
decisional attention, which is driven by the relation of features to a category boundary and
classification. Perceptual attention may influence category decisions based on a single feature,
whereas decisional attention dominates when categorization requires the integration of features
across diagnostic dimensions (e.g., Maddox, 2002).
Consistent with these findings, models of category learning — in both behavior and
neural implementation — consider attention as an important intermediary for learning the
mapping between objects and categories (e.g., Kruschke, 1992; Minda & Smith, 2002; Love et
al., 2004). Accordingly, attention can be used to arbitrate between models of category learning,
for example, by measuring eye movements during a categorization task (Rehder & Hoffman,
2005). In this study, fixations shifted towards highly diagnostic features and away from the least
diagnostic features, reflecting learning of the relevant category features. However, in the last
block of learning, participants still reliably fixated the least diagnostic dimension, suggesting a
sub-optimal allocation of attention. This pattern of attention is consistent with exemplar rather
than prototype models of categorization: prototype models suggest that we represent a template
containing the most common, or ideal, features of a category, whereas exemplar models posit
that we hold each example of a category in memory, and thus would store even idiosyncratic or
uninformative features. Indeed, although allocating attention to non-diagnostic features may be
sub-optimal from a category learning perspective (Minda & Smith, 2002), it may prove adaptive
for memory more generally. That is, learning about the world is not only about learning
categories, but also about forming memories of the particular experiences we have, idiosyncratic
features and all.
Conclusions and Open Questions
Throughout this chapter, we have highlighted interactions between multiple forms of
attention and memory. Across working memory, episodic memory, and statistical learning, the
same pattern of results emerges: attention is important for determining both whether a memory is
formed in the first place and, if so, what content it contains; and those memory representations
are in turn important for guiding attention.
In real life, attention and memory do not operate in isolation. Rather, our mind
seamlessly switches attention between information from the current sensory environment, the
environment from moments ago, and environments in the more distant past. As we move our
eyes across a scene, we perceptually register the part being sampled, we hold in working
memory the parts that are out of view, and these representations in turn trigger the retrieval of
episodic memories, regularities, and categories. The amalgam of this new experience — mixing
present with past — itself gets encoded into working memory and eventually long-term memory,
and gets abstracted over during statistical learning. This intricate and recursive web of perceptual
and mnemonic experiences highlights the complexity of interactions between cognitive systems:
where attention is allocated will influence what kind of memory is formed, and what kind of
memory is retrieved will influence the features to which attention is allocated. And because
attention has limited capacity over features, locations, and time (e.g., Shapiro et al., 1997; Lavie
et al., 2004; Franconeri et al., 2007), these interactions will not always be beneficial. For
example, attention to regularities may compete with attention to episodic details (Sherman &
Turk-Browne, 2020).
What, then, determines which memories guide attention? Not only might working
memory and long-term memory compete, but so too might different forms of long-term memory.
For example, attention can be guided not only by memory for contextual information stored in
the hippocampus, but also by memory for the mapping between the stimulus location and the
required response stored in the striatum (Goldfarb et al., 2016). That said, many of the
documented cases of attentional guidance from long-term memory are related to the
hippocampus. Not only is episodic memory-guided attention dependent upon the hippocampus
(e.g., Ryan et al., 2000), but so are contextual cuing (e.g., Chun & Phelps, 1999), statistical
learning (e.g., Schapiro et al., 2014), and category learning (e.g., Foerde et al., 2013). Thus,
competition within the hippocampus may serve to arbitrate between different kinds of memory
and ultimately play a critical role in determining the allocation of attention. Further work on how
competition between memory systems influences attention is needed.
The shared reliance of working memory and long-term memory on attention highlights
the importance of their relationship. What role does attention play in transforming information
held in working memory into long-term memory representations? How does information
retrieved from long-term memory get transferred into working memory for online use? Can
effects of long-term memory on attention be understood as merely effects of working memory on
attention? In this vein, it is also important to emphasize the ubiquity of attention in a variety of
cognitive processes. Considering how these other modulated factors, such as context, value, and
emotion, relate to attentional processing may help to clarify observed bidirectional interactions
between attention and memory.
References
Adam, K. C., Mance, I., Fukuda, K., & Vogel, E. K. (2015). The contribution of attentional
lapses to individual differences in visual working memory capacity. Journal of Cognitive
Neuroscience, 27(8), 1601-1616.
Adcock, R. A., Thangavel, A., Whitfield-Gabrieli, S., Knutson, B., & Gabrieli, J. D. (2006).
Reward-motivated learning: Mesolimbic activation precedes memory formation. Neuron, 50(3),
507-517.
Aly, M., & Turk-Browne, N. B. (2016a). Attention stabilizes representations in the human
hippocampus. Cerebral Cortex, 26(2), 783-796.
Aly, M., & Turk-Browne, N. B. (2016b). Attention promotes episodic encoding by stabilizing
hippocampal representations. Proceedings of the National Academy of Sciences, 113(4), E420E429.
Al-Aidroos, N., Said, C. P., & Turk-Browne, N. B. (2012). Top-down attention switches
coupling between low-level and high-level areas of human visual cortex. Proceedings of the
National Academy of Sciences, 109(36), 14675-14680.
Anderson, A. K., & Phelps, E. A. (2001). Lesions of the human amygdala impair enhanced
perception of emotionally salient events. Nature, 411(6835), 305-311.
Anderson, M. C., & Spellman, B. A. (1995). On the status of inhibitory mechanisms in
cognition: Memory retrieval as a model case. Psychological Review, 102(1), 68-100.
Aslin, R. N. (2017). Statistical learning: A powerful mechanism that operates by mere exposure.
Wiley Interdisciplinary Reviews: Cognitive Science, 8(1-2), e1373.
https://doi.org/10.1002/wcs.1373
Awh, E., Belopolsky, A. V., & Theeuwes, J. (2012). Top-down versus bottom-up attentional
control: A failed theoretical dichotomy. Trends in Cognitive Sciences, 16(8), 437-443.
Awh, E., & Jonides, J. (2001). Overlapping mechanisms of attention and spatial working
memory. Trends in Cognitive Sciences, 5(3), 119-126.
Awh, E., Jonides, J., & Reuter-Lorenz, P. A. (1998). Rehearsal in spatial working memory.
Journal of Experimental Psychology: Human Perception and Performance, 24(3), 780-790.
Baddeley, A. (1992). Working memory. Science, 255(5044), 556-559.
Baker, C. I., Olson, C. R., & Behrmann, M. (2004). Role of attention and perceptual grouping in
visual statistical learning. Psychological Science, 15(7), 460-466.
Becker, M. W., & Rasmussen, I. P. (2008). Guidance of attention to objects and locations by
long-term memory of natural scenes. Journal of Experimental Psychology: Learning, Memory,
and Cognition, 34(6), 1325-1338.
Berryhill, M. E., Phuong, L., Picasso, L., Cabeza, R., & Olson, I. R. (2007). Parietal lobe and
episodic memory: Bilateral damage causes impaired free recall of autobiographical memory.
Journal of Neuroscience, 27(52), 14415-14423.
Bettencourt, K. C., & Xu, Y. (2016). Decoding the content of visual short-term memory under
distraction in occipital and parietal areas. Nature Neuroscience, 19(1), 150-157.
Boltz, M. (1992). Temporal accent structure and the remembering of filmed narratives. Journal
of Experimental Psychology: Human Perception and Performance, 18(1), 90-105.
Bosman, C. A., Schoffelen, J. M., Brunet, N., Oostenveld, R., Bastos, A. M., Womelsdorf, T., ...
& Fries, P. (2012). Attentional stimulus selection through selective synchronization between
monkey visual areas. Neuron, 75(5), 875-888.
Cabeza, R., Ciaramelli, E., Olson, I. R., & Moscovitch, M. (2008). The parietal cortex and
episodic memory: An attentional account. Nature Reviews Neuroscience, 9(8), 613-625.
Campbell, K. L., Zimerman, S., Healey, M. K., Lee, M., & Hasher, L. (2012). Age differences in
visual statistical learning. Psychology and Aging, 27(3), 650-656.
Carr, V. A., Engel, S. A., & Knowlton, B. J. (2013). Top-down modulation of hippocampal
encoding activity as measured by high-resolution functional MRI. Neuropsychologia, 51(10),
1829-1837.
Carlisle, N. B., & Woodman, G. F. (2011). Automatic and strategic effects in the guidance of
attention by working memory representations. Acta Psychologica, 137(2), 217-225.
Carvalho, P. F., & Goldstone, R. L. (2017). The sequence of study changes what information is
attended to, encoded, and remembered during category learning. Journal of Experimental
Psychology: Learning, Memory, and Cognition, 43(11), 1699-1719.
Chen, J., Olsen, R. K., Preston, A. R., Glover, G. H., & Wagner, A. D. (2011). Associative
retrieval processes in the human medial temporal lobe: Hippocampal retrieval success and CA1
mismatch detection. Learning & Memory, 18(8), 523-528.
Chun, M. M. (2011). Visual working memory as visual attention sustained internally over time.
Neuropsychologia, 49(6), 1407-1409.
Chun, M. M., Golomb, J. D., & Turk-Browne, N. B. (2011). A taxonomy of external and internal
attention. Annual Review of Psychology, 62, 73-101.
Chun, M. M., & Jiang, Y. (1998). Contextual cueing: Implicit learning and memory of visual
context guides spatial attention. Cognitive Psychology, 36(1), 28-71.
Chun, M. M., & Jiang, Y. (1999). Top-down attentional guidance based on implicit learning of
visual covariation. Psychological Science, 10(4), 360-365.
Chun, M. M., & Johnson, M. K. (2011). Memory: Enduring traces of perceptual and reflective
attention. Neuron, 72(4), 520-535.
Chun, M. M., & Phelps, E. A. (1999). Memory deficits for implicit contextual information in
amnesic subjects with hippocampal damage. Nature Neuroscience, 2(9), 844-847.
Ciaramelli, E., Grady, C. L., & Moscovitch, M. (2008). Top-down and bottom-up attention to
memory: A hypothesis (AtoM) on the role of the posterior parietal cortex in memory retrieval.
Neuropsychologia, 46(7), 1828-1851.
Ciaramelli, E., Lin, O., & Moscovitch, M. (2009). Episodic memory for spatial context biases
spatial attention. Experimental Brain Research, 192(3), 511-520.
Clewett, D., DuBrow, S., & Davachi, L. (2019). Transcending time in the brain: How event
memories are constructed from experience. Hippocampus, 29(3), 162-183.
Clewett, D., Gasser, C., & Davachi, L. (2020). Pupil-linked arousal signals track the temporal
organization of events in memory. Nature Communications, 11(1), 1-14.
Clewett, D. V., & Mather, M. (2014). Not all that glittered is gold: Neural mechanisms that
determine when reward will enhance or impair memory. Frontiers in Neuroscience, 8, 1-3.
Corbetta, M., & Shulman, G. L. (2002). Control of goal-directed and stimulus-driven attention in
the brain. Nature Reviews Neuroscience, 3(3), 201-215.
Córdova, N. I., Tompary, A., & Turk-Browne, N. B. (2016). Attentional modulation of
background connectivity between ventral visual cortex and the medial temporal lobe.
Neurobiology of Learning and Memory, 134, 115-122.
Córdova, N. I., Turk‐Browne, N. B., & Aly, M. (2019). Focusing on what matters: Modulation of
the human hippocampus by relational attention. Hippocampus, 29(11), 1025-1037.
Cowan, N. (1998). Attention and memory: An integrated framework (Vol. 26). Oxford
University Press.
Cowan, N. (1999). An embedded-processes model of working memory. In A. Miyake & P. Shah
(Eds.), Models of working memory: Mechanisms of active maintenance and executive control (p.
62-101). Cambridge University Press.
Craik, F. I. (2001). Effects of dividing attention on encoding and retrieval processes. In H.L.
Roediger III, J.S. Nairne, I. Neath, & A.M. Surprenant (Eds.), Science conference series. The
nature of remembering: Essays in honor of Robert G. Crowder (p. 55-68). American
Psychological Association.
Craik, F. I., Govoni, R., Naveh-Benjamin, M., & Anderson, N. D. (1996). The effects of divided
attention on encoding and retrieval processes in human memory. Journal of Experimental
Psychology: General, 125(2), 159-180.
Craik, F. I., & Lockhart, R. S. (1972). Levels of processing: A framework for memory research.
Journal of Verbal Learning and Verbal Behavior, 11(6), 671-684.
Davidson, P. S., Anaki, D., Ciaramelli, E., Cohn, M., Kim, A. S., Murphy, K. J., ... & Levine, B.
(2008). Does lateral parietal cortex support episodic memory?: Evidence from focal lesion
patients. Neuropsychologia, 46(7), 1743-1755.
Dayan, P., Kakade, S., & Montague, P. R. (2000). Learning and selective attention. Nature
Neuroscience, 3(11), 1218-1223.
deBettencourt, M. T., Keene, P. A., Awh, E., & Vogel, E. K. (2019). Real-time triggering reveals
concurrent lapses of attention and working memory. Nature Human Behaviour, 3(8), 808-816.
deBettencourt, M. T., Norman, K. A., & Turk-Browne, N. B. (2018). Forgetting from lapses of
sustained attention. Psychonomic Bulletin & Review, 25(2), 605-611.
de Fockert, J. W., Rees, G., Frith, C. D., & Lavie, N. (2001). The role of working memory in
visual selective attention. Science, 291(5509), 1803-1806.
Desimone, R. (1996). Neural mechanisms for visual memory and their role in attention.
Proceedings of the National Academy of Sciences, 93(24), 13494-13499.
Desimone, R., & Duncan, J. (1995). Neural mechanisms of selective visual attention. Annual
Review of Neuroscience, 18(1), 193-222.
Downing, P. E. (2000). Interactions between visual working memory and selective attention.
Psychological Science, 11(6), 467-473.
DuBrow, S., & Davachi, L. (2013). The influence of context boundaries on memory for the
sequential order of events. Journal of Experimental Psychology: General, 142(4), 1277-1286.
Dudukovic, N. M., DuBrow, S., & Wagner, A. D. (2009). Attention during memory retrieval
enhances future remembering. Memory & Cognition, 37(7), 953-961.
Dudukovic, N. M., Preston, A. R., Archie, J. J., Glover, G. H., & Wagner, A. D. (2011). Highresolution fMRI reveals match enhancement and attentional modulation in the human medial
temporal lobe. Journal of Cognitive Neuroscience, 23(3), 670-682.
Dudukovic, N. M., & Wagner, A. D. (2007). Goal-dependent modulation of declarative memory:
Neural correlates of temporal recency decisions and novelty detection. Neuropsychologia,
45(11), 2608-2620.
Duncan, K., Ketz, N., Inati, S. J., & Davachi, L. (2012). Evidence for area CA1 as a
match/mismatch detector: A high‐resolution fMRI study of the human hippocampus.
Hippocampus, 22(3), 389-398.
Eger, E., Henson, R. N. A., Driver, J., & Dolan, R. J. (2004). BOLD repetition decreases in
object-responsive ventral visual areas depend on spatial attention. Journal of Neurophysiology,
92(2), 1241-1247.
Emberson, L. L., Conway, C. M., & Christiansen, M. H. (2011). Timing is everything: Changes
in presentation rate have opposite effects on auditory and visual implicit statistical learning. The
Quarterly Journal of Experimental Psychology, 64(5), 1021-1040.
Emrich, S. M., Riggall, A. C., LaRocque, J. J., & Postle, B. R. (2013). Distributed patterns of
activity in sensory cortex reflect the precision of multiple items maintained in visual short-term
memory. Journal of Neuroscience, 33(15), 6516-6523.
Endo, N., & Takeda, Y. (2004). Selective learning of spatial configuration and object identity in
visual search. Perception & Psychophysics, 66(2), 293-302.
Engle, R. W. (2002). Working memory capacity as executive attention. Current Directions in
Psychological Science, 11(1), 19-23.
Favila, S. E., Samide, R., Sweigart, S. C., & Kuhl, B. A. (2018). Parietal representations of
stimulus features are amplified during memory retrieval and flexibly aligned with top-down
goals. Journal of Neuroscience, 38(36), 7809-7821.
Fenton, A. A., Lytton, W. W., Barry, J. M., Lenck-Santini, P. P., Zinyuk, L. E., Kubík, Š., ... &
Olypher, A. V. (2010). Attention-like modulation of hippocampus place cell discharge. Journal
of Neuroscience, 30(13), 4613-4625.
Fernandes, M. A., & Moscovitch, M. (2000). Divided attention and memory: Evidence of
substantial interference effects at retrieval and encoding. Journal of Experimental Psychology:
General, 129(2), 155-176.
Fiser, J., & Aslin, R. N. (2001). Unsupervised statistical learning of higher-order spatial
structures from visual scenes. Psychological Science, 12(6), 499-504.
Foerde, K., Race, E., Verfaellie, M., & Shohamy, D. (2013). A role for the medial temporal lobe
in feedback-driven learning: Evidence from amnesia. Journal of Neuroscience, 33(13), 56985704.
Franconeri, S. L., Alvarez, G. A., & Enns, J. T. (2007). How many locations can be selected at
once? Journal of Experimental Psychology: Human Perception and Performance, 33(5), 10031012.
Frost, R., Armstrong, B. C., Siegelman, N., & Christiansen, M. H. (2015). Domain generality
versus modality specificity: The paradox of statistical learning. Trends in Cognitive Sciences,
19(3), 117-125.
Fukuda, K., & Vogel, E. K. (2009). Human variation in overriding attentional capture. Journal of
Neuroscience, 29(27), 8726-8733.
Fukuda, K., & Vogel, E. K. (2011). Individual differences in recovery time from attentional
capture. Psychological Science, 22(3), 361-368.
Garavan, H. (1998). Serial attention within working memory. Memory & Cognition, 26(2), 263276.
Gardiner, J. M., & Parkin, A. J. (1990). Attention and recollective experience in recognition
memory. Memory & Cognition, 18(6), 579-583.
Gebhart, A. L., Aslin, R. N., & Newport, E. L. (2009). Changing structures in midstream:
Learning along the statistical garden path. Cognitive Science, 33(6), 1087-1116.
Gold, D. A., Zacks, J. M., & Flores, S. (2017). Effects of cues to event segmentation on
subsequent memory. Cognitive Research: Principles and Implications, 2(1), 1-15.
Goldfarb, E. V., Chun, M. M., & Phelps, E. A. (2016). Memory-guided attention: Independent
contributions of the hippocampus and striatum. Neuron, 89(2), 317-324.
Griffin, I. C., & Nobre, A. C. (2003). Orienting attention to locations in internal representations.
Journal of Cognitive Neuroscience, 15(8), 1176-1194.
Hakim, N., Adam, K. C., Gunseli, E., Awh, E., & Vogel, E. K. (2019). Dissecting the neural
focus of attention reveals distinct processes for spatial attention and object-based storage in
visual working memory. Psychological Science, 30(4), 526-540.
Hannula, D. E., & Ranganath, C. (2009). The eyes have it: Hippocampal activity predicts
expression of memory in eye movements. Neuron, 63(5), 592-599.
Hannula, D. E., Ryan, J. D., Tranel, D., & Cohen, N. J. (2007). Rapid onset relational memory
effects are evident in eye movement behavior, but not in hippocampal amnesia. Journal of
Cognitive Neuroscience, 19(10), 1690-1705.
Harrison, S. A., & Tong, F. (2009). Decoding reveals the contents of visual working memory in
early visual areas. Nature, 458(7238), 632-635.
Hashimoto, R., Abe, N., Ueno, A., Fujii, T., Takahashi, S., & Mori, E. (2012). Changing the
criteria for old/new recognition judgments can modulate activity in the anterior hippocampus.
Hippocampus, 22(2), 141-148.
Heusser, A. C., Ezzyat, Y., Shiff, I., & Davachi, L. (2018). Perceptual boundaries cause
mnemonic trade-offs between local boundary processing and across-trial associative binding.
Journal of Experimental Psychology: Learning, Memory, and Cognition, 44(7), 1075-1090.
Huff, M., Papenmeier, F., & Zacks, J. M. (2012). Visual target detection is impaired at event
boundaries. Visual Cognition, 20(7), 848-864.
Hutchinson, J. B., Pak, S. S., & Turk-Browne, N. B. (2016). Biased competition during longterm memory formation. Journal of Cognitive Neuroscience, 28(1), 187-197.
Hutchinson, J. B., & Turk-Browne, N. B. (2012). Memory-guided attention: Control from
multiple memory systems. Trends in Cognitive Sciences, 16(12), 576-579.
Hutchinson, J. B., Uncapher, M. R., & Wagner, A. D. (2009). Posterior parietal cortex and
episodic retrieval: Convergent and divergent effects of attention and memory. Learning &
Memory, 16(6), 343-356.
Hutchinson, J. B., Uncapher, M. R., Weiner, K. S., Bressler, D. W., Silver, M. A., Preston, A. R.,
& Wagner, A. D. (2014). Functional heterogeneity in posterior parietal cortex across attention
and episodic memory retrieval. Cerebral Cortex, 24(1), 49-66.
Jiang, Y., & Chun, M. M. (2001). Selective attention modulates implicit learning. The Quarterly
Journal of Experimental Psychology: Section A, 54(4), 1105-1124.
Jiménez, L., & Méndez, C. (1999). Which attention is needed for implicit sequence learning?
Journal of Experimental Psychology: Learning, Memory, and Cognition, 25(1), 236-259.
Johansen, M. K., & Palmeri, T. J. (2002). Are there representational shifts during category
learning? Cognitive Psychology, 45(4), 482-553.
Johansson, R., Holsanova, J., Dewhurst, R., & Holmqvist, K. (2012). Eye movements during
scene recollection have a functional role, but they are not reinstatements of those produced
during encoding. Journal of Experimental Psychology: Human Perception and Performance,
38(5), 1289-1314.
Johansson, R., & Johansson, M. (2014). Look here, eye movements play a functional role in
memory retrieval. Psychological Science, 25(1), 236-242.
Jungé, J. A., Scholl, B. J., & Chun, M. M. (2007). How is spatial context learning integrated over
signal versus noise? A primacy effect in contextual cueing. Visual Cognition, 15(1), 1-11.
Kane, M. J., Bleckley, M. K., Conway, A. R., & Engle, R. W. (2001). A controlled-attention
view of working-memory capacity. Journal of Experimental Psychology: General, 130(2), 169183.
Kastner, S., & Ungerleider, L. G. (2000). Mechanisms of visual attention in the human cortex.
Annual Review of Neuroscience, 23(1), 315-341.
Kentros, C. G., Agnihotri, N. T., Streater, S., Hawkins, R. D., & Kandel, E. R. (2004). Increased
attention to spatial context increases both place field stability and spatial memory. Neuron, 42(2),
283-295.
Kidd, C., Piantadosi, S. T., & Aslin, R. N. (2012). The Goldilocks effect: Human infants allocate
attention to visual sequences that are neither too simple nor too complex. PloS One, 7(5),
e36399. https://doi.org/10.1371/journal.pone.0036399
Kidd, C., Piantadosi, S. T., & Aslin, R. N. (2014). The Goldilocks effect in infant auditory
attention. Child Development, 85(5), 1795-1804.
Kirkham, N. Z., Slemmer, J. A., & Johnson, S. P. (2002). Visual statistical learning in infancy:
Evidence for a domain general learning mechanism. Cognition, 83(2), B35-B42.
Kosie, J. E., & Baldwin, D. (2019). Attention rapidly reorganizes to naturally occurring structure
in a novel activity sequence. Cognition, 182, 31-44.
Kruschke, J. K. (1992). ALCOVE: An exemplar-based connectionist model of category learning.
Psychological Review, 99(1), 22-44.
Kuhl, B. A., & Chun, M. M. (2014). Successful remembering elicits event-specific activity
patterns in lateral parietal cortex. Journal of Neuroscience, 34(23), 8051-8060.
Kuhl, B. A., Johnson, M. K., & Chun, M. M. (2013). Dissociable neural mechanisms for goaldirected versus incidental memory reactivation. Journal of Neuroscience, 33(41), 16099-16109.
Kumaran, D., & Maguire, E. A. (2006). An unexpected sequence of events: Mismatch detection
in the human hippocampus. PLoS Biology, 4(12), e424.
https://doi.org/10.1371/journal.pbio.3000442
Kumaran, D., & Maguire, E. A. (2007). Match–mismatch processes underlie human
hippocampal responses to associative novelty. Journal of Neuroscience, 27(32), 8517-8524.
LaRocque, J. J., Eichenbaum, A. S., Starrett, M. J., Rose, N. S., Emrich, S. M., & Postle, B. R.
(2015). The short-and long-term fates of memory items retained outside the focus of attention.
Memory & Cognition, 43(3), 453-468.
LaRocque, J. J., Lewis-Peacock, J. A., Drysdale, A. T., Oberauer, K., & Postle, B. R. (2013).
Decoding attended information in short-term memory: An EEG study. Journal of Cognitive
Neuroscience, 25(1), 127-142.
Lavie, N., Hirst, A., De Fockert, J. W., & Viding, E. (2004). Load theory of selective attention
and cognitive control. Journal of Experimental Psychology: General, 133(3), 339-354.
Lepsien, J., Griffin, I. C., Devlin, J. T., & Nobre, A. C. (2005). Directing spatial attention in
mental representations: Interactions between attentional orienting and working-memory load.
NeuroImage, 26(3), 733-743.
Lepsien, J., & Nobre, A. C. (2006). Attentional modulation of object representations in working
memory. Cerebral Cortex, 17(9), 2072-2083.
Lepsien, J., Thornton, I., & Nobre, A. C. (2011). Modulation of working-memory maintenance
by directed attention. Neuropsychologia, 49(6), 1569-1577.
Levy, B. J., & Anderson, M. C. (2002). Inhibitory processes and the control of memory retrieval.
Trends in Cognitive Sciences, 6(7), 299-305.
Lewis-Peacock, J. A., Drysdale, A. T., Oberauer, K., & Postle, B. R. (2012). Neural evidence for
a distinction between short-term memory and the focus of attention. Journal of Cognitive
Neuroscience, 24(1), 61-79.
Lisman, J. E., & Grace, A. A. (2005). The hippocampal-VTA loop: Controlling the entry of
information into long-term memory. Neuron, 46(5), 703-713.
Loftus, E. F., Loftus, G. R., & Messo, J. (1987). Some facts about “weapon focus”. Law and
Human Behavior, 11(1), 55-62.
Lohnas, L. J., Duncan, K., Doyle, W. K., Thesen, T., Devinsky, O., & Davachi, L. (2018). Timeresolved neural reinstatement and pattern separation during memory decisions in human
hippocampus. Proceedings of the National Academy of Sciences, 115(31), E7418-E7427.
Love, B. C., Medin, D. L., & Gureckis, T. M. (2004). SUSTAIN: A network model of category
learning. Psychological Review, 111(2), 309-332.
Maccotta, L., & Buckner, R. L. (2004). Evidence for neural effects of repetition that directly
correlate with behavioral priming. Journal of Cognitive Neuroscience, 16(9), 1625-1632.
Mack, M. L., Love, B. C., & Preston, A. R. (2016). Dynamic updating of hippocampal object
representations reflects new conceptual knowledge. Proceedings of the National Academy of
Sciences, 113(46), 13203-13208.
Mackintosh, N. J. (1975). A theory of attention: Variations in the associability of stimuli with
reinforcement. Psychological Review, 82(4), 276-298.
Maddox, W. T. (2002). Learning and attention in multidimensional identification and
categorization: Separating low-level perceptual processes and high-level decisional processes.
Journal of Experimental Psychology: Learning, Memory, and Cognition, 28(1), 99-115.
Makovski, T., & Jiang, Y. V. (2007). Distributing versus focusing attention in visual short-term
memory. Psychonomic Bulletin & Review, 14(6), 1072-1078.
Manns, J. R., Stark, C. E., & Squire, L. R. (2000). The visual paired-comparison task as a
measure of declarative memory. Proceedings of the National Academy of Sciences, 97(22),
12375-12379.
Mason, A., Farrell, S., Howard-Jones, P., & Ludwig, C. J. (2017). The role of reward and reward
uncertainty in episodic memory. Journal of Memory and Language, 96, 62-77.
Mather, M., Clewett, D., Sakaki, M., & Harley, C. W. (2016). Norepinephrine ignites local
hotspots of neuronal excitation: How arousal amplifies selectivity in perception and memory.
Behavioral and Brain Sciences, 39, E200. https://doi.org/10.1017/S0140525X15000667
Mather, M., Gorlick, M., & Nesmith, K. (2009). The limits of arousal's memory impairing
effects on nearby information. The American Journal of Psychology, 122(3), 349-369.
Mather, M., & Sutherland, M. R. (2011). Arousal-biased competition in perception and memory.
Perspectives on Psychological Science, 6(2), 114-133.
Matsukura, M., Luck, S. J., & Vecera, S. P. (2007). Attention effects during visual short-term
memory maintenance: Protection or prioritization? Perception & Psychophysics, 69(8), 14221434.
Maunsell, J. H. (2004). Neuronal representations of cognitive state: Reward or attention? Trends
in Cognitive Sciences, 8(6), 261-265.
McClelland, J. L., McNaughton, B. L., & O'Reilly, R. C. (1995). Why there are complementary
learning systems in the hippocampus and neocortex: Insights from the successes and failures of
connectionist models of learning and memory. Psychological Review, 102(3), 419-457.
Meister, M. L., & Buffalo, E. A. (2016). Getting directions from the hippocampus: The neural
connection between looking and memory. Neurobiology of Learning and Memory, 134, 135-144.
Miller, E. K., & Desimone, R. (1994). Parallel neuronal mechanisms for short-term memory.
Science, 263(5146), 520-522.
Miller, E. K., Erickson, C. A., & Desimone, R. (1996). Neural mechanisms of visual working
memory in prefrontal cortex of the macaque. Journal of Neuroscience, 16(16), 5154-5167.
Miller, E. K., Li, L., & Desimone, R. (1993). Activity of neurons in anterior inferior temporal
cortex during a short-term memory task. Journal of Neuroscience, 13(4), 1460-1478.
Minda, J. P., & Smith, J. D. (2002). Comparing prototype-based and exemplar-based accounts of
category learning and attentional allocation. Journal of Experimental Psychology: Learning,
Memory, and Cognition, 28(2), 275-292.
Moray, N. (1959). Attention in dichotic listening: Affective cues and the influence of
instructions. Quarterly Journal of Experimental Psychology, 11(1), 56-60.
Morris, C. D., Bransford, J. D., & Franks, J. J. (1977). Levels of processing versus transfer
appropriate processing. Journal of Verbal Learning and Verbal Behavior, 16(5), 519-533.
Musz, E., Weber, M. J., & Thompson-Schill, S. L. (2015). Visual statistical learning is not
reliably modulated by selective attention to isolated events. Attention, Perception, &
Psychophysics, 77(1), 78-96.
Muzzio, I. A., Kentros, C., & Kandel, E. (2009). What is remembered? Role of attention on the
encoding and retrieval of hippocampal representations. The Journal of Physiology, 587(12),
2837-2854.
Myers, N. E., Stokes, M. G., & Nobre, A. C. (2017). Prioritizing information during working
memory: Beyond sustained internal attention. Trends in Cognitive Sciences, 21(6), 449-461.
Naveh-Benjamin, M., Guez, J., & Marom, M. (2003). The effects of divided attention at
encoding on item and associative memory. Memory & Cognition, 31(7), 1021-1035.
Newman, E. L., Gupta, K., Climer, J. R., Monaghan, C. K., & Hasselmo, M. E. (2012).
Cholinergic modulation of cognitive processing: insights drawn from computational models.
Frontiers in Behavioral Neuroscience, 6(24), 1-19.
Niklaus, M., Nobre, A. C., & van Ede, F. (2017). Feature-based attentional weighting and
spreading in visual working memory. Scientific Reports, 7, 42384.
https://doi.org/10.1038/srep42384
Nissen, M. J., & Bullemer, P. (1987). Attentional requirements of learning: Evidence from
performance measures. Cognitive Psychology, 19(1), 1-32.
Niv, Y., Daniel, R., Geana, A., Gershman, S. J., Leong, Y. C., Radulescu, A., & Wilson, R. C.
(2015). Reinforcement learning in multidimensional environments relies on attention
mechanisms. Journal of Neuroscience, 35(21), 8145-8157.
Nobre, A. C., Coull, J. T., Maquet, P., Frith, C. D., Vandenberghe, R., & Mesulam, M. M.
(2004). Orienting attention to locations in perceptual versus mental representations. Journal of
Cognitive Neuroscience, 16(3), 363-373.
Nosofsky, R. M. (1986). Attention, similarity, and the identification–categorization relationship.
Journal of Experimental Psychology: General, 115(1), 39-57.
Noudoost, B., Chang, M. H., Steinmetz, N. A., & Moore, T. (2010). Top-down control of visual
attention. Current Opinion in Neurobiology, 20(2), 183-190.
O'Craven, K. M., Downing, P. E., & Kanwisher, N. (1999). fMRI evidence for objects as the
units of attentional selection. Nature, 401(6753), 584-587.
Oberauer, K. (2002). Access to information in working memory: exploring the focus of attention.
Journal of Experimental Psychology: Learning, Memory, and Cognition, 28(3), 411-421.
Öhman, A., Flykt, A., & Esteves, F. (2001). Emotion drives attention: Detecting the snake in the
grass. Journal of Experimental Psychology: General, 130(3), 466-478.
Orbán, G., Fiser, J., Aslin, R. N., & Lengyel, M. (2008). Bayesian learning of visual chunks by
human observers. Proceedings of the National Academy of Sciences, 105(7), 2745-2750.
Park, S., Kim, M. S., & Chun, M. M. (2007). Concurrent working memory load can facilitate
selective attention: Evidence for specialized load. Journal of Experimental Psychology: Human
Perception and Performance, 33(5), 1062-1075.
Postle, B. R. (2006). Working memory as an emergent property of the mind and brain.
Neuroscience, 139(1), 23-38.
Postle, B. R., & D’Esposito, M. (1999). “What”—then—“where” in visual working memory: An
event-related fMRI study. Journal of Cognitive Neuroscience, 11(6), 585-597.
Rao, S. C., Rainer, G., & Miller, E. K. (1997). Integration of what and where in the primate
prefrontal cortex. Science, 276(5313), 821-824.
Rees, G., & Lavie, N. (2001). What can functional imaging reveal about the role of attention in
visual awareness?. Neuropsychologia, 39(12), 1343-1353.
Rees, G., Russell, C., Frith, C. D., & Driver, J. (1999). Inattentional blindness versus
inattentional amnesia for fixated but ignored words. Science, 286(5449), 2504-2507.
Rehder, B., & Hoffman, A. B. (2005). Thirty-something categorization results explained:
Selective attention, eyetracking, and models of category learning. Journal of Experimental
Psychology: Learning, Memory, and Cognition, 31(5), 811-829.
Rose, N. S., LaRocque, J. J., Riggall, A. C., Gosseries, O., Starrett, M. J., Meyering, E. E., &
Postle, B. R. (2016). Reactivation of latent working memories with transcranial magnetic
stimulation. Science, 354(6316), 1136-1139.
Rose, S. A., Feldman, J. F., & Jankowski, J. J. (2004). Infant visual recognition memory.
Developmental Review, 24(1), 74-100.
Ryals, A. J., Wang, J. X., Polnaszek, K. L., & Voss, J. L. (2015). Hippocampal contribution to
implicit configuration memory expressed via eye movements during scene exploration.
Hippocampus, 25(9), 1028-1041.
Ryan, J. D., Althoff, R. R., Whitlow, S., & Cohen, N. J. (2000). Amnesia is a deficit in relational
memory. Psychological Science, 11(6), 454-461.
Ryan, J. D., Hannula, D. E., & Cohen, N. J. (2007). The obligatory effects of memory on eye
movements. Memory, 15(5), 508-525.
Saffran, J. R., Aslin, R. N., & Newport, E. L. (1996). Statistical learning by 8-month-old infants.
Science, 274(5294), 1926-1928.
Saffran, J. R., & Kirkham, N. Z. (2018). Infant statistical learning. Annual Review of Psychology,
69, 181-203.
Saffran, J. R., Newport, E. L., Aslin, R. N., Tunick, R. A., & Barrueco, S. (1997). Incidental
language learning: Listening (and learning) out of the corner of your ear. Psychological Science,
8(2), 101-105.
Schapiro, A. C., Gregory, E., Landau, B., McCloskey, M., & Turk-Browne, N. B. (2014). The
necessity of the medial temporal lobe for statistical learning. Journal of Cognitive Neuroscience,
26(8), 1736-1747.
Schapiro, A. C., Turk-Browne, N. B., Botvinick, M. M., & Norman, K. A. (2017).
Complementary learning systems within the hippocampus: A neural network modelling approach
to reconciling episodic memory with statistical learning. Philosophical Transactions of the Royal
Society B: Biological Sciences, 372(1711), 20160049. https://doi.org/10.1098/rstb.2016.0049
Serences, J. T., Ester, E. F., Vogel, E. K., & Awh, E. (2009). Stimulus-specific delay activity in
human primary visual cortex. Psychological Science, 20(2), 207-214.
Shapiro, K. L., Raymond, J. E., & Arnell, K. M. (1997). The attentional blink. Trends in
Cognitive Sciences, 1(8), 291-296.
Sherman, B. E., & Turk-Browne, N. B. (2020). Statistical prediction of the future impairs
episodic encoding of the present. Proceedings of the National Academy of Sciences, 117(37),
22760-22770.
Shohamy, D., & Adcock, R. A. (2010). Dopamine and adaptive memory. Trends in Cognitive
Sciences, 14(10), 464-472.
Smith, E. E., Jonides, J., Koeppe, R. A., Awh, E., Schumacher, E. H., & Minoshima, S. (1995).
Spatial versus object working memory: PET investigations. Journal of Cognitive Neuroscience,
7(3), 337-356.
Stokes, M. G., Atherton, K., Patai, E. Z., & Nobre, A. C. (2012). Long-term memory prepares
neural activity for perception. Proceedings of the National Academy of Sciences, 109(6), E360E367.
Soto, D., Heinke, D., Humphreys, G. W., & Blanco, M. J. (2005). Early, involuntary top-down
guidance of attention from working memory. Journal of Experimental Psychology: Human
Perception and Performance, 31(2), 248-261.
Soto, D., Humphreys, G. W., & Heinke, D. (2006). Working memory can guide pop-out search.
Vision Research, 46(6-7), 1010-1018.
Summerfield, J. J., Lepsien, J., Gitelman, D. R., Mesulam, M. M., & Nobre, A. C. (2006).
Orienting attention based on long-term memory experience. Neuron, 49(6), 905-916.
Tarder-Stoll, H., Jayakumar, M., Dimsdale-Zucker, H. R., Günseli, E., & Aly, M. (2020).
Dynamic internal states shape memory retrieval. Neuropsychologia, 138, 107328.
Toro, J. M., Sinnett, S., & Soto-Faraco, S. (2005). Speech segmentation by statistical learning
depends on attention. Cognition, 97(2), B25-B34.
Treisman, A. M., & Gelade, G. (1980). A feature-integration theory of attention. Cognitive
Psychology, 12(1), 97-136.
Turk-Browne, N. B., Golomb, J. D., & Chun, M. M. (2013). Complementary attentional
components of successful memory encoding. NeuroImage, 66, 553-562.
Turk-Browne, N. B., Jungé, J. A., & Scholl, B. J. (2005). The automaticity of visual statistical
learning. Journal of Experimental Psychology: General, 134(4), 552-564.
Turk-Browne, N. B., Yi, D. J., & Chun, M. M. (2006). Linking implicit and explicit memory:
Common encoding factors and shared representations. Neuron, 49(6), 917-927.
Uncapher, M. R., Hutchinson, J. B., & Wagner, A. D. (2011). Dissociable effects of top-down
and bottom-up attention during episodic encoding. Journal of Neuroscience, 31(35), 1261312628.
Uncapher, M. R., & Rugg, M. D. (2009). Selecting for memory? The influence of selective
attention on the mnemonic binding of contextual information. Journal of Neuroscience, 29(25),
8270-8279.
Unsworth, N., Fukuda, K., Awh, E., & Vogel, E. K. (2014). Working memory and fluid
intelligence: Capacity, attention control, and secondary memory retrieval. Cognitive Psychology,
71, 1-26.
Unsworth, N., & Robison, M. K. (2016a). The influence of lapses of attention on working
memory capacity. Memory & Cognition, 44(2), 188-196.
Unsworth, N., & Robison, M. K. (2016b). Pupillary correlates of lapses of sustained attention.
Cognitive, Affective, & Behavioral Neuroscience, 16(4), 601-615.
Unsworth, N., & Spillers, G. J. (2010). Working memory capacity: Attention control, secondary
memory, or both? A direct test of the dual-component model. Journal of Memory and Language,
62(4), 392-406.
van Ede, F., Chekroud, S. R., & Nobre, A. C. (2019). Human gaze tracks attentional focusing in
memorized visual space. Nature Human Behaviour, 3(5), 462-470.
van Ede, F., Niklaus, M., & Nobre, A. C. (2017). Temporal expectations guide dynamic
prioritization in visual working memory through attenuated α oscillations. Journal of
Neuroscience, 37(2), 437-445.
Vickery, T. J., & Jiang, Y. V. (2009). Associative grouping: Perceptual grouping of shapes by
association. Attention, Perception, & Psychophysics, 71(4), 896-909.
Vickery, T. J., Park, S. H., Gupta, J., & Berryhill, M. E. (2018). Tasks determine what is learned
in visual statistical learning. Psychonomic Bulletin & Review, 25(5), 1847-1854.
Wais, P. E., & Gazzaley, A. (2011). The impact of auditory distraction on retrieval of visual
memories. Psychonomic Bulletin & Review, 18(6), 1090-1097.
Wais, P. E., Rubens, M. T., Boccanfuso, J., & Gazzaley, A. (2010). Neural mechanisms
underlying the impact of visual distraction on retrieval of long-term memory. Journal of
Neuroscience, 30(25), 8541-8550.
Wagner, A. D., Shannon, B. J., Kahn, I., & Buckner, R. L. (2005). Parietal lobe contributions to
episodic memory retrieval. Trends in Cognitive Sciences, 9(9), 445-453.
Wang, B., & Theeuwes, J. (2018). Statistical regularities modulate attentional capture. Journal of
Experimental Psychology: Human Perception and Performance, 44(1), 13-17.
Ward, E. J., Chun, M. M., & Kuhl, B. A. (2013). Repetition suppression and multi-voxel pattern
similarity differentially track implicit and explicit visual memory. Journal of Neuroscience,
33(37), 14749-14757.
Wig, G. S., Grafton, S. T., Demos, K. E., & Kelley, W. M. (2005). Reductions in neural activity
underlie behavioral components of repetition priming. Nature Neuroscience, 8(9), 1228-1233.
Wolosin, S. M., Zeithamova, D., & Preston, A. R. (2013). Distributed hippocampal patterns that
discriminate reward context are associated with enhanced associative binding. Journal of
Experimental Psychology: General, 142(4), 1264-1276.
Woodman, G. F., Vogel, E. K., & Luck, S. J. (2001). Visual search remains efficient when visual
working memory is full. Psychological Science, 12(3), 219-224.
Woodman, G. F., & Luck, S. J. (2004). Visual search is slowed when visuospatial working
memory is occupied. Psychonomic Bulletin & Review, 11(2), 269-274.
Wulf, G., Höß, M., & Prinz, W. (1998). Instructions for motor learning: Differential effects of
internal versus external focus of attention. Journal of Motor Behavior, 30(2), 169-179.
Xiao, X., Dong, Q., Gao, J., Men, W., Poldrack, R. A., & Xue, G. (2017). Transformed neural
pattern reinstatement during episodic memory retrieval. Journal of Neuroscience, 37(11), 29862998.
Xu, Y. (2017). Reevaluating the sensory account of visual working memory storage. Trends in
Cognitive Sciences, 21(10), 794-815.
Xu, Y. (2018). The posterior parietal cortex in adaptive visual processing. Trends in
Neurosciences, 41(11), 806-822.
Yamaguchi, S., Hale, L. A., D'Esposito, M., & Knight, R. T. (2004). Rapid prefrontalhippocampal habituation to novel events. Journal of Neuroscience, 24(23), 5356-5363.
Yonelinas, A. P. (2002). The nature of recollection and familiarity: A review of 30 years of
research. Journal of Memory and Language, 46(3), 441-517.
Yi, D. J., & Chun, M. M. (2005). Attentional modulation of learning-related repetition
attenuation effects in human parahippocampal cortex. Journal of Neuroscience, 25(14), 35933600.
Yu, R. Q., & Zhao, J. (2015). The persistence of the attentional bias to regularities in a changing
environment. Attention, Perception, & Psychophysics, 77(7), 2217-2228.
Zacks, J. M., Speer, N. K., Swallow, K. M., Braver, T. S., & Reynolds, J. R. (2007). Event
perception: A mind-brain perspective. Psychological Bulletin, 133(2), 273-293.
Zhao, J., Al-Aidroos, N., & Turk-Browne, N. B. (2013). Attention is spontaneously biased
toward regularities. Psychological Science, 24(5), 667-677.
Zhao, J., & Luo, Y. (2017). Statistical regularities guide the spatial scale of attention. Attention,
Perception, & Psychophysics, 79(1), 24-30.
Zhao, L., Cosman, J. D., Vatterott, D. B., Gupta, P., & Vecera, S. P. (2014). Visual statistical
learning can drive object-based attentional selection. Attention, Perception, & Psychophysics,
76(8), 2240-2248.
Zokaei, N., Board, A. G., Manohar, S. G., & Nobre, A. C. (2019). Modulation of the pupillary
response by the content of visual working memory. Proceedings of the National Academy of
Sciences, 116(45), 228082-22810.
Zokaei, N., Manohar, S., Husain, M., & Feredoes, E. (2014). Causal evidence for a privileged
working memory state in early visual cortex. Journal of Neuroscience, 34(1), 158-162.
Zola, S. M., Squire, L. R., Teng, E., Stefanacci, L., Buffalo, E. A., & Clark, R. E. (2000).
Impaired recognition memory in monkeys after damage limited to the hippocampal region.
Journal of Neuroscience, 20(1), 451-463.
Download