Brian Apter – TopUpEdD, Student no. 0842733, 5/9/2011 Title: Do computerised training programs designed to improve working memory work? ABSTRACT: A critical review of working memory training research during the last 10 years is provided. Particular attention is given to research that has attempted to investigate the efficacy of commercially marketed computerised training programs such as 'Cogmed' and 'Jungle Memory'. Claimed benefits are doubted on the basis that research methodologies were flawed. It is also argued that the Working Memory model in its current stage of development was under-specified and paradigmatically unsuited to working memory training research. Indications in respect of memory training for applied psychologists working in schools, and possible areas for future research are suggested. Introduction Memory improvement has been of academic and practical interest since the time of the poet Simonides (circa 500 B.C.). Techniques were documented in an anonymous text, the Rhetorica ad Herennium - dated between 86 and 82 B.C. (Foer, 2011). Self-help books designed to improve memory have had an international market appeal for more than a century (e.g. Pitman, 1889; Loisette, 1896; Young and Gibson,1970; Lorayne and Lucas, 1974,1986; Johnson, B., 1976; Stine, 1997; Buzan, 2009). National newspapers in the UK regularly carry adverts for memory improvement courses. Such materials commonly require a fee to be paid and the completion of special homework. There has been a significant quantity of independent research supporting the claims of generic memory improvement courses. For example, a large US random controlled trial (RCT) study of 3000 older adults (Ball et al., 2002; Willis et al., 2006) with results analysed at 2 years after the course and at 5 years after, showed that a proprietary training course appeared to have measurable benefits that generalised and lasted. 1 - 31 533581322 Brian Apter – TopUpEdD, Student no. 0842733, 5/9/2011 Foer (2011) provided an account of how memory skills can be improved to the extent that the author was able to enter and win a national memory contest in the USA. Foer described techniques to store and recall information efficiently including the use of visualisation keys - so called 'memory palaces', and elaborative encoding using mnemonics. Foer proposes that memory improvement was not about increasing capacity but about using mental resources more skilfully. There have also been some critical findings. For example, Sullivan and Madden (2008) failed to find any benefit in using Memory Power materials with young adults; and Owen and colleagues (Owen et al., 2010) did not detect any transfer effects from brain-training computer games used by 11000 subjects. Owen's BBC funded and mediated research was criticised by the Swedish neuroscientist, Torkel Klingberg. Klingberg alleged that there was a lack of rigour with Owen's research (Callaway, 2010). What emerged in reviewing the generic memory training literature was that with the claim that memory had or had not been improved, the nature of an improvement was often not specified: for example, new memorisation or recall strategies, speed of storage, speed of recall, accuracy of storage, accuracy of recall, a memory capacity increase, or a combination of any or all of these. Working Memory Training A subset of generic memory training has been the comparatively recent innovation of working memory training (Gathercole, 2008). Recently there appeared to be increasing interest from educationalists in the potential of working memory training (Bakalar, 2008; Buckley, 2008). The working memory paradigm (Baddeley and Hitch, 1974; Baddeley, 2000), its limitations, and whether it can be used to meaningfully scrutinise claimed working memory training outcomes is discussed later. Despite possible limitations, the market for 'adaptive' computerised working memory training programs appears ripe. Neuroscientific researchers have made optimistic claims for the 2 - 31 533581322 Brian Apter – TopUpEdD, Student no. 0842733, 5/9/2011 efficacy of programs such as Jungle Memory (Alloway, 2010) and the Cogmed Working Memory Training Program (Klingberg, 2009) in respect of future educational attainment and the amelioration of special educational needs. For example, Buckley (2008) claimed particular benefits for children and young people with Down Syndrome and Klingberg et al. (2005) claimed benefits for children with Attention Deficit Hyperactive Disorder (ADHD). The term: 'adaptive', as applied to computerised working memory programs such as Cogmed and Jungle Memory, describes computer programs that utilise training tasks that are automatically adjusted in difficulty according to a continual reassessment of a subject's so-called working memory capacity. It is claimed that a subject's working memory capacity has thus been optimally exercised and stretched against successive baselines and that the subject’s working memory capacity has been increased. These newer programs contrast with older generic memory training materials that endeavour to provide students with new memory skills and strategies for storage and recall, but do not claim to increase working memory capacity. If Klingberg and Alloway were correct about the utility of their respective adaptive working memory training computer-programs, the international educational market for Jungle Memory and for the Cogmed program would be potentially highly profitable. Recent research review - working memory training Gathercole (2008) was compelling in a keynote review of research in emphasising the importance of working memory functioning to the educational outcomes of children and young people but did not advocate working memory training. Gathercole advised that teachers needed to take account of deficits in pupils' working memory by making adjustments to the classroom environment and to the way that the curriculum was delivered. 3 - 31 533581322 Brian Apter – TopUpEdD, Student no. 0842733, 5/9/2011 Gathercole suggested that the training of working memory skills using computer programs showed promise, but that research had not been conclusive: 'As yet, the precise source of the improvement in working memory performance in training is not fully understood, and may arise from enhancement in basic memory capacity, strategies or both.' (Gathercole, 2008, p.385). In a book published in the same year Gathercole and Alloway (2008) wrote: 'We have no direct evidence that general working memory capacity can be improved by training in low [sic] memory children. Some research has attempted to enhance working memory by training children in the use of highly specific strategies, but the gains have been small despite intensive training, and have not generalised to other memory situations.' (p. 106) Indeed, a review of the small quantity of available research from 20 years ago to the present day investigating the efficacy of working memory training using either random control trials or subtractive experimental designs has been equivocal about its benefits. Flynn and Storandt (1990) concluded that there were no significant benefits to be gained from working memory training with older adults. Olson et al.,(2005) described research where the functioning (speed and accuracy) but not capacity of visuo-spatial memory was improved after a repeating visual memory training task had been completed. Jaeggi et al. (2008) proposed that fluid intelligence was increased after working memory training had been completed. The researchers noted that working memory and fluid intelligence shared a 'common variance' (p.1). Moody (2009) criticised the methodology of this research noting that the 4 - 31 533581322 Brian Apter – TopUpEdD, Student no. 0842733, 5/9/2011 training tasks employed were similar to the tasks used by the measurement tool: the BOMAT (Bochum's Standard Matrices, Hossiep and Hasella, 2010). There were a number of other problems with the research of Jaeggi et al. (2008) that exemplified the potential for obscuring experimental effects that pervades much of the research concerned with working memory training. Jaeggi et al. elected to use a 'no training' control group model. This invited the criticism that the experimental group had much more experimenter attention than the control group, and the possibility that there had been a Hawthorne effect. It also meant that the confounding effect that Moody (2009) identified, was more pronounced than if an alternative placebo-type training intervention had been used as a comparison condition. There were also problems with the specification of the pre- and post-intervention measures of working memory: digit span and reading span. Chase and Ericsson (1982); and Pickering and Gathercole (2001) had previously noted limitations in the specificity of the digit span task as a measure of working memory, and Shipstead et al. (2010) noted difficulties with the use of reading span. The latter also noted that the Jaeggi et al. (2008) effect size over time was small. In Gathercole’s (2008) key note article Gathercole referred to research by Klingberg et al. (2002; 2005). Klingberg and colleagues proposed that the Cogmed computer program had improved the functioning of working memory of a small sample (n=42) of children with ADHD. The improvement claimed appeared to be in respect of the functioning of the visuo-spatial component of the working memory of subjects using a span-board (or Corsi blocks) test. Klingberg reported that an increase in working memory capacity had been achieved. Klingberg conceived and designed the Cogmed program in 1999, (CogMed, 2009). Klingberg was also a founding member of Cogmed Systems, the international program marketing company, and is an executive member of its board. 5 - 31 533581322 Brian Apter – TopUpEdD, Student no. 0842733, 5/9/2011 Klingberg and colleagues at the Karolinska Institute, Stockholm, supported their claim to have increased the capacity of working memory with a study (Olesen et al., 2004) employing functional magnetic resonance imaging (fMRI). In two small scale experiments (n=3 male adults; and n=8: 2 male and 6 female adults), researchers scanned subjects whilst performing cognitive tasks, before, during and after 5 weeks of working memory training. Resultant scans were used to support the researchers' claim that the Cogmed program had induced a 'cortical plasticity' (p. 78) that underlay increased task-related pre-frontal and parietal activity. Jonides (2004), in the same issue of the journal, suggested caution noting that the quantity of data might be insufficient to adequately support Klingberg's claims. A book by Klingberg, 'The Overflowing Brain' (Klingberg, 2009) and a discursive paper (Klingberg, 2010) attempted to provide theoretical support for the possibility of working memory capacity increase by suggesting that working memory tasks recruited neurons in the frontal lobe that then became specialised for working memory tasks: 'As regards working memory, one theory posits that the sensory information from the rear parts of the brain is conveyed to the specialised neurons of the frontal lobe in a way not dissimilar to grandmother cell theory.' (Klingberg, (2009, p.51) Grandmother Cell Theory is the theoretical proposition that there are specialised neurons dedicated exclusively to particular tasks, for example, the recognition of a person's grandmother (Baddeley et al., 2009) or perhaps temporary working memory storage. Klingberg continues: ‘There are also studies, however, showing that information cannot always be gleaned simply from the activity of the nerve cells in the frontal lobes. Certain cells exhibit working memory activity regardless of the type of stimulus being memorized.' (p.51) 6 - 31 533581322 Brian Apter – TopUpEdD, Student no. 0842733, 5/9/2011 Subsequently, Klingberg and colleagues (McNab et al., 2009) proposed a stronger hypothesis about where in the neuron mechanism the plasticity, and thus potential for increased working memory capacity was to be found. From the results of an experiment employing both positron emission tomography (PET) and fMRI scans of 13 males aged between 20 and 28, the researchers claimed that: 'We show that the training of working memory [using the Cogmed program] which improves working memory capacity, is associated with the changes in the cortical density of cortical dopamine D1 receptors. Fourteen hours of training over 5 weeks was associated with changes in both prefrontal and parietal D1 binding potential. This plasticity of the dopamine D1 receptor system demonstrates a reciprocal interplay between mental activity and brain biochemistry in vivo.' (p. 800) This sounds impressive but reading the report indicates: 1. Baseline and post tests used to measure subjects' working memory capacity were under-specified. 2. Control and experimental conditions in respect of the type of training tasks that were used were under-specified. 3. It is not clear how similar test tasks and training tasks were. 4. There was no alternative hypothesis; for example, the possibility that it was the attentional workload that created the effect rather than the plasticity of working memory. 5. There was no longer term follow-up to ascertain whether the changes in cortical dopamine D1 receptor binding lasted significantly beyond the period of training. 6. There might have been a selection effect in respect of such a small homogeneous group of adult male volunteers. 7. The previous learning and training experiences of subjects did not appear to have been controlled for. 8. The change in cortical dopamine D1 receptor binding and the claim that this can be associated with an increase in working memory capacity is speculative. 7 - 31 533581322 Brian Apter – TopUpEdD, Student no. 0842733, 5/9/2011 Baddeley (2009) identified general problems with neuro-imaging studies, citing Duncan and Owen (2000), and noting: '... a lack of consistency across studies at anything other than the broadest level.' (p. 66) Gathercole and colleagues, (Holmes, et al., 2009a; 2009b) also employed the Cogmed program in research. The authors cited Klingberg's research (2002; 2005) but stopped short of similarly claiming to have achieved an increase in working memory capacity, attempting instead to demonstrate generalisation by presenting evidence for gains in subjects’ subsequent educational outcomes, e.g. improved standardised reading and spelling scores. An exclusive association where no other variables are playing a part is improbable however. Alloway (2010) claimed that training using Jungle Memory (Memosyne, 2007), an online licensed computer program, marketed by Memosyne Ltd., improved general learning outcomes, particularly for children with dyslexia, language impairments, motor dyspraxia, and ADHD. Alloway is listed as the company secretary for Memosyne Ltd. by Companies House but does not disclose this in the article. No research findings to support the benefits of Jungle Memory in respect of any of these conditions were cited. Whilst Klingberg et al.'s research (2002; 2005) was cited as supporting Alloway’s claims in respect of using Jungle Memory with children with ADHD, Klingberg (Cogmed, 2009) has been adamant that only the Cogmed program can achieve the capacity increasing effect he and colleagues have reported. Chein and Morrison (2010) conducted a small scale study of 25 female undergraduates. They endeavoured to show the effect of an adaptive working memory training program on capacity, attentional processes, and reading comprehension. The outcomes were significantly improved but only re-tested at the end of the 4 week course and longer term: generalisation could not be claimed. 8 - 31 533581322 Brian Apter – TopUpEdD, Student no. 0842733, 5/9/2011 In a subsequent review, Morrison and Chein (2011) reviewed evidence for positive working memory training outcomes. They concluded that effort and expectancy effects were generally not accounted for in research - including their own. Another experimental error they found in much of the research they reviewed but which their own study was intended to avoid was the use of test tasks that were similar in both assessment and training phases of experiments. Shipstead, Redick and Engle (2010) also compiled a review of research. They concluded that Chein and Morrison's 2010 study was singularly more impressive methodologically than most but too small in scale for the results to be significant. The focus of their review was particularly related to the extent to which research has demonstrated the generalisation of working memory training outcomes. With some of the research they review, generalisation was not an intention, e.g. Klingberg's PET scan research (Oleson et al., 2004). Nonetheless, summarising their critique, Engle and colleagues report multiple methodological problems with the research they reviewed including: 1. Inadequate specification of 'near' and 'far' transfer effects, e.g. Klingberg et al., (2002); Alloway, (2010). 2. Undetectable 'far' transfer effect, e.g. Holmes et al., (2009a; 2009b). 3. Small sample size and / or inadequately specified control group, e.g. Alloway and Alloway, (2009); Holmes et al., (2009b); Klingberg et al., (2002). 4. Normal maturation and learning not accounted for in post-training measures, e.g. Klingberg et al., (2005); Holmes et al., (2009a). 5. Previous experience of the subjects of the type of assessment materials used in research inadequately controlled for, e.g. Holmes et al., (2009a; 2009b). 6. Inadequate control of other cognitive processes affected by test conditions particularly the way in which fatigue and stress during test procedures affect attentional processes, e.g. Klingberg et al., (2002; 2005); Oleson et al., (2004) 7. Selection effects, e.g. in respect of the method of ADHD diagnosis being unspecified e.g. Klingberg et al., (2002; 2005); Holmes et al., (2009b). 9 - 31 533581322 Brian Apter – TopUpEdD, Student no. 0842733, 5/9/2011 8. Expectancy effect by virtue of subjects association with researchers, possibly incorporating a Hawthorne effect, e.g. Klingberg, et al., (2002; 2005); (Oleson et al., 2009). Shipstead, et al. (2010) concluded that the case for adaptive working memory training successfully generalising had not been proven. Adopting a wider view of the working memory training research but incorporating Shipstead et al.'s (2010) review, it appears that in order to establish whether working memory training works, researchers have occupied themselves with proving one of the following: 1. Outcomes have been positive over a long term as proven by test and retest using a working memory test battery. 2. Outcomes have generalised to long-term increases in proprietary measures of intelligence. 3. Outcomes have been associated with positive long-term changes in the physiology of the brain. 4. Outcomes have been positively associated with improved educational learning outcomes over an extended period. 5. A combination of any or all of the above. Any of these outcomes – had they been plausibly demonstrated, could have been construed as being indicative of a permanent increase in working memory capacity. The research evidence remains equivocal however and on balance it appears that any claim of having achieved working memory capacity increase has been unfounded. Discussion The discussion that follows firstly examines the Baddeley and Hitch (1974) working memory model and the augmented model that includes an episodic buffer (Baddeley, 2000) and considers whether there might be inherent limitations with the model that preclude certainty in respect of working 10 - 31 533581322 Brian Apter – TopUpEdD, Student no. 0842733, 5/9/2011 memory training research findings; and whether there are competing models that might offer further illumination on the issue of training efficacy. The second part of the discussion considers the attribute of capacity as it was used in the original conceptualisation of the working memory model (Baddeley and Hitch, 1974) and how it has been subsequently understood by researchers investigating working memory training. The third part of the discussion concerns the limitations that might apply to research methods as they have been employed in investigating working memory training research. The term 'working memory' was first employed in 1960 by Miller, Gallanter and Pribam as a theoretical conjecture. Working memory was refined as a concept by Atkinson and Shiffrin (1968) but as a subsidiary function of shortterm memory. The subsequent three component working memory model was a theoretical device intended to steer experimental memory research (Baddeley, 2001). Baddeley and Hitch (1974) conceived of working memory as comprising a visuo-spatial scratchpad, a phonological loop and an attentional controller the central executive. Baddeley described the utility of the working memory model thus: '... a theoretical framework whose function was to give an economical and coherent account of a relatively wide range of data... ... with a capacity to stimulate further research and to incorporate more precise quantitative and or computational models. ' (Baddeley, 2001, p.85) Baddeley (2009) summarised that the function of working memory as originally envisaged in the model was to briefly hold and manipulate limited amounts of information. Results of working memory processes might be 11 - 31 533581322 Brian Apter – TopUpEdD, Student no. 0842733, 5/9/2011 subsequently stored in longer-term memory. Baddeley and Hitch (1974) did not originally propose that there was an analogous neurological / physiological working memory device singularly localised within the brain. Demonstrating the theoretical mutability of the model, Baddeley added a new fourth component - the episodic buffer (Baddeley, 2000), whose function was to assimilate different types of information, e.g. visual and phonological and cross-reference it with information held in the short-term memory store. The role of the episodic buffer was not considered in Klingberg's research (2002; 2004, 2005); nor by any of the other researchers reviewed here. Representatively, Klingberg appeared to view the working memory model as a fixed, three component entity, each component unfractionalised - much as they were conceived of in 1974. This does not seem to be in keeping with the flexible evolving paradigm that Baddeley originally envisaged. It is conceivable that in time other subsystems could be incorporated into the model; for example, other sensory buffers (Smith and Jondes, 1997) such as: touch / movement (Smyth, et al., 1988) smell (White, 1998) and taste (Bermudez-Rattoni et al., 2005). It is also conceivable that apparently established components of working memory might require further fractionalisation (Smith and Jonides 1997). For example; both they and Henson (2001) make a strong case for distinguishing between visual object and visuo-spatial material, both by neural mapping and by experimental data. Pearson (2001) noted the relative difficulty of researching the visuo-spatial scratchpad without fractionalising the component further. Page and Henson (2001) challenged the standard conceptualisation of the phonological loop, suggesting that it is a specialised dedicated system for immediate verbal recall and implying that another computational sub-system might exist to manage phonological tasks such as the ordering of data. In agreement with May (2001), Baddeley (2009) noted the under-specification of the central executive and highlighted the difficulty of specifying the central executive without further fractionalisation. Baddeley (2009) also noted the 12 - 31 533581322 Brian Apter – TopUpEdD, Student no. 0842733, 5/9/2011 relative preponderance of research pertaining to the specification of the phonological loop, and the potential for the future fractionalisation of all four of the working memory components. Klingberg and colleagues (McNab et al., 2009) claimed that the improvement in working memory following training with the Cogmed computer program equated to an increase in working memory capacity but working memory was originally conceptualised as a limited capacity system and each component was specified partly by its fixed capacity. 'We would like to suggest that the core of the working memory system consists of a limited capacity "workspace" which can be divided between storage and control process demands' (Baddeley and Hitch, 1974, p. 76) Baddeley (2009) described the 'attentional capacity' (p.54) of the central executive as being able to attend to a maximum of 2 active tasks at once, and the capacity of the phonological loop as being typically 4 digits, increased to Miller's (1956) 7 plus or minus 2 by employment of the additional resources of the newly contrived episodic buffer (Baddeley, 2009; p.56). Cowan (2001) argued that the fixed capacity of working memory was 3-5 'chunks' of information. Cowan proposed that a pointer of indicative information in the working memory work-area of the short-term memory store pointed to the chunk, e.g. a word, by coordinated use of other short-duration memory traces in the short-term memory store - perhaps with reference to knowledge held in the long-term memory store. Cowan's conceptualisation of working memory was as a complex dynamic attentional process, rather than the neural workareas in themselves. Whilst researchers agree that full capacity was not developed until adolescence or early adulthood is attained (Gathercole et al., 2004; Cowan, 1997), the concept of a fixed, limited-capacity system was an essentially defining characteristic of Baddeley and Hitch's (1974) working memory model. The original paradigm was not intended to accommodate a potential increase in capacity - with training or without. Dispensing with the attribute of fixed13 - 31 533581322 Brian Apter – TopUpEdD, Student no. 0842733, 5/9/2011 capacity, the working memory model differs much less conceptually from Atkinson and Shiffrin's (1968) 'short term store' memory (STM). Whilst limited capacity is only a theoretical attribute, it is interesting to adhere to the constraint, and then review Klingberg's claim of having increased the working memory capacity of subjects (McNab, 2009) following the completion of a Cogmed training course, and consider how the effect they observed might have been caused. Chase and Ericsson (1982), cited by Shipstead et al.,(2010) report a participant in an experiment who was able to increase digit span from 7 digits to 82 after an extensive training course. An interview with the subject revealed that they had learnt to use the memory technique of ‘elaborative encoding’ (Foer, 2011). This technique involves mapping the information to be learnt on to an existing knowledge base - perhaps within short term memory, in order to provide a recall key. Foer (ibid.) reported that his digit span - identified as being an approxmate indicator of the capacity of the phonological loop (Pickering and Gathercole, 2001), had significantly increased after practising for a year using generic memorisation and recall improvement strategies, from 9 to 18 digits. Foer commented that other measures of his working memory capacity had not increased at all (Foer, 2011, p.266). Klingberg and colleagues. (McNab et al., 2009) did not examine this possibility that subjects might be learning and using memory skills of this sort, perhaps inadvertently or subliminally. The change in cortical dopamine D1 receptor binding that is reported might be as meaningfully associated with strategy-learning and confidence as with capacity increase. Interestingly, the comparatively newly-devised - and thus far, underresearched, episodic buffer (Baddeley, 2000) provides an explanatory device as to how working memory performance is apparently rapidly improved by novel, perhaps subliminal, self-taught memory strategies and the employment of information stored in longer term memory. An explanation of how apparent improvement might be achieved is elaborated by Ericsson (1985) with the Theory of Skilled Memory. The theory proposed that strategic memory processes for storage and recall utilising both short-term memory and longterm memory storage can be significantly accelerated and improved through 14 - 31 533581322 Brian Apter – TopUpEdD, Student no. 0842733, 5/9/2011 training and practice. Whilst Ericsson appeared to not include the working memory model in the theory, closer reading revealed that Ericsson's conception of short term memory, and its function to facilitate storage and recall from long term memory, was analogous to the function of Baddeley's augmented model (Baddeley, 2000) - particularly including the functionality of the episodic buffer. Whilst Andrade (2001) and Baddeley (2003) reflect that the working memory model of Baddeley and Hitch (1974), augmented by Baddeley (2000) has had a robust empirical utility for researchers, Andrade concluded: 'There was also a consensus [among working memory researchers] that the under-specification of the nature and interrelationships of the sub-components of working memory made the model hard to use and hard to test.' (p.307) There are also a number of alternative theories of working memory that compete with Baddeley and Hitch's (1974) model - particularly in placing greater emphasis on the attentional process as a mediating device that utilised different memory stores to synthesise complex multi-modal memories. Cowan's (1999) model proposed that the attentional process was embedded in short-term memory and that there was little fundamental difference between different types of memory. Engle's (1996) theory of inhibitory control suggested that competing demands from the attentional process delimited the effectiveness of working memory but did not reduce or increase capacity. Barrouillet and Camos's resource-sharing hypothesis (Barrouillet et al., 2004) proposed that complex tasks compelled attentional pauses that facilitated rehearsal using the short term memory store. Ward's (2001) General Episodic Memory (GEM) theory developed a model of short-term memory that provided an explanation of an anomaly that has arisen in phonological loop research recency effects during free recall. The central executive component of Baddeley and Hitch's (1974) working memory model and the role of attention in managing working memory resources, offered a particularly problematical aspect for Andrade (2001). 15 - 31 533581322 Brian Apter – TopUpEdD, Student no. 0842733, 5/9/2011 Andrade reported that all researchers - including Baddeley, appeared to experience difficulty in specifying: '... whether there is a coherent cluster of central executive functions or whether executive functions are too diverse to be usefully encapsulated by a modified WM model.' (p.301) In recognition of Donald Broadbent's work on attention (Baddeley (1993), Baddeley wrote that he had speculated about changing the name of the ‘Working Memory Model’ to the ‘Working Attention Model’. Baddeley appeared to take an intriguing step towards Cowan's theory (1999) when he wrote: 'The working memory system is assumed to be capable of holding a limited number of chunks, each of which contains a series of 'pointers' to relevant information in long term memory. Hence, while the number of chunks held by the system is strictly limited, if more can be packed into a chunk as a result of prior learning, then the effective capacity of the working memory system can be expanded.' (p.165) Prior to the development of brain-imaging technology, working memory has primarily been a theoretical device that has been topographically visualised and functionally specified only indirectly by observing a person's behaviour under particular test conditions. Baddeley's primary method for investigating working memory was experimental but he also used evidence obtained from brain lesion studies in an attempt to triangulate his experimental findings (Baddeley, 2009). Baddeley's use of lesion studies was small in scale and not intended to locate the position of working memory in the brain. As with his experiments, Baddeley used observations to assist in topographically mapping the distinctive components of working memory by clustering functions. The sample-size was small and the measurement of lesions inexact. 16 - 31 533581322 Brian Apter – TopUpEdD, Student no. 0842733, 5/9/2011 Controlling variables adequately in psychology experiments is notoriously difficult. Shipstead et al. (2010) list some of the variables that need to be controlled: 1. Individual learning history of subjects 2. Maturation of subjects 3. Other subject selection criteria, e.g. gender 4. Task pre-sensitisation, task-habituation and task-fatigue 5. Regression to the mean 6. Matching of control condition in terms of fatigue and practice effect To Shipstead et al.'s (2010) list can be added: 7. Task-specific self-efficacy 8. Mental interference, e.g. negative self-talk 9. Sleep, diet and the use of drugs There is a reliance placed by many researchers on the specificity of what a proprietary test claims to be testing. For example, the BOMAT is assumed by Jaeggi et al. (2008) to reliably measure fluid intelligence (Gf); and the Digit Span Forward of the WMTB-C is assumed to measure the functioning of the phonological loop. Gould (1981) discussed the limitations of factor analysis as it has been employed in the construction of intelligence tests such as the BOMAT. Pickering and Gathercole (2001) noted that none of the sub-tests brought together in the WMTB-C - including the Digit Span Forward - were eclusively specific in their relationship with particular sub-components of working memory. Oberauer et al. (2000) provided a helpful factor analysis of how different tests map on to working memory components and functions, but note: '... most of the working memory tasks from the literature tap two or three working memory functions which leads to considerable overlap between the sets of tasks...' (p.1021) 17 - 31 533581322 Brian Apter – TopUpEdD, Student no. 0842733, 5/9/2011 With the ADHD studies of Klingberg et al.'s (2002; 2005) and Holmes et al., (2009b), the diagnosis of subjects as having ADHD is assumed to be robust and comparable. Different constellations and degrees of symptoms, iatrogenicity and widely variable diagnostic practices were not considered. Given the under-specification of the central executive, and the episodic buffer, mapping the functionality of other components (the phonological loop and the visuo-spatial scratchpad) by analysing the behaviour of under-specified subjects completing non-specific tasks, means that there is significant scope for false or inaccurate correlation of experimental results with the proposed topographical architecture of Baddeley and Hitch's (1974) working memory model. It cannot be doubted that Baddeley and other researchers, concerned with specifying working memory using an experimental methodology, have refined the specification considerably, but it is probable that the precision of the specification is thus far, insufficient to reliably make an association between working memory training and working memory capacity. This is perhaps a reason for some researchers such as Klingberg and colleagues opting to use brain-imaging methods to validate their experimental findings. Brain imaging research primarily relies on a subtraction method in the experimental design (Smith and Jonides, 1997). This means that brain images are compared when a subject is not performing and then performing a task that is thought to load on specified functions of the brain. Localisation of functions are then cross-referenced between the scans corresponding to the different experimental conditions. Currently, functional brain imaging using fMRI is noisy, physically restrictive and expensive. Conducting scans using fMRI therefore that there is significant cognitive interference when working memory tasks are completed, The arduousness of fMRI scans places a limit on subject-selection criteria. Expense means that the number of trials or subjects is usually small. 18 - 31 533581322 Brian Apter – TopUpEdD, Student no. 0842733, 5/9/2011 PET scans are expensive, physiologically hazardous and temporally inaccurate with a resolution of 30 seconds and a spatial resolution of 10 millimetres (Smith and Jonides, 1997). fMRI scans are more temporally accurate with a resolution of 1 to 4 seconds and a spatial resolution of 1 millimetre (Ward, 2010). Nether technology produces sufficient spatial precision over time to be sure about the association between brief behavioural events (<3 seconds) and brief brain events (=<2.5 seconds) with a varying haemodynamic scan delay of approximately 5 seconds (Smith and Jonides 1997]. One fMRI study (Cohen et al., 1997) attempted to map brain events associated with the use of working memory onto brain areas associated with particular working memory functions in a more temporally accurate way but their results appeared speculative: 'A different possibility is that sustained activation within the PFC [pre-frontal cortex] reflects the operation of more general process associated with task difficulty and mental effort, rather than a process specific to working memory.' (p.606) It might be that future improvements in brain-imaging methods, perhaps through the development of more sophisticated fMRI and PET scan technology, will provide additional evidence for the association. Klingberg and colleagues (Oleson et al., 2004) could be challenged that they have exaggerated the precision of their claim of having shown the effect of the Cogmed working memory training course in increasing capacity. Whilst the changes in cortical dopamine D1 receptor binding can possibly be associated with the cognitive training as described in the paper, the case for the essentialness of Cogmed cognitive training is not made. Neither is the case convincingly made that the changes in the D1 receptor binding equate with an increase in the capacity of working memory. Whilst Henson (2000) is confident about being able to approximately locate the whereabouts of a number of working memory components in the brain, the working memory training researcher's task in examining brain images to 19 - 31 533581322 Brian Apter – TopUpEdD, Student no. 0842733, 5/9/2011 show training effects is a more complex task than, for example, identifying a language or movement centre; or indeed the approximate location of memory centres. The theoretical construct of working memory is comprised of an unfixed number of components (4 plus). Being able to record matrices of fast temporal activity vectors acting between different brain areas, interfered with, and inhibited by, constant sensory feedback, and interactions with short and long term memories is critical to brain-imaging research adequately specifying the working memory model and the effect of any training upon it. We are not even close. The role of learnt strategies in the effective employment of this complex matrix of cognitive activity is not adequately controlled-for in any of the brain-imaging research discussed here. Baddeley (2003) previously cautioned: 'The problem of adequately controlling strategy in imaging studies is important but, I suspect, frequently underestimated. Purely behavioural studies typically use a series of experiments to rule out the possible strategic interpretations of the data, an approach that might be seen as impracticably expensive in neuro-imaging.' (p. 837) Conclusions: indications for research and recommendations for applied psychologists This review of working memory training research has indicated that the evidence for efficacy is weak. Adaptive computerised training programs such as Cogmed (2009) and Jungle Memory (Memosyne Ltd., 2007) require significant amounts of user time, and are costly to buy. Research methodologies employed to demonstrate efficacy, including brain-imaging studies, have been found to be flawed. Many of the research difficulties have arisen because both the Working Memory model (Baddeley and Hitch, 1974) and the augmented version (Baddeley, 2000) are under-specified for the 20 - 31 533581322 Brian Apter – TopUpEdD, Student no. 0842733, 5/9/2011 purpose of the research reviewed here and were not intended for use by a training paradigm. This review has revealed by implication that there are a number of promising areas of research and associated indications for applied psychology in the educational domain: 1. The role of attention Attention and interference appear to be significant variables in promoting or inhibiting the use of working memory and short-term memory (Redick, et al. 2011). Consider, for example, a child in school who has intruding thoughts and anxieties and how this might effect their use of working memory and thus all of their learning in school. This consideration provides support for Gathercole's (2008) recommendation that classroom organisation and learning tasks need to be adapted for children who experience working memory difficulties. 2. The role of mental effort The available mental effort for any working memory task affects, and is affected by, a person's physiological condition, particularly including their cardiovascular condition and glucose levels (Fairclough, et al. 2004). Consider, for example, the under-nourished child in the classroom and the role of diet and meal recency, fatigue, sleep and time of day, prescribed medication and drug misuse. 3. The role of motivation and memory self-efficacy It is evident that a person's motivation to use working memory and to learn, has a complex relationship with memory self-efficacy. There is evidence that a person's motivation to use working memory affects and is affected by their confidence that this will be a successful activity (Beaudoin, M., Desrichard, O. 2011; Dougall, 2009). Consider, for example, a child who has under21 - 31 533581322 Brian Apter – TopUpEdD, Student no. 0842733, 5/9/2011 developed memory self-efficacy and avoids using working memory, short-term memory, and/or memory strategies/skills as a result of previous learning failure. 4. The role of memory skills and strategies There have been a number of indications in this review of the importance of learnt memorisation and recall strategies and the indirect positive effect they might apparently have on working memory functioning, even to the extent of appearing to increase working memory capacity. For example, a study looking at the acquisition of reading skills (McNamara and Scott, 2001) showed how learners who had practised memory strategies appeared to use working memory more effectively when learning to read. The theory of skilled memory (Ericsson, 1985) provides both theory and suggestions for practice that can be used to inform interventions in schools. Buzan has provided prolific guidance on teaching a range of memory skills and strategies (typically,1995, and 2009), including the use of mind-maps, to children and adults, and McPherson (2000) provides concise useful guidance with helpful theoretical underpinnings. It is probable that teaching children and young people to use memorisation and recall strategies would parsimoniously provide a curricularly valid and useful way of promoting improved learning outcomes. Teaching memory skills (rather than training working memory) might also positively impact upon the speed, efficiency, accuracy and confidence of using working memory functions. 22 - 31 533581322 Brian Apter – TopUpEdD, Student no. 0842733, 5/9/2011 References Alloway, T.P. (2007) Automated Working Memory Assessment, UK: Pearson Assessment Alloway, T.P., (2009) 'Working Memory but Not IQ Predicts Subsequent Learning in children with Learning Difficulties' European Journal of Psychological Assessment 25, 2, pp. 92-98 Alloway, T.P., (2010), 'Brain Training' Nasen Special, May, pp.35-37, www.Nasen.org.uk Andrade, J., (2001) 'Concensus, controversy and future directions' in J. Andrade (Ed.) Working Memory in Perspective, UK: Psychology Press Atkinson, R. C., Shiffrin, R. M., (1968) 'Human Memory: A proposed system and control processes.' In K.W. Spence & J.D. Spence (Eds.) The Psychology of Learning and Motivation, Vol.2, (pp. 89-195), N.Y.: Academic Press Bacon, J.H. Rev. (1889) The Complete Guide To The Improvement Of The Memory, Isaac Pitman Baddeley, A., Hitch, G. (1974), 'Working Memory'. In G. A. Bower (Ed.), Recent Advances in Learning and Motivation, Vol.8, pp. 47-89, NY: Academic Press Baddeley, A., (1993) 'Working memory or working attention' in Attention: Selection, awareness and controll: A tribute to Donald Broadbent, UK: Oxford University Press Baddeley, A., (2000), 'The Episodic Buffer: A new component of Working Memory?' Trends in Cognitive Sciences, 4, 11, pp.417=423 23 - 31 533581322 Brian Apter – TopUpEdD, Student no. 0842733, 5/9/2011 Baddeley, A., (2001), 'Is Working Memory Still Working?)' European Psychologist, Vol.7, 2, June 2002, pp. 85-97 Baddeley, A. (2003) 'Working Memory: Looking Back And Looking Forward' Neuroscience 4, pp. 829-839 Baddeley, A., Eysenck, M.W., Anderson, M.C., (2009) Memory, UK: Psychology Press Bakalar, N. (2008) 'Memory Training Shown to Turn Up Brain Power' New York Times: Research, 29th April Ball, K., Berch, D., Helmers, K., Jobe, J., Leveck, M., Marsiske, M., Morris, J., Rebok, G., Smith, D., Tennestedt, S., Unverzagt, F., Willis, S. (2002) 'Effects of Cognitive Training Interventions' Journal of the American Medical Association, November, 13, Vol.288, 18, pp.2271-2279 Barrouillet, P., Bernadin, S., Camos, V. (2004) 'Time constraints and resource sharing in adults' working memory spans' Journal of Experimental Psychology: General, 133, pp. 83-100 Beaudoin, M., Desrichard, O. (2011) 'Are Memory Self-Efficacy and Memory Performance Related? A Meta-Analysis' Psychological Bulletin, 137, 2, pp. 211-241 Bermudez_Rattoni, F., Nunez-Jaramillo, L., Balderas, I., (2005) 'Neurobiology of Taste-recognition Memory' Chemical Senses, 30, 1, pp. 156-157 Buckley, S. (2008) 'It is time to take memory training seriously' Down Syndrome Research and Practice, 12, 2, pp. 105-106 Buzan, T., (1995) Use Your Memory, BBC Books 24 - 31 533581322 Brian Apter – TopUpEdD, Student no. 0842733, 5/9/2011 Buzan, T., (2009) The Memory Book: Boost your memory year after year, UK: BBC Active Callaway, E. (2010) 'Skills from the mind gym don't transfer', New Scientist, 24 April, p.10 Chase, W.G., Ericsson, K.A. (1982) 'Skill and working memory' in G.H. Bower (Ed.), The psychology of learning and motivation, 16, pp. 1-58, US: Academic Press Chein, J.M., Morrison, A.B. (2010) 'Expanding the mind's workspace: Training and transfer effects with a complex working memory span task' Psychonomic Bulletin & Review, 17, 2, pp. 193-199 Cogmed, (2009) 'Working Memory Training' (promotional brochure), www.cogmed.com Cohen, J.D., Peristein, W.M., Braver, T.S, Nystrom, L.E., Neil, D.C., Jonides, J., Smith, E.E. (1997) 'Temporal dynamics of brain activation during a working task' Nature, 386, 604-606 Cowan, N. (1997) 'The development of working memory', in N.Cowan (Ed.) The Development of Memory in Childhood, UK: Psychology Press Cowan, N., (1999) 'An embedded processes model of working memory', in A.M.P. Shah (Ed.) Models of Working Memory, UK: Cambridge University Press Cowan, N., (2001) 'The magical number 4 in short-term memory: a reconsideration of mental storage capacity' Behavioral and Brain Sciences, 24, pp. 87-185 25 - 31 533581322 Brian Apter – TopUpEdD, Student no. 0842733, 5/9/2011 Dougall, G.J. (2009) 'A Framework for Cognitive Interventions Targetting Everyday Memory Performance and Memory Self-Efficacy' Community Health, 32, 1s, pp. s15-s26 Engle, R.W., (1996) 'Working memory and retreival: An inhibition resource approach' in J.T.E Richardson, R.W. Engle, L. Hasher, R.H. Logie, E.R. Stoltfus, R.T.Zacks, (Eds.) Working Memory and Human Cognition, US: Oxford University Press Ericsson, K.A. (1985) 'Memory Skill' Canadian Journal of Psychology, 39, 2, pp. 188-231 Fairclough, S.H., Houston, M. (2004) 'A metabolic measure of mental effort' Biological Psychology, 66, pp. 177-190 Flynn, T., Storandt, M., (1990) 'Supplemental group discussions in memory training for older adults' Psychology and Aging, Vol.5 (2) pp.171-182 Foer, J., (2011) Moonwalking With Einstein: the Art and Science of Remembering Everything, UK: Allen Lane Gathercole, S.E., Brown, L., Pickering, S.J. (2003) 'Working memory assessments at school entry as longitudinal predictors of National Curriculum attainment levels' Educational and Child Psychology, 20, 109-122 Gathercole, S.E., Pickering, S.J., Ambridge, B., Wearing, H., (2004) 'The Structure of Working Memory From 4 to !5 Years of Age' Developmental Psychology, 40, 2, pp. 177-190 Gathercole, S.E. (2008) 'Working memory in the classroom' The Psychologist, 21:5, 382-385 Gould, S.J., (1981) The Mismeasure of Man, UK: Penguin 26 - 31 533581322 Brian Apter – TopUpEdD, Student no. 0842733, 5/9/2011 Henson, R., (2001) 'Neural working memory' in J. Andrade (Ed.) Working Memory in Perspective, UK: Psychology Press Holmes, J., Gathercole, S.E., Dunning, D.L., (2009a) 'Adaptive training leads to sustained enhancement of poor working memory in children', Developmental Science, 12, 4, pp. 9-15 Holmes, J., Gathercole, S.E., Place, M., Dunning, D.L., Hilton, K.A., Elliott, J.G., (2009b) 'Working memory deficits can be overcome. Impacts of training and medication on working memory in children with ADHD' Applied Cognitive Psychology, 24, 6, pp. 827-836 Hossiep, R., Hasella, M. (2010) BOMAT Standard, Standard Matrices Bochum, Gottingen: Hogrefe Jaeggi, S.M., Buschkuehl, M., Jonides, J., Perrig, W. (2008) 'Improving fluid intelligence with training on working memory' PNAS Early Edition, The National Academy of the Sciences of the USA, Feb. 2008 Johnson, B.E. (1976) What was that verse again? Memory improvement methods for the Christian worker, Mott Media Jonides J. (2004) 'How does practice make perfect?' Nature Neuroscience, 7, 1, pp.10-11 Klingberg, T., Forssberg, H., Westerberg, H., (2002) 'Training of Working Memory in Children With ADHD' Journal of Clinical and Experimental Neuropsychology, 22, 6, pp781-791 Klingberg, T., Fernell, E., Olesen, P.J., Johnson, M., Gustafson, P., Dahlstrom, K., Gillberg, C.G., Forssberg, H., Westerberg, H. (2005) 'Computerized Training of Working Memoy in Children With ADHD - A Randomized, Controlled Trial' Journal of the American Academy of Child and Adolescent Psychiatry, 44:2, 177-186 27 - 31 533581322 Brian Apter – TopUpEdD, Student no. 0842733, 5/9/2011 Klingberg, T., (2009) The Overflowing Brain, UK: Oxford Klingberg, T., (2010) 'Training and plasticity of working memory' Trends in Cogntive Sciences, 14, pp. 317-324 Leake, J., (2008) 'Memory Exam as Good as an IQ Test' Sunday Times, 16.8.2009 Loisette, A., (1896) Assimilative memory, or How to attend and never forget, USA, Funk and Wagnalls Co, Lorayne H, Lucas J., (1974) The Memory Book US: Stein and Day Lorayne H., Lucas J., (1986) The memory book: The classic guide to improving your memory at work, at school and at play, US: Ballantine Books Lovatt, P., Avons, S., (2001) 'Re-evaluating the word length effect', in J. Andrade (Ed.) Working Memory in Perspective, UK: Psychology Press May, J., (2001) 'Specifying the central executive may require complexity', in J. Andrade (Ed.) Working Memory in Perspective, UK: Psychology Press McNab, F., Varrone, A., Jucaite, A., Bystritsky, P., Forssberg, H., Klingberg, T., (2009) 'Changes in Cortical Dopamine D1 Receptor Binding Associated with Cognitive Training' Science, 323, Feb., pp. 800-802 McPherson, F. (2000) The Memory Key, Career Pree Memosyne Ltd. (2007) Jungle Memory, (on-line training www.junglememory.com 28 - 31 533581322 package), Brian Apter – TopUpEdD, Student no. 0842733, 5/9/2011 Miller, G.A. (1956) 'The magical number seven, plus or minus two: Some limits on our capacity for processing information', Psychological Review, 6, 3, pp. 81-97 Moody, D.E. (2009) 'Can intelligence be increased by training on a task of working memory?', Intelligence, 37, pp.327-328 Morrison, A.B., Chein, (2011) 'Does working memory training work? The promise and challenges of enhancing cognition by training working memory', Psychonomic Bulletin Review, 18, pp. 46-60 Newell, A., Simon, H.A., (1956) The Logic Theory Machine - A Complex Information Processiong System US: (Monograph) The Rand Corporation Oberauer, K., SuB H.-M., Schulze, R., Wilhem, O., Wittman, W.W. (2000) 'Working memory capacity - facets of a cognitive ability construct' Perssonality and Individual Differences 29, pp.1017-1045 Olesen, P.J., Westerberg, H., Klingberg, T., (2004) 'Increased prefrontal and parietal activity after training of working memory' Nature Neuroscience, 7, 1, pp. 75-79 Olson, I., Jiang, Y., Moore, K. (2005) 'Associative Learning Improves Visual Working Memory Performance' Journal of Experimental Psychology: Human Perception and Performance, 31, 5, pp.889-900 Owen, A.M, Hampshire, A., Grahn, J.A., Stenton, R., Dajani, S., Burns, A.S., Howard, R.J., Ballard, C.G., (2010) 'Putting brain training to the test' Nature, 465, pp. 775-778 Pearson, D.G. (2001) 'Imagery and the visuo-spatial scratchpad' in J. Andrade (Ed.) Working Memory in Perspective, UK: Psychology Press 29 - 31 533581322 Brian Apter – TopUpEdD, Student no. 0842733, 5/9/2011 Pickering, S.J., Gathercole, S.E. (2001) Working Memory Test Battery for Children, UK: Harcourt Assessment Redick, T.S., Calvo, A., Gay, C.E., Engle, R.W. (2011) 'Working Memory Capacity and Go/No-Go Task Performance: Selective Effects of Updating, Maintenance and Inhibition', Journal of Experimental Psychology, 37, 2, pp. 308-324 Shannon, C.E., (1949) The Mathematical Theory of Communication. US: University of Illinois Press Shipstead, Z., Redick, T.S., Engle, R.W., (2010) 'Does Working Memory Generalize?' Psychologica Belgica, 50, 3&4, pp. 245-276 Smith, E.E., Jonides, J. (1997) 'Working Memory: A View from Neuroimaging', Cognitive Psychology, 33, pp. 5-42 Smyth, M.M., Pearson, N.A., Pendleton, L.R. (1988) 'Movement and working memory: Patterns and positions in space' The Quarterly Journal of Experimental Psychology Section A: Human Experimental Psychology, 40, 3, pp. 497-514 Stine, J.M. (1997) Double your brain power: increase your memory by using all of your brain all of the time, USA, Prentice-Hall Sullivan, K.A., Madden, I. (2008) 'A pilot investigation of the effectiveness of a memory improvement program on subjective and objective memory in healthy young adults: directions for future research' Neuro Rehabilitation (in press) Ward, G. (2001) 'A critique of the WM model' in J. Andrade (Ed.) Working Memory in Perspective, UK: Psychology Press Ward, J., (2010) The Student's Guide to Cognitive Neuroscience, UK: Psychology Press -Taylor and Francis 30 - 31 533581322 Brian Apter – TopUpEdD, Student no. 0842733, 5/9/2011 White, T.L. (1998) 'Olfactory Memory: the Long and Short of it' Chemical Senses, 23, pp. 433-441 Willis, S., Tennstedt, S., Marsiske, M., Ball, K., Ellias, J., Koepke, K., Morris, J., Rebok, G., Unversagt, F., Stoddard, A., Wright, E. (2006) 'Long-term Effects of Cognitive Training on Everyday Functional Outcomes in Older Adults' Journal of the American Medical Association, December, 20, Vol.296, 23 pp.2805-2814 Young, M. N., Gibson, W., (1970) How to Develop an Exceptional Memory, UK: Wiltshire Book Company 31 - 31 533581322