Chapter 3 Recall Performance in Air Traffic Controllers Across the 24-hr Day: Influence of Alertness and Task Demands on Recall Strategies Claudine Mélan and Edith Galy Additional information is available at the end of the chapter http://dx.doi.org/10.5772/50342 1. Introduction Air traffic controllers’ (ATCs') work evolves constantly, concerning in particular route complexity and traffic density, but also development of supporting technology. Introducing more automation to allow more efficient ATC control and increased safety and security also requires enhanced supervisory activity, situation awareness, processing of larger amounts of data. These cognitive processes place a heavy load on ATCs’ memory functions as they require item processing and recall, which are also involved in control operations such as monitoring traffic, controlling aircraft movements, managing air traffic sequences, resolving conflicts. Better understanding of memory processes and of their limitations in expert ATCs may thus be crucial for the development of future automation tools, but also for training and selection of controllers. The aim of the present contribution is to give a comprehensive overview of memorisation performance in air traffic controllers, in light of the most recent memory models. More especially, a series of experiments reveal that ATCs’ memorisation performance varies in a complex manner according to both task-related factors (presentation modality, number of items, recall protocol), and task-independent factors. The latter are related more especially to shift-scheduling (time-of-day, on-shift time) and physiological capacities (alertness, automatic item processing). 2. ATCs’ performance variations according to task-related factors 2.1. Information processing during control operations En route ATC involves the processing of information relative to a variable number of aircrafts coming from different directions, at diverse speed and altitudes, and heading to © 2012 Mélan and Galy, licensee InTech. This is an open access chapter distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/3.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. 36 Advances in Air Navigation Services various destinations or that are, on contrary, grouped in a more restricted space, thus requiring more in-depth processing in order to anticipate air-plane conflicts. Presentation modality is of interest as information about an aircraft is presented visually on a strip or script 10 to 15 min before its real-time presentation in the visual modality (radar information) or in the auditory modality (radio information). Radar information includes instantaneous level, attitude (stable, climbing, descending) and speed group, and strips present many information as aircraft call sign, aircraft type and associated speed (or power), provenance and destination, route case (estimated hours of flying), and three cases completed by ATCs with information concerning coordination information with other ATCs, or changes requested in flight. A number of simulation studies and in situ ATC observations explored the way such factors may impact on memory performance. Thus, expert ATCs show high recall performance of aircrafts and their position on a sector map, and poorer recollection of details regarding an aircraft (Means et al., 1988). Higher recognition accuracy for aircrafts involved in an impending conflict compared to those that would not cross or cross in some near future confirmed the impact of aircraft status on memory performance (Gronlund et al., 1998, 2005). Simulation studies revealed higher recall when navigational messages were presented in the auditory rather than in the visual modality. In addition, performance dropped considerably when message length increased beyond three commands, while command wordiness (2 or 4 words) had only limited effects on recall (Wickens & Hollands, 2000; Barshi & Healy, 2002; Schneider et al., 2004). 2.2. Information processing according to presentation modality: The auditory superiority effect Controlled laboratory studies have systematically explored task-related factors that may affect mnemonic performance and have led to the proposal of integrated theoretical models. More especially, encoding and processing of auditory compared to visual verbal material has systematically revealed superior recall of heard material in short-term memory (for a review, Penney, 1989). A common test in this research field contrasts silent reading and reading aloud of unrelated lists of words, nonwords, letters, or digits (see, e.g., Conrad & Hull, 1968; Frankish, 1985). It is assumed that both silent reading and reading aloud provide phonological information and that only reading aloud provides acoustic–sensory information. This effect was found for the recency part of the serial position curve in immediate free recall and in serial recall. Overt vocalization of a visually presented list by the subject produced much the same effect as did auditory presentation on the recency part of the serial position curve, but subject vocalization tended to reduce recall in the non recency part of the serial position curve. The modality effect has been observed with both written and oral recall, but seems to be slightly more marked in the former case. This auditory superiority effect, known as the modality effect, was accounted for by modalityrelated processing differences at different stages of the memorisation process, rather than by strategic differences. Recall Performance in Air Traffic Controllers Across the 24-hr Day: Influence of Alertness and Task Demands on Recall Strategies 37 2.2.1. Differences during processing of auditory and visually presented material Several authors suggested that a long-lasting sensory acoustic trace would be generated for auditory presented words but not for visually presented words (Cowan, 1984; Crowder & Morton, 1969; Crowder et al., 2004; Penney, 1989). The term acoustic–sensory information refers to sensory representations of sounds. Though there is some evidence of a sensory visual trace for seen words, it would be very short-lived compared to the long-lasting sensory acoustic trace that would favour more efficient encoding of heard material. In addition, orally presented list-items would be associated with temporal cues that would not be generated by successively presented visual words. These temporal cues would then result in stronger memory traces and ensure higher recall for heard items (Frankish, 1985, 2008). Other authors argued that the differences between the visual and the auditory information processing streams would occur when the sensory trace is processed into a short term memory trace. The working memory model (Baddeley & Hitch, 1974) includes a dedicated phonological subsystem, in which the code used to represent verbal items broadly corresponds to the phonetic level. Hence, auditory information would benefit from automatic phonological coding while visual information would require effortful phonological recoding (Baddeley, 1986, 2000; Penney, 1989). Phonological coding would favour mental rehearsal and maintenance of information in a short-term store (Baddeley, 1986), what would result in a larger number of phonologically coded memory traces in a short-term store following hearing than following seeing item-lists. According to Penney (1989) the auditory superiority would be based on the combination of a longer-lasting sensory acoustic trace and automatic phonological coding of orally presented materiel. 2.2.2. Differences during restitution of heard and seen item lists Differences during item recall were also proposed to account for better immediate recall of heard than of seen materiel. This research is based in particular on the robust finding that when participants recall a sequence of spoken digits the last one is almost always correctly recalled, but if the same sequence is presented visually, recall of the final item is relatively poor. According to Crowder and Morton (1969), this auditory recency effect indicates that an acoustically coded representation of the final list item is maintained in a sensory store, while representations of earlier items are overwritten by successively incoming speech sounds. Alternatively, Cowan and co-workers accounted for the recency effect by suggesting greater resistance to output interference for heard compared to seen verbal material (Cowan et al., 2002; Harveay & Beaman, 2007; Madigan, 1971). Output interference is defined as the degradation of memory representations as recall proceeds across output positions. Evidence in favour of a greater resistance to interference for heard items came from studies reporting a marked auditory superiority when restitution was based on a free recall procedure (without providing any cues) and a reduced effect when a recognition procedure was used (list items are presented together with new items). Item recognition may be explained by an impression of familiarity for the list-items and would thus not require in-depth processing. 38 Advances in Air Navigation Services In contrast, free recall requires subjects to explicitly recall each item, thereby degrading the remaining memory traces (Brébion et al., 2005). Lower output interference has also been proposed to account for the auditory advantage of sentence recall (Rummer & Schweppe, 2005). In line with this hypothesis, Beaman and Morton (2000) showed that following presentation of 16-item lists, subjects preferentially recalled 2-, 3- and 4-item sub-sequences (of the form 15-16, 14-15-16, 13-14-15-16) from the end of the lists. However, while end sub-sequences were recalled with a similar frequency in both modalities on the opening run of a trial, they were recalled significantly more often for heard than for seen items during the course of a trial. 2.3. Auditory superiority for heard versus seen item-lists in ATCs In light of these findings we explored whether output interference while recalling seen items may be reduced in participants well-practiced in processing visual information, i.e. ATCs habitually processing visual information on a radar. In addition we tested to what extent the effect may be explained by memory load, typically explored by presenting a list of items of variable length. Previous research with this kind of procedure has shown that the amount of proactive interference is much less for smaller set sizes (Oberauer & Vockenberg, 2009) although there can be some proactive interference even at small set sizes (Carroll et al., 2010). We used the procedure described by Beaman and Morton (2000) to explore free recall of heard versus seen 6- and 9-item lists in 15 volunteer ATCs of an en-route centre in southern France. Participants were aged 31.3 years (range: 27 to 42 years old) and had been working for 7 years and 4 months (range: 3 to18 years) in the control centre. The sub-sequences recalled by ATCs at initial and non-initial output positions are summarized in table 1. Analyses revealed significant higher mean numbers of items recalled following hearing (4.9 and 3.6 respectively for 6- and 9- item lists) than seeing the lists (4.2 and 3.2 respectively). Visual Terminal item sequences 6 5, 6 4, 5, 6 3, 4, 5, 6 2, 3, 4, 5, 6 1, 2, 3, 4, 5, 6 Terminal item sequences 9 8, 9 7, 8, 9 6, 7, 8, 9 5, 6, 7, 8, 9 4, 5, 6, 7, 8, 9 Auditory 6-word lists 13 13 12 3 7 10 7 17 12 2 2 27 9-word lists 24 22 7 3 0 1 20 18 14 4 3 1 Recall Performance in Air Traffic Controllers Across the 24-hr Day: Influence of Alertness and Task Demands on Recall Strategies 39 Visual Terminal item sequences 5, 6 4, 5, 6 3, 4, 5, 6 Terminal item sequences 8, 9 7, 8, 9 6, 7, 8, 9 Auditory 6-word lists 16 3 1 34 13 2 9-word lists 14 1 1 30 4 2 Table 1. Number of each of the terminal item sequences as the opening run (upper panel) and in noninitial response positions (lower panel) during free recall of 6- and 9-word lists with auditory and visual presentation (Galy et al., 2010). As shown in table 1, ATCs recalled complete 6-item lists three times more frequently following auditory (27) than following visual list (10) presentation, while recall of five-item sub-sequences (2-3-4-5-6) was rare in both modalities (2 vs. 7 respectively). These results further indicate that occurrences for heard lists were tenfold more frequent for complete sixitem lists than for five-item sub-sequences, while no such difference occurred for seen lists. Occurrences of equivalent end sub-sequences of 9-item lists (5-6-7-8-9; 4-5-6-7-8-9) ranged between zero and three in both modalities. The auditory recall advantage of these lists appeared to result from higher occurrences of ordered 2- and 3-item end sub-sequences in other than initial recall positions. Taken together, the findings show that ATCs would spontaneously adopt the output strategy consisting of uttering end sub-sequences more frequently for heard than for seen items, leading to, or contributing to significant higher overall performance. They thus further stress the proposal that “auditory presentation seems to protect the end of the list from output interference” (Cowan et al., 2002, p.168). In favour of this hypothesis, these authors showed that the auditory advantage is even more pronounced when output interference is high. Alternatively it has been proposed that the auditory advantage that extends over the last few serial positions is retrieved independently for each item from an echoic trace (Frankish, 2008). According to this author, pronounced recency in immediate serial recall is limited to stimuli that engage the perceptual mechanism involved in linguistic decoding of speech. Further research intended to disentangle different sources of sensory information at input. Thus, Rummer and Schweppe (2005) observed a modality effect for spoken sentences compared to conditions without acoustic–sensory information, i.e., both silent reading and mouthing. As the latter two conditions did not differ from each other, the results would rule out articulatory information at input as a source of the modality effect. Differences due to output modality were also investigated. For written recall the auditory advantage was larger with high than with low output interference, while this difference was not maintained for spoken recall (Harvey & Beaman, 2007). Taken together, the data suggest that both superior auditory encoding and reduced output interference would contribute to the auditory modality effect. 40 Advances in Air Navigation Services As ATCs are well-practiced in processing successively presented visual information, on contrary to participants in the above-cited laboratory experiments, the present findings favour the idea that differential physiological features may characterize the visual and auditory information processing streams (Penney, 1989). The modality effect may then be implemented in the current models of spoken and of written words, which are divided on the relation between the different levels of processing, which will not be discussed in this issue. Briefly, in some models the transmission of information through successive levels of representation is represented as a unidirectional flow within a feed forward network. Perceptual analysis begins with encoding of acoustic features, which are then translated into phonetic and then lexical representations. In contrast, interactive activation models propose that communication between these levels is bidirectional. Whenever a lexical unit becomes active, feedback connections boost activation of the units that represent its constituent phonemes (for a review, Frankish, 2008). 3. Shift-scheduling and ATCs’ functional state Like in other safety-related job situations, ATC requires operators to work successive shifts; i.e. different teams work in succession to cover the whole 24h-day. As a consequence, controllers are subjected to the negative impact of shift work on biological rhythms, sleep, job performance, and psychological measures (Costa, 1999; Della Rocco & Nesthus, 2005; Dinges et al., 1997; Folkard & Tucker, 2003). 3.1. Regulation mechanisms of circadian variations It is now largely accepted that the negative effects of shift work result from a disruption of the habitual circadian regulation of physiological and psychological measures (Costa, 2003; Siegrist, 2010). Circadian variations across the 24h-day are under control of two endogenous systems, the homeostatic system expressed by the fatigue accumulating since awakening, and the circadian system evidenced by a sinusoidal variation across the 24h period. Hence, shift work is systematically associated with a cumulative sleep deficit (homeostatic system), and a decreased amplitude of sinusoidal variations (circadian system), thereby interfering with the two powerful factors limiting human ability and, as a consequence, safety and security (Akerstedt, 1991; Akerstedt et al., 2004; Dinges et al., 1997; Folkard & Akerstedt, 1992; Tucker et al., 2006). As stated by Akerstedt (2007, p. 209) “Being exposed to the circadian low (during work/activity), extended time awake or reduced duration of sleep will impair performance”. 3.2. Circadian and non circadian variations of subjective and physiological measures in shift-workers In order to investigate a person’s functional state, behavioural, physiological or subjective measures have been used. It is generally accepted that these measures are subjected to a circadian rhythmicity. Shift work effects have mostly been documented by reporting decreased self-rated alertness (Akerstedt & Gillberg, 1990; Galy et al., 2008) and increased Recall Performance in Air Traffic Controllers Across the 24-hr Day: Influence of Alertness and Task Demands on Recall Strategies 41 occurrences of incidents on the night shift when the circadian decline in human capabilities is further aggravated by a chronic sleep deficit and fatigue (Costa, 2003; Folkard & Akersted, 2003). Laboratory studies have established that alertness is low in the morning, increases during the day until the late afternoon, before decreasing in the evening and reach a minimal level on early morning hours. The shift work literature revealed that in real-job situations alertness also varies with time of day and that the typical diurnal trend would only be marginally modified by shift work scheduling features. However, early morning shifts, extended shift duration and repeated night shifts have been shown to be associated with increased sleepiness, more especially during the last half of extended shifts, particularly on night shifts (Kecklund et al., 1997; Rosa, 1995), but also on day shifts (Tucker et al., 1998). Circadian variations appear to be less consistent for other psychological measures recorded in several shift work studies, and in particular for self-reported tension (Folkard, 1990; Kecklund et al., 1997; Monk et al., 1985; Owens et al., 2000 ; Prizmic et al., 1995). While some studies reported a circadian trend for perceived tension, others did not, and still others reported an atypical trend. More especially, operators supervising a satellite across 24h-day displayed significant increased self-rated tension and heart rate on the first hour of each shift, even on the night-shift, despite a lower baseline level for heart rate during the night (Cariou et al., 2008). In contrast, when the same satellite controllers rated Thayer’s (1989) Activation-Deactivation checklist, their alertness level was highly correlated with their body temperature (Fig. 1), largely considered as an index of subjects’ functional state. Both measures followed a typical circadian trend, indicating a strong dependency of these measures on the endogenous regulation systems. Taken together with the shift-work literature, these results indicate that some subjective and objective measures (here alertness and body temperature) show a strong dependency on the endogenous regulation systems, as they display a circadian trend in different shiftwork conditions, like in controlled laboratory conditions, despite minor variations in this trend by external factors. This then implies that working during the circadian trough requires an additional effort as operators’ functional state is at its lowest level. Most interestingly, other measures (here subjective tension and heart rate), which are known to display a circadian trend in controlled laboratory conditions, are much more influenced by external factors, so that the trends may vary considerably between situations (or jobsituations). Andorre and Queinnec (1998) reported a significant increase on the first shifthour for real-job performance (pages checked on a computer-screen) in operators controlling a chemical production process. In both studies the atypical trend was interpreted as indicating enhanced cognitive demands following shift take-over in jobsituations concerned with supervisory control of a dynamic process. Thus, in shift-work conditions, some psychological and physiological measures, and in particular those that are and other stress-sensitive, would be largely influenced by environmental factors, including meal-timing, task demands, time-pressure and so on, which may mask the otherwise circadian trend of these measures (Averty et al., 2004; Brookings et al., 1996; Khaleque, 1984; Rose et al., 1982). 42 Advances in Air Navigation Services 3,5 2,5 1,5 6h 23 h 2h 30 21 h 18 h 15 h 13 h 8h 10 h3 0 0,5 Figure 1. Upper panel: Mean (+/-S.E.) alertness level on 3 occasions within each of three shifts (1h following shift-start, middle, and 1h before shift-end). Lower panel: Mean (+/-S.E.) sublingual temperature on the same recordings (Cariou et al., 2008). 3.3. Circadian variations of subjective measures in ATCs In light of the inconsistencies of the findings in the literature concerning other subjective measures than alertness, we investigated whether ATCs displayed typical circadian trends for subjective measures and whether on-shift time would modulate these measures. In this job-situation, traffic density variations across the 24h-day determine, partly at least, shift schedules that include in particular overlapping shifts and variable shift-duration. Shift 06:30 -14:00 07:00 - 17:30 09:00 - 20:00 11:00 - 20:00 15:30 - 23:00 20:00 - 07:00 01:00 Time of recording 07:00 13:00 0h30 6h30 0h00 6h00 4h00 2h00 19:00 10h00 8h00 3h30 5h00 Table 2. Time on duty of controllers on each of six shifts at the time each recording was performed (Mélan et al., 2007). Recall Performance in Air Traffic Controllers Across the 24-hr Day: Influence of Alertness and Task Demands on Recall Strategies 43 Therefore, 15 volunteer ATCs were asked to rate Thayer’s (1989) checklist on 01:00, 07:00, 13:00, 19:00 by indicating whether they were on shift for four hours at most or for six hours at least (table 2). Statistical analyses revealed significant time-of-day and time-on-duty effects for both measures. ATCs rated alertness at a lower level at 01:00 and 07:00 than at 13:00 and 19:00 and tension at 07:00 compared to 01:00, 13:00 and 19:00. However, while selfrated tension was higher following long on-shift time, the opposite pattern was observed for self-rated alertness. In other words, when controllers started day-duty they experienced high alertness and low tension, whereas they reported decreased alertness and higher subjective tension after several hours on duty. Index of Subjective Alertness 3 2,8 2,6 2,4 2,2 < 4 hours 2 > 6 hours 1,8 1,6 1,4 1,2 1 13:00 19:00 Index of Subjective Tension 8 7,5 7 < 4 hours 6,5 > 6 hours 6 5,5 5 13:00 19:00 Figure 2. Mean (+/-SE) subjective alertness (upper pannel) and tension (lower pannel) in ATCs as a function of recording time (Mélan et al., 2007). These data favour the interpretation that lower alertness reported by 12-h workers compared to 8-h workers on the early afternoon resulted from the fact that the former were on the second half of duty while the latter started their afternoon-duty (Tucker et al., 1998). Reduced day time alertness was observed on shifts starting late in the morning, though controllers had probably sufficient sleep on the night prior the shift. This raises the 44 Advances in Air Navigation Services possibility that the chronic sleep deficit observed in shift-workers may, partly, account for decreased day-time alertness. Further, both measures were negatively correlated, indicating that the lower ATCs quoted alertness, the higher they quoted tension. The data thus extend the findings of a circadian variation of subjective measures in ATCs and they favour the interpretation that in stressrelated job-situations enhanced tension may compensate for decreased alertness (Thayer, 1989), thereby enabling the maintenance of safety. Further investigations will however be necessary to establish firmly whether ATCs’ tension-ratings indicate a direct influence by environmental factors (i.e. hours at work, heavy traffic), or whether the observed variations are merely the consequence of their functional state, as indicated by the negative correlation between tension and alertness. Thus, air traffic control activities differ indeed between day- and night-work, as high traffic on day-time involves sustained periods of high task requirements and attentional demands, whereas low traffic during the night would favor boredom proneness and sleepiness (Costa, 1999; Lille & Cheliout, 1982; Luna et al., 1997). In recent years, most studies exploring the impact of shift work on health and well-being have reported troubles in psychological and social well-being, performance efficiency and increased stress levels (Costa, 2003). Some of these issues will be highlighted in the next section by exploring the relationship between ATCs’ physiological state and their performance efficiency during short-term recall of verbal material. 4. Complex interactions between task-related factors and ATCs’ functional state The shift-work literature shows that psychological measures differ not only according to time of day but also according to task characteristics, with high performance for tasks requiring rather automatic processing such as short-term memory task when alertness is low (in the morning), and high performance in more demanding tasks, relying for instance on long-term memory processing when alertness is high (in the evening). Laboratory studies reported indeed higher immediate recall in short-term memory tasks in the morning and enhanced delayed recall from long-term memory in the evening (Folkard, 1979; Folkard et al., 1976; Folkard & Monk, 1980; Monk & Embrey, 1981). Further, recall performance was reported to be higher in the morning when a recognition procedure was used, and in the afternoon when participants had to recall the text with a more demanding free recall procedure (Lorenzetti & Natale, 1996; Oakhill & Davies, 1989). Free recall would be cognitively more demanding as it involves an active search of memory traces in the absence of any cues, while item recognition would rely on less demanding item familiarity (Brébion et al., 2005; Mandler, 1980; Prince et al., 2005). In light of the findings of the literature, it was important to investigate whether and to what extent the above-reported modality effect may be sensitive to alertness variations, but also to the cognitive effort required to remember the verbal material (Mélan, et al., 2007). ATCs’ recall performance was recorded on different times of the day (01:00, 07:00, 13:00 and 19:00) Recall Performance in Air Traffic Controllers Across the 24-hr Day: Influence of Alertness and Task Demands on Recall Strategies 45 while varying item modality (auditory or visual) during encoding and restitution, list-length (6- and 9-item lists) and restitution processes (recognition and free recall). 6 items auditory 3,8 9 items auditory Correct responses 3,6 6 items visual 9 items visual 3,4 3,2 3 2,8 2,6 2,4 01:00 07:00 13:00 19:00 6 items auditory 0,9 6 items visual Correct probability 0,85 9 items auditory 0,8 9 items visual 0,75 0,7 0,65 0,6 0,55 0,5 0,45 0,4 01:00 07:00 13:00 19:00 Figure 3. Mean number of correct responses in a probe recognition task (upper panel) and in a free recall task (lower panel) on each of four recordings according to the number of items presented (6- vs. 9item lists) and presentation modality (auditory vs. visual; Mélan, et al., 2007). Overall, ATCs’ performance was lowest on 07:00 compared to 13:00 and 19:00, in particular for visual items, for the longer lists and in the free recall task (Fig.3). In consequence, when the tasks involved more demanding processing performance was decreased particularly when alertness was low. Interestingly, significant main effects occurred for time-of-day, listlength and modality with the free recall procedure, while the three variables interacted when restitution was based on a recognition procedure. In that case, performance dropped in the early morning only for visual 9-item lists, i.e. in the more demanding task conditions. In the literature, differential time-of-day effects on participants' recall performance in recognition and free recall tasks were accounted for by similar processing differences (Folkard, 1979; Folkard, et al., 1976; Folkard & Monk, 1980; Lorenzetti & Natale, 1996; Oakhill & Davies, 1989). Accordingly, the finding of an overall effect on free recall but not on recognition performance may indicate that external factors (time of day) more readily 46 Advances in Air Navigation Services impacted on ATCs’ task performance when deeper processing was required to solve a task. As indicated above, item recognition requires less in-depth processing of the to-beremembered material than free recall (Brébion et al., 2005; Mandler, 1980; Prince et al., 2005). Thus, task-dependent factors (modality, list-length and recall procedure in the present case) even further impact on ATCs’ performance when their functional state is low. 5. Discussion The main finding of the present contribution is that ATCs’ performance depends in a complex manner from the task to be performed, but also from job organisation (shift schedules, shift-duration) and from physiological aspects (alertness, sensory and cognitive processing). Even though it is difficult to generalize between different job-situations, given in particular differences between activities, to-be-performed tasks and shift-scheduling, the data confirm findings reported in other safety-related job-situations for security agents in a nuclear power plant and for operators controlling satellites (Costa, 1999; Cariou et al., 2008; Galy et al., 2008). Working during the night causes a mismatch between the endogenous circadian timing system and the environmental synchronizers (the light/dark cycle in particular), with consequent disturbances of the normal circadian rhythms of psychophysiological functions, beginning with the sleep/wake rhythm, and thus operators’ alertness. In addition to the disruptive effects of shift work on performance efficiency, its impact on health and well-being are now well-documented (Costa, 2003; Siegrist, 2010). In this respect, some international directives have recently stressed the need for the careful organization of shift and night work and the protection of shift workers’ health. Elsewhere, the present findings favour the idea of a more general model to account for the complex interactions reported so far. In this regard, we recently extended Sweller’s cognitive load theory elaborated in the educational field (Sweller, 1988; 1994), to a real-job situation (Galy et al., 2012). 5.1. Towards an integrated model of mental load during ATC? Sweller defined three categories of cognitive load in order to embrace the complexities of a given task, the conditions in which it is performed, and subject-related variables. “Intrinsic cognitive load” refers to the load induced by the material to be processed, such as task difficulty that is defined in particular by the number of items to be processed, and by item interactivity (Ayres, 2006; Kalyuga et al., 2003; Sweller & Chandler, 1994). “Extraneous mental workload” refers to the load induced by external factors, including work situation, work organization, time pressure, and noise (Sweller, 1994). Finally, “germane mental workload” corresponds to the load induced by conscious application of strategies to solve tasks more easily (Schnotz & Kürschner, 2007). We showed an additive effect of intrinsic load (task difficulty) and extrinsic load (time pressure) factors, and that this effect was only observed in the morning. In other words, when participants performed a difficult task under high time pressure in the morning, when alertness and thus available mental resources were low, they probably had to use specific strategies generating germane load. This sequence of Recall Performance in Air Traffic Controllers Across the 24-hr Day: Influence of Alertness and Task Demands on Recall Strategies 47 events would have led to decreased performance in the morning, while no such effect was observed in the afternoon, when alertness and thus available mental resources were high. Figure 4. Graphic representation of putative relationships between cognitive load factors and cognitive load categories (Galy et al., 2012). This model, summarized in figure 4, further indicates that the different cognitive load measures used in the study, i.e. subjective measures (self-rated effort), behavioural measures (correct responses) and psychophysiological measures (heart rate variability) display a differential sensitivity to the three kinds of load factors investigated. More especially, heart rate variability increased with germane load, operationalized by high self-reported 48 Advances in Air Navigation Services alertness, whereas participants’ self-rated mental effort was sensitive to both extrinsic and intrinsic load and task performance was determined both by alertness and by an interaction between task difficulty and time pressure. The latter results stress the difficulties encountered in order to identify a reliable measure of cognitive load on one hand (Backs & Seljos, 1994; Brookings et al., 1996; Carroll et al., 1986), and suggest that it may be hazardous to generalize the proposed model to other situations, on the other hand. With these limitations in mind, it may nevertheless be challenging to test the mental load model in ATCs, given that the findings reported in the previous sections indicate how work organization (shift schedules, shift-duration) affected alertness (germane mental load), and that when ATCs’ alertness was low, their mnemonic performance was lower in the demanding task conditions (intrinsic mental load). Further, as conflicts between aircrafts require ATCs to make the right decisions under high time pressure and to give ground-toair instructions in a limited time, it seems indeed worthwhile to include this extrinsic load factor to a more integrative approach of mental load generated during ATC activities. 5.2. Experimental designs to explore ATC activities Experimental paradigms like the ones used in the studies reported in this contribution may be regarded as simplified models of real-life activities. As such, the results reported may be of interest for ATC activities involving similar cognitive processes than those explored in the experimental paradigms. This is in particular the case for task-related factors, as the influence of such factors may only be demonstrated in controlled study conditions. In this regard, experimental approaches are complementary to in situ observations, which point to the relevant aspects to be explored more systematically by using experimental designs. Further, the observations reported here were performed while ATCs were in their habitual work environment and work conditions. In contrast, in a number of field studies subjective data across the 24h-day are collected retrospectively, i.e. participants are asked to rate these measures on a single session by remembering what they perceived for instance during the night or during the morning shift. In contrast, subjective and performance measures reported in the present contribution were collected in real-time fashion, in order to gain some insight into ATCs’ cognitive abilities in real-job conditions. This is particularly important when investigating job-activities performed on a continuous 24h-day, like ATC. The data reported here clearly show that shift-work features (time-of-day and time-on-shift) are indeed critical factors that impact not only on operators’ functional state, but also on a number of psychological measures. ATCs’ information processing ability is crucial for the safety of the air traffic management system as well as for the sector capacity of a given complexity in a particular time driving the overall system performances. The present findings may be relevant to ensure productivity and/or safety in job-situations involving supervisory control, and in particular ATC, all relying on processing visual and auditory information from various sources on control panels and interfaces. The present findings suggest that short sequences of auditory information would less readily tax controller’s processing capacities than longer sequences and/or visual material. As stated by Recall Performance in Air Traffic Controllers Across the 24-hr Day: Influence of Alertness and Task Demands on Recall Strategies 49 Frankish (2008), all models of speech perception incorporate some form of auditory short term memory, because speech comprehension requires the integration of information from successive elements. The findings reported here may thus be useful for various control operations and in particular during conflict resolution, when controllers’ memory span may be more readily taxed. As shown by several studies, short-term recall of navigational messages decreases when message length increases beyond three commands (Wickens & Hollands, 2000; Barshi & Healy, 2002; Schneider et al., 2004). Taken together with several other studies, the present results may also be useful for ATC selection and training, as they stress the importance of using tests that manipulate, in addition to the more traditional quantitative aspects of memory, more qualitative parameters, such as presentation modality or information type and aircraft status (Gronlund et al., 2005; Means et al., 1988). ATC, like several other safety-related job-activities rely preferentially on visual interfaces, most probably because graphical representations enhance the understanding of complex principles or spatial relations, for instance flight direction, speed and other information that an operator needs to synthetize in order to solve conflicting situations for instance. Within the auditory stream, successive items are strongly associated; in contrast, in the visual modality, it is simultaneously presented items that are strongly associated (Penney, 1989). Speech, with its linear progression through time does not bear these properties. In addition, sound and speech generate considerable noise when compared to silent reading of messages or integration of graphical representations. However, for precisely the same reason, i.e. the disturbance induced by auditory information, this modality is typically used for alarm devices, as one cannot avoid an auditory signal. Indeed, the physical nature of sounds, i.e. waves that cross space in all directions, ensures that this kind of information automatically reaches and stimulates the auditory receptors and is transferred thereafter to the auditory cortex. There is thus a pretty good chance for heard messages or signals to be processed, even without paying attention to one’s environment or when a subject’s motivation or alertness are decreased for some reason. Furthermore, in addition to a specific activation of the auditory system, sounds also induce a non-specific activation of the nervous system, both the autonomous nervous system as evidenced for instance by increased heart-rate, and the central nervous system, as indicated by enhanced arousal. On contrary, written messages may be processed by the visual system only once a subject has oriented his/her gaze on the specific location where the message has occurred. Thus, unless the operator turns his/her attention to a particular location on a radar screen, he/she will not be able to appreciate whether for instance some airplane may be in a difficult position. Research concerning participant’s focus of attention that would reflect conscious awareness and its relation to visual working memory tasks have been reviewed recently (Cowan, 2011). In light of these considerations it appears that supervisory control greatly benefits from a well-weighted combination of visual representations of complex multi-dimensional data and auditory presentation of essential information which have to be maintained in a shortterm memory for problem resolution. 50 Advances in Air Navigation Services Author details Claudine Mélan Shift-work and Cognition Laboratory, Toulouse University, France Edith Galy Research Centre in the Psychology of Cognition, Language, and Emotion, Aix-Marseille University, France 6. References Akerstedt, T. (1991). Sleepiness at work: Effect of irregular work hours. In: Sleep, sleepiness and performance, T. Monk, (Ed.), 129-152, John Wiley & Sons ltd, Akerstedt, T. (2007). Altered sleep/wake patterns and mental performance. Physiology and Behavior, Vol.90, No.2-3, pp. 209-18 Akerstedt T, Folkard S. & Fortin C. (2004). Predictions from the three-process model of alertness. Aviation Space and Environmental Medicine, Vol.75, pp.75-83 Akerstedt, T. & Gillberg, M. (1990). Subjective and objective sleepiness in the active individual. International Journal of Neuroscience, Vol.52, pp. 29-37 Andorre, V. & Quéinnec, Y. (1998). Changes in supervisory activity of a continuous process during night and day shifts. International Journal of Industrial Ergonomics, Vol.21, pp. 179186 Averty, P., Collet, C., Dittmar, A., Athenes, S. & Vernet-Maury E. (2004). Mental workload in air traffic control: an index constructed from field tests. Aviation Space and Environmental Medicine, Vol.75, pp. 333-341 Ayres, P. (2006). Using subjective measures to detect variations of intrinsic cognitive load within problems. Learning and Instruction, Vol.16, pp. 389–400 Backs, R.W. & Seljos, K.A. (1994). Metabolic and cardio-respiratory of mental effort: the effects of level of difficulty in a working memory task. International Journal of Psychophysiology, Vol.16, pp. 57-69 Baddeley, A. D. (1986). Working memory. Oxford: Oxford University Press, UK Baddeley, A. D. (2000). The episodic buffer: a new component of working memory? Trends in Cognitive Science, Vol.4, No.11, pp. 417–423 Baddeley, A. D. & Hitch, G. (1974). Working memory. In: The Psychology of Learning and Motivation, G.A. Bower, (Ed.), 48–79, Academic Press Brookings, J.B, Wilson, G.F. & Swain, C.R. (1996). Psychophysiological responses to changes in workload during simulated air traffic control. Biological Psychology, Vol.42, pp. 361377 Beaman, C.P. & Morton, J. (2000). The separate but related origins of the recency effect and the modality effect in free recall. Cognition, Vol.77, 59-65 Barshi, I. & Healy, A. F. (2002). The effects of mental representation on performance in a navigation task. Memory and Cognition, Vol.30, pp. 1189-1203 Recall Performance in Air Traffic Controllers Across the 24-hr Day: Influence of Alertness and Task Demands on Recall Strategies 51 Brébion, G., David, A.S., Bressan, R.A. & Pilowski, L.S. (2005). Word frequency effects on free recall and recognition in patients with schizophrenia. Journal of Psychiatry Research, Vol.39, pp. 215-222 Conrad, R. & Hull, A.J. (1968) Input modality and the serial position curve in short-term memory. Psychonomic Science, Vol.10, no.4), pp.135-136. Cariou, M.; Galy, E. & Mélan, C. (2008). Differential 24-h variations of alertness and subjective tension in process controllers: investigation of a relationship with body temperature and heart rate. Chronobiology International, Vol.25, No.4, pp. 97-609 Carroll, D., Turner J.R. & Hellawell, J.C. (1986). Heart rate and oxygen consumption during active psychological challenge: the effects of level of difficulty. Psychophysiology. 23:174-181 Carroll, L.M.; Jalbert, A., Penney, A.M., Neath, I., Surprenant, A.M. & Tehan, G. (2010). Evidence for proactive interference in the focus of attention of working memory. Canadian Journal of Experimental Psychology, Vol.64, pp. 208–214 Costa, G. (1996). The impact of shift and nightwork on health. Applied Ergonomics, Vol.27, no.1, pp. 9-16 Costa, G. (1999). Fatigue and biological rhythms. In: Handbook of aviation human factors. D.J. Garland, J.A. Wise & V.D. Hopkin, (Eds.), 235-255, London: Erlbaum Costa, G. (2003). Shift work and occupational medicine: An overview. Occupational Medicine, Vol.53, pp. 83-88 Cowan, N. (1984). On short and long auditory stores. Psychological Bulletin, Vol.96, pp. 341370 Cowan, N. (2011).The focus of attention as observed in visual working memory tasks: Making sense of competing claims. Neuropsychologia, Vol.49, pp. 1401–1406 Cowan, N.; Saults, J.S., Elliott, E.M. & Moreno, M.V. (2002). Deconfounding serial recall. Journal of Memory and Language, Vol.46, pp. 153-177 Cowan, N.; Saults, J.S. & Brown, G. D. (2004). On the auditory modality superiority effect in serial recall: separating input and output factors. Journal of Memory and Language, Vol.46, pp. 153-177 Crowder, R.G. & Morton, J. (1969). Precategorical acoustic storage (PAS). Perception and Psychophysics, Vol.5, pp. 365-373 Frankish, C. (1985). Modality-specific grouping effects in short-term memory. Journal of Memory and Language, Vol.24, pp. 200-209 Frankish, C. (2008). Precategorical acoustic storage and the perception of speech. Journal of Memory and Language, Vol.58, pp. 815–836 Della Rocco, P.S. & Nesthus, T.E. (2005). Shift-work and air traffic control: Transitioning research results to the workforce. In: Human factors impacts in air traffic management. B. Kirwan, M. Rogers, D. Schäfer, (Eds), 243-278, Aldershot, UK: Ashgate Dinges, L.S.; Pack, F., Williams, W., Gillen, K.A., Powell, J.W., Ott, G.E., Aptowicz, C. & Pack, A.I. (1997). Cumulative sleepiness, mood disturbance, and psychomotor vigilance performance decrements during a week of sleep restricted to 4-5 hours per night. Sleep, Vol.20, No.4, pp. 267-277 52 Advances in Air Navigation Services Folkard, S. (1979). Times of day and level of processing. Memory and Cognition, Vol.7, PP. 247-252. Folkard, S.; Knauth, P., Monk, T.H. & Rutenfranz, J. (1976). The effect of memory load on the circadian variation in performance efficiency under a rapidly rotating shift system. Ergonomics, Vol.19, pp. 479-488. Folkard, S. & Monk, T. H. (1980). Circadian rhythms in human memory. British Journal of Psychology, Vol.71, pp. 295-307. Folkard, S. & Akerstedt, T. (1992). A three-process model of the regulation of alertnesssleepiness. In: Sleep, arousal, and performance, R.J. Broughton & R.D. Ogilvie, (Eds.), 1126, Boston: Birkhaüser Folkard, S. & Tucker, P. (2003). Shift work, safety and productivity. Occupational Medicine (London), Vol.53, PP. 95-101. Galy, E.; Cariou, M. & Mélan, C. (2012). What is the relationship between mental workload factors and cognitive load types?, International Journal of Psychophysiology, Vol.83, No.3, pp. 269-275 Galy, E.; Mélan, C. & Cariou, M. (2008). Investigation of task performance variations according to task requirements and alertness across the 24-h day in shift-workers. Ergonomics, Vol.51, No.9, pp. 1338-51 Galy, E.; Mélan, C. & Cariou, M. (2010). Investigation of ATCs' response strategies in a free recall task: what makes auditory recall superior to visual recall? International Journal of Aviation Psychology, Vol.20, No.3, pp. 295-307. Glenberg, A. M., & Swanson, N. G. (1986). A temporal distinctiveness theory of recency and modality effects. Journal of Experimental Psychology: Learning, Memory, and Cognition, Vol.12, No1, pp. 3-15 Gronlund, S.D.; Dougherty, M.R.P., Durso, F.T., Canning, J.M. & Mills, S. H. (2005). Planning in air traffic control: Impact of problem type. International Journal of Aviation Psychology, Vol.15, pp. 269-293 Gronlund, S.D.; Ohrt, D.D., Dougherty, M.R.P., Perry, J.L. & Manning, C.A. (1998). Role of memory in air traffic control. Journal of Experimental Psychology: Learning, Memory, & Cognition, Vol.15, pp. 846-858 Harvey, A.J. & Beaman, C.P. Input and output modality effects in immediate serial recall. Memory, Vol.15, No.7, pp. 693-700 Kecklund, G., Akerstedt, T. & Lowden, A. (1997). Morning work: effects of early rising on sleep and alertness. Sleep, Vol. 20, pp. 215-223 Kalyuga, S., Ayres, P., Chandler, P. & Sweller, J. (2003). The expertise reversal effect. Educational Psychologist, Vol.38, pp. 23–31 Khaleque, A. (1984). Circadian rhythms in heart rate of shift and day workers. Journal of Human Ergology, Vol.13, pp. 23-29 Lille, F. & Cheliout, F. (1982). Variations in diurnal and nocturnal waking state in air traffic controllers. European Journal of Applied Physiology, Vol.49, pp. 319-328 Lorenzetti, R. & Natale, V. (1996). Time of day and processing strategies in narrative comprehension. British Journal of Psychology, Vol.87, pp. 209-221 Recall Performance in Air Traffic Controllers Across the 24-hr Day: Influence of Alertness and Task Demands on Recall Strategies 53 Luna, T.D., French. J. & Mitcha, J.L. (1997). A study of USAF air traffic controller shiftwork: sleep, fatigue, activity, and mood analyses. Aviation Space and Environmental Medicine, Vol.68, pp. 18-23 Madigan, S. A. (1971). Modality and recall order interactions in short-term memory for serial order. Journal of Experimental Psychology, Vol.87, pp. 294-296 Means, B.; Mumaw, R.J., Roth, C., Schlager, M.S., McWilliams, E., Gagne, E. et al. (1988). ATC training analysis study: Design of the next-generation ATC training system. report N°. FAA/OPM 342-036, Washington, DC: Department of Transportation/federal Aviation Administration, USA Mélan, C.; Galy, E. & Cariou, M. (2007). Mnemonic Processing in Air Traffic Controllers (ATCs): Effects of Task Parameters and Work Organization. International Journal of Aviation Psychology, Vol.17, No.4, pp. 391-409 Monk, T.H.; Fookson, J.E., Moline, M.L. & Pollak, C.P. (1985). Diurnal variation in mood and performance in a time isolated environment. Chronobiology International, Vol.2, pp. 185193 Oakhill, J. & Davies, A.M. (1989). The effects of time of day and subjects' test expectations on recall and recognition of prose materials. Acta Psychologica, Vol.72, pp. 145-157 Oberauer, K. & Vockenberg, K. (2009). Updating of working memory: Lingering bindings. The Quarterly Journal of Experimental Psychology, Vol.62, pp. 967-987 Owens, D. S.; Macdonald, I., Tucker, P., Sytnik, N., Totterdell, P., Minors, D., et al. (2000). Diurnal variations in the mood and performance of highly practiced young women living under strictly controlled conditions. British Journal of Psychology, Vol.91, pp. 41-60 Penney, C. G. (1989). Modality effects and structure of short-term verbal memory. Memory and Cognition, Vol.17, No.4, pp. 398-422 Prizmic Z.; Vidadek S., Radosevic-Vidadek B. & Kaliterna L. (1995). Shiftwork tolerance and 24-h variations in moods. Work Stress, Vol. 9, pp. 327-334 Rose, R.M.; Jenkins, C.D., Hurst, M., Herd, J.A. & Hall RP. (1982). Endocrine activity in air traffic controllers at work. II. Biological, psychological and work correlates. Psychoneuroendocrinology, Vol.7, pp. 113-123 Rosa R. (1995). Extended workshifts and excessive fatigue. Journal of Sleep Research, Vol.4, pp. 51-56 Rummer, R. & Schweppe, J. (2005). Evidence for a modality effect in sentence retention. Psychonomic Bulletin & Review, Vol.12, No.6, pp.1094-1099 Prince, S.E., Daselaar, S.M. & Cabeza, R. (2005). Neural of relational memory: successful encoding and retrieval of semantic and perceptual associations. Journal of Neuroscience, Vol.25, pp. 1203-1210 Schneider, V.I.; Healy, A.F. & Barshi, I. (2004). Effects of instruction modality and read-back on accuracy in flowing navigation commands. Journal of Experimental Psychology: Applied, Vol.10, pp. 245-257 Schnotz, W. & Kürschner, C. (2007). A reconsideration of cognitive load theory. Educational Psychology Review, Vol.19, pp. 469–508 Siegrist, J. (2010). Effort-reward imbalance at work and cardiovascular diseases. International Journal of Occupational Medicine and Environmental Health, Vol.23, pp. 279-285 54 Advances in Air Navigation Services Sweller, J. (1988). Cognitive load during problem solving: effects on learning. Cognitive Science, Vol.12, pp. 257–285 Sweller, J. (1994). Cognitive load theory, learning difficulty and instructional design. Learning and Instruction, Vol.4, pp. 295–312 Sweller, J. & Chandler, P. (1994). Why some material is difficult to learn. Cognition and Instruction, Vol.12, pp. 185–233 Thayer, R.E. (1989). The biopsychology of mood and arousal. New-York: Oxford University Press Tucker, P., Lombardi, D., Smith L. & Folkard, S. (2006). The Impact of Rest Breaks on Temporal Trends in Injury Risk. Chronobiology International, Vol. 23, pp. 1423–1434 Tucker P, Smith L, Macdonald I, Folkard S. (1998). Shift length as a determinant of retrospective on-shift alertness. Scandinavian Journal of Work and Environmental Health, Vol.24, pp. 49-54 Wright, K.P., Hull, J.T. & Czeisler, C.A. (2002). Relationship between alertness, performance, and body temperature in humans. American Journal of Physiology, Vol. 253, pp. 1370-1377 Wickens, C.D. & Hollands, J.G. (2000). Engineering psychology and human performance (3rd ed.). Upper Saddle River, NJ: Prentice Hall, USA