Elsevier

NeuroImage

Volume 21, Issue 3, March 2004, Pages 1026-1036
NeuroImage

Task analysis complements neuroimaging: an example from working memory research

https://doi.org/10.1016/j.neuroimage.2003.10.011Get rights and content

Abstract

When functional neuroimaging researchers draw conclusions about the sensory, cognitive, or motor processes that are associated with changes in brain activity, they are making assumptions about the component processes involved in performing a complex behavioral task. We demonstrate the danger in making such assumptions using, as an example, the n-back task, which has been widely used in neuroimaging studies of working memory. Neuroimaging researchers have assumed that the letter n-back task only engages processes involved in the short-term maintenance and manipulation of verbal information. We report three behavioral experiments demonstrating that the letter n-back task additionally recruits spatial processes. A fourth experiment suggested that the location n-back task may recruit verbal processes in addition to spatial processes. These results call into question conclusions that have been drawn about the neural basis of working memory. More broadly, our results demonstrate that task analysis is a vital partner of neuroimaging in the cognitive neuroscience enterprise.

Introduction

Recently developed functional neuroimaging methodologies, such as functional magnetic resonance imaging (fMRI) and positron emission tomography (PET), have made important contributions to the understanding of the neural basis of sensory, cognitive, and motor behavior. The scope of these contributions is limited, however, for a variety of reasons D'Esposito et al., 1999, Friston et al., 1996, Jennings et al., 1997, Kosslyn, 1999, Newman et al., 2001, Poeppel, 1996, Uttal, 2001. One critical limitation of neuroimaging is that it requires that assumptions are made about the component processes involved in performing a behavioral task. When a neuroimaging report states that a change in activity in a particular brain region (or regions), measured while participants perform a task, is associated with a particular process, the authors have assumed that (a) the process is required for performance of the task, and (b) no other processes required for performance of the task are associated with the change in activity. Long before neuroimaging tools were developed, cognitive psychologists had developed methods for determining the component processes comprising cognitive tasks. Thus, it is critical that cognitive psychology be used in conjunction with neuroimaging to confirm which processes are involved in which tasks.

Although in some cases neuroimaging researchers directly adopt tasks for which cognitive psychology has thoroughly analyzed the component processes, this is not always the case. An example of the latter is the n-back task Cohen et al., 1994, Gevins et al., 1990, which has been widely used in neuroimaging studies of working memory despite minimal prior task analysis.1 In the n-back task, participants are presented with a sequence of stimuli, and asked to judge whether the current stimulus matches the stimulus that preceded it by n places in the sequence. For example, in a 3-back task with the sequence of letters B, Q, D, P, Q, participants should respond positively to the second Q because it matches the letter that appeared three letters earlier. Neuroimaging researchers were attracted to the n-back task for several reasons Braver et al., 1997, Cohen et al., 1997, Jonides et al., 1997. First, the n-back task was thought to be a more representative example of a working memory task than the tasks used in earlier neuroimaging studies because it was presumed to require manipulation of information held in working memory in addition to mere maintenance of information. Second, it allowed the use of the method of parametric variation instead of the method of subtraction, thereby avoiding some of the problematic assumptions associated with the latter Friston et al., 1996, Jennings et al., 1997. Third, manipulation of the value of n allowed the systematic manipulation of working memory load, and brain regions showing changes in activity coincident with changes in load were thought to play specific processing roles. Neuroimaging researchers have rationalized their use of the n-back task, despite a lack of task analysis, by claiming that it activates the same brain areas as other working memory tasks whose component processes are well understood. There are at least two consistent exceptions to this claim: dorsolateral Brodmann area 6 (dorsal premotor cortex, or PMd) and right posterior parietal cortex (PPC), two regions that are not active during other nonspatial working memory tasks, are active during nonspatial n-back tasks D'Esposito et al., 1998, Smith and Jonides, 1999.

According to current theory, which was introduced by Baddeley and Hitch (1974) and refined by many contributors Baddeley, 1986, Baddeley and Logie, 1999, there are two main types of component systems involved in working memory tasks: the executive system and the subordinate systems. The executive controls the maintenance, manipulation, and retrieval of the contents of working memory, and is thought to be involved in all working memory tasks regardless of the domain of information that is being maintained. Different subordinate systems, under the control of the executive, are thought to be involved in the maintenance of specific domains of information (e.g., verbal, spatial, and visual form). In other words, the executive is thought to be a domain-general system, whereas the subordinate systems are thought to be domain-specific systems. Neuroimaging studies of working memory have exploited this distinction in an effort to identify the brain regions associated with these systems. The logic is as follows: if you design two working memory tasks that are identical except for the domain of the information to be maintained, then brain regions that are activated by both tasks (excepting sensory and motor activation) are associated with the executive, and brain regions that are activated by just one of the tasks are associated with one of the subordinate systems. Studies employing this logic have concluded that prefrontal cortical areas are associated with the executive, and more posterior regions, especially in parietal and frontal cortices, are associated with the different subordinate systems D'Esposito et al., 1998, Smith and Jonides, 1999.

Before the n-back task was introduced in neuroimaging studies, regions of activity in PMd and right PPC were associated with the spatial subordinate system (Jonides et al., 1993). However, studies using the n-back task have shown that PMd and right PPC are active for all domains of information, not just spatial information (e.g., D'Esposito et al., 1998, Nystrom et al., 2000, Postle et al., 2000b, Zurowski et al., 2002). Application of the aforementioned logic forces the conclusion that these PMd and right PPC activations are associated with domain-general processes rather than spatial-specific processes. An alternative possibility is that erroneous assumptions have been made about the component processes involved in the n-back task. The n-back task is similar to other working memory tasks in that it requires the maintenance of stimulus identity and serial position information. However, the n-back task is unique in that it requires the dynamic comparison of serially presented stimuli. Perhaps such comparisons are aided by the mental transformation of serially presented information into a spatial representation. Experiment 1, Experiment 2, Experiment 3 were designed to test the hypothesis that the n-back task, regardless of the domain of information to be maintained, recruits spatial processing.

Section snippets

Experiment 1

Participants performed a letter n-back task, and responded verbally in one condition and spatially in another. According to the existing literature, the letter n-back task is purely reliant on the executive and the verbal subordinate system. This view predicted that memory performance should be susceptible to disruption from verbal responding, but not spatial responding Baddeley, 1986, Brooks, 1968. Our hypothesis suggests that the letter n-back task additionally recruits the spatial

Experiment 2

The fact that the spatial and verbal response tasks were equally disruptive to letter n-back performance in Experiment 1 could be attributed to the possibility that the spatial task was generally more difficult. Thus, it was important to assess the relative impact of the verbal and spatial response tasks on another letter working memory task thought to recruit the verbal subordinate system, but not the spatial subordinate system. Participants were presented with sequences of eight letters, and

Experiment 3

Eye movements during spatial cognitive tasks are considered to be an external manifestation of internal spatial processing (e.g., Brandt and Stark, 1997, Hebb, 1968, Laeng and Teodorescu, 2002). Monitoring gaze position is particularly effective at gauging spatial processing when the spatial nature of the task is not obvious (e.g., Kennedy and Murray, 1987, Richardson and Spivey, 2000, Spivey and Geng, 2001). For example, Richardson and Spivey (2000) reported that participants tended to return

Experiment 4

When discussing possible explanations for why letter and location n-back tasks, relative to other verbal and spatial working memory tasks, do not show as much differential brain activation in neuroimaging studies, Fiez (2001) considered two possibilities.2 First, the

Spatial processing in the letter n-back task

Experiment 1 demonstrated that spatial responding was as disruptive as verbal responding to letter n-back performance. Experiment 2 demonstrated that spatial responding was less disruptive than verbal responding to letter-immediate-recall performance. Experiment 3 monitored the eyes during letter n-back performance, and showed that saccade frequency and the spatial variability of gaze position were load-dependent. Taken together, these results suggest that the letter n-back task, unlike other

Acknowledgements

This research was supported by the Natural Sciences and Engineering Research Council of Canada. We thank Caroline Proctor, Alison Parisi, and Fern Jaspers-Fayer for assistance in data collection and analysis.

References (93)

  • M.S. Graziano et al.

    The cortical control of movement revisited

    Neuron

    (2002)
  • G. Hatano et al.

    Digit memory of grand experts in abacus-derived mental calculation

    Cognition

    (1983)
  • Y. Hoshi et al.

    Visuospatial imagery is a fruitful strategy for the digit span backward task: a study with near-infrared optical tomography

    Brain Res. Cognit. Brain Res.

    (2000)
  • J.M. Jennings et al.

    Cognitive subtractions may not add up: the interaction between semantic processing and response mode

    NeuroImage

    (1997)
  • S. Kastner et al.

    Increased activity in human visual cortex during directed attention in the absence of visual stimulation

    Neuron

    (1999)
  • Y.H. Kim et al.

    The large-scale neural network for spatial attention displays multifunctional overlap but differential asymmetry

    NeuroImage

    (1999)
  • K.S. LaBar et al.

    Neuroanatomic overlap of working memory and spatial attention networks: a functional MRI comparison within subjects

    NeuroImage

    (1999)
  • B. Laeng et al.

    Eye scanpaths during visual imagery reenact those of perception of the same visual scene

    Cogn. Sci.

    (2002)
  • C. Lamm et al.

    Evidence for premotor cortex activity during dynamic visuospatial imagery from single-trial functional magnetic resonance imaging and event-related slow cortical potentials

    NeuroImage

    (2001)
  • E.K. Miller

    The prefrontal cortex: no simple matter

    NeuroImage

    (2000)
  • A.C. Nobre et al.

    Covert visual spatial orienting and saccades: overlapping neural systems

    NeuroImage

    (2000)
  • L.E. Nystrom et al.

    Working memory for letters, shapes, and locations: fMRI evidence against stimulus-based regional organization in human prefrontal cortex

    NeuroImage

    (2000)
  • T. Paus

    Location and function of the human frontal eye-field: a selective review

    Neuropsychologia

    (1996)
  • D. Poeppel

    A critical review of PET studies of phonological processing

    Brain Lang.

    (1996)
  • B.R. Postle et al.

    An fMRI investigation of cortical contributions to spatial and nonspatial visual working memory

    NeuroImage

    (2000)
  • L.J. Rapport et al.

    Digit span performance and unilateral neglect

    Neuropsychologia

    (1994)
  • D.C. Richardson et al.

    Representation, space and Hollywood Squares: looking at things that aren't there anymore

    Cognition

    (2000)
  • R.I. Schubotz et al.

    Functional organization of the lateral premotor cortex: fMRI reveals different regions activated by anticipation of object properties, location and speed

    Brain Res. Cognit. Brain Res.

    (2001)
  • E. Zarahn et al.

    Temporal isolation of the neural correlates of spatial mnemonic processing with fMRI

    Brain Res. Cognit. Brain Res.

    (1999)
  • E. Zarahn et al.

    Replication and further studies of neural mechanisms of spatial mnemonic processing in humans

    Brain Res. Cognit. Brain Res.

    (2000)
  • B. Zurowski et al.

    Dissociating a common working memory network from different neural substrates of phonological and spatial stimulus processing

    NeuroImage

    (2002)
  • T.J. Anderson et al.

    Cortical control of saccades and fixation in man: a PET study

    Brain

    (1994)
  • E. Awh et al.

    Dissociation of storage and rehearsal in verbal working memory: evidence from positron emission tomography

    Psychol. Sci.

    (1996)
  • A.D. Baddeley

    Working Memory

    (1986)
  • A.D. Baddeley et al.

    Spatial working memory

  • A.D. Baddeley et al.

    Working memory: the multiple component model

  • A.D. Baddeley et al.

    Imagery and visual working memory

  • J. Beatty

    Task-evoked pupillary responses, processing load, and the structure of processing resources

    Psychol. Bull.

    (1982)
  • D.H. Brainard

    The psychophysics toolbox

    Spat. Vis.

    (1997)
  • S.A. Brandt et al.

    Spontaneous eye movements during visual imagery reflect the content of the visual scene

    J. Cogn. Neurosci.

    (1997)
  • L.R. Brooks

    Spatial and verbal components of the act of recall

    Can. J. Psychol.

    (1968)
  • S. Carlson et al.

    Distribution of cortical activation during visuospatial n-back tasks as revealed by functional magnetic resonance imaging

    Cereb. Cortex

    (1998)
  • J.D. Cohen et al.

    Activation of the prefrontal cortex in a nonspatial working memory task with functional MRI

    Hum. Brain Mapp.

    (1994)
  • J.D. Cohen et al.

    Temporal dynamics of brain activation during a working memory task

    Nature

    (1997)
  • J.D. Connolly et al.

    A comparison of frontoparietal fMRI activation during anti-saccades and anti-pointing

    J. Neurophysiol.

    (2000)
  • Cited by (26)

    • Mental workload of young and older adults gauged with ERPs and spectral power during N-Back task performance

      2019, Biological Psychology
      Citation Excerpt :

      Subjects have to decide whether the current stimulus matches the one presented N stimuli before, hence, they know to which stimulus the new stimulus is a match. It calls upon different mental processes manipulating and maintaining information (Meegan, Purc-Stephenson, Honsberger, & Topan, 2004; Owen, McMillan, Laird, & Bullmore, 2005): WM updating, which involves the encoding of incoming stimuli, monitoring, maintenance and updating of the sequence, and stimulus matching, i.e., matching the current stimulus to the one that occurred N positions back in the sequence. Furthermore, the N-Back task reflects a number of core Executive Functions (EFs) besides WM, such as inhibitory control and cognitive flexibility, as well as other higher-order EFs such as problem solving, decision making, selective attention, and so on (Kane & Engle, 2002).

    • The influence of self-relevant materials on working memory in dysphoric undergraduates

      2015, Psychiatry Research
      Citation Excerpt :

      This task involves a continuous performance WM measure that, in its higher cognitive load conditions (i.e., two-back and three-back), makes strong demands on WM. During each trial, the participants must process the presented stimulus, add it to their maintained set of stimuli, discard the stimulus presented several trials earlier, compare the current stimulus with the one presented earlier, and then respond. The N-back task taps into updating processes involving manipulation as well as maintenance of information in WM (Meegan et al., 2004; Owen et al., 2005; Ragland et al., 2002). In this task, lower accuracy or longer RTs to stimuli indicate difficulty in one’s ability to update WM, which was closely correlated with rumination (Joormann et al., 2007; Koster et al., 2013).

    • Age differences in prefontal recruitment during verbal working memory maintenance depend on memory load

      2010, Cortex
      Citation Excerpt :

      Based on CRUNCH, we predicted: (1) age-related over-activation of DLPFC at low verbal WM loads and (2) age-related under-activation of DLPFC at high verbal WM loads. Furthermore, the use of a delayed item-recognition task (Sternberg, 1969) in concert with event-related functional magnetic resonance imaging (fMRI) allowed us to compare age-related differences in DLPFC activation across encoding, maintenance, and retrieval stages, (Meegan et al., 2004). Twenty-one young (11 female) and 23 senior (13 female) adults were paid to participate in the study.

    • Sub-processes of working memory in the N-back task: An investigation using ERPs

      2008, Clinical Neurophysiology
      Citation Excerpt :

      A broader meta-analysis of tasks involving an ‘updating’ process, such as the one central to the N-back task, show significant activation clusters in the right dorsolateral prefrontal, right parietal, and bilateral premotor cortices (Wager and Smith, 2003). Researchers currently prefer the N-back task in studies of WM because it taps into processes involving manipulation as well as maintenance of information in WM (e.g., Meegan et al., 2004; Ragland et al., 2002; Owen et al., 2005). Impairment in executive function of WM is suggested as a feature of early Alzheimer’s dementia (Hashimoto et al., 2004; Morris, 1994; Vecchi and Cornoldi, 1999; Vecchi et al., 1998), and, in these patients, continuous deterioration of WM performance is noted in dual rather than single task settings (Baddeley et al., 1991).

    View all citing articles on Scopus
    View full text