Hostname: page-component-8448b6f56d-jr42d Total loading time: 0 Render date: 2024-04-16T21:49:58.345Z Has data issue: false hasContentIssue false
  • English
  • Français

The case for the development and use of “ecologically valid” measures of executive function in experimental and clinical neuropsychology

Published online by Cambridge University Press:  22 March 2006

PAUL W. BURGESS ,
NICK ALDERMAN ,
CATRIN FORBES ,
ANGELA COSTELLO ,
LAURE M-A.COATES ,
DEIRDRE R. DAWSON ,
NICOLE D. ANDERSON ,
SAM J. GILBERT ,
IROISE DUMONTHEIL  and
SHELLEY CHANNON
PAUL W. BURGESS
Affiliation:
Institute of Cognitive Neuroscience, University College London, London, UK Psychology Department, University College London, London, UK
NICK ALDERMAN
Affiliation:
Kemsley National Brain Injury Rehabilitation Centre, St. Andrew's Hospital, Northampton, UK
CATRIN FORBES
Affiliation:
Institute of Cognitive Neuroscience, University College London, London, UK Psychology Department, University College London, London, UK
ANGELA COSTELLO
Affiliation:
Neuroscience Unit, King's College Healthcare Trust, London, UK
LAURE M-A.COATES
Affiliation:
Institute of Psychiatry, University of London, London, UK
DEIRDRE R. DAWSON
Affiliation:
Kunin-Lunenfeld Applied Research Unit, Baycrest Centre for Geriatric Care, Toronto, Ontario, Canada. Dept. of Occupational Therapy and Occupational Science; Graduate Dept. of Rehabilitation Sciences, University of Toronto, Canada
NICOLE D. ANDERSON
Affiliation:
Kunin-Lunenfeld Applied Research Unit, Baycrest Centre for Geriatric Care, Toronto, Ontario, Canada. Department of Psychology, University of Toronto, Toronto, Ontario, Canada
SAM J. GILBERT
Affiliation:
Institute of Cognitive Neuroscience, University College London, London, UK Psychology Department, University College London, London, UK
IROISE DUMONTHEIL
Affiliation:
Institute of Cognitive Neuroscience, University College London, London, UK Psychology Department, University College London, London, UK
SHELLEY CHANNON
Affiliation:
Psychology Department, University College London, London, UK
Get access Rights & Permissions [Opens in a new window]

Abstract

This article considers the scientific process whereby new and better clinical tests of executive function might be developed, and what form they might take. We argue that many of the traditional tests of executive function most commonly in use (e.g., the Wisconsin Card Sorting Test; Stroop) are adaptations of procedures that emerged almost coincidentally from conceptual and experimental frameworks far removed from those currently in favour, and that the prolongation of their use has been encouraged by a sustained period of concentration on “construct-driven” experimentation in neuropsychology. This resulted from the special theoretical demands made by the field of executive function, but was not a necessary consequence, and may not even have been a useful one. Whilst useful, these tests may not therefore be optimal for their purpose. We consider as an alternative approach a function-led development programme which in principle could yield tasks better suited to the concerns of the clinician because of the transparency afforded by increased “representativeness” and “generalisability.” We further argue that the requirement of such a programme to represent the interaction between the individual and situational context might also provide useful constraints for purely experimental investigations. We provide an example of such a programme with reference to the Multiple Errands and Six Element tests. (JINS, 2006, 12, 194–209.)

Keywords

Frontal lobesMultiple Errands TestSix Element TestWisconsin Card Sorting TestStroopAssessment
Type
SYMPOSIUM
Information
Journal of the International Neuropsychological Society , Volume 12 , Issue 2 , March 2006 , pp. 194 - 209
Copyright
© 2006 The International Neuropsychological Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

REFERENCES

Ackerly, S.S. & Benton, A.L. (1947). Report of a case of bilateral frontal lobe defect. Research Publications: Association for Research in Nervous and Mental Disease, 27, 479–504.Google Scholar
Alderman, N., Burgess, P.W., Knight, C., & Henman, C. (2003). Ecological validity of a simplified version of the multiple errands shopping test. Journal of the International Neuropsychological Society, 9, 31–44.Google Scholar
Alderman, N., Evans, J.J., Emslie, H., Wilson, B.W., & Burgess, P.W. (1996). Zoo Map Test. In B.A. Wilson, N. Alderman, P.W. Burgess, H. Emslie, & J.J. Evans (Eds.), Behavioural assessment of the dysexecutive syndrome. Bury St. Edmunds: Thames Valley Test Company.
Anderson, C.V., Bigler, E.D., & Blatter, D.D. (1995). Frontal lobe lesions, diffuse damage, and neuropsychological functioning in traumatic brain-injured patients. Journal of Clinical and Experimental Neuropsychology, 17, 900–908.Google Scholar
Baddeley, A.D. (1996). Exploring the central executive. Quarterly Journal of Experimental Psychology, 49A(1), 5–28.Google Scholar
Baddeley, A., Della Salla, S., Gray, C., Papagno, C., & Spinnler, H. (1997). Testing central executive functioning with a pencil-and-paper test. In P. Rabbitt (Ed.), Methodology of frontal and executive function (pp. 61–80). Hove, U.K.: Psychology Press.
Benton, A.L. (1991). The prefrontal region: Its early history. In H.S. Levin, H.M. Eisenberg, & A.L. Benton (Eds.), Frontal lobe function and dysfunction (pp. 3–34). New York: Oxford University Press.
Bergner, M., Bobbitt, R.A., Carter, W.B., & Gilson, B.S. (1981). The Sickness Impact Profile: Development and final revision of a health status measure. Medical Care, 19, 787–805.Google Scholar
Bird, C.M., Castelli, F., Malik, O., Frith, U., & Husain, M. (2004). The impact of extensive medial frontal lobe damage on “Theory of Mind” and cognition. Brain, 127, 914–928.Google Scholar
Brickner, R.M. (1936). The intellectual functions of the frontal lobes: A study based upon observation of a man after partial bilateral frontal lobectomy. New York: Macmillan.
Bruce, V. & Young, A.W. (1986). Understanding face recognition. British Journal of Psychology, 77, 305–327.Google Scholar
Brunswik, E. (1956). Perception and the representative design of psychological experiments (2nd ed.). Berkeley: University of California Press.
Burgess, P.W. (1997). Theory and methodology in executive function research. In P. Rabbitt (Ed.), Methodology of frontal and executive function (pp. 81–116). Hove, U.K.: Taylor and Francis.
Burgess, P.W. (2000a). Real-world multitasking from a cognitive neuroscience perspective. In S. Monsell & J. Driver (Eds.), Control of cognitive processes: Attention and performance XVIII (pp. 465–472). Cambridge, MA: MIT Press.
Burgess, P.W. (2000b). Strategy application disorder: The role of the frontal lobes in human multitasking. Psychological Research, 63, 279–288.Google Scholar
Burgess, P.W. & Alderman, N. (2004). Executive dysfunction. In L.H. Goldstein & J.E. McNeil (Eds.), Clinical neuropsychology: A practical guide to assessment and management for clinicians (pp. 185–210). Chichester, U.K.: John Wiley.
Burgess, P.W., Alderman, N., Emslie, H., Evans, J.J., & Wilson, B.A. (1996a). The dysexecutive questionnaire. In B.A. Wilson, N. Alderman, P.W. Burgess, H. Emslie, & J.J. Evans (Eds.), Behavioural assessment of the dysexecutive syndrome. Bury St. Edmunds, U.K.: Thames Valley Test Company.
Burgess, P.W., Alderman, N., Emslie, H., Evans, J.J., Wilson, B.A., & Shallice, T. (1996b). The simplified six element test. In B.A. Wilson, N. Alderman, P.W. Burgess, H. Emslie, & J.J. Evans (Eds.), Behavioural assessment of the dysexecutive syndrome. Bury St. Edmunds, U.K.: Thames Valley Test Company.
Burgess, P.W., Alderman, N., Evans, J., Emslie, H., & Wilson, B.A. (1998). The ecological validity of tests of executive function. Journal of the International Neuropsychological Society, 4, 547–558.Google Scholar
Burgess, P.W., Gilbert, S.J., Okuda, J., & Simons, J.S. (2006). Rostral prefrontal brain regions (Area 10): A gateway between inner thought and the external world? In W. Prinz & N. Sebanz (Eds.), Disorders of volition (pp. 373–396). Cambridge, MA: MIT Press.
Burgess, P.W., Quayle, A., & Frith, C.D. (2001). Brain regions involved in propsective memory as determined by positron emission tomography. Neuropsychologia, 39, 545–555.Google Scholar
Burgess, P.W. & Robertson, I.H. (2002). Principles of the rehabilitation of frontal lobe function. In D.T. Stuss & R.T. Knight (Eds.), Principles of frontal lobe function (pp. 557–572). New York: Oxford University Press.
Burgess, P.W., Scott, S.K., & Frith, C.D. (2003). The role of the rostral frontal cortex (area 10) in prospective memory: A lateral versus medial dissociation. Neuropsychologia, 41, 906–918.Google Scholar
Burgess, P.W. & Shallice, T. (1996). Response suppression, initiation and strategy use following frontal lobe lesions. Neuropsychologia, 34, 263–273.Google Scholar
Burgess, P.W., Simons, J.S., Coates, L.M.-A., & Channon, S. (2005a). The search for specific planning processes. In G. Ward & R. Morris (Eds.), The cognitive psychology of planning (pp. 199–227). Hove, U.K.: Psychology Press.
Burgess, P.W., Simons, J.S., Dumontheil, I., & Gilbert, S.J. (2005b). The gateway hypothesis of rostral PFC function. In J. Duncan, P. McLeod, & L. Phillips (Eds.), Measuring the mind: Speed, control, & age (pp. 215–246). Oxford University Press.
Burgess, P.W., Veitch, E., Costello, A., & Shallice, T. (2000). The cognitive and neuroanatomical correlates of multitasking. Neuropsychologia, 38, 848–863.Google Scholar
Carlin, D., Bonerba, J., Phipps, M., Alexander, G., Shapiro, M., & Grafman, J. (2000). Planning impairments in frontal lobe dementia and frontal lobe lesion patients. Neuropsychologia, 38(5), 655–65.Google Scholar
Channon, S. & Green, P.S.S. (1999). Executive function in depression: The role of performance strategies in aiding depressed and non-depressed participants. Journal of Neurology, Neurosurgery and Psychiatry, 66, 162–171.Google Scholar
Channon, S., Pellijeff, A., & Rule, A. (2005). Social cognition after head injury: Sarcasm and theory of mind. Brain and Language, 93, 123–134.Google Scholar
Chaytor, N. & Schmitter-Edgecombe, M. (2003). The ecological validity of neuropsychological tests: A review of the literature on everyday cognitive skills. Neuropsychology Review, 13, 181–197.Google Scholar
Chorover, S.L. & Cole, M. (1966). Delayed alternation performance in patients with cerebral lesions. Neuropsychologia, 4, 1–7.Google Scholar
Clark, A. (1997). Being there: putting brain, body and world together again. Cambridge, MA: MIT Press.
Clark, C., Prior, M., & Kinsella, G.J. (2000). Do executive function deficits differentiate between adolescents with ADHD and Oppositional Defiant/Conduct Disorder? A neuropsychological study using the Six Elements Test and Hayling Sentence Completion Test. Journal of Abnormal Child Psychology, 28, 403–414.Google Scholar
Cohen, L.D., Braver, T.S., & O'Reilly, R.C. (1998). A computational approach to prefrontal cortex, cognitive control, and schizophrenia: Recent developments and current challenges. In A.C. Roberts, T.W. Robbins, & L. Weiskrantz (Eds.), The prefrontal cortex: Executive and cognitive functions (pp. 195–220). Oxford: Oxford University Press.
Cohen, J.D., Dunbar, K., & McClelland, J.L. (1990). On the control of automatic processes: A parallel distributed processing account of the Stroop effect. Psychological Review, 97, 332–61.Google Scholar
Cohen, J.D. & Servan-Schreiber, D. (1992). Context, cortex and doapmine: A connectionist approach to behaviour and biology in schizophrenia. Psychological Review, 99, 45–77.Google Scholar
Coltheart, M. & Davies, M. (2003). Inference and explanation in cognitive neuropsychology. Cortex, 39, 188–91.Google Scholar
Corcoran, R. & Upton, D. (1993). A role for the hippocampus in card sorting? Cortex, 29, 293–304.Google Scholar
Coughlan, A.K., Crowe, S.F., Mahony, K., & Jackson, M. (2004). Predicting competency in automated machine use in an acquired brain injury population using neuropsychological measures. Archives of Clinical Neuropsychology, 19, 673–691.Google Scholar
Coughlan, A.K. & Hollows, S.K. (1985). The adult memory and information processing battery (AMIPB). St. James's University Hospital, Leeds, U.K.
Dawson, D.R., Anderson, N., Burgess, P.W., Levine, B., Rewilak, D., Cooper, E.K., Farrow, S., Koscik, K.M., Krpan, K.M., Lo, A., Peer, M., & Stuss, D.T. (2005a). The ecological validity of the Multiple Errands Test—Hospital Version: Preliminary findings. Poster presented at meeting of the International Neuropsychological Society, St. Louis, USA, February.
Dawson, D.R., Anderson, N., Burgess, P.W., Levine, B., Rewilak, D., Cooper, E.K., Farrow, S., Krpan, K., Peer, M., & Stuss, D.T. (2005b). Naturalistic assessment of executive function: The Multiple Errands Test. Presentation at the American Congress of Rehabilitation Medicine, Chicago, USA, September (Abstract submitted).
Dehaene, S., Kerszberg, M., & Changeux, J.-P. (1998). A neuronal model of a global workspace in effortful cognitive tasks. Proceedings of the National Academy of Science, 95, 14,529–14,534.Google Scholar
Duchaine, B.C., Dingle, K., Butterworth, E., & Nakayama, K. (2004). Normal greeble learning in a severe case of developmental prosopagnosia. Neuron, 43, 469–473.Google Scholar
Duchaine, B.C., Wendt, T.N., New, J., & Kulomaki, T. (2003). Dissociations of visual recognition in a developmental agnostic: Evidence for separate developmental processes. Neurocase, 9, 380–389.Google Scholar
Duncan, J. (2005). Prefrontal cortex and Spearman's g. In J. Duncan, L. Phillips, & P. McLeod (Eds.), Measuring the mind: Speed, control and age (pp. 249–274). Oxford: Oxford University Press.
Duncan, J., Burgess, P.W., & Emslie, H. (1995). Fluid intelligence after frontal lobe lesions. Neuropsychologia, 33, 261–268.Google Scholar
Duncan, J., Johnson, R., Swales, M., & Freer, C. (1997). Frontal lobe deficits after head injury: Unity and diversity of function. Cognitive Neuropsychology, 14, 713–741.Google Scholar
Duncan, J. & Miller, E.K. (2002). Cognitive focus through adaptive neural coding in the primate prefrontal cortex. In D.T. Stuss & R.T. Knight (Eds.), Principles of frontal lobe function (pp. 278–291). Oxford: Oxford University Press.
Emslie, H., Wilson, F.C., Burden, V., Nimmo-Smith, I., & Wilson, B.A. (2003). Behavioural assessment of the dysexecutive syndrome in children (BADS-C). London, U.K.: Harcourt Assessment.
Eslinger, P.J. & Damasio, A.R. (1985). Severe disturbance of higher cognition after bilateral frontal lobe ablation: Patient E.V.R. Neurology, 35, 1731–1741.Google Scholar
Evans, J.J., Chua, S., McKenna, P.J., & Wilson, B.A. (1997). Assessment of the dysexecutive syndrome in schizophrenia. Psychological Medicine, 27, 635–646.Google Scholar
Farias, S.T., Harrell, E., Neumann, C., & Houtz, A. (2003). The relationship between neuropsychological performance and daily functioning in individuals with Alzheimer's disease: Ecological validity of neuropsychological tests. Archives of Clinical Neuropsychology, 18, 655–672.Google Scholar
Fisher, A.G. (2003). Assessment of motor and process skills. Vol. 1: Development, standardization, and administration manual (5th ed.). Fort Collins, CO: Three Star Press.
Fortin, S., Godbout, L., & Braun, C.M.J. (2003). Cognitive structure of executive deficits in frontally lesioned head trauma patients performing activities of daily living. Cortex, 39, 273–291.Google Scholar
Frith, C.D. & Frith, U. (2003). Development and neurophysiology of mentalizing. Philosophical Transactions of the Royal Society of London B, 358(1431), 459–473.Google Scholar
Fuster, J.M. (1997). The prefrontal cortex: Anatomy, physiology and neuropsychology of the frontal lobe (3rd ed.). New York: Lippincott–Raven.
Fuster, J.M. (2002). Physiology of executive functions: The perception-action cycle. In D.T. Stuss & R.T. Knight (Eds.), Principles of frontal lobe function, pp. 96–108. Oxford U.K.: Oxford University Press.
Garden, S.E., Phillips, L.H., & MacPherson, S.E. (2001). Midlife aging, open-ended planning, and laboratory measures of executive function. Neuropsychology, 15, 472–482.Google Scholar
Gelb, A. & Goldstein, K. (1920). Psychologische analysenh hirnpathologischer faelle. Leipzig: Barth.
Gilbert, S.J., Frith, C.D., & Burgess, P.W. (2005). Involvement of rostral prefrontal cortex in selection between stimulus-oriented and stimulus-independent thought. European Journal of Neuroscience, 21, 1423–1431.Google Scholar
Gilbert, S.J., Simons, J.S., Frith, C.D., & Burgess, P.W. (2006). Performance-related activity in medial rostral prefrontal cortex (Area 10) during low-demand tasks. Journal of Experimental Psychology: Human Perception and Performance, 32, 45–58.Google Scholar
Gilbert, S.J., Spengler, S., Simons, J.S., Steele, J.D., Lawrie, S.M., Frith, C.D., & Burgess, P.W., (in press). Functional specialization within rostral prefrontal cortex (area 10): A meta- analysis. Journal of Cognitive Neuroscience.
Gioia, G.A. & Isquith, P.K. (2004). Ecological assessment of executive function in traumatic brain injury. Developmental Neuropsychology, 25, 135–158.Google Scholar
Goel, V. & Grafman, J. (1995). Are the frontal lobes implicated in “planning” functions? Interpreting data from the Tower of Hanoi. Neuropsychologia, 33, 623–42.Google Scholar
Goel, V. & Grafman, J. (2000). The role of the right prefrontal cortex in ill-structured problem solving. Cognitive Neuropsychology, 17, 415–436.Google Scholar
Goel, V., Grafman, J., Tajik, J., Gana, S., & Danto, D. (1997). A study of the performance of patients with frontal lesions in a financial planning task. Brain, 120, 1805–1822.Google Scholar
Goldman-Rakic, P.S. (1995). Architecture of the prefrontal cortex and the central executive. Annals of the New York Academy of Science, 769, 212–220.Google Scholar
Goldman-Rakic, P.S. (1998). The prefrontal landscape: Implications of functional architecture for understanding human mentation and the central executive. In A.C. Roberts, T.W. Robbins, & L. Weiskrantz (Eds.), The prefrontal cortex: Executive and cognitive functions (pp. 87–102). Oxford, U.K.: Oxford University Press.
Goldman-Rakic, P.S. & Leung, H.-C. (2002). Functional architecture of the dorsolateral prefrontal cortex in monkeys and humans. In D.T. Stuss & R.T. Knight (Eds.), Principles ofqs frontal lobe function (pp. 85–95). Oxford: Oxford University Press.
Goldstein, L.H., Bernard, S., Fenwick, P.B.C., Burgess, P.W., & McNeil, J. (1993). Unilateral frontal lobectomy can produce strategy application disorder. Journal of Neurology, Neurosurgery and Psychiatry, 56, 274–276.Google Scholar
Goldstein, K.H. & Scheerer, M. (1941). Abstract and concrete behaviour: An experimental study with special tests. Psychological Monographs, 53 (No. 2) (Whole No. 239).Google Scholar
Grady, C.L. (1999). Neuroimaging and activation of the frontal lobes. In B.L. Miller & J.L. Cummings (Eds.), The human frontal lobes: Function and disorders (pp. 196–230). New York: Guilford Press.
Grafman, J. (2002). The structured event complex and the human prefrontal cortex. In D.T. Stuss & R.T. Knight (Eds.), Principles of frontal lobe function (pp. 292–310). Oxford: Oxford University Press.
Grant, D.A. & Berg, E.A. (1948). A behavioural analysis of degree or reinforcement and ease of shifting to new responses in a Weigl-type card sorting problem. Journal of Experimental Psychology, 38, 404–411.Google Scholar
Greve, K.W., Brooks, J., Crouch, J.A., Williams, M.C., & Rice, W.J. (1997). Factorial structure of the Wisconsin Card Sorting Test. British Journal of Clinical Psychology, 36, 283–285.Google Scholar
Haggard, P. & Richardson, J. (1996). Spatial patterns in the control of human movement. Journal of Experimental Psychology: Human Perception and Performance, 22, 42–62.Google Scholar
Hammond, K.R. (1966). The psychology of Egon Brunswik. New York: Holt, Rinehart, & Winston.
Hammond, K.R. (1998). Ecological validity: Then and now. Unpublished manuscript available electronically at: http://brunswik.org/notes/essay2.html
Harlow, J.M. (1848). Passage of an iron bar through the head. Boston Medical and Surgical Journal, 39, 389–393.Google Scholar
Harlow, J.M. (1868). Recovery from the passage of an iron bar through the head. Reprinted in Miller, E. (1993). History of Psychiatry, 4, 271–278.Google Scholar
Higginson, C.I., Arnett, P.A., & Voss, W.D. (2000). The ecological validity of clinical tests of memory and attention in multiple sclerosis. Archives of Clinical Neuropsychology, 15, 185–204.Google Scholar
Hoclet, E., Gronier, D., Joly-Pottuz, B., & Carbonnel, S. (2003). The six element test with twenty-four TBI patients during rehabilitation, and fractionation of the Supervisory System. Revue de Neuropsychologie, 13, 263–290.Google Scholar
Hodgson, T.L., Bajwa, A., Owen, A.M., & Kennard, C. (2000). The strategic control of gaze direction in the Tower-of-London task. Journal of Cognitive Neuroscience, 12, 894–907.Google Scholar
Hutchins, E. (1995). Cognition in the wild. Cambridge, MA: MIT Press.
Jacobsen, C.F. (1931). A study of cerebral function in learning: The frontal lobes. Journal of Comparative Neurology, 52, 271–340.Google Scholar
Jacobsen, C.F. (1936). Studies of cerebral function in primates: I. The functions of the frontal association areas in monkeys. Comparative Psychology Monographs, 13, 3–60.Google Scholar
Jelicic, M., Henquet, C.E., Derix, M.M., & Jolles, J. (2001). Test-retest stability of the behavioural assessment of the dysexecutive syndrome in a sample of psychiatric patients. International Journal of Neuroscience, 110, 73–8.Google Scholar
Kafer, K.L. & Hunter, M. (1997). On testing the face validity of planning/problem-solving tasks in a normal population. Journal of the International Neuropsychological Society, 3, 108–19.Google Scholar
Kanwisher, N. (2000). Domain-specificity in face perception. Nature Neuroscience, 3, 759–761.Google Scholar
Kibby, M.Y., Schmitter-Edgecombe, M., & Long, C.J. (1998). Ecological validity of neuropsychological tests: focus on the California Verbal Learning Test and the Wisconsin Card Sorting Test. Archives of Clinical Neuropsychology, 13, 523–534.Google Scholar
Kingstone, A., Smilek, D., Birmingham, E., Cameron, D., & Bischof, W.F. (2005). Cognitive ethology: Giving real life to attention research. In J. Duncan, L. Phillips, & P. McLeod (Eds.), Measuring the mind: Speed, control and age (pp. 341–357). Oxford: Oxford University Press.
Kingstone, A., Smilek, D., & Ristic, J. (2003). Attention, researchers! It is time to take a look at the real world. Current Directions in Psychological Science, 12, 176–180.Google Scholar
Kirsh, D. (1995). The intelligent use of space. Artificial Intelligence, 73, 31–68.Google Scholar
Kliegel, M., McDaniel, M.A., & Einstein, G.O. (2000). Plan formation, retention, and execution in prospective memory: A new approach and age-related effects. Memory and Cognition, 28, 1041–1049.Google Scholar
Knight, C., Alderman, N., & Burgess, P.W. (2002). Development of a simplified version of the multiple errands test for use in hospital settings. Neuropsychological Rehabilitation, 12, 231–255.Google Scholar
Kvavilashvili, L. & Ellis, J. (2004). Ecological validity and the real-life/laboratory controversy in memory research: A critical and historical review. History & Philosophy of Psychology, 6, 59–80.Google Scholar
Leichnetz, G.R. (1986). Afferent and efferent connections of the dorsolateral precentral areas (area 4, hand/arm region) in the macaque monkey, with comparisons to area 8. Journal of Comparative Neurology, 254, 460–492.Google Scholar
Levine, B., Freedman, M., Dawson, D., Black, S.E., & Stuss, D.T. (1999). Ventral frontal contribution to self-regulation: Convergence of episodic memory and inhibition. Neurocase, 5, 263–275. (Special issue on orbitofrontal cortex).Google Scholar
Levine, B., Robertson, I., Clare, L., Carter, G., Hong, J., Wilson, B.A., Duncan, J., & Stuss, D.T. (2000). Rehabilitation of executive functioning: An experimental–clinical validation of goal management training. Journal of the International Neuropsychological Society, 6, 299–312.Google Scholar
Levine, B., Stuss, D.T., Milberg, WP., Alexander, M.P., Schwartz, M., & Macdonald, R. (1998). The effects of focal and diffuse brain damage on strategy application: Evidence from focal lesions, traumatic brain injury and normal aging. Journal of the International Neuropsychological Society, 4, 247–264.Google Scholar
MacSweeney, M., Campbell, R., Woll, B., Giampicto, V., David, A.S., McGuire, P.K., Calvert, G., & Brammer, M.J. (2004). Dissociating linguistic and non-linguistic gestural communication in the brain. NeuroImage, 22, 1605–1618.Google Scholar
Malec, J.F. & Lezak, M.D. (2003). Manual for the Mayo-Portland adaptability inventory. PM&R–3MB–SMH, Mayo Medical Center, Rochester, MN 55905, USA.
Malmo, R.B. (1948). Psychological aspects of frontal gyrectomy and frontal lobotomy in mental patients. Research Publications of the Association for Research into Nervous and Mental Disease, 27, 537–564.Google Scholar
Manchester, D., Priestly, N., & Jackson, H. (2004). The assessment of executive functions: Coming out of the office. Brain Injury, 18, 1067–1081.Google Scholar
Manly, T., Hawkins, K., Evans, J., Woldt, K., & Robertson, I.H. (2002). Rehabilitation of executive function: Facilitation of effective goal management on complex tasks using periodic auditory alerts. Neuropsychologia, 40, 271–281.Google Scholar
Marenco, S., Coppola, R., Daniel, D.G., Zigun, J.R., & Weinberger, D.R. (1993). Regional cerebral blood flow during the Wisconsin Card Sorting Test in normal subjects studied by xenon-133 dynamic SPECT: Comparison of absolute values, percent distribution values, and covariance analysis. Psychiatry Research, 50, 177–192.Google Scholar
McDonald, S., Flanagan, S., Martin, I., & Saunders, C. (2004). The ecological validity of TASIT: A test of social perception. Neuropsychological Rehabilitation, 14, 285–302.Google Scholar
Mentzel, H.J., Gaser, C., Volz, H.P., Rzanny, R., Hager, F., Sauer, H., & Kaiser, W.A. (1998). Cognitive stimulation with the Wisconsin Card Sorting Test: Functional MR imaging at 1.5 T. Radiology, 207, 399–404.Google Scholar
Miller, E. (1984). Verbal fluency as a measure of verbal intelligence and in relation to different types of cerebral pathology. British Journal of Clinical Psychology, 23, 53–57.Google Scholar
Milner, B. (1963). Effects of different brain regions on card sorting. Archives of Neurology (Chicago), 9, 90–100.Google Scholar
Miyake, A., Friedman, N.P., Emerson, M.J., Witzki, A.H., Howerter, A., & Wager, T.D. (2000). The unity and diversity of executive functions and their contributions to complex “Frontal Lobe” tasks: A latent variable analysis. Cognitive Psychology, 41, 49–100.Google Scholar
Morris, R.G., Miotto, E.C., Feigenbaum, J.D., Bullock, P., & Polkey, C.E. (1997). The effect of goal-subgoal conflict on planning ability after frontal- and temporal-lobe lesions in humans. Neuropsychologia, 35, 1147–57.Google Scholar
Nelson, H.E. (1976). A modified card sorting test sensitive to frontal lobe defects. Cortex, 12, 313–324.Google Scholar
Nilsson, J.P., Soderstrom, M., Karlsson, A.U., Lekander, M., Akerstedt, T., Lindroth, N.E., & Axelsson, J. (2005). Less effective executive functioning after one night's sleep deprivation. Journal of Sleep Research, 14, 1–6.Google Scholar
Norman, D.A. & Shallice, T. (1986). Attention to action: Willed and automatic control of behaviour. In R.J. Davidson, G.E. Schwartz, & D. Shapiro (Eds.), Consciousness and self regulation: Advances in research, (Vol. IV, pp. 1–18). New York: Plenum. Reprinted in Cognitive neuroscience: A reader (M.S. Gazzaniga (Ed.), Malden, Mass: Blackwell, 2000. Initially published as a technical report in 1980.
Odhuba, R.A., van den Broek, M.D., & Johns, L.C. (2005). Ecological validity of measures of executive functioning. British Journal of Clinical Psychology, 44, 269–278.Google Scholar
Okuda, J., Frith, C.D., & Burgess, P.W. (2004). Organisation of time- and event-based intentions in rostral prefrontal cortex. NeuroImage, 22(S1) S53.Google Scholar
Owen, A.M., Herrod, N.J., Menon, D.K., Clark, J.C., Downey, S.P., Carpenter, T.A., Minhas, P.S., Turkheimer, F.E., Willimas, E.J., Robbins, T.W., Sahakian, B.J., Petrides, M., & Pickard, J.D. (1999). Redefining the functional organization of working memory processes within human lateral prefrontal cortex. European Journal of Neuroscience, 11, 567–574.Google Scholar
Passingham, R. (1993). The frontal lobes and voluntary action. Oxford, U.K.: Oxford University Press.
Penfield, W. & Evans, J. (1935). The frontal lobe in man: A clinical study of maximum removals. Brain, 58, 115–133.Google Scholar
Perret, E. (1974). The left frontal lobe of man and the suppression of habitual responses in verbal categorical behaviour. Neuropsychologia, 12, 323–330.CrossRefGoogle Scholar
Petrides, M. (1994). Frontal lobes and working memory: Evidence from investigations of the effects of cortical excisions in nonhuman primates. In F. Boller & J. Grafman (Eds.), Handbook of Neuropsychology, Vol. 9 (pp. 59–82). Amsterdam: Elsevier.
Petrides, M. (1998). Specialized systems for the processing of mnemonic information within the primate frontal cortex. In A.C. Roberts, T.W. Robbins, & L. Weiskrantz (Eds.), The prefrontal cortex: Executive and cognitive functions (pp. 103–116). Oxford: Oxford University Press.
Petrides, M. & Pandya, D.N. (2002). Association pathways of the prefrontal cortex and functional observations. In D.T. Stuss & R.T. Knight (Eds.), Principles of frontal lobe function (pp. 31–50). Oxford: Oxford University Press.
Pribram, K.H. (1973). The primate frontal cortex—executive of the brain. In K.H. Pribram & A.R. Luria (Eds.), Psychophysiology of the frontal lobes (pp. 293–314). New York: Academic Press.
Ramnani, N. & Owen, A.M. (2004). Anterior prefrontal cortex: Insights into function from anatomy and neuroimaging. Nature Reviews Neuroscience, 5, 184–194.Google Scholar
Ramnani, N., Toni, I., Passingham, R.E., & Haggard, P. (2001). The cerebellum and parietal cortex play a specific role in coordination: A PET study. NeuroImage, 14, 899–911.Google Scholar
Robertson, I.H., Ward, T., Ridgeway, V., & Nimmo-Smith, I. (1994). Test of everyday attention (TEA). London: Harcourt Assessment.
Rowe, J.B., Owen, A.M., Johnsrude, I.S., & Passingham, R.E. (2001). Imaging the mental components of a planning task. Neuropsychologia, 39, 315–327.Google Scholar
Semkovska, M., Bedard, M.A., Godbout, L., Limoge, F., & Stip, E. (2004). Assessment of executive function during activities of daily living in schizophrenia. Schizophrenia Research, 69, 289–300.Google Scholar
Shallice, T. (1982). Specific impairments of planning. Philosophical Transactions of the Royal Society of London B, 298, 199–209.Google Scholar
Shallice, T. (1988). From neuropsychology to mental structure. New York: Cambridge University Press.
Shallice, T. (2002). Fractionation of the supervisory system. In D.T. Stuss & R.T. Knight (Eds.), Principles of frontal lobe function (pp. 261–277). New York: Oxford University Press.
Shallice, T. & Burgess, P.W. (1991a). Deficits in strategy application following frontal lobe damage in man. Brain, 114, 727–741.Google Scholar
Shallice, T. & Burgess, P.W. (1991b). Higher-order cognitive impairments and frontal lobe lesions in man. In H.S. Levin, H.M. Eisenberg, & A.L. Benson, (Eds.), Frontal lobe function and injury (pp. 125–138). Oxford: Oxford University Press.
Shallice, T. & Burgess, P.W. (1993). Supervisory control of action and thought selection. In A. Baddeley & L. Weiskrantz (Eds.), Attention: Selection, awareness and control: A tribute to Donald Broadbent (pp. 171–187). Oxford: Clarendon Press.
Shallice, T. & Burgess, P.W. (1996). Domains of supervisory control and the temporal organisation of behaviour. Philosophical Transactions of the Royal Society B, 351, 1405–1412. [Reprinted in A.C. Roberts, T.W. Robbins, & L. Weiskrantz (Eds.), The prefrontal cortex: Executive and cognitive functions, pp. 22–35. Oxford, U.K.: Oxford University Press, 1998.]Google Scholar
Shallice, T., Burgess, P.W., Schon, F., & Baxter, D.M. (1989). The origins of utilisation behaviour. Brain, 112, 1587–1598.Google Scholar
Shallice, T. & Evans, M.E. (1978). The involvement of the frontal lobes in cognitive estimation. Cortex, 14, 294–303. (Reprinted in J. Davidoff (Ed.), Brain and behaviour: Critical concepts in psychology, Vol. 4, London: Routledge.)Google Scholar
Simons, J.S., Gilbert, S.J., Owen, A.M., Fletcher, P.C., & Burgess, P.W. (2005a). Distinct roles for lateral and medial anterior prefrontal cortex in contextual recollection. Journal of Neurophysiology, 94, 813–820.Google Scholar
Simons, J.S., Owen, A.M., Fletcher, P.C., & Burgess, P.W. (2005b). Anterior prefrontal cortex and the recollection of internally-generated thoughts. Neuropsychologia, 43, 1774–1783.Google Scholar
Simons, J.S., Schölvinck, M., Gilbert, S.J., Frith, C.D., & Burgess, P.W. (in press). Differential components of prospective memory? Evidence from fMRI. Neuropsychologia.
Stroop, J.R. (1935). Studies of interference in serial verbal reaction. Journal of Experimental Psychology, 18, 643–662.Google Scholar
Stuss, D.T., Binns, M.A., Murphey, K.J., & Alexander, M.P. (2002). Dissociations within the anterior attentional system: Effects of task complexity and irrelevant information on reaction time speed and accuracy. Neuropsychology, 16, 500–513.Google Scholar
Stuss, D.T., Floden, D., Alexander, M.P., Levine, B., & Katz, D. (2001). Stroop performance in focal lesion patients: Dissociation of processes and frontal lobe lesion location. Neuropsychologia, 39, 771–786.Google Scholar
Stuss, D.T., Levine, B., Alexander, M.P., Hong, J., Palumbo, C., Hamer, L., Murphy, K.J., & Izukawa, D. (2000). Wisconsin Card Sorting Test performance in patients with focal frontal and posterior brain damage: Effects of lesion location and test structure on separable cognitive processes. Neuropsychologia, 38, 388–402.Google Scholar
Stuss, D.T., Shallice, T., Alexander, M.P., & Picton, T.W. (1995). A multidisciplinary approach to anterior attentional functions. Annals of the New York Academy of Sciences, 769, 191–212.Google Scholar
Sukantarat, K.T., Burgess, P.W., Williamson, R.C.N., & Brett, S.J. (2005). Prolonged cognitive dysfunction in survivors of critical illness. Anaesthesia, 60, 847–853.Google Scholar
Teuber, H.-L. (1964). The riddle of frontal lobe function in man. In J.M. Warren & K. Akert (Eds.), The frontal granular cortex and behavior (pp. 410–477). New York: McGraw-Hill.
van den Broek, M.D., Bradshaw, C.M., & Szabadi, E. (1993). Utility of the Modified Wisconsin Card Sorting Test in neuropsychological assessment. British Journal of Clinical Psychology, 32, 333–343.Google Scholar
Ward, L.M. (2002). Dynamical cognitive science. Cambridge, MA: MIT Press.
Weinberg, G.M. (1975). An introduction to general systems thinking. New York: Wiley.
Weigl, E. (1927). Zur Psychologie sogenannter Abstraktionsprozesse. Zeitschrift fur Psychologie, 103, 2–45. [Translated by M. Rioch and reprinted as: On the psychology of so-called processes of abstraction. Journal of Abnormal and Social Psychology, 36, 3–33, 1948].Google Scholar
Welsh, M.C., Revilla, V., Strongin, D., & Kepler, M. (2000). Towers of Hanoi and London: Is the nonshared variance due to differences in task administration? Perceptual and Motor Skills, 90, 562–572.Google Scholar
Welsh, M.C., Satterlee-Cartmell, T., & Stine, M. (1999). Towers of Hanoi and London: Contribution of working memory and inhibition to performance. Brain and Cognition, 41, 231–234.Google Scholar
Wilson, B.A., Alderman, N., Burgess, P.W., Emslie, H., & Evans, J.J. (1996). Behavioural assessment of the dysexecutive syndrome. London: Harcourt Assessment.
Wilson, B.A., Cockburn, J., & Baddeley, A. (2003). The Rivermead Behavioural Memory Test (RBMT-II). London: Harcourt Assessment.
Wilson, B.A., Evans, J.J., Emslie, H., Alderman, N., & Burgess, P.W. (1998). The development of an ecologically valid test for assessing patients with a dysexecutive syndrome. Neuropsychological Rehabilitation, 8, 213–228.Google Scholar
Zakzanis, K.K. & Young, D.A. (2001). Memory impairment in abstinent MDMA (“Ecstasy”) users: A longitudinal investigation. Neurology, 56, 966–969.Google Scholar