Shaping multisensory action–space with tools: evidence from patients with cross-modal extinction
Introduction
Tools enable us to modify our action–space for various purposes, facilitating our daily interactions with objects in the environment (Beck, 1980, Napier, 1956). Also, non-human primates can spontaneously use tools for diverse purposes (e.g., branch-hook-use during locomotion and leaf-pads-use during feeding) and acquire a more ‘sophisticated’ control of the environment (Bradshaw, 1997; Fox & bin’Muhamad, 2002; Johnson-Frey, 2003). Effective tool-actions require sensing polymodal properties of (a) the agent, e.g., the effector's location and its motor properties; (b) the object, e.g. target object's location and its material properties; (c) the mean, e.g., the shape, size and functional properties of the tool. Here, we address several questions mainly related with the latter component, by investigating the effects that distinct experiences with various types of tools can produce on the multisensory representation of peri-personal space. Indeed, the sector of space surrounding the body (Rizzolatti, Fadiga, Fogassi, & Gallese, 1997) seems to be represented in primates by multisensory systems that share several functional commonalities (Làdavas, 2002; Rizzolatti, Matelli, & Pavesi, 1983).
In monkeys, multisensory processing of peri-hand space is achieved at the single cell level, as in bimodal visuo-tactile neurons that are activated both by touches delivered within the hand somatotopic receptive field (RF) and visual stimuli presented near the same RF (Bremmer, Schlack, Duhamel, Graf, & Fink, 2001; Duhamel et al., 1991, Duhamel et al., 1998; Graziano and Gross, 1995, Graziano and Gross, 1998; Rizzolatti, Luppino, & Matelli, 1998; Rizzolatti, Scandolara, Matelli, & Gentilucci, 1981). Typically, neuronal visual responses vary as a function of the distance of the visual stimulus from the hand somatosensory RF, increasing when the stimulus comes closer, and decreasing at farther distances (Duhamel, Colby, & Goldberg, 1998; Fogassi et al., 1996, Fogassi et al., 1999).
In humans, multisensory activity has been identified in possibly homologous cerebral areas by functional imaging studies (Bremmer, Schlack, Shah et al., 2001; Culham & Kanwisher, 2001; Grefkes, Weiss, Zilles, & Fink, 2002; Lloyd, Shore, Spence, & Calvert, 2003; Macaluso & Driver, 2001; Macaluso, Frith, & Driver, 2000; Weiss et al., 2000; Weiss, Marshall, Zilles, & Fink, 2003).
However, compelling evidence for functional similarities in representing peri-personal space in human and non-human primates has been provided by neuropsychological studies (di Pellegrino, Làdavas, & Farnè, 1997; Làdavas, di Pellegrino, Farnè, & Zeloni, 1998; Làdavas, Zeloni, & Farnè, 1998). In some right brain-damaged (RBD) patients with cross-modal extinction on double simultaneous stimulation (Bender, 1952; Mattingley, Driver, Beschin, & Robertson, 1997; Rapp & Hendel, 2003) contralesional tactile perception can be modulated by the distance at which ipsilesional (auditory or visual) stimuli are presented from a body-part (Farnè & Làdavas, 2002; Farnè, Demattè, & Làdavas, 2003). In the case of the hand, nearby visual stimuli (∼5 cm) are more efficient than farther ones (∼35 cm) in extinguishing contralesional tactile stimuli, this spatial modulation representing a behavioural hallmark of multisensory coding for peri-hand space (see for review Làdavas, 2002).
Because of its limited extension, peri-hand space would go little beyond the hand-reachable space when the arm is fully stretched-out. However, tools can make out-of-reach objects reachable by the hands. Furthermore, kinematics of prehensile actions performed directly by the hand or through a hand-held tool are remarkably similar (Jeannerod, 1986; Jeannerod, Arbib, Rizzolatti, & Sakata, 1995; Gentilucci, Roy, & Stefanini, 2004). The merging of sensory information from different locations (somatosensory inputs from the hand and visual inputs from the tool tip) may be useful for optimal tool-manipulation of objects that are not at hand. Indeed, multidisciplinary evidence widely supports the notion that tool-use can extend the multisensory coding of near space into far space (Làdavas & Farnè, 2004a; Maravita, Spence, & Driver, 2003; Calvert, Spence, & Stein, 2004). In a seminal work, Iriki, Tanaka, and Iwamura (1996) revealed that visual RFs of monkey's parietal neurons enlarged along the axis of a rake immediately after its use for retrieving distant food pellets. After prolonged passive tool-wielding, they also documented a backward shrinking of the same visual RFs, thus showing an activity-dependent re-mapping of far visual objects as nearer ones. Functional imaging studies have shown that the cerebral areas involved in tool-use are almost coincident with those involved in multisensory integration both in monkeys (Obayashi et al., 2001, Obayashi et al., 2002, Obayashi et al., 2003) and humans (Choi et al., 2001, Inoue et al., 2001, Moll et al., 2000; Grafton, Fadiga, Arbib, & Rizzolatti, 1997; Johnson et al., 2002; Johnson & Grafton 2003; Macaluso, Driver, & Frith, 2003).
In humans, Farnè and Làdavas (2000) reported behavioural evidence of tool incorporation in the multisensory peri-hand space by investigating cross-modal extinction in a group of RBD patients. Visual stimuli, presented at the tip of a 38 cm long rake statically held in the patients’ ipsilesional hand, induced more contralesional tactile extinction immediately after tool-use (retrieving distant objects with the rake for 5 min) than before tool-use. Stronger cross-modal extinction at the same far location after tool-use can be considered as evidence for the extension of peri-hand space along the tool axis. In the same study, backward contraction of the extended peri-hand space was also documented, as cross-modal extinction was reduced at pre-tool-use levels after a longer interval of tool inactivity. In a closely related single case study, Maravita, Husain, Clarke, and Driver (2001) similarly found that visuo-tactile extinction was stronger when the patient wielded the tip of a stick close to the visual stimulus than in absence of the stick, or when the stick was present but physically disconnected from the hand.
Several reports have now shown that tool-use can change space perception both in normal subjects (Riggio, Gawriszewski, & Umiltà, 1986; Maravita, Spence, Kennett, & Driver, 2002a; Yamamoto & Kitazawa, 2001), and neglect or extinction patients (Ackroyd, Riddoch, Humphreys, Nightingale, & Townsend, 2002; Berti & Frassinetti, 2000; Maravita, Clarke, Husain, & Driver, 2002; Pegna et al., 2001), thus raising several questions about the crucial determinants of peri-hand space extension. Is a passive change of the corporeal configuration (hand + tool) sufficient, or is some goal-directed activity needed? Is there a linear relationship between the length of a tool and the amount of peri-hand space extension? A crucial question concerns the specificity and the critical determinant of the extent to which peri-hand space increases. Does this depend upon the physical, absolute length of the tool, or the length of the tool that can be effectively used to act on objects? Here, we addressed such questions, within the same cross-modal paradigm, to shed further light onto the crucial determinants of tool dependent re-sizing of peri-hand space.
To answer the first question (passive/active experience), we investigated whether a relatively prolonged, passive exposure to a hand-held tool induces an elongation of the peri-hand space representation. In the light of the above cited neurophysiological and psychophysical findings (Iriki et al., 1996; Maravita, Spence et al., 2002; Maravita & Iriki, 2004), we expected that a passive increase in body size, physically extended by the hand-held tool, would not elongate peri-hand space representation along the tool axis.
Concerning the second question (tool-length/peri-hand space length relationships), we verified whether differently sized tools produce differential amounts of peri-hand space expansion. We predicted that, with respect to a fixed far location (60 cm from the hand), the use of a 30 cm long tool would extend peri-hand space to a much lesser degree, if any, than the use of a 60 cm long tool. Preliminary support to the first two hypotheses was also based on a single case study (Farnè, Bonifazi, & Làdavas, in press).
To answer the third question (absolute/operative length effects), we devised a hybrid tool that measured 60 cm of absolute length, but whose functionally effective part (the tines) was only 30 cm away from the hand (see Fig. 2c). We reasoned that, by dissociating within the same tool its physical aspect from its functional properties, it would be possible to demonstrate whether peri-hand space elongation is determined by the absolute length of a tool, or by its relative, functional length. In particular, if the key element is the operative length (i.e. 30 cm), then a comparable amount of peri-hand space extension should be found after use of the hybrid tool and a regular, 30 cm long tool (see Fig. 2b). Alternatively, if the absolute length (i.e. 60 cm) of the tool is crucial, then peri-hand space extension after hybrid tool-use should be similar to that obtained after the use of a regular 60 cm long tool (see Fig. 2a).
These hypotheses were tested in a group of RBD patients with left tactile extinction, who were examined in a series of conditions involving either passive exposure (1) or active use (2) of different types of tools.
Section snippets
Subjects
A group of eight neurological patients gave their informed consent to participate in the study, which was approved by the local ethical committee. All patients were right-handed and suffered a right unilateral lesion due to haemorrhagic or ischaemic cerebro-vascular accident, as confirmed by CT scan. Table 1 illustrates the anatomical areas involved by the lesion from seven patients, according to the method of Damasio and Damasio (1989). For one patient (P7), the scan film was not available,
Results
All the patients performed very well on catch trials, almost never producing false alarms (none exceeded two false alarms per session). They performed the task flawlessly when considering single tactile or visual stimuli presented in the right hemispace. To verify the presence and the severity of unimodal tactile extinction, the mean accuracy in detecting touches on the left hand, as a function of unilateral and bilateral tactile stimulation, was computed in percentage for all patients. A
Discussion
Three main findings were obtained by the present study. First, cross-modal extinction, as assessed 60 cm far from the patient's ipsilesional hand, did not increase after a 5 min period of passive exposure to a 60 cm long tool. Instead, cross-modal extinction assessed at an equally far distance increased after an equally long period of use of an equally long tool. Second, a differential amount of cross-modal extinction was induced, at the same 60 cm far location, by using tools that differed in
Acknowledgements
We wish to thank all the subjects for their collaboration. We thank A.C. Roy and F. Frassinetti for helpful discussions (F.F. also for lesion reconstruction), and S. Bonifazi for helping in data collection. This work was supported by grants from MIUR and RFO.
References (81)
- et al.
Space coding in primate posterior parietal cortex
NeuroImage
(2001) - et al.
Polymodal motion processing in posterior parietal and premotor cortex: A human fMRI study strongly implies equivalencies between humans and monkeys
Neuron
(2001) - et al.
Neuroimaging of cognitive functions in human parietal cortex
Current Opinion in Neurobiology
(2001) - et al.
Beyond the window: Multisensory representation of peripersonal space across a transparent barrier
International Journal of Psychophysiology
(2003) - et al.
Premotor cortex activation during observation and naming of familiar tools
NeuroImage
(1997) - et al.
Rapid learning of sequential tool use by macaque monkeys
Physiology & Behavior
(2003) - et al.
Spontaneous vocal differentiation of coo-calls for tools and food in Japanese monkeys
Neuroscience Research
(2003) - et al.
Activation in the ipsilateral posterior parietal cortex during tool-use: A PET study
NeuroImage
(2001) The formation of finger grip during prehension. A cortically mediated visuomotor pattern
Behavioral Brain Research
(1986)- et al.
Grasping objects: The cortical mechanisms of visuomotor transformation
Trends in Neuroscience
(1995)
What's so special about human tool use?
Neuron
From ‘acting on’ to ‘acting with’: The functional anatomy of object-oriented action schemata
Progress in Brain Research
Selective activation of parietofrontal circuit during implicitly imagined prehension
NeuroImage
“Near” and “far” in language and perception
Cognition
Functional and dynamic properties of visual peripersonal space in humans
Trends in Cognitive Sciences
Spatial attention and crossmodal interactions between vision and touch
Neuropsychologia
Multimodal spatial representations engaged in human parietal cortex during both saccadic and manual spatial orienting
Current Biology
Reaching with the tool extends visual–tactile interactions into far space: Evidence from cross-modal extinction
Neuropsychologia
Tool-use changes multimodal spatial interactions between vision and touch in normal humans
Cognition
Attentional competition between modalities: Extinction between touch and vision after right hemisphere damage
Neuropsychologia
Functional brain mapping of monkey tool use
NeuroImage
Fronto-parieto-cerebellar interaction associated with intermanual transfer of monkey tool-use learning
Neuroscience Letters
What is crossed in crossed-hand effects?
Acta Psychologica
The organization of the cortical motor system: New concepts
Electroencephalography and Clinical Neurophysiology
Afferent properties of periarcuate neurons in macaque monkeys. II. Visual responses
Behavioral Brain Research
Are action and perception in near and far space additive or interactive factors?
NeuroImage
Widening the sphere of influence: Using a tool to extend extrapersonal visual space in a patient with severe neglect
Neurocase
Disownership of left hand and objects related to it in a patient with right brain damage
Neuroreport
A simple test for visual neglect
Neurology
Language, gesture, and the developing brain
Developmental Psychobiology
Animal tool behavior: The use and manufacture of tools by animals
Disorders in perception
The body and the self
When far becomes near: Remapping of space by tool use
Journal of Cognitive Neuroscience
Human evoluton: A neuropsychological perspective
Functional magnetic resonance during pantomiming tool-use gestures
Experimental Brain Research
Lesion analysis in neuropsychology
Hemi-inattention in rehabilitation: The evolution of a rational remediation program
Advances in Neurology
Congruent representation of visual and somatosensory space in single neurons of monkey ventral intra-parietal area (VIP)
Cited by (194)
Evolutionary perspective on peripersonal space and perception
2023, Cognitive Archaeology, Body Cognition, and the Evolution of Visuospatial PerceptionParietal cortex and cumulative technological culture
2023, Cognitive Archaeology, Body Cognition, and the Evolution of Visuospatial PerceptionBody-tool integration: past, present, and future
2023, Cognitive Archaeology, Body Cognition, and the Evolution of Visuospatial PerceptionOn the psychological origins of tool use
2022, Neuroscience and Biobehavioral ReviewsSmartphone use can modify the body schema: An ERP study based on hand mental rotation task
2022, Computers in Human BehaviorSpatial hearing training in virtual reality with simulated asymmetric hearing loss
2024, Scientific Reports