Does tool-related fMRI activity within the intraparietal sulcus reflect the plan to grasp?
Introduction
The concept of affordances was first articulated by James Gibson (1979) who argued that an animal’s perception of its surroundings includes a description of how the environment and the objects within it influence the animal’s potential for action. Following these ideas, it was suggested that simply seeing an object automatically evokes movement representations consistent with the possible actions that could be performed on that particular object given its shape, size, orientation, and location. In other words, objects potentiate certain actions depending on their intrinsic and extrinsic visual properties and this translates into an increased level of neuronal activity within the representations underlying those actions. Some of the most compelling evidence in support of this proposal has come from neurophysiological studies in the macaque monkey. Several of these investigations have shown that grasping-related neurons in both the ventral premotor cortex (area F5) and the anterior intraparietal sulcus (area AIP) not only respond during the act of grasping but also during the passive viewing of graspable objects (Murata et al., 1997, Murata et al., 2000, Taira et al., 1990). Importantly, many of these visual responses were congruent with the motor properties encoded by the neurons. That is, those objects for which the cells responded most strongly during grasping actions were often the same objects that evoked the highest responses during viewing. These results indicate that neuronal populations dedicated to mediating specific object-directed actions can also be engaged during the simple viewing of objects in the absence of any overt movement.
More recently, some intriguing behavioral results from human psychophysical studies also suggest that simply viewing objects can activate motor representations consistent with the particular actions that the objects most strongly afford (Craighero et al., 2002, Derbyshire et al., 2006, Ellis and Tucker, 2000, Helbig et al., 2006, Symes et al., 2007, Tucker and Ellis, 1998, Tucker and Ellis, 2004, Vainio et al., 2006). For example, Tucker and Ellis (2004) showed that responses during an object categorization task are influenced by the graspable properties of the object. The authors had previously developed a response apparatus that simulated both a precision-type grasp (which requires the opposition of the thumb and index finger) and a power-type grasp (which requires the opposition of the fingers and the palm of the hand) (Ellis and Tucker, 2000). Using this apparatus they instructed subjects to decide if an object, presented in picture format, was man-made or natural. Responses that simulated a precision grasp were facilitated if the object under question afforded a precision grasp (e.g., a mushroom) and responses that simulated a power grasp were facilitated if the object under question afforded a power grasp (e.g., a cucumber). Moreover, these effects were also observed when the stimuli were not the images of the objects but rather simply their written names. This last finding suggests that simply thinking about the concept of an object is enough to automatically evoke motor representations associated with grasping it.
In parallel with this line of research, human neuroimaging studies have described a number of areas within the posterior parietal cortex (PPC) as specialized for the control of particular actions (for reviews, see Culham et al., 2006, Culham and Valyear, 2006). Analogous to the functional organization within the macaque monkey PPC (for review, see Colby and Goldberg, 1999), a discrete region at the anterior end of the intraparietal sulcus (IPS) has been implicated in the guidance and control of object-directed grasping (Binkofski et al., 1998, Culham et al., 2003, Frey et al., 2005). Activity within this region, referred to as human area AIP, was elevated during grasping actions relative to reaching actions (Culham et al., 2003) and the grasp-related activation was not merely due to somatosensory stimulation (Culham, 2004). Critical to the current discussion, this grasping-related area also appears to respond during object viewing in the absence of any movement (Grèzes et al., 2003a, Grèzes et al., 2003b, Grèzes and Decety, 2002). These findings have been interpreted as evidence in support of the idea that an object’s visual affordances can activate specific motor representations; in this case, an object’s graspable properties activate motor modules specialized for grasping.
Other imaging research has reliably shown selectivity for familiar tools within the PPC, particularly in the left hemisphere (for reviews, see Johnson-Frey, 2004, Lewis, 2006). Some of these activation foci appear close to area AIP and it has been suggested that this activity relates to the hand actions associated with using familiar tools (Chao and Martin, 2000). However, perhaps what becomes activated within the PPC is not so much those motor representations specialized for using tools but rather those more generally associated with object-directed grasping. In other words, perhaps this tool-related activity reflects processing within the visuomotor system specialized for grasping, driven by the perceived ‘graspability’ of tools. A recent imaging study by Creem-Regehr and Lee (2005) aimed to test this possibility. The authors compared the activations associated with novel graspable objects to those associated with familiar tools. Their results revealed that during passive viewing, tool stimuli exclusively activated motor-related parieto-frontal areas. These results were interpreted to reflect an interaction between the functional identity of the tool and its perceived potential for action. However, since the two stimulus categories also differed in their overall familiarity, including the strength and extent of the sensorimotor experiences associated with them, perhaps the pattern of activity that was observed simply reflected these differences. Moreover, the unfamiliar “graspable” shapes were presented as 2D images with no cues as to their real world size and thus their graspability. Therefore, as the authors noted, it was uncertain whether the subjects perceived the shapes as graspable or not.
The purpose of the present study was to further investigate whether the intraparietal activity associated with tool naming simply reflects the fact that tools afford grasping, whereas typical control stimuli do not (e.g., Chao and Martin, 2000, used images of animals as control stimuli and animals do not typically afford grasping). To evaluate this possibility we measured responses during the naming of familiar objects that varied with respect to their graspability. Within each individual, we identified the intraparietal area selective for naming images of tools (vs. animals, as in Chao and Martin, 2000) and then examined the activity within this area during the naming of familiar tools, familiar graspable objects, and familiar non-graspable objects. The aim here was to evaluate whether or not responses within this area would generalize to other objects that were graspable but did not have the functional properties of tools. We also examined the combined group data using a whole-volume voxel-wise approach. To identify areas showing selectivity for tools we contrasted naming tools vs. naming graspable objects, and to identify areas sensitive to object graspability we contrasted naming graspable vs. non-graspable objects. At the same time, in a subset of subjects, we compared parietal activations associated with real grasping actions to those associated with naming tools. If the tool-related activity within the intraparietal cortex was being driven by the graspable properties of tools, perhaps reflecting the automatic activation of motor programs associated with grasping, then we would predict the following: (i) responses within the region should also be elevated during the naming and viewing of other graspable objects compared with non-graspable objects; and (ii) the region should show significant spatial overlap with area AIP as defined by real grasping (vs. reaching) actions. Alternatively, if the activity within this region was to reflect processing specifically related to tools then we would expect the area to respond selectively to our tool stimuli and not to our other categories of objects and perhaps also to be distinct from AIP.
Preliminary data from this project have previously been presented in abstract form.
Section snippets
Subjects
Eleven neurologically intact individuals participated in the study (five female; age range of 22–35). All were right-handed, with normal or corrected-to-normal visual acuity and all were naive to the goals of the study. Each participant provided informed consent according to procedures approved by the University of Western Ontario Health Sciences Review Ethics Board.
Stimuli
Visual stimuli were presented using a PC laptop connected to a video projector. Images were shown on a rear-projection screen
ROI analysis
All three ROIs that had been identified using an independent localizer (naming tools vs. animals) – the left AIPC, the left LTOC, and the left IFC – demonstrated a preference for tools but not graspable objects in the experimental runs (see Fig. 2). Specifically, in each of these three areas, the activation during the naming of tools was higher than during the naming of graspable objects; however, activation levels during the naming of graspable and non-graspable objects were comparable.
Most
Discussion
The goal of this study was to evaluate if the intraparietal activity driven by tool naming could be accounted for simply by the graspable nature of tools (compared to control stimuli used in previous studies, such as animals) or whether it was due to additional factors such as the functionality of tools. Our results revealed an area within the left intraparietal cortex that was active for tools but not other graspable objects, and responses to graspable and non-graspable objects did not differ.
References (92)
- et al.
Parallel visual motion processing streams for manipulable objects and human movements
Neuron
(2002) - et al.
Integration of auditory and visual information about objects in superior temporal sulcus
Neuron
(2004) - et al.
The role of ventral premotor cortex in action execution and action understanding
J. Physiol. (Paris)
(2006) - et al.
Distinctions between manipulation and function knowledge of objects: evidence from functional magnetic resonance imaging
Brain Res. Cogn. Brain Res.
(2005) - et al.
Cognitive representations of hand posture in ideomotor apraxia
Neuropsychologia
(2003) - et al.
Deficient internal models for planning hand-object interactions in apraxia
Neuropsychologia
(2005) - et al.
On beyond mirror neurons: internal representations subserving imitation and recognition of skilled object-related actions in humans
Brain Res. Cogn. Brain Res.
(2005) - et al.
Representation of manipulable man-made objects in the dorsal stream
NeuroImage
(2000) - et al.
Hand action preparation influences the responses to hand pictures
Neuropsychologia
(2002) - et al.
Neural representations of graspable objects: are tools special?
Brain Res Cogn. Brain Res.
(2005)
Human parietal cortex in action
Curr. Opin. Neurobiol.
The role of parietal cortex in visuomotor control: what have we learned from neuroimaging?
Neuropsychologia
Neural correlates of naming actions and of naming spatial relations
NeuroImage
How we interact with objects: learning from brain lesions
Trends Cogn. Sci.
The potentiation of two components of the reach-to-grasp action during object categorisation in visual memory
Acta Psychol. (Amst)
Cortical topography of human anterior intraparietal cortex active during visually guided grasping
Brain Res. Cogn. Brain Res.
The role of the dorsal stream for gesture production
NeuroImage
Commentary on: divide and conquer; a defence of functional localisers
NeuroImage
A critique of functional localisers
NeuroImage
Premotor cortex activation during observation and naming of familiar tools
NeuroImage
Crossmodal processing of object features in human anterior intraparietal cortex: an fMRI study implies equivalencies between humans and monkeys
Neuron
Does visual perception of object afford action? Evidence from a neuroimaging study
Neuropsychologia
Activations related to “mirror” and “canonical” neurones in the human brain: an fMRI study
NeuroImage
Eccentricity bias as an organizing principle for human high-order object areas
Neuron
Large-scale mirror-symmetry organization of human occipito-temporal object areas
Neuron
Extension of corticocortical afferents into the anterior bank of the intraparietal sulcus by tool-use training in adult monkeys
Neuropsychologia
Tool-use learning induces BDNF expression in a selective portion of monkey anterior parietal cortex
Brain Res. Mol. Brain Res.
Tool-use learning selectively induces expression of brain-derived neurotrophic factor, its receptor trkB, and neurotrophin 3 in the intraparietal multisensory cortex of monkeys
Brain Res. Cogn. Brain Res.
Differential effects of viewpoint on object-driven activation in dorsal and ventral streams
Neuron
The neural bases of complex tool use in humans
Trends Cogn. Sci.
Actions or hand-object interactions? Human inferior frontal cortex and action observation
Neuron
An efficient algorithm for topologically correct segmentation of the cortical sheet in anatomical mr volumes
NeuroImage
The topography of high-order human object areas
Trends Cogn. Sci.
Naming of animals and tools: a functional magnetic resonance imaging study of categorical differences in the human brain areas commonly used for naming visually presented objects
Neurosci. Lett.
Orientation sensitivity to graspable objects: an fMR adaptation study
NeuroImage
The cortical motor system
Neuron
Divide and conquer: a defense of functional localizers
NeuroImage
Dissociation between ventral and dorsal fMRI activation during object and action recognition
Neuron
A selective impairment of hand posture for object utilization in apraxia
Cortex
Visual object affordances: object orientation
Acta Psychol. (Amst)
Action priming by briefly presented objects
Acta Psychol. (Amst)
A double dissociation between sensitivity to changes in object identity and object orientation in the ventral and dorsal visual streams: a human fMRI study
Neuropsychologia
FMRI responses to video and point-light displays of moving humans and manipulable objects
J. Cogn. Neurosci.
Unraveling multisensory integration: patchy organization within human STS multisensory cortex
Nat. Neurosci.
Human anterior intraparietal area subserves prehension: a combined lesion and functional MRI activation study
Neurology
A fronto-parietal circuit for object manipulation in man: evidence from an fMRI-study
Eur. J. Neurosci.
Cited by (112)
Body-tool integration: past, present, and future
2023, Cognitive Archaeology, Body Cognition, and the Evolution of Visuospatial PerceptionDecoding stimuli (tool-hand) and viewpoint invariant grasp-type information
2021, CortexCitation Excerpt :Alternatively, it could simply be that first person perspectives show stronger effects during relatively passive observation than third person perspectives (but note that paired tests did not reveal a significant accuracy difference between 1pp and 3pp for left PPC). Our tool-hand invariant finding is consistent with previous literature showing that tool processing is left lateralized in PPC (Almeida, Fintzi, & Mahon, 2013; Almeida et al., 2017; Buchwald et al., 2018; Castiello, 2005; Culham & Valyear, 2006; Gallivan & Culham, 2015; Gallivan & Goodale, 2018; Garcea et al., 2016; Gerbella, Rozzi, & Rizzolatti, 2017; Ishibashi et al., 2016; Jacobs, Danielmeier, & Frey, 2010; Johnson-Frey, 2004; Kristensen, Garcea, Mahon, & Almeida, 2016; Lewis, 2006; Mahon, Kumar, & Almeida, 2013; Rizzolatti & Matelli, 2003; Sakreida et al., 2016; Valyear et al., 2007, 2012). Specifically, it has been shown that left PPC (in particular SMG) is engaged during tool action observation (Peeters et al., 2009, 2013), contain stable tool affordances (Sakreida et al., 2016), and if damaged produces deficits in tool use and pantomiming (Almeida et al., 2018; Buxbaum, Kyle, Grossman, & Coslett, 2007; Goldenberg & Hagmann, 1998; Sunderland, Wilkins, Dineen, & Dawson, 2013).
Priming of grasp affordance in an ambiguous object: evidence from ERPs, source localization, and motion tracking
2021, HeliyonCitation Excerpt :However, if unfamiliar but highly graspable tools are used instead of shapes, this difference may disappear, at least at the behavioral level (Vingerhoets et al., 2009), while other research shows a decrease in the visuomotor response due to familiarity with the functional role of certain objects (Handy et al., 2006). Moreover, it seems that processes related to object graspability and function are mediated by different neural mechanisms (Valyear et al., 2007). They may also operate at different time scales, with early grasp-related motor activations observed simultaneously with the frontal affordance-related negativity, while activations in areas supposed to play a role in processing the functional significance of tools (e.g., the supramarginal gyrus) appear to operate later (Proverbio et al., 2013).
Post-stroke object affordances: An EEG investigation
2020, Brain and Cognition