Skip to main content
Top
Gepubliceerd in: Psychological Research 6/2015

28-10-2014 | Original Article

How do you hold your mouse? Tracking the compatibility effect between hand posture and stimulus size

Auteurs: Andrea Flumini, Laura Barca, Anna M. Borghi, Giovanni Pezzulo

Gepubliceerd in: Psychological Research | Uitgave 6/2015

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

In keeping with the idea that observing objects activates possible motor responses, several experiments revealed compatibility effects between the hand postures used to report a choice and some characteristics of the stimuli. The real-time dynamics of such compatibility effects are currently unknown. We tracked the time course of a categorization experiment requiring subjects to categorize as natural or artifact figures of big and small objects. Participants reported their choice using either a big mouse (requiring a power grip: a hand posture compatible with the grasping of big objects) or a small mouse (requiring a precision grip: a hand posture compatible with the grasping of small objects). We found a compatibility effect between the grip required by the mouse and the grip elicited by objects, even if it was irrelevant to the task. In a following experiment with the same paradigm, lexical stimuli failed to reproduce the same effect. Nevertheless, a compatibility effect mediated by the target-word category (artificial vs. natural) was observed. We discuss the results in the context of affordance effects literature and grounded theories of cognition.
Voetnoten
1
Time normalization is conducted because each trajectory tends to have a different length. To permit averaging and comparison across multiple trials, the xy coordinates of each trajectory are normalized into a given number of time-bin (in our study we choose 101 time-bin) using linear interpolation as available in the MouseTracker software (http://​psych.​nyu.​edu/​freemanlab/​mousetracker/​). Thus, each trajectory is normalized to have 101 time-bins, and each time-bin has a corresponding x and y coordinate.
 
2
The AUC of a trajectory is calculated as the geometric area between the actual trajectory and the idealized straight trajectory connecting the start with the end point of the movement. Area on the opposite side (i.e., in the direction away from the unselected response) of the straight line is calculated as negative area.
 
3
The MD of a trajectory is calculated as the largest perpendicular deviation between the actual trajectory and an idealized trajectory connecting the start and end point of the movement, out of all time-steps. Thus, the higher the MD, the more the trajectory deviated toward the unselected alternative.
 
Literatuur
go back to reference Anelli, F., Nicoletti, R., & Borghi, A. M. (2010). Categorization and action. What about object consistence? Acta Psychologica, 133, 203–211.CrossRefPubMed Anelli, F., Nicoletti, R., & Borghi, A. M. (2010). Categorization and action. What about object consistence? Acta Psychologica, 133, 203–211.CrossRefPubMed
go back to reference Borghi, A. M. (2012). Action language comprehension, affordances and goals. In Y. Coello & A. Bartolo (Eds.), Language and action in cognitive neuroscience. Contemporary topics in cognitive neuroscience series (pp. 125–143). East Sussex: Psychology Press. Borghi, A. M. (2012). Action language comprehension, affordances and goals. In Y. Coello & A. Bartolo (Eds.), Language and action in cognitive neuroscience. Contemporary topics in cognitive neuroscience series (pp. 125–143). East Sussex: Psychology Press.
go back to reference Borghi, A. M., Bonfiglioli, C., Lugli, L., Ricciardelli, P., Rubichi, S., & Nicoletti, R. (2007). Are visual stimuli sufficient to evoke motor information? Studies with hand primes. Neuroscience Letters, 411, 17–21.CrossRefPubMed Borghi, A. M., Bonfiglioli, C., Lugli, L., Ricciardelli, P., Rubichi, S., & Nicoletti, R. (2007). Are visual stimuli sufficient to evoke motor information? Studies with hand primes. Neuroscience Letters, 411, 17–21.CrossRefPubMed
go back to reference Borghi, A. M., Flumini, A., Natraj, N., & Wheaton, L. A. (2012). One hand, two objects: Emergence of affordance in contexts. Brain and Cognition, 80(1), 64–73.CrossRefPubMed Borghi, A. M., Flumini, A., Natraj, N., & Wheaton, L. A. (2012). One hand, two objects: Emergence of affordance in contexts. Brain and Cognition, 80(1), 64–73.CrossRefPubMed
go back to reference Borghi, A. M., & Riggio, L. (2009). Sentence comprehension and simulation of objects temporary, canonical and stable affordances. Brain Research, 1253, 117–128.CrossRefPubMed Borghi, A. M., & Riggio, L. (2009). Sentence comprehension and simulation of objects temporary, canonical and stable affordances. Brain Research, 1253, 117–128.CrossRefPubMed
go back to reference Bruhn, P., Huette, S., & Spivey, M. (2014). Degree of certainty modulates anticipatory processes in real time. Journal of Experimental Psychology: Human Perception and Performance, 40(2), 525–538.PubMed Bruhn, P., Huette, S., & Spivey, M. (2014). Degree of certainty modulates anticipatory processes in real time. Journal of Experimental Psychology: Human Perception and Performance, 40(2), 525–538.PubMed
go back to reference Bruzzo, A., Borghi, A. M., & Ghirlanda, S. (2008). Hand-object interaction in perspective. Neuroscience Letters, 441, 61–65.CrossRefPubMed Bruzzo, A., Borghi, A. M., & Ghirlanda, S. (2008). Hand-object interaction in perspective. Neuroscience Letters, 441, 61–65.CrossRefPubMed
go back to reference Bub, D. N., & Masson, M. E. J. (2010). Grasping beer mugs: on the dynamics of alignment effects induced by handled objects. Journal of Experimental Psychology: Human Perception and Performance, 36(2), 341–358. Bub, D. N., & Masson, M. E. J. (2010). Grasping beer mugs: on the dynamics of alignment effects induced by handled objects. Journal of Experimental Psychology: Human Perception and Performance, 36(2), 341–358.
go back to reference Bub, D. N., Masson, M. E. J., & Cree, G. S. (2008). Evocation of functional and volumetric gestural knowledge by objects and words. Cognition, 106, 27–58.CrossRefPubMed Bub, D. N., Masson, M. E. J., & Cree, G. S. (2008). Evocation of functional and volumetric gestural knowledge by objects and words. Cognition, 106, 27–58.CrossRefPubMed
go back to reference Craighero, L., Bello, A., Fadiga, L., & Rizzolatti, G. (2002). Hand action preparation influences the responses to hand pictures. Neuropsychologia, 40(5), 492–502.CrossRefPubMed Craighero, L., Bello, A., Fadiga, L., & Rizzolatti, G. (2002). Hand action preparation influences the responses to hand pictures. Neuropsychologia, 40(5), 492–502.CrossRefPubMed
go back to reference Creem, S. H., & Proffitt, D. R. (2001). Grasping objects by their handles: a necessary interaction between cognition and action. Journal of Experimental Psychology: Human Perception and Performance, 27, 218–228.PubMed Creem, S. H., & Proffitt, D. R. (2001). Grasping objects by their handles: a necessary interaction between cognition and action. Journal of Experimental Psychology: Human Perception and Performance, 27, 218–228.PubMed
go back to reference Fagioli, S., Hommel, B., & Schubotz, R. I. (2007). Intentional control of attention: action planning primes action-related stimulus dimensions. Psychological Research, 71(1), 22–29.CrossRefPubMed Fagioli, S., Hommel, B., & Schubotz, R. I. (2007). Intentional control of attention: action planning primes action-related stimulus dimensions. Psychological Research, 71(1), 22–29.CrossRefPubMed
go back to reference Ferri, F., Riggio, L., Gallese, V., & Costantini, M. (2011). Objects and their nouns in peripersonal space. Neuropsychologia, 49(13), 3519–3524.CrossRefPubMed Ferri, F., Riggio, L., Gallese, V., & Costantini, M. (2011). Objects and their nouns in peripersonal space. Neuropsychologia, 49(13), 3519–3524.CrossRefPubMed
go back to reference Fischer, M. H., & Zwaan, R. (2008). Embodied language: a review of the role of the motor system in language comprehension. The Quarterly Journal of Experimental Psychology, 61, 825–850.CrossRefPubMed Fischer, M. H., & Zwaan, R. (2008). Embodied language: a review of the role of the motor system in language comprehension. The Quarterly Journal of Experimental Psychology, 61, 825–850.CrossRefPubMed
go back to reference Flumini, A., & Santiago, J. (2013). Time (also) flies from left to right… if it is needed! In M. Knauff, M. Paulen, N. Sebanz, & I. Wachsmuth (Eds.), Proceedings of the 35th annual meeting of the Cognitive Science Society (pp. 2315–2320). Austin: Cognitive Science Society. Flumini, A., & Santiago, J. (2013). Time (also) flies from left to right… if it is needed! In M. Knauff, M. Paulen, N. Sebanz, & I. Wachsmuth (Eds.), Proceedings of the 35th annual meeting of the Cognitive Science Society (pp. 2315–2320). Austin: Cognitive Science Society.
go back to reference Freeman, J. B., & Ambady, N. (2010). MouseTracker: software for studying real-time mental processing using a computer mouse-tracking method. Behavioural Research Methods, 42(1), 226–241.CrossRef Freeman, J. B., & Ambady, N. (2010). MouseTracker: software for studying real-time mental processing using a computer mouse-tracking method. Behavioural Research Methods, 42(1), 226–241.CrossRef
go back to reference Gallese, V. (2008). Mirror neurons and the social nature of language: the neural exploitation hypothesis. Social Neuroscience, 3, 317–333.CrossRefPubMed Gallese, V. (2008). Mirror neurons and the social nature of language: the neural exploitation hypothesis. Social Neuroscience, 3, 317–333.CrossRefPubMed
go back to reference Gibson, J. J. (1979). The ecological approach to visual perception. Mahwah, NJ: Erlbaum. Gibson, J. J. (1979). The ecological approach to visual perception. Mahwah, NJ: Erlbaum.
go back to reference Goslin, J., Dixon, T., Fischer, M. H., Cangelosi, A., & Ellis, R. (2012). Electrophysiological examination of embodiment in vision and action. Psychological Science, 23(2), 152–157.CrossRefPubMed Goslin, J., Dixon, T., Fischer, M. H., Cangelosi, A., & Ellis, R. (2012). Electrophysiological examination of embodiment in vision and action. Psychological Science, 23(2), 152–157.CrossRefPubMed
go back to reference Hehman, E., Carpinella, C. M., Johnson, K. L., Leitner, J. B., & Freeman, J. B. (2014). Early processing of gendered facial cues predicts the electoral success of female politicians. Social Psychological and Personality Science. doi:10.1177/1948550614534701. Hehman, E., Carpinella, C. M., Johnson, K. L., Leitner, J. B., & Freeman, J. B. (2014). Early processing of gendered facial cues predicts the electoral success of female politicians. Social Psychological and Personality Science. doi:10.​1177/​1948550614534701​.
go back to reference Hehman, E., Stolier, R. M., & Freeman, J. B. (2014). Advanced mouse-tracking analytic techniques for enhancing psychological science. Group Processes and Intergroup Relations, 1–18. doi:10.1177/1368430214538325. Hehman, E., Stolier, R. M., & Freeman, J. B. (2014). Advanced mouse-tracking analytic techniques for enhancing psychological science. Group Processes and Intergroup Relations, 1–18. doi:10.​1177/​1368430214538325​.
go back to reference Hommel, B., Müsseler, J., Aschersleben, G., & Prinz, W. (2001). The theory of event coding (TEC): a framework for perception and action planning. Behavioral and brain sciences, 24(5), 849–878.CrossRefPubMed Hommel, B., Müsseler, J., Aschersleben, G., & Prinz, W. (2001). The theory of event coding (TEC): a framework for perception and action planning. Behavioral and brain sciences, 24(5), 849–878.CrossRefPubMed
go back to reference Jax, S. A., & Buxbaum, L. J. (2010). Response interference between functional and structural actions linked to the same familiar object. Cognition, 115, 350–355.PubMedCentralCrossRefPubMed Jax, S. A., & Buxbaum, L. J. (2010). Response interference between functional and structural actions linked to the same familiar object. Cognition, 115, 350–355.PubMedCentralCrossRefPubMed
go back to reference Jirak, D., Menz, M., Buccino, G., Borghi, A. M., & Binkofski, F. (2010). Grasping language. A short story on embodiment. Consciousness and Cognition, 19, 711–720.CrossRefPubMed Jirak, D., Menz, M., Buccino, G., Borghi, A. M., & Binkofski, F. (2010). Grasping language. A short story on embodiment. Consciousness and Cognition, 19, 711–720.CrossRefPubMed
go back to reference Kalénine, S., Shapiro, A. D., Flumini, A., Borghi, A. M., & Buxbaum, L. J. (2014). Visual context modulates potentiation of grasp types during semantic object categorization. Psychonomic Bulletin & Review, 21(3), 645–651. Kalénine, S., Shapiro, A. D., Flumini, A., Borghi, A. M., & Buxbaum, L. J. (2014). Visual context modulates potentiation of grasp types during semantic object categorization. Psychonomic Bulletin & Review, 21(3), 645–651.
go back to reference Lee, C. L., Middleton, E., Mirman, D., Kalénine, S., & Buxbaum, L. J. (2013). Incidental and context-responsive activation of structure- and function-based action features during object identification. Journal of Experimental Psychology: Human Perception and Performance, 39(1), 257–270.PubMedCentralPubMed Lee, C. L., Middleton, E., Mirman, D., Kalénine, S., & Buxbaum, L. J. (2013). Incidental and context-responsive activation of structure- and function-based action features during object identification. Journal of Experimental Psychology: Human Perception and Performance, 39(1), 257–270.PubMedCentralPubMed
go back to reference Meteyard, L., Cuadrado, S. R., Bahrami, B., & Vigliocco, G. (2012). Coming of age: a review of embodiment and the neuroscience of semantics. Cortex, 48, 788–804.CrossRefPubMed Meteyard, L., Cuadrado, S. R., Bahrami, B., & Vigliocco, G. (2012). Coming of age: a review of embodiment and the neuroscience of semantics. Cortex, 48, 788–804.CrossRefPubMed
go back to reference Lepora, N., & Pezzulo, G. (submitted). Embodied Choice: How action influences perceptual decision making. Lepora, N., & Pezzulo, G. (submitted). Embodied Choice: How action influences perceptual decision making.
go back to reference Myachykov, A., Ellis, R., Cangelosi, A., & Fischer, M. H. (2013). Visual and linguistic cues to graspable objects. Experimental Brain Research, 229(4), 545–559.CrossRefPubMed Myachykov, A., Ellis, R., Cangelosi, A., & Fischer, M. H. (2013). Visual and linguistic cues to graspable objects. Experimental Brain Research, 229(4), 545–559.CrossRefPubMed
go back to reference Milner, A. D., & Goodale, M. A., (1995). The visual brain in action. Oxford: Oxford University Press. Milner, A. D., & Goodale, M. A., (1995). The visual brain in action. Oxford: Oxford University Press.
go back to reference Natraj, N., Poole, V., Mizelle, J. C., Flumini, A., Borghi, A. M., & Wheaton, L. A. (2013). Context and hand posture modulate the neural dynamics of tool-object perception. Neuropsychologia, 51(3), 506–519.CrossRefPubMed Natraj, N., Poole, V., Mizelle, J. C., Flumini, A., Borghi, A. M., & Wheaton, L. A. (2013). Context and hand posture modulate the neural dynamics of tool-object perception. Neuropsychologia, 51(3), 506–519.CrossRefPubMed
go back to reference Oztop, E., & Arbib, M. A. (2002). Schema design and implementation of the grasp-related mirror neuron system. Biological Cybernetics, 87(2), 116–140.CrossRefPubMed Oztop, E., & Arbib, M. A. (2002). Schema design and implementation of the grasp-related mirror neuron system. Biological Cybernetics, 87(2), 116–140.CrossRefPubMed
go back to reference Pezzulo, G., Barsalou, L. W., Cangelosi, A., Fischer, M. H., McRae, K., & Spivey, M. J. (2013). Computational grounded cognition: a new alliance between grounded cognition and computational modeling. Frontiers in Psychology, 3, 612.PubMedCentralCrossRefPubMed Pezzulo, G., Barsalou, L. W., Cangelosi, A., Fischer, M. H., McRae, K., & Spivey, M. J. (2013). Computational grounded cognition: a new alliance between grounded cognition and computational modeling. Frontiers in Psychology, 3, 612.PubMedCentralCrossRefPubMed
go back to reference Pezzulo, G., Candidi, M., Dindo, H., & Barca, L. (2013). Action simulation in the human brain: twelve questions. New Ideas in Psychology, 31(3), 270–290.CrossRef Pezzulo, G., Candidi, M., Dindo, H., & Barca, L. (2013). Action simulation in the human brain: twelve questions. New Ideas in Psychology, 31(3), 270–290.CrossRef
go back to reference Pezzulo, G., & Castelfranchi, C. (2009). Thinking as the control of imagination: a conceptual framework for goal-directed systems. Psychological Research, 73(4), 559–577.CrossRefPubMed Pezzulo, G., & Castelfranchi, C. (2009). Thinking as the control of imagination: a conceptual framework for goal-directed systems. Psychological Research, 73(4), 559–577.CrossRefPubMed
go back to reference Pezzulo, G., Barsalou, L. W., Cangelosi, A., Fischer, M. H., McRae, K., & Spivey, M. (2011). The mechanics of embodiment: a dialogue on embodiment and computational modeling. Frontiers in Cognition, 2(5), 1–21. Pezzulo, G., Barsalou, L. W., Cangelosi, A., Fischer, M. H., McRae, K., & Spivey, M. (2011). The mechanics of embodiment: a dialogue on embodiment and computational modeling. Frontiers in Cognition, 2(5), 1–21.
go back to reference Quinton, J. C., Catenacci, N., Barca, L., & Pezzulo, G. (2014). The cat is on the mat. Or is it a dog? Dynamic competition in perceptual decision making. IEEE Transactions on Systems, Man and Cybernetics, 44(5), 539–551.CrossRef Quinton, J. C., Catenacci, N., Barca, L., & Pezzulo, G. (2014). The cat is on the mat. Or is it a dog? Dynamic competition in perceptual decision making. IEEE Transactions on Systems, Man and Cybernetics, 44(5), 539–551.CrossRef
go back to reference Riggio, L., Iani, C., Gherri, E., Benatti, F., Rubichi, S., & Nicoletti, R. (2008). The role of attention in the occurrence of the affordance effect. Acta Psychologica, 127, 449–458.CrossRefPubMed Riggio, L., Iani, C., Gherri, E., Benatti, F., Rubichi, S., & Nicoletti, R. (2008). The role of attention in the occurrence of the affordance effect. Acta Psychologica, 127, 449–458.CrossRefPubMed
go back to reference Spivey, M. (2007). The continuity of mind. New York: Oxford University Press. Spivey, M. (2007). The continuity of mind. New York: Oxford University Press.
go back to reference Spivey, M., Grosjean, M., & Knoblich, G. (2005). Continuous attraction toward phonological competitors. Proceedings of the National Academy of Sciences of the USA, 102(29), 10393–10398. Spivey, M., Grosjean, M., & Knoblich, G. (2005). Continuous attraction toward phonological competitors. Proceedings of the National Academy of Sciences of the USA, 102(29), 10393–10398.
go back to reference Tucker, M., & Ellis, R. (1998). On the relations between seen objects and components of potential actions. Journal of Experimental Psychology, Human perception and performance, 24(3), 830.CrossRefPubMed Tucker, M., & Ellis, R. (1998). On the relations between seen objects and components of potential actions. Journal of Experimental Psychology, Human perception and performance, 24(3), 830.CrossRefPubMed
go back to reference Tucker, M., & Ellis, R. (2001). The potentiation of grasp types during visual object categorization. Visual Cognition, 8, 769–800.CrossRef Tucker, M., & Ellis, R. (2001). The potentiation of grasp types during visual object categorization. Visual Cognition, 8, 769–800.CrossRef
go back to reference Tucker, M., & Ellis, R. (2004). Action priming by briefly presented objects. Acta Psychologica, 116, 185–203.CrossRefPubMed Tucker, M., & Ellis, R. (2004). Action priming by briefly presented objects. Acta Psychologica, 116, 185–203.CrossRefPubMed
go back to reference Vainio, L., Symes, E., Ellis, R., Tucker, M., & Ottoboni, G. (2008). On the relations between action planning, object identification, and motor representations of observed actions and objects. Cognition, 108, 444–465.CrossRefPubMed Vainio, L., Symes, E., Ellis, R., Tucker, M., & Ottoboni, G. (2008). On the relations between action planning, object identification, and motor representations of observed actions and objects. Cognition, 108, 444–465.CrossRefPubMed
go back to reference Vogt, S., Taylor, P., & Hopkins, B. (2003). Visuo-motor priming by pictures of hand postures: perspective matters. Neuropsychologia, 41, 941–951.CrossRefPubMed Vogt, S., Taylor, P., & Hopkins, B. (2003). Visuo-motor priming by pictures of hand postures: perspective matters. Neuropsychologia, 41, 941–951.CrossRefPubMed
go back to reference Yoon, E. Y., Humphreys, W. W., & Riddoch, M. J. (2010). The paired-object affordance effect. Journal of Experimental Psychology: Human Perception and Performance, 36, 812–824.PubMed Yoon, E. Y., Humphreys, W. W., & Riddoch, M. J. (2010). The paired-object affordance effect. Journal of Experimental Psychology: Human Perception and Performance, 36, 812–824.PubMed
Metagegevens
Titel
How do you hold your mouse? Tracking the compatibility effect between hand posture and stimulus size
Auteurs
Andrea Flumini
Laura Barca
Anna M. Borghi
Giovanni Pezzulo
Publicatiedatum
28-10-2014
Uitgeverij
Springer Berlin Heidelberg
Gepubliceerd in
Psychological Research / Uitgave 6/2015
Print ISSN: 0340-0727
Elektronisch ISSN: 1430-2772
DOI
https://doi.org/10.1007/s00426-014-0622-0

Andere artikelen Uitgave 6/2015

Psychological Research 6/2015 Naar de uitgave