Top

Gepubliceerd in:

24-06-2024 | Research

The contribution of eye gaze and movement kinematics to the expression and identification of social intention in object-directed motor actions

Auteurs: Maria Francesca Gigliotti, Laurent Ott, Angela Bartolo, Yann Coello

Gepubliceerd in: Psychological Research | Uitgave 8/2024

Abstract

The intention to include another person in an interaction (i.e., social intention) is known to influence the spatio-temporal characteristics of motor performances. However, the interplay between these kinematic variations and the social cues provided by eye gaze has not been properly assessed yet. In the present study, we tested whether limiting the access to eye gaze altered the motor-related effects of social intention on motor performances. In a dyadic interaction, the agents’ task was to displace a dummy glass to a new position with the intention to fill it themselves (personal intention) or having it filled by the observers facing them (social intention). The observers performed their action only when they were able to identify a social intention in agents’ action. The task was performed while having access to observers’ eye gaze or not, through the manipulation of an occluder. Results showed an effect of social intention on agents’ motor performances, that induced an amplification of the kinematic spatio-temporal parameters. Such amplification was smaller when the observers’ eye gaze was not available. In this latter condition, the identification of the social intention in the observed actions was impaired. Altogether, the results suggest that the presence of eye gaze cues contributes significantly to the success of social interaction, by facilitating the expression and the understanding of social intentions through the kinematics of object-directed actions.

volgende artikel Not to follow because of distrust: perceived trust modulates the gaze cueing effect

Ansuini, C., Giosa, L., Turella, L., Altoè, G., & Castiello, U. (2008). An object for an action, the same object for other actions: Effects on hand shaping. Experimental Brain Research, 185(1), 111–119. https://doi.org/10.1007/s00221-007-1136-4CrossRefPubMed

Argyle, M., & Dean, J. (1965). Eye-Contact, Distance and Affiliation. Sociometry, 28(3), 289–304. https://doi.org/10.2307/2786027CrossRefPubMed

Barr, D. J., Levy, R., Scheepers, C., & Tily, H. J. (2013). Random effectsstructure for confirmatory hypothesis testing: Keep it maximal. Journal of Memory and Language, 68(3), 255–278. https://doi.org/10.1016/j.jml.2012.11.001.RandomCrossRef

Bartolo, A., Claisse, C., Gallo, F., Ott, L., Sampaio, A., & Nandrino, J. L. (2019). Gestures convey different physiological responses when performed toward and away from the body. Scientific Reports, 9(1), 1–10. https://doi.org/10.1038/s41598-019-49318-3CrossRef

Bates, D., Mächler, M., Bolker, B. M., & Walker, S. C. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67(1). https://doi.org/10.18637/jss.v067.i01

Bates, D., Kliegl, R., Vasishth, S., & Baayen, R. H. (2015a). Parsimonious mixed models. ArXiv Preprint ArXiv:1506.04967.

Becchio, C., Sartori, L., Bulgheroni, M., & Castiello, U. (2008a). Both your intention and mine are reflected in the kinematics of my reach-to-grasp movement. Cognition, 106(2), 894–912. https://doi.org/10.1016/j.cognition.2007.05.004CrossRefPubMed

Becchio, C., Sartori, L., Bulgheroni, M., & Castiello, U. (2008b). The case of Dr. Jekyll and Mr. Hyde: A kinematic study on social intention. Cognition, 17(3), 557–564. https://doi.org/10.1016/j.concog.2007.03.003CrossRef

Becchio, C., Cavallo, A., Begliomini, C., Sartori, L., Feltrin, G., & Castiello, U. (2012). From mirroring to mentalizing. Neuroimage, 61(1), 240–248. https://doi.org/10.1016/j.neuroimage.2012.03.013CrossRefPubMed

Binetti, N., Harrison, C., Coutrot, A., Johnston, A., & Mareschal, I. (2016). Pupil dilation as an index of preferred mutual gaze duration. Royal Society Open Science, 3(7). https://doi.org/10.1098/rsos.160086

Cartaud, A., Quesque, F., & Coello, Y. (2020). Wearing a face mask against Covid-19 results in a reduction of social distancing. Plos One, 15(12 December), 1–9. https://doi.org/10.1371/journal.pone.0243023CrossRef

Cavallo, A., Koul, A., Ansuini, C., Capozzi, F., & Becchio, C. (2016). Decoding intentions from movement kinematics. Scientific Reports, 6, 37036. https://doi.org/10.1038/srep37036CrossRefPubMedPubMedCentral

Cook, M., & Smith, J. M. C. (1975). The role of gaze in impression formation. British Journal of Social and Clinical Psychology, 14(1), 19–25. https://doi.org/10.1111/j.2044-8260.1975.tb00144.xCrossRefPubMed

Corballis, M. C. (2003). From mouth to hand: Gesture, speech, and the evolution of right-handedness. Behavioral and Brain Sciences, 26(2), 199–208. https://doi.org/10.1017/S0140525X03000062CrossRefPubMed

Dargue, N., & Sweller, N. (2020). Two hands and a tale: When gestures benefit adult narrative comprehension. Learning and Instruction, 68(March), 101331. https://doi.org/10.1016/j.learninstruc.2020.101331CrossRef

Dargue, N., Sweller, N., & Jones, M. P. (2019). When our hands help us understand: A meta-analysis into the effects of gesture on comprehension. Psychological Bulletin, 145(8), 765–784. https://doi.org/10.1037/bul0000202CrossRefPubMed

Drijvers, L., & Özyürek, A. (2017). Visual context enhanced: The joint contribution of iconic gestures and visible speech to degraded speech comprehension. Journal of Speech Language and Hearing Research, 60(1), 212–222. https://doi.org/10.1044/2016_JSLHR-H-16-0101CrossRef

Drijvers, L., Vaitonytė, J., & Özyürek, A. (2019). Degree of Language Experience modulates visual attention to visible Speech and Iconic gestures during Clear and degraded Speech Comprehension. Cognitive Science, 43(10). https://doi.org/10.1111/cogs.12789

Driver, I. V., Davis, J., Ricciardelli, G., Kidd, P., Maxwell, P., E., & Baron-Cohen, S. (1999). Gaze Perception triggers Reflexive Visuospatial Orienting. Visual Cognition, 6(5), 509–540. https://doi.org/10.1080/135062899394920CrossRef

Efran, J. S. (1968). Looking for approval: Effects on visual behavior of approbation from persons differing in importance. Psychology, 10(1), 21–25. https://doi.org/10.1037/h0026383CrossRef

Elsner, C., Falck-Ytter, T., & Gredebäck, G. (2012). Humans anticipate the goal of other people’s point-light actions. Frontiers in Psychology, 3, 1–7. https://doi.org/10.3389/fpsyg.2012.00120CrossRef

Emery, N. J., Lorincz, E. N., Perrett, D. I., Oram, M. W., & Baker, C. I. (1997). Gaze following and joint attention in Rhesus monkeys (Macaca mulatta). Journal of Comparative Psychology, 111(3), 286–293. https://doi.org/10.1037/0735-7036.111.3.286CrossRefPubMed

Farroni, T., Csibra, G., Simion, F., & Johnson, M. H. (2002). Eye contact detection in humans from birth. Proceedings of the National Academy of Sciences of the United States of America, 99(14), 9602–9605. https://doi.org/10.1073/pnas.152159999CrossRefPubMedPubMedCentral

Ferri, F., Campione, G. C., Volta, D., Gianelli, R., C., & Gentilucci, M. (2011). Social requests and social affordances: How they affect the kinematics of motor sequences during interactions between conspecifics. Plos One, 6(1), e15855. https://doi.org/10.1371/journal.pone.0015855CrossRefPubMedPubMedCentral

Gallagher, S. (2008). Direct perception in the intersubjective context. Consciousness and Cognition, 17(2), 535–543. https://doi.org/10.1016/j.concog.2008.03.003CrossRefPubMed

Gallagher, H. L., & Frith, C. D. (2004). Dissociable neural pathways for the perception and recognition of expressive and instrumental gestures. Neuropsychologia, 42(13), 1725–1736. https://doi.org/10.1016/j.neuropsychologia.2004.05.006CrossRefPubMed

Georgiou, I., Becchio, C., Glover, S., & Castiello, U. (2007). Different action patterns for cooperative and competitive behaviour. Cognition, 102(3), 415–433. https://doi.org/10.1016/j.cognition.2006.01.008CrossRefPubMed

Gigliotti, M. F., Sampaio, A., Bartolo, A., & Coello, Y. (2020). The combined effects of motor and social goals on the kinematics of object-directed motor action. Scientific Reports, 10(1), 1–10. https://doi.org/10.1038/s41598-020-63314-yCrossRef

Goldin-Meadow, S. (1999). The role of gesture in communication and thinking. Trends in Cognitive Sciences, 3(11), 419–429. https://doi.org/10.1016/S1364-6613(99)01397-2CrossRefPubMed

Green, P., & Macleod, C. J. (2016). SIMR: An R package for power analysis of generalized linear mixed models by simulation. Methods in Ecology and Evolution, 7(4), 493–498. https://doi.org/10.1111/2041-210X.12504CrossRef

Haith, M. M., Bergman, T., & Moore, M. J. (1977). Eye Contact and face scanning in early infancy. Science, 198(4319), 853–855.CrossRefPubMed

Ho, S., Foulsham, T., & Kingstone, A. (2015). Speaking and listening with the eyes: Gaze signaling during dyadic interactions. Plos One, 10(8), 1–18. https://doi.org/10.1371/journal.pone.0136905CrossRef

Hostetter, A. B. (2011). When do gestures communicate? A Meta-analysis. Psychological Bulletin, 137(2), 297–315. https://doi.org/10.1037/a0022128CrossRefPubMed

Innocenti, A., De Stefani, E., Bernardi, N. F., Campione, G. C., & Gentilucci, M. (2012). Gaze direction and request gesture in social interactions. Plos One, 7(5), e36390. https://doi.org/10.1371/journal.pone.0036390CrossRefPubMedPubMedCentral

Janik, S. W., Wellens, A. R., Goldberg, M. L., & Dell’osso, L. F. (1978). Eyes as the center of focus in the visual examination of human faces. Perceptual and Motor Skills, 47(3 Pt 1), 857–858. https://doi.org/10.2466/pms.1978.47.3.857CrossRefPubMed

John, A., Weisberg, S., Price, B., Adler, D., Bates, D., Baud-bovy, G., Bolker, B., Ellison, S., Graves, S., Krivitsky, P., Laboissiere, R., Maechler, M., Monette, G., Murdoch, D., Ogle, D., Ripley, B., Venables, W., Walker, S., & Winsemius, D. (2020). Package ‘car.’.

Judd, C. M., Westfall, J., & Kenny, D. A. (2012). Treating stimuli as a random factor in social psychology: A new and comprehensive solution to a pervasive but largely ignored problem. Journal of Personality and Social Psychology, 103(1), 54–69. https://doi.org/10.1037/a0028347CrossRefPubMed

Kendrick, K. H., & Holler, J. (2017). Gaze direction signals response preference in conversation. Research on Language and Social Interaction, 50(1), 12–32. https://doi.org/10.1080/08351813.2017.1262120CrossRef

Kumle, L., Võ, M. L. H., & Draschkow, D. (2018). Mixedpower: a library for estimating simulation-based power for mixed models in R. https://doi.org/https://github.com/DejanDraschkow/mixedpower

Kumle, L., Võ, M. L. H., & Draschkow, D. (2021). Estimating power in (generalized) linear mixed models: An open introduction and tutorial in R. Behavior Research Methods, 53(6), 2528–2543. https://doi.org/10.3758/s13428-021-01546-0CrossRefPubMedPubMedCentral

Kuznetsova, A., Brockhoff, P. B., & Christensen, R. H. B. (2017). lmerTest Package: Tests in Linear mixed effects models. Journal of Statistical Software, 82(13), 1–26. https://doi.org/10.18637/jss.v082.i13CrossRef

Lenth, M. R., Singmann, H., Love, J., Buerkner, P., & Herve, M. (2019). Package ‘emmeans.’https://doi.org/https://CRAN.R-project.org/package=emmeans

Lewkowicz, D., & Delevoye-Turrell, Y. (2015). Real-time motion capture Toolbox (RTMocap): An open-source code for recording 3-D motion kinematics to study action-effect anticipations during motor and social interactions. Behavioural Research Methods, 48(1), 366–380. https://doi.org/10.3758/s13428-015-0580-5CrossRef

Lewkowicz, D., Delevoye-Turrell, Y., Bailly, D., Andry, P., & Gaussier, P. (2013). Reading motor intention through mental imagery. Adpatative Behavior, 21(5), 1–13. https://doi.org/10.1177/1059712313501347CrossRef

Lewkowicz, D., Quesque, F., Coello, Y., & Delevoye-turrell, Y. N. (2015). Individual differences in reading social intentions from motor deviants. Frontiers in Psychology, 6, 1175. https://doi.org/10.3389/fpsyg.2015.01175CrossRefPubMedPubMedCentral

Leys, C., Ley, C., Klein, O., Bernard, P., & Licata, L. (2013). Detecting outliers: Do not use standard deviation around the mean, use absolute deviation around the median. Journal of Experimental Social Psychology, 49(4), 764–766.CrossRef

Luke, S. G. (2017). Evaluating significance in linear mixed-effects models in R. Behavioural Research, 49(September 2016), 1494–1502. https://doi.org/10.3758/s13428-016-0809-y

Macdonald, R. G., & Tatler, B. W. (2013). Do as eye say: Gaze cueing and language in a real-world social interaction. Journal of Vision, 13(4), 1–12. https://doi.org/10.1167/13.4.6CrossRef

Manera, V., Becchio, C., Schouten, B., Bara, B. G., & Verfaillie, K. (2011). Communicative interactions improve visual detection of biological motion. Plos One, 6(1), 8–13. https://doi.org/10.1371/journal.pone.0014594CrossRef

Marini, M., Ansani, A., Paglieri, F., Caruana, F., & Viola, M. (2021). The impact of facemasks on emotion recognition, trust attribution and re-identification. Scientific Reports, 11(1), 1–14. https://doi.org/10.1038/s41598-021-84806-5CrossRef

Marteniuk, R. G., Mackenzie, C. L., Jeannerod, M., Athenes, S., & Dougas, C. (1987). Constraints on human arm movement trajectories. Canadian Journal of Psychology/ Revue Canadienne De Psychologie, 41(3), 365–378. https://doi.org/10.1037/h0084157CrossRef

Matuschek, H., Kliegl, R., Vasishth, S., Baayen, H., & Bates, D. (2017). Balancing type I error and power in linear mixed models. Journal of Memory and Language, 94, 305–315. https://doi.org/10.1016/j.jml.2017.01.001CrossRef

Morton, J., & Johnson, M. H. (1991). CONSPEC and CONLERN: A two-process theory of infant face recognition. Psychological Review, 98(2), 164–181. https://doi.org/10.1037/0033-295x.98.2.164CrossRefPubMed

Oldfield, R. C. (1971). The assessment and analysis of handedness: The Edinburgh inventory. Neuropsychologia, 9(1), 97–113. https://doi.org/10.1016/0028-3932(71)90067-4CrossRefPubMed

Orliaguet, J., Kandel, S., & Boe, L. (1997). Visual perception of motor anticipation in cursive handwriting: Influence of spatial and movement information on the prediction of forthcoming letters. Perception, 26(7), 905–912. https://doi.org/10.1068/p260905CrossRefPubMed

Quesque, F., & Coello, Y. (2014). For your eyes only: Effect of confederate’ s eye level on reach-to-grasp action. Frontiers in Psychlogy, 5, 1407. https://doi.org/10.3389/fpsyg.2014.01407CrossRef

Quesque, F., Lewkowicz, D., Delevoye-Turrell, Y. N., & Coello, Y. (2013). Effects of social intention on movement kinematics in cooperative actions. Frontiers in Neurobiotics, 7, 14. https://doi.org/10.3389/fnbot.2013.00014CrossRef

Quesque, F., Delevoye-Turrell, Y., & Coello, Y. (2016). Facilitation effect of observed motor deviants in a cooperative motor task: Evidence for direct perception of social intention in action. The Quarterly Journal of Experimental Psychology, 69(8), 1451–1463. https://doi.org/10.1080/17470218.2015.1083596CrossRefPubMed

R Core Team, R. (2013). R: A language and environment for statistical computing.

Sartori, L., Becchio, C., Bara, B. G., & Castiello, U. (2009a). Does the intention to communicate affect action kinematics? Consciousness and Cognition, 18(3), 766–772. https://doi.org/10.1016/j.concog.2009.06.004CrossRefPubMed

Sartori, L., Becchio, C., Bulgheroni, M., & Castiello, U. (2009b). Modulation of the action control system by social intention: Unexpected social requests override preplanned action. Journal of Experimental Psychology, 35(5), 1490–1500. https://doi.org/10.1037/a0015777CrossRefPubMed

Sartori, L., Bucchioni, G., & Castiello, U. (2013). When emulation becomes reciprocity. Social Cognitive and Affective Neuroscience, 8(6), 662–669. https://doi.org/10.1093/scan/nss044CrossRefPubMed

Sartori, L., Camperio-ciani, A., Bulgheroni, M., & Castiello, U. (2013b). Reach-to-grasp movements in Macaca fascicularis monkeys: The Isochrony Principle at work. Frontiers in Psychology, 4, 114. https://doi.org/10.3389/fpsyg.2013.00114CrossRefPubMedPubMedCentral

Scorolli, C., Miatton, M., Wheaton, L. A., & Borghi, A. M. (2014). I give you a cup, I get a cup: A kinematic study on social intention. Neuropsychologia, 57(1), 196–204. https://doi.org/10.1016/j.neuropsychologia.2014.03.006CrossRefPubMed

Sebanz, N., & Knoblich, G. (2009). Prediction in Joint Action: What, when, and where. Topics in Cognitive Science, 1(2), 353–367. https://doi.org/10.1111/j.1756-8765.2009.01024.xCrossRefPubMed

Senju, A., & Hasegawa, T. (2005). Direct gaze captures visuospatial attention. Visual Cognition, 12(1), 127–144. https://doi.org/10.1080/13506280444000157CrossRef

Shaw, J. A., Bryant, L. K., Malle, B. F., Povinelli, D. J., & Pruett, J. R. (2017). The relationship between joint attention and theory of mind in neurotypical adults. Consciousness and Cognition, 51, 268–278. https://doi.org/10.1016/j.concog.2017.02.012CrossRefPubMed

Shepherd, S. V. (2010). Following gaze: Gaze-following behavior as a window into social cognition. Frontiers in Integrative Neuroscience, 4(MARCH 2010), 1–13. https://doi.org/10.3389/fnint.2010.00005

Stapel, J. C., Hunnius, S., & Bekkering, H. (2012). Online prediction of others’ actions: The contribution of the target object, action context and movement kinematics. Psychological Research Psychologische Forschung, 76(4), 434–445. https://doi.org/10.1007/s00426-012-0423-2CrossRefPubMed

Vesper, C., Schmitz, L., Safra, L., Sebanz, N., & Knoblich, G. (2016). The role of shared visual information for joint action coordination. Cognition, 153, 118–123. https://doi.org/10.1016/j.cognition.2016.05.002CrossRefPubMedPubMedCentral

World Medical Association. (2013). World Medical Association Declaration of Helsinki. Ethical principles for medical research involving human subjects. Journal of the American Medical Association, 310(20), 2191–2194. https://doi.org/10.1001/jama.2013.281053CrossRef

Titel: The contribution of eye gaze and movement kinematics to the expression and identification of social intention in object-directed motor actions
Auteurs: Maria Francesca Gigliotti
Laurent Ott
Angela Bartolo
Yann Coello
Publicatiedatum: 24-06-2024
Uitgeverij: Springer Berlin Heidelberg
Gepubliceerd in: Psychological Research / Uitgave 8/2024
Print ISSN: 0340-0727
Elektronisch ISSN: 1430-2772
DOI: https://doi.org/10.1007/s00426-024-01985-2

Andere artikelen Uitgave 8/2024

Financial scarcity and financial avoidance: an eye-tracking and behavioral experiment

Open Access
Research

Not to follow because of distrust: perceived trust modulates the gaze cueing effect

Research

How do emotions respond to outcome values and influence choice?

Open Access
Research

Altered temporal awareness during Covid-19 pandemic

Research

The association between physical activity and memory interference

Research

How well can young adults and children discriminate between odors?

Research