Skip to main content
Top
Gepubliceerd in: Psychological Research 6/2021

13-09-2020 | Original Article

Visual exploration of emotional body language: a behavioural and eye-tracking study

Auteurs: M. Calbi, N. Langiulli, F. Siri, M. A. Umiltà, V. Gallese

Gepubliceerd in: Psychological Research | Uitgave 6/2021

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

Bodily postures are essential to correctly comprehend others’ emotions and intentions. Nonetheless, very few studies focused on the pattern of eye movements implicated in the recognition of emotional body language (EBL), demonstrating significant differences in relation to different emotions. A yet unanswered question regards the presence of the “left-gaze bias” (i.e. the tendency to look first, to make more fixations and to spend more looking time on the left side of centrally presented stimuli) while scanning bodies. Hence, the present study aims at exploring both the presence of a left-gaze bias and the modulation of EBL visual exploration mechanisms, by investigating the fixation patterns (number of fixations and latency of the first fixation) of participants while judging the emotional intensity of static bodily postures (Angry, Happy and Neutral, without head). While results on the latency of first fixations demonstrate for the first time the presence of the left-gaze bias while scanning bodies, suggesting that it could be related to the stronger expressiveness of the left hand (from the observer’s point of view), results on fixations’ number only partially fulfil our hypothesis. Moreover, an opposite viewing pattern between Angry and Happy bodily postures is showed. In sum, the present results, by integrating the spatial and temporal dimension of gaze exploration patterns, shed new light on EBL visual exploration mechanisms.
Bijlagen
Alleen toegankelijk voor geautoriseerde gebruikers
Literatuur
go back to reference Albiero, P., Ingoglia, S., & Lo Coco, A. (2006). Contributo all’adattamento italiano dell’Interpersonal Reactivity Index. Testing Psicometria Metodologia, 13(2), 107–125. Albiero, P., Ingoglia, S., & Lo Coco, A. (2006). Contributo all’adattamento italiano dell’Interpersonal Reactivity Index. Testing Psicometria Metodologia, 13(2), 107–125.
go back to reference Bagby, R. M., Parker, J. D., & Taylor, G. J. (1994). The twenty-item Toronto Alexithymia Scale—I. Item selection and cross-validation of the factor structure. Journal of Psychosomatic Research, 38(1), 23–32.CrossRef Bagby, R. M., Parker, J. D., & Taylor, G. J. (1994). The twenty-item Toronto Alexithymia Scale—I. Item selection and cross-validation of the factor structure. Journal of Psychosomatic Research, 38(1), 23–32.CrossRef
go back to reference Bates, D., Mächler, M., Bolker, B., & Walker, S. (2014). Fitting linear mixed-effects models using lme4. arXiv preprintarXiv:1406.5823. Bates, D., Mächler, M., Bolker, B., & Walker, S. (2014). Fitting linear mixed-effects models using lme4. arXiv preprintarXiv:​1406.​5823.
go back to reference Borji, A., & Itti, L. (2014). Defending Yarbus: Eye movements reveal observers' task. Journal of Vision, 14(3), 29–29.CrossRef Borji, A., & Itti, L. (2014). Defending Yarbus: Eye movements reveal observers' task. Journal of Vision, 14(3), 29–29.CrossRef
go back to reference Bradley, M. M., Sabatinelli, D., Lang, P. J., Fitzsimmons, J. R., King, W., & Desai, P. (2003). Activation of the visual cortex in motivated attention. Behavioral Neuroscience, 117(2), 369–380.CrossRef Bradley, M. M., Sabatinelli, D., Lang, P. J., Fitzsimmons, J. R., King, W., & Desai, P. (2003). Activation of the visual cortex in motivated attention. Behavioral Neuroscience, 117(2), 369–380.CrossRef
go back to reference Bressi, C., Taylor, G., Parker, J., Bressi, S., Brambilla, V., Aguglia, E., et al. (1996). Cross validation of the factor structure of the 20-item Toronto Alexithymia Scale: an Italian multicenter study. Journal of Psychosomatic Research, 41(6), 551–559.CrossRef Bressi, C., Taylor, G., Parker, J., Bressi, S., Brambilla, V., Aguglia, E., et al. (1996). Cross validation of the factor structure of the 20-item Toronto Alexithymia Scale: an Italian multicenter study. Journal of Psychosomatic Research, 41(6), 551–559.CrossRef
go back to reference Butler, S., Gilchrist, I. D., Burt, D. M., Perrett, D. I., Jones, E., & Harvey, M. (2005). Are the perceptual biases found in chimeric face processing reflected in eye-movement patterns? Neuropsychologia, 43(1), 52–59.CrossRef Butler, S., Gilchrist, I. D., Burt, D. M., Perrett, D. I., Jones, E., & Harvey, M. (2005). Are the perceptual biases found in chimeric face processing reflected in eye-movement patterns? Neuropsychologia, 43(1), 52–59.CrossRef
go back to reference Calvo, M. G., Krumhuber, E. G., & Fernández-Martín, A. (2019). Visual attention mechanisms in happiness versus trustworthiness processing of facial expressions. Quarterly Journal of Experimental Psychology, 72(4), 729–741.CrossRef Calvo, M. G., Krumhuber, E. G., & Fernández-Martín, A. (2019). Visual attention mechanisms in happiness versus trustworthiness processing of facial expressions. Quarterly Journal of Experimental Psychology, 72(4), 729–741.CrossRef
go back to reference Carver, C. S., & White, T. L. (1994). Behavioral-inhibition, behavioral activation, and affective responses to impending reward and punishment—the Bis Bas Scales. Journal of Personality and Social Psychology, 67(2), 319–333. https://doi.org/Doi10.1037/0022-3514.67.2.319.CrossRef Carver, C. S., & White, T. L. (1994). Behavioral-inhibition, behavioral activation, and affective responses to impending reward and punishment—the Bis Bas Scales. Journal of Personality and Social Psychology, 67(2), 319–333. https://​doi.​org/​Doi10.​1037/​0022-3514.​67.​2.​319.​CrossRef
go back to reference Chokron, S. (2002). On the origin of free-viewing perceptual asymmetries. Cortex, 38(2), 109–112.CrossRef Chokron, S. (2002). On the origin of free-viewing perceptual asymmetries. Cortex, 38(2), 109–112.CrossRef
go back to reference Connor, K. M., Davidson, J. R., Churchill, L. E., Sherwood, A., Foa, E., & Weisler, R. H. (2000). Psychometric properties of the Social Phobia Inventory (SPIN). New self-rating scale. The British Journal of Psychiatry, 176(4), 379–386.CrossRef Connor, K. M., Davidson, J. R., Churchill, L. E., Sherwood, A., Foa, E., & Weisler, R. H. (2000). Psychometric properties of the Social Phobia Inventory (SPIN). New self-rating scale. The British Journal of Psychiatry, 176(4), 379–386.CrossRef
go back to reference Crowne, D. P., & Marlowe, D. (1960). A new scale of social desirability independent of psychopathology. Journal of Consulting and Clinical Psychology, 24(4), 349–354.CrossRef Crowne, D. P., & Marlowe, D. (1960). A new scale of social desirability independent of psychopathology. Journal of Consulting and Clinical Psychology, 24(4), 349–354.CrossRef
go back to reference de Gelder, B., Snyder, J., Greve, D., Gerard, G., & Hadjikhani, N. (2004). Fear fosters flight: a mechanism for fear contagion when perceiving emotion expressed by a whole body. Proceedings of the National Academy of Sciences, 101(47), 16701–16706.CrossRef de Gelder, B., Snyder, J., Greve, D., Gerard, G., & Hadjikhani, N. (2004). Fear fosters flight: a mechanism for fear contagion when perceiving emotion expressed by a whole body. Proceedings of the National Academy of Sciences, 101(47), 16701–16706.CrossRef
go back to reference Duchowski, A. T. (2007). Eye tracking methodology. Theory and Practice, 328, 614. Duchowski, A. T. (2007). Eye tracking methodology. Theory and Practice, 328, 614.
go back to reference Fridin, M., Barliya, A., Schechtman, E., de Gelder, B., & Flash, T. (2009). Computational model and human perception of emotional body language (EBL). InProceeding of the Symposium on Mental States, Emotions and their Embodiment. Edinburgh, Scotland Fridin, M., Barliya, A., Schechtman, E., de Gelder, B., & Flash, T. (2009). Computational model and human perception of emotional body language (EBL). InProceeding of the Symposium on Mental States, Emotions and their Embodiment. Edinburgh, Scotland
go back to reference Goldin-Meadow, S. (1999). The role of gesture in communication and thinking. Trends in Cognitive Sciences, 3(11), 419–429.CrossRef Goldin-Meadow, S. (1999). The role of gesture in communication and thinking. Trends in Cognitive Sciences, 3(11), 419–429.CrossRef
go back to reference Gori, A., Giannini, M., Socci, S., Luca, M., Dewey, D. E., Schuldberg, D., et al. (2013). Assessing social anxiety disorder: psychometric properties of the Italian social phobia inventory (I-SPIN). Clinical Neuropsychiatry, 10(1), 37. Gori, A., Giannini, M., Socci, S., Luca, M., Dewey, D. E., Schuldberg, D., et al. (2013). Assessing social anxiety disorder: psychometric properties of the Italian social phobia inventory (I-SPIN). Clinical Neuropsychiatry, 10(1), 37.
go back to reference Guo, K. (2012). Holistic gaze strategy to categorize facial expression of varying intensities. PLoS ONE, 7(8), e42585.CrossRef Guo, K. (2012). Holistic gaze strategy to categorize facial expression of varying intensities. PLoS ONE, 7(8), e42585.CrossRef
go back to reference Hox, J. (2010). Multilevel analysis: Techniques and applications. New York: Routledge.CrossRef Hox, J. (2010). Multilevel analysis: Techniques and applications. New York: Routledge.CrossRef
go back to reference Lang, P. J., Bradley, M. M., & Cuthbert, B. N. (1997). Motivated attention: Affect, activation, and action. Attention and Orienting: Sensory and Motivational Processes, 97, 97–135. Lang, P. J., Bradley, M. M., & Cuthbert, B. N. (1997). Motivated attention: Affect, activation, and action. Attention and Orienting: Sensory and Motivational Processes, 97, 97–135.
go back to reference Lao, J., Miellet, S., Pernet, C., Sokhn, N., & Caldara, R. (2017). iMap4: An open source toolbox for the statistical fixation mapping of eye movement data with linear mixed modeling. Behavior Research Methods, 49(2), 559–575.CrossRef Lao, J., Miellet, S., Pernet, C., Sokhn, N., & Caldara, R. (2017). iMap4: An open source toolbox for the statistical fixation mapping of eye movement data with linear mixed modeling. Behavior Research Methods, 49(2), 559–575.CrossRef
go back to reference Leone, L., Pierro, A., & Mannetti, L. (2002). Validità della versione italiana delle scale BIS/BAS di Carver e White (1994): generalizzabilità della struttura e relazioni con costrutti affini. Giornale Italiano di Psicologia, 29(2), 413–436. Leone, L., Pierro, A., & Mannetti, L. (2002). Validità della versione italiana delle scale BIS/BAS di Carver e White (1994): generalizzabilità della struttura e relazioni con costrutti affini. Giornale Italiano di Psicologia, 29(2), 413–436.
go back to reference Manning, L., Halligan, P. W., & Marshall, J. C. (1990). Individual variation in line bisection: a study of normal subjects with application to the interpretation of visual neglect. Neuropsychologia, 28(7), 647–655.CrossRef Manning, L., Halligan, P. W., & Marshall, J. C. (1990). Individual variation in line bisection: a study of normal subjects with application to the interpretation of visual neglect. Neuropsychologia, 28(7), 647–655.CrossRef
go back to reference Mathieu, J. E., Aguinis, H., Culpepper, S. A., & Chen, G. (2012). Understanding and estimating the power to detect cross-level interaction effects in multilevel modeling. Journal of Applied Psychology, 97(5), 951.CrossRef Mathieu, J. E., Aguinis, H., Culpepper, S. A., & Chen, G. (2012). Understanding and estimating the power to detect cross-level interaction effects in multilevel modeling. Journal of Applied Psychology, 97(5), 951.CrossRef
go back to reference Mertens, I., Siegmund, H., & Grusser, O. J. (1993). Gaze motor asymmetries in the perception of faces during a memory task. Neuropsychologia, 31(9), 989–998.CrossRef Mertens, I., Siegmund, H., & Grusser, O. J. (1993). Gaze motor asymmetries in the perception of faces during a memory task. Neuropsychologia, 31(9), 989–998.CrossRef
go back to reference Mills, M., Hollingworth, A., Van der Stigchel, S., Hoffman, L., & Dodd, M. D. (2011). Examining the influence of task set on eye movements and fixations. Journal of Vision, 11(8), 17–17.CrossRef Mills, M., Hollingworth, A., Van der Stigchel, S., Hoffman, L., & Dodd, M. D. (2011). Examining the influence of task set on eye movements and fixations. Journal of Vision, 11(8), 17–17.CrossRef
go back to reference Nummenmaa, L., Hyönä, J., & Calvo, M. G. (2006). Eye movement assessment of selective attentional capture by emotional pictures. Emotion, 6(2), 257.CrossRef Nummenmaa, L., Hyönä, J., & Calvo, M. G. (2006). Eye movement assessment of selective attentional capture by emotional pictures. Emotion, 6(2), 257.CrossRef
go back to reference Oldfield, R. C. (1971). The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia, 9(1), 97–113.CrossRef Oldfield, R. C. (1971). The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia, 9(1), 97–113.CrossRef
go back to reference Pedrabissi, L., & Santinello, M. (1989). Inventario per l’ansia di «Stato» e di «Tratto»: Nuova versione italiana dello STAI Forma Y: Manuale (p. 44). Firenze: Organizzazioni Speciali. Pedrabissi, L., & Santinello, M. (1989). Inventario per l’ansia di «Stato» e di «Tratto»: Nuova versione italiana dello STAI Forma Y: Manuale (p. 44). Firenze: Organizzazioni Speciali.
go back to reference Pollux, P. M., Craddock, M., & Guo, K. (2019). Gaze patterns in viewing static and dynamic body expressions. Acta psychologica, 198, 102862.CrossRef Pollux, P. M., Craddock, M., & Guo, K. (2019). Gaze patterns in viewing static and dynamic body expressions. Acta psychologica, 198, 102862.CrossRef
go back to reference R Core Team (2019). R: A language and environment for statistical computing [Internet]. Vienna, Austria: R Foundation for Statistical Computing; 2019. R Core Team (2019). R: A language and environment for statistical computing [Internet]. Vienna, Austria: R Foundation for Statistical Computing; 2019.
go back to reference Tobii, A. (2016). Tobii studio user’s manual. Version 3.4, 5, 1–170. Tobii, A. (2016). Tobii studio user’s manual. Version 3.4, 5, 1–170.
go back to reference Vaid, J., & Singh, M. (1989). Asymmetries in the perception of facial affect: Is there an influence of reading habits? Neuropsychologia, 27(10), 1277–1287.CrossRef Vaid, J., & Singh, M. (1989). Asymmetries in the perception of facial affect: Is there an influence of reading habits? Neuropsychologia, 27(10), 1277–1287.CrossRef
go back to reference Van der Gucht, K., Dejonckheere, E., Erbas, Y., Takano, K., Vandemoortele, M., Maex, E., Raes, F., Kuppens, P. (2019). An experience sampling study examining the potential impact of a mindfulness-based intervention on emotion differentiation. Emotion 19(1), 123–131. https://doi.org/10.1037/emo0000406. Van der Gucht, K., Dejonckheere, E., Erbas, Y., Takano, K., Vandemoortele, M., Maex, E., Raes, F., Kuppens, P. (2019). An experience sampling study examining the potential impact of a mindfulness-based intervention on emotion differentiation. Emotion 19(1), 123–131. https://​doi.​org/​10.​1037/​emo0000406.
go back to reference Wickham, H. (2016). ggplot2: elegant graphics for data analysis. Berlin: Springer.CrossRef Wickham, H. (2016). ggplot2: elegant graphics for data analysis. Berlin: Springer.CrossRef
Metagegevens
Titel
Visual exploration of emotional body language: a behavioural and eye-tracking study
Auteurs
M. Calbi
N. Langiulli
F. Siri
M. A. Umiltà
V. Gallese
Publicatiedatum
13-09-2020
Uitgeverij
Springer Berlin Heidelberg
Gepubliceerd in
Psychological Research / Uitgave 6/2021
Print ISSN: 0340-0727
Elektronisch ISSN: 1430-2772
DOI
https://doi.org/10.1007/s00426-020-01416-y

Andere artikelen Uitgave 6/2021

Psychological Research 6/2021 Naar de uitgave