Skip to main content
Mijn bibliotheek
Shop
Nieuws Boeken Tijdschriften E-learning Web-tv Video Audio
Tips voor Mijn BSL
UITGEBREID ZOEKEN
Inloggen
Top
Psychological Research
Gepubliceerd in: Psychological Research 6/2023

27-11-2022 | Original Article

The role of hand gestures in emotion communication: Do type and size of gestures matter?

Auteurs: Esma Nur Asalıoğlu, Tilbe Göksun

Gepubliceerd in: Psychological Research | Uitgave 6/2023

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail
    Link delen
publish
Publiceer nu

Abstract

We communicate emotions in a multimodal way, yet non-verbal emotion communication is a relatively understudied area of research. In three experiments, we investigated the role of gesture characteristics (e.g., type, size in space) on individuals’ processing of emotional content. In Experiment 1, participants were asked to rate the emotional intensity of emotional narratives from the videoclips either with iconic or beat gestures. Participants in the iconic gesture condition rated the emotional intensity higher than participants in the beat gesture condition. In Experiment 2, the size of gestures and its interaction with gesture type were investigated in a within-subjects design. Participants again rated the emotional intensity of emotional narratives from the videoclips. Although individuals overall rated narrow gestures more emotionally intense than wider gestures, no effects of gesture type, or gesture size and type interaction were found. Experiment 3 was conducted to check whether findings of Experiment 2 were due to viewing gestures in all videoclips. We compared the gesture and no gesture (i.e., speech only) conditions and showed that there was not a difference between them on emotional ratings. However, we could not replicate the findings related to gesture size of Experiment 2. Overall, these findings indicate the importance of examining gesture’s role in emotional contexts and that different gesture characteristics such as size of gestures can be considered in nonverbal communication.
vorige artikel Individual differences in resilience to stress are associated with affective flexibility
volgende artikel EPELI: a novel virtual reality task for the assessment of goal-directed behavior in real-life contexts
Voetnoten
1
Note that we included valence of stories based on the norming study we previously conducted.
 
2
Note that the last sentence “I am doing pretty alright in life” is translated into Turkish as “I am in a good place in life.” The narrator’s gesture represented “a good place.”.
 
3
Note that 1 narrative in no gesture trials was positively-valenced because we did not have any other negatively-valenced video without gestures in our stimuli set.
 
Literatuur
Akhavan, N., Nozari, N., & Göksun, T. (2017). Expression of motion events in Farsi. Language, Cognition and Neuroscience, 32(6), 792–804.
Alibali, M. W. (2005). Gesture in spatial cognition: Expressing, communicating, and thinking about spatial information. Spatial Cognition and Computation, 5(4), 307–331.
Alibali, M. W., Flevares, L. M., & Goldin-Meadow, S. (1997). Assessing knowledge conveyed in gesture: Do teachers have the upper hand? Journal of Educational Psychology, 89(1), 183–193.
Alibali, M. W., Heath, D. C., & Myers, H. J. (2001). Effects of visibility between speaker and listener on gesture production: Some gestures are meant to be seen. Journal of Memory and Language, 44(2), 169–188.
Alibali, M. W., & Kita, S. (2010). Gesture highlights perceptually present information for speakers. Gesture, 10(1), 3–28.
Alibali, M. W., & Nathan, M. J. (2007). Teachers’ gestures as a means of scaffolding students’ understanding: Evidence from an early algebra lesson. In R. Goldman, R. Pea, B. Barron, & S. J. Derry (Eds.), Video research in the learning sciences (pp. 349–365). Erlbaum.
Alibali, M. W., Spencer, R. C., Knox, L., & Kita, S. (2011). Spontaneous gestures influence strategy choices in problem solving. Psychological Science, 22(9), 1138–1144.PubMed
Allen, G. L. (2003). Gestures accompanying verbal route directions: Do they point to a new avenue for examining spatial representations? Spatial Cognition and Computation, 3(4), 259–268.
Ambady, N., & Rosenthal, R. (1992). Thin slices of expressive behavior as predictors of interpersonal consequences: A meta-analysis. Psychological Bulletin, 111(2), 256–274.
Arslan, B., & Göksun, T. (2021). Ageing, working memory, and mental imagery: Understanding gestural communication in younger and older adults. Quarterly Journal of Experimental Psychology, 74(1), 29–44.
Atkinson, A. P., Dittrich, W. H., Gemmell, A. J., & Young, A. W. (2004). Emotion perception from dynamic and static body expressions in point-light and full-light displays. Perception, 33(6), 717–746.PubMed
Aussems, S., & Kita, S. (2019). Seeing iconic gestures while encoding events facilitates children’s memory of these events. Child Development, 90(4), 1123–1137.PubMed
Austin, E. E., & Sweller, N. (2014). Presentation and production: The role of gesture in spatial communication. Journal of Experimental Child Psychology, 122, 92–103.PubMed
Bänziger, T., Mortillaro, M., & Scherer, K. R. (2012). Introducing the Geneva Multimodal expression corpus for experimental research on emotion perception. Emotion, 12(5), 1161–1179.PubMed
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67(1), 1–48.
Bavelas, J., Gerwing, J., Sutton, C., & Prevost, D. (2008). Gesturing on the telephone: Independent effects of dialogue and visibility. Journal of Memory and Language, 58(2), 495–520.
Beattie, G., & Shovelton, H. (1999). Do iconic hand gestures really contribute anything to the semantic information conveyed by speech? An experimental investigation. Semiotica, 123(1–2), 1–30.
Beattie, G., & Shovelton, H. (2002). What properties of talk are associated with the generation of spontaneous iconic hand gestures? British Journal of Social Psychology, 41(3), 403–417.PubMed
Beattie, G., & Shovelton, H. (2006). When size really matters: How a single semantic feature is represented in the speech and gesture modalities. Gesture, 6(1), 63–84.
Beilock, S. L., & Goldin-Meadow, S. (2010). Gesture changes thought by grounding it in action. Psychological Science, 21(11), 1605–1610.PubMed
Boone, R. T., & Cunningham, J. G. (1998). Children’s decoding of emotion in expressive body movement: The development of cue attunement. Developmental Psychology, 34(5), 1007–1016.PubMed
Boone, R. T., & Cunningham, J. G. (2001). Children’s expression of emotional meaning in music through expressive body movement. Journal of Nonverbal Behavior, 25(1), 21–41.
Buchanan, T. W., & Lovallo, W. R. (2001). Enhanced memory for emotional material following stress-level cortisol treatment in humans. Psychoneuroendocrinology, 26(3), 307–317.PubMed
Casasanto, D., & Jasmin, K. (2010). Good and bad in the hands of politicians: spontaneous gestures during positive and negative speech. PLoS ONE, 5(7), e11805.PubMedPubMedCentral
Cassell, J., McNeill, D., & McCullough, K. E. (1999). Speech-gesture mismatches: Evidence for one underlying representation of linguistic and nonlinguistic information. Pragmatics & Cognition, 7(1), 1–34.
Çatak, E. N., Açık, A., & Göksun, T. (2018). The relationship between handedness and valence: A gesture study. Quarterly Journal of Experimental Psychology, 71(12), 2615–2626.
Clark, H. (1996). Using Language. Cambridge University Press.
Cook, S. W., Duffy, R. G., & Fenn, K. M. (2013). Consolidation and transfer of learning after observing hand gesture. Child Development, 84(6), 1863–1871.PubMed
Coulson, M. (2004). Attributing emotion to static body postures: Recognition accuracy, confusions, and viewpoint dependence. Journal of Nonverbal Behavior, 28(2), 117–139.
Cutica, I., & Bucciarelli, M. (2008). The deep versus the shallow: Effects of co-speech gestures in learning from discourse. Cognitive Science, 32(5), 921–935.PubMed
Dael, N., Goudbeek, M., & Scherer, K. R. (2013). Perceived gesture dynamics in nonverbal expression of emotion. Perception, 42(6), 642–657.PubMed
Dargue, N., & Sweller, N. (2018a). Donald Duck’s garden: The effects of observing iconic reinforcing and contradictory gestures on narrative comprehension. Journal of Experimental Child Psychology, 175, 96–107.PubMed
Dargue, N., & Sweller, N. (2018b). Not all gestures are created equal: the effects of typical and atypical iconic gestures on narrative comprehension. Journal of Nonverbal Behavior, 42(3), 327–345.
Dargue, N., & Sweller, N. (2020). Learning stories through gesture: Gesture’s effects on child and adult narrative comprehension. Educational Psychology Review, 32(1), 249–276.
Dargue, N., Sweller, N., & Jones, M. P. (2019). When our hands help us understand: A meta-analysis into the effects of gesture on comprehension. Psychological Bulletin, 145(8), 765–784.PubMed
De Gelder, B. (2006). Towards the neurobiology of emotional body language. Nature Reviews Neuroscience, 7(3), 242–249.PubMed
De Gelder, B. (2009). Why bodies? Twelve reasons for including bodily expressions in affective neuroscience. Philosophical Transactions of the Royal Society b: Biological Sciences, 364(1535), 3475–3484.
De Gelder, B., & Van den Stock, J. (2011). The Bodily expressive action stimulus test (BEAST). Construction and validation of a stimulus basis for measuring perception of whole body expression of emotions. Frontiers in Psychology, 2, 181.PubMedPubMedCentral
De Meijer, M. (1989). The contribution of general features of body movement to the attribution of emotions. Journal of Nonverbal Behavior, 13(4), 247–268.
De Ruiter, J. P., Bangerter, A., & Dings, P. (2012). The interplay between gesture and speech in the production of referring expressions: investigating the tradeoff hypothesis. Topics in Cognitive Science, 4(2), 232–248.PubMed
Demir-Lira, Ö. E., Asaridou, S. S., Raja Beharelle, A., Holt, A. E., Goldin-Meadow, S., & Small, S. L. (2018). Functional neuroanatomy of gesture–speech integration in children varies with individual differences in gesture processing. Developmental Science, 21(5), e12648.PubMedPubMedCentral
Dittrich, W. H., Troscianko, T., Lea, S. E., & Morgan, D. (1996). Perception of emotion from dynamic point-light displays represented in dance. Perception, 25(6), 727–738.PubMed
Dixon, P., Bortolussi, M., Twilley, L. C., & Leung, A. (1993). Literary processing and interpretation: Towards empirical foundations. Poetics, 22(1–2), 5–33.
Djikic, M., Oatley, K., & Moldoveanu, M. C. (2013). Opening the closed mind: the effect of exposure to literature on the need for closure. Creativity Research Journal, 25(2), 149–154.
Drijvers, L., & Özyürek, A. (2017). Visual context enhanced: the joint contribution of iconic gestures and visible speech to degraded speech comprehension. Journal of Speech, Language, and Hearing Research, 60(1), 212–222.PubMed
Driskell, J. E., & Radtke, P. H. (2003). The effect of gesture on speech production and comprehension. Human Factors, 45(3), 445–454.PubMed
Ekman, P. (1992). Facial Expressions of emotion: an old controversy and new findings. Philosophical transactions of the royal society of London. Series B: Biological Sciences, 335(1273), 63–69.
Ekman, P. (1993). Facial expression and emotion. American Psychologist, 48(4), 384–392.PubMed
Emmorey, K., & Casey, S. (2001). Gesture, thought and spatial language. Gesture, 1(1), 35–50.
Enfield, N. J. (2009). The Anatomy of Meaning: Speech, Gesture, and Composite Utterances. Cambridge University Press.
Esteve-Gibert, N., & Prieto, P. (2013). Prosodic structure shapes the temporal realization of intonation and manual gesture movements. Journal of Speech, Language, and Hearing Research, 56(3), 850–864.PubMed
Faul, F., Erdfelder, E., Lang, A. G., & Buchner, A. (2007). G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39(2), 175–191.PubMed
Galati, A., & Brennan, S. E. (2014). Speakers adapt gestures to addressees’ knowledge: Implications for models of co-speech gesture. Language, Cognition and Neuroscience, 29(4), 435–451.
Galati, A., & Samuel, A. G. (2011). The role of speech-gesture congruency and delay in remembering action events. Language and Cognitive Processes, 26(3), 406–436.
Gerwing, J., & Allison, M. (2009). The relationship between verbal and gestural contributions in conversation: A comparison of three methods. Gesture, 9(3), 312–336.
Gerwing, J., & Bavelas, J. (2004). Linguistic influences on gesture’s form. Gesture, 4(2), 157–195.
Glowinski, D., Dael, N., Camurri, A., Volpe, G., Mortillaro, M., & Scherer, K. (2011). Toward a minimal representation of affective gestures. IEEE Transactions on Affective Computing, 2(2), 106–118.
Goldin-Meadow, S. (2003). Hearing Gesture: How Our Hands Help Us Think. Harvard University Press.
Goldin-Meadow, S., & Alibali, M. W. (2013). Gesture’s role in speaking, learning, and creating language. Annual Review of Psychology, 64(1), 257–283.PubMed
Guilbert, D., Sweller, N., & Van Bergen, P. (2021). Emotion and gesture effects on narrative recall in young children and adults. Applied Cognitive Psychology, 35(4), 873–889.
Gullberg, M., & Holmqvist, K. (2006). What speakers do and what addressees look at: Visual attention to gestures in human interaction live and on video. Pragmatics & Cognition, 14(1), 53–82.
Gullberg, M., & Kita, S. (2009). Attention to speech-accompanying gestures: Eye movements and information uptake. Journal of Nonverbal Behavior, 33(4), 251–277.PubMedPubMedCentral
Gunes, H., & Piccardi, M. (2007). Bi-modal emotion recognition from expressive face and body gestures. Journal of Network and Computer Applications, 30(4), 1334–1345.
Hadar, U., & Butterworth, B. (1997). Iconic gestures, imagery, and word retrieval in speech. Semiotica, 115(1–2), 147–172.
Hall, J. A., Harrigan, J. A., & Rosenthal, R. (1995). Nonverbal behavior in clinician—patient interaction. Applied and Preventive Psychology, 4(1), 21–37.
Hicheur, H., Kadone, H., Grèzes, J., & Berthoz, A. (2013). The Combined Role of Motion-Related Cues and Upper Body Posture for the Expression of Emotions during Human Walking. In K. Mombaur & K. Berns (Eds.), Modeling, Simulation and Optimization of Bipedal Walking Cognitive Systems Monographs (pp. 71–85). Berlin, Heidelberg: Springer.
Hilliard, C., & Cook, S. W. (2016). Bridging gaps in common ground: Speakers design their gestures for their listeners. Journal of Experimental Psychology: Learning, Memory, and Cognition, 42(1), 91–103.PubMed
Holle, H., & Gunter, T. C. (2007). The role of iconic gestures in speech disambiguation: ERP evidence. Journal of Cognitive Neuroscience, 19(7), 1175–1192.PubMed
Holle, H., Gunter, T. C., Rüschemeyer, S. A., Hennenlotter, A., & Iacoboni, M. (2008). Neural correlates of the processing of co-speech gestures. NeuroImage, 39(4), 2010–2024.PubMed
Holle, H., Obleser, J., Rueschemeyer, S. A., & Gunter, T. C. (2010). Integration of iconic gestures and speech in left superior temporal areas boosts speech comprehension under adverse listening conditions. NeuroImage, 49(1), 875–884.PubMed
Holler, J., & Beattie, G. (2003). How iconic gestures and speech interact in the representation of meaning: Are both aspects really integral to the process? Semiotica, 146, 81–116.
Holler, J., Schubotz, L., Kelly, S., Hagoort, P., Schuetze, M., & Özyürek, A. (2014). Social eye gaze modulates processing of speech and co-speech gesture. Cognition, 133(3), 692–697.PubMed
Holler, J., Shovelton, H., & Beattie, G. (2009). Do iconic hand gestures really contribute to the communication of semantic information in a face-to-face context? Journal of Nonverbal Behavior, 33(2), 73–88.
Holler, J., & Stevens, R. (2007). The effect of common ground on how speakers use gesture and speech to represent size information. Journal of Language and Social Psychology, 26(1), 4–27.
Hostetter, A. B. (2011). When do gestures communicate? A meta-analysis. Psychological Bulletin, 137(2), 297.PubMed
Hostetter, A. B., & Alibali, M. W. (2008). Visible embodiment: Gestures as simulated action. Psychonomic Bulletin & Review, 15(3), 495–514.
Hough, M. S. (1990). Narrative comprehension in adults with right and left hemisphere brain-damage: Theme organization. Brain and Language, 38(2), 253–277.PubMed
Juslin, P. N., & Laukka, P. (2003). Communication of emotions in vocal expression and music performance: Different channels, same code? Psychological Bulletin, 129(5), 770–814.PubMed
Juslin, P. N., & Scherer, K. R. (2005). Vocal Expression of Affect. Oxford University Press.
Kandana Arachchige, K. G., Simoes Loureiro, I., Blekic, W., Rossignol, M., & Lefebvre, L. (2021). The role of iconic gestures in speech comprehension: An overview of various methodologies. Frontiers in Psychology, 1429.
Kartalkanat, H., & Göksun, T. (2020). The effects of observing different gestures during storytelling on the recall of path and event information in 5-year-olds and adults. Journal of Experimental Child Psychology, 189, 104725.PubMed
Kelly, S. D., Barr, D. J., Church, R. B., & Lynch, K. (1999). Offering a hand to pragmatic understanding: The role of speech and gesture in comprehension and memory. Journal of Memory and Language, 40(4), 577–592.
Kelly, S. D., Creigh, P., & Bartolotti, J. (2010b). Integrating speech and iconic gestures in a Stroop- like task: Evidence for automatic processing. Journal of Cognitive Neuroscience, 22(4), 683–694.PubMed
Kelly, S. D., Kravitz, C., & Hopkins, M. (2004). Neural correlates of bimodal speech and gesture comprehension. Brain and Language, 89(1), 253–260.PubMed
Kelly, S. D., Özyürek, A., & Maris, E. (2010a). Two sides of the same coin: Speech and gesture mutually interact to enhance comprehension. Psychological Science, 21(2), 260–267.PubMed
Kelly, S. D., Ward, S., Creigh, P., & Bartolotti, J. (2007). An intentional stance modulates the integration of gesture and speech during comprehension. Brain and Language, 101(3), 222–233.PubMed
Keltner, D., Ekman, P., Gonzaga, G. C., & Beer, J. (2003). Facial expression of emotion. In K. R. Scherer & H. H. Goldsmith (Eds.), Handbook of Affective Sciences (pp. 415–432). Oxford University Press.
Kendon, A. (2004). Gesture: Visible Action as Utterance. Cambridge University Press.
Kessous, L., Castellano, G., & Caridakis, G. (2010). Multimodal emotion recognition in speech-based interaction using facial expression, body gesture and acoustic analysis. Journal on Multimodal User Interfaces, 3(1), 33–48.
Kidd, D. C., & Castano, E. (2013). Reading literary fiction improves theory of mind. Science, 342(6156), 377–380.PubMed
Kita, S. (2000). How representational gestures help speaking. Language and Gesture, 1, 162–185.
Kita, S. (2009). Cross-cultural variation of speech-accompanying gesture: A review. Language and Cognitive Processes, 24(2), 145–167.
Kita, S., & Özyürek, A. (2003). What does cross-linguistic variation in semantic coordination of speech and gesture reveal? Evidence for an interface representation of spatial thinking and speaking. Journal of Memory and Language, 48(1), 16–32.
Krahmer, E., & Swerts, M. (2007). The effects of visual beats on prosodic prominence: Acoustic analyses, auditory perception and visual perception. Journal of Memory and Language, 57(3), 396–414.
Krumhuber, E. G., Skora, L., Küster, D., & Fou, L. (2017). A review of dynamic datasets for facial expression research. Emotion Review, 9(3), 280–292.
Kuznetsova, A., Brockhoff, P. B., & Christensen, R. H. B. (2017). lmerTest package: Tests in linear mixed effects models. Journal of Statistical Software, 82(13), 1–26.
Lakoff, G., & Johnson, M. (1999). Philosophy in the flesh: The embodied mind and its challenge to Western thought. Basic Books.
Lavergne, J., & Kimura, D. (1987). Hand movement asymmetry during speech: No effect of speaking topic. Neuropsychologia, 25(4), 689–693.PubMed
Lawrence, A. D., Calder, A. J., McGowan, S. W., & Grasby, P. M. (2002). Selective disruption of the recognition of facial expressions of anger. NeuroReport, 13(6), 881–884.PubMed
Lhommet, M., & Marsella, S. C. (2015). Expressing Emotion Through Posture and Gesture. In R. A. Calvo, S. D’Mello, J. M. Gratch, & A. Kappas (Eds.), The Oxford Handbook of Affective Computing (pp. 273–285). Oxford Handbooks Online.
Llanes-Coromina, J., Vilà-Giménez, I., Kushch, O., Borràs-Comes, J., & Prieto, P. (2018). Beat gestures help preschoolers recall and comprehend discourse information. Journal of Experimental Child Psychology, 172, 168–188.PubMed
Lyle, S. (2000). Narrative understanding: Developing a theoretical context for understanding how children make meaning in classroom settings. Journal of Curriculum Studies, 32(1), 45–63.
Macoun, A., & Sweller, N. (2016). Listening and watching: The effects of observing gesture on preschoolers’ narrative comprehension. Cognitive Development, 40, 68–81.
McNeill, D. (1992). Hand and mind: What gestures reveal about thought. University of Chicago Press.
McNeill, D. (2005). Gesture and Thought. University of Chicago Press.
Melinger, A., & Kita, S. (2007). Conceptualisation load triggers gesture production. Language and Cognitive Processes, 22(4), 473–500.
Melinger, A., & Levelt, W. J. (2004). Gesture and the communicative intention of the speaker. Gesture, 4(2), 119–141.
Montepare, J. M., Goldstein, S. B., & Clausen, A. (1987). The identification of emotions from gait information. Journal of Nonverbal Behavior, 11(1), 33–42.
O’Reilly, H., Pigat, D., Fridenson, S., Berggren, S., Tal, S., Golan, O., & Lundqvist, D. (2016). The EU-emotion stimulus set: A validation study. Behavior Research Methods, 48(2), 567–576.PubMed
Obermeier, C., Dolk, T., & Gunter, T. C. (2012). The benefit of gestures during communication: Evidence from hearing and hearing-impaired individuals. Cortex, 48(7), 857–870.PubMed
Obermeier, C., Kelly, S. D., & Gunter, T. C. (2015). A speaker’s gesture style can affect language comprehension: ERP evidence from gesture-speech integration. Social Cognitive and Affective Neuroscience, 10(9), 1236–1243.PubMedPubMedCentral
Olderbak, S., Wilhelm, O., Hildebrandt, A., & Quoidbach, J. (2019). Sex differences in facial emotion perception ability across the lifespan. Cognition and Emotion, 33(3), 579–588.PubMed
Orgeta, V., & Phillips, L. H. (2007). Effects of age and emotional intensity on the recognition of facial emotion. Experimental Aging Research, 34(1), 63–79.
Özder, L. E., Özer, D., & Göksun, T. (2022). Gesture use in L1-Turkish and L2-English: Evidence from emotional narrative retellings. Quarterly Journal of Experimental Psychology.
Özer, D., & Göksun, T. (2020). Gesture use and processing: A review on individual differences in cognitive resources. Frontiers in Psychology, 11, 573555.PubMedPubMedCentral
Özer, D., & Göksun, T. (2020). Visual-spatial and verbal abilities differentially affect processing of gestural vs. spoken expressions. Language, Cognition and Neuroscience, 35(7), 896–914.
Özyürek, A. (2018). Role of gesture in language processing: Toward a unified account for production and comprehension. Oxford Handbook of Psycholinguistics (pp. 592–607). Oxford University Press.
Özyürek, A., Willems, R. M., Kita, S., & Hagoort, P. (2007). On-line integration of semantic information from speech and gesture: Insights from event-related brain potentials. Journal of Cognitive Neuroscience, 19(4), 605–616.PubMed
Paterson, H. M., Pollick, F. E., & Sanford, A. J. (2001). The role of velocity in affect discrimination. In Proceedings of the Annual Meeting of the Cognitive Science Society, 23, 23.
Peelen, M. V., Atkinson, A. P., Andersson, F., & Vuilleumier, P. (2007). Emotional modulation of body-selective visual areas. Social Cognitive and Affective Neuroscience, 2(4), 274–283.PubMedPubMedCentral
Pollick, F. E., Paterson, H. M., Bruderlin, A., & Sanford, A. J. (2001). Perceiving affect from arm movement. Cognition, 82(2), B51–B61.PubMed
Repetto, C., Pedroli, E., & Macedonia, M. (2017). Enrichment effects of gestures and pictures on abstract words in a second language. Frontiers in Psychology, 8, 2136.PubMedPubMedCentral
Riskind, J. H. (1984). They stoop to conquer: Guiding and self-regulatory functions of physical posture after success and failure. Journal of Personality and Social Psychology, 47(3), 479–493.
Roether, C. L., Omlor, L., Christensen, A., & Giese, M. A. (2009). Critical features for the perception of emotion from gait. Journal of Vision, 9(6), 15–15.
Rozanska, A., Rachwaniec-Szczecinska, Z., Kawala-Janik, A., & Podpora, M. (2018). Internet of things embedded system for emotion recognition. IEEE 20th International Conference on E-Health Networking, Applications and Services, Healthcom, 1–10.
Russell, J. A., Bachorowski, J. A., & Fernández-Dols, J. M. (2003). Facial and vocal expressions of emotion. Annual Review of Psychology, 54(1), 329–349.PubMed
Sawada, M., Suda, K., & Ishii, M. (2003). Expression of emotions in dance: Relation between arm movement characteristics and emotion. Perceptual and Motor Skills, 97(3), 697–708.PubMed
Scherer, K. R., Johnstone, T., & Klasmeyer, G. (2003). Vocal Expression of Emotion (pp. 433–456). Oxford University Press.
Schindler, K., Van Gool, L., & De Gelder, B. (2008). Recognizing emotions expressed by body pose: A biologically inspired neural model. Neural Networks, 21(9), 1238–1246.PubMed
Schmithorst, V. J., Holland, S. K., & Plante, E. (2006). Cognitive modules utilized for narrative comprehension in children: A functional magnetic resonance imaging study. NeuroImage, 29(1), 254–266.PubMed
Sekine, K., Schoechl, C., Mulder, K., Holler, J., Kelly, S., Furman, R., & Özyürek, A. (2020). Evidence for children’s online integration of simultaneous information from speech and iconic gestures: An ERP study. Language, Cognition and Neuroscience, 35(10), 1283–1294.
Singer, M. A., & Goldin-Meadow, S. (2005). Children learn when their teacher’s gestures and speech differ. Psychological Science, 16(2), 85–89.PubMed
Skipper, J. I., Goldin-Meadow, S., Nusbaum, H. C., & Small, S. L. (2007). Speech-associated gestures, Broca’s area, and the human mirror system. Brain and Language, 101(3), 260–277.PubMedPubMedCentral
Skipper, J. I., Goldin-Meadow, S., Nusbaum, H. C., & Small, S. L. (2009). Gestures orchestrate brain networks for language understanding. Current Biology, 19(8), 661–667.PubMed
So, W. C., Shum, P. L. C., & Wong, M. K. Y. (2015). Gesture is more effective than spatial language in encoding spatial information. The Quarterly Journal of Experimental Psychology, 68(12), 2384–2401.PubMed
So, W. C., Sim Chen-Hui, C., & Low Wei-Shan, J. (2012). Mnemonic effect of iconic gesture and beat gesture in adults and children: Is meaning in gesture important for memory recall? Language and Cognitive Processes, 27(5), 665–681.
Stepper, S., & Strack, F. (1993). Proprioceptive determinants of emotional and nonemotional feelings. Journal of Personality and Social Psychology, 64(2), 211–220.
Straube, B., Green, A., Jansen, A., Chatterjee, A., & Kircher, T. (2010). Social cues, mentalizing and the neural processing of speech accompanied by gestures. Neuropsychologia, 48(2), 382–393.PubMed
Straube, B., Green, A., Weis, S., Chatterjee, A., & Kircher, T. (2009). Memory effects of speech and gesture binding: Cortical and hippocampal activation in relation to subsequent memory performance. Journal of Cognitive Neuroscience, 21(4), 821–836.PubMed
Sullivan, S., Campbell, A., Hutton, S. B., & Ruffman, T. (2017). What’s good for the goose is not good for the gander: Age and gender differences in scanning emotion faces. Journals of Gerontology Series b: Psychological Sciences and Social Sciences, 72(3), 441–447.PubMed
Thompson, A. E., & Voyer, D. (2014). Sex differences in the ability to recognise non-verbal displays of emotion: A meta-analysis. Cognition and Emotion, 28(7), 1164–1195.PubMed
Tracy, J. L., & Robins, R. W. (2004). Show your pride: Evidence for a discrete emotion expression. Psychological Science, 15(3), 194–197.PubMed
Tracy, J. L., Robins, R. W., & Schriber, R. A. (2009). Development of a FACS-verified set of basic and self-conscious emotion expressions. Emotion, 9(4), 554–559.PubMed
Trujillo, J. P., Simanova, I., Bekkering, H., & Özyürek, A. (2018). Communicative intent modulates production and comprehension of actions and gestures: A Kinect study. Cognition, 180(April), 38–51.PubMed
Trujillo, J. P., Simanova, I., Bekkering, H., & Özyürek, A. (2020). The communicative advantage: How kinematic signaling supports semantic comprehension. Psychological Research Psychologische Forschung, 84(7), 1897–1911.PubMed
Valenzeno, L., Alibali, M. W., & Klatzky, R. (2003). Teachers’ gestures facilitate students’ learning: A lesson in symmetry. Contemporary Educational Psychology, 28(2), 187–204.
Vilà-Giménez, I., & Prieto, P. (2021). The value of non-referential gestures: A systematic review of their cognitive and linguistic effects in children’s language development. Children, 8(2), 148.PubMedPubMedCentral
Wallbott, H. G. (1985). Hand movement quality: A neglected aspect of nonverbal behavior in clinical judgment and person perception. Journal of Clinical Psychology, 41(3), 345–359.PubMed
Wallbott, H. G. (1998). Bodily expression of emotion. European Journal of Social Psychology, 28(6), 879–896.
Wang, L., & Chu, M. (2013). The role of beat gesture and pitch accent in semantic processing: An ERP study. Neuropsychologia, 51(13), 2847–2855.PubMed
Wu, Y. C., & Coulson, S. (2005). Meaningful gestures: Electrophysiological indices of iconic gesture comprehension. Psychophysiology, 42(6), 654–667.PubMed
Wu, Y. C., & Coulson, S. (2007). How iconic gestures enhance communication: An ERP study. Brain and Language, 101(3), 234–245.PubMed
Wu, Y. C., & Coulson, S. (2014a). Co-speech iconic gestures and visuo-spatial working memory. Acta Psychologica, 153, 39–50.PubMed
Wu, Y. C., & Coulson, S. (2014b). A psychometric measure of working memory capacity for configured body movement. PLoS ONE, 9(1), e84834.PubMedPubMedCentral
Yıldırım, E. A., Kasar, M., Güdük, M., Ateş, E., Küçükparlak, I., & Özalmete, E. O. (2011). Investigation of the reliability of the “reading the mind in the eyes test” in a Turkish population. Turkish Journal of Psychiatry, 22(3).
Metagegevens
Titel
The role of hand gestures in emotion communication: Do type and size of gestures matter?
Auteurs
Esma Nur Asalıoğlu
Tilbe Göksun
Publicatiedatum
27-11-2022
Uitgeverij
Springer Berlin Heidelberg
Gepubliceerd in
Psychological Research / Uitgave 6/2023
Print ISSN: 0340-0727
Elektronisch ISSN: 1430-2772
DOI
https://doi.org/10.1007/s00426-022-01774-9

Andere artikelen Uitgave 6/2023

Psychological Research 6/2023 Naar de uitgave

Review

The social roots of self development: from a bodily to an intellectual interpersonal dialogue

Original Article

Motor demands influence conflict processing in a mouse-tracking Simon task

Original Article

Altered processing of conflicting body representations in women with restrictive anorexia nervosa

Original Article

Previous experiences can influence individual cricket spin bowlers’ perceptions of affordances in the performance landscape

Original Article

Insight problem solving is not that special, but business is not quite 'as usual': typical versus exceptional problem-solving strategies

Original Article

Is there a survival processing effect in metacognition?