Abstract
In this study, we investigated the emotional effect of dynamic presentation of facial expressions. Dynamic and static facial expressions of negative and positive emotions were presented using computer-morphing (Experiment 1) and videos of natural changes (Experiment 2), as well as other dynamic and static mosaic images. Participants rated the valence and arousal of their emotional response to the stimuli. The participants consistently reported higher arousal responses to dynamic than to static presentation of facial expressions and mosaic images for both valences. Dynamic presentation had no effect on the valence ratings. These results suggest that dynamic presentation of emotional facial expressions enhances the overall emotional experience without a corresponding qualitative change in the experience, although this effect is not specific to facial images.
Similar content being viewed by others
Notes
In contrast to this view, some researchers have proposed that arousal indicates the quality of emotional experience, which is different from that of valence (e.g., Russell, 1989). To clarify this issue, we replicated Experiment 1 and measured intensity, instead of arousal, with 15 participants. The results were almost identical to those of Experiment 1: The valence ratings indicated that participants experienced a negative subjective emotion in response to fearful faces and a positive emotion in response to happy faces, and that dynamic presentation had no effect on the valence ratings; The results of the intensity ratings indicated that dynamically presented stimuli were rated as highly intense relative to static stimuli. These results suggest that, at least for emotional experience in response to dynamic faces and their mosaics, arousal and intensity can be used interchangeably.
References
Berry, D. S. (1990). What can a moving face tell us? Journal of Personality and Social Psychology, 58, 1004–1014.
Bruce, V., & Valentine, T. (1988). When a nod’s as good as a wink: The role of dynamic information in facial recognition. In M. M. Gruneberg, P. E. Morris & R. N. Sykes (Eds.), Practical Aspects of Memory: Current Research and Issues (Vol. 1, pp. 169–174). New York: John Wiley & Sons.
De Gelder, B., Vroomen, J., Pourtois, G., & Weiskrantz, L. (1999). Non-conscious recognition of affect in the absence of striate cortex. Neuroreport, 10, 3759–3763.
Detenber, B. H., & Simons, R. F. (1998). Roll ‘em!: The effects of picture motion on emotional responses. Journal of Broadcasting & Electronic Media, 42, 112–126.
Dimberg, U. (1988). Facial electromyography and the experience of emotion. Journal of Psychophysiology, 2, 277–282.
Ekman, P., & Friesen, W. V. (1975). Unmasking the face: A guide to recognizing emotions from facial clues. Englewood Cliffs, NJ: Prentice–Hall.
Ekman, P., & Friesen, W. V. (1976). Pictures of facial affect. Palo Alto, CA: Consulting Psychologist.
Frijda, N. H. (1953). The understanding of facial expression of emotion. Acta Psychologica, 9, 294–362.
Frijda, N. H. (1986). Facial expression processing. In H. Ellis, M. A. Jeeves, F. Newcombe, & A. Young (Eds.), Aspects of face processing (pp. 319–325). Dordrecht, The Netherlands: M. Nijhoff.
Frijda, N. H. (1996). On the functions of emotional expression. In A. Vingerhoets, F. Van Bussel, & J. Boelhouwer (Eds.), The (Non)expression of emotions in health and disease (pp. 1–14). Tilburg, the Netherlands: Tilburg University Press.
Frijda, N. H., Ortony, A., Sonnemans J., & Clore, G. L. (1992). The complexity of intensity: Issues concerning the structure of emotion intensity. In M. S. Clark (Ed.), Review of personality and social psychology (Vol. 13, pp. 60–89). Newbury Park, CA: Sage.
Greenwald, M. K., Cook, E. W., & Lang, P. J. (1989). Affective judgment and psychophysiological response: Dimensional covariation in the evaluation of pictorial stimuli. Journal of Psychophysiology, 3, 51–64.
Harwood, N. K., Hall, L. J., & Shinkfield, A. J. (1999). Recognition of facial emotional expressions from moving and static displays by individuals with mental retardation. American Journal of Mental Retardation, 104, 270–278.
Hess, U., & Blairy, S. (2001). Facial mimicry and emotional contagion to dynamic emotional facial expressions and their influence on decoding accuracy. International Journal of Psychophysiology, 40, 129–141.
Hess, U., Kappas, A., McHugo, G. J., Lanzetta, J. T., & Kleck, R. E. (1992). The facilitative effect of facial expression on the self-generation of emotion. International Journal of Psychophysiology, 12, 251–265.
Hill, H., & Johnston, A. (2001). Categorizing sex and identity from the biological motion of faces. Current Biology, 11, 880–885.
Humphreys, G. W., Donnelly, N., & Riddoch, M. J. (1993). Expression is computed separately from facial identity, and it is computed separately for moving and static faces: Neuropsychological evidence. Neuropsychologia, 31, 173–181.
Johnsen, B. H., Thayer, J. F., & Hugdahl, K. (1995). Affective judgment of the Ekman faces: A dimensional approach. Journal of Psychophysiology, 9, 193–202.
Johnson, M. H., Dziurawiec, S., Ellis, H., & Morton, J. (1991). Newborns’ preferential tracking of face-like stimuli and its subsequent decline. Cognition. 40, 1-19.
Kanwisher, N., McDermott, J., & Chun, M. M. (1997). The fusiform face area: A module in human extrastriate cortex specialized for face perception. Journal of Neuroscience, 17, 4302-4311.
Keltner, D., & Kring, A. (1998). Emotion, social function, and psychopathology. Review of General Psychology, 2, 320-342.
Knappmeyer, B., Thornton, I. M., & Bulthoff, H. H. (2003). The use of facial motion and facial form during the processing of identity. Vision Research, 43, 1921–1936.
Kozel, N. J., & Gitter, A. G. (1968). Perception of emotion: Differences in mode of presentation, sex of perceiver, and race of expressor. CRC-Report, 18, 36.
Lander, K., Christie, F., & Bruce, V. (1999). The role of movement in the recognition of famous faces. Memory and Cognition, 27, 974–985.
Lang, P. J., Bradley, M. M., & Cuthbert, B. N. (1998). Emotion, motivation, and anxiety: Brain mechanisms and psychophysiology. Biological Psychiatry, 44, 1248–1263.
Lundqvist, L. O., & Dimberg, U. (1995). Facial expressions are contagious. Journal of Psychophysiology, 9, 203–211.
Mukaida, S., Kamachi, M., Kato, T., Oda, M., Yoshikawa, S., & Akamatsu, S. (2000). Foolproof utilities for facial image manipulation. Kyoto, Japan: ATR.
O’Toole, A. J., Roark, D. A., & Abdi, H. (2002). Recognizing moving faces: A psychological and neural synthesis. Trends in Cognitive Sciences, 6, 261–266.
Planalp, S. (1999). Communicating emotion: Social, moral, and cultural processes. New York: Cambridge University Press.
Reisenzein, R. (1994). Pleasure-arousal theory and the intensity of emotions. Journal of Personality and Social Psychology, 67, 525–539.
Russell, J. A. (1989). Measures of emotion. In R. Plutchik & H. Kellerman (Eds.), The measurement of emotions. Emotion: Theory, research, and experience (Vol. 4, pp. 83–111). San Diego, CA: Academic Press.
Sato, W., Kochiyama, T., Yoshikawa, S., Naito, E., & Matsumura, M. (2004). Enhanced neural activity in response to dynamic facial expressions of emotion: An fMRI study. Brain Research. Cognitive Brain Research, 20, 81–91.
Sato, W., & Yoshikawa, S. (2004). The dynamic aspects of emotional facial expressions. Cognition and Emotion, 18, 701–710.
Sato, W., & Yoshikawa, S. (in press). Spontaneous facial mimicry in response to dynamic facial expressions. Cognition.
Schiff, W., Banka, L., & de Bordes Galdi, G. (1986). Recognizing people seen in events via dynamic “mug shots.” American Journal of Psychology, 99, 219–231.
Schneider, F., Gur, R. C., Gur, R. E., & Muenz, L. R. (1994). Standardized mood induction with happy and sad facial expressions. Psychiatry Research, 51, 19–31.
Simons, R. F., Detenber, B. H., Reiss, J. E., & Shults, C. W. (2000). Image motion and context: a between- and within-subjects comparison. Psychophysiology, 37, 706–710.
Simons, R. F., Detenber, B. H., Roedema, T. M., & Reiss, J. E. (1999). Emotion processing in three systems: The medium and the message. Psychophysiology, 36, 619–627.
Stone, J. V. (1998). Object recognition using spatiotemporal signatures. Vision Research, 38, 947–951.
Tabachnick, B. G., & Fidell, L. S. (2001). Computer-assisted research design and analysis. Boston, MA: Allyn and Bacon.
Tomkins, S. (1982). Affect theory. In P. Ekman (Ed.), Emotion in the human face (2nd ed., pp. 353–397). Cambridge, UK: Cambridge University Press.
Wehrle, T., Kaiser, S., Schmidt, S., & Scherer, K. R. (2000). Studying the dynamics of emotional expression using synthesized facial muscle movements. Journal of Personality and Social Psychology, 78, 105–119.
Wild, B., Erb, M., & Bartels, M. (2001). Are emotions contagious? Evoked emotions while viewing emotionally expressive faces: quality, quantity, time course and gender differences. Psychiatry Research, 102, 109–124.
Acknowledgements
The authors heartily thank Dr. Robert F. Simons, Dr. Monica Harris, and anonymous reviewers for their helpful advice. This study was supported by Special Coordination Funds for promoting Science and Technology from the Science and Technology Agency of the Japanese government, and by a Research Fellowship from the Japan Society for the Promotion of Science.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Sato, W., Yoshikawa, S. Enhanced Experience of Emotional Arousal in Response to Dynamic Facial Expressions. J Nonverbal Behav 31, 119–135 (2007). https://doi.org/10.1007/s10919-007-0025-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10919-007-0025-7