Top

Gepubliceerd in:

29-11-2016 | Original Article

What makes a smiling face look happy? Visual saliency, distinctiveness, and affect

Auteurs: Manuel G. Calvo, Aida Gutiérrez-García, Mario Del Líbano

Gepubliceerd in: Psychological Research | Uitgave 2/2018

Abstract

We investigated the relative contribution of (a) perceptual (eyes and mouth visual saliency), (b) conceptual or categorical (eye expression distinctiveness), and (c) affective (rated valence and arousal) factors, and (d) specific morphological facial features (Action Units; AUs), to the recognition of facial happiness. The face stimuli conveyed truly happy expressions with a smiling mouth and happy eyes, or blended expressions with a smile but non-happy eyes (neutral, sad, fearful, disgusted, surprised, or angry). Saliency, distinctiveness, affect, and AUs served as predictors; the probability of judging a face as happy was the criterion. Both for truly happy and for blended expressions, the probability of perceiving happiness increased mainly as a function of positive valence of the facial configuration. In addition, for blended expressions, the probability of being (wrongly) perceived as happy increased as a function of (a) delayed saliency and (b) reduced distinctiveness of the non-happy eyes, and (c) enhanced AU 6 (cheek raiser) or (d) reduced AUs 4, 5, and 9 (brow lowerer, upper lid raiser, and nose wrinkler, respectively). Importantly, the later the eyes become visually salient relative to the smiling mouth, the more likely it is that faces will look happy.

vorige artikel Focusing on task conflict in the Stroop effect

volgende artikel Modulating adaptation to emotional faces by spatial frequency filtering

Alleen toegankelijk voor geautoriseerde gebruikers

The age (range 18–25 years, all the studies) and sex proportion were practically the same in the current study and in the prior studies, and all the participants were drawn from the same undergraduate psychology population, albeit in different years (from 2011 to 2015): (a) current experiment (M age = 21.1 years; female/male proportion = 75/25%), (b) current norming study (M age = 21.3; f/m proportion = 67/33%); (c) Calvo et al. (2012) (M age = 21.5; f/m proportion = 72/28%); (d) Calvo, Gutiérrez-García et al. (2013) (M age = 21.7; f/m proportion = 76/24%).

Adolphs, R. (2002). Recognizing emotion from facial expressions: Psychological and neurological mechanisms. Behavioral and Cognitive Neuroscience Reviews, 1, 21–62.CrossRefPubMed

Ambadar, Z., Cohn, J. F., & Reed, L. I. (2009). All smiles are not created equal: Morphology and timing of smiles perceived as amused, polite, and embarrassed/nervous. Journal of Nonverbal Behavior, 33, 17–34.CrossRefPubMedPubMedCentral

Barrett, L. F. (2006). Are emotions natural kinds? Perspectives on Psychological Science, 1, 28–58.CrossRefPubMed

Bartlett, M., & Whitehill, J. (2011). Automated facial expression measurement: Recent applications to basic research in human behavior, learning, and education. In A. Calder, G. Rhodes, M. Johnson, & J. Haxby (Eds.), Handbook of face perception (pp. 489–513). Oxford: Oxford University Press.

Beaudry, O., Roy-Charland, A., Perron, M., Cormier, I., & Tapp, R. (2014). Featural processing in recognition of emotional facial expressions. Cognition and Emotion, 28, 416–432.CrossRefPubMed

Becker, D. V., & Srinivasan, N. (2014). The vividness of the happy face. Current Directions in Psychological Science, 23, 189–194.CrossRef

Bombari, D., Schmid, P. C., Schmid-Mast, M., Birri, S., Mast, F. W., & Lobmaier, J. S. (2013). Emotion recognition: The role of featural and configural face information. Quarterly Journal of Experimental Psychology, 66, 2426–2442.CrossRef

Borji, A., & Itti, L. (2013). State-of-the-art in visual attention modeling. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35, 185–207.CrossRefPubMed

Bradley, M. M., Codispoti, M., Cuthbert, B. N., & Lang, P. J. (2001). Emotion and motivation I: Defensive and appetitive reactions in picture processing. Emotion, 1, 276–298.CrossRefPubMed

Calder, A. J., Young, A. W., Keane, J., & Dean, M. (2000). Configural information in facial expression perception. Journal of Experimental Psychology: Human Perception and Performance, 26, 527–551.PubMed

Calvo, M. G., & Beltrán, D. (2013). Recognition advantage of happy faces: Tracing the neurocognitive processes. Neuropsychologia, 51, 2051–2060.CrossRefPubMed

Calvo, M. G., & Beltrán, D. (2014). Brain lateralization of holistic versus analytic processing of emotional facial expressions. NeuroImage, 92, 237–247.CrossRefPubMed

Calvo, M. G., Beltrán, D., & Fernández-Martín, A. (2014). Early processing of happy facial expressions in peripheral vision: Neurophysiological evidence. Biological Psychology, 100, 60–70.CrossRefPubMed

Calvo, M. G., Fernández-Martín, A., & Nummenmaa, L. (2012). Perceptual, categorical, and affective processing of ambiguous smiling facial expressions. Cognition, 125, 373–393.CrossRefPubMed

Calvo, M. G., Fernández-Martín, A., & Nummenmaa, L. (2013). A smile biases the recognition of eye expressions: Configural projection from a salient mouth. The Quarterly Journal of Experimental Psychology, 66, 1159–1181.CrossRef

Calvo, M. G., Fernández-Martín, A., & Nummenmaa, L. (2014). Facial expression recognition in peripheral versus central vision: Role of the eyes and the mouth. Psychological Research, 78, 180–195.CrossRefPubMed

Calvo, M. G., Gutiérrez-García, A., Avero, P., & Lundqvist, D. (2013). Attentional mechanisms in judging genuine and fake smiles: Eye-movement patterns. Emotion, 13, 792–802.CrossRefPubMed

Calvo, M. G., Marrero, H., & Beltrán, D. (2013). When does the brain distinguish between genuine and ambiguous smiles? An ERP study. Brain and Cognition, 81, 237–246.CrossRefPubMed

Calvo, M. G., & Nummenmaa, L. (2008). Detection of emotional faces: Salient physical features guide effective visual search. Journal of Experimental Psychology: General, 137, 471–494.CrossRef

Calvo, M. G., & Nummenmaa, L. (2016). Perceptual and affective mechanisms in facial expression recognition: An integrative review. Cognition and Emotion, 30, 1081–1106.CrossRefPubMed

Carroll, N. C., & Young, A. W. (2005). Priming of emotion recognition. The Quarterly Journal of Experimental Psychology, 58A, 1173–1197.CrossRef

Cohn, J. F., & De la Torre, F. (2015). Automated face analysis for affective computing. In R. A. Calvo, S. DiMello, J. Gratch, & A. Kappas (Eds.), The Oxford handbook of affective computing (pp. 131–150). New York: Oxford University Press.

Cottrell, G. W., & Hsiao, J. H. (2011). Neurocomputational models of face processing. In A. Calder, G. Rhodes, M. Johnson, & J. Haxby (Eds.), The Oxford handbook of face perception (pp. 401–425). Oxford: Oxford University Press.

Crivelli, C., Carrera, P., & Fernández-Dols, J. M. (2015). Are smiles a sign of happiness? Spontaneous expressions of judo winners. Evolution and Human Behavior, 36, 52–58.CrossRef

Dailey, M. N., Cottrell, G. W., Padgett, C., & Adolphs, R. (2002). EMPATH: A neural network that categorizes facial expressions. Journal of Cognitive Neuroscience, 14, 1158–1173.CrossRefPubMed

Eisenbarth, H., Alpers, G. W., Segré, D., Calogero, A., & Angrilli, A. (2008). Categorization and evaluation of emotional faces in psychopathic women. Psychiatry Research, 159, 189–195.CrossRefPubMed

Ekman, P. (1992). Are there basic emotions? Psychological Review, 99, 550–553.CrossRefPubMed

Ekman, P. (2001). Telling lies: Clues to deceit in the marketplace, politics, and marriage. New York: W.W. Norton & Co.

Ekman, P., & Cordaro, D. (2011). What is meant by calling emotions basic. Emotion Review, 3, 364–370.CrossRef

Ekman, P., Friesen, W. V., & Hager, J. C. (2002). Facial action coding system. Investigator’s guide. Salt Lake City: Human Face.

Frank, M. G., Ekman, P., & Friesen, W. V. (1993). Behavioral markers and recognizability of the smile of enjoyment. Journal of Personality and Social Psychology, 64, 83–93.CrossRefPubMed

Gardiner, J. M., Ramponi, C., & Richardson-Klavehn, A. (2002). Recognition memory and decision processes: A meta-analysis of remember, know, and guess responses. Memory, 10, 83–98.CrossRefPubMed

Girard, J. M., Cohn, J. F., Jeni, L. A., Sayette, M. A., & De la Torre, F. (2015). Spontaneous facial expression in unscripted social interactions can be measured automatically. Behavior Research Methods, 47, 1136–1147.CrossRefPubMedPubMedCentral

Gunnery, S. D., & Hall, J. A. (2014). The Duchenne smile and persuasion. Journal of Nonverbal Behavior, 38, 181–194.CrossRef

Gunnery, S. D., & Ruben, M. A. (2016). Perceptions of Duchenne and non-Duchenne smiles: A meta-analysis. Cognition and Emotion, 30, 501–515.CrossRefPubMed

Gutiérrez-García, A., & Calvo, M. G. (2015). Discrimination thresholds for smiles in genuine versus blended facial expressions. Cogent Psychology, 2, 1064586.

Itti, L., & Koch, C. (2000). A saliency-based search mechanism for overt and covert shifts of visual attention. Vision Research, 40, 1489–1506.CrossRefPubMed

Johnston, L., Miles, L. K., & Macrae, C. (2010). Why are you smiling at me? Social functions of enjoyment and non-enjoyment smiles. British Journal of Social Psychology, 49, 107–127.CrossRefPubMed

Kohler, C. G., Turner, T., Stolar, N. M., Bilker, W. B., Brensinger, C. M., Gur, R. E., & Gur, R. C. (2004). Differences in facial expressions of four universal emotions. Psychiatry Research, 128, 235–244.CrossRefPubMed

Krumhuber, E. G., Likowski, K. U., & Weyers, P. (2014). Facial mimicry of spontaneous and deliberate Duchenne and non-Duchenne smiles. Journal of Nonverbal Behavior, 38, 1–11.CrossRef

Krumhuber, E. G., & Manstead, A. S. R. (2009). Can Duchenne smiles be feigned? New evidence on felt and false smiles. Emotion, 9, 807–820.CrossRefPubMed

Lang, P. J., Bradley, M. M., & Cuthbert, B. N. (2008). International affective picture system (IAPS): Affective ratings of pictures and instruction manual. Technical Report A-8. University of Florida, Gainesville, FL.

Lipp, O., Price, S. M., & Tellegen, C. L. (2009). No effect of inversion on attentional and affective processing of facial expressions. Emotion, 9, 248–259.CrossRefPubMed

Lundqvist, D., Flykt, A., & Öhman, A. (1998). The Karolinska directed emotional faces—KDEF. CD-ROM from Department of Clinical Neuroscience, Psychology section, Karolinska Institutet, Stockholm, Sweden. ISBN 91-630-7164-9.

Luo, W., Feng, W., He, W., Wang, N.-Y., & Luo, Y.-J. (2010). Three stages of facial expression processing: ERP study with rapid serial visual presentation. NeuroImage, 47, 1856–1867.

McLellan, T. L., Johnston, L., Dalrymple-Alford, J., & Porter, R. (2010). Sensitivity to genuine vs. posed emotion specified in facial displays. Cognition and Emotion, 24, 1277–1292.CrossRef

McLellan, T. L., Wilcke, J. C., Johnston, L., Watts, R., & Miles, L. K. (2012). Sensitivity to posed and genuine displays of happiness and sadness: A fMRI study. Neuroscience Letters, 531, 149–154.CrossRefPubMed

Miles, L. K., & Johnston, L. (2007). Detecting happiness: Perceiver sensitivity to enjoyment and non-enjoyment smiles. Journal of Nonverbal Behavior, 31, 259–275.CrossRef

Nelson, N. L., & Russell, J. A. (2013). Universality revisited. Emotion Review, 5, 8–15.CrossRef

Niedenthal, P. M., Mermillod, M., Maringer, M., & Hess, U. (2010). The simulation of smiles (SIMS) model: Embodied simulation and the meaning of facial expression. Behavioral and Brain Sciences, 33, 417–433.CrossRefPubMed

Nusseck, M., Cunningham, D. W., Wallraven, C., & Bülthoff, H. H. (2008). The contribution of different facial regions to the recognition of conversational expressions. Journal of Vision, 8(8), 1–23.CrossRefPubMed

Okubo, M., Kobayashi, A., & Ishikawa, K. (2012). A fake smile thwarts cheater detection. Journal of Nonverbal Behavior, 36, 217–225.CrossRef

Olderbak, S., Hildebrandt, A., Pinkpank, T., Sommer, W., & Wilhelm, O. (2014). Psychometric challenges and proposed solutions when scoring facial emotion expression codes. Behavior Research Methods, 46, 992–1006.CrossRefPubMed

Quadflieg, S., Vermeulen, N., & Rossion, B. (2013). Differential reliance on the Duchenne marker during smile evaluations and person judgments. Journal of Nonverbal Behavior, 37, 69–77.CrossRef

Russell, J. A. (1994). Is there universal recognition of emotion from facial expression? A review of the cross-cultural studies. Psychological Bulletin, 115, 102–141.CrossRefPubMed

Russell, J. A. (2003). Core affect and the psychological construction of emotion. Psychological Review, 110, 145–172.CrossRefPubMed

Slessor, G., Bailey, P. E., Rendell, P. G., Ruffman, T., Henry, J. D., & Miles, L. K. (2014). Examining the time course of young and older adults’ mimicry of enjoyment and non-enjoyment smiles. Emotion, 14, 532–544.CrossRefPubMed

Smith, M. L., Cottrell, G., Gosselin, F., & Schyns, P. G. (2005). Transmitting and decoding facial expressions of emotions. Psychological Science, 16, 184–189.CrossRefPubMed

Snodgrass, J. G., & Corwin, J. (1988). Pragmatics of measuring recognition memory: Applications to dementia and amnesia. Journal of Experimental Psychology: General, 117, 34–50.CrossRef

Susskind, J. M., Littlewort, G., Bartlett, M. S., Movellan, J., & Anderson, A. K. (2007). Human and computer recognition of facial expressions of emotion. Neuropsychologia, 45, 152–162.CrossRefPubMed

Underwood, G., & Foulsham, T. (2006). Visual saliency and semantic incongruency influence eye movements when inspecting pictures. The Quarterly Journal of Experimental Psychology, 59, 1931–1949.CrossRefPubMed

Walther, D., & Koch, C. (2006). Modelling attention to salient proto-objects. Neural Networks, 19, 1395–1407.CrossRefPubMed

Titel: What makes a smiling face look happy? Visual saliency, distinctiveness, and affect
Auteurs: Manuel G. Calvo
Aida Gutiérrez-García
Mario Del Líbano
Publicatiedatum: 29-11-2016
Uitgeverij: Springer Berlin Heidelberg
Gepubliceerd in: Psychological Research / Uitgave 2/2018
Print ISSN: 0340-0727
Elektronisch ISSN: 1430-2772
DOI: https://doi.org/10.1007/s00426-016-0829-3

Bohn Stafleu van Loghum

Deel dit onderdeel of sectie (kopieer de link)

Abstract

Log in om toegang te krijgen

Andere artikelen Uitgave 2/2018

Conflict and disfluency as aversive signals: context-specific processing adjustments are modulated by affective location associations

Cue-target contingencies modulate voluntary orienting of spatial attention: dissociable effects for speed and accuracy

Now you make false memories; now you do not: the order of presentation of words in DRM lists influences the production of the critical lure in Alzheimer’s disease

Sharing tasks or sharing actions? Evidence from the joint Simon task

Spatial attention across perception and action

Focusing on task conflict in the Stroop effect