Abstract
Faces provide a wealth of information essential to social interaction, including both static features, such as identity, and dynamic features, such as emotional state. Classic models of face perception propose separate neural-processing routes for identity and facial expression (Bruce & Young, 1986), but more recent models suggest that these routes are not independent of each other (Calder & Young, 2005). Using a perceptual adaptation paradigm in the present study, we attempted to further examine the nature of the relation between the neural representations of identity and emotional expression. In Experiment 1, adaptation to the basic emotions of anger, surprise, disgust, and fear resulted in significantly biased perception away from the adapting expression. A significantly decreased aftereffect was observed when the adapting and the test faces differed in identity. With a statistical model that separated surface texture and reflectance from underlying expression geometry, Experiment 2 showed a similar decrease in adaptation when the face stimuli had identical underlying prototypical geometry but differed in the static surface features supporting identity. These results provide evidence that expression adaptation depends on perceptual features important for identity processing and thus suggest at least partly overlapping neural processing of identity and facial expression.
Article PDF
Similar content being viewed by others
References
Adams, R. B., & Kleck, R. E. (2003). Perceived gaze direction and the processing of facial displays of emotion. Psychological Science, 14, 644–647.
Adams, R. B., & Kleck, R. E. (2005). The effects of direct and averted gaze on the perception of facially communicated emotion. Emotion, 5, 3–11.
Adolphs, R., Tranel, D., Hamann, S., Young, A. W., Calder, A. J., Phelps, E. A., et al. (1999). Recognition of facial emotion in nine individuals with bilateral amygdala damage. Neuropsychologia, 37, 1111–1117.
Anderson, A. K., Christoff, K., Panitz, D., De Rosa, E., & Gabrieli, J. D. E. (2003). Neural correlates of the automatic processing of threat facial signals. Journal of Neuroscience, 23, 5627–5633.
Bartlett, M. S., Movellan, J. R., & Sejnowski, T. J. (2002). Face recognition by independent component analysis. IEEE Transactions on Neural Networks, 13, 1450–1464.
Baudouin, J.-Y., Gilibert, D., Sansone, S., & Tiberghien, G. (2000). When the smile is a cue to familiarity. Memory, 8, 285–292.
Bruce, V. (1986). Influences of familiarity on the processing of faces. Perception, 15, 387–397.
Bruce, V., & Young, A. (1986). Understanding face recognition. British Journal of Psychology, 77, 305–327.
Bruyer, R., Laterre, C., Seron, X., Feyereisen, P., Strypstein, E., Pierrard, E., & Rectem, D. (1983). A case of prosopagnosia with some preserved covert remembrance of familiar faces. Brain & Cognition, 2, 257–284.
Calder, A. J., Beaver, J. D., Winston, J. S., Dolan, R. J., Jenkins, R., Eger, E., & Henson, R. N. A. (2007). Separate coding of different gaze directions in the superior temporal sulcus and inferior parietal lobule. Current Biology, 17, 20–25.
Calder, A. J., Burton, A. M., Miller, P., Young, A. W., & Akamatsu, S. (2001). A principal component analysis of facial expressions. Vision Research, 41, 1179–1208.
Calder, A. J., Lawrence, A. D., & Young, A. W. (2001). Neuropsychology of fear and loathing. Nature Reviews Neuroscience, 2, 352–363.
Calder, A. J., & Young, A. W. (2005). Understanding the recognition of facial identity and facial expression. Nature Reviews Neuroscience, 6, 641–651.
Cornsweet, T. N. (1962). The staircase-method in psychophysics. American Journal of Psychology, 75, 485–491.
Craw, I., & Cameron, P. (1991). Parameterising images for recognition and reconstruction. In P. Mowforth (Ed.), Proceedings of the 2nd British Machine Vision Conference (pp. 367–370). London: Springer.
de Gelder, B., & Vroomen, J. (2000). The perception of emotions by ear and by eye. Cognition & Emotion, 14, 289–311.
Dolan, R. J., Morris, J. S., & de Gelder, B. (2001). Crossmodal binding of fear in voice and face. Proceedings of the National Academy of Sciences, 98, 10006–10010.
Ekman, P., & Friesen, W. V. (1976). Pictures of facial affect. Palo Alto, CA: Consulting Psychologists Press.
Fox, C. J., & Barton, J. J. S. (2007a). Asymmetric relationship in representations of facial identity and expression for novel faces within the human visual system [Abstract]. Journal of Vision, 7(9), 997a.
Fox, C. J., & Barton, J. J. S. (2007b). What is adapted in face adaptation? The neural representations of expression in the human visual system. Brain Research, 1127, 80–89.
Ganel, T., & Goshen-Gottstein, Y. (2004). Effects of familiarity on the perceptual integrality of the identity and expression of faces: The parallel-route hypothesis revisited. Journal of Experimental Psychology: Human Perception & Performance, 30, 583–597.
Goodall, C. (1991). Procrustes methods in the statistical analysis of shape. Journal of the Royal Statistical Society: Series B, 53, 285–339.
Goshtasby, A. (1986). Piecewise linear mapping functions for image registration. Pattern Recognition, 19, 459–466.
Grill-Spector, K., Henson, R., & Martin, A. (2006). Repetition and the brain: Neural models of stimulus-specific effects. Trends in Cognitive Sciences, 10, 14–23.
Grill-Spector, K., Knouf, N., & Kanwisher, N. (2004). The fusiform face area subserves face perception, not generic within-category identification. Nature Reviews Neuroscience, 7, 555–562.
Grossman, E., Donnelly, M., Price, R., Pickens, P., Morgan, V., Neighbor, G., & Blake, R. (2000). Brain areas involved in perception of biological motion. Journal of Cognitive Neuroscience, 12, 711–720.
Haxby, J. V., Hoffman, E. A., & Gobbini, M. I. (2000). The distributed human neural system for face perception. Trends in Cognitive Sciences, 4, 223–233.
Hsu, S.-M., & Young, A. W. (2004). Adaptation effects in facial expression recognition. Visual Cognition, 11, 871–899.
Jenkins, R., Beaver, J. D., & Calder, A. J. (2006). I thought you were looking at me: Direction-specific aftereffects in gaze perception. Psychological Science, 17, 506–513.
Jiang, F., Blanz, V., & O’Toole, A. J. (2006). Probing the visual representation of faces with adaptation: A view from the other side of the mean. Psychological Science, 17, 493–500.
Kanwisher, N., McDermott, J., & Chun, M. M. (1997). The fusiform face area: A module in human extrastriate cortex specialized for face perception. Journal of Neuroscience, 17, 4302–4311.
Kaufmann, J. M., & Schweinberger, S. R. (2004). Expression influences the recognition of familiar faces. Perception, 33, 399–408.
Kℏler, W., & Wallach, H. (1944). Figural aftereffects: An investigation of visual processes. Proceedings of the American Philosophical Society, 88, 269–357.
Kurucz, J., & Feldmar, G. (1979). Prosopo-affective agnosia as a symptom of cerebral organic disease. Journal of the American Geriatrics Society, 27, 225–230.
Kurucz, J., Feldmar, G., & Werner, W. (1979). Prosopo-affective agnosia associated with chronic organic brain syndrome. Journal of the American Geriatrics Society, 27, 91–95.
LaBar, K. S., Crupain, M. J., Voyvodic, J. T., & McCarthy, G. (2003). Dynamic perception of facial affect and identity in the human brain. Cerebral Cortex, 13, 1023–1033.
Leopold, D. A., O’Toole, A. J., Vetter, T., & Blanz, V. (2001). Prototype-referenced shape encoding revealed by high-level aftereffects. Nature Neuroscience, 4, 89–94.
Littlewort, G., Bartlett, M. S., Fasel, I., Susskind, J., & Movellan, J. (2006). Dynamics of facial expression extracted automatically from video. Image & Vision Computing, 24, 615–625.
Martínez, A. M. (2003). Matching expression variant faces. Vision Research, 43, 1047–1060.
Narumoto, J., Okada, T., Sadato, N., Fukui, K., & Yonekura, Y. (2001). Attention to emotion modulates fMRI activity in human right superior temporal sulcus. Cognitive Brain Research, 12 225–231.
Perrett, D. I., Smith, P. A. J., Potter, D. D., Mistlin, A. J., Head, A. S., Milner, A. D., & Jeeves, M. A. (1984). Neurons responsive to faces in the temporal cortex: Studies of functional organization, sensitivity to identity, and relation to perception. Human Neurobiology, 3, 197–208.
Phillips, M. L., Young, A. W., Scott, S. K., Calder, A. J., Andrew, C., Giampietro, V., et al. (1998). Neural responses to facial and vocal expressions of fear and disgust. Proceedings of the Royal Society B, 265, 1809–1817.
Rhodes, G., Jeffery, L., Watson, T. L., Clifford, C. W. G., & Nakayama, K. (2003). Fitting the mind to the world: Face adaptation and attractiveness aftereffects. Psychological Science, 14, 558–566.
Schweinberger, S. R., & Soukup, G. R. (1998). Asymmetric relationships among perceptions of facial identity, emotion, and facial speech. Journal of Experimental Psychology: Human Perception & Performance, 24, 1748–1765.
Servos, P., Osu, R., Santi, A., & Kawato, M. (2002). The neural substrates of biological motion perception: An fMRI study. Cerebral Cortex, 12, 772–782.
Susskind, J. M., Littlewort, G., Bartlett, M. S., Movellan, J., & Anderson, A. K. (2007). Human and computer recognition of facial expressions of emotion. Neuropsychologia, 45, 152–162.
Walker, S., Bruce, V., & O’Malley, C. (1995). Facial identity and facial speech processing: Familiar faces and voices in the McGurk effect. Perception & Psychophysics, 57, 1124–1133.
Webster, M. A., Kaping, D., Mizokami, Y., & Duhamel, P. (2004). Adaptation to natural facial categories. Nature, 428, 557–561.
Webster, M. A., & MacLin, O. H. (1999). Figural aftereffects in the perception of faces. Psychonomic Bulletin & Review, 6, 647–653.
Winston, J. S., Henson, R. N. A., Fine-Goulden, M. R., & Dolan, R. J. (2004). fMRI-adaptation reveals dissociable neural representations of identity and expression in face perception. Journal of Neurophysiology, 92, 1830–1839.
Zhao, L., & Chubb, C. (2001). The size-tuning of the face-distortion aftereffect. Vision Research, 41, 2979–2994.
Author information
Authors and Affiliations
Corresponding author
Additional information
This work was supported by grants from the Natural Sciences and Engineering Research Council and Canada Research Chairs program to A.K.A.
Rights and permissions
About this article
Cite this article
Ellamil, M., Susskind, J.M. & Anderson, A.K. Examinations of identity invariance in facial expression adaptation. Cognitive, Affective, & Behavioral Neuroscience 8, 273–281 (2008). https://doi.org/10.3758/CABN.8.3.273
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/CABN.8.3.273