Skip to main content
Log in

Functional Mapping of Dynamic Happy and Fearful Facial Expression Processing in Adolescents

  • Published:
Brain Imaging and Behavior Aims and scope Submit manuscript

Abstract

This paper assessed the neural systems involved in processing of dynamic facial expressions in adolescents. The processing of facial expressions changes as a function of age, and it is thus important to understand how healthy adolescent subjects process dynamic facial expressions prior to analyzing disease-related changes. We hypothesized that viewing of dynamic facial expressions with opposing valences (happy vs. fearful) induces differential activations and deactivations in the brain. 27 healthy adolescents (9 ♀, 18 ♂, mean age = 14.5 years; age range 11.6–17.3 years) were examined by using the ASSQ and K-SADS-PL and scanned with 1.5-T fMRI during viewing of dynamic facial expressions and mosaic control images. The stimuli activated the same areas as previously seen in dynamic facial expression in adults. Our results indicated that opposing-valence dynamic facial expressions had differential effects on many cortical structures but not on subcortical limbic structures. The mirror neuron system is activated more during viewing of fearful compared to happy expressions in bilateral inferior frontal gyrus (IFG) and superior temporal sulcus (STS) left dominantly. We also detected more deactivation in the ventral anterior cingulate gyrus (ACG), showing more automated attentional processing of fearful expressions during passive viewing. Females were found to deactivate the right frontal pole more than male adolescents during happy facial expressions, while there were no differences in fear processing between genders. No clear gender or age effects were detected. In conclusion fear induces stronger responses in attention and mirror neurons probably related to fear contagion.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Abbreviations

ASSQ:

Autism Spectrum Screening Questionnaire

ACG:

Anterior cingulate gyrus

Basic expression:

Facial expression of basic emotion

BA:

Brodmann area

BOLD:

Blood oxygenation level dependent

EK:

Ekman’s collections

FACS:

Facial Action Coding System

FFA:

Fusiform face area

IAPS:

The International Affective Pictures System (IAPS)

IFG:

Inferior frontal gyrus

JBL:

Juxtapositional lobule

K-SADS-PL:

Schedule for Affective Disorders and Schizophrenia for School-Age Children – Present and Lifetime Version (K-SADS-PL)

MFC:

Medial frontal cortex

MNS:

Mirror neuron system

OFA:

Occipital face area

PFC:

Prefrontal cortices

PMC:

Premotor cortex

PPC:

Posterior parietal cortex

pSTS:

Posterior superior temporal sulcus

SFG:

Superior frontal gyrus

SMA:

Supplementary motor area

SMG:

Supramarginal gyrus

STG:

Superior temporal gyrus

STS:

Superior temporal sulcus

References

  • Amodio, D., & Frith, C. (2006). Meeting of minds: the medial frontal cortex and social cognition. Nature Reviews Neuroscience, 7, 268–277.

    Article  CAS  PubMed  Google Scholar 

  • Beckmann, M., Jenkinson, M., & Smith, S. M. (2003). General multi-level linear modelling for group analysis in FMRI. NeuroImage, 20(2), 1052–1063.

    Article  PubMed  Google Scholar 

  • Bigler, E., Mortensen, S., Neeley, E., Ozonoff, S., Krasny, L., & Johnson, M. (2007). Superior temporal gyrus, language function, and autism. Developmental Neuropsychology, 31(2), 217–238.

    PubMed  Google Scholar 

  • Boddaert, N., Chabane, N., Gervais, H., Good, C., Bourgeous, M., & Plumet, M.-H. (2004). Superior temporal sulcus anatomical abnormalities in childhood autism: a voxel-based morphometry MRI study. Neuroimage, 23(1), 364–369.

    Article  CAS  PubMed  Google Scholar 

  • Buckner, R., & Vincenta, J. (2007). Unrest at rest: default activity and spontaneous network correlations. Neuroimage, 37, 1091–1096.

    Article  PubMed  Google Scholar 

  • Cahill, L. (2006). Why sex matters for neuroscience. Nature Reviews. Neuroscience, 7, 477–484.

    Article  CAS  PubMed  Google Scholar 

  • Calder, A., Keane, J., Manes, F., Antoun, N., & Young, A. (2000). Impaired recognition and experience of disgust following brain injury. Nature Neuroscience, 3(11), 1077–1078.

    Article  CAS  PubMed  Google Scholar 

  • Calder, A., Lawrence, A., & Young, A. (2001). The neuropsychology of fear and loathing. Nature Reviews. Neuroscience, 2, 352–363.

    Article  CAS  PubMed  Google Scholar 

  • Cattaneo, L., & Rizzolatti, G. (2009). The mirror neuron system. Archives of Neurology, 66(5), 557–560.

    Article  PubMed  Google Scholar 

  • Charland, L. (2005a). Emotion experience and the indeterminacy of valence. In L. F. Barrett, P. Niedenthal, & P. Winkielman (Eds.), Emotions: Conscious and unconscious. New York: Guilford.

    Google Scholar 

  • Charland, L. (2005b). The heat of emotion: valence and the demarcation problem. Journal of Consciousness Studies, 12(8–10), 82–102.

    Google Scholar 

  • Colombetti, G. (2005). Appraising valence. Journal of Consciousness Studies, 12(8–10), 103–26.

    Google Scholar 

  • Custini, R., & Feldman, R. (1989). Children’s social competence and nonverbal encoding and decoding of emotions. Journal of Clinical Child Psychology, 18, 336–342.

    Article  Google Scholar 

  • Dapretto, M., Davies, M., Pfeifer, J., Scott, A., Sigman, M., Bookheimer, S., et al. (2006). Understanding emotions in others: mirror neuron dysfunction in children with autism spectrum disorders. Nature Neuroscience, 9(1), 28–30.

    Article  CAS  PubMed  Google Scholar 

  • Darwin, C. (1872/1998). The expression of the emotions in man and animals, P. Ekman (Ed.). Oxford: Oxford University Press (Original work published 1872).

  • de Gelder, B., Snyder, J., Greve, D., Gerard, G., & Hadjikhani, N. (2004). Fear fosters flight: a mechanism for fear contagion when perceiving emotion expressed by a whole body. Proceedings of the National Academy of Sciences, 101(47), 16701–16706.

    Article  Google Scholar 

  • de Gelder, B., van der Riet, W., Grezes, J., & Denollet, J. (2008). Decreased differential activity in the amygdale in response to fearful expressions in Type D personality. Clinical Neurophysiologie Clinigue/Clinical Neuropshysiologie, 38, 163–169.

    Article  Google Scholar 

  • Deeley, Q., Daly, E., Azuma, R., Surguladze, S., Giampietro, V., & Brammer, M. (2008). Changes in male brain responses to emotional faces from adolescence to middle age. NeuroImage, 40(1), 389–397.

    Article  PubMed  Google Scholar 

  • Delgado, M., Olsson, A., & Phelps, E. (2006). Extending animal models of fear conditioning to humans. Biological Psychology, 73, 39–48.

    Article  CAS  PubMed  Google Scholar 

  • Ehlers, S., Gillberg, C., & Wing, L. (1999). A screening questionnaire for Asperger syndrome and other high-functioning autism spectrum disorders in school age children. Journal of Autism Developmental Disorders, 29(2), 129–141.

    Article  CAS  Google Scholar 

  • Ekman, P., Friesen, W. (1976). Pictures of facial affect. Palo Alto, CA: Consulting Psychologist Press.

    Google Scholar 

  • Ekman, P., Friesen, W. (1978). Pictures of facial affect. Palo Alto, CA: Consulting Psychologist Press.

    Google Scholar 

  • Ekman, P., & Friesen, W. (1986). A new pan-cultural facial expression of emotion. Motivation and Emotion, 10(2), 159–168.

    Article  Google Scholar 

  • Ekman, P., Friesen, W., Hager, J. (2002). Facial Action Coding System: Investigator´s Guide. 2nd ed, Salt Lake City: Research Nexus eBook.

    Google Scholar 

  • Gotlib, I., Sivers, H., Gabrieli, J., Whitfield-Gabrieli, S., Goldin, P., Minor, K. et al. (2005). Subgenual anterior cingulate activation to valenced emotional stimuli in major depression. Neuroreport, 16(16), 1731–1734.

    Article  PubMed  Google Scholar 

  • Hadjikhani, N., Joseph, R., Snyder, J., Chabris, C., Clark, J., & Steele, S. (2004). Activation of the fusiform gyrus when individuals with autism spectrum disorder view faces. Neuroimage, 22, 1141–1150.

    Article  PubMed  Google Scholar 

  • Haxby, J., Hoffman, E., & Gobbini, M. (2001). The distributed human neural system for face perception. Trends in Cognitive Sciences, 4, 223–233.

    Article  Google Scholar 

  • Haxby, J., Hoffman, E., & Gobbini, M. (2002). Human neural systems for face recognition and social communication. Biological Psychiatry, 51(1), 59–67.

    Article  PubMed  Google Scholar 

  • Herba, H., & Phillips, M. (2004). Annotation:development of facial expression recognition from childhood to adolescence: behavioral and neurological perspectives. Journal of Child Psychology and Psychiatry, 45, 1185–1198.

    Article  PubMed  Google Scholar 

  • Hsu, S.-M., & Pessoa, L. (2007). Dissociable effects of bottom-up and top-down factors in the processing of unattended fearful faces. Neuropsychologi, 45(13), 3075–3086.

    Article  Google Scholar 

  • Iacoboni, I., & Dapretto, M. (2006). The mirror neuron system and the consequences of its dysfunction. Nature Reviews Neuroscience, 7(12), 942–951.

    Article  CAS  PubMed  Google Scholar 

  • Ishai, A., Schmidt, C., & Boesiger, P. (2005). Face perception is mediated by a distributed cortical network. Brain Research Bulletin, 67, 87–93.

    Article  PubMed  Google Scholar 

  • Jansson-Verkasalo, E., Kujala, T., Jussila, K., Mattila, M. L., Moilanen, I., Näätänen, R., et al. (2005). Similarities in the phenotype of the auditory neural substrate in children with Asperger syndrome and their parents. European Journal of Neuroscience, 22(4), 986–990.

    Article  CAS  PubMed  Google Scholar 

  • Jenkinson, M., & Smith, S. (2001). A global optimisation method for robust affine registration of brain images. Medical Image Analysis, 5(2), 143–156.

    Article  CAS  PubMed  Google Scholar 

  • Jenkinson, M., Bannister, P., Brady, J., & Smith, S. (2002). Improved optimization for the robust and accurate linear registration and motion correction of brain images. NeuroImage, 17(2), 825–841.

    Article  PubMed  Google Scholar 

  • Kanwisher, N., McDermott, J., & Chun, M. (1997). The fusiform face area: a module in human extrastriate cortex specialized for face perception. Journal of Neuroscience, 17, 4302–4311.

    CAS  PubMed  Google Scholar 

  • Kätsyri, J. (2006). Human Recognition of Basic Emotions from Posed and Animated Dynamic Facial Expressions. Helsinki University of Technology. Dissertation in PDF format (ISBN 951-22-8538-831X).

  • Kätsyri, J., & Sams, M. (2008). The effect of dynamics on identifying basic emotions from synthetic and natural faces. International Journal of Human-Computer Studies, 66(4), 233–242.

    Article  Google Scholar 

  • Kaufman, J., Birmaher, B., Brent, D., Rao, U., Flynn, C., Moreci, P., et al. (1997). Schedule for affective disorders and schizophrenia for school-age children—present and lifetime version (K-SADS-PL): initial reliability and validity data. Journal of the American Academy Child and Adolescent Psychiatry, 36(7), 980–988.

    Article  CAS  Google Scholar 

  • Kolb, B., Wilson, B., & Taylor, L. (1992). Developmental changes in the recognition and comprehension of facial expression: implications for frontal lobe function. Brain and Cognition, 20(1), 74–84.

    Article  CAS  PubMed  Google Scholar 

  • Kuusikko, S., Pollock-Wurman, R., Jussila, K., Carter, A. S., Mattila, M. L., Ebeling, H., et al. (2008). Social anxiety in high-functioning children and adolescents with Autism and Asperger syndrome. Journal of Autism and Developmental Disorders, 38(9), 1697–1709.

    Article  PubMed  Google Scholar 

  • Kuusikko, S., Haapsamo, H., Jansson-Verkasalo, E., Hurtig, T., Mattila, M. L., Ebeling, H., et al. (2009). Emotion recognition in children and adolescents with autism spectrum disorders. Journal of Autism and Developmental Disorders, 39(6), 938–945.

    Article  PubMed  Google Scholar 

  • LaBar, K., Crupain, M., Voyvodic, J., & McCarthy, G. (2003). Dynamic perception of facial affect and identity in the human brain. Cerebral Cortex, 13(10), 1023–1033.

    Article  PubMed  Google Scholar 

  • LaBar, S., & Cabeza, R. (2006). Cognitive neuroscience of emotional memory. Neuroscience, 7, 54–64.

    CAS  PubMed  Google Scholar 

  • LeDoux, J. (2003). The emotional brain, fear, and the amygdala. Cellular and Molecular Neurobiology, 23(4–5), 727–738.

    Article  PubMed  Google Scholar 

  • Leslie, K., Johanson-Frey, S., & Grafton, S. (2004). Functional imaging of face and hand imitation: towards a motor theory of empathy. Neuroimage, 21, 601–607.

    Article  PubMed  Google Scholar 

  • Lewis, P., Critchley, H., Rotshtein, P., & Dolan, R. (2007). Neural correlates of processing valence and arousal in affective words. Cerebral Cortex, 17(3), 742–748.

    Article  CAS  PubMed  Google Scholar 

  • Lobaugh, N., Gibson, E., & Taylor, M. (2006). Children recruit distinct neural systems for implicit emotional face processing. Neuroreport, 17(2), 215–219.

    Article  PubMed  Google Scholar 

  • Malinen, S., Hlushchuk, Y., & Hari, R. (2007). Towards natural stimulation in fMRI—issues of data analysis. NeuroImage, 35, 131–139.

    Article  PubMed  Google Scholar 

  • Mattila, M.-L., Kielinen, M., Jussila, K., Linna, S. L., Bloigu, R., Ebeling, H., et al. (2007). An epidemiological and diagnostic study of Asperger syndrome according to four sets of diagnostic criteria. Journal of the American Academy of Child and Adolescent Psychiatry, 46, 636–646.

    Article  PubMed  Google Scholar 

  • Morris, J., Ohman, A., & Dolan, R. (1998). Conscious and unconscious emotional learning in the human amygdala. Nature, 393, 467–470.

    Article  CAS  PubMed  Google Scholar 

  • Nishitani, N., Schűrmann, M., Amunts, K., & Hari, R. (2005). Broca’s region: from action to language. Physiology, 20, 60–69.

    Article  PubMed  Google Scholar 

  • Nummenmaa, L., Hirvonen, J., Parkkola, R., & Hietanen, J. (2008). Is emotional contagion special? An fMRI study on neural systems for affective and cognitive empathy. Neuroimage, 43(3), 571–580.

    Article  PubMed  Google Scholar 

  • Petrovic, P., Dietrich, T., Fransson, P., Andersson, J., Carlsson, K., & Ingvar, M. (2005). Placebo in emotional processing-induced expectations of anxiety relief activate a generalized modulatory network. Neuron, 46(6), 957–969.

    Article  CAS  PubMed  Google Scholar 

  • Pfeifer, H., Iacoboni, M., Mazziotta, J., & Dapretto, M. (2008).Mirroring other’s emotions relates to empathy and interpersonal competence in children. Neuroimage, 39, 2076–2085.

    Article  PubMed  Google Scholar 

  • Phelps, E., Delgado, M., Nearing, K., & LeDoux, E. (2004). Extinction learning in humans: role of the amygdala and vmPFC. Neuron, 43(6), 897–905.

    Article  CAS  PubMed  Google Scholar 

  • Phillips, M. L., Drevets, W. C., Rauch, S. L., & Lane, R. (2003a). Neurobiology of emotion perception I: the neural basis of normal emotion perception. Biological Psychiatry, 54, 504–514.

    Article  PubMed  Google Scholar 

  • Phillips, M. L., Drevets, W. C., Rauch, S. L., & Lane, R. (2003b). Neurobiology of emotion perception II: implications for major psychiatric disorders. Biological Psychiatry, 54, 515–528.

    Article  PubMed  Google Scholar 

  • Puce, A., Constable, R., Luby, M., McCarthy, G., Nobre, A., & Spencer, D. (1995). Functional magnetic resonance imaging of sensory and motor cortex: comparison with electrophysiological localization. Journal of Neurosurgery, 83(2), 262–270.

    Article  CAS  PubMed  Google Scholar 

  • Raichle, M., MacLeod, A., Snyder, A., Powers, W., Gusnard, D., & Shulman, G. (2001). A default mode of brain function. Proceedings of National Academy of Sciences of the United States of America, 16(2), 676–682.

    Article  Google Scholar 

  • Redcay, E. (2008). The superior temporal sulcus performs a common function for social and speech perception: implications for the emergence of autism. Neuroscience and Biobehavioral Reviews, 32, 123–142.

    Article  PubMed  Google Scholar 

  • Rizzolatti, G., & Craighero, L. (2004). The mirror-neuron system. Annual Review of Neuroscience, 27, 169–192.

    Article  CAS  PubMed  Google Scholar 

  • Rizzolatti, G., Fogassi, L., & Gallese, V. (2001). Neurophysiological mechanisms underlying the understanding and imitation of action. Nature Reviews Neuroscience, 2, 661–670.

    Article  CAS  PubMed  Google Scholar 

  • Sato, W., Kochiyama, T., Yoshikawa, S., Naito, E., & Matsumura, M. (2004). Enhanced neural activity in response to dynamic facial expressions of emotion: an fMRI study. Cognitive Brain Research, 20(1), 81–91.

    Article  PubMed  Google Scholar 

  • Schlosberg, H. (1941). A scale of the judgement of facial expressions. Journal of Experimental Psychology, 29(6), 229–37.

    Google Scholar 

  • Schlosberg, H. (1954). Three dimensions of emotions. Psychiological Review, 61(2), 81–8.

    Article  CAS  Google Scholar 

  • Smith, S. (2002). Fast robust automated brain extraction. Human Brain Mapping, 17(3), 143–155.

    Article  PubMed  Google Scholar 

  • Tonks, J., Williams, W., Frampton, I., Yates, P., & Slater, A. (2007). Assessing emotion recognition in 9–15-years olds: preliminary analysis of abilities in reading emotions from faces, voices and eyes. Brain Injury, 21, 623–629.

    Article  PubMed  Google Scholar 

  • Trautmann, S., Fehr, T., & Herrmann, M. (2009). Emotions in motion: dynamic compared to static facial expressions of disgust and happiness reveal more widespread emotion-specific activations. Brain Research, 1284, 100–115.

    Article  CAS  PubMed  Google Scholar 

  • Van der Gaag, C., Minderaa, R., & Keysers, C. (2007). Facial expressions: what the mirror neuron system can and cannot tell us. Social Neuroscience, 2(3–4), 179–222.

    Article  PubMed  Google Scholar 

  • Vuilleumier, P., Armony, J., Driver, J., & Dolan, R. (2001). Effects of attention and emotion on face processing in the human brain: an event-related fMRI study. Neuron, 30, 829–841.

    Article  CAS  PubMed  Google Scholar 

  • Vuilleumier, P., & Driver, J. (2007). Modulation of visual processing by attention and emotion: windows on causal interactions between human brain regions. Philosophical Transactions of The Royal Society, 362, 837–855.

    Article  Google Scholar 

  • Wager, M., Morris, A., McGlone, F., Abbott, D., & Mattingley, J. (2004). Amygdala responses to fearful and happy facial expressions under conditions of binocular suppression. Journal of Neuroscience, 24, 2898–2904.

    Article  Google Scholar 

  • Williams, M., Morris, A., McGlone, F., Abbott, D., & Mattingley, J. (2004). Amygdala responses to fearful and happy facial expressions under conditions of binocular suppression. Journal of Neuroscience, 24, 2898–2904.

    Article  CAS  PubMed  Google Scholar 

  • Woodworth, R. (1938). Experimental psychology. New York: Holt.

    Google Scholar 

  • Woodworth, R., Schlosberg, H., (1954). Experimental Psychology: Revised edition. New York: Henry Holt.

  • Woolrich, M., Behrens, T., Beckmann, T., Jenkinson, M., & Smith, S. (2004). Multi-level linear modelling for FMRI group analysis using Bayesian inference. NeuroImage, 21(4), 1732–1747.

    Article  PubMed  Google Scholar 

  • Yurgelun-Todd, D., Killgore, W. (2006). Fear-related activity in the prefrontal cortex increases with age during adolescence: a preliminary fMRI study. Neuroscience Letters, 9; 406(3):194–199.

    Google Scholar 

Download references

Acknowledgements

We wish to thank the adolescents and their families for participating. This study received financial support from the Alma and K. A. Snellman Foundation, Oulu, Finland, the Emil Aaltonen Foundation, Finland, the Sigrid Jusélius Foundation, Finland and the Thule Institute, Oulu, Finland. This study was funded by Finnish Academy Grant # 117111 and Finnish Medical Foundation grants. The Graduate School of Circumpolar Wellbeing Health and Adaptation is acknowledged for their support.

Declaration of interest:

None

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jukka Rahko.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Rahko, J., Paakki, JJ., Starck, T. et al. Functional Mapping of Dynamic Happy and Fearful Facial Expression Processing in Adolescents. Brain Imaging and Behavior 4, 164–176 (2010). https://doi.org/10.1007/s11682-010-9096-x

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11682-010-9096-x

Keywords

Navigation