Elsevier

Biological Psychology

Volume 94, Issue 2, October 2013, Pages 397-407
Biological Psychology

Automatic facial responses to briefly presented emotional stimuli in autism spectrum disorder

https://doi.org/10.1016/j.biopsycho.2013.08.004Get rights and content

Highlights

  • The ASD group failed to differentiate by valence in zygomaticus and corrugator EMG.

  • Brief emotions do not sufficiently engage mimicry system in high-functioning ASDs.

  • Pre- and post-stimulus arousal (SCL, SCR) were atypical with stimulus repetition.

  • Typical ECD suggests individuals had intact stimulus registration/detection.

  • Disruption in allocation of attention to faces provides a target for interventions.

Abstract

Emotion processing, including automatic facial mimicry, plays an important role in social reciprocity. Disruptions in these processes have implications for individuals with impaired social functioning, such as autism spectrum disorders (ASDs). Past research has demonstrated that ASDs are impaired in the recognition of briefly presented emotions and display atypical mimicry of emotions presented for protracted duration. Mimicry (electromyography; EMG) of briefly presented emotions was investigated in adults with ASDs. Concurrent measures of skin conductance and cardiac responses were used as markers of orientation and stimulus detection, respectively. A backward masking task was employed whereby the emotional face (happy, angry) was presented for 30 ms followed by a neutral face “mask”. An implicit comparison task required rapid gender identification. The ASD group failed to differentiate by valence in their EMG (zygomaticus, corrugator) and demonstrated atypical pre- and post-stimulus arousal. These findings may provide a potential mechanism for marked deficits in social reciprocity.

Introduction

Individuals with autism spectrum disorders (ASDs; including autism and Asperger's Syndrome)1 display marked impairments in social interaction (poor social-emotional reciprocity, deficits in the use of non-verbal communication such as eye-gaze and facial expression) and the presence of repetitive and stereotyped behaviours (APA, 2000, APA, 2013). Consistent with diagnostic criteria of marked deficits in reciprocal social interaction, individuals with ASDs generally have impaired emotion processing and recognition. Studies have shown that low-functioning children display deficits in the recognition of basic facial emotional expressions (Celani et al., 1999, Gross, 2004), whereas high-functioning individuals with ASDs appear impaired in the recognition of complex (e.g., sincerity, pride and embarrassment; Capps et al., 1992, Golan et al., 2007) but not basic emotions (Adolphs et al., 2001, Boucher et al., 2000, Capps et al., 1992, Grossman et al., 2000, Loveland et al., 1997). As a result, it has been suggested that emotional responsivity and recognition in ASDs increases with cognitive ability (Dissanayake et al., 1996, Rutherford and McIntosh, 2007). In order to diminish the confound of cognitive ability, emotional stimuli may be presented briefly, thereby shifting the load from higher-level intellectual functioning to more automatic processing abilities. Using a backward masking paradigm, whereby participants are exposed to brief displays that are rapidly masked, or simply rapidly presenting the emotional face without a mask, two recent studies demonstrated that high-functioning children (Hall, West, & Szatmari, 2007) and young adults (Clark, Winkielman, & McIntosh, 2008) with ASDs continue to be impaired in the recognition of basic emotional stimuli (fear/neutral backward masking (33 ms) and happy/angry rapid presentation (30 ms), respectively. Importantly, these deficits were specific to emotion recognition, as recognition of facial identity, age, and gender remained intact (Celani et al., 1999, Clark et al., 2008).

This finding is intriguing and prompts further enquiry as to the basic processes involved in recognising and processing emotional stimuli, in particular, automatic orientation to and mimicry of emotional expressions. Mimicry, including rapid, automatic facial responses to facial emotions and affective scenes, may be conceptualised as a marker of emotional processing and affective response to the environment (Cacioppo et al., 1986, Dimberg and Thunberg, 1998, Winkielman and Cacioppo, 2001). It is present at an early age, such that typically developing infants actively seek and mimic the facial expressions of their mothers (Haviland & Lelwica, 1987), and use this information to regulate their responses to ambiguous environmental stimuli (Smith, McHugo, & Kappas, 1996). Similarly, automatic facial mimicry is not purely a motor mirroring of environmental stimuli, but reciprocally interacts with emotional state, thus providing important emotional feedback information (Moody, McIntosh, Mann, & Weisser, 2007). Furthermore, mimicry facilitates emotion recognition, whilst preventing or blocking mimicry impairs emotion processing (Neidenthal et al., 2001, Oberman et al., 2007). Impaired mimicry may therefore have negative effects for social reciprocity (see Hatfield, Cacioppo, & Rapson, 1994 for review). This has important implications for individuals with known impairments in social functioning, such as autism spectrum disorders (ASDs).

Mimicry is typically investigated using automatic facial muscle responses (as measured by electromyography; EMG). For example, the corrugator supercilii (frown) muscle is generally increased in response to angry faces and other negative stimuli, whereas the zygomaticus major (smile) muscle is generally increased in response to happy faces/positive stimuli (e.g., Cacioppo et al., 1986, Dimberg, 1982, Lang et al., 1993, McDonald et al., 2011). These responses occur even when the emotional stimuli are presented very briefly (30 ms; Dimberg, Thunberg, & Elmehed, 2000). A handful of studies have shown that high-functioning children (Beall, Moody, McIntosh, Hepburn, & Reed, 2008), adolescents and adults (McIntosh, Reichmann-Decker, Winkielman, & Wilbarger, 2006) with ASDs, and adults with ASD traits (Hermans, van Wingen, Bos, Putman, & van Honk, 2009), display atypical (delayed or absent) spontaneous/automatic mimicry of passively viewed facial emotional (happy and angry) expressions presented for protracted duration (3–8 s), whilst their voluntary mimicry (production of expression when instructed) remains intact. Whilst this research implies that the early automatic aspects of emotion recognition are impaired in ASDs, the use of protracted exposure times makes it difficult to draw definite conclusions regarding this. Only one study to date has investigated automatic mimicry of briefly (25 ms) presented emotional expressions in a small sample (n = 13) of children with ASDs (Oberman, Winkielman, & Ramachandran, 2009). Consistent with previous research on protracted presentation of emotional stimuli, this study found that high-functioning children with ASDs were delayed in their mimicry response (Oberman et al., 2009). Interestingly, they found no deficits in the amplitude of their mimicry responses. This may have been due to the explicit instructions to label the emotional expression, which would have alerted their attention to the emotional content of the stimuli and potentially primed the mimicry system. Furthermore, in comparison tasks, longer presentation time (75 ms and 1000 ms) reduced but did not entirely remove the delay in mimicry response in the children with ASDs (Oberman et al., 2009).

Taken together, these studies demonstrate atypical automatic facial mimicry (EMG) of both protracted and briefly presented emotional stimuli in individuals with ASDs. Despite this impaired affective responsivity, these individuals demonstrate intact ability to recognise facial identity, age, and gender, as well as basic emotions. One potential explanation for these conflicting findings is a lack of motivational engagement in ASDs, which is proposed to result in reduced attention to social stimuli such as faces, voices, and hand gestures (Dawson, Webb, & McPartland, 2005). Similarly, it has been suggested that ASDs may be associated with a disruption in the allocation of emotional significance to facial stimuli (Pinkham, Hopfinger, Pelphrey, Piven, & Penn, 2008). Indeed, recent studies have shown that individuals with ASDs will only show spontaneous mimicry when the task sufficiently engages them in emotion processing (Magnée et al., 2007, Mathersul et al., 2013a, Oberman et al., 2009). Current conceptualisations of this social motivation hypothesis propose that deficits in ASDs occur not just at the basic behavioural level, but also encompass social orienting/attention and social maintaining (Chevallier, Kohls, Troiani, Brodkin, & Schultz, 2012). The majority of support for this comes from eye tracking or visual fixation studies that demonstrate impaired orienting and attention to socially-relevant stimuli such as eyes or people in pictures and movies of social interactions (e.g., Dalton et al., 2005, Klin et al., 2002, Pelphrey et al., 2002). If this is indeed an accurate representation of this hypothesis, then autonomic measures (e.g., heart rate, skin conductance) provide a potential method of further investigating these processes.

Classic notions of orienting propose a combination of behavioural and physiological changes (e.g., heart rate (HR), electrodermal activity (skin conductance), respiration rate, pupillary dilation) in response to novel or significant environmental stimuli, including socially-relevant stimuli (e.g., Sokolov, 1960, Sokolov, 1963). However, extensive work over the past three decades suggests that skin conductance responses (SCRs) are the only true physiological marker of this orienting response (OR) in that they are elicited by novel stimuli, are modulated by stimulus intensity, and habituate with stimulus repetition (i.e., the Preliminary Process Theory (PPT); see Barry, 1981, Barry, 1996, Barry, 2006, Barry, 2009). As such, they may be seen to reflect allocation of attention/engagement or (emotional) significance to stimuli over time (e.g., Barry, 1990, Barry and Sokolov, 1993, Maltzman, 1977, Maltzman and Boyd, 1984, Rushby and Barry, 2007, Rushby and Barry, 2009, Sokolov, 1990). In contrast, evoked cardiac deceleration (ECD) typically occurs as an initial response to stimulus presentation, regardless of novelty, intensity (magnitude) or repetition, and is suggested to reflect early stimulus registration or detection (see Barry, 1981, Barry, 1996, Barry, 2006, Barry, 2009). Similarly, ECD has been proposed to reflect continued attention to, and interest in, a stimulus (e.g., Graham and Clifton, 1966, Turpin, 1983). Slower, longer lasting changes in arousal are reflected in skin conductance levels (SCLs), which have the potential to influence task-dependent SCRs (e.g., Barry, 2004, Barry and Sokolov, 1993, Rushby and Barry, 2007). SCL typically increases (sensitisation) to novel stimuli then rapidly decreases (habituation) with stimulus repetition (Barry, 2004, Groves and Thompson, 1970, Rushby and Barry, 2007, VaezMousavi et al., 2007).

Socially-relevant information (including facial emotional expressions) is particularly salient to humans, and as such, typically elicits an OR and influences autonomic responses generally (Levenson, Ekman, & Friesen, 1990). Past research generally suggests that autonomic responses are disrupted in individuals with ASDs (Bal et al., 2010, Bölte et al., 2008, Corona et al., 1998, Hubert et al., 2009, Jansen et al., 2006, Joseph et al., 2008, Mathersul et al., 2013a, Mathersul et al., 2013b, Van Hecke et al., 2009), although this is not always the case (e.g., Ben Shalom et al., 2006). Importantly though, one recent study demonstrated (through the use of SCL and SCR) disruptions in the allocation of attention and (emotional) significance to socially-relevant stimuli (neutral faces) in ASDs, whilst stimulus registration/detection (ECD) remained intact (Mathersul, McDonald, & Rushby, 2013c). Concurrent autonomic measures therefore provide an important means of investigating allocation of attention and emotional significance to social stimuli (including emotional faces) in ASDs, and may help to explain why automatic mimicry to emotional stimuli is disrupted whilst processing of non-emotional features of faces is not.

Thus, the aim of the present study was to investigate automatic facial mimicry (EMG responses) to briefly presented facial emotional stimuli in high-functioning individuals with ASDs. Building and extending on past research, particularly the study by Oberman et al. (2009), the present study investigated 30 adults with ASDs compared to 31 demographically matched, developmentally unremarkable adults, when viewing angry versus happy facial emotional expressions. Specifically, the present study employed two approaches to examining the automatic processing of emotional information. Firstly, a “backward masking” task was employed, where the emotional face was presented for 30 ms, immediately followed by a neutral expression mask. This approach enabled measurement to be focused upon the very early responses to emotional stimuli prior to elaborative processing. Secondly, an “implicit” task, was used in which participants were exposed to a slightly longer time frame but were given explicit instructions to rapidly identify the gender of the face (presented for a maximum of 500 ms), thereby minimising the likelihood that the emotional content of the stimuli was overtly attended to. Importantly, no explicit reference was made in either task to the emotion or valence of the facial stimuli. Given the suggestion that individuals with ASDs will only show spontaneous mimicry of facial expressions when the task sufficiently engages them in emotion processing (Oberman et al., 2009), the implicit task was included as a comparison task to determine whether engagement varies as a function of exposure time in the absence of attention (to the emotional content). Furthermore, concurrent measurements of skin conductance and cardiac responses were employed in both tasks to investigate allocation of attention/engagement and emotional significance to facial stimuli, as well as general stimulus registration or detection. It was hypothesised that if there is no opportunity for elaborative processing or attention to be focused upon the emotional content, facial mimicry (EMG) would be absent for the adults with ASDs in both tasks. It was also hypothesised that this atypical recognition would be reflected in atypical skin conductance (SCR, SCL), indicative of a disruption in the allocation of emotional significance to facial emotional stimuli and overall disruptions in arousal. Given past research suggesting disruptions in emotion processing but intact processing of non-emotional features of faces, it was hypothesised that cardiac responses (initial ECD) would be typical, reflective of intact stimulus registration/detection.

Section snippets

Participants

Thirty-one high-functioning adults with ASDs and thirty-six non-clinical control individuals were recruited from Sydney and surrounding regions in New South Wales, Australia, via advertisements, support groups, clinicians, Aspect (Autism Spectrum Australia)2 and undergraduate university populations. Individuals were

Demographics

There were no significant differences between groups on age (F(1,60) = 0.6, p = .455), gender ratio (χ2 = .06, p = .806), years of education (F(1,60) = 1.7, p = .204), or full scale IQ (F(1,60) = 0.02, p = .894; Table 1). Confirming diagnostic group, the ASD group was significantly higher on the AQ (F(1,60) = 79.1, p < .001) and RAADS (F(1,60) = 76.2, p < .001; Table 1).

Behavioural responses

There were no significant main or interaction effects for gender identification accuracy (implicit task); individuals performed equally regardless of

Discussion

The aim of the present study was to investigate automatic facial mimicry (EMG) to briefly presented facial emotional stimuli in a large sample of high-functioning adults with ASDs. Building and extending on past research, the present study employed concurrent autonomic measures in order to investigate allocation of attention and (emotional) significance over time (SCL, SCR) and stimulus registration or detection (initial ECD). Consistent with past research on emotional stimuli presented for

Acknowledgements

DM is supported by an Australian Postgraduate Award (APA). JAR is supported by an Australian National Health and Medical Research Council (NHMRC) Postdoctoral Fellowship (Clinical Training; APP1013796). This research was funded by the Australian National Health and Medical Research Council (NHMRC). We would like to thank the individuals who gave their time to participate in this study, and the clinicians who assisted with participant recruitment.

References (117)

  • B. Corden et al.

    Avoidance of emotionally arousing stimuli predicts social-perceptual impairment in Asperger's syndrome

    Neuropsychologia

    (2008)
  • U. Frith et al.

    Autism: Beyond “theory of mind”

    Cognition

    (1994)
  • G.B.C. Hall et al.

    Backward masking: Evidence of reduced subcortical amygdala engagement in autism

    Brain & Cognition

    (2007)
  • E.J. Hermans et al.

    Reduced spontaneous facial mimicry in women with autistic traits

    Biological Psychology

    (2009)
  • A.L. James et al.

    Cardiovascular and electrodermal responses to simple stimuli in autistic, retarded and normal children

    International Journal of Psychophysiology

    (1984)
  • D. Mathersul et al.

    Automatic facial responses to affective stimuli in high-functioning adults with autism spectrum disorder

    Physiology & Behavior

    (2013)
  • D. Mathersul et al.

    Psychophysiological correlates of social judgement in high-functioning adults with autism spectrum disorder

    International Journal of Psychophysiology

    (2013)
  • A.E. Pinkham et al.

    Neural bases for impaired social cognition in schizophrenia and autism spectrum disorders

    Schizophrenia Research

    (2008)
  • J.A. Rushby et al.

    Event-related potential correlates of phasic and tonic measures of the orienting reflex

    Biological Psychology

    (2007)
  • J.A. Rushby et al.

    Single-trial event-related potentials to significant stimuli

    International Journal of Psychophysiology

    (2009)
  • R. Adolphs et al.

    Abnormal processing of social information from faces in autism

    Journal of Cognitive Neuroscience

    (2001)
  • APA

    Diagnostic and statistical manual of mental disorders

    (2000)
  • APA

    Diagnostic and statistical manual of mental disorders

    (2013)
  • C. Ashwin et al.

    Impaired recognition of negative basic emotions in autism: A test of the amygdala theory

    Social Neuroscience

    (2006)
  • T.M. Azevedo et al.

    A freezing-like posture to pictures of mutilation

    Psychophysiology

    (2005)
  • E. Bal et al.

    Emotion recognition in children with autism spectrum disorders: Relations to eye gaze and autonomic state

    Journal of Autism & Developmental Disorders

    (2010)
  • S. Baron-Cohen et al.

    The empathy quotient: An investigation of adults with Asperger syndrome or high functioning autism, and normal sex differences

    Journal of Autism & Developmental Disorders

    (2004)
  • S. Baron-Cohen et al.

    The “Reading the Mind in the Eyes” Test revised version: A study with normal adults, and adults with Asperger syndrome or high-functioning autism

    Journal of Child Psychology & Psychiatry & Allied Disciplines

    (2001)
  • S. Baron-Cohen et al.

    The autism-spectrum quotient (AQ): Evidence from Asperger syndrome/high-functioning autism, males and females, scientists and mathematicians

    Journal of Autism & Developmental Disorders

    (2001)
  • R.J. Barry

    Signal value and preliminary processes in OR elicitation

    Pavlovian Journal of Biological Science

    (1981)
  • R.J. Barry

    The orienting response: Stimulus factors and response measures

    Pavlovian Journal of Biological Science

    (1990)
  • R.J. Barry

    Preliminary process theory: Towards an integrated account of the psychophysiology of cognitive processes

    Acta Neurobiologiae Experimentalis

    (1996)
  • R.J. Barry

    Stimulus significance effects in habituation of the phasic and tonic orienting reflex

    Integrative Physiological & Behavioral Science

    (2004)
  • D. Ben Shalom et al.

    Normal physiological emotions but differences in expression of conscious feelings in children with high-functioning autism

    Journal of Autism & Developmental Disorders

    (2006)
  • W.K. Berg et al.

    Startle elicitation: Stimulus parameters, recording techniques, and quantification

  • T.D. Blumenthal et al.

    Committee report: Guidelines for human startle eyeblink electromyographic studies

    Psychophysiology

    (2005)
  • S. Bölte et al.

    Brief report: Emotional processing in high-functioning autism – Physiological reactivity and affective report

    Journal of Autism & Developmental Disorders

    (2008)
  • J. Boucher et al.

    Voice processing abilities in children with autism, children with specific language impairments, and young typically developing children

    Journal of Child Psychology & Psychiatry & Allied Disciplines

    (2000)
  • W. Boucsein

    Electrodermal activity

    (1992)
  • M.M. Bradley et al.

    Emotion and motivation. I: Defensive and appetitive reactions in picture processing

    Emotion

    (2001)
  • M.M. Bradley et al.

    When good things go bad: The reflex physiology of defense

    Psychological Science

    (2005)
  • J.T. Cacioppo et al.

    Electromyographic activity over facial muscle regions can differentiate the valence and intensity of affective reactions

    Journal of Personality & Social Psychology

    (1986)
  • L. Capps et al.

    Understanding of simple and complex emotions in non-retarded children with autism

    Journal of Child Psychology & Psychiatry & Allied Disciplines

    (1992)
  • G. Celani et al.

    The understanding of the emotional meaning of facial expressions in people with autism

    Journal of Autism & Developmental Disorders

    (1999)
  • T.F. Clark et al.

    Autism and the extraction of emotion from briefly presented facial expressions: Stumbling at the first step of empathy

    Emotion

    (2008)
  • R. Corona et al.

    Is affect aversive to young children with autism? Behavioral and cardiac responses to experimenter distress

    Child Development

    (1998)
  • K.M. Dalton et al.

    Gaze fixation and the neural circuitry of face processing in autism

    Nature Neuroscience

    (2005)
  • G. Dawson et al.

    Affective exchanges between young autistic children and their mothers

    Journal of Abnormal Child Psychology

    (1990)
  • G. Dawson et al.

    Understanding the nature of face processing impairment in autism: Insights from behavioral and electrophysiological studies

    Developmental Neuropsychology

    (2005)
  • J. Decety

    The neurodevelopment of empathy in humans

    Developmental Neuroscience

    (2010)
  • Cited by (34)

    • Is autonomic function during resting-state atypical in Autism: A systematic review of evidence

      2021, Neuroscience and Biobehavioral Reviews
      Citation Excerpt :

      In one study (Mathersul et al., 2013b), SCL was recorded while participants spent two minutes with their eyes closed and found no significant overall group differences between adults with and without autism. Interestingly, in another paper with the same sample of adults with and without autism (Mathersul et al., 2013a), the authors measured SCL for the duration of 500 ms before stimulus onset in a social judgement task. In this study they reported hypoarousal in autistic adults compared to neurotypical adults.

    • The enfacement illusion boosts facial mimicry

      2020, Cortex
      Citation Excerpt :

      Indeed, facial mimicry is linked to neural and autonomic changes related to the actual emotional experience of the observer (Likowski et al., 2012; Price & Harmon-Jones, 2015) and is modulated by the observer's emotional empathic traits (Dimberg, Andréasson, & Thunberg, 2011; Sonnby-Borgström, 2002). Moreover, autistic individuals, known to have difficulties in empathic skills (Greenberg, Warrier, Allison, & Baron-cohen, 2018), show reduced and/or delayed facial mimicry (Mathersul, McDonald, & Rushby, 2013; McIntosh, Reichmann-Decker, Winkielman, & Wilbarger, 2006; Oberman, Winkielman, & Ramachandran, 2009; Stel, Van Den Heuvel, & Smeets, 2008; Yoshimura, Sato, & Uono, 2015). Similarly, atypical facial mimicry is also found in neurotypical individuals with high number of autistic traits (Hermans, van Wingen, Bos, Putman, & van Honk, 2009; Neufeld, Ioannou, Korb, Schilbach, & Chakrabarti, 2016).

    • Less differentiated facial responses to naturalistic films of another person's emotional expressions in adolescents and adults with High-Functioning Autism Spectrum Disorder

      2019, Progress in Neuro-Psychopharmacology and Biological Psychiatry
      Citation Excerpt :

      It has even been posited that the reciprocation of emotional facial expressions may be a precursor to healthy social development (Prochazkova and Kret, 2017). Findings from electromyography (EMG) investigations in ASD, mostly studying single facial muscle activation following one-time confrontation with another person's emotional expression have been mixed, with the majority reporting deficits compared to TD individuals (Beall et al., 2008; Mathersul et al., 2013; McIntosh et al., 2006; Oberman et al., 2009), but some studies reported no deficits (Deschamps et al., 2015), or even more pronounced responses in ASD (Magnée et al., 2007). Moreover, EMG amplitude changes are very subtle and are not necessarily visible to the eye.

    • Is it avoidance or hypoarousal? A systematic review of emotion recognition, eye-tracking, and psychophysiological studies in young adults with autism spectrum conditions

      2018, Research in Autism Spectrum Disorders
      Citation Excerpt :

      These hypotheses are in line with the current views of emotion processing, consensually conceptualized as a psychophysiological goal-oriented process (Atkinson & Adolphs, 2011; Calder & Young, 2005; Niedenthal & Brauer, 2012). It is also known that changes in physiological arousal (e.g. SCR) can index orienting responses to novel or significant environmental information, including socially-relevant stimuli (Sokolov, 1960; Barry, 1984; Mathersul, McDonald, & Rushby, 2013b). Furthermore, models of empathy have consistently suggested that the perception of emotion in others involves some level of physiological resonance that allows emotional contagion to occur.

    View all citing articles on Scopus
    View full text