Automatic facial responses to briefly presented emotional stimuli in autism spectrum disorder
Introduction
Individuals with autism spectrum disorders (ASDs; including autism and Asperger's Syndrome)1 display marked impairments in social interaction (poor social-emotional reciprocity, deficits in the use of non-verbal communication such as eye-gaze and facial expression) and the presence of repetitive and stereotyped behaviours (APA, 2000, APA, 2013). Consistent with diagnostic criteria of marked deficits in reciprocal social interaction, individuals with ASDs generally have impaired emotion processing and recognition. Studies have shown that low-functioning children display deficits in the recognition of basic facial emotional expressions (Celani et al., 1999, Gross, 2004), whereas high-functioning individuals with ASDs appear impaired in the recognition of complex (e.g., sincerity, pride and embarrassment; Capps et al., 1992, Golan et al., 2007) but not basic emotions (Adolphs et al., 2001, Boucher et al., 2000, Capps et al., 1992, Grossman et al., 2000, Loveland et al., 1997). As a result, it has been suggested that emotional responsivity and recognition in ASDs increases with cognitive ability (Dissanayake et al., 1996, Rutherford and McIntosh, 2007). In order to diminish the confound of cognitive ability, emotional stimuli may be presented briefly, thereby shifting the load from higher-level intellectual functioning to more automatic processing abilities. Using a backward masking paradigm, whereby participants are exposed to brief displays that are rapidly masked, or simply rapidly presenting the emotional face without a mask, two recent studies demonstrated that high-functioning children (Hall, West, & Szatmari, 2007) and young adults (Clark, Winkielman, & McIntosh, 2008) with ASDs continue to be impaired in the recognition of basic emotional stimuli (fear/neutral backward masking (33 ms) and happy/angry rapid presentation (30 ms), respectively. Importantly, these deficits were specific to emotion recognition, as recognition of facial identity, age, and gender remained intact (Celani et al., 1999, Clark et al., 2008).
This finding is intriguing and prompts further enquiry as to the basic processes involved in recognising and processing emotional stimuli, in particular, automatic orientation to and mimicry of emotional expressions. Mimicry, including rapid, automatic facial responses to facial emotions and affective scenes, may be conceptualised as a marker of emotional processing and affective response to the environment (Cacioppo et al., 1986, Dimberg and Thunberg, 1998, Winkielman and Cacioppo, 2001). It is present at an early age, such that typically developing infants actively seek and mimic the facial expressions of their mothers (Haviland & Lelwica, 1987), and use this information to regulate their responses to ambiguous environmental stimuli (Smith, McHugo, & Kappas, 1996). Similarly, automatic facial mimicry is not purely a motor mirroring of environmental stimuli, but reciprocally interacts with emotional state, thus providing important emotional feedback information (Moody, McIntosh, Mann, & Weisser, 2007). Furthermore, mimicry facilitates emotion recognition, whilst preventing or blocking mimicry impairs emotion processing (Neidenthal et al., 2001, Oberman et al., 2007). Impaired mimicry may therefore have negative effects for social reciprocity (see Hatfield, Cacioppo, & Rapson, 1994 for review). This has important implications for individuals with known impairments in social functioning, such as autism spectrum disorders (ASDs).
Mimicry is typically investigated using automatic facial muscle responses (as measured by electromyography; EMG). For example, the corrugator supercilii (frown) muscle is generally increased in response to angry faces and other negative stimuli, whereas the zygomaticus major (smile) muscle is generally increased in response to happy faces/positive stimuli (e.g., Cacioppo et al., 1986, Dimberg, 1982, Lang et al., 1993, McDonald et al., 2011). These responses occur even when the emotional stimuli are presented very briefly (30 ms; Dimberg, Thunberg, & Elmehed, 2000). A handful of studies have shown that high-functioning children (Beall, Moody, McIntosh, Hepburn, & Reed, 2008), adolescents and adults (McIntosh, Reichmann-Decker, Winkielman, & Wilbarger, 2006) with ASDs, and adults with ASD traits (Hermans, van Wingen, Bos, Putman, & van Honk, 2009), display atypical (delayed or absent) spontaneous/automatic mimicry of passively viewed facial emotional (happy and angry) expressions presented for protracted duration (3–8 s), whilst their voluntary mimicry (production of expression when instructed) remains intact. Whilst this research implies that the early automatic aspects of emotion recognition are impaired in ASDs, the use of protracted exposure times makes it difficult to draw definite conclusions regarding this. Only one study to date has investigated automatic mimicry of briefly (25 ms) presented emotional expressions in a small sample (n = 13) of children with ASDs (Oberman, Winkielman, & Ramachandran, 2009). Consistent with previous research on protracted presentation of emotional stimuli, this study found that high-functioning children with ASDs were delayed in their mimicry response (Oberman et al., 2009). Interestingly, they found no deficits in the amplitude of their mimicry responses. This may have been due to the explicit instructions to label the emotional expression, which would have alerted their attention to the emotional content of the stimuli and potentially primed the mimicry system. Furthermore, in comparison tasks, longer presentation time (75 ms and 1000 ms) reduced but did not entirely remove the delay in mimicry response in the children with ASDs (Oberman et al., 2009).
Taken together, these studies demonstrate atypical automatic facial mimicry (EMG) of both protracted and briefly presented emotional stimuli in individuals with ASDs. Despite this impaired affective responsivity, these individuals demonstrate intact ability to recognise facial identity, age, and gender, as well as basic emotions. One potential explanation for these conflicting findings is a lack of motivational engagement in ASDs, which is proposed to result in reduced attention to social stimuli such as faces, voices, and hand gestures (Dawson, Webb, & McPartland, 2005). Similarly, it has been suggested that ASDs may be associated with a disruption in the allocation of emotional significance to facial stimuli (Pinkham, Hopfinger, Pelphrey, Piven, & Penn, 2008). Indeed, recent studies have shown that individuals with ASDs will only show spontaneous mimicry when the task sufficiently engages them in emotion processing (Magnée et al., 2007, Mathersul et al., 2013a, Oberman et al., 2009). Current conceptualisations of this social motivation hypothesis propose that deficits in ASDs occur not just at the basic behavioural level, but also encompass social orienting/attention and social maintaining (Chevallier, Kohls, Troiani, Brodkin, & Schultz, 2012). The majority of support for this comes from eye tracking or visual fixation studies that demonstrate impaired orienting and attention to socially-relevant stimuli such as eyes or people in pictures and movies of social interactions (e.g., Dalton et al., 2005, Klin et al., 2002, Pelphrey et al., 2002). If this is indeed an accurate representation of this hypothesis, then autonomic measures (e.g., heart rate, skin conductance) provide a potential method of further investigating these processes.
Classic notions of orienting propose a combination of behavioural and physiological changes (e.g., heart rate (HR), electrodermal activity (skin conductance), respiration rate, pupillary dilation) in response to novel or significant environmental stimuli, including socially-relevant stimuli (e.g., Sokolov, 1960, Sokolov, 1963). However, extensive work over the past three decades suggests that skin conductance responses (SCRs) are the only true physiological marker of this orienting response (OR) in that they are elicited by novel stimuli, are modulated by stimulus intensity, and habituate with stimulus repetition (i.e., the Preliminary Process Theory (PPT); see Barry, 1981, Barry, 1996, Barry, 2006, Barry, 2009). As such, they may be seen to reflect allocation of attention/engagement or (emotional) significance to stimuli over time (e.g., Barry, 1990, Barry and Sokolov, 1993, Maltzman, 1977, Maltzman and Boyd, 1984, Rushby and Barry, 2007, Rushby and Barry, 2009, Sokolov, 1990). In contrast, evoked cardiac deceleration (ECD) typically occurs as an initial response to stimulus presentation, regardless of novelty, intensity (magnitude) or repetition, and is suggested to reflect early stimulus registration or detection (see Barry, 1981, Barry, 1996, Barry, 2006, Barry, 2009). Similarly, ECD has been proposed to reflect continued attention to, and interest in, a stimulus (e.g., Graham and Clifton, 1966, Turpin, 1983). Slower, longer lasting changes in arousal are reflected in skin conductance levels (SCLs), which have the potential to influence task-dependent SCRs (e.g., Barry, 2004, Barry and Sokolov, 1993, Rushby and Barry, 2007). SCL typically increases (sensitisation) to novel stimuli then rapidly decreases (habituation) with stimulus repetition (Barry, 2004, Groves and Thompson, 1970, Rushby and Barry, 2007, VaezMousavi et al., 2007).
Socially-relevant information (including facial emotional expressions) is particularly salient to humans, and as such, typically elicits an OR and influences autonomic responses generally (Levenson, Ekman, & Friesen, 1990). Past research generally suggests that autonomic responses are disrupted in individuals with ASDs (Bal et al., 2010, Bölte et al., 2008, Corona et al., 1998, Hubert et al., 2009, Jansen et al., 2006, Joseph et al., 2008, Mathersul et al., 2013a, Mathersul et al., 2013b, Van Hecke et al., 2009), although this is not always the case (e.g., Ben Shalom et al., 2006). Importantly though, one recent study demonstrated (through the use of SCL and SCR) disruptions in the allocation of attention and (emotional) significance to socially-relevant stimuli (neutral faces) in ASDs, whilst stimulus registration/detection (ECD) remained intact (Mathersul, McDonald, & Rushby, 2013c). Concurrent autonomic measures therefore provide an important means of investigating allocation of attention and emotional significance to social stimuli (including emotional faces) in ASDs, and may help to explain why automatic mimicry to emotional stimuli is disrupted whilst processing of non-emotional features of faces is not.
Thus, the aim of the present study was to investigate automatic facial mimicry (EMG responses) to briefly presented facial emotional stimuli in high-functioning individuals with ASDs. Building and extending on past research, particularly the study by Oberman et al. (2009), the present study investigated 30 adults with ASDs compared to 31 demographically matched, developmentally unremarkable adults, when viewing angry versus happy facial emotional expressions. Specifically, the present study employed two approaches to examining the automatic processing of emotional information. Firstly, a “backward masking” task was employed, where the emotional face was presented for 30 ms, immediately followed by a neutral expression mask. This approach enabled measurement to be focused upon the very early responses to emotional stimuli prior to elaborative processing. Secondly, an “implicit” task, was used in which participants were exposed to a slightly longer time frame but were given explicit instructions to rapidly identify the gender of the face (presented for a maximum of 500 ms), thereby minimising the likelihood that the emotional content of the stimuli was overtly attended to. Importantly, no explicit reference was made in either task to the emotion or valence of the facial stimuli. Given the suggestion that individuals with ASDs will only show spontaneous mimicry of facial expressions when the task sufficiently engages them in emotion processing (Oberman et al., 2009), the implicit task was included as a comparison task to determine whether engagement varies as a function of exposure time in the absence of attention (to the emotional content). Furthermore, concurrent measurements of skin conductance and cardiac responses were employed in both tasks to investigate allocation of attention/engagement and emotional significance to facial stimuli, as well as general stimulus registration or detection. It was hypothesised that if there is no opportunity for elaborative processing or attention to be focused upon the emotional content, facial mimicry (EMG) would be absent for the adults with ASDs in both tasks. It was also hypothesised that this atypical recognition would be reflected in atypical skin conductance (SCR, SCL), indicative of a disruption in the allocation of emotional significance to facial emotional stimuli and overall disruptions in arousal. Given past research suggesting disruptions in emotion processing but intact processing of non-emotional features of faces, it was hypothesised that cardiac responses (initial ECD) would be typical, reflective of intact stimulus registration/detection.
Section snippets
Participants
Thirty-one high-functioning adults with ASDs and thirty-six non-clinical control individuals were recruited from Sydney and surrounding regions in New South Wales, Australia, via advertisements, support groups, clinicians, Aspect (Autism Spectrum Australia)2 and undergraduate university populations. Individuals were
Demographics
There were no significant differences between groups on age (F(1,60) = 0.6, p = .455), gender ratio (χ2 = .06, p = .806), years of education (F(1,60) = 1.7, p = .204), or full scale IQ (F(1,60) = 0.02, p = .894; Table 1). Confirming diagnostic group, the ASD group was significantly higher on the AQ (F(1,60) = 79.1, p < .001) and RAADS (F(1,60) = 76.2, p < .001; Table 1).
Behavioural responses
There were no significant main or interaction effects for gender identification accuracy (implicit task); individuals performed equally regardless of
Discussion
The aim of the present study was to investigate automatic facial mimicry (EMG) to briefly presented facial emotional stimuli in a large sample of high-functioning adults with ASDs. Building and extending on past research, the present study employed concurrent autonomic measures in order to investigate allocation of attention and (emotional) significance over time (SCL, SCR) and stimulus registration or detection (initial ECD). Consistent with past research on emotional stimuli presented for
Acknowledgements
DM is supported by an Australian Postgraduate Award (APA). JAR is supported by an Australian National Health and Medical Research Council (NHMRC) Postdoctoral Fellowship (Clinical Training; APP1013796). This research was funded by the Australian National Health and Medical Research Council (NHMRC). We would like to thank the individuals who gave their time to participate in this study, and the clinicians who assisted with participant recruitment.
References (117)
- et al.
Blind ratings of early symptoms of autism based upon family home movies
Journal of the American Academy of Child & Adolescent Psychiatry
(1993) - et al.
Emotional scenes and facial expressions elicit different psychophysiological responses
International Journal of Psychophysiology
(2011) - et al.
Differential activation of the amygdala and the ‘social brain’ during fearful face-processing in Asperger Syndrome
Neuropsychologia
(2007) Promise versus reality in relation to the unitary orienting reflex: A case study examining the role of theory in psychophysiology
International Journal of Psychophysiology
(2006)Habituation of the orienting reflex and the development of Preliminary Process Theory
Neurobiology of Learning and Memory
(2009)- et al.
Timing of caffeine's impact on autonomic and central nervous system measures: Clarification of arousal effects
Biological Psychology
(2008) - et al.
Habituation of phasic and tonic components of the orienting reflex
International Journal of Psychophysiology
(1993) - et al.
Age-related increase in inferior frontal gyrus activity and social functioning in autism spectrum disorder
Biological Psychiatry
(2011) - et al.
Rapid facial reactions to emotional facial expressions in typically developing children and children with autism spectrum disorder
Journal of Experimental Child Psychology
(2008) - et al.
The social motivation theory of autism
Trends in Cognitive Sciences
(2012)
Avoidance of emotionally arousing stimuli predicts social-perceptual impairment in Asperger's syndrome
Neuropsychologia
Autism: Beyond “theory of mind”
Cognition
Backward masking: Evidence of reduced subcortical amygdala engagement in autism
Brain & Cognition
Reduced spontaneous facial mimicry in women with autistic traits
Biological Psychology
Cardiovascular and electrodermal responses to simple stimuli in autistic, retarded and normal children
International Journal of Psychophysiology
Automatic facial responses to affective stimuli in high-functioning adults with autism spectrum disorder
Physiology & Behavior
Psychophysiological correlates of social judgement in high-functioning adults with autism spectrum disorder
International Journal of Psychophysiology
Neural bases for impaired social cognition in schizophrenia and autism spectrum disorders
Schizophrenia Research
Event-related potential correlates of phasic and tonic measures of the orienting reflex
Biological Psychology
Single-trial event-related potentials to significant stimuli
International Journal of Psychophysiology
Abnormal processing of social information from faces in autism
Journal of Cognitive Neuroscience
Diagnostic and statistical manual of mental disorders
Diagnostic and statistical manual of mental disorders
Impaired recognition of negative basic emotions in autism: A test of the amygdala theory
Social Neuroscience
A freezing-like posture to pictures of mutilation
Psychophysiology
Emotion recognition in children with autism spectrum disorders: Relations to eye gaze and autonomic state
Journal of Autism & Developmental Disorders
The empathy quotient: An investigation of adults with Asperger syndrome or high functioning autism, and normal sex differences
Journal of Autism & Developmental Disorders
The “Reading the Mind in the Eyes” Test revised version: A study with normal adults, and adults with Asperger syndrome or high-functioning autism
Journal of Child Psychology & Psychiatry & Allied Disciplines
The autism-spectrum quotient (AQ): Evidence from Asperger syndrome/high-functioning autism, males and females, scientists and mathematicians
Journal of Autism & Developmental Disorders
Signal value and preliminary processes in OR elicitation
Pavlovian Journal of Biological Science
The orienting response: Stimulus factors and response measures
Pavlovian Journal of Biological Science
Preliminary process theory: Towards an integrated account of the psychophysiology of cognitive processes
Acta Neurobiologiae Experimentalis
Stimulus significance effects in habituation of the phasic and tonic orienting reflex
Integrative Physiological & Behavioral Science
Normal physiological emotions but differences in expression of conscious feelings in children with high-functioning autism
Journal of Autism & Developmental Disorders
Startle elicitation: Stimulus parameters, recording techniques, and quantification
Committee report: Guidelines for human startle eyeblink electromyographic studies
Psychophysiology
Brief report: Emotional processing in high-functioning autism – Physiological reactivity and affective report
Journal of Autism & Developmental Disorders
Voice processing abilities in children with autism, children with specific language impairments, and young typically developing children
Journal of Child Psychology & Psychiatry & Allied Disciplines
Electrodermal activity
Emotion and motivation. I: Defensive and appetitive reactions in picture processing
Emotion
When good things go bad: The reflex physiology of defense
Psychological Science
Electromyographic activity over facial muscle regions can differentiate the valence and intensity of affective reactions
Journal of Personality & Social Psychology
Understanding of simple and complex emotions in non-retarded children with autism
Journal of Child Psychology & Psychiatry & Allied Disciplines
The understanding of the emotional meaning of facial expressions in people with autism
Journal of Autism & Developmental Disorders
Autism and the extraction of emotion from briefly presented facial expressions: Stumbling at the first step of empathy
Emotion
Is affect aversive to young children with autism? Behavioral and cardiac responses to experimenter distress
Child Development
Gaze fixation and the neural circuitry of face processing in autism
Nature Neuroscience
Affective exchanges between young autistic children and their mothers
Journal of Abnormal Child Psychology
Understanding the nature of face processing impairment in autism: Insights from behavioral and electrophysiological studies
Developmental Neuropsychology
The neurodevelopment of empathy in humans
Developmental Neuroscience
Cited by (34)
Is autonomic function during resting-state atypical in Autism: A systematic review of evidence
2021, Neuroscience and Biobehavioral ReviewsCitation Excerpt :In one study (Mathersul et al., 2013b), SCL was recorded while participants spent two minutes with their eyes closed and found no significant overall group differences between adults with and without autism. Interestingly, in another paper with the same sample of adults with and without autism (Mathersul et al., 2013a), the authors measured SCL for the duration of 500 ms before stimulus onset in a social judgement task. In this study they reported hypoarousal in autistic adults compared to neurotypical adults.
Rapid facial mimicry responses are preserved in youth with first presentation borderline personality disorder
2020, Journal of Affective DisordersThe enfacement illusion boosts facial mimicry
2020, CortexCitation Excerpt :Indeed, facial mimicry is linked to neural and autonomic changes related to the actual emotional experience of the observer (Likowski et al., 2012; Price & Harmon-Jones, 2015) and is modulated by the observer's emotional empathic traits (Dimberg, Andréasson, & Thunberg, 2011; Sonnby-Borgström, 2002). Moreover, autistic individuals, known to have difficulties in empathic skills (Greenberg, Warrier, Allison, & Baron-cohen, 2018), show reduced and/or delayed facial mimicry (Mathersul, McDonald, & Rushby, 2013; McIntosh, Reichmann-Decker, Winkielman, & Wilbarger, 2006; Oberman, Winkielman, & Ramachandran, 2009; Stel, Van Den Heuvel, & Smeets, 2008; Yoshimura, Sato, & Uono, 2015). Similarly, atypical facial mimicry is also found in neurotypical individuals with high number of autistic traits (Hermans, van Wingen, Bos, Putman, & van Honk, 2009; Neufeld, Ioannou, Korb, Schilbach, & Chakrabarti, 2016).
Less differentiated facial responses to naturalistic films of another person's emotional expressions in adolescents and adults with High-Functioning Autism Spectrum Disorder
2019, Progress in Neuro-Psychopharmacology and Biological PsychiatryCitation Excerpt :It has even been posited that the reciprocation of emotional facial expressions may be a precursor to healthy social development (Prochazkova and Kret, 2017). Findings from electromyography (EMG) investigations in ASD, mostly studying single facial muscle activation following one-time confrontation with another person's emotional expression have been mixed, with the majority reporting deficits compared to TD individuals (Beall et al., 2008; Mathersul et al., 2013; McIntosh et al., 2006; Oberman et al., 2009), but some studies reported no deficits (Deschamps et al., 2015), or even more pronounced responses in ASD (Magnée et al., 2007). Moreover, EMG amplitude changes are very subtle and are not necessarily visible to the eye.
Is it avoidance or hypoarousal? A systematic review of emotion recognition, eye-tracking, and psychophysiological studies in young adults with autism spectrum conditions
2018, Research in Autism Spectrum DisordersCitation Excerpt :These hypotheses are in line with the current views of emotion processing, consensually conceptualized as a psychophysiological goal-oriented process (Atkinson & Adolphs, 2011; Calder & Young, 2005; Niedenthal & Brauer, 2012). It is also known that changes in physiological arousal (e.g. SCR) can index orienting responses to novel or significant environmental information, including socially-relevant stimuli (Sokolov, 1960; Barry, 1984; Mathersul, McDonald, & Rushby, 2013b). Furthermore, models of empathy have consistently suggested that the perception of emotion in others involves some level of physiological resonance that allows emotional contagion to occur.
Face proprioception does not modulate access to visual awareness of emotional faces in a continuous flash suppression paradigm
2017, Consciousness and Cognition