Top

Journal of Autism and Developmental Disorders

Gepubliceerd in:

08-10-2018 | Original Paper

Automatic Recognition of Posed Facial Expression of Emotion in Individuals with Autism Spectrum Disorder

Auteurs: Joseph Manfredonia, Abigail Bangerter, Nikolay V. Manyakov, Seth Ness, David Lewin, Andrew Skalkin, Matthew Boice, Matthew S. Goodwin, Geraldine Dawson, Robert Hendren, Bennett Leventhal, Frederick Shic, Gahan Pandina

Gepubliceerd in: Journal of Autism and Developmental Disorders | Uitgave 1/2019

Abstract

Facial expression is impaired in autism spectrum disorder (ASD), but rarely systematically studied. We focus on the ability of individuals with ASD to produce facial expressions of emotions in response to a verbal prompt. We used the Janssen Autism Knowledge Engine (JAKE^®), including automated facial expression analysis software (FACET) to measure facial expressions in individuals with ASD (n = 144) and a typically developing (TD) comparison group (n = 41). Differences in ability to produce facial expressions were observed between ASD and TD groups, demonstrated by activation of facial action units (happy, scared, surprised, disgusted, but not angry or sad). Activation of facial action units correlated with parent-reported social communication skills. This approach has potential for diagnostic and response to intervention measures.

Trial Registration NCT02299700.

vorige artikel Internalizing Symptoms Mediate the Relation Between Acute Pain and Autism in Adults

volgende artikel Signing with the Face: Emotional Expression in Narrative Production in Deaf Children with Autism Spectrum Disorder

Bangerter, A., Ness, S., Aman, M. G., Esbensen, A. J., Goodwin, M. S., Dawson, G., et al. (2017). Autism Behavior Inventory: A novel tool for assessing core and associated symptoms of autism spectrum disorder. Journal of Child and Adolescent Psychopharmacology, 27(9), 814–822.CrossRef

Bartlett, M., Littlewort, G., Wu, T., & Movellan, J. (2008). Computer expression recognition toolbox. Presented at the 8th IEEE international Conference on Automatic Face and Gesture Recognition (FG 2008), September 17–19, 2008, Amsterdam, The Netherlands. pp. 1–2.

Bartlett, M. S., Hager, J. C., Ekman, P., & Sejnowski, T. J. (1999). Measuring facial expressions by computer image analysis. Psychophysiology, 36, 253–263.CrossRef

Beadle-Brown, J. D., & Whiten, A. (2004). Elicited imitation in children and adults with autism: Is there a deficit? Journal of Intellectual and Developmental Disability, 29(2), 147–163. https://doi.org/10.1080/13668250410001709494.CrossRef

Begeer, S., Koot, H. M., Rieffe, C., Meerum Terwogt, M., & Stegge, H. (2008). Emotional competence in children with autism: Diagnostic criteria and empirical evidence. Developmental Review. https://doi.org/10.1016/j.dr.2007.09.001.CrossRef

Berenbaum, H., & Rotter, A. (1992). The relationship between spontaneous facial expressions of emotion and voluntary control of facial muscles. Journal of Nonverbal Behavior, 16, 179–190.CrossRef

Brewer, R., Biotti, F., Catmur, C., Press, C., Happé, F., Cook, R., et al. (2016). Can neurotypical individuals read autistic facial expressions? A typical production of emotional facial expressions in autism spectrum disorders. Autism Research. https://doi.org/10.1002/aur.1508.CrossRefPubMed

Constantino, J. N., & Gruber, C. P. (2012). Social responsiveness scale (SRS). Torrance: Western Psychological Services.

Darwin, C. (1872). The expression of emotion in animals and man. London: Methuen.(1877), A biographical sketch of an infant. Mind, 2, 285–294.

Deckers, A., Muris, P., & Roelofs, J. (2017). Being on your own or feeling lonely? Loneliness and other social variables in youths with autism spectrum disorders. Child Psychiatry & Human Development, 48, 828–839.CrossRef

Denham, S. A. (1986). Social cognition, prosocial behavior, and emotion in preschoolers: contextual validation. Child Development, 57(1), 194–201.CrossRef

Diano, M., Celeghin, A., Bagnis, A., & Tamietto, M. (2017). Amygdala response to emotional stimuli without awareness: facts and interpretations. Frontiers in Psychology, 7, 2029.CrossRef

Eack, S. M., Mazefsky, C. A., & Minshew, N. J. (2015). Misinterpretation of facial expressions of emotion in verbal adults with autism spectrum disorder. Autism, 19(3), 308–315.CrossRef

Ekman, P. (1992). An argument for basic emotions. Cognition & emotion, 6(3–4), 169–200.CrossRef

Ekman, P., & Friesen, W. V. (1978). Manual for the facial action coding system. Palo Alto: Consulting Psychologists Press.

Ekman, P., Friesen, W. V., & Hager, J. C. (2002). Facial Action Coding System. Manual and Investigator’s Guide. Salt Lake City, UT: Research Nexus.

Ekman, P., & Oster, H. (1979). Facial expressions of emotion. Annual Review of Psychology, 30(1), 527–554. https://doi.org/10.1146/annurev.ps.30.020179.002523.CrossRef

Elliott, R., Zahn, R., Deakin, J. W., & Anderson, I. M. (2011). Affective cognition and its disruption in mood disorders. Neuropsychopharmacology, 36(1), 153–182.CrossRef

Farroni, T., Menon, E., Rigato, S., & Johnson, M. H. (2007). The perception of facial expressions in newborns. European Journal of Developmental Psychology, 4(1), 2–13.CrossRef

Faso, D. J., Sasson, N. J., & Pinkham, A. E. (2015). Evaluating posed and evoked facial expressions of emotion from adults with autism spectrum disorder. Journal of Autism and Developmental Disorders, 45(1), 75–89. https://doi.org/10.1007/s10803-014-2194-7.CrossRefPubMed

Freedman, N. (1972). The Analysis of Movement Behavior During the Clinical Interview. In A. W. Siegman & B. Pope (Eds.), Studies in dyadic communication (Vol. 7, pp. 153–175). Amsterdam: Elsevier B.V.CrossRef

Friesen, W., & Ekman, P. (1983). EMFACS-7: Emotional Facial Action Coding System. California: Unpublished manual, University of California.

Frith, C. & Series, B. (2009). Role of facial expressions in social interactions. Philosophical Transactions of the Royal Society of London: Biological Sciences, 364(1535), 3453–3458. https://doi.org/10.1098/rstb.2009.0142.CrossRefPubMed

Gordon, I., Pierce, M. D., Bartlett, M. S., & Tanaka, J. W. (2014). Training facial expression production in children on the autism spectrum. Journal of Autism and Developmental Disorders, 44(10), 2486–2498.CrossRef

Grossman, R. B., Edelson, L. R., & Tager-Flusberg, H. (2013). Emotional facial and vocal expressions during story retelling by children and adolescents with high-functioning autism. Journal of Speech, Language, and Hearing Research, 56(3), 1035–1044.CrossRef

Guarnera, M., Hichy, Z., Cascio, M. I., & Carrubba, S. (2015). Facial expressions and ability to recognize emotions from eyes or mouth in children. Europe’s Journal of Psychology, 11(2), 183.CrossRef

Gunnery, S. D., Hall, J. A., & Ruben, M. A. (2013). The deliberate Duchenne smile: Individual differences in expressive control. Journal of Nonverbal Behavior, 37(1), 29–41.CrossRef

Harms, M. B., Martin, A., & Wallace, G. L. (2010). Facial emotion recognition in autism spectrum disorders: A review of behavioral and neuroimaging studies. Neuropsychology Review, 20(3), 290–322. https://doi.org/10.1007/s11065-010-9138-6.CrossRef

iMotions, A./S. (2016). Facial Expression Analysis. Retrieved 10 November, 2017, from https://imotions.com/guides.

Jack, R. E., Garrod, O. G., Yu, H., Caldara, R., & Schyns, P. G. (2012). Facial expressions of emotion are not culturally universal. Proceedings of the National Academy of Sciences, 109(19), 7241–7244.CrossRef

Kasari, C., Sigman, M., Mundy, P., & Yirmiya, N. (1990). Affective sharing in the context of joint attention interactions of normal, autistic, and mentally retarded children. Journal of Autism and Developmental Disorders, 20(1), 87–100.CrossRef

Kim, J. A., Szatmari, P., Bryson, S. E., Streiner, D. L., & Wilson, F. J. (2000). The prevalence of anxiety and mood problems among children with autism and Asperger syndrome. Autism, 4(2), 117–132.CrossRef

Langdell, T. (1981). Face perception: An approach to the study of autism PhD Thesis, University of London.

Littlewort, G., Whitehill, J., Wu, T., Fasel, I., Frank, M., Movellan, J., et al. (2011). The computer expression recognition toolbox (CERT). Proceedings of the 2011 IEEE International Conference on Automatic Face & Gesture Recognition and Workshops (FG 2011), (pp. 298–305). IEEE.

Loomes, R., Hull, L., & Mandy, W. P. L. (2017). What is the male-to-female ratio in autism spectrum disorder? A systematic review and meta-analysis. Journal of the American Academy of Child & Adolescent Psychiatry, 56(6), 466–474. https://doi.org/10.1016/j.jaac.2017.03.013.CrossRef

Lord, C., Rutter, M., DiLavore, P. C., Risi, S., Gotham, K., & Bishop, S. (2012). Autism diagnostic observation schedule: ADOS-2. Los Angeles: Western Psychological Services.

Loveland, K. A., Tunali-Kotoski, B., Pearson, D. A., & Brelsford, K. A. (1994). Imitation and expression of facial affect in autism. Development & Psychopathology, 6(3), 433–444. https://doi.org/10.1017/S0954579400006039.CrossRef

MacDonald, H., Rutter, M., Howlin, P., Rios, P., Conteur, A. L., Evered, C., et al. (1989). Recognition and expression of emotional cues by autistic and normal adults. Journal of Child Psychology and Psychiatry, 30, 865–877. https://doi.org/10.1111/j.1469-7610.1989.tb00288.x.CrossRefPubMed

McIntosh, D. N., Reichmann-Decker, A., Winkielman, P., & Wilbarger, J. L. (2006). When the social mirror breaks: Deficits in automatic, but not voluntary, mimicry of emotional facial expressions in autism. Developmental Science, 9(3), 295–302. https://doi.org/10.1111/j.1467-7687.2006.00492.x.CrossRefPubMed

Namba, S., Makihara, S., Kabir, R. S., Miyatani, M., & Nakao, T. (2016). Spontaneous facial expressions are different from posed facial expressions: Morphological properties and dynamic sequences. Current Psychology, 35, 1–13. https://doi.org/10.1007/s12144-016-9448-9.CrossRef

Ness, S. L., Manyakov, N. V., Bangerter, A., Lewin, D., Jagannatha, S., Boice, M., et al. (2017). JAKE® multimodal data capture system: Insights from an observational study of autism spectrum disorder. Frontiers in Neuroscience, 11, 517. https://doi.org/10.3389/fnins.2017.00517.CrossRefPubMedPubMedCentral

Orsmond, G. I., Krauss, M. W., & Seltzer, M. M. (2004). Peer relationships and social and recreational activities among adolescents and adults with autism. Journal of Autism and Developmental Disorders, 34(3), 245–256.CrossRef

Press, C., Richardson, D., & Bird, G. (2010). Intact imitation of emotional facial actions in autism spectrum conditions. Neuropsychologia, 48(11), 3291–3297.CrossRef

Rodgers, J. D., Thomeer, M. L., Lopata, C., Volker, M. A., Lee, G. K., McDonald, C. A., et al. (2016). RCT of a psychosocial treatment for children with high-functioning ASD: supplemental analyses of treatment effects on facial emotion encoding. Journal of Developmental and Physical Disabilities, 27(2), 207–221. https://doi.org/10.1007/s10882-014-9409-x.CrossRef

Rutter, M., Bailey, A., & Lord, C. (2003). The social communication questionnaire: Manual. Oxford: Western Psychological Services.

Sheppard, E., Pillai, D., Wong, G. T. L., Ropar, D., & Mitchell, P. (2016). How easy is it to read the minds of people with autism spectrum disorder? Journal of Autism and Developmental Disorders. https://doi.org/10.1007/s10803-015-2662-8.CrossRefPubMedPubMedCentral

Snow, M. E., Hertzig, M. E., & Shapiro, T. (1987). Expression of emotion in young autistic children. Journal of the American Academy of Child & Adolescent Psychiatry, 26(6), 836–838. https://doi.org/10.1097/00004583-198726060-00006.CrossRef

Stagg, S. D., Slavny, R., Hand, C., Cardoso, A., & Smith, P. (2014). Does facial expressivity count? How typically developing children respond initially to children with autism. Autism, 18(6), 704–711. https://doi.org/10.1177/1362361313492392.CrossRefPubMed

Stel, M., & van Knippenberg, A. (2008). The role of facial mimicry in the recognition of affect. Psychological Science, 19(10), 984–985.CrossRef

Stewart, M. E., Barnard, L., Pearson, J., Hasan, R., & O’Brien, G. (2006). Presentation of depression in autism and Asperger syndrome: A review. Autism, 10(1), 103–116.CrossRef

Tanaka, J. W., Wolf, J. M., Klaiman, C., Koenig, K., Cockburn, J., Herlihy, L., et al. (2010). Using computerized games to teach face recognition skills to children with autism spectrum disorder: The Let’s Face It! program. Journal of Child Psychology and Psychiatry, 51(8), 944–952. https://doi.org/10.1111/j.1469-7610.2010.02258.x.CrossRefPubMed

Tell, D., Davidson, D., & Camras, L. A. (2014). Recognition of emotion from facial expressions with direct or averted eye gaze and varying expression intensities in children with autism disorder and typically developing children. Autism Research and Treatment. https://doi.org/10.1155/2014/816137.CrossRefPubMedPubMedCentral

Thomeer, M. L., Lopata, C., Volker, M. A., Toomey, J. A., Lee, G. K., Smerbeck, A. M., et al. (2012). Randomized clinical trial replication of a psychosocial treatment for children with high-functioning autism spectrum disorders. Psychology in the Schools, 49(10), 942–954. https://doi.org/10.1002/pits.21647.CrossRef

Thomeer, M. L., Smith, R. A., Lopata, C., Volker, M. A., Lipinski, A. M., & Rodgers, J. D., et al. (2015). Randomized controlled trial of Mind Reading and in vivo rehearsal for high-functioning children with ASD. Journal of Autism and Developmental Disorders, 45(7), 2115–2127. https://doi.org/10.1007/s10803-015-2374-0.CrossRefPubMed

Tomkins, S. S., & McCarter, R. (1964). What and where are the primary affects? Some evidence for a theory. Perceptual and Motor Skills, 18(1), 119–158.CrossRef

Tracy, J. L., Robins, R. W., Schriber, R. A., & Solomon, M. (2011). Is emotion recognition impaired in individuals with autism spectrum disorders? Journal of Autism and Developmental Disorders, 41(1), 102–109.CrossRef

Trevisan, D. A., Bowering, M., & Birmingham, E. (2016). Alexithymia, but not autism spectrum disorder, may be related to the production of emotional facial expressions. Molecular Autism, 7(1), 46.CrossRef

Uljarevic, M., & Hamilton, A. (2013). Recognition of emotions in autism: A formal meta-analysis. Journal of Autism and Developmental Disorders, 43(7), 1517–1526. https://doi.org/10.1007/s10803-012-1695-5.CrossRef

Volker, M. A., Lopata, C., Smith, D. A., & Thomeer, M. L. (2009). Facial encoding of children with high-functioning autism spectrum disorders. Focus on Autism and Other Developmental Disabilities, 24(4), 195–204. https://doi.org/10.1177/1088357609347325.CrossRef

Wegrzyn, M., Vogt, M., Kireclioglu, B., Schneider, J., & Kissler, J. (2017). Mapping the emotional face. How individual face parts contribute to successful emotion recognition. PLoS ONE, 12(5), e0177239.CrossRef

Whitaker, L., & Widen, S. C. (2018). How does emotional intelligence relate to adolescents’ interpretation of cues for disgust? Cognition and Emotion, 32(5), 1097–1104.CrossRef

Widen, S. C., Pochedly, J. T., & Russell, J. A. (2015). The development of emotion concepts: A story superiority effect in older children and adolescents. Journal of Experimental Child Psychology, 131, 186–192.CrossRef

Winkielman, P., McIntosh, D. N., & Oberman, L. (2009). Embodied and disembodied emotion processing: Learning from and about typical and autistic individuals. Emotion Review, 1(2), 178–190.CrossRef

Wolf, K. (2015). Measuring facial expression of emotion. Dialogues in Clinical Neuroscience, 17(4), 457.PubMedPubMedCentral

Yirmiya, N., Kasari, C., Sigman, M., & Mundy, P. (1989). Facial expressions of affect in autistic, mentally retarded and normal children. Journal of Child Psychology and Psychiatry, 30(5), 725–735. https://doi.org/10.1111/j.1469-7610.1989.tb00785.x.CrossRefPubMed

Yoshimura, S., Sato, W., Uono, S., & Toichi, M. (2015). Impaired overt facial mimicry in response to dynamic facial expressions in high-functioning autism spectrum disorders. Journal of Autism and Developmental Disorders, 45(5), 1318–1328. https://doi.org/10.1007/s10803-014-2291-7.CrossRefPubMed

Titel: Automatic Recognition of Posed Facial Expression of Emotion in Individuals with Autism Spectrum Disorder
Auteurs: Joseph Manfredonia
Abigail Bangerter
Nikolay V. Manyakov
Seth Ness
David Lewin
Andrew Skalkin
Matthew Boice
Matthew S. Goodwin
Geraldine Dawson
Robert Hendren
Bennett Leventhal
Frederick Shic
Gahan Pandina
Publicatiedatum: 08-10-2018
Uitgeverij: Springer US
Gepubliceerd in: Journal of Autism and Developmental Disorders / Uitgave 1/2019
Print ISSN: 0162-3257
Elektronisch ISSN: 1573-3432
DOI: https://doi.org/10.1007/s10803-018-3757-9

Bohn Stafleu van Loghum

Deel dit onderdeel of sectie (kopieer de link)

Abstract

Log in om toegang te krijgen

Andere artikelen Uitgave 1/2019

Brief Report: Flanker Visual Filtering Ability in Older Adolescents with Autism Spectrum Disorder

Autism Traits, Sensory Over-Responsivity, Anxiety, and Stress: A Test of Explanatory Models

Do Beliefs About Whether Others Can See Modulate Social Seeking in Autism?

Parental Perceptions of the Nature of the Relationship Children with Autism Spectrum Disorders Share with Their Canine Companion

ECHO Autism STAT: Accelerating Early Access to Autism Diagnosis

Prevalence of Psychotropic Medicine Use in Australian Children with Autism Spectrum Disorder: A Drug Utilization Study Based on Children Enrolled in the Longitudinal Study of Australian Children