Skip to main content
Top
Gepubliceerd in:

01-07-2014 | Original Paper

Assessing the Utility of a Virtual Environment for Enhancing Facial Affect Recognition in Adolescents with Autism

Auteurs: Esubalew Bekele, Julie Crittendon, Zhi Zheng, Amy Swanson, Amy Weitlauf, Zachary Warren, Nilanjan Sarkar

Gepubliceerd in: Journal of Autism and Developmental Disorders | Uitgave 7/2014

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

Teenagers with autism spectrum disorder (ASD) and age-matched controls participated in a dynamic facial affect recognition task within a virtual reality (VR) environment. Participants identified the emotion of a facial expression displayed at varied levels of intensity by a computer generated avatar. The system assessed performance (i.e., accuracy, confidence ratings, response latency, and stimulus discrimination) as well as how participants used their gaze to process facial information using an eye tracker. Participants in both groups were similarly accurate at basic facial affect recognition at varied levels of intensity. Despite similar performance characteristics, ASD participants endorsed lower confidence in their responses and substantial variation in gaze patterns in absence of perceptual discrimination deficits. These results add support to the hypothesis that deficits in emotion and face recognition for individuals with ASD are related to fundamental differences in information processing. We discuss implications of this finding in a VR environment with regards to potential future applications and paradigms targeting not just enhanced performance, but enhanced social information processing within intelligent systems capable of adaptation to individual processing differences.
Literatuur
go back to reference Adolphs, R., Sears, L., & Piven, J. (2001). Abnormal processing of social information from faces in autism. Journal of Cognitive Neuroscience, 13(2), 232–240.PubMedCrossRef Adolphs, R., Sears, L., & Piven, J. (2001). Abnormal processing of social information from faces in autism. Journal of Cognitive Neuroscience, 13(2), 232–240.PubMedCrossRef
go back to reference Anderson, C. J., Colombo, J., & Shaddy, D. J. (2006). Visual scanning and pupillary responses in young children with autism spectrum disorder. Journal of Clinical and Experimental Neuropsychology, 28(7), 1238–1256.PubMedCrossRef Anderson, C. J., Colombo, J., & Shaddy, D. J. (2006). Visual scanning and pupillary responses in young children with autism spectrum disorder. Journal of Clinical and Experimental Neuropsychology, 28(7), 1238–1256.PubMedCrossRef
go back to reference Bekele, E., Zheng, Z., Swanson, A., Crittendon, J., Warren, Z., & Sarkar, N. (2013). Understanding how adolescents with autism respond to facial expressions in virtual reality environments. IEEE Transactions on Visualization and Computer Graphics, 19(4), 711–720.PubMedCrossRef Bekele, E., Zheng, Z., Swanson, A., Crittendon, J., Warren, Z., & Sarkar, N. (2013). Understanding how adolescents with autism respond to facial expressions in virtual reality environments. IEEE Transactions on Visualization and Computer Graphics, 19(4), 711–720.PubMedCrossRef
go back to reference Blocher, K., & Picard, R. W. (2002). Affective social quest: emotion recognition therapy for autistic children. In K. Dautenhahn, A. Bond, L. Canamero, & B. Edmonds (Eds.), Socially intelligent agents—creating relationships with computers and robots (pp. 1–8). Dordrecht: Kluwer. Blocher, K., & Picard, R. W. (2002). Affective social quest: emotion recognition therapy for autistic children. In K. Dautenhahn, A. Bond, L. Canamero, & B. Edmonds (Eds.), Socially intelligent agents—creating relationships with computers and robots (pp. 1–8). Dordrecht: Kluwer.
go back to reference Bolte, S., Hubl, E., Feineis-Matthews, S., Prvulovic, D., Dierks, T., & Poustka, F. (2006). Facial affect recognition training in autism: Can we animate the fusiform gyrus? Behavioral Neuroscience, 120(1), 211–216.PubMedCrossRef Bolte, S., Hubl, E., Feineis-Matthews, S., Prvulovic, D., Dierks, T., & Poustka, F. (2006). Facial affect recognition training in autism: Can we animate the fusiform gyrus? Behavioral Neuroscience, 120(1), 211–216.PubMedCrossRef
go back to reference Bolte, S., Golan, O., Goodwin, M. S., & Zwaigenbaum, L. (2010). What can innovative technologies do for autism spectrum disorders? Autism, 14(3), 155–159.PubMedCrossRef Bolte, S., Golan, O., Goodwin, M. S., & Zwaigenbaum, L. (2010). What can innovative technologies do for autism spectrum disorders? Autism, 14(3), 155–159.PubMedCrossRef
go back to reference Capps, L., Yirmiya, N., & Sigman, M. (1992). Understanding of simple and complex emotions in non-retarded children with autism. Journal of Child Psychology and Psychiatry, 33(7), 1169–1182.PubMedCrossRef Capps, L., Yirmiya, N., & Sigman, M. (1992). Understanding of simple and complex emotions in non-retarded children with autism. Journal of Child Psychology and Psychiatry, 33(7), 1169–1182.PubMedCrossRef
go back to reference Castelli, F. (2005). Understanding emotions from standardized facial expressions in autism and normal development. Autism, 9(4), 428–449.PubMedCrossRef Castelli, F. (2005). Understanding emotions from standardized facial expressions in autism and normal development. Autism, 9(4), 428–449.PubMedCrossRef
go back to reference Celani, G., Battacchi, M. W., & Arcidiacono, L. (1999). The understanding of the emotional meaning of facial expressions in people with autism. Journal of Autism and Developmental Disorders, 29(1), 57–66.PubMedCrossRef Celani, G., Battacchi, M. W., & Arcidiacono, L. (1999). The understanding of the emotional meaning of facial expressions in people with autism. Journal of Autism and Developmental Disorders, 29(1), 57–66.PubMedCrossRef
go back to reference Centers for Disease Control and Prevention (CDC). (2012). Prevalence of autism spectrum disorders—autism and developmental disabilities monitoring network, United States, 2008. Morbidity and Mortal Weekly Report, 61(SS03), 1–19. Centers for Disease Control and Prevention (CDC). (2012). Prevalence of autism spectrum disorders—autism and developmental disabilities monitoring network, United States, 2008. Morbidity and Mortal Weekly Report, 61(SS03), 1–19.
go back to reference Constantino, J. N., & Gruber, C. P. (2005). The Social Responsiveness Scale. Los Angeles, CA: Western Psychological Services. Constantino, J. N., & Gruber, C. P. (2005). The Social Responsiveness Scale. Los Angeles, CA: Western Psychological Services.
go back to reference Dawson, G., Webb, S. J., Carver, L., Panagiotides, H., & McPartland, J. (2004). Young children with autism show atypical brain responses to fearful versus neutral facial expressions of emotion. Developmental Science, 7(3), 340–359.PubMedCrossRef Dawson, G., Webb, S. J., Carver, L., Panagiotides, H., & McPartland, J. (2004). Young children with autism show atypical brain responses to fearful versus neutral facial expressions of emotion. Developmental Science, 7(3), 340–359.PubMedCrossRef
go back to reference Dawson, G., Webb, S. J., & McPartland, J. (2005). Understanding the nature of face processing impairment in autism: Insights from behavioral and electrophysiological studies. Developmental Neuropsychology, 27(3), 403–424.PubMedCrossRef Dawson, G., Webb, S. J., & McPartland, J. (2005). Understanding the nature of face processing impairment in autism: Insights from behavioral and electrophysiological studies. Developmental Neuropsychology, 27(3), 403–424.PubMedCrossRef
go back to reference Elliott, C. D. (2007). Differential Ability Scales (2nd ed.). San Antonio, TX: Harcourt Assessment. Elliott, C. D. (2007). Differential Ability Scales (2nd ed.). San Antonio, TX: Harcourt Assessment.
go back to reference Golan, O., & Baron-Cohen, S. (2006). Systemizing empathy: Teaching adults with Asperger syndrome and high functioning autism to recognize complex emotions using interactive multimedia. Development and Psychopathology, 18(2), 589–615.CrossRef Golan, O., & Baron-Cohen, S. (2006). Systemizing empathy: Teaching adults with Asperger syndrome and high functioning autism to recognize complex emotions using interactive multimedia. Development and Psychopathology, 18(2), 589–615.CrossRef
go back to reference Golan, O., Ashwin, E., Granader, Y., McClintock, S., Day, K., Leggett, V., et al. (2010). Enhancing emotion recognition in children with autism spectrum conditions: An intervention using animated vehicles with real emotional faces. Journal of Autism and Developmental Disorders, 40(3), 269–279.PubMedCrossRef Golan, O., Ashwin, E., Granader, Y., McClintock, S., Day, K., Leggett, V., et al. (2010). Enhancing emotion recognition in children with autism spectrum conditions: An intervention using animated vehicles with real emotional faces. Journal of Autism and Developmental Disorders, 40(3), 269–279.PubMedCrossRef
go back to reference Goodwin, M. S. (2008). Enhancing and accelerating the pace of autism research and treatment. Focus on Autism and Other Developmental Disabilities, 23(2), 125–128.CrossRef Goodwin, M. S. (2008). Enhancing and accelerating the pace of autism research and treatment. Focus on Autism and Other Developmental Disabilities, 23(2), 125–128.CrossRef
go back to reference Hobson, R. P. (1986). The autistic child’s appraisal of expressions of emotion. Journal of Child Psychology and Psychiatry, 27(3), 321–342.PubMedCrossRef Hobson, R. P. (1986). The autistic child’s appraisal of expressions of emotion. Journal of Child Psychology and Psychiatry, 27(3), 321–342.PubMedCrossRef
go back to reference Hobson, R. P., Ouston, J., & Lee, A. (1988). Emotion recognition in autism: Coordinating faces and voices. Psychological Medicine, 18(4), 911–923.PubMedCrossRef Hobson, R. P., Ouston, J., & Lee, A. (1988). Emotion recognition in autism: Coordinating faces and voices. Psychological Medicine, 18(4), 911–923.PubMedCrossRef
go back to reference Kandalaft, M. R., Didehbani, N., Krawczyk, D. C., Allen, T. T., & Chapman, S. B. (2012). Virtual reality social cognition training for young adults with high-functioning autism. Journal of Autism and Developmental Disorders. doi:10.1007/s10803-012-1544-6.PubMed Kandalaft, M. R., Didehbani, N., Krawczyk, D. C., Allen, T. T., & Chapman, S. B. (2012). Virtual reality social cognition training for young adults with high-functioning autism. Journal of Autism and Developmental Disorders. doi:10.​1007/​s10803-012-1544-6.PubMed
go back to reference Klin, A., Jones, W., Schultz, R., Volkmar, F., & Cohen, D. (2002). Visual fixation patterns during viewing of naturalistic social situations as predictors of social competence in individuals with autism. Archives of General Psychiatry, American Medical Association, 59(9), 809–816.CrossRef Klin, A., Jones, W., Schultz, R., Volkmar, F., & Cohen, D. (2002). Visual fixation patterns during viewing of naturalistic social situations as predictors of social competence in individuals with autism. Archives of General Psychiatry, American Medical Association, 59(9), 809–816.CrossRef
go back to reference LaCava, P., Rankin, A., Mahlois, E., Cook, K., & Simpson, R. (2010). A single case design evaluation of a software and tutor intervention addressing emotion recognition and social interaction in four boys with ASD. Autism, 14(3), 161–178.PubMedCrossRef LaCava, P., Rankin, A., Mahlois, E., Cook, K., & Simpson, R. (2010). A single case design evaluation of a software and tutor intervention addressing emotion recognition and social interaction in four boys with ASD. Autism, 14(3), 161–178.PubMedCrossRef
go back to reference Lahiri, U., Warren, Z., & Sarkar, N. (2012). Design of a gaze-sensitive virtual social interactive system for children with autism. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 19(4), 443–452.CrossRef Lahiri, U., Warren, Z., & Sarkar, N. (2012). Design of a gaze-sensitive virtual social interactive system for children with autism. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 19(4), 443–452.CrossRef
go back to reference Lahiri, U., Bekele, E., Dohrmann, E., Warren, Z., & Sarkar, N. (2013). Design of a virtual reality based adaptive response technology for children with autism. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 21(1), 55–64.PubMedCrossRef Lahiri, U., Bekele, E., Dohrmann, E., Warren, Z., & Sarkar, N. (2013). Design of a virtual reality based adaptive response technology for children with autism. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 21(1), 55–64.PubMedCrossRef
go back to reference Lord, C., Risi, S., Lambrecht, L., Cook, E. H., Leventhal, B. L., DiLavore, P. C., et al. (2000). The autism diagnostic observation schedule—generic: A standard measure of social and communication deficits associated with spectrum of autism. Journal of Autism and Developmental Disorders, 30(3), 205–225.PubMedCrossRef Lord, C., Risi, S., Lambrecht, L., Cook, E. H., Leventhal, B. L., DiLavore, P. C., et al. (2000). The autism diagnostic observation schedule—generic: A standard measure of social and communication deficits associated with spectrum of autism. Journal of Autism and Developmental Disorders, 30(3), 205–225.PubMedCrossRef
go back to reference Mitchell, P., Parsons, S., & Leonard, A. (2007). Using virtual environments for teaching social understanding to 6 adolescents with autistic spectrum disorders. Journal of Autism and Developmental Disorders, 37(3), 589–600.PubMedCrossRef Mitchell, P., Parsons, S., & Leonard, A. (2007). Using virtual environments for teaching social understanding to 6 adolescents with autistic spectrum disorders. Journal of Autism and Developmental Disorders, 37(3), 589–600.PubMedCrossRef
go back to reference Parsons, S., & Mitchell, P. (2002). The potential of virtual reality in social skills training for people with autistic spectrum disorders. Journal of Intellectual Disabilities Research, 46(5), 430–443.CrossRef Parsons, S., & Mitchell, P. (2002). The potential of virtual reality in social skills training for people with autistic spectrum disorders. Journal of Intellectual Disabilities Research, 46(5), 430–443.CrossRef
go back to reference Parsons, S., Mitchell, P., & Leonard, A. (2004). The use and understanding of virtual environments by adolescents with autistic spectrum disorders. Journal of Autism and Developmental Disorders, 34(4), 449–466.PubMedCrossRef Parsons, S., Mitchell, P., & Leonard, A. (2004). The use and understanding of virtual environments by adolescents with autistic spectrum disorders. Journal of Autism and Developmental Disorders, 34(4), 449–466.PubMedCrossRef
go back to reference Pelphrey, K. A., Sasson, N. J., Reznick, J. S., Paul, G., Goldman, B. D., & Piven, J. (2002). Visual scanning of faces in autism. Journal of Autism and Developmental Disorders, 32(4), 249–261.PubMedCrossRef Pelphrey, K. A., Sasson, N. J., Reznick, J. S., Paul, G., Goldman, B. D., & Piven, J. (2002). Visual scanning of faces in autism. Journal of Autism and Developmental Disorders, 32(4), 249–261.PubMedCrossRef
go back to reference Ploog, B. O. (2010). Stimulus overselectivity four decades later: A review of the literature and its implications for current research in autism spectrum disorder. Journal of Autism and Developmental Disorders, 40(11), 1332–1349.PubMedCrossRef Ploog, B. O. (2010). Stimulus overselectivity four decades later: A review of the literature and its implications for current research in autism spectrum disorder. Journal of Autism and Developmental Disorders, 40(11), 1332–1349.PubMedCrossRef
go back to reference Ploog, B. O., Scharf, A., Nelson, D., & Brooks, P. J. (2013). Use of computer-assisted technologies (CAT) to enhance social, communicative, and language development in children with autism spectrum disorders. Journal of Autism and Developmental Disorders, 43(2), 301–322.PubMedCrossRef Ploog, B. O., Scharf, A., Nelson, D., & Brooks, P. J. (2013). Use of computer-assisted technologies (CAT) to enhance social, communicative, and language development in children with autism spectrum disorders. Journal of Autism and Developmental Disorders, 43(2), 301–322.PubMedCrossRef
go back to reference Rold, G. (2003). Stanford-Binet Intelligence Scales (5th ed.). Nelson Education. Rolling Meadows, IL: Riverside. Rold, G. (2003). Stanford-Binet Intelligence Scales (5th ed.). Nelson Education. Rolling Meadows, IL: Riverside.
go back to reference Rutter, M., Bailey, A., Lord, C., & Berument, S. (2003). Social Communication Questionnaire. Los Angeles, CA: Western Psychological Services. Rutter, M., Bailey, A., Lord, C., & Berument, S. (2003). Social Communication Questionnaire. Los Angeles, CA: Western Psychological Services.
go back to reference Wechlser, D. (2003). Wechsler Intelligence Scale for Children (WISC-IV) (4th ed.). San Antonio, TX: The Psychological Corporation. Wechlser, D. (2003). Wechsler Intelligence Scale for Children (WISC-IV) (4th ed.). San Antonio, TX: The Psychological Corporation.
go back to reference Wechsler, D. (1999). Wechsler Abbreviated Scale of Intelligence. San Antonio, TX: The Psychological Corporation. Wechsler, D. (1999). Wechsler Abbreviated Scale of Intelligence. San Antonio, TX: The Psychological Corporation.
go back to reference Weeks, S. J., & Hobson, R. P. (1987). The salience of facial expression for autistic children. Journal of Child Psychology and Psychiatry, 28(1), 137–152.PubMedCrossRef Weeks, S. J., & Hobson, R. P. (1987). The salience of facial expression for autistic children. Journal of Child Psychology and Psychiatry, 28(1), 137–152.PubMedCrossRef
go back to reference Welch, K., Lahiri, U., Liu, C., Weller, R., Sarkar, N., & Warren, Z. (2009). An affect-sensitive social interaction paradigm utilizing virtual reality environments for autism intervention. Human-Computer Interaction: Ambient, Ubiquitous and Intelligent Interaction, 56(12), 703–712. Welch, K., Lahiri, U., Liu, C., Weller, R., Sarkar, N., & Warren, Z. (2009). An affect-sensitive social interaction paradigm utilizing virtual reality environments for autism intervention. Human-Computer Interaction: Ambient, Ubiquitous and Intelligent Interaction, 56(12), 703–712.
go back to reference Welch, K., Sarkar, N., & Liu, C. (2010a). Affective modeling for children with autism spectrum disorders: Application of active learning. In L. Berhardt (Ed.), Advances in medicine and biology (pp. 297–310). New York: Nova Science Publishers. Welch, K., Sarkar, N., & Liu, C. (2010a). Affective modeling for children with autism spectrum disorders: Application of active learning. In L. Berhardt (Ed.), Advances in medicine and biology (pp. 297–310). New York: Nova Science Publishers.
go back to reference Welch, K. C., Lahiri, U., Sarkar, N., & Warren, Z. (2010b). An approach to the design of socially acceptable robots for children with autism spectrum disorders. International Journal of Social Robotics, 2(4), 391–403.CrossRef Welch, K. C., Lahiri, U., Sarkar, N., & Warren, Z. (2010b). An approach to the design of socially acceptable robots for children with autism spectrum disorders. International Journal of Social Robotics, 2(4), 391–403.CrossRef
go back to reference Wilms, M., Schilbach, L., Pfeiffer, U., Bente, G., Fink, G., & Vogeley, K. (2010). It’s in your eyes—using gaze-contingent stimuli to create truly interactive paradigms for social cognition and affective neuroscience. Social Cognitive and Affective Neuroscience, 5(1), 98–107.PubMedCentralPubMedCrossRef Wilms, M., Schilbach, L., Pfeiffer, U., Bente, G., Fink, G., & Vogeley, K. (2010). It’s in your eyes—using gaze-contingent stimuli to create truly interactive paradigms for social cognition and affective neuroscience. Social Cognitive and Affective Neuroscience, 5(1), 98–107.PubMedCentralPubMedCrossRef
Metagegevens
Titel
Assessing the Utility of a Virtual Environment for Enhancing Facial Affect Recognition in Adolescents with Autism
Auteurs
Esubalew Bekele
Julie Crittendon
Zhi Zheng
Amy Swanson
Amy Weitlauf
Zachary Warren
Nilanjan Sarkar
Publicatiedatum
01-07-2014
Uitgeverij
Springer US
Gepubliceerd in
Journal of Autism and Developmental Disorders / Uitgave 7/2014
Print ISSN: 0162-3257
Elektronisch ISSN: 1573-3432
DOI
https://doi.org/10.1007/s10803-014-2035-8