Skip to main content
Top
Gepubliceerd in: Journal of Autism and Developmental Disorders 1/2020

03-10-2019 | Original Paper

Assessing Social Communication and Collaboration in Autism Spectrum Disorder Using Intelligent Collaborative Virtual Environments

Auteurs: Lian Zhang, Amy S. Weitlauf, Ashwaq Zaini Amat, Amy Swanson, Zachary E. Warren, Nilanjan Sarkar

Gepubliceerd in: Journal of Autism and Developmental Disorders | Uitgave 1/2020

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

Existing literature regarding social communication outcomes of interventions in autism spectrum disorder (ASD) depends upon human raters, with limited generalizability to real world settings. Technological innovation, particularly virtual reality (VR) and collaborative virtual environments (CVE), could offer a replicable, low cost measurement platform when endowed with intelligent agent technology and peer-based interactions. We developed and piloted a novel collaborative virtual environment and intelligent agent (CRETA) for the assessment of social communication and collaboration within system and peer interactions. The system classified user statements with moderate to high accuracies. We found moderate to high agreement in displayed communication and collaboration skills between human–human and human–agent interactions. CRETA offers a promising avenue for future development of autonomous measurement systems for ASD research.
Literatuur
go back to reference Battocchi, A., Pianesi, F., Tomasini, D., Zancanaro, M., Esposito, G., Venuti, P., … Weiss, P. L. (2009). Collaborative Puzzle Game: A tabletop interactive game for fostering collaboration in children with Autism Spectrum Disorders (ASD). Paper presented at the Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces. Battocchi, A., Pianesi, F., Tomasini, D., Zancanaro, M., Esposito, G., Venuti, P., … Weiss, P. L. (2009). Collaborative Puzzle Game: A tabletop interactive game for fostering collaboration in children with Autism Spectrum Disorders (ASD). Paper presented at the Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces.
go back to reference Benford, S., Greenhalgh, C., Rodden, T., & Pycock, J. (2001). Collaborative virtual environments. Communications of the ACM,44(7), 79–85.CrossRef Benford, S., Greenhalgh, C., Rodden, T., & Pycock, J. (2001). Collaborative virtual environments. Communications of the ACM,44(7), 79–85.CrossRef
go back to reference Bennett, A. E., Miller, J. S., Stollon, N., Prasad, R., & Blum, N. J. (2018). Autism spectrum disorder and transition-aged youth. Current Psychiatry Reports,20, 103.CrossRef Bennett, A. E., Miller, J. S., Stollon, N., Prasad, R., & Blum, N. J. (2018). Autism spectrum disorder and transition-aged youth. Current Psychiatry Reports,20, 103.CrossRef
go back to reference Cauell, J., Bickmore, T., Campbell, L., & Vilhjálmsson, H. (2000). Designing embodied conversational agents. In J. Cassell, J. Sullivan, S. Prevost, & E. Churchi (Eds.), Embodied conversational agents (pp. 29–63). Cambridge: The MIT Press. Cauell, J., Bickmore, T., Campbell, L., & Vilhjálmsson, H. (2000). Designing embodied conversational agents. In J. Cassell, J. Sullivan, S. Prevost, & E. Churchi (Eds.), Embodied conversational agents (pp. 29–63). Cambridge: The MIT Press.
go back to reference Cheng, Y., Chiang, H.-C., Ye, J., & Cheng, L.-H. (2010). Enhancing empathy instruction using a collaborative virtual learning environment for children with autistic spectrum conditions. Computers & Education,55(4), 1449–1458.CrossRef Cheng, Y., Chiang, H.-C., Ye, J., & Cheng, L.-H. (2010). Enhancing empathy instruction using a collaborative virtual learning environment for children with autistic spectrum conditions. Computers & Education,55(4), 1449–1458.CrossRef
go back to reference Constantino, J. N., & Gruber, C. P. (2002). The social responsiveness scale. Los Angeles: Western Psychological Services. Constantino, J. N., & Gruber, C. P. (2002). The social responsiveness scale. Los Angeles: Western Psychological Services.
go back to reference Curtis, D. D., & Lawson, M. J. (2001). Exploring collaborative online learning. Journal of Asynchronous Learning Networks,5(1), 21–34. Curtis, D. D., & Lawson, M. J. (2001). Exploring collaborative online learning. Journal of Asynchronous Learning Networks,5(1), 21–34.
go back to reference Desmarais, M. C., & Baker, R. S. (2012). A review of recent advances in learner and skill modeling in intelligent learning environments. User Modeling and User-Adapted Interaction,22(1–2), 9–38.CrossRef Desmarais, M. C., & Baker, R. S. (2012). A review of recent advances in learner and skill modeling in intelligent learning environments. User Modeling and User-Adapted Interaction,22(1–2), 9–38.CrossRef
go back to reference Dowd, A. M., McGinley, J. L., Taffe, J. R., & Rinehart, N. J. (2012). Do planning and visual integration difficulties underpin motor dysfunction in autism? A kinematic study of young children with autism. Journal of Autism and Developmental Disorders,42(8), 1539–1548.CrossRef Dowd, A. M., McGinley, J. L., Taffe, J. R., & Rinehart, N. J. (2012). Do planning and visual integration difficulties underpin motor dysfunction in autism? A kinematic study of young children with autism. Journal of Autism and Developmental Disorders,42(8), 1539–1548.CrossRef
go back to reference Fulceri, F., Grossi, E., Contaldo, A., Narzisi, A., Apicella, F., Parrini, I.,… & Muratori, F. (2018). Motor skills as moderators of core symptoms in Autism Spectrum Disorders: Preliminary data from an exploratory analysis with Artificial Neural Networks. Frontiers in Psychology, 9, 2683. Fulceri, F., Grossi, E., Contaldo, A., Narzisi, A., Apicella, F., Parrini, I.,… & Muratori, F. (2018). Motor skills as moderators of core symptoms in Autism Spectrum Disorders: Preliminary data from an exploratory analysis with Artificial Neural Networks. Frontiers in Psychology, 9, 2683.
go back to reference Gogoulou, A., Gouli, E., & Grigoriadou, M. (2008). Adapting and personalizing the communication in a synchronous communication tool. Journal of Computer Assisted Learning,24(3), 203–216.CrossRef Gogoulou, A., Gouli, E., & Grigoriadou, M. (2008). Adapting and personalizing the communication in a synchronous communication tool. Journal of Computer Assisted Learning,24(3), 203–216.CrossRef
go back to reference Hourcade, J. P., Williams, S. R., Miller, E. A., Huebner, K. E., & Liang, L. J. (2013). Evaluation of tablet apps to encourage social interaction in children with autism spectrum disorders. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 3197–3206). Hourcade, J. P., Williams, S. R., Miller, E. A., Huebner, K. E., & Liang, L. J. (2013). Evaluation of tablet apps to encourage social interaction in children with autism spectrum disorders. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 3197–3206).
go back to reference Josman, N., Ben-Chaim, H. M., Friedrich, S., & Weiss, P. L. (2008). Effectiveness of virtual reality for teaching street-crossing skills to children and adolescents with autism. International Journal on Disability and Human Development,7(1), 49–56.CrossRef Josman, N., Ben-Chaim, H. M., Friedrich, S., & Weiss, P. L. (2008). Effectiveness of virtual reality for teaching street-crossing skills to children and adolescents with autism. International Journal on Disability and Human Development,7(1), 49–56.CrossRef
go back to reference Kaur, M., Srinivasan, S. M., & Bhat, A. N. (2018). Comparing motor performance, praxis, coordination, and interpersonal synchrony between children with and without Autism Spectrum Disorder (ASD). Research in Developmental Disabilities,72, 79–95.CrossRef Kaur, M., Srinivasan, S. M., & Bhat, A. N. (2018). Comparing motor performance, praxis, coordination, and interpersonal synchrony between children with and without Autism Spectrum Disorder (ASD). Research in Developmental Disabilities,72, 79–95.CrossRef
go back to reference Klakow, D., & Peters, J. (2002). Testing the correlation of word error rate and perplexity. Speech Communication,38(1–2), 19–28.CrossRef Klakow, D., & Peters, J. (2002). Testing the correlation of word error rate and perplexity. Speech Communication,38(1–2), 19–28.CrossRef
go back to reference Kopp, S., Gesellensetter, L., Krämer, N. C., & Wachsmuth, I. (2005). A conversational agent as museum guide–design and evaluation of a real-world application. Paper presented at the International Workshop on Intelligent Virtual Agents. Kopp, S., Gesellensetter, L., Krämer, N. C., & Wachsmuth, I. (2005). A conversational agent as museum guidedesign and evaluation of a real-world application. Paper presented at the International Workshop on Intelligent Virtual Agents.
go back to reference Krishnaiah, P. R. (1980). Handbook of statistics (Vol. 31). New Delhi: Motilal Banarsidass Publishe. Krishnaiah, P. R. (1980). Handbook of statistics (Vol. 31). New Delhi: Motilal Banarsidass Publishe.
go back to reference Kumar, R., Rosé, C. P., Wang, Y.-C., Joshi, M., & Robinson, A. (2007). Tutorial dialogue as adaptive collaborative learning support. Frontiers in Artificial Intelligence and Applications,158, 383. Kumar, R., Rosé, C. P., Wang, Y.-C., Joshi, M., & Robinson, A. (2007). Tutorial dialogue as adaptive collaborative learning support. Frontiers in Artificial Intelligence and Applications,158, 383.
go back to reference Laugeson, E. A., Ellingsen, R., Sanderson, J., Tucci, L., & Bates, S. (2014). The ABC’s of teaching social skills to adolescents with autism spectrum disorder in the classroom: The UCLA PEERS® program. Journal of Autism and Developmental Disorders,44(9), 2244–2256.CrossRef Laugeson, E. A., Ellingsen, R., Sanderson, J., Tucci, L., & Bates, S. (2014). The ABC’s of teaching social skills to adolescents with autism spectrum disorder in the classroom: The UCLA PEERS® program. Journal of Autism and Developmental Disorders,44(9), 2244–2256.CrossRef
go back to reference Laugeson, E. A., Frankel, F., Gantman, A., Dillon, A. R., & Mogil, C. (2012). Evidence-based social skills training for adolescents with autism spectrum disorders: The UCLA PEERS program. Journal of Autism and Developmental Disorders,42(6), 1025–1036.CrossRef Laugeson, E. A., Frankel, F., Gantman, A., Dillon, A. R., & Mogil, C. (2012). Evidence-based social skills training for adolescents with autism spectrum disorders: The UCLA PEERS program. Journal of Autism and Developmental Disorders,42(6), 1025–1036.CrossRef
go back to reference Leman, P. J. (2015). How do groups work? Age differences in performance and the social outcomes of peer collaboration. Cognitive science,39(4), 804–820.CrossRef Leman, P. J. (2015). How do groups work? Age differences in performance and the social outcomes of peer collaboration. Cognitive science,39(4), 804–820.CrossRef
go back to reference Linton, F., Goodman, B., Gaimari, R., Zarrella, J., & Ross, H. (2003). Student modeling for an intelligent agent in a collaborative learning environment. Paper presented at the International Conference on User Modeling. Linton, F., Goodman, B., Gaimari, R., Zarrella, J., & Ross, H. (2003). Student modeling for an intelligent agent in a collaborative learning environment. Paper presented at the International Conference on User Modeling.
go back to reference Lord, C., Risi, S., Lambrecht, L., Cook, E. H., Leventhal, B. L., DiLavore, P. C., … Rutter, M. (2000). The Autism Diagnostic Observation Schedule-Generic: A standard measure of social and communication deficits associated with the spectrum of autism. Journal of Autism and Developmental Disorders, 30(3), 205–223. https://doi.org/10.1023/a:1005592401947. Lord, C., Risi, S., Lambrecht, L., Cook, E. H., Leventhal, B. L., DiLavore, P. C., … Rutter, M. (2000). The Autism Diagnostic Observation Schedule-Generic: A standard measure of social and communication deficits associated with the spectrum of autism. Journal of Autism and Developmental Disorders, 30(3), 205–223. https://​doi.​org/​10.​1023/​a:​1005592401947.
go back to reference McManus, M. M., & Aiken, R. M. (1995). Monitoring computer-based collaborative problem solving. Journal of Interactive Learning Research,6(4), 307. McManus, M. M., & Aiken, R. M. (1995). Monitoring computer-based collaborative problem solving. Journal of Interactive Learning Research,6(4), 307.
go back to reference Millen, L., Hawkins, T., Cobb, S., Zancanaro, M., Glover, T., Weiss, P. L., & Gal, E. (2011). Collaborative technologies for children with autism. Paper presented at the Proceedings of the 10th International Conference on Interaction Design and Children. Millen, L., Hawkins, T., Cobb, S., Zancanaro, M., Glover, T., Weiss, P. L., & Gal, E. (2011). Collaborative technologies for children with autism. Paper presented at the Proceedings of the 10th International Conference on Interaction Design and Children.
go back to reference Nabeth, T., Razmerita, L., Angehrn, A., & Roda, C. (2005). InCA: A cognitive multi-agents architecture for designing intelligent & adaptive learning systems. Computer Science and Information Systems,2(2), 99–114.CrossRef Nabeth, T., Razmerita, L., Angehrn, A., & Roda, C. (2005). InCA: A cognitive multi-agents architecture for designing intelligent & adaptive learning systems. Computer Science and Information Systems,2(2), 99–114.CrossRef
go back to reference Ohl, A., Grice Sheff, M., Small, S., Nguyen, J., Paskor, K., & Zanjirian, A. (2017). Predictors of employment status among adults with Autism Spectrum Disorder. Work,56(2), 345–355.CrossRef Ohl, A., Grice Sheff, M., Small, S., Nguyen, J., Paskor, K., & Zanjirian, A. (2017). Predictors of employment status among adults with Autism Spectrum Disorder. Work,56(2), 345–355.CrossRef
go back to reference Owen-DeSchryver, J. S., Carr, E. G., Cale, S. I., & Blakeley-Smith, A. (2008). Promoting social interactions between students with autism spectrum disorders and their peers in inclusive school settings. Focus on Autism and Other Developmental Disabilities,23(1), 15–28.CrossRef Owen-DeSchryver, J. S., Carr, E. G., Cale, S. I., & Blakeley-Smith, A. (2008). Promoting social interactions between students with autism spectrum disorders and their peers in inclusive school settings. Focus on Autism and Other Developmental Disabilities,23(1), 15–28.CrossRef
go back to reference Parsons, L., Cordier, R., Munro, N., & Joosten, A. (2018). The feasibility and appropriateness of a peer-to-peer, play-based intervention for improving pragmatic language in children with autism spectrum disorder. International Journal of Speech-Language Pathology,2, 1–13. Parsons, L., Cordier, R., Munro, N., & Joosten, A. (2018). The feasibility and appropriateness of a peer-to-peer, play-based intervention for improving pragmatic language in children with autism spectrum disorder. International Journal of Speech-Language Pathology,2, 1–13.
go back to reference Parsons, L., Cordier, R., Munro, N., Joosten, A., & Speyer, R. (2017). A systematic review of pragmatic language interventions for children with autism spectrum disorder. PLoS ONE,12(4), e0172242.CrossRef Parsons, L., Cordier, R., Munro, N., Joosten, A., & Speyer, R. (2017). A systematic review of pragmatic language interventions for children with autism spectrum disorder. PLoS ONE,12(4), e0172242.CrossRef
go back to reference Parsons, S., & Mitchell, P. (2002). The potential of virtual reality in social skills training for people with autistic spectrum disorders. Journal of Intellectual Disability Research,46(Pt 5), 430–443.CrossRef Parsons, S., & Mitchell, P. (2002). The potential of virtual reality in social skills training for people with autistic spectrum disorders. Journal of Intellectual Disability Research,46(Pt 5), 430–443.CrossRef
go back to reference Rutter, M., Bailey, A., & Lord, C. (2003). The social communication questionnaire: Manual. Los Angeles: Western Psychological Services. Rutter, M., Bailey, A., & Lord, C. (2003). The social communication questionnaire: Manual. Los Angeles: Western Psychological Services.
go back to reference Samad, M. D., Diawara, N., Bobzien, J. L., Harrington, J. W., Witherow, M. A., & Iftekharuddin, K. M. (2017). A feasibility study of autism behavioral markers in spontaneous facial, visual, and hand movement response data. IEEE Transactions on Neural Systems and Rehabilitation Engineering,26(2), 353–361.CrossRef Samad, M. D., Diawara, N., Bobzien, J. L., Harrington, J. W., Witherow, M. A., & Iftekharuddin, K. M. (2017). A feasibility study of autism behavioral markers in spontaneous facial, visual, and hand movement response data. IEEE Transactions on Neural Systems and Rehabilitation Engineering,26(2), 353–361.CrossRef
go back to reference Scheuer, O., Loll, F., Pinkwart, N., & McLaren, B. M. (2010). Computer-supported argumentation: A review of the state of the art. International Journal of Computer-Supported Collaborative Learning,5(1), 43–102.CrossRef Scheuer, O., Loll, F., Pinkwart, N., & McLaren, B. M. (2010). Computer-supported argumentation: A review of the state of the art. International Journal of Computer-Supported Collaborative Learning,5(1), 43–102.CrossRef
go back to reference Schmidt, M., Laffey, J. M., Schmidt, C. T., Wang, X., & Stichter, J. (2012). Developing methods for understanding social behavior in a 3D virtual learning environment. Computers in Human Behavior,28(2), 405–413.CrossRef Schmidt, M., Laffey, J. M., Schmidt, C. T., Wang, X., & Stichter, J. (2012). Developing methods for understanding social behavior in a 3D virtual learning environment. Computers in Human Behavior,28(2), 405–413.CrossRef
go back to reference Schmidt, M., Laffey, J., & Stichter, J. (2011). Virtual social competence instruction for individuals with autism spectrum disorders: Beyond the single-user experience. Paper presented at the Proceedings of CSCL. Schmidt, M., Laffey, J., & Stichter, J. (2011). Virtual social competence instruction for individuals with autism spectrum disorders: Beyond the single-user experience. Paper presented at the Proceedings of CSCL.
go back to reference Srinivasan, S., & Petkovic, D. (2000). Phonetic confusion matrix based spoken document retrieval. Paper presented at the Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval. Srinivasan, S., & Petkovic, D. (2000). Phonetic confusion matrix based spoken document retrieval. Paper presented at the Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval.
go back to reference Stolcke, A., Coccaro, N., Bates, R., Taylor, P., Van Ess-Dykema, C., Ries, K., … Meteer, M. (2000). Dialogue act modeling for automatic tagging and recognition of conversational speech. Computational Linguistics, 26(3), 339-373.CrossRef Stolcke, A., Coccaro, N., Bates, R., Taylor, P., Van Ess-Dykema, C., Ries, K., … Meteer, M. (2000). Dialogue act modeling for automatic tagging and recognition of conversational speech. Computational Linguistics, 26(3), 339-373.CrossRef
go back to reference Van Rosmalen, P., Brouns, F., Tattersall, C., Vogten, H., Bruggen, J., Sloep, P., et al. (2005). Towards an open framework for adaptive, agent-supported e-learning. International Journal of Continuing Engineering Education and Life Long Learning,15(3–6), 261–275.CrossRef Van Rosmalen, P., Brouns, F., Tattersall, C., Vogten, H., Bruggen, J., Sloep, P., et al. (2005). Towards an open framework for adaptive, agent-supported e-learning. International Journal of Continuing Engineering Education and Life Long Learning,15(3–6), 261–275.CrossRef
go back to reference Vernon, T. W., Miller, A. R., Ko, J. A., Barrett, A. C., & McGarry, E. S. (2018). A randomized controlled trial of the Social Tools And Rules for Teens (START) program: An immersive socialization intervention for adolescents with autism spectrum disorder. Journal of Autism and Developmental Disorders,48(3), 892–904.CrossRef Vernon, T. W., Miller, A. R., Ko, J. A., Barrett, A. C., & McGarry, E. S. (2018). A randomized controlled trial of the Social Tools And Rules for Teens (START) program: An immersive socialization intervention for adolescents with autism spectrum disorder. Journal of Autism and Developmental Disorders,48(3), 892–904.CrossRef
go back to reference Vieira, A. C., Teixeira, L., Timóteo, A., Tedesco, P., & Barros, F. (2004). Analyzing on-line collaborative dialogues: The oxentchê–chat. Paper presented at the International Conference on Intelligent Tutoring Systems. Vieira, A. C., Teixeira, L., Timóteo, A., Tedesco, P., & Barros, F. (2004). Analyzing on-line collaborative dialogues: The oxentchêchat. Paper presented at the International Conference on Intelligent Tutoring Systems.
go back to reference Walker, E., Rummel, N., & Koedinger, K. R. (2014). Adaptive intelligent support to improve peer tutoring in algebra. International Journal of Artificial Intelligence in Education,24(1), 33–61.CrossRef Walker, E., Rummel, N., & Koedinger, K. R. (2014). Adaptive intelligent support to improve peer tutoring in algebra. International Journal of Artificial Intelligence in Education,24(1), 33–61.CrossRef
go back to reference Wallace, S., Parsons, S., & Bailey, A. (2015). Self-reported sense of presence and responses to social stimuli by adolescents with ASD in a collaborative virtual reality environment. Journal of Intellectual and Developmental Disability,42(2), 131–141.CrossRef Wallace, S., Parsons, S., & Bailey, A. (2015). Self-reported sense of presence and responses to social stimuli by adolescents with ASD in a collaborative virtual reality environment. Journal of Intellectual and Developmental Disability,42(2), 131–141.CrossRef
go back to reference Weitlauf, A. S., McPheeters, M. L., Peters, B., Sathe, N., Travis, R., Aiello, R., … Warren, Z. (2014). Therapies for Children With Autism Spectrum Disorder: Behavioral Interventions Update. Rockville: Agency for Healthcare Research and Quality. Weitlauf, A. S., McPheeters, M. L., Peters, B., Sathe, N., Travis, R., Aiello, R., … Warren, Z. (2014). Therapies for Children With Autism Spectrum Disorder: Behavioral Interventions Update. Rockville: Agency for Healthcare Research and Quality.
go back to reference Wilson, G. F., & Russell, C. A. (2007). Performance enhancement in an uninhabited air vehicle task using psychophysiologically determined adaptive aiding. Human Factors, 49(6), 1005–1018.CrossRef Wilson, G. F., & Russell, C. A. (2007). Performance enhancement in an uninhabited air vehicle task using psychophysiologically determined adaptive aiding. Human Factors, 49(6), 1005–1018.CrossRef
go back to reference Zancanaro, M., Pianesi, F., Stock, O., Venuti, P., Cappelletti, A., Iandolo, G., … Rossi, F. (2007). Children in the museum: an environment for collaborative storytelling. In O. Stock, M. Zancanaro (Eds.), PEACH-intelligent interfaces for museum visits (pp. 165–184). Berlin: Springer. Zancanaro, M., Pianesi, F., Stock, O., Venuti, P., Cappelletti, A., Iandolo, G., … Rossi, F. (2007). Children in the museum: an environment for collaborative storytelling. In O. Stock, M. Zancanaro (Eds.), PEACH-intelligent interfaces for museum visits (pp. 165–184). Berlin: Springer.
Metagegevens
Titel
Assessing Social Communication and Collaboration in Autism Spectrum Disorder Using Intelligent Collaborative Virtual Environments
Auteurs
Lian Zhang
Amy S. Weitlauf
Ashwaq Zaini Amat
Amy Swanson
Zachary E. Warren
Nilanjan Sarkar
Publicatiedatum
03-10-2019
Uitgeverij
Springer US
Gepubliceerd in
Journal of Autism and Developmental Disorders / Uitgave 1/2020
Print ISSN: 0162-3257
Elektronisch ISSN: 1573-3432
DOI
https://doi.org/10.1007/s10803-019-04246-z

Andere artikelen Uitgave 1/2020

Journal of Autism and Developmental Disorders 1/2020 Naar de uitgave