Cara Wilson
Laurianne Sitbon
Bernd Ploderer
ABSTRACT
Expressing one's thoughts and feelings is a fundamental human need - the basis for communication and social interaction. We ask, how do minimally-verbal children on the autism spectrum express themselves? How can we better recognise instances of self-expression? And how might technologies support and encourage self-expression? To address these questions, we undertook co-design research at an autism-specific primary school with 20 children over one school year. This paper contributes six Modalities of Self-Expression, through which children self-express and convey their design insights. Each modality of self-expression can occur across two different dimensions (socio-expressive and auto-expressive) and can be of a fundamental or an integrative nature. Further, we contribute the design trajectory of a tangible ball prototype, the ExpressiBall, which - through voice, sounds, lights, and motion sensors - explores how tangible technologies can support this range of expressive modalities. Finally, we discuss the concept of Self-Expression by Design.
- Andrea Alessandrini, Victor Loux, Gabriel Ferreira Serra, and Cormac Murray. 2016. Designing ReduCat: AudioAugmented Paper Drawings Tangible Interface in Educational Intervention for High-Functioning Autistic Children. In Proceedings of the 15th International Conference on Interaction Design and Children (IDC '16), 463--472.Google Scholar
Digital Library
- Meryl Alper. 2017. Giving voice: Mobile communication, disability, and inequality. MIT Press, 2017.Google ScholarCross Ref
- Aloha Hufana Ambe, Margot Brereton, Alessandro Soro, and Paul Roe. 2017. Technology Individuation: The Foibles of Augmented Everyday Objects. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17), 6632--6644.Google ScholarDigital Library
- Alissa N. Antle. 2008. Inquiring materials for tangible prototyping. In Proceedings of the 2nd international conference on Tangible and embedded interaction (TEI '08). ACM, NY, NY, USA, 139--140.Google ScholarDigital Library
- AssistiveWare 'Proloquo2Go'. 2013. Retrieved July 14, 2019 from https://www.assistiveware.com/products/proloquo2goGoogle Scholar
- Ellie Bates, Kristy Evers, Lee Leewis, Jenny Zhou, Asimina Vasalou, Vali Lalioti, and Kandase Augustin. 2018. The bits & atoms of play: critical engagements with intercultural meaning making. In Proceedings of the 17th ACM Conference on Interaction Design and Children (IDC '18), 761--764.Google ScholarDigital Library
- Tilde Bekker, Janienke Sturm, Rik Wesselink, Bas Groenendaal, and Berry Eggen. 2008. Interactive play objects and the effects of open-ended play on social interaction and fun. In Proceedings of the 2008 International Conference on Advances in Computer Entertainment Technology (ACE '08), 389--392.Google ScholarDigital Library
- Erna Blanche, Gustavo Imperatore, Megan Reinoso, Megan C. Chang, and Stefanie Bodison. 2012. Proprioceptive processing difficulties among children with autism spectrum disorders and developmental disabilities. American Journal of Occupational Therapy 66, 5: 621--624.Google ScholarCross Ref
- Margot Brereton, Laurianne Sitbon, Muhammad Haziq Lim Abdullah, Mark Vanderberg, and Stewart Koplick. 2015. Design after design to bridge between people living with cognitive or sensory impairments, their friends and proxies. CoDesign 11,1 : 4--20.Google ScholarCross Ref
- Franceli L. Cibrian. 2016. Music therapy on interactive surfaces to improve sensorimotor problems of children with autism. SIGACCESS Transactions on Accessible Computing 114 (March 2016), 20--24.Google Scholar
- Tom Djajadiningrat, Ben Matthews, and Marcelle Stienstra. 2007. Easy doesn't do it: skill and expression in tangible aesthetics. In Personal and Ubiquitous Computing 11, 8, 657676.Google ScholarDigital Library
- Paul Dourish. Where the action is: the foundations of embodied interaction. MIT press, 2004.Google Scholar
- Allison Druin. 1999. Cooperative Inquiry: Developing New Technologies for Children with Children. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '99). ACM, NY, NY, USA, 592--599.Google ScholarDigital Library
- Carl J. Dunst. 1998. Sensorimotor development and developmental disabilities. Handbook of mental retardation and development, 135--182.Google Scholar
- eSafety Commission Website 'Safety by Design'. 2019. Retrieved August 10, 2019 from https://www.esafety.gov.au/esafety-information/safety-bydesignGoogle Scholar
- William Farr, Nicola Yuill, Eric Harris, and Steve Hinske. 2010. In my own words: configuration of tangibles, object interaction and children with autism. In Proceedings of the 9th International Conference on Interaction Design and Children (IDC '10), 30--38.Google ScholarDigital Library
- Christina T. Fuentes, Stewart H. Mostofsky, and Amy J. Bastian. 2011. No proprioceptive deficits in autism despite movement-related sensory and execution impairments. Journal of autism and developmental disorders 41, no. 10: 1352--1361.Google ScholarCross Ref
- Christopher Frauenberger, Julia Makhaeva, and Katharina Spiel. 2016. Designing Smart Objects with Autistic Children: Four Design Exposès. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16) 130--139.Google ScholarDigital Library
- Elisa Giaccardi and Elvin Karana. 2015. Foundations of Materials Experience: An Approach for HCI. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15), 2447--2456.Google ScholarDigital Library
- Jenna Gillett-Swan and Jonathon Sargeant. 2018. Assuring children's human right to freedom of opinion and expression in education. International Journal of Speech-Language Pathology, 20,1 (2018),120--127Google ScholarCross Ref
- Mitchell S. Green. 2007. Self-expression. Oxford University Press.Google Scholar
- Mariellen Griffith. 1997. Empowering techniques of play therapy: A method for working with sexually abused children. Journal of Mental Health Counseling 19 (2): 130-Google Scholar
- Clint Heyer and Margot Brereton. 2010. Design from the everyday: continuously evolving, embedded exploratory prototypes. In Proceedings of the 8th ACM Conference on Designing Interactive Systems (DIS '10), 282--291.Google ScholarDigital Library
- Hanneke Hooft van Huysduynen, Linda de Valk, and Tilde Bekker. 2016. Tangible Play Objects: Influence of Different Combinations of Feedback Modalities. In Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '16), 262--270.Google ScholarDigital Library
- Eva Hornecker and Jacob Buur. 2006. Getting a grip on tangible interaction: a framework on physical space and social interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '06), 437--446.Google ScholarDigital Library
- Ole Sejer Iversen, Rachel Charlotte Smith, and Christian Dindler. 2017. Child As Protagonist: Expanding the Role of Children in Participatory Design. In Proceedings of the 2017 Conference on Interaction Design and Children (IDC '17), 27--37.Google ScholarDigital Library
- Carey Jewitt. 2013. Multimodal methods for researching digital technologies. In Price S and Jewitt C (eds) The SAGE Handbook of Digital Technology Research, 250--265.Google Scholar
- Brigitte Jordan and Austin Henderson. 1995. Interaction Analysis: Foundations and Practice. Journal of the Learning Sciences 4, 1 (1995), 39--103.Google ScholarCross Ref
- Connie Kasari, Stephanny Freeman, and Tanya Paparella. 2006. Joint attention and symbolic play in young children with autism: A randomized controlled intervention study. Journal of Child Psychology and Psychiatry 47, 6: 611--620.Google ScholarCross Ref
- Barbara Kawulich. 2005. Participant Observation as a Data Collection Method. Qualitative Social Research 6, 2 (2005).Google Scholar
- Wendy Keay-Bright and Imogen Howarth. 2012. Is simplicity the key to engagement for children on the autism spectrum?. Personal and Ubiquitous Computing 16, 2: 129--141.Google ScholarDigital Library
- Heejung S. Kim and Deborah Ko. 2007. Culture and selfexpression. In C. Sedikides & S. Spencer (Eds.), Frontiers of social psychology: The self (pp. 325--342). New York, US: Psychology Press.Google Scholar
- Garry L. Landreth. 2012. Play Therapy: The Art of the Relationship. (3rd ed.). London: Routledge.Google ScholarCross Ref
- Amanda Lazar, Jessica L. Feuston, Caroline Edasis, and Anne Marie Piper. 2018. Making As Expression: Informing Design with People with Complex Communication Needs Through Art Therapy. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). Artcile 351, 16 pages.Google ScholarDigital Library
- Susan R. Leekam, Carmen Nieto, Sarah J. Libby, Lorna Wing, and Judith Gould. 2007. Describing the sensory abnormalities of children and adults with autism. Journal of autism and developmental disorders 37, 5 (2007), 894--910.Google ScholarCross Ref
- Kevin Lefeuvre, Soeren Totzauer, Michael Storz, Albrecht Kurze, Andreas Bischof, and Arne Berger. 2018. Bricks, Blocks, Boxes, Cubes, and Dice: On the Role of Cubic Shapes for the Design of Tangible Interactive Devices. In Proceedings of the 2018 Designing Interactive Systems Conference (DIS '18). 485--496.Google ScholarDigital Library
- Julia Makhaeva, Christopher Frauenberger, and Katharina Spiel. 2016. Creating Creative Spaces for Co-designing with Autistic Children: The Concept of a "Handlungsspielraum". In Proceedings of the 14th Participatory Design Conference: Full Papers - Volume 1 (PDC '16), 51--60.Google ScholarDigital Library
- Laura Malinverni, Edith Ackermann, and Narcis Pares. 2016. Experience as an Object to Think with: from Sensing-in-action to Making-Sense of action in Full-Body Interaction Learning Environments. In Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '16), 332--339.Google ScholarDigital Library
- Laura Malinverni, Marie-Monique Schaper, and Narcis Pares. 2019. Multimodal methodological approach for participatory design of Full-Body Interaction Learning Environments. Qualitative Research 19, 1 (2019), 71--89.Google ScholarCross Ref
- Elysa J. Marco, L. B. Hinkley, Susanna S. Hill and Srikantan S. Nagarajan. 2011. Sensory processing in autism: A review of neurophysiologic findings. Paediatric Research, 69 (5 Part 2), 48.Google ScholarCross Ref
- Nancy J. Minshew, Jessica Meyer, and Gerald Goldstein. 2002. Abstract reasoning in autism: A disassociation between concept formation and concept identification. Neuropsychology 16, 3 (2002), 327.Google ScholarCross Ref
- Ulric Neisser. 1988. Five kinds of self-knowledge. Philosophical psychology, 1(1): 35--59.Google Scholar
- Antonella Nonnis and Nick Bryan-Kinns. 2019. Mazi: Tangible Technologies as a Channel for Collaborative Play. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19) 440, 13Google ScholarDigital Library
- Marianna Obrist, Carlos Velasco, Chi Thanh Vi, Nimesha Ranasinghe, Ali Israr, Adrian D. Cheok, Charles Spence, and Ponnampalam Gopalakrishnakone. 2016. Touch, Taste, & Smell User Interfaces: The Future of Multisensory HCI. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16), 3285--3292.Google ScholarDigital Library
- Marianna Obrist, Elia Gatti, Emanuela Maggioni, Chi Thanh Vi, and Carlos Velasco. 2017. Multisensory experiences in HCI. IEEE MultiMedia 24, 2 (2017), 9--13Google ScholarDigital Library
- Deysi Helen Ortega, Franceli Linney Cibrian, and Mónica Tentori. 2015. BendableSound: a Fabric-based Interactive Surface to Promote Free Play in Children with Autism. In Proc. of the 17th International ACM SIGACCESS Conference on Computers & Accessibility (ASSETS '15), 315-Google ScholarDigital Library
- Jean Piaget. 2013. Play, dreams and imitation in childhood. Routledge.Google Scholar
- Kenneth K. Poon, Linda R. Watson, Grace T. Baranek, and Michele D. Poe. 2012. To What Extent Do Joint Attention, Imitation, and Object Play Behaviors in Infancy Predict Later Communication and Intellectual Functioning in ASD? Journal of Autism and Developmental Disorders 42, 6 (Jun 2012), 1064--1074.Google ScholarCross Ref
- Barry M. Prizant, and Judith F. Duchan. 1981. The functions of immediate echolalia in autistic children. Journal of speech and hearing disorders 46, 3 (1981), 241--249.Google ScholarCross Ref
- Nicolas Rasamimanana, Frédéric Bevilacqua, Julien Bloit, Norbert Schnell, Emmanuel Fléty, Andrea Cera, Uros Petrevski, and Jean-Louis Frechin. 2012. The urban musical game: using sport balls as musical interfaces. In CHI '12 Extended Abstracts on Human Factors in Computing Systems(CHI EA '12), 1027--1030Google ScholarDigital Library
- Kathryn E. Ringland, Rodrigo Zalapa, Megan Neal, Lizbeth Escobedo, Monica E. Tentori, and Gillian R. Hayes. 2014. SensoryPaint: a natural user interface supporting sensory integration in children with neurodevelopmental disorders. In CHI'14 Extended Abstracts on Human Factors in Computing Systems (CHI EA '14), 1681--1686.Google Scholar
- Kathryn E. Ringland, LouAnne Boyd, Heather Faucett, Amanda L.L. Cullen, and Gillian R. Hayes. 2017. Making in Minecraft: A Means of Self-Expression for Youth with Autism. In Proceedings of the 2017 Conference on Interaction Design and Children (IDC '17) 340--345.Google ScholarDigital Library
- John Rooksby, Mattias Rost, Alistair Morrison, and Matthew Chalmers. 2015. Pass the Ball: Enforced Turn-Taking in Activity Tracking. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15), 2417--2426.Google ScholarDigital Library
- Richard M. Ryan and Edward L. Deci. 2000. Intrinsic and extrinsic motivations: Classic definitions and new directions. Contemporary educational psychology 25, 1: 54--67.Google Scholar
- Daniel Salber, and Joëlle Coutaz. 1993. Applying the wizard of oz technique to the study of multimodal systems. In International Conference on Human-Computer Interaction, 753: 219--230, Springer, Berlin, HeidelbergGoogle ScholarCross Ref
- Laura Scheepmaker, Christopher Frauenberger, and Katta Spiel. 2018. The Things We Play with Roles of Technology in Social Play. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '18), 451462.Google ScholarDigital Library
- Katta Spiel, Julia Makhaeva, and Christopher Frauenberger. 2016. Embodied Companion Technologies for Autistic Children. In Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '16) 245--252.Google ScholarDigital Library
- Miguel Sicart. Play matters. MIT Press, 2014.Google ScholarCross Ref
- Steve Silberman. Neurotribes: The legacy of autism and the future of neurodiversity. Penguin, 2015.Google Scholar
- Helen Tager-Flusberg and Connie Kasari. 2013. Minimally Verbal School--Aged Children with Autism Spectrum Disorder: The Neglected End of the Spectrum. Autism Research 6, 6: 468--478.Google ScholarCross Ref
- Jelle van Dijk, Remko van der Lugt, and Caroline Hummels. 2014. Beyond distributed representation: embodied cognition design supporting socio-sensorimotor couplings. In Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction (TEI '14), 181--188.Google Scholar
- Jelle van Dijk and Caroline Hummels. 2017. Designing for Embodied Being-in-the-World: Two Cases, Seven Principles and One Framework. In Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction (TEI '17), 47--56.Google ScholarDigital Library
- Lilia Villafuerte, Milena Markova and Sergi Jorda. 2012. Acquisition of social abilities through musical tangible user interface: children with autism spectrum condition and the Reactable. In CHI '12 Extended Abstracts on Human Factors in Computing Systems (CHI EA '12), 745--760.Google ScholarDigital Library
- Lev S. Vygotsky. 1967. Play and its role in the mental development of the child. Soviet psychology 5, 3 (1967), 6--18.Google Scholar
- Alan Waterman, Seth Schwartz and Regina Conti. 2008. The implications of two conceptions of happiness (hedonic enjoyment and eudaimonia) for the understanding of intrinsic motivation. Journal of Happiness Studies, 9, 1: 41--79.Google ScholarCross Ref
- Gil Weinberg, Maggie Orth, and Peter Russo. 2000. The embroidered musical ball: a squeezable instrument for expressive performance. In CHI '00 Extended Abstracts on Human Factors in Computing Systems (CHI EA '00), 283--284.Google ScholarDigital Library
- Danielle Wilde. 2008. The hipdiskettes: learning (through) wearables. In Proceedings of the 20th Australasian Conference on Computer-Human Interaction: Designing for Habitus and Habitat (OZCHI '08), 259--262.Google ScholarDigital Library
- Cara Wilson, Margot Brereton, Bernd Ploderer, Laurianne Sitbon, and Beth Saggers. 2017. Digital Strategies for Supporting Strengths- and Interests-based Learning with Children with Autism. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '17). Association for Computing Machinery, New York, NY, USA, 52--61.Google ScholarDigital Library
- Cara Wilson, Margot Brereton, Bernd Ploderer, and Laurianne Sitbon. 2018. MyWord: Enhancing Engagement, Interaction and Self- expression with Minimally-verbal Children on the Autism Spectrum Through a Personal Audio-visual Dictionary. In Proceedings of the 17th ACM Conference on Interaction Design and Children (IDC '18), 106--118.Google ScholarDigital Library
- Cara Wilson, Margot Brereton, Bernd Ploderer, and Laurianne Sitbon. 2019. Co-Design Beyond Words: 'Moments of Interaction' with Minimally-Verbal Children on the Autism Spectrum. In CHI Conference on Human Factors in Computing Systems Proceedings (CHI 2019), Paper 21, 1--15.Google Scholar
- Yulia Zhiglova. 2018. The Interactive Carpet - Smart Textile Interface for Children on Autism Spectrum Disorder. In Proc. of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '18), 712--714.Google ScholarDigital Library
Index Terms
- Self-Expression by Design: Co-Designing the ExpressiBall with Minimally-Verbal Children on the Autism Spectrum
Recommendations
Co-Design Beyond Words: 'Moments of Interaction' with Minimally-Verbal Children on the Autism Spectrum
CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing SystemsExisting co-design methods support verbal children on the autism spectrum in the design process, while their minimally-verbal peers are overlooked. We describe Co-Design Beyond Words (CDBW), an approach which merges existing co-design methods with ...
Co-Designing Digital Technologies to Support Minimally-Verbal Children on the Autism Spectrum
CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing SystemsThis doctoral work considers how to best co-design with minimally-verbal children on the autism spectrum in classroom contexts. It focuses on 1) leveraging personal interests and individual strengths to foster engagement, social interaction and self-...
Toward a Technology-based Tool to Support Idea Generation during Participatory Design with Children with Autism Spectrum Disorders
ASSETS '18: Proceedings of the 20th International ACM SIGACCESS Conference on Computers and AccessibilityOur research explores the development of a novel technology-based prototype to support children and designers during brainstorming, one of the most challenging activities within Participatory Design (PD). This paper describes a proof-of-concept ...
Comments