Abstract
Autism spectrum disorder is typically associated with social deficits and is often specifically linked to difficulty with processing faces and other socially relevant stimuli. Emerging research has suggested that children with autism might also have deficits in basic perceptual abilities including multisensory processing (e.g., simultaneously processing visual and auditory inputs). The current study examined the relationship between multisensory temporal processing (assessed via a simultaneity judgment task wherein participants were to report whether a visual stimulus and an auditory stimulus occurred at the same time or at different times) and self-reported symptoms of autism (assessed via the Autism Spectrum Quotient questionnaire). Data from over 100 healthy adults revealed a relationship between these two factors as multisensory timing perception correlated with symptoms of autism. Specifically, a stronger bias to perceive auditory stimuli occurring before visual stimuli as simultaneous was associated with greater levels of autistic symptoms. Additional data and analyses confirm that this relationship is specific to multisensory processing and symptoms of autism. These results provide insight into the nature of multisensory processing while also revealing a continuum over which perceptual abilities correlate with symptoms of autism and that this continuum is not just specific to clinical populations but is present within the general population.
Similar content being viewed by others
Notes
We define ‘low-level’ visual processes as the basic, first steps of perception such as discriminating the orientation of visual stimuli or determining the frequency of an auditory sound, and ‘high-level’ processing as the identification of a face or speech, or any complex object consisting of multiple types of ‘low-level’ stimuli.
No data were removed from this correlation as outliers since data were already removed from participants who had a PSS outside the range of SOAs tested (i.e., those who were unable/refused to do the task). As seen in Fig. 2a, one participant scored low on the ASQ. However, with this data point removed, the correlation is still highly significant (R = −0.26, p = 0.008).
The alpha level necessary to reach significance here is 0.025 via Bonferroni correction for multiple comparisons since two different analyses are being run on both the near and the far data.
There were several other assessments obtained from our participants in their first visit; however, we are only analyzing (and reporting here) the tests conducted based on a priori predictions about the relationships between video game play, ADHD, and multisensory processing.
References
Adolphs R, Sears L, Piven J (2001) Abnormal processing of social information from faces in autism. J Cogn Neurosci 13(2):232–240. doi:10.1162/089892901564289
Alais D, Newell FN, Mamassian P (2010) Multisensory processing in review: from physiology to behaviour. See Perceiving 23(1):3–38. doi:10.1163/187847510x488603
Baron-Cohen S, Ring HA, Wheelwright S, Bullmore ET, Brammer MJ, Simmons A, Williams SCR (1999) Social intelligence in the normal and autistic brain: an fMRI study. Eur J Neurosci 11(6):1891–1898. doi:10.1046/j.1460-9568.1999.00621.x
Baron-Cohen S, Wheelwright S, Skinner R, Martin J, Clubley E (2001) The autism-spectrum quotient (AQ): evidence from Asperger syndrome/high-functioning autism, males and females, scientists and mathematicians (vol 31, pg 5, 2001). J Autism Dev Disord 31(6):603–603
Batty M, Meaux E, Wittemeyer K, Roge B, Taylor MJ (2011) Early processing of emotional faces in children with autism: an event-related potential study. J Exp Child Psychol 109(4):430–444. doi:10.1016/j.jecp.2011.02.001
Centers for Disease Control and Prevention (2012) Prevalence of autism spectrum disorders- autism and developmental disabilities monitoring network, United States, 2008. Morb Mortal Wkly Report 61(3):1–24
Cesaroni L, Garber M (1991) Exploring the experience of autism through firsthand accounts. J Autism Dev Disord 21(3):303–313. doi:10.1007/bf02207327
Charman T, Jones CRG, Pickles A, Simonoff E, Baird G, Happe F (2011) Defining the cognitive phenotype of autism. Brain Res 1380:10–21. doi:10.1016/j.brainres.2010.10.075
Clark K, Fleck MS, Mitroff SR (2011) Enhanced change detection performance reveals improved strategy use in avid action video game players. Acta Psychol 136(1):67–72. doi:10.1016/j.actpsy.2010.10.003
Dahlgren SO, Gillberg C (1989) Symptoms in the 1st 2 years of life—a preliminary population study of infantile-autism. Eur Arch Psychiatry Clin Neurosci 238(3):169–174
Dalton KM, Nacewicz BM, Johnstone T, Schaefer HS, Gernsbacher MA, Goldsmith HH, Alexander AL, Davidson RJ (2005) Gaze fixation and the neural circuitry of face processing in autism. Nat Neurosci 8(4):519–526. doi:10.1038/nn1421
Donohue SE, Woldorff MG, Mitroff SR (2010) Video game players show more precise multisensory temporal processing abilities. Attent Percept Psychophys 72(4):1120–1129. doi:10.3758/app.72.4.1120
Driver J, Noesselt T (2008) Multisensory interplay reveals crossmodal influences on ‘sensory-specific’ brain regions, neural responses, and judgments. Neuron 57(1):11–23. doi:10.1016/j.neuron.2007.12.013
Elsabbagh M, Mercure E, Hudry K, Chandler S, Pasco G, Charman T, Pickles A, Baron-Cohen S, Bolton P, Johnson MH, Team B (2012) Infant neural sensitivity to dynamic eye gaze is associated with later emerging autism. Curr Biol 22(4):338–342. doi:10.1016/j.cub.2011.12.056
Foss-Feig JH, Kwakye LD, Cascio CJ, Burnette CP, Kadivar H, Stone WL, Wallace MT (2010) An extended multisensory temporal binding window in autism spectrum disorders. Exp Brain Res 203(2):381–389. doi:10.1007/s00221-010-2240-4
Grelotti DJ, Gauthier I, Schultz RT (2002) Social interest and the development of cortical face specialization: what autism teaches us about face processing. Dev Psychobiol 40(3):213–225. doi:10.1002/dev.10028
Harms MB, Martin A, Wallace GL (2010) Facial emotion recognition in autism spectrum disorders: a review of behavioral and neuroimaging studies. Neuropsychol Rev 20(3):290–322. doi:10.1007/s11065-010-9138-6
Hileman CM, Henderson H, Mundy P, Newell L, Jaime M (2011) Developmental and individual differences on the P1 and N170 ERP components in children with and without autism. Dev Neuropsychol 36(2):214–236. doi:10.1080/87565641.2010.549870
Jasper L, Goldberg I (1993) Jasper/Goldberg adult ADD questionnaire. Retrieved 1 Oct 2009, from http://www.mentalhelp.net/poc/view_doc.php?id=974&type=doc&cn=ADHD
Kwakye LD, Foss-Feig JH, Cascio CJ, Stone WL, Wallace MT (2011) Altered auditory and multisensory temporal processing in autism spectrum disorders. Front Integr Neurosci 5(4):129
Kwon S, Kim J, Choe BH, Ko C, Park S (2007) Electrophysiologic assessment of central auditory processing by auditory brainstem responses in children with autism spectrum disorders. J Korean Med Sci 22(4):656–659
Leyfer OT, Folstein SE, Bacalman S, Davis NO, Dinh E, Morgan J, Tager-Flusberg H, Lainhart JE (2006) Comorbid psychiatric disorders in children with autism: interview development and rates of disorders. J Autism Dev Disord 36(7):849–861. doi:10.1007/s10803-006-0123-0
Marco EJ, Hinkley LBN, Hill SS, Nagarajan SS (2011) Sensory processing in autism: a review of neurophysiologic findings. Pediatr Res 69(5):48R–54R. doi:10.1203/PDR.0b013e3182130c54
Megnin O, Flitton A, Jones CRG, de Haan M, Baldeweg T, Charman T (2012) Audiovisual speech integration in autism spectrum disorders: ERP evidence for atypicalities in lexical-semantic processing. Autism Res 5(1):39–48. doi:10.1002/aur.231
Miles JH (2011) Autism spectrum disorders-a genetics review. Genet Med 13(4):278–294. doi:10.1097/GIM.0b013e3181ff67ba
Modi ME, Young LJ (2012) The oxytocin system in drug discovery for autism: animal models and novel therapeutic strategies. Horm Behav 61(3):340–350. doi:10.1016/j.yhbeh.2011.12.010
Osterling J, Dawson G (1994) Early recognition of children with autism = a study of 1st birthday home videotapes. J Autism Dev Disord 24(3):247–257. doi:10.1007/bf02172225
Philip RCM, Whalley HC, Stanfield AC, Sprengelmeyer R, Santos IM, Young AW, Atkinson AP, Calder AJ, Johnstone EC, Lawrie SM, Hall J (2010) Deficits in facial, body movement and vocal emotional processing in autism spectrum disorders. Psychol Med 40(11):1919–1929. doi:10.1017/s0033291709992364
Powers AR 3rd, Hillock AR, Wallace MT (2009) Perceptual training narrows the temporal window of multisensory binding. J Neurosci 29(39):12265–12274. doi:10.1523/JNEUROSCI.3501-09.2009
Roth DAE, Muchnik C, Shabtai E, Hildesheimer M, Henkin Y (2012) Evidence for atypical auditory brainstem responses in young children with suspected autism spectrum disorders. Dev Med Child Neurol 54(1):23–29. doi:10.1111/j.1469-8749.2011.04149.x
Russo N, Foxe JJ, Brandwein AB, Altschuler T, Gomes H, Molholm S (2010) Multisensory processing in children with autism: high-density electrical mapping of auditory somatosensory Integration. Autism Res 3(5):253–267. doi:10.1002/aur.152
Stein BE, Stanford TR (2008) Multisensory integration: current issues from the perspective of the single neuron. Nat Rev Neurosci 9(4):255–266. doi:10.1038/nrn2331
Stone JV, Hunkin NM, Porrill J, Wood R, Keeler V, Beanland M, Port M, Porter NR (2001) When is now? Perception of simultaneity. Proc R Soc Lond Ser B Biol Sci 268(1462):31–38
Tomchek SD, Dunn W (2007) Sensory processing in children with and without autism: a comparative study using the short sensory profile. Am J Occup Ther 61(2):190–200
van Eijk RLJ, Kohlrausch A, Juola JF, van de Par S (2008) Audiovisual synchrony and temporal order judgments: effects of experimental method and stimulus type. Percept Psychophys 70(6):955–968. doi:10.3758/pp.70.6.955
van Wassenhove V, Grant KW, Poeppel D (2007) Temporal window of integration in auditory-visual speech perception. Neuropsychologia 45(3):598–607. doi:10.1016/j.neuropsychologia.2006.01.001
Xiong QJ, Oviedo HV, Trotman LC, Zador AM (2012) PTEN regulation of local and long-range connections in mouse auditory cortex. J Neurosci 32(5):1643–1652. doi:10.1523/jneurosci.4480-11.2012
Zampini M, Guest S, Shore DI (2005) Audio-visual simultaneity judgments. Percept Psychophys 67(3):531–544
References for battery questionnaires
Baron-Cohen S, Wheelwright S, Skinner R, Martin J, Clubley E (2001) The autism-spectrum quotient (AQ): evidence from Asperger syndrome/high-functioning autism, males and females, scientists and mathematicians. J Autism Dev Disorders 31:5–17
Costa PT Jr, McCrae RR (1992) Revised NEO personality inventory (NEO-PI-R) and NEO five-factor inventory (NEO-FFI) professional manual. Odessa, Florida
Garner DM, Garfinkel PE (1979) The eating attitudes test: an index of the symptoms of anorexia nervosa. Psychol Med 9:273–279
Higgins ET, Friedman RS, Harlow RE, Idson LC, Ayduk ON, Taylor A (2001) Achievement orientations from subjective histories of success: promotion pride versus prevention pride. Euro J Soc Psychol 31:3–23
Jasper L, Goldberg I (1993) Jasper/Goldberg adult ADD questionnaire. http://www.mentalhelp.net/poc/view_doc.php?id=974&type=doc&cn=ADHD. Accessed 1 Oct 2009
Ophir E, Nass C, WagnerAD (2009) Cognitive control in media multitaskers. Proceedings of the national academy of sciences of the United States of America, doi:10.1073/pnas.0903620106
Oldfield RC (1971) The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 9:97–113
Marian V, Blumenfeld HK, Kaushanskaya M (2007) The language experience and proficiency questionnaire (LEAP-Q): assessing language profiles in bilinguals and multilinguals. J Speech Lang Hear Res 50:940–967
Schwartz B, Ward A, Lyubomirsky S, Monterosso J, White K, Lehman DR (2002) Maximizing versus satisfying: happiness is a matter of choice. J Pers Soc Psychol 83:1178–1197
Smith KB, Oxley DR, Hibbing MV, Alford JR, Hibbing JR (2011) Linking genetics and political attitudes: reconceptualizing political ideology. Polit Psychol 32:369–397
Spielberger CD, Gorssuch RL, Lushene PR, Vagg PR, Jacobs GA (1983) Manual for the state-trait anxiety inventory. Palo Alto, California
Watson D, Clark LA, Tellegen A (1988) Development and validation of brief measures of positive and negative affect: The PANAS scales. J Pers Soc Psychol 54:1063–1070
Wilson GD, Patterson JR (1968) A new measure of conservatism. Br J Soc Clin Psychol 7:264–269
Acknowledgments
We thank Matthew S. Cain for assistance with data analysis and helpful comments on this manuscript, Kait Clark for assistance with the visual–visual temporal-order judgment task, and Matthew Forester, Edward Liu, and Sylvia Nantier for assistance with data acquisition. This work was supported by a National Science Graduate Research Fellowship award to S.E.D. and was partially supported by the Army Research Office (#54528LS) and partially through a subcontract with the Institute for Homeland Security Solutions, a research consortium sponsored by the Human Factors Division in the Department of Homeland Security (DHS). This material is based upon work supported by the DHS under Contract No. HSHQDC-08-C-00100. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the official policy or position of DHS or of the US Government. The study is approved for public release.
Author information
Authors and Affiliations
Corresponding author
Appendix for Donohue, Darling, and Mitroff
Appendix for Donohue, Darling, and Mitroff
The Duke Visual Cognition Laboratory administers a ‘battery’ of individual differences assessments as part of an experimental protocol to understand how cognitive abilities vary across participants. Below we provide the self-report questionnaires that were administered at the time of testing for this study’s participants.
Self-report questionnaires examined for the current study
-
Autism Spectrum Quotient (ASQ; Baron-Cohen et al. 2001)
-
Attention deficit hyperactivity disorder (ADHD; Jasper and Goldberg 1993)
-
Video game playing questionnaire (designed in laboratory)
Questionnaires administered to participants but not examined for the current study
-
Race/Ethnicity
-
Society Works Best (Smith et al. 2011)
-
Language Experience and Proficiency Questionnaire (LEAPQ; Marian et al. 2007)
-
General pastimes questionnaire (designed in laboratory)
-
Maximization scale (Schwartz et al. 2002)
-
Eating Attitudes Test (EAT; Garner and Garfinkel 1979)
-
Media Multitasking questionnaire (MMI; Ophir et al. 2009), 101 participants
-
Wilson and Patterson (1968)
-
Edinburgh Handedness Inventory (EHI; Oldfield 1971)
-
Positive and Negative Affect Schedule (PANAS; Watson et al. 1988)
-
NEO Personality Inventory (NEO-PI-R; Costa and McCrae 1992)
-
Religious Beliefs (designed in laboratory)
-
Trait Anxiety (Taken from State-Trait Anxiety Inventory; Spielberger et al. 1983)
-
Regulatory Focus (Higgins et al. 2001)
Rights and permissions
About this article
Cite this article
Donohue, S.E., Darling, E.F. & Mitroff, S.R. Links between multisensory processing and autism. Exp Brain Res 222, 377–387 (2012). https://doi.org/10.1007/s00221-012-3223-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00221-012-3223-4