Abstract
Presenting information to multiple sensory modalities sometimes facilitates and sometimes interferes with processing of this information. Research examining interference effects shows that auditory input often interferes with processing of visual input in young children (i.e., auditory dominance effect), whereas visual input often interferes with auditory processing in adults (i.e., visual dominance effect). The current study used a cross-modal statistical learning task to examine modality dominance in adults. Participants ably learned auditory and visual statistics when auditory and visual sequences were presented unimodally and when auditory and visual sequences were correlated during training. However, increasing task demands resulted in an important asymmetry: Increased task demands attenuated visual statistical learning, while having no effect on auditory statistical learning. These findings are consistent with auditory dominance effects reported in young children and have important implications for our understanding of how sensory modalities interact while learning the structure of cross-modal information.
References
(2011). Coexistence of multiple modal dominances. In , Proceedings of the 33rd Annual Conference of the Cognitive Science Society (pp. 2604–2609). Austin, TX: Cognitive Science Society.
(1974). Human sensory dominance. Perception & Psychophysics, 16, 409–412.
(2006). The race model inequality: Interpreting a geometric measure of the amount of violation. Psychological Review, 113, 148–154.
(2005). Modality-constrained statistical learning of tactile, visual, and auditory sequences. Journal of Experimental Psychology: Learning, Memory, and Cognition, 31, 24–39.
(2006). Statistical learning within and between modalities: Pitting abstract against stimulus-specific representations. Psychological Science, 17, 905–912.
(2004). Merging the senses into a robust percept. Trends in Cognitive Sciences, 8, 162–169.
(2002a). Statistical learning of higher-order temporal structure from visual shape-sequences. Journal of Experimental Psychology: Learning, Memory, and Cognition, 28, 458–467.
(2002b). Statistical learning of new visual feature combinations by infants. Proceedings of the National Academy of Sciences, 99, 15822–15826.
(2002). Dynamics of cortico-subcortical cross-modal operations involved in audio-visual object recognition in humans. Cerebral Cortex, 12, 1031–1039.
(1999). Auditory-visual integration during multimodal object recognition in humans: A behavioral and electrophysiological study. Journal of Cognitive Neuroscience, 11, 473–490.
(2000). Infant artificial language learning and language acquisition. Trends in Cognitive Sciences, 4, 178–186.
(2002). Visual statistical learning in infancy: Evidence of a domain general learning mechanism. Cognition, 83, B35–B42.
(2007). Location, location, location: Development of spatiotemporal sequence learning in infancy. Child Development, 78, 1559–1571.
(1982). Divided attention: Evidence for coactivation with redundant signals. Cognitive Psychology, 14, 247–279.
(2004). Multisensory visual-auditory object recognition in humans: A high-density electrical mapping study. Cerebral Cortex, 14, 452–465.
(2010). Repetition blindness and the Colavita effect. Neuroscience Letters, 480, 186–190.
(1976). Visual dominance: An information-processing account of its origins and significance. Psychological Review, 83, 157–171.
(2003). Principles of cross-modal competition: Evidence from deficits of attention. Psychological Bulletin and Review, 10, 210–219.
(2010). Evidence for auditory dominance in a passive oddball task. In , Proceedings of the 32nd Annual Conference of the Cognitive Science Society (pp. 2644–2649). Austin, TX: Cognitive Science Society.
(2012). The role of words in cognitive tasks: What, when, and how? Frontiers in Psychology, 3, 1–8.
(2004). Auditory dominance and its change in the course of development. Child Development, 75, 1387–1401.
(2010a). Development of cross-modal processing. Wiley Interdisciplinary Reviews: Cognitive Science, 1, 135–141.
(2010b). Effects of multimodal presentation and stimulus familiarity on auditory and visual processing. Journal of Experimental Child Psychology, 107, 351–358.
(1996). Statistical learning by 8-month old infants. Science, 274, 1926–1928.
(1999). Statistical learning of tone sequences by adults and infants. Cognition, 70, 27–52.
(1997). Incidental language learning: Listening (and learning) out of the corner of your ear. Psychological Science, 8, 101–105.
(2007). Simultaneous and independent acquisition of multisensory and unisensory associations. Perception, 36, 1445–1453.
(2001). Sensory modalities are not separate modalities: Plasticity and interactions. Current Opinion in Neurobiology, 11, 505–509.
(2008). The co-occurrence of multisensory competition and facilitation. Acta Psychologica, 128, 153–161.
(2007). Visual dominance and attention: Revisiting the Colavita effect. Perception & Psychophysics, 69, 673–686.
(2003). Is a picture worth a thousand words? Preference for auditory modality in young children. Child Development, 74, 822–833.
(2008). The role of words and sounds in visual processing: From overshadowing to attentional tuning. Cognitive Science, 32, 354–377.
(2009). Explaining the Colavita visual dominance effect. Progress in Brain Research, 176, 245–258.
(2005). Speech segmentation by statistical learning depends on attention. Cognition, 97, B25–B34.
(2005). The automaticity of visual statistical learning. Journal of Experimental Psychology: General, 134, 552–564.
(1980). Immediate perceptual response to intersensory discrepancy. Psychological Bulletin, 88, 638–667.
