Abstract
In three experiments, we addressed the issue of attention effects on unattended sound processing when one auditory stream is selected from three potential streams, creating a simple model of the cocktail party situation. We recorded event-related brain potentials (ERPs) to determine the way in which unattended, task-irrelevant sounds were stored in auditory memory (i.e., as one integrated stream or as two distinct streams). Subjects were instructed to ignore all the sounds and attend to a visual task or to selectively attend to a subset of the sounds and perform a task with the sounds (Experiments 1 and 2). A third (behavioral) experiment was conducted to test whether global pattern violations (used in Experiments 1 and 2) were perceptible when the sounds were segregated. We found that the mismatch negativity ERP component, an index of auditory change detection, was evoked by infrequent pattern violations occurring in the unattended sounds when all the sounds were ignored, but not when attention was focused on a subset of the sounds. The results demonstrate that multiple unattended sound streams can segregate by frequency range but that selectively attending to a subset of the sounds can modify the extent to which the unattended sounds are processed. These results are consistent with models in animal and human studies showing that attentional control can limit the processing of unattended input in favor of attended sensory inputs, thereby facilitating the ability to achieve behavioral goals.
Article PDF
Similar content being viewed by others
References
Bey, C., & McAdams, S. (2003). Postrecognition of interleaved melodies as an indirect measure of auditory stream formation. Journal of Experimental Psychology: Human Perception & Performance, 29, 267–279.
Botte, M.-C., Drake, C., Brochard, R., & McAdams, S. (1997). Perceptual attenuation of nonfocused auditory streams. Perception & Psychophysics, 59, 419–425.
Bregman, A. S. (1978). Auditory streaming is cumulative. Journal of Experimental Psychology: Human Perception & Performance, 4, 380–387.
Bregman, A. S. (1990). Auditory scene analysis. Cambridge, MA: MIT Press.
Broadbent, D. E. (1958). Perception and communication. New York: Pergamon.
Brochard, R., Drake, C., Botte, M.-C., & McAdams, S. (1999). Perceptual organization of complex auditory sequences: Effect of number of simultaneous subsequences and frequency separation. Journal of Experimental Psychology: Human Perception & Performance, 25, 1742–1759.
Bushnell, M. C., Goldberg, M. E., & Robinson, D. L. (1981). Behavioral enhancement of visual responses in monkey cerebral cortex: I. Modulation in posterior parietal cortex related to selective visual attention. Journal of Neurophysiology, 46, 755–772.
Carlyon, R. P., Cusack, R., Foxton, J. M., & Robertson, I. H. (2001). Effects of attention and unilateral neglect on auditory stream segregation. Journal of Experimental Psychology: Human Perception & Performance, 27, 115–127.
Cusack, R., Deeks, J., Aikman, G., & Carlyon, R. P. (2004). Effects of location, frequency region, and time course of selective attention on auditory scene analysis. Journal of Experimental Psychology: Human Perception & Performance, 30, 643–656.
Desimone, R. (1998). Visual attention mediated by biased competition in extrastriate visual cortex. Philosophical Transactions of the Royal Society of London, 353, 1245–1255.
Desimone, R., & Duncan, J. (1995). Neural mechanisms of selective visual attention. Annual Review of Neuroscience, 18, 193–222.
Deutsch, J. A., & Deutsch, D. (1963). Attention: Some theoretical considerations. Psychological Review, 70, 80–90.
Duncan, J., & Humphreys, G. (1989). Visual search and stimulus similarity. Psychological Review, 96, 433–458.
Duncan, J., Martens, S., & Ward, R. (1997). Restricted attentional capacity within but not between sensory modalities. Nature, 387, 808–810.
Friedman, D., Cycowicz, Y. M., & Gaeta, H. (2001). The novelty P3: An event-related brain potential (ERP) sign of the brain’s evaluation of novelty. Neuroscience & Biobehavioral Reviews, 25, 355–373.
Fritz, J., Shamma, S., Elhilali, M., & Klein, D. (2003). Rapid taskrelated plasticity of spectrotemporal receptive fields in primary auditory cortex. Nature Neuroscience, 6, 1216–1223.
Green, D. M., & Swets, J. A. (1966). Signal detection theory and psychophysics. New York: Wiley.
Hillyard, S. A., Vogel, E. K., & Luck, S. J. (1998). Sensory gain control (amplification) as a mechanism of selective attention: Electrophysiological and neuroimaging evidence. Philosophical Transactions of the Royal Society of London: Series B, 353, 1257–1270.
Kisley, M. A., Davalos, D. B., Layton, H. S., Pratt, D., Ellis, J. K., & Seger, C. A. (2004). Small changes in temporal deviance modulate mismatch negativity amplitude in humans. Neuroscience Letters, 358, 197–200.
Macmillan, N. A., & Creelman, C. D. (1991). Detection theory: A user’s guide. New York: Cambridge University Press.
Moran, J., & Desimone, R. (1985). Selective attention gates visual processing in the extrastriate cortex. Science, 229, 782–784.
Näätänen, R., Paavilainen, P., Tiitinen, H., Jiang, D., & Alho, K. (1993). Attention and mismatch negativity. Psychophysiology, 30, 436–450.
Näätänen, R., Tervaniemi, M., Sussman, E., Paavilainen, P., & Winkler, I. (2001). “Primitive intelligence” in the auditory cortex. Trends in Neurosciences, 24, 283–288.
Neisser, U. (1967). Cognitive psychology. New York: Appleton-Century-Crofts.
Norman, D. A. (1967). Temporal confusion and limited capacity processors. Acta Psychologica, 27, 293–297.
Picton, D.W., Alain, C., Otten, L., Ritter, W., & Achim, A. (2000). Mismatch negativity: Different water in the same river. Audiology & Neuro-Otology, 5, 111–139.
Ritter, W., Sussman, E., Deacon, D., Cowan, N., & Vaughan, H. G., Jr. (1999). Two cognitive systems simultaneously prepared for opposite events. Psychophysiology, 36, 835–839.
Ritter, W., Sussman, E., & Molholm, S. (2000). Evidence that the mismatch negativity system works on the basis of objects. NeuroReport, 11, 61–63.
Rugg, M. D., & Coles, G. H. (1995). Electrophysiology of mind. Eventrelated brain potentials and cognition (Oxford Psychology Series No. 25). Oxford: Oxford University Press.
Stekelenburg, J. J., Vroomen, J., & de Gelder, B. (2004). Illusory sound shifts induced by the ventriloquist illusion evoke the mismatch negativity. Neuroscience Letters, 357, 163–166.
Sussman, E. (2004). Auditory scene analysis: Examining the role of nonlinguistic auditory processing in speech perception. In P. Divenyi (Ed.), Speech separation by humans and machines (pp. 5–12). New York: Kluwer.
Sussman, E. (2005). Integration and segregation in auditory scene analysis. Journal of the Acoustical Society of America, 117, 1285–1298.
Sussman E.,Čeponienė, R., Shestakova, A., Näätänen, R., & Winkler, I. (2001). Auditory stream segregation processes operate similarly in school-aged children as adults. Hearing Research, 153, 108–114.
Sussman, E., Kujala, T., Halmetoja, J., Lyytinen, H., Alku, P., & Näätänen, R. (2004). Automatic and controlled processing of acoustic and phonetic contrasts. Hearing Research, 190, 128–140.
Sussman, E., Ritter, W., & Vaughan, H. G., Jr. (1998). Attention affects the organization of auditory input associated with the mismatch negativity system. Brain Research, 789, 130–138.
Sussman, E., Ritter, W., & Vaughan, H. G., Jr. (1999). An investigation of the auditory streaming effect using event-related brain potentials. Psychophysiology, 36, 22–34.
Sussman, E., Winkler, I., Huoutilainen, M., Ritter, W., & Näätänen, R. (2002). Top-down effects on the initially stimulus-driven auditory organization. Cognitive Brain Research, 13, 393–405.
Sussman, E., Winkler, I., Kreuzer, J., Saher, M., Näätänen, R., & Ritter, W. (2002). Temporal integration: Intentional sound discrimination does not modify stimulus-driven processes in auditory event synthesis. Clinical Neurophysiology, 113, 909–920.
Sussman, E.,Winkler, I., & Wang, W. J. (2003). MMN and attention: Competition for deviance detection. Psychophysiology, 40, 430–435.
Tiitinen, H., May, P., Reinikainen, K., & Näätänen, R. (1994). Attentive novelty detection in humans is governed by pre-attentive sensory memory. Nature, 372, 90–92.
Treisman, A. (1969). Strategies and models in selective attention. Psychological Review, 76, 242–299.
van Noorden, L. P. A. S. (1975). Temporal coherence in the perception of tone sequences. Unpublished doctoral dissertation, Eindhoven University of Technology.
Winkler, I., Sussman, E., Tervaniemi, M., Ritter, W., Horvath, J., & Näätänen, R. (2003). Pre-attentive auditory context effects. Cognitive, Affective, & Behavioral Neuroscience, 3, 57–77.
Woldorff, M. G., Hackley, S. A., & Hillyard, S. A. (1991). The effects of channel-selective attention on the mismatch negativity wave elicited by deviant tones. Psychophysiology, 28, 30–42.
Woldorff, M. G., Hillyard, S. A., Gallen, C. C., Hampson, S. R., & Bloom, F. E. (1998). Magnetoencephalographic recordings demonstrate attentional modulation of mismatch-related neural activity in human auditory cortex. Psychophysiology, 35, 283–292.
Yabe, H., Winkler, I., Czigler, I., Koyama, S., Kakigi, R., Sutoh, T., Hiruma, T., & Kaneko, S. (2001). Organizing sound sequences in the human brain: The interplay of auditory streaming and temporal integration. Brain Research, 897, 222–227.
Author information
Authors and Affiliations
Corresponding author
Additional information
This research was supported by National Institutes of Health Grant R01 DC 04263 and by the Natural Sciences and Engineering Research Council of Canada. The authors thank Robert Carlyon and an anonymous reviewer for their helpful comments.
Rights and permissions
About this article
Cite this article
Sussman, E.S., Bregman, A.S., Wang, W.J. et al. Attentional modulation of electrophysiological activity in auditory cortex for unattended sounds within multistream auditory environments. Cognitive, Affective, & Behavioral Neuroscience 5, 93–110 (2005). https://doi.org/10.3758/CABN.5.1.93
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/CABN.5.1.93