Abstract
The features of perceived objects are processed in distinct neural pathways, which call for mechanisms that integrate the distributed information into coherent representations (the binding problem). Recent studies of sequential effects have demonstrated feature binding not only in perception, but also across (visual) perception and action planning. We investigated whether comparable effects can be obtained in and across auditory perception and action. The results from two experiments revealed effects indicative of spontaneous integration of auditory features (pitch and loudness, pitch and location), as well as evidence for audio—manual stimulus—response integration. Even though integration takes place spontaneously, features related to task-relevant stimulus or response dimensions are more likely to be integrated. Moreover, integration seems to follow a temporal overlap principle, with features coded close in time being more likely to be bound together. Taken altogether, the findings are consistent with the idea of episodic event files integrating perception and action plans.
Article PDF
Similar content being viewed by others
References
Allport, D. A., Tipper, S. P., & Chmiel, N. R. J. (1985). Perceptual integration and postcategorical filtering. In M. I. Posner & O. S. M. Marin (Eds.), Attention and performance XI (pp. 107–132). Hillsdale, NJ: Erlbaum.
Bangasser. D. A., Waxler, D. E., Santollo, J., & Shors, T. J. (2006). Trace conditioning and the hippocampus: The importance of contiguity. Journal of Neuroscience, 26, 8702–8706. doi:10.1523/ JNEUROSCI.1742-06.2006
Bundesen, C. (1990). A theory of visual attention. Psychological Review, 97, 523–547.
Clement, S., Demany, L., & Semal, C. (1999). Memory for pitch versus memory for loudness. Journal of the Acoustical Society of America, 106, 2805–2811.
Colzato, L. S., van Wouwe, N. C., & Hommel, B. (2007). Feature binding and affect: Emotional modulation of visuomotor integration. Neuropsychologia, 45, 440–446. doi:10.1016/j.neuropsychologia.2006.06.032
Fagioli, S., Hommel, B., & Schubotz, R. I. (2007). Intentional control of attention: Action planning primes action-related stimulus dimensions. Psychological Research, 71, 22–29. doi:10.1007/s00426-005-0033-3
Found, A., & Müller, H. J. (1996). Searching for unknown feature targets on more than one dimension: Investigating a “dimension weighting” account. Perception & Psychophysics, 58, 88–101.
Hall, M. D., Pastore, R. E., Acker, B. E., & Huang, W. (2000). Evidence for auditory feature integration with spatially distributed items. Perception & Psychophysics, 62, 1243–1257.
Hommel, B. (1996). The cognitive representation of action: Automatic integration of perceived action effects. Psychological Research, 59, 176–186. doi:10.1007/BF00425832
Hommel, B. (1998). Event files: Evidences for automatic integration of stimulus—response episodes. Visual Cognition, 5, 183–216. doi:10.1080/713756773
Hommel, B. (2004). Event files: Feature binding in and across perception and action. Trends in Cognitive Sciences, 8, 494–500. doi:10.1016/j.tics.2004.08.007
Hommel, B. (2005). How much attention does an event file need? Journal of Experimental Psychology: Human Perception & Performance, 31, 1067–1082. doi:10.1037/0096-1523.31.5.1067
Hommel, B. (2007). Feature integration across perception and action: Event files affect response choice. Psychological Research, 71, 42–63. doi:10.1007/s00426-005-0035-1
Hommel, B., & Colzato, L. S. (2004). Visual attention and the temporal dynamics of feature integration. Visual Cognition, 11, 483–521. doi:10.1080/13506280344000400
Hommel, B., Müsseler, J., Aschersleben, G., & Prinz, W. (2001). The theory of event coding (TEC): A framework for perception and action planning. Behavioral & Brain Sciences, 24, 849–937.
Kaas, J. H., & Hackett, T. A. (1999). “What” and “where” processing in auditory cortex. Nature Neuroscience, 2, 1045–1047.
Kahneman, D., Treisman, A., & Gibbs, B. J. (1992). The reviewing of object files: Object-specific integration of information. Cognitive Psychology, 24, 175–219.
Leboe, J. P., Mondor, T. A., & Leboe, L. C. (2006). Feature mismatch effects in auditory negative priming: Interference as dependent on salient aspects of prior episodes. Perception & Psychophysics, 68, 897–910.
Lee, C. C., & Winer, J. A. (2005). Principles governing auditory cortex connections. Cerebral Cortex, 15, 1804–1814. doi:10.1093/cercor/ bhi057
Mondor, T. A., Hurlburt, J., & Thorne, L. (2003). Categorizing sounds by pitch: Effects of stimulus similarity and response repetition. Perception & Psychophysics, 65, 107–114.
Mondor, T. A., & Leboe, L. C. (2008). Stimulus and response repetition effects in the detection of sounds: Evidence of obligatory retrieval and use of a prior event. Psychological Research, 72, 183–191. doi:10.1007/s00426-006-0095-x
Neuhoff, J. G., Knight, R., & Wayand, J. (2002). Pitch change, sonification, and musical expertise: Which way is up? In R. Nakatsu & H. Kawahara (Eds.), Proceedings of the 8th International Conference on Auditory Display, Kyoto, Japan.
Neuhoff, J. G., Kramer, G., & Wayand, J. (2002). Pitch and loudness interact in auditory displays: Can the data get lost in the map? Journal of Experimental Psychology: Applied, 8, 17–25. doi:10.1037//1076-898X8.1.17
Pavlov, I. P. (1927). Conditioned reflexes (G. V. Anrep, Trans.). London: Oxford University Press.
Posner, M. I., & Cohen, Y. A. (1984). Components of visual orienting. In: H. Bouma & D. G. Bouwhuis (Eds.), Attention and performance: X. Control of language processes (pp. 531–556). Hillsdale, NJ: Erlbaum.
Schultz, W. (2002). Getting formal with dopamine and reward. Neuron, 36, 241–263.
Takegata, R., Brattico, E., Tervaniemi, M., Varyagina, O., Näätänen, R., & Winkler, I. (2005). Preattentive representation of feature conjunctions for concurrent spatially distributed audition objects. Cognitive Brain Research, 25, 169–179. doi:10.1016/j.cogbrainres.2005.05.006
Treisman A. M. (1990). Variations on the theme of feature integration: Reply to Navon. Psychological Review, 97, 460–463.
Treisman, A. M., & Gelade, G. (1980). A feature-integration theory of attention. Cognitive Psychology, 12, 97–136.
Wessinger, C. M., VanMeter, J., Tian, B., Van Lare, J., Pekar, J., & Rauschecker, J. P. (2001). Hierarchical organization of the human auditory cortex revealed by functional magnetic resonance imaging. Journal of Cognitive Neuroscience, 13, 1–7.
Zeki, S., & Bartels, A. (1999). Toward a theory of visual consciousness. Consciousness & Cognition, 8, 225–259.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zmigrod, S., Hommel, B. Auditory event files: Integrating auditory perception and action planning. Attention, Perception, & Psychophysics 71, 352–362 (2009). https://doi.org/10.3758/APP.71.2.352
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/APP.71.2.352