Abstract
In two experiments, we studied the temporal dynamics of feature integration with auditory (Experiment 1) and audiovisual (Experiment 2) stimuli and manual responses. Consistent with previous observations, performance was better when the second of two consecutive stimuli shared all or none of the features of the first, rather than when only one of the features overlapped. Comparable partial-overlap costs were obtained for combinations of stimulus features and responses. These effects decreased systematically with increasing time between the two stimulus-and-response events, and the decreased rate was comparable for unimodal and multimodal bindings. General effect size reflected the degree of task relevance of the dimension or modality of the respective feature, but the effects of relevance and of temporal delay did not interact. This suggests that the processing of stimuli on task-relevant sensory modalities and feature dimensions is facilitated by task-specific attentional sets, whereas the temporal dynamics might reflect that bindings “decay” or become more difficult to access over time.
Article PDF
Similar content being viewed by others
References
Akyürek, E. G., Toffanin, P., & Hommel, B. (2008). Adaptive control of event integration. Journal of Experimental Psychology: Human Perception & Performance, 34, 569–577. doi:10.1037/0096-1523.34.3.569
Allport, D. A., Tipper, S. P., & Chmiel, N. R. J. (1985). Perceptual integration and postcategorical filtering. In M. I. Posner & O. S. M. Marin (Eds.), Attention & performance XI (pp. 107–132). Hillsdale, NJ: Erlbaum.
Alvarez, G. A., & Thompson, T. W. (2009). Overwriting and rebinding: Why feature-switch detecting tasks underestimate the binding capacity of visual working memory. Visual Cognition, 17, 141–159. doi:10.1080/13506280802265496
Bertelson, P. (1963). S-R relationships and reaction times to new versus repeated signals in a serial task. Journal of Experimental Psychology, 65, 478–484.
Bertelson, P., Vroomen, J., de Gelder, B., & Driver, J. (2000). The ventriloquist effect does not depend on the direction of deliberate visual attention. Perception & Psychophysics, 62, 321–332.
Burke, L. (1952). On the tunnel effect. Quarterly Journal of Experimental Psychology, 4, 121–138.
Colzato, L. S., Raffone, A., & Hommel, B. (2006). What do we learn from binding features? Evidence for multilevel feature integration. Journal of Experimental Psychology: Human Perception & Performance, 32, 705–716. doi:10.1037/0096-1523.32.3.705
DeSchepper, B., & Treisman, A. [M.] (1996). Visual memory for novel shapes: Implicit coding without attention. Journal of Experimental Psychology: Learning, Memory, & Cognition, 22, 27–47.
Dyson, B. J., & Quinlan, P. T. (2004). Stimulus processing constraints in audition. Journal of Experimental Psychology: Human Perception & Performance, 30, 1117–1131. doi:10.1037/0096-1523.30.6.1117
Einhorn, H. J., & Hogarth, R. M. (1986). Judging probable cause. Psychological Bulletin, 99, 3–19.
Gao, T., & Scholl, B. J. (in press). Are objects required for object-files? Roles of segmentation and spatiotemporal continuity in computing object persistence. Visual Cognition. doi:10.1080/13506280802614966
Goldstein, E. B. (2007). Sensation and perception (7th ed.). Belmont, CA: Thomson Wadsworth.
Gordon, R. D., & Irwin, D. E. (2000). The role of physical and conceptual properties in preserving object continuity. Journal of Experimental Psychology: Learning, Memory, & Cognition, 26, 136–150.
Gruber, H. E., Fink, C. D., & Damm, V. (1957). Effects of experience on perception of causality. Journal of Experimental Psychology, 53, 89–93.
Hall, M. D., Pastore, R. E., Acker, B. E., & Huang, W. (2000). Evidence for auditory feature integration with spatially distributed items. Perception & Psychophysics, 62, 1243–1257.
Hommel, B. (1996). The cognitive representation of action: Automatic integration of perceived action effects. Psychological Research, 59, 176–186. doi:10.1007/BF00425832
Hommel, B. (1998). Event files: Evidence for automatic integration of stimulus-response episodes. Visual Cognition, 5, 183–216. doi:10.1080/713756773
Hommel, B. (2004). Event files: Feature binding in and across perception and action. Trends in Cognitive Sciences, 8, 494–500. doi:10.1016/j.tics.2004.08.007
Hommel, B. (2005). How much attention does an event file need? Journal of Experimental Psychology: Human Perception & Performance, 31, 1067–1082. doi:10.1037/0096-1523.31.5.1067
Hommel, B. (2007). Feature integration across perception and action: Event files affect response choice. Psychological Research, 71, 42–63. doi:10.1007/s00426-005-0035-1
Hommel, B. (2009). Action control according to TEC (theory of event coding). Psychological Research, 73, 512–526. doi:10.1007/s00426-009-0234-2
Hommel, B. (2010). Grounding attention in action control: The intentional control of selection. In B. J. Bruya (Ed.), Effortless attention: A new perspective in the cognitive science of attention and action (pp. 121–140). Cambridge, MA: MIT Press.
Hommel, B., & Colzato, L. S. (2004). Visual attention and the temporal dynamics of feature integration. Visual Cognition, 11, 483–521. doi:10.1080/13506280344000400
Hommel, B., & Colzato, L. S. (2009). When an object is more than a binding of its features: Evidence for two mechanisms of visual feature integration. Visual Cognition, 17, 120–140. doi:10.1080/13506280802349787
Hommel, B., Memelink, J., Zmigrod, S., & Colzato, L. S. (2009). How information of relevant dimension controls the creation and retrieval of feature-response binding. Manuscript submitted for publication.
Hötting, K., & Röder, B. (2004). Hearing cheats touch, but less in congenitally blind than in sighted individuals. Psychological Science, 15, 60–64.
Hyun, J.-S., Woodman, G. F., & Luck, S. J. (2009). The role of attention in the binding of surface features to locations. Visual Cognition, 17, 10–24. doi:10.1080/13506280802113894
Kahneman, D., Treisman, A. [M.], & Gibbs, B. J. (1992). The reviewing of object files: Object-specific integration of information. Cognitive Psychology, 24, 175–219.
Logan, G. D. (1988). Toward an instance theory of automatization. Psychological Review, 95, 492–527.
Luck, S. J., & Hillyard, S. A. (1994). Spatial filtering during visual search: Evidence from human electrophysiology. Journal of Experimental Psychology: Human Perception & Performance, 20, 1000–1014.
Luck, S. J., & Hillyard, S. A. (1995). The role of attention in feature detection and conjunction discrimination: An electrophysiological analysis. International Journal of Neuroscience, 80, 281–297.
Massaro, D. W. (1987). Speech perception by ear and eye: A paradigm for psychological inquiry. Hillsdale, NJ: Erlbaum.
McGurk, H., & MacDonald, J. (1976). Hearing lips and seeing voices. Nature, 264, 746–748.
Mitroff, S. R., & Alvarez, G. A. (2007). Space and time, not surface features, guide object persistence. Psychonomic Bulletin & Review, 14, 1199–1204.
Mitroff, S. R., Arita, J. T., & Fleck, M. S. (2009). Staying in bounds: Contextual constraints on object-file coherence. Visual Cognition, 17, 195–211. doi:10.1080/13506280802103457
Mitroff, S. R., Scholl, B. J., & Wynn, K. (2004). Divide and conquer: How object files adapt when a persisting object splits into two. Psychological Science, 15, 420–425.
Mondor, T. A., Hurlburt, J., & Thorne, L. (2003). Categorizing sounds by pitch: Effects of stimulus similarity and response repetition. Perception & Psychophysics, 65, 107–114.
Mordkoff, J. T., & Halterman, R. (2008). Feature integration without visual attention: Evidence from the correlated flankers task. Psychonomic Bulletin & Review, 15, 385–389. doi:10.3758/PBR.15.2.385
Noles, N. S., Scholl, B. J., & Mitroff, S. R. (2005). The persistence of object file representations. Perception & Psychophysics, 67, 324–334.
Pratt, J., & Hommel, B. (2003). Symbolic control of visual attention: The role of working memory and attentional control settings. Journal of Experimental Psychology: Human Perception & Performance, 29, 835–845. doi:10.1037/0096-1523.29.5.835
Reed, P. (1992). Effect of a signalled delay between an action and outcome on human judgement of causality. Quarterly Journal of Experimental Psychology, 44B, 81–100.
Reed, P. (1999). Role of a stimulus filling an action-outcome delay in human judgments of causal effectiveness. Journal of Experimental Psychology: Animal Behavior Processes, 25, 92–102.
Saiki, J. (2009). Functional roles of memory for feature-location binding in event perception: Investigation with spatiotemporal visual search. Visual Cognition, 17, 212–231. doi:10.1080/13506280802280230
Shams, L., Kamitani, Y., & Shimojo, S. (2000). Illusions: What you see is what you hear. Nature, 408, 788.
Takegata, R., Brattico, E., Tervaniemi, M., Varyagina, O., Näätänen, R., & Winkler, I. (2005). Preattentive representation of feature conjunctions for concurrent spatially distributed auditory objects. Cognitive Brain Research, 25, 169–179. doi:10.1016/j.cogbrainres.2005.05.006
Talsma, D., & Woldorff, M. G. (2005). Selective attention and multisensory integration: Multiple phases of effects on the evoked brain activity. Journal of Cognitive Neuroscience, 17, 1098–1114.
Treisman, A. M., & Gelade, G. (1980). A feature-integration theory of attention. Cognitive Psychology, 12, 97–136.
Treisman, A. [M.], & Sato, S. (1990). Conjunction search revisited. Journal of Experimental Psychology: Human Perception & Performance, 16, 459–478.
Vroomen, J., Bertelson, P., & de Gelder, B. (2001). The ventriloquist effect does not depend on the direction of automatic visual attention. Perception & Psychophysics, 63, 651–659.
Vroomen, J., & de Gelder, B. (2004). Temporal ventriloquism: Sound modulates the flash-lag effect. Journal of Experimental Psychology: Human Perception & Performance, 30, 513–518.
Wessinger, C. M., VanMeter, J., Tian, B., Van Lare, J., Pekar, J., & Rauschecker, J. P. (2001). Hierarchical organization of the human auditory cortex revealed by functional magnetic resonance imaging. Journal of Cognitive Neuroscience, 13, 1–7.
Yi, D.-J., Turk-Browne, N. B., Flombaum, J. I., Kim, M.-S., Scholl, B. J., & Chun, M. M. (2008). Spatiotemporal object continuity in human ventral visual cortex. Proceedings of the National Academy of Sciences, 105, 8840–8845. doi:10.1073/pnas.0802525105
Zeki, S., & Bartels, A. (1999). Toward a theory of visual consciousness. Consciousness & Cognition, 8, 225–259.
Zmigrod, S., & Hommel, B. (2009). Auditory event files: Integrating auditory perception and action planning. Attention, Perception, & Psychophysics, 71, 352–362. doi:10.3758/APP.71.2.352
Zmigrod, S., Spapé, M., & Hommel, B. (2009). Intermodal event files: Integrating features across vision, audition, taction, and action. Psychological Research, 73, 674–684. doi:10.1007/s00426-008-0163-5
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zmigrod, S., Hommel, B. Temporal dynamics of unimodal and multimodal feature binding. Attention, Perception, & Psychophysics 72, 142–152 (2010). https://doi.org/10.3758/APP.72.1.142
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/APP.72.1.142