Top

Gepubliceerd in:

31-01-2022 | Original Article

Beyond motion extrapolation: vestibular contribution to head-rotation-induced flash-lag effects

Auteurs: Xin He, Jianying Bai, Yi Jiang, Tao Zhang, Min Bao

Gepubliceerd in: Psychological Research | Uitgave 7/2022

Abstract

The perceived position of a flash aligned with a moving object usually lags behind that object. This illusion is well known as the flash-lag effect. Interestingly, head rotation alone can also induce a flash-lag effect. To date, the underlying mechanism for the head-rotation-induced flash-lag effect remains unclear. Using a virtual reality approach, we examined the contribution of vestibular signal processing in producing the effect. We found that vestibular, rather than kinesthetic, signal processing is critical for this type of flash-lag effect to occur. When head rotation induced a stationary reference stimulus in space to move on the retina, we observed a flash-lead effect relative to the reference (or a flash-lag effect relative to the head). Moreover, after a short-term adaptation training on a novel association between head rotation and retinal motion, the direction of the flash-lag effect was consistent with the newly trained association. These findings disagree with a previous account extended from the influential motion extrapolation hypothesis. Rather, they support a cross-modal bias hypothesis that the visual-vestibular associations developed from multisensory experiences may generate biasing visual signals in the associated direction with the vestibular signals, which help produce the head-rotation-induced flash-lag effects. Our findings may provide new insight into other multisensory integration phenomena.

vorige artikel The visual size of graspable objects is needed to induce the potentiation of grasping behaviors even with verbal stimuli

volgende artikel Multisensory integration of musical emotion perception in singing

Alleen toegankelijk voor geautoriseerde gebruikers

Readers may notice that the sign of PSA for the flash-lag effect (FLE) in the RM condition was opposite to those in the other conditions. Actually, it was challenging to devise a totally consistent sign of PSA for all the conditions in Experiments 1 and 2 because they did not have a common reference for FLE: in the HM condition of Experiment 1 there was only head movement but no retinal motion while in the RM condition of the Experiment 2 there was only retinal motion but no head movement, and in the HMRM condition existed both types of motion. Moreover, the retinal motion direction was opposite to the head-movement direction in the HMRM condition. So, we chose the head (or body) movement direction as the reference of FLE for conditions HM, BM, TM, HMRM, and TMRM, and exceptionally the retinal motion direction as reference for the RM condition. That was why the sign of PSA for FLE in the RM condition was opposite to those in the other 5 conditions.

Alais, D., & Burr, D. (2003). The “flash-lag” effect occurs in audition and cross-modally. Current Biology, 13(1), 59–63. https://doi.org/10.1016/S0960-9822(02)01402-1CrossRefPubMed

Angelaki, D. E., & Cullen, K. E. (2008). Vestibular system: The many facets of a multimodal sense. Annual Review of Neuroscience, 31(1), 125–150. https://doi.org/10.1146/annurev.neuro.31.060407.125555CrossRefPubMed

Arnold, D. H., Ong, Y., & Roseboom, W. (2009). Simple differential latencies modulate, but do not cause the flash-lag effect. Journal of Vision, 9(5), 4–4. https://doi.org/10.1167/9.5.4CrossRefPubMed

Bai, J., Bao, M., Zhang, T., & Jiang, Y. (2019). A virtual reality approach identifies flexible inhibition of motion aftereffects induced by head rotation. Behavior Research Methods, 51(1), 96–107. https://doi.org/10.3758/s13428-018-1116-6CrossRefPubMed

Bai, J., He, X., Jiang, Y., Zhang, T., & Bao, M. (2020). Rotating one’s head modulates the perceived velocity of motion aftereffect. Multisensory Research, 33(2), 189–212. https://doi.org/10.1163/22134808-20191477CrossRefPubMed

Baldo, M. V. C., & Klein, S. A. (1995). Extrapolation or attention shift? Nature, 378(6557), 565–566. https://doi.org/10.1038/378565a0CrossRefPubMed

Berger, D. R., & Bülthoff, H. H. (2009). The role of attention on the integration of visual and inertial cues. Experimental Brain Research, 198(2–3), 287–300. https://doi.org/10.1007/s00221-009-1767-8CrossRefPubMedPubMedCentral

Brainard, D. H. (1997). The psychophysics toolbox. Spatial Vision, 10(4), 433–436. https://doi.org/10.1163/156856897X00357CrossRefPubMed

Brandt, T., Bartenstein, P., Janek, A., & Dieterich, M. (1998). Reciprocal inhibitory visual-vestibular interaction. Visual motion stimulation deactivates the parieto-insular vestibular cortex. Brain, 121(9), 1749–1758. https://doi.org/10.1093/brain/121.9.1749CrossRefPubMed

Cantor, C. R. L., & Schor, C. M. (2007). Stimulus dependence of the flash-lag effect. Vision Research, 47(22), 2841–2854. https://doi.org/10.1016/j.visres.2007.06.023CrossRefPubMedPubMedCentral

Carriere, B. N., Royal, D. W., Perrault, T. J., Morrison, S. P., Vaughan, J. W., Stein, B. E., & Wallace, M. T. (2007). Visual deprivation alters the development of cortical multisensory integration. Journal of Neurophysiology, 98(5), 2858–2867. https://doi.org/10.1152/jn.00587.2007CrossRefPubMed

Cellini, C., Scocchia, L., & Drewing, K. (2016). The buzz-lag effect. Experimental Brain Research, 234(10), 2849–2857. https://doi.org/10.1007/s00221-016-4687-4CrossRefPubMed

Cuturi, L. F., & MacNeilage, P. R. (2014). Optic flow induces nonvisual self-motion aftereffects. Current Biology, 24(23), 2817–2821. https://doi.org/10.1016/j.cub.2014.10.015CrossRefPubMed

Dong, X., Bai, J., & Bao, M. (2017). Robust size illusion produced by expanding and contracting flow fields. Vision Research, 133, 87–94. https://doi.org/10.1016/J.VISRES.2017.01.003CrossRefPubMed

Dong, X., & Bao, M. (2021). The growing sensory suppression on visual perception during head-rotation preparation. PsyCh Journal. https://doi.org/10.1002/pchj.438 Epub ahead of print.CrossRefPubMed

Drewing, K., Hitzel, E., & Scocchia, L. (2018). The haptic and the visual flash-lag effect and the role of flash characteristics. PLoS ONE. https://doi.org/10.1371/journal.pone.0189291CrossRefPubMedPubMedCentral

Eagleman, D. M., & Sejnowski, T. J. (2000a). Motion integration and postdiction in visual awareness. Science, 287(5460), 2036–2038. https://doi.org/10.1126/SCIENCE.287.5460.2036CrossRefPubMed

Eagleman, D. M., & Sejnowski, T. J. (2000b). The position of moving objects. Science, 289(5482), 1107a. https://doi.org/10.1126/science.289.5482.1107aCrossRefPubMed

Faisal, A. A., Selen, L. P. J., & Wolpert, D. M. (2008). Noise in the nervous system. Nature Reviews Neuroscience, 9(4), 292–303. https://doi.org/10.1038/nrn2258CrossRefPubMedPubMedCentral

Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007). G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39(2), 175–191. https://doi.org/10.3758/BF03193146CrossRefPubMed

Frank, S. M., Pawellek, M., Forster, L., Langguth, B., Schecklmann, M., & Greenlee, M. W. (2020). Attention networks in the parietooccipital cortex modulate activity of the human vestibular cortex during attentive visual processing. Journal of Neuroscience, 40(5), 1110–1119. https://doi.org/10.1523/JNEUROSCI.1952-19.2019CrossRefPubMed

Frank, S. M., Sun, L., Forster, L., Tse, P. U., & Greenlee, M. W. (2016a). Cross-modal attention effects in the vestibular cortex during attentive tracking of moving objects. Journal of Neuroscience, 36(50), 12720–12728. https://doi.org/10.1523/JNEUROSCI.2480-16.2016CrossRefPubMed

Frank, S. M., Wirth, A. M., & Greenlee, M. W. (2016b). Visual-vestibular processing in the human Sylvian fissure. Journal of Neurophysiology, 116(2), 263–271. https://doi.org/10.1152/jn.00009.2016CrossRefPubMedPubMedCentral

Gallese, V., Fadiga, L., Fogassi, L., & Rizzolatti, G. (1996). Action recognition in the premotor cortex. Brain, 119(2), 593–609. https://doi.org/10.1093/brain/119.2.593CrossRefPubMed

Hayashi, R., & Murakami, I. (2019). Distinct mechanisms of temporal binding in generalized and cross-modal flash-lag effects. Scientific Reports, 9(1), 1–12. https://doi.org/10.1038/s41598-019-40370-7CrossRef

Hebb, D. O. (1949). The organization of behavior. Wiley.

Hidaka, S., Teramoto, W., Kobayashi, M., & Sugita, Y. (2011). Sound-contingent visual motion aftereffect. BMC Neuroscience, 12(1), 1–6. https://doi.org/10.1186/1471-2202-12-44CrossRef

Hidaka, S., Teramoto, W., & Sugita, Y. (2015). Spatiotemporal processing in crossmodal interactions for perception of the external world: A review. Frontiers in Integrative Neuroscience, 9, 62. https://doi.org/10.3389/fnint.2015.00062CrossRefPubMedPubMedCentral

Hubbard, T. L. (2014). The flash-lag effect and related mislocalizations: Findings, properties, and theories. Psychological Bulletin, 140(1), 308–338. https://doi.org/10.1037/a0032899CrossRefPubMed

Hubbard, T. L. (2018). The Flash-lag Effect. In T. L. Hubbard (Ed.), Spatial biases in perception and cognition. Cambridge University Press. https://doi.org/10.1017/9781316651247CrossRef

Keppel, G. (1991). Design and analysis: A researcher’s handbook (3rd ed.). Prentice-Hall Inc.

Kwon, O.-S., Tadin, D., & Knill, D. C. (2015). Unifying account of visual motion and position perception. Proceedings of the National Academy of Sciences of the United States of America, 112(26), 8142–8147. https://doi.org/10.1073/pnas.1500361112CrossRefPubMedPubMedCentral

Lappe, M., & Krekelberg, B. (1998). The position of moving objects. Perception, 27(12), 1437–1449. https://doi.org/10.1068/p271437CrossRefPubMed

Mackay, D. M. (1958). Perceptual stability of a stroboscopically lit visual field containing self-luminous objects. Nature, 181(4607), 507–508. https://doi.org/10.1038/181507a0CrossRefPubMed

McCollough, C. (1965). Color adaptation of edge-detectors in the human visual system. Science, 149(3688), 1115–1116. https://doi.org/10.1126/SCIENCE.149.3688.1115CrossRefPubMed

Nijhawan, R. (1992). Misalignment of contours through the interaction of apparent and real motion systems. Investigative Ophthalmology & Visual Science, 33(4), 974–974.

Nijhawan, R. (1994). Motion extrapolation in catching. Nature, 370(6487), 256–257. https://doi.org/10.1038/370256b0CrossRefPubMed

Nijhawan, R., & Kirschfeld, K. (2003). Analogous mechanisms compensate for neural delays in the sensory and the motor pathways: Evidence from motor flash-lag. Current Biology, 13(9), 749–753. https://doi.org/10.1016/S0960-9822(03)00248-3CrossRefPubMed

Öǧmen, H., Patel, S. S., Bedell, H. E., & Camuz, K. (2004). Differential latencies and the dynamics of the position computation process for moving targets, assessed with the flash-lag effect. Vision Research, 44(18), 2109–2128. https://doi.org/10.1016/j.visres.2004.04.003CrossRefPubMed

Purushothaman, G., Patel, S. S., Bedell, H. E., & Ogmen, H. (1998). Moving ahead through differential visual latency. Nature, 396(6710), 424–424. https://doi.org/10.1038/24766CrossRefPubMed

Schlag, J., Cai, R. H., Dorfman, A., Mohempour, A., & Schlag-Rey, M. (2000). Extrapolating movement without retinal motion. Nature, 403(6765), 38–39. https://doi.org/10.1038/47402CrossRefPubMed

Shams, L., Kamitani, Y., & Shimojo, S. (2000). What you see is what you hear. Nature, 408(6814), 788. https://doi.org/10.1038/35048669CrossRefPubMed

Sperry, R. W. (1950). Neural basis of the spontaneous optokinetic response produced by visual inversion. Journal of Comparative and Physiological Psychology, 43(6), 482–489. https://doi.org/10.1037/h0055479CrossRefPubMed

Teramoto, W., Kobayashi, M., Hidaka, S., & Sugita, Y. (2011). Crossmodal contingent aftereffect. I-Perception, 2(8), 880–880. https://doi.org/10.1068/IC880CrossRef

von Holst, E., & Mittelstaedt, H. (1950). Das Reafferenzprinzip (Wechselwirkungen zwischen Zentralnervensystem und Peripherie). Naturwissenschaften, 37(20), 464–476. https://doi.org/10.1007/BF00622503CrossRef

Wallace, M. T., Perrault, T. J., Hairston, W. D., & Stein, B. E. (2004). Visual experience is necessary for the development of multisensory integration. Journal of Neuroscience, 24(43), 9580–9584. https://doi.org/10.1523/JNEUROSCI.2535-04.2004CrossRefPubMed

Wallace, M. T., & Stein, B. E. (2007). Early experience determines how the senses will interact. Journal of Neurophysiology, 97(1), 921–926. https://doi.org/10.1152/jn.00497.2006CrossRefPubMed

Whitney, D., & Cavanagh, P. (2000). The position of moving objects. Science, 289(5482), 1107a. https://doi.org/10.1126/science.289.5482.1107aCrossRefPubMed

Whitney, D., & Murakami, I. (1998). Latency difference, not spatial extrapolation. Nature Neuroscience, 1(8), 656–657. https://doi.org/10.1038/3659CrossRefPubMed

Titel: Beyond motion extrapolation: vestibular contribution to head-rotation-induced flash-lag effects
Auteurs: Xin He
Jianying Bai
Yi Jiang
Tao Zhang
Min Bao
Publicatiedatum: 31-01-2022
Uitgeverij: Springer Berlin Heidelberg
Gepubliceerd in: Psychological Research / Uitgave 7/2022
Print ISSN: 0340-0727
Elektronisch ISSN: 1430-2772
DOI: https://doi.org/10.1007/s00426-021-01638-8

Bohn Stafleu van Loghum

Deel dit onderdeel of sectie (kopieer de link)

Abstract

Log in om toegang te krijgen

Andere artikelen Uitgave 7/2022

The impact of stimulus format on task inhibition during task switching

The interplay between unexpected events and behavior in the development of explicit knowledge in implicit sequence learning

On the reliability of behavioral measures of cognitive control: retest reliability of task-inhibition effect, task-preparation effect, Stroop-like interference, and conflict adaptation effect

The effect of strategy game types on inhibition

Sustained visual attention improves visuomotor timing

Preview frequency effects in reading: evidence from Chinese