Abstract
Investigations of situations involving spatial discordance between auditory and visual data which can otherwise be attributed to a common origin have revealed two main phenomena:cross-modal bias andperceptual fusion (or ventriloquism). The focus of the present study is the relationship between these two. The question asked was whether bias occurred only with fusion, as is predicted by some accounts of reactions to discordance, among them those based on cuesubstitution. The approach consisted of having subjects, on each trial, both point to signals in one modality in the presence of conflicting signals in the other modality and produce same-different origin judgments. To avoid the confounding of immediate effects with cumulative adaptation, which was allowed in most previous studies, the direction and amplitude of discordance was varied randomly from trial to trial. Experiment 1, which was a pilot study, showed that both visual bias of auditory localization and auditory bias of visual localization can be observed under such conditions. Experiment 2, which addressed the main question, used a method which controls for the selection involved in separating fusion from no-fusion trials and showed that the attraction of auditory localization by conflicting visual inputs occurs even when fusion is not reported. This result is inconsistent with purely postperceptual views of cross-modal interactions. The question could not be answered for auditory bias of visual localization, which, although significant, was very small in Experiment 1 and fell below significance under the conditions of Experiment 2.
Article PDF
Similar content being viewed by others
Reference Note
Radeau, M., & Bertelson, P.Auditory-visual intermodal bias and temporal relations between signals. Manuscript in preparation.
References
Bermant, R. I., &Welch, R. B. The effect of degree of visual-auditory stimulus separation and eye position upon the spatial interaction of vision and audition.Perceptual and Motor Skills, 1976,43, 487–493.
Bertelson, P., &Radeau, M. Ventriloquism, sensory interaction, and response bias: Remarks on the paper by Choe, Welch, Gilford, and Juola.Perception & Psychophysics, 1976,19, 531–535.
Canon, L. K. Intermodality inconsistency of input and directed attention as determinants of the nature of adaptation.Journal of Experimental Psychology, 1970,84, 141–147.
Choe, C. S., Welch, R. B., Gilford, R. M., &Juola, J. F. The “ventriloquist effect”: Visual dominance or response bias?Perception & Psychophysics, 1975,18, 55–60.
Faverge, J. M.Méthodes statistiques en psychologie appliquée (Vol. 2). Paris: Presses Universitaires de France, 1972.
Howard, I. P., &Templeton, W. B.Human spatial orientation. New York: Wiley, 1966.
Jack, C. E., &Thurlow, W. R. Effects of degree of visual association and angle of displacement on the “ventriloquism” effect.Perceptual and Motor Skills, 1973,37, 967–979.
Jackson, C. V. Visual factors in auditory localization.Quarterly Journal of Experimental Psychology, 1953,5, 52–65.
Kaufman, L.Sight and mind. New York: Oxford University Press, 1974.
Kelso, J. A. S., Cook, E., Olson, M. E., &Epstein, W. Allocation of attention and the locus of adaptation to displaced vision.Journal of Experimental Psychology: Human Perception and Performance, 1975,1, 237–245.
Klemm, O. Lokalisation von Sinneseindrücken bei disparaten Nebenreizen.Psychologische Studien (Wundt), 1909,5, 73–161.
Pick, H. L., Jr.,Warren, D. H., &Hay, J. C. Sensory conflict in judgments of spatial direction.Perception & Psychophysics, 1969,6, 203–205.
Radeau, M. Adaptation au déplacement prismatique sur la base d’une discordance entre la vision et l’audition.L’Année Psychologique, 1974,74, 23–34.
Radeau, M., &Bertelson, P. The effect of a textured visual field on modality dominance in a ventriloquism situation.Perception & Psychophysics, 1976,20, 227–235.
Radeau, M., &Bertelson, P. Adaptation to auditory-visual discordance and ventriloquism in semirealistic situations.Perception & Psychophysics, 1977,22, 137–146.
Stratton, G. M. Vision without inversion of the retinal image.Psychological Review, 1897,4, 341–360, 463–481.
Thomas, G. J. Experimental study of the influence of vision on sound localization.Journal of Experimental Psychology, 1941,28, 167–177.
Thurlow, W. R., &Jack, C. E. Certain determinants of the “ventriloquism effect.”Perception and Motor Skills, 1973,36, 1171–1184.
Warren, D. H. Spatial localization under conflict conditions: Is there a single explanation?Perception, 1979,8, 323–337.
Weerts, T. C., &Thurlow, W. R. The effect of eye position and expectation on sound localization.Perception & Psychophysics, 1971,9, 35–39.
Witkin, H. A., Wapner, S., &Leventhal, T. Sound localization with conflicting visual and auditory cues.Journal of Experimental Psychology, 1952,43, 58–67.
Author information
Authors and Affiliations
Additional information
This research was supported by the Belgian Fonds de la Recherche Fondamentale Collective under Contract 2.4505.80 with P. Bertelson and M. Wajskop. M. Radeau is Chercheur Qualifié of the Belgian Fonds National de la Recherche Scientifique.
An erratum to this article is available at http://dx.doi.org/10.3758/BF03214277.
Rights and permissions
About this article
Cite this article
Bertelson, P., Radeau, M. Cross-modal bias and perceptual fusion with auditory-visual spatial discordance. Perception & Psychophysics 29, 578–584 (1981). https://doi.org/10.3758/BF03207374
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03207374