Top

Gepubliceerd in:

01-05-2007 | Original Article

Spatial updating in virtual reality: the sufficiency of visual information

Auteurs: Bernhard E. Riecke, Douglas W. Cunningham, Heinrich H. Bülthoff

Gepubliceerd in: Psychological Research | Uitgave 3/2007

Abstract

Robust and effortless spatial orientation critically relies on “automatic and obligatory spatial updating”, a largely automatized and reflex-like process that transforms our mental egocentric representation of the immediate surroundings during ego-motions. A rapid pointing paradigm was used to assess automatic/obligatory spatial updating after visually displayed upright rotations with or without concomitant physical rotations using a motion platform. Visual stimuli displaying a natural, subject-known scene proved sufficient for enabling automatic and obligatory spatial updating, irrespective of concurrent physical motions. This challenges the prevailing notion that visual cues alone are insufficient for enabling such spatial updating of rotations, and that vestibular/proprioceptive cues are both required and sufficient. Displaying optic flow devoid of landmarks during the motion and pointing phase was insufficient for enabling automatic spatial updating, but could not be entirely ignored either. Interestingly, additional physical motion cues hardly improved performance, and were insufficient for affording automatic spatial updating. The results are discussed in the context of the mental transformation hypothesis and the sensorimotor interference hypothesis, which associates difficulties in imagined perspective switches to interference between the sensorimotor and cognitive (to-be-imagined) perspective.

vorige artikel Biased representations of the spatial structure of navigable environments

volgende artikel Human non-visual discrimination of gradual turning is poor

Gender is known to correlate, under certain circumstances, with spatial abilities like imagined perspective changes and spatial updating of path layouts (Mou et al., 2004; Sholl & Bartels, 2002). Studies using a methodology comparable to the current study did, however, not show any gender effects. Hence, the female bias in the current participant population does not seem critical. Moreover, only withinsubject analyzes were used in the current study.

Avraamides, M. N., & Ioannidou, L. M. (2005). Locating targets from imagined perspectives: Labeling vs. pointing. In Proceedings of the XXVII Annual Meeting of the Cognitive Science Society, Stresa, Italy (pp. 175–180). Mahwah: Lawrence Erlbaum.

Batschelet, E. (1981). Circular statistics in biology. London: Academic.

Boer, L. C. (1991). Mental rotation in perspective problems. Acta Psychologica, 76(1), 1–9.PubMedCrossRef

Bremmer, F., & Lappe, M. (1999). The use of optical velocities for distance discrimination and reproduction during visually simulated self motion. Experimental Brain Research, 127(1), 33–42.CrossRef

Brockmole, J. R., & Wang, R. X. F. (2003). Changing perspective within and across environments. Cognition, 87(2), B59–B67.PubMedCrossRef

Chance, S. S., Gaunet, F., Beall, A. C., & Loomis, J. M. (1998). Locomotion mode affects the updating of objects encountered during travel: The contribution of vestibular and proprioceptive inputs to path integration. Presence Teleoperators and Virtual Environments, 7(2), 168–178.CrossRef

Christou, C., & Bülthoff, H. (1999). The perception of spatial layout in a virtual world (Tech. Rep. No. 75). Max-Planck-Institut für biologische Kybernetik. (Available: http://www.kyb.mpg.de/publication.html?publ=1540).

Christou, C., Tjan, B., & Bülthoff, H. (1999). Viewpoint information provided by familiar environment facilitates object identification (Tech. Rep. No. 68). Max-Planck-Institut für biologische Kybernetik. (Available: http://www.kyb.mpg.de/publication.html?publ=1536).

Christou, C. G., Tjan, B. S., & Bülthoff, H. H. (2003). Extrinsic cues aid shape recognition from novel viewpoints. Journal of Vision, 3, 183–198. (http://www.journalofvision.org/3/3/1).

Cooper, L. A., & Shepard, R. N. (1973). Time required to prepare for a rotated stimulus. Memory & Cognition, 1(3), 246–250.

de Vega, M., & Rodrigo, M. J. (2001). Updating spatial layouts mediated by pointing and labelling under physical and imaginary rotation. European Journal of Cognitive Psychology, 13(3), 369–393.

Dichgans, J., & Brandt, T. (1978). Visual vestibular interaction: Effects on self-motion perception and postural control. In R. Held, H. W. Leibowitz, & H.L. Teuber (Eds.), Perception (vol. VIII, pp. 756–804). Berlin Heidelberg New York: Springer.

Diwadkar, V. A., & McNamara, T. P. (1997). Viewpoint dependence in scene recognition. Psychological Science, 8(4), 302–307.CrossRef

Easton, R. D., & Sholl, M. J. (1995). Object-array structure, frames of reference, and retrieval of spatial knowledge. Journal of Experimental Psychology. Learning, Memory and Cognition, 21(2), 483–500.CrossRef

Farrell, M. J., & Robertson, I. H. (1998). Mental rotation and the automatic updating of bodycentered spatial relationships. Journal of Experimental Psychology. Learning, Memory and Cognition, 24(1), 227–233.CrossRef

Farrell, M. J., & Robertson, I. H. (2000). The automatic updating of egocentric spatial relationships and its impairment due to right posterior cortical lesions. Neuropsychologia, 38(5), 585–595.PubMedCrossRef

Farrell, M. J., & Thomson, J. A. (1998). Automatic spatial updating during locomotion without vision. Quarterly Journal of Experimental Psychology Section A Human Experimental Psychology, 51(3), 637–654.

Hettinger, L. J. (2002). Illusory self-motion in virtual environments. In K. M. Stanney (Ed.), Handbook of virtual environments (pp. 471–492). Hillsdale: Lawrence Erlbaum.

Hintzman, D. L., O’Dell, C. S., & Arndt, D. R. (1981). Orientation in cognitive maps. Cognitive Psychology, 13(2), 149–206.PubMedCrossRef

Hirtle, S. C., & Jonides, J. (1985). Evidence of hierarchies in cognitive maps. Memory & Cognition, 13(3), 208–217.

Holmes, M. C., & Sholl, M. J. (2005). Allocentric coding of object-to-object relations in overlearned and novel environments. Journal of Experimental Psychology. Learning. Memory and Cognition, 31(5), 1069–1087.CrossRef

Ivanenko, Y. P., Viaud-Delmon, I., Siegler, I., Israël, I., & Berthoz, A. (1998). The vestibulo-ocular reflex and angular displacement perception in darkness in humans: adaptation to a virtual environment. Neuroscience Letters, 241(2–3), 167–170.PubMed

Klatzky, R. L., Loomis, J. M., Beall, A. C., Chance, S. S., & Golledge, R. G. (1998). Spatial updating of self-position and orientation during real, imagined, and virtual locomotion. Psychology Science, 9(4), 293–298.CrossRef

Loomis, J. M., & Beall, A. C. (1998). Visually controlled locomotion: Its dependence on optic flow, three-dimensional space perception, and cognition. Ecological Psychology, 10(3–4), 271–285.CrossRef

Loomis, J. M., Da Silva, J. A., Philbeck, J. W., & Fukusima, S. S. (1996). Visual perception of location and distance. Current Directions in Psychological Science, 5(3), 72–77.CrossRef

May, M. (1996). Cognitive and embodied modes of spatial imagery. Psychologische Beiträge, 38(3/4), 418–434.

May, M. (2000). Kognition im Umraum [cognition in spatial surroundings]. Wiesbaden: DUV: Kognitionswissenschaft.

May, M. (2001). Mechanismen räumlicher Perspektivwechsel [mechanisms of spatial perspective switches]. In R. K. Silbereisen & M. Reitzle (Eds.), Psychologie 2000 (pp. 627–634). Lengerich: Pabst.

May, M. (2004). Imaginal perspective switches in remembered environments: Transformation versus interference accounts. Cognitive Psychology, 48(2), 163–206.PubMedCrossRef

May, M., & Klatzky, R. L. (2000). Path integration while ignoring irrelevant movement. Journal of Experimental Psychology. Learning, Memory and Cognition, 26(1), 169–186.CrossRef

McNamara, T. P. (1986). Mental representations of spatial relations. Cognitive Psychology, 18(1), 87–121.PubMedCrossRef

Mou, W. M., McNamara, T. P., Valiquette, C. M., & Rump, B. (2004). Allocentric and egocentric updating of spatial memories. Journal of Experimental Psychology. Learning, Memory and Cognition, 30(1), 142–157.CrossRef

Presson, C. C., & Montello, D. R. (1994). Updating after rotational and translational body movements: Coordinate structure of perspective space. Perception, 23(12), 1447–1455.PubMedCrossRef

Riecke, B. E., & von der Heyde, M. (2002). Qualitative modeling of spatial orientation processes using logical propositions: Interconnecting spatial presence, spatial updating, piloting, and spatial cognition (Tech. Rep. No. 100). MPI for Biological Cybernetics (Avaliable: http://www.kyb.mpg.de/publication.html?publ=2021).

Riecke, B. E., von der Heyde, M., & Bülthoff, H. H. (2001). How real is virtual reality really? Comparing spatial updating using pointing tasks in real and virtual environments. Journal of Vision, 1(3), 321a (http://www.journalofvision.org/1/3/321/).

Riecke, B. E., van Veen, H. A. H. C., & Bülthoff, H. H. (2002). Visual homing is possible without landmarks: A path integration study in virtual reality. Presence Teleoperators and Virtual Environments, 11(5), 443–473.CrossRef

Riecke, B. E., von der Heyde, M., & Bülthoff, H. H. (2004). Spatial updating in real and virtual environments contribution and interaction of visual and vestibular cues. In ACM SIGGRAPH Symposium on Applied Perception in Graphics and Visualization (APGV) (pp. 9–17). Los Angeles, USA. (Available: http://www.kyb.mpg.de/publication.html?publ=2764).

Riecke, B. E., Schulte-Pelkum, J., & Bülthoff, H. H. (2005a). Perceiving simulated ego-motions in virtual reality comparing large screen displays with HMDs. In B. E. Rogowitz, T. N. Pappas, & S. J. Daly (Eds.), SPIE invited paper on VALVE: Vision, action, and locomotion in virtual (and real) environments (pp. 344–355). San Jose, CA, USA.

Riecke, B. E., Schulte-Pelkum, J., Caniard, F., & Bülthoff, H. H. (2005b). Towards lean and elegant self-motion simulation in virtual reality. In Proceedings of IEEE VR2005 (pp. 131–138). Bonn, Germany.

Riecke, B. E., Västfjäll, D., Larsson, P., & Schulte-Pelkum, J. (2005c). Topdown and multimodal influences on self-motion perception in virtual reality. In Proceedings of HCI International 2005. Las Vegas, NV, USA.

Riecke, B. E., von der Heyde, M., & Bülthoff, H. H. (2005d). Visual cues can be sufficient for triggering automatic, reflex-like spatial updating. ACM Transactions on Applied Perception (TAP), 2(3), 183–215.CrossRef

Riecke, B. E., Schulte-Pelkum, J., & Caniard, F. (2006). Using the perceptually oriented approach to optimize spatial presence & egomotion simulation. In Handbook of Presence. Hillsdale: Lawrence Erlbaum (submitted).

Rieser, J. J. (1989). Access to knowledge of spatial structure at novel points of observation. Journal of Experimental Psychology. Learning, Memory and Cognition, 15(6), 1157–1165.CrossRef

Roskos-Ewoldsen, B., McNamara, T. P., Shelton, A. L., & Carr, W. (1998). Mental representations of large and small spatial layouts are orientation dependent. Journal of Experimental Psychology. Learning, Memory and Cognition, 24(1), 215–226.CrossRef

Schulte-Pelkum, J., Riecke, B. E., Caniard, F., & Bülthoff, H. H. (2006). Influence of brief physical accelerations and vibrations on visually induced linear vection (manuscript in preparation).

Shepard, R. N., & Metzler, J. (1971). Mental rotation of 3-dimensional objects. Science, 171(3972), 701–703.PubMedCrossRef

Sholl, M. J., & Bartels, G. P. (2002). The role of self-to-object updating in orientation-free performance on spatial memory tasks. Journal of Experimental Psychology Learning. Memory and Cognition, 28(3), 422–436.CrossRef

Sholl, M. J., & Nolin, T. L. (1997). Orientation specificity in representations of place. Journal of Experimental Psychology.Learning, Memory and Cognition, 23(6), 1494–1507.CrossRef

Simons, D. J., & Wang, R. F. (1998). Perceiving real-world viewpoint changes. Psychological Science, 9(4), 315–320.CrossRef

Simons, D. J., Wang, R. X. F., & Roddenberry, D. (2002). Object recognition is mediated by extra-retinal information. Perception & Psychophysics, 64(4), 521–530.

Stevens, A., & Coupe, P. (1978). Distortions in judged spatial relations. Cognitive Psychology, 10, 422–437.PubMedCrossRef

Waller, D., Montello, D. R., Richardson, A. E., & Hegarty, M. (2002). Orientation specificity and spatial updating of memories for layouts. Journal of Experimental Psychology. Learning, Memory and Cognition, 28(6), 1051–1063.CrossRef

Wang, R. F. (1999). Representing a stable environment by egocentric updating and invariant representations. Spatial Cognition and Computation, 1, 431–445.CrossRef

Wang, R. F. (2005). Beyond imagination: Perspective change problems revisited. Psicologica, 26(1), 25–38.

Wang, R. F., & Spelke, E. S. (2002). Human spatial representation: Insights from animals. Trends in Cognitive Sciences, 6(9), 376–382.PubMedCrossRef

Wang, R. X. F., & Brockmole, J. R. (2003). Human navigation in nested environments. Journal of Experimental Psychology. Learning, Memory and Cognition, 29(3), 398–404.CrossRef

Wang, R. X. F., & Simons, D. J. (1999). Active and passive scene recognition across views. Cognition, 70(2), 191–210.PubMedCrossRef

Wang, R. X. F., & Spelke, E. S. (2000). Updating egocentric representations in human navigation. Cognition, 77(3), 215–250.PubMedCrossRef

Warren, R., & Wertheim, A. H. (Eds.) (1990). Perception & control of self-motion. New Jersey, London: Erlbaum.

Warren, W. H., Kay, B. A., Zosh, W. D., Duchon, A. P., & Sahuc, S. (2001). Optic flow is used to control human walking. Nature Neuroscience, 4(2), 213–216.PubMedCrossRef

Wong, S. C. P., & Frost, B. J. (1981). The effect of visual-vestibular conflict on the latency of steadystate visually induced subjective rotation. Perception & Psychophysics, 30(3), 228–236.

Wraga, M. (2003). Thinking outside the body: An advantage for spatial updating during imagined versus physical self-rotation. Journal of Experimental Psychology. Learning, Memory and Cognition, 29(5), 993–1005.CrossRef

Wraga, M., Creem, S. H., & Proffitt, D. R. (2000). Updating displays after imagined object and viewer rotations. Journal of Experimental Psychology. Learning, Memory and Cognition, 26(1), 151–168.CrossRef

Wraga, M., Creem-Regehr, S. H., & Proffitt, D. R. (2004). Spatial updating of virtual displays during self and display rotation. Memory & Cognition, 32(3), 399–415.

Yardley, L., & Higgins, M. (1998). Spatial updating during rotation: The role of vestibular information and mental activity. Journal of Vestibular Research. Equilibrium and Orientation, 8(6), 435–442.

Titel: Spatial updating in virtual reality: the sufficiency of visual information
Auteurs: Bernhard E. Riecke
Douglas W. Cunningham
Heinrich H. Bülthoff
Publicatiedatum: 01-05-2007
Uitgeverij: Springer-Verlag
Gepubliceerd in: Psychological Research / Uitgave 3/2007
Print ISSN: 0340-0727
Elektronisch ISSN: 1430-2772
DOI: https://doi.org/10.1007/s00426-006-0085-z

Bohn Stafleu van Loghum

Deel dit onderdeel of sectie (kopieer de link)

Abstract

Log in om toegang te krijgen

Andere artikelen Uitgave 3/2007

Using geometry to specify location: implications for spatial coding in children and nonhuman animals

Humans do not switch between path knowledge and landmarks when learning a new environment

Wayfinding with words: spatial learning and navigation using dynamically updated verbal descriptions

Updating representations of learned scenes

Human non-visual discrimination of gradual turning is poor

Perspectives on human spatial cognition: memory, navigation, and environmental learning