Abstract
The research reported in the present article investigates whether information is represented the same way in both visual mental imagery and the early phases of visual perception. In Experiment 1, the same participants scanned over patterns of dots in a mental image (with images based on a just-seen pattern), during perception, and in an iconic image. The time to scan increasing distances increased at comparable rates in the three tasks. However, in Experiment 2, when mental images were created from information stored in long-term memory, participants scanned more slowly in the mental image condition. Nevertheless, the rates of scanning in the perceptual tasks were highly correlated with the rates of scanning in the imagery tasks in both experiments. The results provide evidence that mental images and perceived stimuli are represented similarly and can be processed in the same way.
Article PDF
Similar content being viewed by others
References
Avons, S. E., & Phillips, W. A. (1980). Visualization and memorization as a function of display time and poststimulus processing time. Journal of Experimental Psychology: Human Learning & Memory, 6, 407–420.
Bahill, A. T., & Stark, L. (1979). The trajectories of saccadic eye movements. Scientific American, 240, 108–117.
Basso, A., Bisiach, E., &Luzzatti, C. (1980). Loss of mental imagery: A case study. Neuropsychologia, 18, 435–442.
Becker, M. W., Pashler, H., & Anstis, S.M. (2000). The role of iconic memory in change-detection tasks. Perception, 29, 273–286.
Beech, J. R. (1980). Imaginal vs. perceptual scanning of a visual representation. Perceptual & Motor Skills, 50, 367–370.
Behrmann, M., Winocur, G., & Moscovitch, M. (1992). Dissociation between mental imagery and object recognition in a brain-damaged patient. Nature, 359, 636–637.
Bisiach, E., & Luzzatti, C. (1978). Unilateral neglect of representational space. Cortex, 14, 129–133.
Bodis-Wollner, I., Bucher, S. F., & Seelos, K. C. (1999). Cortical activation patterns during voluntary blinks and voluntary saccades. Neurology, 53, 1800–1805.
Borst, G., Kosslyn, S. M., & Denis, M. (2006). Different cognitive processes in two image-scanning paradigms. Memory & Cognition, 34, 475–490.
Brandt, S. A., & Stark, L. W. (1997). Spontaneous eye movements during visual imagery reflect the content of the visual scene. Journal of Cognitive Neuroscience, 9, 27–38.
Coltheart, M. (1983). Iconic memory. Philosophical Transactions of the Royal Society B, 302, 283–294.
Craver-Lemley, C., & Reeves, A. (1987). Visual imagery selectively reduces vernier acuity. Perception, 16, 599–614.
Craver-Lemley, C., & Reeves, A. (1992). How visual imagery interferes with vision. Psychological Review, 99, 633–649.
Denis, M. (1991). Image and cognition (M. Denis & C. Greenbaum, Trans.). New York: Harvester.
Denis, M., & Cocude, M. (1989). Scanning visual images generated from verbal descriptions. European Journal of Cognitive Psychology, 1, 293–307.
Denis, M., & Kosslyn, S. M. (1999). Scanning visual mental images: A window on the mind. Current Psychology of Cognition, 18, 409–465.
Dror, I. E., & Kosslyn, S. M. (1994). Mental imagery and aging. Psychology & Aging, 9, 90–102.
Duysens, J., Orban, G. A., Cremieux, J., & Maes, H. (1985). Visual cortical correlates of visible persistence. Vision Research, 25, 171–178.
Engel, G. R. (1970). An investigation of visual responses to brief stereoscopic stimuli. Quarterly Journal of Experimental Psychology, 22, 148–166.
Enns, J. T., & Di Lollo, V. (2000). What’s new in visual masking? Trends in Cognitive Sciences, 4, 345–352.
Epstein, R., & Kanwisher, N. (1998). A cortical representation of the local visual environment. Nature, 392, 598–601.
Farah, M. J. (1984). The neurological basis of mental imagery: A componential analysis. Cognition, 18, 245–272.
Farah, M. J., Levine, D. N., & Calvanio, R. (1988). A case study of mental imagery deficit. Brain & Cognition, 8, 147–164.
Felleman, D. J., & Van Essen, D. C. (1991). Distributed hierarchical processing in the primate cerebral cortex. Cerebral Cortex, 1, 1–47.
Finke, R. A. (1985). Theories relating mental imagery to perception. Psychological Bulletin, 98, 236–259.
Finke, R. A., & Pinker, S. (1982). Spontaneous imagery scanning in mental extrapolation. Journal of Experimental Psychology: Learning, Memory, & Cognition, 8, 142–147.
Finke, R. A., & Pinker, S. (1983). Directional scanning of remembered visual patterns. Journal of Experimental Psychology: Learning, Memory, & Cognition, 9, 398–410.
Fisher, R. A. (1921). On the probable error of a coefficient of correlation deduced from a small sample. Metron, 1, 3–32.
Francis, G. (1996). Cortical dynamics of visual persistence and temporal integration. Perception & Psychophysics, 58, 1203–1212.
Fuchs, A. F. (1976). The neurophysiology of saccades. In R. A. Monty & J. W. Senders (Eds.), Eye movements and psychological processes (pp. 39–53). Hillsdale, NJ: Erlbaum.
Ganis, G., Schendan, H. E., & Kosslyn, S. M. (2007). Neuroimaging evidence for object model verification theory: Role of prefrontal control in visual object categorization. NeuroImage, 34, 384–398.
Ganis, G., Thompson, W. L., & Kosslyn, S. M. (2004). Brain areas underlying visual mental imagery and visual perception: An fMRI study. Cognitive Brain Research, 20, 226–241.
Gegenfurtner, K. R., & Sperling, G. (1993). Information transfer in iconic memory experiments. Journal of Experimental Psychology: Human Perception & Performance, 19, 845–866.
Ghaëm, O., Mellet, E., Crivello, F., Tzourio, N., Mazoyer, B., Berthoz, A., & Denis, M. (1997). Mental navigation along memorized routes activates the hippocampus, precuneus, and insula. NeuroReport, 8, 739–744.
Guariglia, C., Padovani, A., Pantano, P., & Pizzamiglio, L. (1993). Unilateral neglect restricted to visual imagery. Nature, 364, 235–237.
Hari, R., Salmelin, R., Tissari, S. O., Kajola, M., & Virsu, V. (1994). Visual stability during eyeblinks. Nature, 367, 121–122.
Intons-Peterson, M. J. (1983). Imagery paradigms: How vulnerable are they to experimenters’ expectations? Journal of Experimental Psychology: Human Perception & Performance, 9, 394–412.
Ishai, A., Ungerleider, L. G., Martin, A., & Haxby, J. V. (2000). The representation of objects in the human occipital and temporal cortex. Journal of Cognitive Neuroscience, 12, 35–51.
Jolicoeur, P., & Kosslyn, S. M. (1985). Is time to scan visual images due to demand characteristics? Memory & Cognition, 13, 320–332.
Kelley, T. A., Serences, J. T., Giesbrecht, B., & Yantis, S. (2008). Cortical mechanisms for shifting and holding visuospatial attention. Cerebral Cortex, 18, 114–125.
Kosslyn, S. M. (1973). Scanning visual images: Some structural implications. Perception & Psychophysics, 14, 90–94.
Kosslyn, S. M. (1980). Image and mind. Cambridge, MA: Harvard University Press.
Kosslyn, S. M. (1994). Image and brain: The resolution of the imagery debate. Cambridge, MA: MIT Press.
Kosslyn, S. M., Ball, T. M., & Reiser, B. J. (1978). Visual images preserve metric spatial information: Evidence from studies of image scanning. Journal of Experimental Psychology: Human Perception & Performance, 4, 47–60.
Kosslyn, S. M., & Schwartz, S. P. (1977). A simulation of visual imagery. Cognitive Science, 1, 265–295.
Kosslyn, S. M., & Thompson, W. L. (2003). When is early visual cortex activated during visual mental imagery? Psychological Bulletin, 129, 723–746.
Kosslyn, S. M., Thompson, W. L., & Alpert, N. M. (1997). Neural systems shared by visual imagery and visual perception: A positron emission tomography study. NeuroImage, 6, 320–334.
Kosslyn, S. M., Thompson, W. L., & Ganis, G. (2006). The case for mental imagery. New York: Oxford University Press.
Laeng, B., & Teodorescu, D.-S. (2002). Eye scanpaths during visual imagery reenact those of perception of the same visual scene. Cognitive Science, 26, 207–231.
Mast, F. W., & Kosslyn, S. M. (2002). Eye movements during visual mental imagery. Trends in Cognitive Sciences, 6, 271–272.
Mellet, E., Briscogne, S., Tzourio-Mazoyer, N., Ghaëm, O., Petit, L., Zago, L., et al. (2000). Neural correlates of topographic mental exploration: The impact of route versus survey perspective learning. NeuroImage, 12, 588–600.
Mellet, E., Tzourio, N., Denis, M., & Mazoyer, B. (1995). A posi tron emission tomography study of visual and mental spatial exploration. Journal of Cognitive Neuroscience, 7, 433–445.
Nobre, A. C., Sebestyen, G. N., Gitelman, D. R., Mesulam, M. M., Frackowiak, R. S., & Frith, C. D. (1997). Functional localization of the system for visuospatial attention using positron emission tomography. Brain, 120, 515–533.
Paivio, A. (1986). Mental representations: A dual coding approach. New York: Oxford University Press.
Perky, C. W. (1910). An experimental study of imagination. American Journal of Psychology, 21, 422–452.
Pinker, S. (1980). Mental imagery and the third dimension. Journal of Experimental Psychology: General, 109, 354–371.
Pinker, S., Choate, P. A., & Finke, R. A. (1984). Mental extrapolation in patterns constructed from memory. Memory & Cognition, 12, 207–218.
Posner, M. I., Nissen, M. J., & Ogden, W. C. (1978). Attended and unattended processing modes: The role of set for spatial location. In H. L. Pick, Jr., & E. Saltzman (Eds.), Modes of perceiving and processing information (pp. 137–157). Hillsdale, NJ: Erlbaum.
Posner, M. I., Walker, J. A., Friedrich, F. J., & Rafal, R. D. (1984). Effects of parietal injury on covert orienting of attention. Journal of Neuroscience, 4, 1863–1874.
Posner, M. I., Walker, J. A., Friedrich, F. J., & Rafal, R. D. (1987). How do the parietal lobes direct covert attention? Neuropsychologia, 25, 135–145.
Pylyshyn, Z. W. (1973). What the mind’s eye tells the mind’s brain: A critique of mental imagery. Psychological Bulletin, 80, 1–24.
Pylyshyn, Z. W. (1981). The imagery debate: Analogue media versus tacit knowledge. Psychological Review, 88, 16–45.
Pylyshyn, Z. W. (2002). Mental imagery: In search of a theory. Behavioral & Brain Sciences, 25, 157–238.
Pylyshyn, Z. [W.] (2003). Return of the mental image: Are there really pictures in the brain? Trends in Cognitive Sciences, 7, 113–118.
Rayner, K. (1998). Eye movements in reading and information processing: 20 years of research. Psychological Bulletin, 124, 372–422.
Segal, S. J., & Fusella, V. (1970). Influence of imaged pictures and sounds on detection of visual and auditory signals. Journal of Experimental Psychology, 83, 458–464.
Sereno, M. I., Pitzalis, S., & Martinez, A. (2001). Mapping of contralateral space in retinotopic coordinates by a parietal cortical area in humans. Science, 294, 1350–1354.
Shepard, R. N., & Cooper, L. A. (1982). Mental images and their transformations. Cambridge, MA: MIT Press.
Spearman, C. (1907). Demonstration of formulae for true measurement of correlation. American Journal of Psychology, 18, 161–169.
Sperling, G. (1960). The information available in brief visual presentation. Psychological Monographs: General & Applied, 74 (11, Whole No. 498), 1–29.
Steiger, J. H. (1980). Tests for comparing elements of a correlation matrix. Psychological Bulletin, 87, 245–251.
Supèr, H., Spekreijse, H., & Lamme, V. A. F. (2001). A neural correlate of working memory in the monkey primary visual cortex. Science, 293, 120–124.
Tootell, R. B., Silverman, M. S., Switkes, E., & De Valois, R. L. (1982). Deoxyglucose analysis of retinotopic organization in primate striate cortex. Science, 218, 902–904.
Wede, J., & Francis, G. (2006). The time course of visual afterimages: Data and theory. Perception, 35, 1155–1170.
Wilimzig, C., Schneider, S., & Schöner, G. (2006). The time course of saccadic decision making: Dynamic field theory. Neural Networks, 19, 1059–1074.
Williams, E. J. (1959). The comparison of regression variables. Journal of the Royal Statistical Society, Series B, 21, 396–399.
Author information
Authors and Affiliations
Corresponding author
Additional information
This research was supported by the National Institutes of Health, Grant 2 R01 MH060734; any opinions, findings, conclusions, or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of NIH.
Rights and permissions
About this article
Cite this article
Borst, G., Kosslyn, S.M. Visual mental imagery and visual perception: Structural equivalence revealed by scanning processes. Memory & Cognition 36, 849–862 (2008). https://doi.org/10.3758/MC.36.4.849
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/MC.36.4.849