Skip to main content
SpringerLink
Log in

Text and Picture Integration in Comprehending and Memorizing Spatial Descriptions

  • Chapter
Book cover Understanding Multimedia Documents

Abstract

Spatial processes are involved both in subjects' perception and motion in real-life environments, and in the comprehension of texts with spatial contents. Two experiments examined the effectiveness of pictures in supporting the comprehension of spatial text. Undergraduate students listened to the description of a town while either viewing an integrated picture, partial pictures of some landmarks, or no picture at all. Integrated pictures resulted in better comprehension especially in participants with a lower spatial working memory capacity. It is concluded that integrated pictures help low spatial ability individuals comprehend spatial relations that are explicit in the text. Integrated pictures also help any listener draw inferences about other, non specified spatial relations.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 159.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Baddeley, A. D. (1986). Working Memory. Oxford: Oxford University Press.

    Google Scholar 

  • Baddeley, A. D., & Hitch, G. (1974). Working memory. In G. A. Bower (Ed.), Recent advances in learning and motivation (Vol. 8). New York: Academic Press.

    Google Scholar 

  • Baguley, T., & Payne, S. (2000). Long-term memory for spatial and temporal mental models includes construction processes and model structure. Quarterly Journal of Experimental Psychology: Human Experimental Psychology, 53A, 479–512.

    Article  Google Scholar 

  • Bosco, A., Filomena, S., Sardone, L., Scalisi, T. G., & Longoni, A. M. (1996). Spatial models derived from verbal descriptions of fictitious environments: The influence of study time and the individual differences in visuospatial ability. Psychologische-Beitrage, 38, 451–464.

    Google Scholar 

  • Bower, G. H., & Morrow, D. G. (1990). Mental models in narrative comprehension. Science, 247, 44–48.

    Article  Google Scholar 

  • Brooks, L. R. (1967). The suppression of visualization by reading. Quarterly Journal of Experimental Psychology, 19, 289–299.

    Article  Google Scholar 

  • Bryant, D. J. (1997). Representing space in language and perception. Mind and Language, 12, 239–264.

    Article  Google Scholar 

  • Conte, A., Cornoldi, C., Pazzaglia, F., & Sanavio, S. (1995). Lo sviluppo della memoria di lavoro visuospaziale e il suo ruolo nella memoria spaziale./The development of the visuo-spatial working memory and its role in spatial memory. Ricerche di Psicologia, 19, 95–114.

    Google Scholar 

  • Cornoldi , C., Rizzo , A., & Pra Baldi , A. (1991). Prove avanzate di comprensione della lettura./Reading comprehension advanced tests. Firenze: Organizzazioni Speciali.

    Google Scholar 

  • Cornoldi, C., & Vecchi, T. (2003). Visuo-spatial working memory and individual differences. Philadelphia, PA: Psychology Press.

    Google Scholar 

  • Daniel, M. P., & Denis, M. (1998). Spatial descriptions as navigational aids: A cognitive analysis of route directions. Kognitionswisssenchaft, 7, 45–52.

    Article  Google Scholar 

  • De Beni, R., Pazzaglia, F., Gyselinck, V., & Meneghetti, C. (2005). Visuo-spatial working memory and mental representation of spatial descriptions. European Journal of Cognitive Psychology, 17, 77–95.

    Article  Google Scholar 

  • Devlin , A. N. (2001). Mind and maze: Spatial cognition and environmental behavior. Westport, CT: Praeger Publishers/Greenwood Publishing Group, Inc.

    Google Scholar 

  • van Dijk, T. A., & Kintsch, W. (1983). Strategies of discourse comprehension. New York: Academic Press.

    Google Scholar 

  • Farmer, E. W., Berman, J. V. F., & Fletcher, Y. L. (1986). Evidence for a visuo-spatial scratchpad in working memory. The Quarterly Journal of Experimental Psychology, 38A, 675–688.

    Google Scholar 

  • Ferguson, E. L., & Hegarty, M. (1994). Properties of cognitive maps constructed from texts. Memory and Cognition, 22, 455–473.

    Google Scholar 

  • Franklin, N., & Tversky, B. (1990). Searching imagined environments. Journal of Experimental Psychology: General, 119, 63–76.

    Article  Google Scholar 

  • Franklin, N., Tversky, B., & Coon, V. (1992). Switching points of view in spatial mental models. Memory and Cognition, 20, 507–518.

    Article  Google Scholar 

  • Glenberg, A. M., & Langston, W. E. (1992). Comprehension of illustrated texts: Picture help to build models. Journal of Memory and Language, 31, 129–151.

    Article  Google Scholar 

  • Gyselinck, V., & Tardieu, H. (1999). The role of illustration in text comprehension: what, when, for whom and why? In H. van Oostendorp & S. Goldman (Eds.), The construction of mental representations during reading (pp. 195–218). Mahvah, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Hannus, M., & Hyona, J. (1999). Utilization of illustrations during learning of science textbook passages among low and high-ability children. Contemporary Educational Psychology, 24, 95–113.

    Article  Google Scholar 

  • Johnson-Laird, P. (1983). Mental models. Cambridge, MA: The MIT Press.

    Google Scholar 

  • Kirasic, K. C. (2000). Age differences in adults' spatial abilities, learning environmental layout, and wayfinding behavior. Spatial Cognition and Computation, 2, 117–134.

    Article  Google Scholar 

  • Lee, P. U., & Tversky, B. (2005). Interplay Between Visual and Spatial: The Effect of Landmark Descriptions on Comprehension of Route/Survey Spatial Descriptions. Spatial Cognition and Computation, 5, 163–185.

    Article  Google Scholar 

  • Levelt, W. J. M. (1989). Speaking: From intention to articulation. Cambridge, MA: The MIT Press.

    Google Scholar 

  • Levie, W. H., & Lentz, R. (1982). Effects of text illustration: A review of research. Educational Communication of Technology Journal, 30, 195–232.

    Google Scholar 

  • Linn, M. C., & Petersen, A. C. (1985). “Emergence and characterization of sex differences in spatial ability: A meta-analysis” Child Development, 56, 1479–1498.

    Article  Google Scholar 

  • Logie, R. H. (1995). Visual-spatial working memory. Hillsdale, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Maki, R. H., & Marek, M. N. (1997). Egocentric spatial framework effects from single and multiple points of view. Memory and Cognition, 25, 677–690.

    Article  Google Scholar 

  • Mani, K., & Johnson-Laird, P. (1982). The mental representation of spatial descriptions. Memory and Cognition, 10, 181–187.

    Article  Google Scholar 

  • Miyake, A., & Shah, P. (1999). Emerging general consensus, unresolved theoretical issues, and future research directions. In A. Miyake & P. Shah (Eds.). Models of working memory: Mechanisms of active maintenance and executive control. New York, NY, US: Cambridge University Press (pp. 1–27).

    Google Scholar 

  • Morrow, D. G., Bower, G. H., & Greenspan, S. L. (1989). Updating situation models during narrative comprehension. Journal of Memory and Language, 28, 292–312.

    Article  Google Scholar 

  • Morrow, D. G., Greenspan, S. L., & Bower, G. H. (1987). Accessibility and situation models in narrative comprehension. Journal of Memory and Language, 26, 165–187.

    Article  Google Scholar 

  • Nieding, G., & Ohler, P.(1999). Der Einfluss von Protagonisten Zielstrukturen auf raeumliche mentale Modelle beim narrativen Textverstehen von Kindern./The effect of protagonists' movements on spatial mental models in narrative text comprehension by children. Sprache and Kognition, 18, 146–158

    Article  Google Scholar 

  • Paivio, A. (1978). Comparisons of mental clocks. Journal of Experimental Psychology: Human Perception and Performance, 4, 61–71.

    Article  Google Scholar 

  • Pazzaglia, F. (2000). Tipologie di descrizione di ambienti in funzione delle caratteristiche ambientali, individuali, e di familiarità con i luoghi. (Typology of environmental descriptions in function of environmental, individual, and familiarity characteristics of place). Giornale Italiano di Psicologia, 27, 133–159.

    Google Scholar 

  • Pazzaglia, F., & Cornoldi, C. (1999). The role of distinct components of visuo-spatial working memory in the processing of texts. Memory, 7, 19–41.

    Article  Google Scholar 

  • Pazzaglia, F., Cornoldi, C., & Longoni, A. (1994). Limiti di memoria e specificità di rappresentazione nel ricordo di descrizioni spaziali “dall’alto” o “entro il percorso”. (Limits of memory and the specificity of representations in the memory of survey and route descriptions). Giornale Italiano di Psicologia, 21, 267–286.

    Google Scholar 

  • Pazzaglia, F., & De Beni, R. (2001). Strategies of processing spatial information in survey and landmark-centred individuals. European Journal of Cognitive Psychology, 13, 493–508.

    Google Scholar 

  • Pazzaglia , F., De Beni , R., & Meneghetti , C. (2006). The effects of verbal and spatial interference in the encoding and retrieval of spatial and nonspatial texts, Psychological Research, Feb 16; [Epub ahead of print; DOI: 10.1007/s00426-006-0045-7].

    Google Scholar 

  • Perrig, W., & Kintsch, W. (1985). Prepositional and situational representations of text. Journal of Memory and Language, 24, 503–518.

    Article  Google Scholar 

  • Taylor, H. A., & Tversky, B. (1992). Spatial mental models derived from survey and route descriptions. Journal of Memory and Language, 31, 261–292.

    Article  Google Scholar 

  • Thurstone, L. L., & Thurstone, T. G. (1947). Primary mental abilities. New York: Psychological Corporation.

    Google Scholar 

  • Tversky, B. (1991). Spatial mental models. In. G. H. Bower (Ed.), The psychology of learning and motivation: Advances in research and theory (pp. 109–145). San Diego, CA: Academic Press.

    Google Scholar 

  • Tversky, B. (2003). Structures of mental spaces: How people think about space. Environment and Behavior, 35, 66–80.

    Article  Google Scholar 

  • Tversky, B., & Lee, P. U. (1999a). Pictorial and verbal tools for conveying routes. In C. Freksa & D. M. Mark (Eds.), Spatial Information Theory. Cognitive and computational foundations of geographic information science: International Conference COSIT’99 (pp. 51–64). Heidelberg: Springer-Verlag.

    Chapter  Google Scholar 

  • Tversky, B. & Lee, P. U. (1999b). Why do speakers mix perspectives? Spatial Cognition and Computation, 1, 399–412.

    Article  Google Scholar 

  • Vanderberg, S. G., & Kuse, A. R. (1978). Mental rotations: A group test of three-dimensional spatial visualization. Perceptual and Motor Skills, 47, 599–604.

    Google Scholar 

  • Vandierendonck, A., & De Vooght, G. (1997). Working memory constraints on linear reasoning with spatial and temporal contents. The Quarterly Journal of Experimental Psychology, 50A, 803–820.

    Google Scholar 

  • de Vega, M. (1994). Characters and their perspectives in narratives describing spatial environments. Psychological-Research/Psychologische-Forschung, 56, 116–126.

    Article  Google Scholar 

  • de Vega, M., Cocude, M., Denis, M., Rodrigo, M. J., & Zimmer, H. D. (2001). The interface between language and visuo-spatial representation. In M. Denis, R. H. Logie, C. Cornoldi, M. de Vega, & J. Engelkamp (Eds.), Imagery, Language and Visuo-Spatial Thinking (pp. 109–136). Hove, East Sussex: Psychology Press Ltd.

    Google Scholar 

  • Wechsler, D. (1981). Wechsler Adult Intelligence Scale-Revised. New York: Psychological Corporation.

    Google Scholar 

Download references

Acknowledgments

The author wishes to thank Sabina Scattola and Francesca Zanardi for collecting data of the two experiments.

Author information

Authors and Affiliations

  1. Universitá Degli Studi di Padova, Dipartimento di Psicologia Generale “Vittorio Benussi”, Via Venezia 8, 35131 Padova, Italy

    Francesca Pazzaglia

Authors
  1. Francesca Pazzaglia
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Francesca Pazzaglia .

Editor information

Editors and Affiliations

  1. University of Poitiers, France

    Jean-François Rouet

  2. Curtin University, Perth, WA, Australia

    Richard Lowe

  3. University of Landau, Germany

    Wolfgang Schnotz

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer Science+Business Media, LLC

About this chapter

Cite this chapter

Pazzaglia, F. (2008). Text and Picture Integration in Comprehending and Memorizing Spatial Descriptions. In: Rouet, JF., Lowe, R., Schnotz, W. (eds) Understanding Multimedia Documents. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-73337-1_3

Download citation

Publish with us

Policies and ethics

Search

Navigation