Abstract
Previous research showed that the eyes revisit the location in which the stimulus has been encoded when visual or verbal information is retrieved from memory. A recent study showed that this behavior still occurs 1 week after encoding, suggesting that visual, spatial and linguistic information is tightly associated with the oculomotor trace and stored as an integrated memory representation. However, it is yet unclear whether looking behavior simply remains stable between encoding and recall or whether it changes over time in a more fine-tuned manner. Here, we investigate the time course of looking behavior during recall in multiple sessions across 1 week. Participants encoded visual objects presented in one of the four locations on the computer screen. In five sessions during the week after encoding, they performed on a visual memory recall task. During retrieval, participants looked back to the encoding location, but only in the recall sessions within 1 day of encoding. We discuss different explanations for the temporal dynamics of looking behavior during recall, searching for the role of eye movements in memory.
References
Altmann GTM (2004) Language-mediated eye movements in the absence of a visual world: the “blank screen paradigm”. Cognition 93(2):B79–B87. doi:10.1016/j.cognition.2004.02.005
Bochynska A, Laeng B (2015) Tracking down the path of memory: eye scanpaths facilitate retrieval of visuospatial information. Cogn Process 16(1):159–163. doi:10.1007/s10339-015-0690-0
Bourlon C, Oliviero B, Wattiez N, Pouget P, Bartolomeo P (2011) Visual mental imagery: what the head“s eye tells the mind”s eye. Brain Res 1367:287–297. doi:10.1016/j.brainres.2010.10.039
Brodeur MB, Dionne-Dostie E, Montreuil T, Lepage M (2010) The Bank of Standardized Stimuli (BOSS), a new set of 480 normative photos of objects to be used as visual stimuli in cognitive research. PLoS One 5(5):e10773. doi:10.1371/journal.pone.0010773
Erdelyi MH (2010) The ups and downs of memory. Am Psychol 65:623–633. doi:10.1037/a0020440
Erdelyi MH, Becker J (1974) Hypermnesia for pictures: incremental memory for pictures but not words in multiple recall trials. Cogn Psychol 6(1):159–171. doi:10.1016/0010-0285(74)90008-5
Ferreira F, Apel J, Henderson JM (2008) Taking a new look at looking at nothing. Trends Cogn Sci 12(11):405–410. doi:10.1016/j.tics.2008.07.007
Hoover MA, Richardson DC (2008) When facts go down the rabbit hole: contrasting features and objecthood as indexes to memory. Cognition 108(2):533–542. doi:10.1016/j.cognition.2008.02.011
Humphrey K, Underwood G (2008) Fixation sequences in imagery and in recognition during the processing of pictures of real-world scenes. J Eye Mov Res 2(2):1–15
Johansson R, Johansson M (2014) Look here, eye movements play a functional role in memory retrieval. Psychol Sci 25(1):236–242. doi:10.1177/0956797613498260
Johansson R, Holsanova J, Holmqvist K (2006) Pictures and spoken descriptions elicit similar eye movements during mental imagery, both in light and in complete darkness. Cogn Sci 30(6):1053–1079. doi:10.1207/s15516709cog0000_86
Johansson R, Holsanova J, Holmqvist K (2011) The dispersion of eye movements during visual imagery is related to individual differences in spatial imagery ability, 1200–1205. In: Carlson L, Hölscher C, Shipley TF (eds) Expanding the space of cognitive science: proceedings of the 33rd annual meeting of the Cognitive Science Society. Cognitive Science Society, Austin, TX, pp 1200–1205
Johansson R, Holsanova J, Dewhurst R, Holmqvist K (2012) Eye movements during scene recollection have a functional role, but they are not reinstatements of those produced during encoding. J Exp Psychol Hum Percept Perform 38(5):1289–1314. doi:10.1037/a0026585
Laeng B, Teodorescu D-S (2002) Eye scanpaths during visual imagery reenact those of perception of the same visual scene. Cogn Sci 26(2):207–231. doi:10.1016/S0364-0213(01)00065-9
Laeng B, Bloem IM, D’Ascenzo S, Tommasi L (2014) Scrutinizing visual images: the role of gaze in mental imagery and memory. Cognition. doi:10.1016/j.cognition.2014.01.003
Martarelli CS, Mast FW (2011) Preschool children’s eye-movements during pictorial recall. Br J Dev Psychol 29(3):425–436. doi:10.1348/026151010X495844
Martarelli CS, Mast FW (2013) Eye movements during long-term pictorial recall. Psychol Res 77(3):303–309. doi:10.1007/s00426-012-0439-7
Mast FW, Kosslyn SM (2002) Eye movements during visual mental imagery. Trends Cogn Sci 6(7):271–272. doi:10.1016/S1364-6613(02)01931-9
Müri RM, Hess CW, Meienberg O (1991) Transcranial stimulation of the human frontal eye field by magnetic pulses. Exp Brain Res 86(1):219–223. doi:10.1007/BF00231057
Nyffeler T, Wurtz P, Lüscher H-R, Hess CW, Senn W, Pflugshaupt T et al (2006a) Repetitive TMS over the human oculomotor cortex: comparison of 1-Hz and theta burst stimulation. Neurosci Lett 409(1):57–60. doi:10.1016/j.neulet.2006.09.011
Nyffeler T, Wurtz P, Pflugshaupt T, von Wartburg R, Lüthi M, Hess CW et al (2006b) One-Hertz transcranial magnetic stimulation over the frontal eye field induces lasting inhibition of saccade triggering. NeuroReport 17(3):273–275. doi:10.1097/01.wnr.0000199468.39659.bf
Olsen RK, Chiew M, Buchsbaum BR, Ryan JD (2014) The relationship between delay period eye movements and visuospatial memory. J Vis 14(1):8. doi:10.1167/14.1.8
Richardson DC, Kirkham NZ (2004) Multimodal Events and moving locations: eye movements of adults and 6-month-olds reveal dynamic spatial indexing. J Exp Psychol Gen 133(1):46–62. doi:10.1037/0096-3445.133.1.46
Richardson DC, Spivey MJ (2000) Representation, space and Hollywood Squares: looking at things that aren’t there anymore. Cognition 76(3):269–295. doi:10.1016/S0010-0277(00)00084-6
Richardson DC, Altmann GTM, Spivey MJ, Hoover MA (2009) Much ado about eye movements to nothing: a response to Ferreira et al.: Taking a new look at looking at nothing. Trends Cogn Sci 13(6):235–236. doi:10.1016/j.tics.2009.02.006
Scholz A, Melhorn K, Bocklisch F, Krems JF (2011) Looking at nothing diminishes with practice. In: Carlson L, Hölscher C, Shipley T (eds) Proceedings of the 33rd annual meeting of the Cognitive Science Society. Cognitive Science Society, Austin, TX, pp 1070–1075
Scholz A, Mehlhorn K, Krems JF (in press) Listen up, eye movements play a role in verbal memory retrieval. Psychol Res. doi:10.1007/s00426-014-0639-4
Siegelbaum SA, Kandel ER (2013) Prefrontal cortex, hippocampus, and the biology of explicit memory storage. In: Kandel ER, Schwartz JH, Jessell TM, Siegelbaum SA, Hudspeth AJ (eds) Principles of neural science, 5th edn. McGraw-Hill, New York, NY
Spivey MJ, Geng JJ (2001) Oculomotor mechanisms activated by imagery and memory: eye movements to absent objects. Psychol Res 65(4):235–241. doi:10.1007/s004260100059
Spivey M, Tyler M, Richardson D, Young E (2000) Eye movements during comprehension of spoken scene descriptions. In: Gleitman LR, Joshi AK (eds) Proceedings of the 22nd annual conference of the Cognitive Science Society. Erlbaum, Mahwah, NJ, pp 487–492
Acknowledgments
We would like to thank Corina Schöne and Markus Lauber for helping with data collection.
Author information
Authors and Affiliations
Corresponding author
Additional information
Handling Editor: Bruno Laeng, University of Oslo.
Reviewers: Valerio Santangelo, University of Perugia; Agata Bochynska, Norwegian University of Science and Technology.
Appendix
Appendix
See Table 2.
Rights and permissions
About this article
Cite this article
Wantz, A.L., Martarelli, C.S. & Mast, F.W. When looking back to nothing goes back to nothing. Cogn Process 17, 105–114 (2016). https://doi.org/10.1007/s10339-015-0741-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10339-015-0741-6