Abstract
In two experiments with categorized lists, we asked whether the testing effect in free recall is related to enhancements in organizational processing. During a first phase in Experiment 1, subjects studied one list over eight consecutive trials, they studied another list six times while taking two interspersed recall tests, and they learned a third list in four alternating study and test trials. On a test 2 days later, recall was directly related to the number of tests and inversely related to the number of study trials. In addition, increased testing enhanced both the number of categories accessed and the number of items recalled from within those categories. One measure of organization also increased with the number of tests. In a second experiment, different groups of subjects studied a list either once or twice before a final criterial test, or they studied the list once and took an initial recall test before the final test. Prior testing again enhanced recall, relative to studying on the final test a day later, and also improved category clustering. The results suggest that the benefit of testing in free recall learning arises because testing creates retrieval schemas that guide recall.
Article PDF
Similar content being viewed by others
References
Ausubel, D. P. (1963). The psychology of meaningful verbal learning. New York: Grune & Stratton.
Bartlett, F. C. (1932). Remembering: A study in experimental and social psychology. Cambridge: Cambridge University Press.
Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society: Series B, 57, 289–300.
Benjamini, Y., & Yekutieli, D. (2001). The control of the false discovery rate in multiple testing under dependency. Annals of Statistics, 29, 1165–1188.
Bousfield, A. K., & Bousfield, W. A. (1966). Measurement of clustering and sequential constancies in repeated free recall. Psychological Reports, 19, 935–942.
Bousfield, W. A. (1953). The occurrence of clustering in the recall of randomly arranged associates. Journal of General Psychology, 49, 229–240.
Bousfield, W. A., Cohen, B. H., & Whitmarsh, G. A. (1958). Associative clustering in the recall of words of different taxonomic frequencies of occurrence. Psychological Reports, 4, 39–44.
Bousfield, W. A., Puff, C. R., & Cowan, T. M. (1964). The development of constancies in sequential organization during repeated free recall. Journal of Verbal Learning & Verbal Behavior, 3, 489–495.
Bower, G. H., & Springston, F. (1970). Pauses as recoding points in letter series. Journal of Experimental Psychology, 83, 421–430.
Brewer, G. A., Marsh, R. L., Meeks, J. T., Clark-Foos, A., & Hicks, J. L. (2010). The effects of free recall testing on subsequent source memory. Memory, 18, 385–393.
Burns, D. J., & Brown, C. A. (2000). The category access measure of relational processing. Journal of Experimental Psychology: Learning, Memory, & Cognition, 26, 1057–1062.
Butler, A. C. (2010). Repeated testing produces superior transfer of learning relative to repeated studying. Journal of Experimental Psychology: Learning, Memory, & Cognition, 36, 1118–1133.
Butler, A. C., & Roediger, H. L., III (2007). Testing improves long-term retention in a simulated classroom setting. European Journal of Cognitive Psychology, 19, 514–527.
Callender, A. A., & McDaniel, M. A. (2009). The limited benefits of rereading educational texts. Contemporary Educational Psychology, 34, 30–41.
Carrier, M., & Pashler, H. (1992). The influence of retrieval on retention. Memory & Cognition, 20, 633–642.
Chan, J. C. K. (2009). When does retrieval induce forgetting and when does it induce facilitation? Implications for retrieval inhibition, testing effect, and text processing. Journal of Memory & Language, 61, 153–170.
Chan, J. C. K., McDermott, K. B., & Roediger, H. L., III (2006). Retrieval-induced facilitation: Initially nontested material can benefit from prior testing of related material. Journal of Experimental Psychology: General, 135, 553–571.
Cohen, B. H. (1963). Recall of categorized word lists. Journal of Experimental Psychology, 66, 227–234.
Cohen, B. H. (1966). Some ornone characteristics of coding behavior. Journal of Verbal Learning & Verbal Behavior, 5, 182–187.
Daniel, D. B., & Poole, D. A. (2009). Learning for life: An ecological approach to pedagogical research. Perspectives on Psychological Science, 4, 91–96.
Gallo, D. A., & Roediger, H. L., III (2002). Variability among word lists in eliciting memory illusions: Evidence for associative activation and monitoring. Journal of Memory & Language, 47, 469–497.
Gates, A. I. (1917). Recitation as a factor in memorizing. Archives of Psychology, 6, 1–104.
Geller, A. S., Schleifer, I. K., Sederberg, P. B., Jacobs, J., & Kahana, M. J. (2007). PyEPL: A cross-platform experiment-programming library. Behavior Research Methods, 39, 950–958.
Hunt, R. R. (2006). The concept of distinctiveness in memory research. In R. R. Hunt & J. B. Worthen (Eds.), Distinctiveness and memory (pp. 3–25). New York: Oxford University Press.
Hunt, R. R., & McDaniel, M. A. (1993). The enigma of organization and distinctiveness. Journal of Memory & Language, 32, 421–445.
Hunt, R. R., & Seta, C. E. (1984). Category size effects in recall: The roles of relational and individual item information. Journal of Experimental Psychology: Learning, Memory, & Cognition, 10, 454–464.
Izawa, C. (1970). Optimal potentiating effects and forgetting-prevention effects of tests in paired-associate learning. Journal of Experimental Psychology, 83, 340–344.
Johnson, C. I., & Mayer, R. E. (2009). The testing effect with multimedia learning. Journal of Educational Psychology, 101, 621–629.
Kahana, M. J., Howard, M. W., & Polyn, S. M. (2008). Associative processes in episodic memory. In J. Byrne (Series Ed.) & H. L. Roediger III (Vol. Ed.), Learning and memory: A comprehensive reference. Vol. 2: Cognitive psychology of memory (pp. 467–490). Amsterdam: Elsevier.
Kang, S. H. K., McDermott, K. B., & Roediger, H. L., III (2007). Test format and corrective feedback modify the effect of testing on long-term retention. European Journal of Cognitive Psychology, 19, 528–558.
Karpicke, J. D. (2009). Metacognitive control and strategy selection: Deciding to practice retrieval during learning. Journal of Experimental Psychology: General, 138, 469–486.
Karpicke, J. D., & Roediger, H. L., III (2007). Repeated retrieval during learning is the key to long-term retention. Journal of Memory & Language, 57, 151–162.
Karpicke, J. D., & Roediger, H. L., III (2008). The critical importance of retrieval for learning. Science, 319, 966–968.
Karpicke, J. D., & Zaromb, F. M. (2010). Retrieval mode distinguishes the testing effect from the generation effect. Journal of Memory & Language, 62, 227–239.
Katona, G. (1940). Organizing and memorizing. New York: Columbia University Press.
Klein, S. B., Loftus, J., Kihlstrom, J. F., & Aseron, R. (1989). Effects of item-specific and relational information on hypermnesic recall. Journal of Experimental Psychology: Learning, Memory, & Cognition, 15, 1192–1197.
Mandler, G. (1967). Organization and memory. In K. W. Spence & J. T. Spence (Eds.), The psychology of learning and motivation (Vol. 1, pp. 327–372). New York: Academic Press.
Masson, M. E. J., & McDaniel, M. A. (1981). The roles of organizational processes in long-term retention. Journal of Experimental Psychology: Human Learning & Memory, 7, 100–110.
Matthews, T. D., Smith, R. E., Hunt, R. R., & Pivetta, C. E. (1999). Role of distinctive processing during retrieval. Psychological Reports, 84, 904–916.
McDaniel, M. A., Anderson, J. L., Derbish, M. H., & Morrisette, N. (2007). Testing the testing effect in the classroom. European Journal of Cognitive Psychology, 19, 494–513.
McDaniel, M. A., Moore, B. A., & Whiteman, H. L. (1998). Dynamic changes in hypermnesia across early and late tests: A relational/item-specific account. Journal of Experimental Psychology: Learning, Memory, & Cognition, 24, 173–185.
McDaniel, M. A., Roediger, H. L., III, & McDermott, K. B. (2007). Generalizing test-enhanced learning from the laboratory to the classroom. Psychonomic Bulletin & Review, 14, 200–206.
McDaniel, M. A., Waddill, P. J., & Einstein, G. O. (1988). A contextual account of the generation effect: A three-factor theory. Journal of Memory & Language, 27, 521–536.
Miller, G. A. (1956). The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychological Review, 63, 81–97.
Mulligan, N. W. (2001). Generation and hypermnesia. Journal of Experimental Psychology: Learning, Memory, & Cognition, 27, 436–450.
Mulligan, N. W. (2002). The emergence of item-specific encoding effects in between-subjects designs: Perceptual interference and multiple recall tests. Psychonomic Bulletin & Review, 9, 375–382.
Mulligan, N. W. (2005). Total retrieval time and hypermnesia: Investigating the benefits of multiple recall tests. Psychological Research, 69, 272–284.
Mulligan, N. W., & Duke, M. D. (2002). Positive and negative general effects, hypermnesia, and total recall time. Memory & Cognition, 30, 1044–1053.
Murphy, M. D. (1979). Measurement of category clustering in free recall. In C. R. Puff (Ed.), Memory organization and structure (pp. 51–83). New York: Academic Press.
Murphy, M. D., & Puff, C. R. (1982). Free recall: Basic methodology and analyses. In C. R. Puff (Ed.), Handbook of research methods in human memory and cognition (pp. 99–128). New York: Academic Press.
Pashler, H., Rohrer, D., Cepeda, N. J., & Carpenter, S. K. (2007). Enhancing learning and retarding forgetting: Choices and consequences. Psychonomic Bulletin & Review, 14, 187–193.
Pellegrino, J. W., & Hubert, J. L. (1982). The analysis of organization and structure in free recall. In C. R. Puff (Ed.), Handbook of research methods in human memory and cognition (pp. 129–172). New York: Academic Press.
Puff, C. R. (1979). Memory organization research and theory: The state of the art. In C. R. Puff (Ed.), Memory organization and structure (pp. 3–17). New York: Academic Press.
Roediger, H. L., III, & Karpicke, J. D. (2006a). The power of testing memory: Basic research and implications for educational practice. Perspectives on Psychological Science, 1, 181–210.
Roediger, H. L., III, & Karpicke, J. D. (2006b). Test-enhanced learning: Taking memory tests improves long-term retention. Psychological Science, 17, 249–255.
Roenker, D. L., Thompson, C. P., & Brown, S. C. (1971). Comparison of measures for the estimation of clustering in free recall. Psychological Bulletin, 76, 45–48.
Rohrer, D., Taylor, K., & Sholar, B. (2010). Tests enhance the transfer of learning. Journal of Experimental Psychology: Learning, Memory, & Cognition, 36, 233–239.
Schmidt, S. R., & Cherry, K. (1989). The negative generation effect: Delineation of a phenomenon. Memory & Cognition, 17, 359–369.
Slamecka, N. J. (1968). An examination of trace storage in free recall. Journal of Experimental Psychology, 76, 504–513.
Spitzer, H. F. (1939). Studies in retention. Journal of Educational Psychology, 30, 641–656.
Sternberg, R. J., & Tulving, E. (1977). The measurement of subjective organization in free recall. Psychological Bulletin, 84, 539–556.
Szpunar, K. K., McDermott, K. B., & Roediger, H. L., III (2008). Testing during study insulates against the build-up of proactive interference. Journal of Experimental Psychology: Learning, Memory, & Cognition, 34, 1392–1399.
Tse, C.-S., Balota, D. A., & Roediger, H. L., III (in press). The benefits and costs of repeated testing on the learning of face—name pairs in healthy older adults. Psychology & Aging.
Tulving, E. (1962). Subjective organization in free recall of unrelated words. Psychological Review, 69, 344–354.
Tulving, E., & Pearlstone, Z. (1966). Availability versus accessibility of information in memory for words. Journal of Verbal Learning & Verbal Behavior, 5, 381–391.
Tulving, E., & Watkins, M. J. (1974). On negative transfer: Effects of testing one list on the recall of another. Journal of Verbal Learning & Verbal Behavior, 13, 181–193.
Van Overschelde, J. P., Rawson, K. A., & Dunlosky, J. (2004). Category norms: An updated and expanded version of the Battig and Montague (1963) norms. Journal of Memory & Language, 50, 289–335.
Zaromb, F. M. (2010). Organizational processes contribute to the testing effect in free recall. Unpublished doctoral dissertation, Washington University, St. Louis.
Author information
Authors and Affiliations
Corresponding author
Additional information
Support for this research was provided by a Collaborative Activity grant from the James S. McDonnell Foundation (220020041). Data from Experiment 2 were included as part of the first author’s doctoral thesis under the direction of the second author.
Rights and permissions
About this article
Cite this article
Zaromb, F.M., Roediger, H.L. The testing effect in free recall is associated with enhanced organizational processes. Mem Cogn 38, 995–1008 (2010). https://doi.org/10.3758/MC.38.8.995
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/MC.38.8.995