1932

Abstract

How do we go about learning new information? This article reviews the importance of practicing retrieval of newly experienced information if one wants to be able to retrieve it again in the future. Specifically, practicing retrieval shortly after learning can slow the forgetting process. This benefit can be seen across various material types, and it seems prevalent in all ages and learner abilities and on all types of test. It can also be used to enhance student learning in a classroom setting. I review theoretical understanding of this phenomenon (sometimes referred to as the testing effect or as retrieval-based learning) and consider directions for future research.

Loading

Article metrics loading...

/content/journals/10.1146/annurev-psych-010419-051019
2021-01-04
2024-03-29
Loading full text...

Full text loading...

/deliver/fulltext/psych/72/1/annurev-psych-010419-051019.html?itemId=/content/journals/10.1146/annurev-psych-010419-051019&mimeType=html&fmt=ahah

Literature Cited

  1. Abbott EE. 1909. On the analysis of the factor of recall in the learning process. Psychol. Monogr. 11:159–77
    [Google Scholar]
  2. Adesope OO, Trevisan DA, Sundararajan N 2017. Rethinking the use of tests: a meta-analysis of practice testing. Rev. Educ. Res. 87:3659–701
    [Google Scholar]
  3. Agarwal PK, Bain P. 2019. Powerful Teaching: Unleash the Science of Learning San Francisco, CA: Jossey-Bass
  4. Agarwal PK, D'Antonio L, Roediger HL III, McDermott KB, McDaniel MA 2014. Classroom-based programs of retrieval practice reduce middle school and high school students’ test anxiety. J. Appl. Res. Mem. Cogn. 3:3131–39
    [Google Scholar]
  5. Allen GA, Mahler WA, Estes WK 1969. Effects of recall tests on long-term retention of paired associates. J. Verbal Learn. Verbal Behav. 8:463–70
    [Google Scholar]
  6. Anderson MC, Bjork RA, Bjork EL 1994. Remembering can cause forgetting: retrieval dynamics in long-term memory. J. Exp. Psychol. Learn. Mem. Cogn. 20:51063–87
    [Google Scholar]
  7. Anderson MC, McCulloch KC. 1999. Integration as a general boundary condition on retrieval-induced forgetting. J. Exp. Psychol. Learn. Mem. Cogn. 25:608–29
    [Google Scholar]
  8. Arnold KM, McDermott KB. 2013a. Free recall enhances subsequent learning. Psychon. Bull. Rev. 20:3507–13
    [Google Scholar]
  9. Arnold KM, McDermott KB. 2013b. Test-potentiated learning: distinguishing between direct and indirect effects of tests. J. Exp. Psychol. Learn. Mem. Cogn. 39:3940–45
    [Google Scholar]
  10. Bacon F. 2000 (1620). Novum Organum transl. LJM Silverthorne Cambridge, UK: Cambridge Univ. Press
  11. Batsell WR, Perry JL, Hanley E, Hostetter AB 2017. Ecological validity of the testing effect: the use of daily quizzes in introductory psychology. Teach. Psychol. 44:118–23
    [Google Scholar]
  12. Bjork EL, Little JL, Storm BC 2014. Multiple-choice testing as a desirable difficulty in the classroom. J. Appl. Res. Mem. Cogn. 3:3165–70
    [Google Scholar]
  13. Bjork RA. 1975. Retrieval as a memory modifier: an interpretation of negative recency and related phenomena. Information Processing and Cognition: The Loyola Symposium RL Solso 123–44 Mahwah, NJ: Lawrence Erlbaum Assoc.
    [Google Scholar]
  14. Bjork RA. 1994. Memory and metamemory considerations in the training of human beings. Metacognition: Knowing About Knowing J Metcalfe, AP Shimamura 185–205 Cambridge, MA: MIT Press
    [Google Scholar]
  15. Blasiman RN, Dunlosky J, Rawson KA 2017. The what, how much, and when of study strategies: comparing intended versus actual study behaviour. Memory 25:6784–92
    [Google Scholar]
  16. Brewer GA, Unsworth N. 2012. Individual differences in the effects of retrieval from long-term memory. J. Mem. Lang. 66:3407–15
    [Google Scholar]
  17. Brown PC, McDaniel MA, Roediger HL III 2014. Make it Stick: The Science of Successful Learning Cambridge, MA: Belknap Press
  18. Butler AC. 2010. Repeated testing produces superior transfer of learning relative to repeated studying. J. Exp. Psychol. Learn. Mem. Cogn. 36:51118–33
    [Google Scholar]
  19. Butler AC, Roediger HL III 2007. Testing improves long-term retention in a simulated classroom setting. Eur. J. Cogn. Psychol. 19:4–5514–27
    [Google Scholar]
  20. Carpenter SK. 2009. Cue strength as a moderator of the testing effect: the benefits of elaborative retrieval. J. Exp. Psychol. Learn. Mem. Cogn. 35:61563–69
    [Google Scholar]
  21. Carpenter SK, DeLosh EL. 2006. Impoverished cue support enhances subsequent retention: support for the elaborative retrieval explanation of the testing effect. Mem. Cogn. 34:2268–76
    [Google Scholar]
  22. Carpenter SK, Pashler H. 2007. Testing beyond words: using tests to enhance visuospatial map learning. Psychon. Bull. Rev. 14:3474–78
    [Google Scholar]
  23. Carpenter SK, Pashler H, Cepeda NJ 2009. Using tests to enhance 8th grade students’ retention of U.S. history facts. Appl. Cogn. Psychol. 23:6760–71
    [Google Scholar]
  24. Carpenter SK, Pashler H, Wixted JT, Vul E 2008. The effects of tests on learning and forgetting. Mem. Cogn. 36:2438–48
    [Google Scholar]
  25. Carrier M, Pashler H. 1992. The influence of retrieval on retention. Mem. Cogn. 20:6633–42
    [Google Scholar]
  26. Chan JCK. 2009. When does retrieval induce forgetting and when does it induce facilitation? Implications for retrieval inhibition, testing effect, and text processing. J. Mem. Lang. 61:2153–70
    [Google Scholar]
  27. Chan JCK. 2010. Long-term effects of testing on the recall of nontested materials. Memory 18:149–57
    [Google Scholar]
  28. Chan JCK, McDermott KB. 2007. The testing effect in recognition memory: a dual process account. J. Exp. Psychol. Learn. Mem. Cogn. 33:2431–37
    [Google Scholar]
  29. Chan JCK, McDermott KB, Roediger HL III 2006. Retrieval-induced facilitation: initially nontested material can benefit from prior testing of related material. J. Exp. Psychol. Gen. 135:4553–71
    [Google Scholar]
  30. Chan JCK, Meissner CA, Davis SD 2018. Retrieval potentiates new learning: a theoretical and meta-analytic review. Psychol. Bull. 144:111111–46
    [Google Scholar]
  31. Cranney J, Ahn M, McKinnon R, Morris S, Watts K 2009. The testing effect, collaborative learning, and retrieval-induced facilitation in a classroom setting. Eur. J. Cogn. Psychol. 21:6919–40
    [Google Scholar]
  32. Darley CF, Murdock BB. 1971. Effects of prior free recall testing on final recall and recognition. J. Exp. Psychol. Learn. 91:166–73
    [Google Scholar]
  33. Draheim C, Mashburn CA, Martin JD, Engle RW 2019. Reaction time in differential and developmental research: a review and commentary on the problems and alternatives. Psychol. Bull. 145:5508–35
    [Google Scholar]
  34. Duchastel PC, Nungester RJ. 1982. Testing effects measured with alternate test forms. J. Educ. Res. 75:5309–13
    [Google Scholar]
  35. Dunlosky J, Rawson KA, Marsh EJ, Nathan MJ, Willingham DT 2013. Improving students’ learning with effective learning techniques: promising directions from cognitive and educational psychology. Psychol. Sci. Public Interest 14:14–58
    [Google Scholar]
  36. Ebbinghaus H. 1964 (1885). Memory: A Contribution to Experimental Psychology transl. HA Ruger, CE Bussenius, ER Hilgard New York: Dover
  37. Fazio LK, Marsh EJ. 2019. Retrieval-based learning in children. Curr. Dir. Psychol. Sci. 28:2111–16
    [Google Scholar]
  38. Foss DJ, Pirozzolo JW. 2017. Four semesters investigating frequency of testing, the testing effect, and transfer of training. J. Educ. Psychol. 109:81067–83
    [Google Scholar]
  39. Gardiner JM. 2007. Retrieval: on its essence and related concepts. Science of Memory: Concepts HL Roediger III, Y Dudai, SM Fitzpatrick 221–24 Oxford, UK: OPxford Univ. Press
    [Google Scholar]
  40. Gates AI. 1917. Recitation as a Factor in Memorizing New York: Science Press
  41. Glover JA. 1989. The “testing” phenomenon: not gone but nearly forgotten. J. Educ. Psychol. 81:3392–99
    [Google Scholar]
  42. Hanawalt NG, Tarr AG. 1961. The effect of recall upon recognition. J. Exp. Psychol. 62:4361–67
    [Google Scholar]
  43. Hashimoto T, Usui N, Taira M, Kojima S 2011. Neural enhancement and attenuation induced by repetitive recall. Neurobiol. Learn. Mem. 96:143–49
    [Google Scholar]
  44. Hedge C, Powell G, Sumner P 2018. The reliability paradox: why robust cognitive tasks do not produce reliable individual differences. Behav. Res. Methods 50:1166–86
    [Google Scholar]
  45. James WJ. 1890. The Principles of Psychology New York: Dover
  46. Johnson CI, Mayer RE. 2009. A testing effect with multimedia learning. J. Educ. Psychol. 101:3621–29
    [Google Scholar]
  47. Kang SHK. 2010. Enhancing visuospatial learning: the benefit of retrieval practice. Mem. Cogn. 38:81009–17
    [Google Scholar]
  48. Kang SHK, McDaniel MA, Pashler H 2011. Effects of testing on learning of functions. Psychon. Bull. Rev. 18:5998–1005
    [Google Scholar]
  49. Kang SHK, McDermott KB, Roediger HL III 2007. Test format and corrective feedback modify the effect of testing on long-term retention. Eur. J. Cogn. Psychol. 19:4–5528–58
    [Google Scholar]
  50. Karpicke JD. 2017. Retrieval-based learning: a decade of progress. Learning and Memory: A Comprehensive Reference JH Byrne 487–514 Amsterdam: Elsevier
    [Google Scholar]
  51. Karpicke JD, Blunt JR. 2011. Retrieval practice produces more learning than elaborative studying with concept mapping. Science 331:6018772–75
    [Google Scholar]
  52. Karpicke JD, Blunt JR, Smith MA 2016. Retrieval-based learning: positive effects of retrieval practice in elementary school children. Front. Psychol. 7:350
    [Google Scholar]
  53. Karpicke JD, Blunt JR, Smith MA, Karpicke SS 2014a. Retrieval-based learning: the need for guided retrieval in elementary school children. J. Appl. Res. Mem. Cogn. 3:3198–206
    [Google Scholar]
  54. Karpicke JD, Butler AC, Roediger HL III 2009. Metacognitive strategies in student learning: Do students practise retrieval when they study on their own. Memory 17:4471–79
    [Google Scholar]
  55. Karpicke JD, Lehman M, Aue WR 2014b. Retrieval-based learning: an episodic context account. Psychology of Learning and Motivation 61 BH Ross 237–84 Amsterdam: Elsevier
    [Google Scholar]
  56. Köhler W. 1947. Gestalt Psychology New York: Liveright
  57. Kornell N, Bjork RA. 2007. The promise and perils of self-regulated study. Psychon. Bull. Rev. 14:2219–24
    [Google Scholar]
  58. Kornell N, Bjork RA, Garcia MA 2011. Why tests appear to prevent forgetting: a distribution-based bifurcation model. J. Mem. Lang. 65:285–97
    [Google Scholar]
  59. Larsen DP, Butler AC, Roediger HL III 2009. Repeated testing improves long-term retention relative to repeated study: a randomised controlled trial. Med. Educ. 43:121174–81
    [Google Scholar]
  60. Lockhart RS. 1975. The facilitation of recognition by recall. J. Verbal Learn. Verbal Behav. 14:253–58
    [Google Scholar]
  61. Lyle KB, Crawford NA. 2011. Retrieving essential material at the end of lectures improves performance on statistics exams. Teach. Psychol. 38:294–97
    [Google Scholar]
  62. MacLeod MD, Macrae CN. 2001. Gone but not forgotten: the transient nature of retrieval-induced forgetting. Psychol. Sci. 12:148–52
    [Google Scholar]
  63. Malmberg KJ, Lehman M, Annis J, Criss AH, Shiffrin RM 2014. Consequences of testing memory. Psychology of Learning and Motivation 61 BH Ross 285–313 Amsterdam: Elsevier
    [Google Scholar]
  64. Marsh EJ, Agarwal PK, Roediger HL III 2009. Memorial consequences of answering SAT II questions. J. Exp. Psychol. Appl. 15:11–11
    [Google Scholar]
  65. Mayer RE, Stull A, DeLeeuw K, Almeroth K, Bimber B et al. 2009. Clickers in college classrooms: fostering learning with questioning methods in large lecture classes. Contemp. Educ. Psychol. 34:151–57
    [Google Scholar]
  66. McCabe J. 2011. Metacognitive awareness of learning strategies in undergraduates. Mem. Cogn. 39:3462–76
    [Google Scholar]
  67. McDaniel MA, Agarwal PK, Huelser BJ, McDermott KB, Roediger HL III 2011. Test-enhanced learning in a middle school science classroom: the effects of quiz frequency and placement. J. Educ. Psychol. 103:2399–414
    [Google Scholar]
  68. McDaniel MA, Roediger HL III, McDermott KB 2007. Generalizing test-enhanced learning from the laboratory to the classroom. Psychon. Bull. Rev. 14:2200–6
    [Google Scholar]
  69. McDaniel MA, Thomas RC, Agarwal PK, McDermott KB, Roediger HL III 2013. Quizzing in middle-school science: successful transfer performance on classroom exams. Appl. Cogn. Psychol. 27:3360–72
    [Google Scholar]
  70. McDermott KB, Agarwal PK, D'Antonio L, Roediger HL III, McDaniel MA 2014a. Both multiple-choice and short-answer quizzes enhance later exam performance in middle and high school classes. J. Exp. Psychol. Appl. 20:13–21
    [Google Scholar]
  71. McDermott KB, Arnold KM, Nelson SM 2014b. The testing effect. The SAGE Handbook of Applied Memory TJ Perfect, DS Lindsay 183–200 London: SAGE
    [Google Scholar]
  72. Melton AW. 1963. Implications of short-term memory for a general theory of memory. J. Verbal Learn. Verbal Behav. 2:1–21
    [Google Scholar]
  73. Meyer AND, Logan JM. 2013. Taking the testing effect beyond the college freshman: benefits for lifelong learning. Psychol. Aging 28:1142–47
    [Google Scholar]
  74. Minear M, Coane JH, Boland SC, Cooney LH, Albat M 2018. The benefits of retrieval practice depend on item difficulty and intelligence. J. Exp. Psychol. Learn. Mem. Cogn. 44:91474–86
    [Google Scholar]
  75. Morris CD, Bransford JD, Franks JJ 1977. Levels of processing versus transfer appropriate processing. J. Verbal Learn. Verbal Behav. 16:5519–33
    [Google Scholar]
  76. Morris PE, Fritz CO. 2000. The name game: using retrieval practice to improve the learning of names. J. Exp. Psychol. Appl. 6:124–29
    [Google Scholar]
  77. Nelson SM, Arnold KM, Gilmore AW, McDermott KB 2013. Neural signatures of test-potentiated learning in parietal cortex. J. Neurosci. 33:2911754–62
    [Google Scholar]
  78. Nunes LD, Karpicke JD. 2015. Retrieval-based learning: research at the interface between cognitive science and education. Emerging Trends in the Social and Behavioral Sciences RA Scott, SM Kosslyn 1–16 Hoboken, NJ: Wiley
    [Google Scholar]
  79. Pan SC, Pashler H, Potter ZE, Rickard TC 2015. Testing enhances learning across a range of episodic memory abilities. J. Mem. Lang. 83:53–61
    [Google Scholar]
  80. Pan SC, Rickard TC. 2018. Transfer of test-enhanced learning: meta-analytic review and synthesis. Psychol. Bull. 144:7710–56
    [Google Scholar]
  81. Pastötter BB, Bäuml K-HT. 2014. Retrieval practice enhances new learning: the forward effect of testing. Front. Psychol. 5:286
    [Google Scholar]
  82. Putnam AL, Roediger HL III 2013. Does response mode affect amount recalled or the magnitude of the testing effect. Mem. Cogn. 41:136–48
    [Google Scholar]
  83. Pyc MA, Rawson KA. 2009. Testing the retrieval effort hypothesis: Does greater difficulty correctly recalling information lead to higher levels of memory. J. Mem. Lang. 60:4437–47
    [Google Scholar]
  84. Robey A. 2019. The benefits of testing: individual differences based on student factors. J. Mem. Lang. 108:104029
    [Google Scholar]
  85. Roediger HL III, Agarwal PK, McDaniel MA, McDermott KB 2011a. Test-enhanced learning in the classroom: long-term improvements from quizzing. J. Exp. Psychol. Appl. 17:4382–95
    [Google Scholar]
  86. Roediger HL III, Karpicke JD 2006a. Test-enhanced learning: taking memory tests improves long-term retention. Psychol. Sci. 17:324955
    [Google Scholar]
  87. Roediger HL III, Karpicke JD 2006b. The power of testing memory: basic research and implications for educational practice. Perspect. Psychol. Sci. 1:3181–210
    [Google Scholar]
  88. Roediger HL III, Karpicke JD 2018. Reflections on the resurgence of interest in the testing effect. Perspect. Psychol. Sci. 13:2236–41
    [Google Scholar]
  89. Roediger HL III, Marsh EJ 2005. The positive and negative consequences of multiple-choice testing. J. Exp. Psychol. Learn. Mem. Cogn. 31:51155–59
    [Google Scholar]
  90. Roediger HL III, McDermott KB 1995. Creating false memories: remembering words not presented in lists. J. Exp. Psychol. Learn. Mem. Cogn. 21:4803–14
    [Google Scholar]
  91. Roediger HL III, Putnam AL, Smith MA 2011b. Ten benefits of testing and their applications to educational practice. Psychology of Learning and Motivation 55 JP Mestre, BH Ross 1–36 Amsterdam: Elsevier
    [Google Scholar]
  92. Rogalski Y, Altmann LJP, Rosenbek JC 2014. Retrieval practice and testing improve memory in older adults. Aphasiology 28:4381–400
    [Google Scholar]
  93. Rohrer D, Taylor K, Sholar B 2010. Tests enhance the transfer of learning. J. Exp. Psychol. Learn. Mem. Cogn. 36:1233–39
    [Google Scholar]
  94. Rowland CA. 2014. The effect of testing versus restudy on retention: a meta-analytic review of the testing effect. Psychol. Bull. 140:61432–63
    [Google Scholar]
  95. Rowland CA, DeLosh EL. 2015. Mnemonic benefits of retrieval practice at short retention intervals. Memory 23:3403–19
    [Google Scholar]
  96. Runquist WN. 1983. Some effects of remembering on forgetting. Mem. Cogn. 11:6641–50
    [Google Scholar]
  97. Schwieren J, Barenberg J, Dutke S 2017. The testing effect in the psychology classroom: a meta-analytic perspective. Psychol. Learn. Teach. 16:2179–96
    [Google Scholar]
  98. Spitzer HF. 1939. Studies in retention. J. Educ. Psychol. 30:9641–56
    [Google Scholar]
  99. Szpunar KK, McDermott KB, Roediger HL III 2008. Testing during study insulates against the buildup of proactive interference. J. Exp. Psychol. Learn. Mem. Cogn. 34:61392–99
    [Google Scholar]
  100. Thomas RC, Weywadt CR, Anderson JL, Martinez-Papponi B, McDaniel MA 2018. Testing encourages transfer between factual and application questions in an online learning environment. J. Appl. Res. Mem. Cogn. 7:2252–60
    [Google Scholar]
  101. Thompson CP, Wenger SK, Bartling CA 1978. How recall facilitates subsequent recall: a reappraisal. J. Exp. Psychol. Hum. Learn. Mem. 4:210–21
    [Google Scholar]
  102. Toppino TC, Cohen MS. 2009. The testing effect and the retention interval: questions and answers. Exp. Psychol. 56:4252–57
    [Google Scholar]
  103. Tse C-S, Balota DA, Roediger HL III 2010. The benefits and costs of repeated testing on the learning of face-name pairs in healthy older adults. Psychol. Aging 25:4833–45
    [Google Scholar]
  104. Underwood BJ 1972. Are we overloading memory?. Coding Processes in Human Memory AW Melton, E Martin 1–23 Washington, DC: Winston & Sons
    [Google Scholar]
  105. Unsworth N. 2019. Individual differences in long-term memory. Psychol. Bull. 145:179–139
    [Google Scholar]
  106. van den Broek GSE, Takashima A, Segers E, Fernández G, Verhoeven L 2013. Neural correlates of testing effects in vocabulary learning. NeuroImage 78:94–102
    [Google Scholar]
  107. van den Broek GSE, Takashima A, Wiklund-Hörnqvist C, Karlsson Wirebring L, Segers E et al. 2016. Neurocognitive mechanisms of the “testing effect”: a review. Trends Neurosci. Educ. 5:252–66
    [Google Scholar]
  108. Vestergren P, Nyberg L. 2014. Testing alters brain activity during subsequent restudy: evidence for test-potentiated encoding. Trends Neurosci. Educ. 3:269–80
    [Google Scholar]
  109. Wagner AD, Schacter DL, Rotte M, Koutstaal W, Maril A et al. 1998. Building memories: remembering and forgetting of verbal experiences as predicted by brain activity. Science 281:1188–91
    [Google Scholar]
  110. Watkins MJ. 1975. Inhibition in recall with extralist “cues.”. J. Verbal Learn. Verbal Behav. 14:294–303
    [Google Scholar]
  111. Wing EA, Marsh EJ, Cabeza R 2013. Neural correlates of retrieval-based memory enhancement: an fMRI study of the testing effect. Neuropsychologia 51:122360–70
    [Google Scholar]
  112. Wixted JT. 2004. The psychology and neuroscience of forgetting. Annu. Rev. Psychol. 55:23569
    [Google Scholar]
  113. Yonelinas AP. 2002. The nature of recollection and familiarity: a review of 30 years of research. J. Mem. Lang. 46:3441–517
    [Google Scholar]
  114. Zerr CL, Berg JJ, Nelson SM, Fishell AK, Savalia NK, McDermott KB 2018. Learning efficiency: identifying individual differences in learning rate and retention in healthy adults. Psychol. Sci. 29:91436–50
    [Google Scholar]
/content/journals/10.1146/annurev-psych-010419-051019
Loading
/content/journals/10.1146/annurev-psych-010419-051019
Loading

Data & Media loading...

  • Article Type: Review Article
This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error