ArticlePublisher preview available

Effortful Tests and Repeated Metacognitive Judgments Enhance Future Learning

Authors:
To read the full-text of this research, you can request a copy directly from the authors.

Abstract and Figures

Prior testing can facilitate subsequent learning, a phenomenon termed the forward testing effect (FTE). We examined a metacognitive account of this effect, which proposes that the FTE occurs because retrieval leads to strategy optimizations during later learning. One prediction of this account is that tests that require less retrieval effort (e.g., multiple-choice relative to cued-recall) should lead to a smaller benefit on new learning. We examined the impact of interpolated multiple-choice or cued-recall testing (relative to no prior testing) on new learning of a four-section STEM text passage. The effect sizes associated with the FTE were numerically, though not significantly larger when the prior tests were cued-recall than multiple-choice, but only when interpolated judgments of learning were not queried. Further, when multiple-choice tests were made more difficult through lure similarity, the FTE was similarly increased. Finally, the FTE was eliminated entirely when participants provided four JOLs after reading each text section. We believe this elimination of the FTE stemmed from an increase in performance for the control participants induced by reactivity from repeated metacognitive queries requiring deep metacognitive reflection. Taken together, these experiments support a metacognitive account of FTE and have important implications for how educators and students should employ retrieval practice and leverage the benefits of metacognitive reflection to improve new learning.
This content is subject to copyright. Terms and conditions apply.
Vol.:(0123456789)
Educational Psychology Review (2023) 35:86
https://doi.org/10.1007/s10648-023-09803-8
1 3
INTERVENTION STUDY
Effortful Tests andRepeated Metacognitive Judgments
Enhance Future Learning
SaraD.Davis1 · JasonC.K.Chan2
Accepted: 3 August 2023 / Published online: 22 August 2023
© The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2023
Abstract
Prior testing can facilitate subsequent learning, a phenomenon termed the forward
testing effect (FTE). We examined a metacognitive account of this effect, which pro-
poses that the FTE occurs because retrieval leads to strategy optimizations during
later learning. One prediction of this account is that tests that require less retrieval
effort (e.g., multiple-choice relative to cued-recall) should lead to a smaller benefit
on new learning. We examined the impact of interpolated multiple-choice or cued-
recall testing (relative to no prior testing) on new learning of a four-section STEM
text passage. The effect sizes associated with the FTE were numerically, though
not significantly larger when the prior tests were cued-recall than multiple-choice,
but only when interpolated judgments of learning were not queried. Further, when
multiple-choice tests were made more difficult through lure similarity, the FTE was
similarly increased. Finally, the FTE was eliminated entirely when participants pro-
vided four JOLs after reading each text section. We believe this elimination of the
FTE stemmed from an increase in performance for the control participants induced
by reactivity from repeated metacognitive queries requiring deep metacognitive
reflection. Taken together, these experiments support a metacognitive account of
FTE and have important implications for how educators and students should employ
retrieval practice and leverage the benefits of metacognitive reflection to improve
new learning.
Keywords Testing effect· Forward testing effect· Retrieval· Metacognition· JOL
Reactivity
All materials as well as data used for analyses can be found at the Open Science Framework
athttps:// osf. io/ ezjuv/.
* Sara D. Davis
sara.davis@unf.edu
1 Department ofPsychology, University ofNorth Florida, Building 51, Room 3404, Jacksonville,
FL32224, USA
2 Iowa State University, Ames, IA, USA
Content courtesy of Springer Nature, terms of use apply. Rights reserved.
... Research has demonstrated that metacognitive ability is a key variable for students' development and academic achievement (e.g., Ohtani & Hisasaka, 2018;Perry et al., 2019). It has been recognized as an important factor driving students' learning (Baars et al., 2018;Davis & Chan, 2023;Kuhn, 2022) and performance gain (Rutherford, 2017). ...
Preprint
The Dunning-Kruger effect describes that low performers tend to overestimate and high performers tend to underestimate their ability and that on average low performers provide less accurate estimates of their ability than high performers. Based on data from N = 1,047 students in Grade 7 (n = 613) and Grade 10 (n = 434), we examined whether the Dunning-Kruger effect exists with regard to high school students’ political knowledge, whether the effect is different in Grade 7 and Grade 10, and how teachers’ behavior (i.e., cognitively activating and motivating teaching) affects students’ judgement accuracy and judgement direction. The results show that the Dunning-Kruger effect exists in both grade levels. Furthermore, visual and statistical examination of the data suggest that the pattern of data is very similar in both grade levels. Finally, we further find that perceived motivational quality is associated with judgement accuracy, but also with overconfidence. Perceived cognitive activation is negatively associated with judgement accuracy. Through the usage of two-cohort data, this study applies a novel approach and bears important implications for research on the Dunning-Kruger effect. Furthermore, the results regarding the teachers’ behavior provide important insights for educational practice in civic education.
... Two empirical articles in the special issue, Kang et al. (2023) and Davis and Chan (2023), address forward testing (i.e., test-potentiated new learning). With forward testing, learners engage in retrieval practice prior to learning new sets of materials. ...
Article
Full-text available
Over the past eighteen years, research into test-enhanced learning has expanded significantly and remains vibrant to this day. The fact that many major research questions in the literature have already been addressed, however, raises the question: “What’s next?” That question motivates this special issue. We asked leading researchers in the field to contribute articles highlighting cutting-edge and new directions in test-enhanced learning research. The resulting review papers, empirical articles, and commentaries address many fascinating topics, including: (a) new approaches that are generating insights into test-enhanced learning in relation to other learning techniques (e.g., combining testing with elaborative or generative learning activities); (b) investigations of lesser-known test-based learning strategies that have the potential to enhance educational outcomes (e.g., pretesting and prequestioning, spaced retrieval practice, test-potentiated new learning or forward testing; and successive relearning); (c) new research on effective uses of practice testing during self-regulated learning and in other contexts; and (d) how to promote awareness and acceptance of test-enhanced learning among students and practitioners. These articles showcase some of the most promising new directions in test-enhanced learning research, so we anticipate that this special issue will inspire further investigations of practice testing and its educational applications.
... We found that five courses either eliminated open-ended questions or substantially increased the proportion of multiple-choice questions for online exams, two additional courses (N = 299) officially adopted an open-notes policy for online exams, and eight courses (N = 678) provided students with an extended exam window (e.g., 12 to 168 h). Together, these factors could account for a substantial proportion of the grade inflation (5,6), which was about 5% in exam scores (g = 0.40). ...
Article
Full-text available
Testing can potentiate new learning, which is often called the forward testing effect. One potential explanation for this benefit is that testing might enable participants to use more effective learning strategies subsequently. We investigated this possibility by asking participants to report their encoding strategies in a multi-list foreign language learning paradigm with four preregistered experiments and one non-preregistered pilot experiment. In Experiments 1–3, participants learned three lists of Chinese–English pairs; one group took a test after every list (i.e., test condition) and the other group took a test only for the criterial List 3 (i.e., restudy condition). In addition, participants completed a transfer test and a study strategy survey. Although we found a forward testing effect in all experiments, participants in the test and restudy conditions did not report differences in strategies. In Experiments 4 and 5, we used a within-subject design so that we could correlate changes in strategy use with the magnitude of the forward testing effect on an individual level. Interestingly, individual differences in strategy change were moderately associated with the magnitude of the forward testing effect, but even here, strategy change did not mediate the effect of testing on performance. Overall, our data showed that, at least for foreign language learning of Chinese characters, interim testing did not enhance new learning by altering participants’ subsequent encoding strategies. Moreover, our data showed that interim testing did not promote the transfer of Chinese language learning to novel characters.
Article
Full-text available
Testing facilitates subsequent learning of new information, a phenomenon known as the forward testing effect. The effect is often investigated in multilist procedures, where studied lists are followed by a retrieval test, or a control task such as restudying, and learning is compared on the final list. In most studies of the effect, tests include all material from the preceding list. We report four experiments, three of which were preregistered, to determine whether tests that are partial (not including all studied items) and distributed (including retrieval of items from earlier lists) are effective in enhancing new learning. The results show that testing of all studied material is not necessary to produce beneficial effects on new learning or to reduce intrusions. The beneficial effects of testing were substantially mediated by reduced proactive interference. Importantly, there was minimal evidence that the forward learning benefits of partial and distributed tests are offset by a cost to untested items via retrieval-induced forgetting. (PsycInfo Database Record (c) 2022 APA, all rights reserved).
Article
Full-text available
Interim tests of previously studied information can potentiate subsequent learning of new information, in part, because retrieval-based processes help to reduce proactive interference from previously learned information. We hypothesized that an effect similar to this forward testing effect would also occur when making judgments of (prior) learning (JOLs). Previous research showed that making JOLs likely prompts covert retrieval attempts and thereby enhances memory, specifically when providing only parts of previously studied information. This study examined the forward effect of different types of JOLs (i.e., with complete or partial prior study information available) on subsequent learning of new materials, compared to restudy and retrieval practice. In a between-subjects design, participants (N = 161) consecutively studied five lists of 20 words with the aim to recall as many of them on a final cumulative recall test. After the presentation of each of the first four lists, participants either restudied the list, made JOLs with complete words, made JOLs with word stems, or they were tested on word stems. Compared to restudy, practicing retrieval and making JOLs with word stems, but not JOLs with complete words, facilitated the List-5 interim recall performance and attenuated the number of intrusions from prior lists. The findings suggest that, similar to overt retrieval, making JOLs with incomplete information can enhance new learning to the extent that it elicits covert retrieval attempts.
Article
Full-text available
Taking a test on previously learned material can enhance new learning. One explanation for this forward testing effect is that retrieval inoculates learners from proactive interference (PI). Although this release-from-PI account has received considerable empirical support, most extant evidence is correlational rather than causal. We tested this account by manipulating the level of PI that participants experience as they studied several lists while receiving interpolated tests or not. In Experiments 1 and 2, we found that testing benefited new learning similarly regardless of PI level. These results contradict those from Nunes and Weinstein (2012), who found no forward testing effect when encoding conditions minimized PI. In Experiments 3 and 4, we failed to replicate their results. Together, our data indicate that reduced PI is likely a byproduct, rather than a causal factor, of the forward testing effect.
Article
Full-text available
Recent studies established that making concurrent judgments of learning (JOLs) can significantly alter (typically enhance) memory itself—a reactivity effect. The current study recruited 190 Chinese children (Mage = 8.68 years; 101 female) in 2020 and 2021 to explore the reactivity effect on children's learning, its developmental trajectory and associated metacognitive awareness. The results showed that making JOLs significantly enhanced retention for students in Grades 1, 3, and 5, with Cohen's ds ranging from 0.40 to 1.33. Grade 5 students exhibited a larger reactivity effect than Grade 1 and 3 students. Children's metacognitive appreciation of the effect was weak. Firsthand experience of the reactivity effect, induced by taking a memory test, enhanced their awareness and calibrated their judgment accuracy.
Article
Full-text available
Recalling details from an experienced event can sometimes exacerbate eyewitnesses’ susceptibility to subsequent misinformation. This finding, known as retrieval-enhanced suggestibility (RES), can be eliminated when participants are warned about possible inaccuracies in the misinformation source (Thomas, Bulevich, & Chan, 2010). In three experiments, we investigated whether this warning benefit persists across delays. When the warning was issued shortly after participants were exposed to misinformation, it inoculated participant witnesses against RES, regardless of whether the final memory test occurred immediately or 48 hr after the warning. However, the warning lost its effectiveness when it was delivered 48 hr after participants were exposed to misinformation. These results applied to both recognition memory and the confidence-accuracy relationship. We considered these data from the perspective of temporal distinctiveness, and we argue that a warning serves a similar function to a forget cue in the directed forgetting paradigm.
Article
Full-text available
An emerging body of studies demonstrates that practicing retrieval of studied information, by comparison with restudying or no treatment, can facilitate subsequent learning and retrieval of new information, a phenomenon termed the forward testing effect (FTE) or test-potentiated new learning. Several theoretical explanations have been proposed to account for the FTE. A release-from-PI theory proposes that interpolated testing induces context changes and enhances event segregation, which in turn protect new learning from proactive interference (PI). A strategy-change view hypothesizes that prior tests teach learners to adopt more effective/elaborative learning and retrieval strategies in subsequent study and test phases. Finally, a reset-of-encoding account proposes that interim testing on studied information reduces memory load, resets the subsequent encoding process, and enhances encoding of new information. The current study recruited a large sample (over 1,000 participants) and employed a multilist learning task and mediation analyses to test these theories. The results suggest that prior list intrusions (an index of PI) significantly mediated the FTE, supporting the release-from-PI theory. In addition, interim testing enhanced strategic processing of temporal information during new learning (reflected by increased clustering), and temporal clustering significantly mediated the FTE, supporting a role for strategy-change in the FTE. Lastly, a variety of indices were constructed to represent the benefit of reset-of-encoding, but none of them provided evidence supporting the reset-of-encoding view. The results shed new light on the complex mechanisms underlying the forward benefits of testing. (PsycInfo Database Record (c) 2021 APA, all rights reserved).
Article
Recent studies have found that making judgments of learning (JOLs) for verbal materials changes memory itself, a form of reactivity effect on memory. The current study explores the reactivity effect on visual (image) memory and tests the potential role of enhanced learning engagement in this effect. Experiment 1 employed object image pairs as stimuli and observed a positive reactivity effect on memory for visual details. Experiment 2 conceptually replicated this positive reactivity effect using pairs of scene images. Experiment 3 introduced mind wandering (MW) probes to measure participants’ attentional state (learning engagement) and observed that making JOLs significantly reduced MW. More importantly, reduced MW mediated the reactivity effect. Lastly, Experiment 4 found that a manipulation that heightened learning motivation decreased the reactivity effect. Overall, the current study provides the first demonstration of the reactivity effect on visual memory, as well as support for the enhanced learning engagement explanation. Practical implications are discussed.
Article
The forward testing effect (FTE) refers to the finding that retrieval practice of previously studied information can facilitate learning and memory of newly studied information. The goal of the present set of six experiments was to examine whether the FTE is influenced by study material. We replicated prior work by showing that the FTE can arise with both unrelated and categorized item lists. Going beyond the prior work, we found that parallel FTEs for the two types of lists arose only for short retention interval and when the lag between study of the previous lists and study of the final critical list was also short. When there was a prolonged retention interval or a prolonged lag, the FTE was observed with categorized lists but disappeared with unrelated lists. Moreover, semantic generation of extra-list items interspersed between study of the single lists produced an FTE with unrelated lists but not with categorized lists. These findings on the critical role of study material for the FTE are consistent with a two-factor explanation of the FTE, which assumes contributions of both strategy change and context change for the FTE. The account suggests that the FTE is mainly driven by strategy change with categorized material and is mainly driven by context change with unrelated material.
Article
How do we go about learning new information? This article reviews the importance of practicing retrieval of newly experienced information if one wants to be able to retrieve it again in the future. Specifically, practicing retrieval shortly after learning can slow the forgetting process. This benefit can be seen across various material types, and it seems prevalent in all ages and learner abilities and on all types of test. It can also be used to enhance student learning in a classroom setting. I review theoretical understanding of this phenomenon (sometimes referred to as the testing effect or as retrieval-based learning) and consider directions for future research. Expected final online publication date for the Annual Review of Psychology, Volume 72 is January 5, 2021. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.