Does Retrieval Fluency Contribute to the Underconfidence-With-Practice Effect?

Judgments of learning (JOLs) made during multiple study-test trials underestimate increases in recall performance across those trials, an effect that has been dubbed the underconfidence-with-practice (UWP) effect. In 3 experiments, the authors examined the contribution of retrieval fluency to the UWP effect for immediate and delayed JOLs. The UWP effect was demonstrated with reliable underconfidence on Trial 2 occurring for both kinds of JOL. However, in contrast to a retrieval-fluency hypothesis, fine-grained analyses indicated that the reliance of JOLs on retrieval fluency contributed minimally to the UWP effect. Our discussion focuses on the status of the retrieval-fluency hypothesis for the UWP effect. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Metacognition in prospective memory: Are performance predictions accurate?

This study investigated the role of metacognition in event-based prospective memory. The aim of the study was to explore the relation between an item-level prediction (judgments of learning, JOL) and actual performance. The task and JOLs allowed a differentiation of the two components of prospective memory tasks (retrospective vs. prospective). Results revealed that individuals' predictions were (moderately) accurate for delayed JOLs but not for JOLs that had to be given immediately after task encoding. Moreover, data revealed an underconfidence-with-practice effect only for the retrospective component. For the prospective component, a substantial and general level of underconfidence in individuals' prediction–performance ratios was observed. The importance of metacognitive factors for prospective memory is discussed. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Exploring a mnemonic debiasing account of the underconfidence-with-practice effect.

Judgments of learning (JOLs) underestimate the increase in recall that occurs with repeated study (the underconfidence-with-practice effect; UWP). The authors explore an account in terms of a foresight bias in which JOLs are inflated when the to-be-recalled target highlights aspects of the cue that are not transparent when the cue appears alone and the tendency of practice to alleviate bias by providing learners with cues pertinent to recall. In 3 experiments the UWP effect was strongest for items that induce a foresight bias, but delaying JOLs reduced the debiasing effects of practice, thereby moderating the UWP effect. This occurred when delayed JOLs were prompted by the cue alone (like during testing), not when prompted by the cue-target pair (like during study). (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The influence of delaying judgments of learning on metacognitive accuracy: A meta-analytic review.

Many studies have examined the accuracy of predictions of future memory performance solicited through judgments of learning (JOLs). Among the most robust findings in this literature is that delaying predictions serves to substantially increase the relative accuracy of JOLs compared with soliciting JOLs immediately after study, a finding termed the delayed JOL effect. The meta-analyses reported in the current study examined the predominant theoretical accounts as well as potential moderators of the delayed JOL effect. The first meta-analysis examined the relative accuracy of delayed compared with immediate JOLs across 4,554 participants (112 effect sizes) through gamma correlations between JOLs and memory accuracy. Those data showed that delaying JOLs leads to robust benefits to relative accuracy (g = 0.93). The second meta-analysis examined memory performance for delayed compared with immediate JOLs across 3,807 participants (98 effect sizes). Those data showed that delayed JOLs result in a modest but reliable benefit for memory performance relative to immediate JOLs (g = 0.08). Findings from these meta-analyses are well accommodated by theories suggesting that delayed JOL accuracy reflects access to more diagnostic information from long-term memory rather than being a by-product of a retrieval opportunity. However, these data also suggest that theories proposing that the delayed JOL effect results from a memorial benefit or the match between the cues available for JOLs and those available at test may also provide viable explanatory mechanisms necessary for a comprehensive account. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Separating bias and sensitivity in judgments of associative memory.

Ratings of the degree of association between words are linearly related to normed associative strengths, but the intercept is high, and the slope is shallow (the judgments of associative memory [JAM] function). Two experiments included manipulations intended to decrease the intercept and increase the slope. Discrimination training on many pairs of words and constraining ratings to sum to a constant both reduced the intercept but failed to change the slope. The intercept of the JAM function appears to contain a bias component that can be manipulated independently of the slope, which reflects sensitivity to associative strengths. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Comparing objective and subjective learning curves: Judgments of learning exhibit increased underconfidence with practice.

When participants studied a list of paired associates for several study-test cycles, their judgments of learning (JOLs) exhibited relatively good calibration on the 1st cycle, with a slight overconfidence. However, a shift toward marked underconfidence occurred from the 2nd cycle on. This underconfidence-with-practice (UWP) effect was very robust across several experimental manipulations, such as feedback or no feedback regarding the correctness of the answer, self-paced versus fixed-rate presentation, different incentives for correct performance, magnitude and direction of associative relationships, and conditions producing different degrees of knowing. It was also observed both in item-by-item JOLs and in aggregate JOLs. The UWP effect also occurred for list learning and for the memory of action events. Several theoretical explanations for this counterintuitive effect are discussed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Metacognition in motor learning.

Research on judgments of verbal learning has demonstrated that participants' judgments are unreliable and often overconfident. The authors studied judgments of perceptual-motor learning. Participants learned 3 keystroke patterns on the number pad of a computer, each requiring that a different sequence of keys be struck in a different total movement time. Practice trials on each pattern were either blocked or randomly interleaved with trials on the other patterns, and each participant was asked, periodically, to predict his or her performance on a 24-hr test. Consistent with earlier findings, blocked practice enhanced acquisition but harmed retention. Participants, though, predicted better performance given blocked practice. These results augment research on judgments of verbal learning and suggest that humans, at their peril, interpret current ease of access to a perceptual-motor skill as a valid index of learning. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Lack of Pervasiveness of the Underconfidence-With-Practice Effect: Boundary Conditions and an Explanation Via Anchoring.

The authors investigated whether underconfidence in judgments of learning (JOLs) is pervasive across multiple study-test trials as suggested by A. Koriat, L. Sheffer, and H. Ma'ayan (2002) or whether underconfidence with practice (UWP) might be a kind of anchoring-and-adjustment effect, such that the occurrence or nonoccurrence of the UWP effect depends on whether recall is above a psychological anchor. Participants studied normatively difficult items or normatively easy items and made immediate JOLs or delayed JOLs. The UWP effect occurred for easy items, but for difficult items an overconfidence-with-practice (OWP) effect occurred for delayed JOLs and no bias occurred for immediate JOLs. The systematic occurrence of all 3 outcomes establishes boundary conditions for the UWP effect and confirms the hypothesis that underconfidence (or the lack thereof) may arise at least in part from an anchoring-and-adjustment mechanism. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The testing effect in recognition memory: A dual process account.

The testing effect, or the finding that taking an initial test improves subsequent memory performance, is a robust and reliable phenomenon--as long as the final test involves recall. Few studies have examined the effects of taking an initial recall test on final recognition performance, and results from these studies are equivocal. In 3 experiments, we attempt to demonstrate that initial testing can change the ways in which later recognition decisions are executed even when no difference can be detected in the recognition hit rates. Specifically, initial testing was shown to enhance later recollection but leave familiarity unchanged. This conclusion emerged from three dependent measures: source memory, exclusion performance, and remember/know judgments. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Comprehension as a basis for metacognitive judgments: Effects of effort after meaning on recall and metacognition.

We examined free recall and metacognitive judgments of ambiguous sentences studied with and without clues to facilitate their comprehension. Sentences were either studied without clues, with clues meaningfully embedded, or with clues following a 10-s interval delay. After presentation, subjects made judgments of comprehension (JCOMPs) or judgments of learning (JOLs). Puzzling over the meaning of sentences for several seconds prior to receiving the clue enhanced recall compared with studying sentences without clues or with embedded clues. This benefit of effort after meaning was not reflected in JCOMPs or JOLs. Rather, sentences considered relatively easy to understand received higher JOLs regardless of experimental condition. Although effort after meaning enhanced recall, subjects displayed no awareness of this benefit in their judgments. Our study adds to a growing literature showing students’ ignorance of factors affecting their own learning, which have important implications for education. Making learning conditions more difficult, thus requiring students to engage more cognitive effort, often leads to enhanced retention. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Familiarity and retrieval processes in delayed judgments of learning.

Two processes are postulated to underlie delayed judgments of learning (JOLs)--cue familiarity and target retrievability. The two processes are distinguishable because the familiarity-based judgments are thought to be faster than the retrieval-based processes, because only retrieval-based JOLs should enhance the relative accuracy of the correlations between the JOLs and criterion test performance, and because only retrieval-based judgments should enhance memory. To test these predictions, in three experiments, the authors either speeded people's JOLs or allowed them to be unspeeded. The relative accuracy of the JOLs in predicting performance on the criterion test was higher for the unspeeded JOLs than for the speeded JOLs, as predicted. The unspeeded JOL conditions showed enhanced memory as compared with the speeded JOL conditions, as predicted. Finally, the unspeeded JOLs were sensitive to manipulations that modified recallability of the target, whereas the speeded JOLs were selectively sensitive to experimental variations in the familiarity of the cues. Thus, all three of the predictions about the consequences of the two processes potentially underlying delayed JOLs were borne out. A model of the processes underlying delayed JOLs based on these and earlier results is presented. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The modality-match effect in recognition memory.

The modality-match effect in recognition refers to superior memory for words presented in the same modality at study and test. Prior research on this effect is ambiguous and inconsistent. The present study demonstrates that the modality-match effect is found when modality is rendered salient at either encoding or retrieval. Specifically, in Experiment 1, visual and auditory study trials were either randomly intermixed or presented in blocks, followed by a standard (old–new) recognition test. The modality-match effect was observed for the mixed but not the blocked condition. Experiment 2 used a modality-judgment test (requiring a seen, heard, or new judgment). The resulting measure of recognition memory exhibited the modality-match effect for both list conditions. These results imply (a) that the modality-match effect is a consistent finding when modality is salient and (b) that the effect arises at retrieval rather than encoding. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Memory predictions are influenced by perceptual information: Evidence for metacognitive illusions.

Although perceptual information is utilized to judge size or depth, little work has investigated whether such information is used to make memory predictions. The present study examined how the font size of to-be-remembered words influences predicted memory performance. Participants studied words for a free-recall test that varied in font size and made judgments of learning (JOLs) for each item. JOLs were influenced by font size, as larger font sizes were given higher JOLs, whereas little relationship was evident between font size and recall. The effect was modified when other, more valid, sources of information (e.g., associative strength) were available when JOLs were made and persisted despite experience with multiple study-test sessions, use of a forgetting scale to assess predictions, and explicit warning of participants that font size has little effect on memory performance. When ease of reading was manipulated, such that large font size words were made less fluent, the effect was eliminated. Thus, highly accessible perceptual cues can strongly influence JOLs, likely via encoding fluency, and this effect can lead to metacognitive illusions. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Illusions of competence for phonetically, orthographically, and semantically similar word pairs.

Illusions of competence are thought to arise when judgements of learning (JOLs) made in the presence of intact cue-target pairs during study create a “foresight bias,” such that JOLs are inflated by the apparent association between a cue and a target, despite the lack of benefit this association has for recall performance. For example, Castel, McCabe, and Roediger (2007) recently demonstrated an illusion of competence for identical word pairs (mouse—mouse). In two experiments, the authors examined possible sources for this overconfidence, including phonetic, semantic, and orthographic similarity. An illusion of competence was found for homophones, synonyms, orthographically similar, and unrelated items, whereas no illusion of competence was found for word pairs with a relatively high forward-semantic association. Self-paced study times indicated that encoding fluency was not closely associated with the magnitude of overconfidence. Error data revealed participants may have been engaging in strategic responding in order to maximise correct recall. Our results underscore the importance of considering factors that influence both JOLs and recall performance when considering sources of (mis)calibration in absolute accuracy. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

A stability bias in human memory: Overestimating remembering and underestimating learning.

The dynamics of human memory are complex and often unintuitive, but certain features—such as the fact that studying results in learning—seem like common knowledge. In 12 experiments, however, participants who were told they would be allowed to study a list of word pairs between 1 and 4 times and then take a cued-recall test predicted little or no learning across trials, notwithstanding their large increases in actual learning. When queried directly, the participants espoused the belief that studying results in learning, but they showed little evidence of that belief in the actual task. These findings, when combined with A. Koriat, R. A. Bjork, L. Sheffer, and S. K. Bar’s (2004) research on judgments of forgetting, suggest a stability bias in human memory—that is, a tendency to assume that the accessibility of one’s memories will remain relatively stable over time rather than benefiting from future learning or suffering from future forgetting. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

False memory propensity in people reporting recovered memories of past lives.

Are elevated rates of false recall and recognition in the Deese–Roediger–McDermott (DRM) paradigm associated with false autobiographical memories in everyday life? To investigate this issue, the authors recruited participants who reported improbable memories of past lives and compared their DRM performance with that of control participants who reported having lived only one life (i.e., their current one). Relative to control participants, those reporting memories of past lives exhibited significantly higher false recall and recognition rates in the DRM paradigm, and they scored higher on measures of magical ideation and absorption as well. The groups did not differ on correct recall, recognition, or intelligence. False memory propensity in the DRM paradigm may tap proneness for developing false memories outside the laboratory. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Intrinsic frames of reference in spatial memory.

Three experiments investigated the frames of reference used in memory to represent the spatial structure of the environment. Participants learned the locations of objects in a room according to an intrinsic axis of the configuration; the axis was different from or the same as their viewing perspective. Judgments of relative direction using memory were most accurate for imagined headings parallel to the intrinsic axis, even when it differed from the viewing perspective, and there was no cost to learning the layout according to a nonegocentric axis. When the shape of the layout was bilaterally symmetric relative to the intrinsic axis of learning, novel headings orthogonal to that axis were retrieved more accurately than were other novel headings. These results indicate that spatial memories are defined with respect to intrinsic frames of reference, which are selected on the basis of egocentric experience and environmental cues. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

On the role of individual items in recognition memory and metacognition: Challenges for signal detection theory.

The authors tested the role of individual items in recognition memory using a forced-choice paradigm with face stimuli. They constructed distractor stimuli using morphing procedures that were similar to two parent faces and then compared a studied morph against an unstudied morph that was similar to two studied parents. The similarity of the parent faces was carefully balanced so that the choosing rates for the studied and unstudied morphs were approximately equal. Despite being equally likely to choose the studied and the unstudied morph, participants were systematically more confident when choosing the studied morph. This result is incompatible with Gaussian signal detection theory, even with unequal variances for targets and distractors. The authors propose an extension of an extant sampling model, SimSample, which provides a qualitative and quantitative account of the confidence and recognition dissociation. The results suggest that observers make contact with individual items when making recognition judgments with faces and that the structure of the sampling and decision process naturally leads to this dissociation of confidence and recognition. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The intermixed-blocked effect in human perceptual learning is not the consequence of trial spacing.

A robust finding in humans and animals is that intermixed exposure to 2 similar stimuli (AX/BX) results in better discriminability of those stimuli on test than does exposure to 2 equally similar stimuli in 2 separate blocks (CX_DX)--the intermixed-blocked effect. This intermixed-blocked effect may be an example of the superiority of spaced over massed practice; in the intermixed, but not the blocked exposure regime, each presentation of a given stimulus (e.g., AX) is separated from the next by the presentation of its partner (BX). Two experiments with human participants replicated the intermixed-blocked effect and showed that the effect was not due to the spacing of exposure trials. A mechanism for the intermixed-blocked effect is proposed, which combines theories from associative learning and memory. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The interplay between value and relatedness as bases for metacognitive monitoring and control: Evidence for agenda-based monitoring.

Two experiments are reported examining how value and relatedness interact to influence metacognitive monitoring and control processes. Participants studied unrelated and related word pairs, each accompanied by point values denoting how important the items were to remember. These values were presented either before or after each pair in a between-subjects design, and participants made item-by-item judgments of learning (JOLs) predicting the likelihood that each item would be remembered later. Results from Experiment 1 showed that participants used value and relatedness as cues to inform their JOLs. Interestingly, JOLs increased as a function of value even in the after condition in which value had no impact on cued recall. Participants in Experiment 2 were permitted to control study time for each item. Results showed that value and relatedness were simultaneously considered when allocating study time. These results support a cue-weighting process in which JOLs and study time allocation are based on multiple cues, which may or may not be predictive of future memory performance, and complements the agenda-based regulation model of study time (Ariel, Dunlosky, & Bailey, 2009) by providing evidence for agenda-based monitoring. (PsycINFO Database Record (c) 2011 APA, all rights reserved)