Comprehension as a basis for metacognitive judgments: Effects of effort after meaning on recall and metacognition.

We examined free recall and metacognitive judgments of ambiguous sentences studied with and without clues to facilitate their comprehension. Sentences were either studied without clues, with clues meaningfully embedded, or with clues following a 10-s interval delay. After presentation, subjects made judgments of comprehension (JCOMPs) or judgments of learning (JOLs). Puzzling over the meaning of sentences for several seconds prior to receiving the clue enhanced recall compared with studying sentences without clues or with embedded clues. This benefit of effort after meaning was not reflected in JCOMPs or JOLs. Rather, sentences considered relatively easy to understand received higher JOLs regardless of experimental condition. Although effort after meaning enhanced recall, subjects displayed no awareness of this benefit in their judgments. Our study adds to a growing literature showing students’ ignorance of factors affecting their own learning, which have important implications for education. Making learning conditions more difficult, thus requiring students to engage more cognitive effort, often leads to enhanced retention. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The influence of delaying judgments of learning on metacognitive accuracy: A meta-analytic review.

Many studies have examined the accuracy of predictions of future memory performance solicited through judgments of learning (JOLs). Among the most robust findings in this literature is that delaying predictions serves to substantially increase the relative accuracy of JOLs compared with soliciting JOLs immediately after study, a finding termed the delayed JOL effect. The meta-analyses reported in the current study examined the predominant theoretical accounts as well as potential moderators of the delayed JOL effect. The first meta-analysis examined the relative accuracy of delayed compared with immediate JOLs across 4,554 participants (112 effect sizes) through gamma correlations between JOLs and memory accuracy. Those data showed that delaying JOLs leads to robust benefits to relative accuracy (g = 0.93). The second meta-analysis examined memory performance for delayed compared with immediate JOLs across 3,807 participants (98 effect sizes). Those data showed that delayed JOLs result in a modest but reliable benefit for memory performance relative to immediate JOLs (g = 0.08). Findings from these meta-analyses are well accommodated by theories suggesting that delayed JOL accuracy reflects access to more diagnostic information from long-term memory rather than being a by-product of a retrieval opportunity. However, these data also suggest that theories proposing that the delayed JOL effect results from a memorial benefit or the match between the cues available for JOLs and those available at test may also provide viable explanatory mechanisms necessary for a comprehensive account. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Mending metacognitive illusions: A comparison of mnemonic-based and theory-based procedures.

Previous research indicated that learners experience an illusion of competence during learning (termed foresight bias) because judgments of learning (JOLs) are made in the presence of information that will be absent at test. The authors examined the following 2 procedures for alleviating foresight bias: enhancing learners' sensitivity to mnemonic cues pertaining to ease of retrieval and inducing learners to resort to theory-based judgments as a basis for JOLs. Both procedures proved effective in mending metacognitive illusions--as reflected in JOLs and self-regulation of study time--but only theory-based debiasing yielded transfer to new items. The results support the notion that improved metacognition is 1 key to optimizing transfer but also that educating subjective experience does not guarantee generalization to new situations. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The interplay between value and relatedness as bases for metacognitive monitoring and control: Evidence for agenda-based monitoring.

Two experiments are reported examining how value and relatedness interact to influence metacognitive monitoring and control processes. Participants studied unrelated and related word pairs, each accompanied by point values denoting how important the items were to remember. These values were presented either before or after each pair in a between-subjects design, and participants made item-by-item judgments of learning (JOLs) predicting the likelihood that each item would be remembered later. Results from Experiment 1 showed that participants used value and relatedness as cues to inform their JOLs. Interestingly, JOLs increased as a function of value even in the after condition in which value had no impact on cued recall. Participants in Experiment 2 were permitted to control study time for each item. Results showed that value and relatedness were simultaneously considered when allocating study time. These results support a cue-weighting process in which JOLs and study time allocation are based on multiple cues, which may or may not be predictive of future memory performance, and complements the agenda-based regulation model of study time (Ariel, Dunlosky, & Bailey, 2009) by providing evidence for agenda-based monitoring. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Memory predictions are influenced by perceptual information: Evidence for metacognitive illusions.

Although perceptual information is utilized to judge size or depth, little work has investigated whether such information is used to make memory predictions. The present study examined how the font size of to-be-remembered words influences predicted memory performance. Participants studied words for a free-recall test that varied in font size and made judgments of learning (JOLs) for each item. JOLs were influenced by font size, as larger font sizes were given higher JOLs, whereas little relationship was evident between font size and recall. The effect was modified when other, more valid, sources of information (e.g., associative strength) were available when JOLs were made and persisted despite experience with multiple study-test sessions, use of a forgetting scale to assess predictions, and explicit warning of participants that font size has little effect on memory performance. When ease of reading was manipulated, such that large font size words were made less fluent, the effect was eliminated. Thus, highly accessible perceptual cues can strongly influence JOLs, likely via encoding fluency, and this effect can lead to metacognitive illusions. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Aging and recollection in the accuracy of judgments of learning.

Dual-process theories propose that episodic memory performance reflects both recollection of prior details as well as more automatic influences of the past. The authors explored the idea that recollection mediates the accuracy of judgments of learning (JOLs) and may also help explain age differences in JOL accuracy. Young and older adults made immediate JOLs at study and then completed recognition or recall tests that included a recollect/familiar judgment. JOLs were found to be strongly related to recollected items but not to items remembered on the basis of familiarity. The pattern was weaker in older adults, consistent with age-related declines in recollection. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Dynamics of metacognitive judgments: Pre- and postretrieval mechanisms.

Two experiments examined the temporal course of pre- and postretrieval mechanisms using a new kind of dynamic metacognitive judgment. Experiment 1 presented participants with primed and unprimed triples of remote associates to a target word and required them to provide repeated metacognitive judgments, 4 times during a 12-s interval, about the likelihood that they would later recognize the target. Both familiarity with the words and the processing time were associated with changes in metacognitive evaluations. Experiment 2 placed pre- and postretrieval mechanisms in opposition by transforming an element of a previously primed question. For transformed questions this led to high initial ratings, which decreased over time, while for novel questions the ratings were initially lower and increased with time. The results are discussed in terms of pre- and postretrieval mechanisms interacting over time. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Separating bias and sensitivity in judgments of associative memory.

Ratings of the degree of association between words are linearly related to normed associative strengths, but the intercept is high, and the slope is shallow (the judgments of associative memory [JAM] function). Two experiments included manipulations intended to decrease the intercept and increase the slope. Discrimination training on many pairs of words and constraining ratings to sum to a constant both reduced the intercept but failed to change the slope. The intercept of the JAM function appears to contain a bias component that can be manipulated independently of the slope, which reflects sensitivity to associative strengths. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Illusions of competence for phonetically, orthographically, and semantically similar word pairs.

Illusions of competence are thought to arise when judgements of learning (JOLs) made in the presence of intact cue-target pairs during study create a “foresight bias,” such that JOLs are inflated by the apparent association between a cue and a target, despite the lack of benefit this association has for recall performance. For example, Castel, McCabe, and Roediger (2007) recently demonstrated an illusion of competence for identical word pairs (mouse—mouse). In two experiments, the authors examined possible sources for this overconfidence, including phonetic, semantic, and orthographic similarity. An illusion of competence was found for homophones, synonyms, orthographically similar, and unrelated items, whereas no illusion of competence was found for word pairs with a relatively high forward-semantic association. Self-paced study times indicated that encoding fluency was not closely associated with the magnitude of overconfidence. Error data revealed participants may have been engaging in strategic responding in order to maximise correct recall. Our results underscore the importance of considering factors that influence both JOLs and recall performance when considering sources of (mis)calibration in absolute accuracy. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The intricate relationships between monitoring and control in metacognition: Lessons for the cause-and-effect relation between subjective experience and behavior.

Do we run away because we are frightened, or are we frightened because we run away? The authors address this issue with respect to the relation between metacognitive monitoring and metacognitive control. When self-regulation is goal driven, monitoring effects control processes so that increased processing effort should enhance feelings of competence and feelings of knowing. In contrast, when self-regulation is data driven, such feelings may be based themselves on the feedback from control processes, in which case they should decrease with increasing effort. Evidence for both monitoring-based control and control-based monitoring occurring even in the same situation is presented. The results are discussed with regard to the issue of the cause-and-effect relation between subjective experience and behavior. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Finding the self in metacognitive evaluations: Metamemory and agency in nondemented elders.

Objective: Metacognitive methodologies are used to examine the integrity of self-referential processing in healthy adults and have been implemented to study disorders of the self-concept in neurologic and psychiatric populations. However, the extent to which metacognitive evaluations assess a uniquely self-evaluative capacity that cannot be explained fully by primary cognitive functions, demographics, or mood is not clear. The objective of the current study was to examine whether metamemory and a metacognitive test of agency shared a self-referential association that would not be explained by cognition, demographics, or mood. Method: Thirty-eight nondemented older adults (Mini Mental State Examination [MMSE] ≥24 and mean age = 68.13) participated in metacognitive testing and completed cognitive testing and mood questionnaires. Bivariate correlations were used to evaluate the association between metamemory and agency, and to determine the cognitive (memory, attention, and executive functioning), demographic (age and education), and mood (anxiety and depression) correlates of each. Correlates of metamemory and agency were then entered into linear regression models to determine whether any association between metacognitive measures remained. Results: Metamemory was associated with agency judgments (n = 27), specifically those on self-controlled rather than computer-controlled trials (r = .41, p = .03). Regression results supported a role for agency in predicting metamemory, above and beyond memory and education (β = .39, p = .034). Metamemory was also an independent predictor of agency judgments (β = .36, p = .049). Conclusions: The interrelation between metamemory and agency judgments suggests that metacognitive testing captures an important aspect of self-referential processing not otherwise assessed in a standard cognitive evaluation and may provide unique information about self-evaluative capacities in clinical populations. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Familiarity and retrieval processes in delayed judgments of learning.

Two processes are postulated to underlie delayed judgments of learning (JOLs)--cue familiarity and target retrievability. The two processes are distinguishable because the familiarity-based judgments are thought to be faster than the retrieval-based processes, because only retrieval-based JOLs should enhance the relative accuracy of the correlations between the JOLs and criterion test performance, and because only retrieval-based judgments should enhance memory. To test these predictions, in three experiments, the authors either speeded people's JOLs or allowed them to be unspeeded. The relative accuracy of the JOLs in predicting performance on the criterion test was higher for the unspeeded JOLs than for the speeded JOLs, as predicted. The unspeeded JOL conditions showed enhanced memory as compared with the speeded JOL conditions, as predicted. Finally, the unspeeded JOLs were sensitive to manipulations that modified recallability of the target, whereas the speeded JOLs were selectively sensitive to experimental variations in the familiarity of the cues. Thus, all three of the predictions about the consequences of the two processes potentially underlying delayed JOLs were borne out. A model of the processes underlying delayed JOLs based on these and earlier results is presented. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Encoding fluency is a cue used for judgments about learning.

The authors used paired-associate learning to investigate the hypothesis that the speed of generating an interactive image (encoding fluency) influenced 2 metacognitive judgments: judgments of learning (JOLs) and quality of encoding ratings (QUEs). Results from Experiments 1 and 2 indicated that latency of a keypress indicating successful image formation was negatively related to both JOLs and QUEs even though latency was unrelated to recall. Experiment 3 demonstrated that when concrete and abstract items were mixed in a single list, latency was related to concreteness, judgments, and recall. However, item concreteness and fluency influenced judgments independently of one another. These outcomes suggest an important role of encoding fluency in the formation of metacognitive judgments about learning and future recall. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Metamemory judgments and the benefits of repeated study: Improving recall predictions through the activation of appropriate knowledge.

Correspondence between judgments of learning (JOLs) and actual recall tends to be poor when the same items are studied and recalled multiple times (e.g., A. Koriat, L. Sheffer, & H. Ma’ayan, 2002). The authors investigated whether making relevant metamemory knowledge more salient would improve the association between actual and predicted recall as a function of repeated exposure to the same study list. In 2 experiments, participants completed 4 study–recall phases involving the same list of items. In addition to having participants make item-by-item JOLs during each study phase, after the 1st study–recall phase participants also generated change-in-recall estimates as to how many more or fewer words they would recall given another exposure to the same study list. This estimation procedure was designed to highlight repeated study as a factor that can contribute to recall performance. Activating metamemory knowledge about the benefits of repeated study for recall in this way allowed participants to accurately express this knowledge in a free-recall context (Experiment 2), but less so when the memory test was cued recall (Experiment 1). (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Effect of changes in self-esteem upon impulsiveness and deliberation in making judgments.

The need for closure, i.e., the effort to impart meaning to situations, is assumed to be related to the personality variable of self-esteem. Self-esteem was manipulated experimentally and hypotheses tested as to the effect of increased or decreased self-esteem on the need for closure. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Flexible corrections of juror judgments: Implications for jury instructions.

The Flexible Correction Model (FCM, D. T. Wegener & R. E. Petty, 1997; D. T. Wegener, R. E. Petty, & M. Dunn, 1998) conceptualizes efforts at bias correction (i.e., attempts to remove influences that are perceived as illegitimate or unwanted) as guided by people's naive theories (perceptions) of the influences at work in that judgment setting. In this article, the authors present this model, discuss the general support for this model outside of courtroom judgment, and discuss a variety of implications of this model for courtroom judgment in general and for the impact of judges' instructions to juries in particular. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Metacognition in motor learning.

Research on judgments of verbal learning has demonstrated that participants' judgments are unreliable and often overconfident. The authors studied judgments of perceptual-motor learning. Participants learned 3 keystroke patterns on the number pad of a computer, each requiring that a different sequence of keys be struck in a different total movement time. Practice trials on each pattern were either blocked or randomly interleaved with trials on the other patterns, and each participant was asked, periodically, to predict his or her performance on a 24-hr test. Consistent with earlier findings, blocked practice enhanced acquisition but harmed retention. Participants, though, predicted better performance given blocked practice. These results augment research on judgments of verbal learning and suggest that humans, at their peril, interpret current ease of access to a perceptual-motor skill as a valid index of learning. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Recollection-based prospective metamemory judgments are more accurate than those based on confidence: Judgments of remembering and knowing (JORKS).

Five experiments were conducted to examine whether the nature of the information that is monitored during prospective metamemory judgments affected the relative accuracy of those judgments. We compared item-by-item judgments of learning (JOLs), which involved participants determining how confident they were that they would remember studied items, with judgments of remembering and knowing (JORKs), which involved participants determining whether studied items would later be accompanied by contextual details (i.e., remembering) or would not (i.e., knowing). JORKs were more accurate than JOLs when remember–know or confidence judgments were made at test and when cued recall was the outcome measure, but not for yes–no recognition. We conclude that the accuracy of metamemory judgments depends on the nature of the information monitored during study and test and that metamemory monitoring can be improved if participants are asked to base their judgments on contextual details rather than on confidence. These data support the contention that metamemory decisions can be based on qualitatively distinct cues, rather than an overall memory strength signal. (PsycINFO Database Record (c) 2011 APA, all rights reserved)