Comprehension as a basis for metacognitive judgments: Effects of effort after meaning on recall and metacognition.

We examined free recall and metacognitive judgments of ambiguous sentences studied with and without clues to facilitate their comprehension. Sentences were either studied without clues, with clues meaningfully embedded, or with clues following a 10-s interval delay. After presentation, subjects made judgments of comprehension (JCOMPs) or judgments of learning (JOLs). Puzzling over the meaning of sentences for several seconds prior to receiving the clue enhanced recall compared with studying sentences without clues or with embedded clues. This benefit of effort after meaning was not reflected in JCOMPs or JOLs. Rather, sentences considered relatively easy to understand received higher JOLs regardless of experimental condition. Although effort after meaning enhanced recall, subjects displayed no awareness of this benefit in their judgments. Our study adds to a growing literature showing students’ ignorance of factors affecting their own learning, which have important implications for education. Making learning conditions more difficult, thus requiring students to engage more cognitive effort, often leads to enhanced retention. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Aging and recollection in the accuracy of judgments of learning.

Dual-process theories propose that episodic memory performance reflects both recollection of prior details as well as more automatic influences of the past. The authors explored the idea that recollection mediates the accuracy of judgments of learning (JOLs) and may also help explain age differences in JOL accuracy. Young and older adults made immediate JOLs at study and then completed recognition or recall tests that included a recollect/familiar judgment. JOLs were found to be strongly related to recollected items but not to items remembered on the basis of familiarity. The pattern was weaker in older adults, consistent with age-related declines in recollection. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Memory predictions are influenced by perceptual information: Evidence for metacognitive illusions.

Although perceptual information is utilized to judge size or depth, little work has investigated whether such information is used to make memory predictions. The present study examined how the font size of to-be-remembered words influences predicted memory performance. Participants studied words for a free-recall test that varied in font size and made judgments of learning (JOLs) for each item. JOLs were influenced by font size, as larger font sizes were given higher JOLs, whereas little relationship was evident between font size and recall. The effect was modified when other, more valid, sources of information (e.g., associative strength) were available when JOLs were made and persisted despite experience with multiple study-test sessions, use of a forgetting scale to assess predictions, and explicit warning of participants that font size has little effect on memory performance. When ease of reading was manipulated, such that large font size words were made less fluent, the effect was eliminated. Thus, highly accessible perceptual cues can strongly influence JOLs, likely via encoding fluency, and this effect can lead to metacognitive illusions. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Attributing study effort to data-driven and goal-driven effects: Implications for metacognitive judgments.

In self-paced learning, when the regulation of effort is goal driven (e.g., allocated to different items according to their relative importance), judgments of learning (JOLs) increase with study time. When it is data driven (i.e., determined by the ease of committing the item to memory), JOLs decrease with study time (Koriat, Ma’ayan, & Nussinson, 2006). Because the amount of effort invested in different items is conjointly determined by data-driven and goal-driven regulation, an attribution process must be postulated in which variations in effort are attributed by the learner to data-driven or goal-driven regulation before the implications for metacognitive judgments are determined. To support the reality of this process, the authors asked learners to adopt a facial expression that creates a feeling of effort and induced them to attribute that effort either to data-driven or to goal-driven regulation. This manipulation was found to determine the direction in which experienced effort affected metacognitive judgment. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Recollection-based prospective metamemory judgments are more accurate than those based on confidence: Judgments of remembering and knowing (JORKS).

Five experiments were conducted to examine whether the nature of the information that is monitored during prospective metamemory judgments affected the relative accuracy of those judgments. We compared item-by-item judgments of learning (JOLs), which involved participants determining how confident they were that they would remember studied items, with judgments of remembering and knowing (JORKs), which involved participants determining whether studied items would later be accompanied by contextual details (i.e., remembering) or would not (i.e., knowing). JORKs were more accurate than JOLs when remember–know or confidence judgments were made at test and when cued recall was the outcome measure, but not for yes–no recognition. We conclude that the accuracy of metamemory judgments depends on the nature of the information monitored during study and test and that metamemory monitoring can be improved if participants are asked to base their judgments on contextual details rather than on confidence. These data support the contention that metamemory decisions can be based on qualitatively distinct cues, rather than an overall memory strength signal. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Mending metacognitive illusions: A comparison of mnemonic-based and theory-based procedures.

Previous research indicated that learners experience an illusion of competence during learning (termed foresight bias) because judgments of learning (JOLs) are made in the presence of information that will be absent at test. The authors examined the following 2 procedures for alleviating foresight bias: enhancing learners' sensitivity to mnemonic cues pertaining to ease of retrieval and inducing learners to resort to theory-based judgments as a basis for JOLs. Both procedures proved effective in mending metacognitive illusions--as reflected in JOLs and self-regulation of study time--but only theory-based debiasing yielded transfer to new items. The results support the notion that improved metacognition is 1 key to optimizing transfer but also that educating subjective experience does not guarantee generalization to new situations. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Familiarity and retrieval processes in delayed judgments of learning.

Two processes are postulated to underlie delayed judgments of learning (JOLs)--cue familiarity and target retrievability. The two processes are distinguishable because the familiarity-based judgments are thought to be faster than the retrieval-based processes, because only retrieval-based JOLs should enhance the relative accuracy of the correlations between the JOLs and criterion test performance, and because only retrieval-based judgments should enhance memory. To test these predictions, in three experiments, the authors either speeded people's JOLs or allowed them to be unspeeded. The relative accuracy of the JOLs in predicting performance on the criterion test was higher for the unspeeded JOLs than for the speeded JOLs, as predicted. The unspeeded JOL conditions showed enhanced memory as compared with the speeded JOL conditions, as predicted. Finally, the unspeeded JOLs were sensitive to manipulations that modified recallability of the target, whereas the speeded JOLs were selectively sensitive to experimental variations in the familiarity of the cues. Thus, all three of the predictions about the consequences of the two processes potentially underlying delayed JOLs were borne out. A model of the processes underlying delayed JOLs based on these and earlier results is presented. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Separating bias and sensitivity in judgments of associative memory.

Ratings of the degree of association between words are linearly related to normed associative strengths, but the intercept is high, and the slope is shallow (the judgments of associative memory [JAM] function). Two experiments included manipulations intended to decrease the intercept and increase the slope. Discrimination training on many pairs of words and constraining ratings to sum to a constant both reduced the intercept but failed to change the slope. The intercept of the JAM function appears to contain a bias component that can be manipulated independently of the slope, which reflects sensitivity to associative strengths. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Metamemory judgments and the benefits of repeated study: Improving recall predictions through the activation of appropriate knowledge.

Correspondence between judgments of learning (JOLs) and actual recall tends to be poor when the same items are studied and recalled multiple times (e.g., A. Koriat, L. Sheffer, & H. Ma’ayan, 2002). The authors investigated whether making relevant metamemory knowledge more salient would improve the association between actual and predicted recall as a function of repeated exposure to the same study list. In 2 experiments, participants completed 4 study–recall phases involving the same list of items. In addition to having participants make item-by-item JOLs during each study phase, after the 1st study–recall phase participants also generated change-in-recall estimates as to how many more or fewer words they would recall given another exposure to the same study list. This estimation procedure was designed to highlight repeated study as a factor that can contribute to recall performance. Activating metamemory knowledge about the benefits of repeated study for recall in this way allowed participants to accurately express this knowledge in a free-recall context (Experiment 2), but less so when the memory test was cued recall (Experiment 1). (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Metacognition in motor learning.

Research on judgments of verbal learning has demonstrated that participants' judgments are unreliable and often overconfident. The authors studied judgments of perceptual-motor learning. Participants learned 3 keystroke patterns on the number pad of a computer, each requiring that a different sequence of keys be struck in a different total movement time. Practice trials on each pattern were either blocked or randomly interleaved with trials on the other patterns, and each participant was asked, periodically, to predict his or her performance on a 24-hr test. Consistent with earlier findings, blocked practice enhanced acquisition but harmed retention. Participants, though, predicted better performance given blocked practice. These results augment research on judgments of verbal learning and suggest that humans, at their peril, interpret current ease of access to a perceptual-motor skill as a valid index of learning. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The interplay between value and relatedness as bases for metacognitive monitoring and control: Evidence for agenda-based monitoring.

Two experiments are reported examining how value and relatedness interact to influence metacognitive monitoring and control processes. Participants studied unrelated and related word pairs, each accompanied by point values denoting how important the items were to remember. These values were presented either before or after each pair in a between-subjects design, and participants made item-by-item judgments of learning (JOLs) predicting the likelihood that each item would be remembered later. Results from Experiment 1 showed that participants used value and relatedness as cues to inform their JOLs. Interestingly, JOLs increased as a function of value even in the after condition in which value had no impact on cued recall. Participants in Experiment 2 were permitted to control study time for each item. Results showed that value and relatedness were simultaneously considered when allocating study time. These results support a cue-weighting process in which JOLs and study time allocation are based on multiple cues, which may or may not be predictive of future memory performance, and complements the agenda-based regulation model of study time (Ariel, Dunlosky, & Bailey, 2009) by providing evidence for agenda-based monitoring. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Solve the problem first: Constructive solution strategies can influence the accuracy of retrospective confidence judgments.

Two experiments tested whether differences in problem-solving strategies influence the ability of people to monitor their problem-solving effectiveness as measured by confidence judgments. On multiple choice problems, people tend to use either a constructive matching strategy, whereby they attempt to solve a problem before looking at the response options, or a response elimination strategy, whereby they work backward from response options trying to find one that fits as a solution. Constructive matching gives rise to different cues that may enhance confidence monitoring. Experiment 1 showed that spontaneous constructive matching in nonverbal spatial reasoning problems was associated with better confidence calibration and resolution than response elimination. We manipulated strategy in Experiment 2 by requiring constructive matching and found improved monitoring. Implications for research on monitoring, overconfidence, and the association between skill and monitoring are discussed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Finding the self in metacognitive evaluations: Metamemory and agency in nondemented elders.

Objective: Metacognitive methodologies are used to examine the integrity of self-referential processing in healthy adults and have been implemented to study disorders of the self-concept in neurologic and psychiatric populations. However, the extent to which metacognitive evaluations assess a uniquely self-evaluative capacity that cannot be explained fully by primary cognitive functions, demographics, or mood is not clear. The objective of the current study was to examine whether metamemory and a metacognitive test of agency shared a self-referential association that would not be explained by cognition, demographics, or mood. Method: Thirty-eight nondemented older adults (Mini Mental State Examination [MMSE] ≥24 and mean age = 68.13) participated in metacognitive testing and completed cognitive testing and mood questionnaires. Bivariate correlations were used to evaluate the association between metamemory and agency, and to determine the cognitive (memory, attention, and executive functioning), demographic (age and education), and mood (anxiety and depression) correlates of each. Correlates of metamemory and agency were then entered into linear regression models to determine whether any association between metacognitive measures remained. Results: Metamemory was associated with agency judgments (n = 27), specifically those on self-controlled rather than computer-controlled trials (r = .41, p = .03). Regression results supported a role for agency in predicting metamemory, above and beyond memory and education (β = .39, p = .034). Metamemory was also an independent predictor of agency judgments (β = .36, p = .049). Conclusions: The interrelation between metamemory and agency judgments suggests that metacognitive testing captures an important aspect of self-referential processing not otherwise assessed in a standard cognitive evaluation and may provide unique information about self-evaluative capacities in clinical populations. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Metacognition in prospective memory: Are performance predictions accurate?

This study investigated the role of metacognition in event-based prospective memory. The aim of the study was to explore the relation between an item-level prediction (judgments of learning, JOL) and actual performance. The task and JOLs allowed a differentiation of the two components of prospective memory tasks (retrospective vs. prospective). Results revealed that individuals' predictions were (moderately) accurate for delayed JOLs but not for JOLs that had to be given immediately after task encoding. Moreover, data revealed an underconfidence-with-practice effect only for the retrospective component. For the prospective component, a substantial and general level of underconfidence in individuals' prediction–performance ratios was observed. The importance of metacognitive factors for prospective memory is discussed. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Judgments of learning reflect encoding fluency: Conclusive evidence for the ease-of-processing hypothesis.

According to the ease-of-processing hypothesis, judgments of learning (JOLs) rely on the ease with which items are committed to memory during encoding—that is, encoding fluency. Conclusive evidence for this hypothesis does not yet exist because encoding fluency and item difficulty have been confounded in all previous studies. To disentangle the effects of encoding fluency and item difficulty on JOLs, we used a variant of the learner–observer–judge method in which participants observed the study phase of another participant and indicated his or her JOLs. At the same time, the to-be-studied word pairs were concealed by strings of symbols. Our experiment revealed that participants use self-paced study time as a cue for JOLs when they themselves have studied and recalled word pairs before. This metacognitive monitoring of study time provides strong support for the ease-of-processing hypothesis. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Encoding fluency is a cue used for judgments about learning.

The authors used paired-associate learning to investigate the hypothesis that the speed of generating an interactive image (encoding fluency) influenced 2 metacognitive judgments: judgments of learning (JOLs) and quality of encoding ratings (QUEs). Results from Experiments 1 and 2 indicated that latency of a keypress indicating successful image formation was negatively related to both JOLs and QUEs even though latency was unrelated to recall. Experiment 3 demonstrated that when concrete and abstract items were mixed in a single list, latency was related to concreteness, judgments, and recall. However, item concreteness and fluency influenced judgments independently of one another. These outcomes suggest an important role of encoding fluency in the formation of metacognitive judgments about learning and future recall. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Does aging influence people's metacomprehension? Effects of processing ease on judgments of text learning.

In 2 experiments, the authors investigated whether age-related differences exist in metacomprehension by evaluating predictions based on the ease-of-processing (EOP) hypothesis. According to this hypothesis, judgments of how well a text has been learned are based on how easily each text was processed; easier processing results in higher judgments. Participants read either sentence pairs or longer texts and judged their learning of each immediately afterward. Although an age-related difference in the use of processing ease in judgments was observed with sentence pairs, for longer texts older and younger adults' judgments were similarly related to processing ease. In both experiments, age equivalence was also evident in the accuracy of the judgments at predicting performance on the criterion test. The overall pattern of results suggests that judging text learning remains largely intact with aging. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

A stability bias in human memory: Overestimating remembering and underestimating learning.

The dynamics of human memory are complex and often unintuitive, but certain features—such as the fact that studying results in learning—seem like common knowledge. In 12 experiments, however, participants who were told they would be allowed to study a list of word pairs between 1 and 4 times and then take a cued-recall test predicted little or no learning across trials, notwithstanding their large increases in actual learning. When queried directly, the participants espoused the belief that studying results in learning, but they showed little evidence of that belief in the actual task. These findings, when combined with A. Koriat, R. A. Bjork, L. Sheffer, and S. K. Bar’s (2004) research on judgments of forgetting, suggest a stability bias in human memory—that is, a tendency to assume that the accessibility of one’s memories will remain relatively stable over time rather than benefiting from future learning or suffering from future forgetting. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Dynamics of metacognitive judgments: Pre- and postretrieval mechanisms.

Two experiments examined the temporal course of pre- and postretrieval mechanisms using a new kind of dynamic metacognitive judgment. Experiment 1 presented participants with primed and unprimed triples of remote associates to a target word and required them to provide repeated metacognitive judgments, 4 times during a 12-s interval, about the likelihood that they would later recognize the target. Both familiarity with the words and the processing time were associated with changes in metacognitive evaluations. Experiment 2 placed pre- and postretrieval mechanisms in opposition by transforming an element of a previously primed question. For transformed questions this led to high initial ratings, which decreased over time, while for novel questions the ratings were initially lower and increased with time. The results are discussed in terms of pre- and postretrieval mechanisms interacting over time. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Age differences in the monitoring of learning: Cross-sectional evidence of spared resolution across the adult life span.

Researchers of metacognitive development in adulthood have exclusively used extreme-age-groups designs. We used a full cross-sectional sample (N = 285, age range: 18–80) to evaluate how associative relatedness and encoding strategies influence judgments of learning (JOLs) in adulthood. Participants studied related and unrelated word pairs and made JOLs. After a cued-recall test, retrospective item strategy reports were collected. Results revealed developmental patterns not available from previous studies (e.g., a linear age-related increase in aggregate JOL resolution across the life span). They also demonstrated the value of investigating multiple cues' influences on JOLs. Multilevel regression models showed that both relatedness and effective strategy use positively and independently influenced JOLs. Furthermore, effective strategy use was responsible for higher resolution of JOLs for unrelated items (relative to related items). The effects of relatedness and strategy use with JOLs did not interact with age. The monitoring of learning is spared by adult development despite age differences in learning itself. (PsycINFO Database Record (c) 2010 APA, all rights reserved)