Abstract
Three experiments tested the hypothesis that people make judgments of learning (JOLs) by attempting to retrieve the target first. If this were the whole story, then the reaction time (RT) functions for making JOLs with no special instructions would parallel those found when people are told to first attempt retrieval and then make a JOL. In the present data, monotonic functions, showing an increase in RT with decreasing JOL, were found when people were instructed to retrieve covertly or overtly and then make a JOL, as would be expected if retrieval fluency entirely determined JOLs. However, the functions for making uninstructed JOLs were different: Low JOLs were made quickly, not slowly, and the curves were inverted U shapes, rather than linear. Furthermore, people’s memory performance was somewhat better, especially on low-JOL items, when they were instructed to first retrieve as opposed to when they were told only to make JOLs. To account for these data, we propose a two-stage model of JOLs, with the first stage occurring prior to attempted retrieval.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Atkinson, R. C., Hermann, D. J., &Wescourt, K. T. (1974). Search processes in recognition memory. In R. L. Solso (Ed.),Theories in cognitive psychology: The Loyola Symposium. Potomac, MD: Erlbaum.
Bacon, E., Danion, M.-J., Kauffmann-Muller, F., Schelstraete, M.-A., Bruant, A., Sellal, F., &Grange, D. (1998). Confidence level and feeling of knowing for episodic and semantic memory: An investigation of lorazepam effects on metamemory.Psychopharmacology,138, 318–325.
Begg, I., Duft, S., Lalonde, P., Melnick, R., &Sanvito, J. (1989). Memory predictions are based on ease of processing.Journal of Memory & Language,28, 610–632.
Benjamin, A. S., Bjork, R. A., &Schwartz, B. L. (1998). The mismeasure of memory: When retrieval fluency is misleading as a metamnemonic index.Journal of Experimental Psychology: General,127, 55–68.
Costermans, J., Lories, G., &Ansay, C. (1992). Confidence level and feeling of knowing in question answering: The weight of inferential processes.Journal of Experimental Psychology: Learning, Memory, and Cognition,18, 142–150.
Dunlosky, J., &Hertzog, C. (1998). Training programs to improve learning in later adulthood: Helping older adults educate themselves. In D. J. Hacker, J. Dunlosky, & A. C. Graesser (Eds.),Metacognition in educational theory and practice (pp. 249–276). Mahwah, NJ: Erlbaum.
Dunlosky, J., &Nelson, T. O. (1994). Does the sensitivity of judgments of learning (JOLs) to the effects of various study activities depend on when the JOLs occur?Journal of Memory & Language,33, 545–565.
Dunlosky, J., Rawson, K. A., &McDonald, S. L. (2002). Influence of practice tests on the accuracy of predicting memory performance for paired associates, sentences, and text material. In T. J. Perfect & B. L. Schwartz (Eds.),Applied metacognition (pp. 68–92). Cambridge: Cambridge University Press.
Glenberg, A. M. (1987). Temporal context and recency. In D. S. Gorfein & R. R. Hoffman (Eds.),Memory and learning: The Ebbinghaus Centennial Conference (pp. 173–190). Hillsdale, NJ: Erlbaum.
Glenberg, A. M., Sanocki, T., Epstein, W., &Morris, C. (1987). Enhancing calibration of comprehension.Journal of Experimental Psychology: General,116, 119–136.
Glucksberg, S., &McCloskey, M. (1981). Decisions about ignorance: Knowing that you don’t know.Journal of Experimental Psychology: Human Learning & Memory,7, 311–325.
Gruppuso, V., Lindsay, D. S., &Kelley, C. M. (1997). The processdissociation procedure and similarity: Defining and estimating recollection and familiarity in recognition memory.Journal of Experimental Psychology: Learning, Memory, & Cognition,23, 259–278.
Hintzman, D. L., Caulton, D. A., &Levitin, D. J. (1998). Retrieval dynamics in recognition and list discrimination: Further evidence of separate processes of familiarity and recall.Memory & Cognition,26, 449–462.
Jacoby, L. L. (1991). A process dissociation framework: Separating automatic from intentional uses of memory.Journal of Memory & Language,30, 513–541.
Jacoby, L. L., Jones, T. C., &Dolan, P. O. (1998). Two effects of repetition: Support for a dual-process model of know judgments and exclusion errors.Psychonomic Bulletin & Review,5, 705–709.
Jones, W. P., &Anderson, J. R. (1982). Semantic categorization and high-speed scanning.Journal of Experimental Psychology: Learning, Memory, & Cognition,8, 237–242.
Juola, J. F., &Atkinson, R. C. (1971). Memory scanning for words versus categories.Journal of Verbal Learning & Verbal Behavior,10, 522–527.
Juola, J. F., Fischler, I., Wood, C. T., &Atkinson, R. C. (1971). Recognition time for information stored in long-term memory.Perception & Psychophysics,10, 8–14.
Kelemen, W. L. (2000). Metamemory cues and monitoring accuracy: Judging what you know and what you will know.Journal of Educational Psychology,92, 800–810.
Kelemen, W. L., &Weaver, C. A. (1997). Enhanced metamemory at delays: Why do judgments of learning improve over time?Journal of Experimental Psychology: Learning, Memory, & Cognition,23, 1394–1409.
Kelley, C. M., &Lindsay, D. S. (1993). Remembering mistaken for knowing: Ease of retrieval as a basis for confidence in answers to general knowledge questions.Journal of Memory & Language,32, 1–24.
Kimball, D. R., &Metcalfe, J. (2003). Delaying judgments of learning affects memory, not metamemory.Memory & Cognition,31, 918–929.
Klin, C. M., Guzman, A. E., &Levine, W. H. (1999). Prevalence and persistence of predictive inferences.Journal of Memory & Language,40, 593–604.
Kolers, P. A., &Palef, S. R. (1976). Knowing not.Memory & Cognition,4, 553–558.
Koriat, A. (1993). How do we know that we know? The accessibility model of the feeling of knowing.Psychological Review,100, 609–639.
Koriat, A. (1997). Monitoring one’s own knowledge during study: A cue-utilization approach to judgments of learning.Journal of Experimental Psychology: General,126, 349–370.
Koriat, A., &Levy-Sadot, R. (2001). The combined contributions of the cue-familiarity and accessibility heuristics to feelings of knowing.Journal of Experimental Psychology: Learning, Memory, & Cognition,27, 34–53.
Leonesio, R. J., &Nelson, T. O. (1990). Do different metamemory judgments tap the same underlying aspects of memory?Journal of Experimental Psychology: Learning, Memory, & Cognition,16, 464–470.
Maki, R. H. (1998). Predicting performance on text: Delayed versus immediate predictions and tests.Memory & Cognition,26, 959–964.
Mandler, G. (1980). Recognizing: The judgment of previous occurrence.Psychological Review,87, 252–271.
Mandler, G., &Boeck, W. J. (1974). Retrieval processes in recognition.Memory & Cognition,2, 613–615.
Matvey, G., Dunlosky, J., &Guttentag, R. (2001). Fluency of retrieval at study affects judgments of learning (JOLs): An analytic or nonanalytical basis for JOLs?Memory & Cognition,29, 222–233.
Mazzoni, G., Cornoldi, C., &Marchitelli, G. (1990). Do memorability ratings affect study-time allocation?Memory & Cognition,18, 196–204.
Metcalfe, J. (1993). Novelty monitoring, metacognition, and control in a composite holographic associative recall model: Implications for Korsakoff amnesia.Psychological Review,100, 3–22.
Metcalfe, J. (1998). Cognitive optimism: Self-deception or memorybased processing heuristics?Personality & Social Psychology Review,2, 100–110.
Metcalfe, J. (2002). Is study time allocated selectively to a region of proximal learning?Journal of Experimental Psychology: General,131, 349–363.
Metcalfe, J., &Kornell, N. (2003). The dynamics of learning and allocation of study time to a region of proximal learning.Journal of Experimental Psychology: General,132, 530–542.
Metcalfe, J., Schwartz, B. L., &Joaquim, S. G. (1993). The cuefamiliarity heuristic in metacognition.Journal of Experimental Psychology: Learning, Memory, & Cognition,19, 851–861.
Meyer, D. E., Irwin, D. E., Osman, A. M., &Kounios, J. (1988). The dynamics of cognition and action: Memory processes inferred from speed—accuracy decomposition.Psychological Review,95, 183–237.
Miner, A. C., &Reder, L. M. (1994). A new look at feeling of knowing: Its metacognitive role in regulating question answering. In J. Metcalfe & A. P. Shimamura (Eds.),Metacognition: Knowing about knowing (pp. 47–70). Cambridge, MA: MIT Press.
Nelson, T. O. (1984). A comparison of current measures of the accuracy of feeling of knowing predictions.Psychological Bulletin,95, 109–133.
Nelson, T. O., &Dunlosky, J. (1991). When people’s judgments of learning (JOL) are extremely accurate at predicting subsequent recall: The delayed-JOL effect.Psychological Science,2, 267–270.
Nelson, T. O., Dunlosky, J., Graf, A., &Narens, L. (1994). Utilization of metacognitive judgments in the allocation of study during multitrial learning.Psychological Science,5, 207–213.
Nelson, T. O., &Narens, L. (1990). Metamemory: A theoretical framework and new findings. In G. H. Bower (Ed.),The psychology of learning and motivation (Vol. 26, pp. 125–141). San Diego: Academic Press.
Nelson, T. O., &Narens, L. (1994). Why investigate metacognition? In J. Metcalfe & A. P. Shimamura (Eds.),Metacognition: Knowing about knowing (pp. 1–25). Cambridge, MA: MIT Press.
Nelson, T. O., Narens, L., &Dunlosky, J. (2004). A revised methodology for research on metamemory: Pre-judgment recall and monitoring (PRAM).Psychological Methods,9, 53–69.
Nhouyvanisvong, A., &Reder, L. M. (1998). Rapid feeling-ofknowing: A strategy selection mechanism. In V. Y. Yzerbyt, G. Lories, & B. Dardenne (Eds.),Metacognition: Cognitive and social dimensions (pp. 35–52). London: Sage.
Pike, A. R. (1973). Response latency models for signal detection.Psychological Review,80, 53–68.
Ratcliff, R. (1978). A theory of memory retrieval.Psychological Review,85, 59–108.
Ratcliff, R. (1988). Continuous versus discrete information processing: Modeling accumulation of partial information.Psychological Review,95, 238–255.
Ratcliff, R., &McKoon, G. (1997). A counter model for implicit priming in perceptual word identification.Psychological Review,104, 319–343.
Rawson, K. A., &Dunlosky, J. (2002). Are performance predictions for text based on ease of processing?Journal of Experimental Psychology: Learning, Memory, & Cognition,28, 69–80.
Reder, L. M. (1987). Strategy selection in question answering.Cognitive Psychology,19, 90–138.
Reder, L. M. (1988). Strategic control of retrieval strategies. In G. H. Bower (Ed.),The psychology of learning and motivation (Vol. 22, pp. 277–259). San Diego: Academic Press.
Reder, L. M. (Ed.) (1996).Implicit memory and metacognition. Mahwah, NJ: Erlbaum.
Reder, L. M., &Ritter, F. E. (1992). What determines initial feeling of knowing? Familiarity with question terms, not with the answer.Journal of Experimental Psychology: Learning, Memory, and Cognition,18, 435–451.
Reder, L. M., &Schunn, C. D. (1996). Metacognition does not imply awareness: Strategy choice is governed by implicit learning and memory. In L. M. Reder (Ed.),Implicit memory and metacognition (pp. 45–78). Mahwah, NJ: Erlbaum.
Roy-Byrne, P. P., Uhde, T. W., Holcomb, H., Thompson, K., King, A. K., &Weingartner, H. (1987). Effects of diazepam on cognitive processes in normal subjects.Psychopharmacology,91, 30–33.
Schnyer, D. M., Verfaellie, M., Alexander, M. P., LaFleche, G., Nicholls, L., &Kaszniak, A. W. (2004). A role for right medial prefrontal cortex in accurate feeling-of-knowing judgments: Evidence from patients with lesions to frontal cortex.Neuropsychologia,42, 957–966.
Schunn, C. D., Reder, L. M., Nhouyvanisvong, A., Richards, D. R., &Stroffolino, P. J. (1997). To calculate or not to calculate: A source activation confusion model of problem familiarity’s role in strategy selection.Journal of Experimental Psychology: Learning, Memory, & Cognition,23, 3–29.
Schwartz, B. L., &Metcalfe, J. (1992). Cue familiarity but not target retrievability enhances feeling-of-knowing judgments.Journal of Experimental Psychology: Learning, Memory, & Cognition,18, 1074–1083.
Son, L. K. (2004). Spacing one’s study: Evidence for a metacognitive control strategy.Journal of Experimental Psychology: Learning, Memory, & Cognition,30, 601–604.
Son, L. K., &Metcalfe, J. (2000). Metacognitive and control strategies in study-time allocation.Journal of Experimental Psychology: Learning, Memory, & Cognition,26, 204–221.
Spellman, B. A., &Bjork, R. A. (1992). When predictions create reality: Judgments of learning may alter what they are intended to assess.Psychological Science,3, 315–316.
Weaver, C. A., III, &Kelemen, W. L. (1997). Judgments of learning at delays: Shifts in response patterns or increased metamemory accuracy?Psychological Science,8, 318–321.
Author information
Authors and Affiliations
Corresponding author
Additional information
This research was supported by NIMH Grant MH60637 to J.M. The experiments were conducted as part of a doctoral dissertation completed by L.K.S. at Columbia University.
Rights and permissions
About this article
Cite this article
Son, L.K., Metcalfe, J. Judgments of learning: Evidence for a two-stage process. Memory & Cognition 33, 1116–1129 (2005). https://doi.org/10.3758/BF03193217
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03193217