Skip to main content

Sources of information in metamemory: Judgments of learning and feelings of knowing

Abstract

Metamnemonic judgments probe people’s awareness of their own memory processes. The research reviewed here is an examination of the sources of information that subjects use to make judgments of learning (e.g., paired-associate judgments, ease-of-recognition predictions, free-recall judgments), and feelings of knowing (e.g., speeded strategy decisions, tip-of-the-tongue states, feeling-of-knowing judgments). The general pattern in the data suggests that subjects use different sources of information to form these judgments. Target-based sources appear to be important in judgments made at the time of acquisition, whereas cue-based judgments appear to be important in judgments made at the time of retrieval. In general, these sources of information serve as useful heuristics, and metamnemonic judgments tend to be accurate.

References

  1. Arbuckle, T. Y., &Cuddy, L. L. (1969). Discrimination of item strength at time of presentation.Journal of Experimental Psychology,81, 126–131.

    Article  Google Scholar 

  2. Atkinson, R. C., &Juola, J. F. (1973). Factors influencing speed and accuracy of word recognition. In S. Kornblum (Ed.),Attention and performance IV. New York: Academic Press.

    Google Scholar 

  3. Begg, I. M., Anas, A., &Farinacci, S. (1992). Dissociation of processes in belief: Source recollection, statement familiarity, and the illusion of truth.Journal of Experimental Psychology: General,121, 446–458.

    Article  Google Scholar 

  4. Begg, I., Duft, S., Lalonde, P., Melnick, R., &Sanvito, J. (1989). Memory predictions are based on ease of processing.Journal of Memory & Language,28, 610–632.

    Article  Google Scholar 

  5. Begg, I. M., Martin, L. M., &Needham, D. R. (1993). Memory monitoring: How useful is self-knowledge about memory?European Journal of Cognitive Psychology,4, 195–218.

    Article  Google Scholar 

  6. Begg, I., Vinski, E., Frankovich, L., &Holgate, B. (1991). Generating makes words memorable, but so does effective reading.Memory & Cognition,19, 487–497.

    Article  Google Scholar 

  7. Bjork, R. A., &Bjork, E. L. (1992). A new theory of disuse and an old theory of stimulation fluctuation. In A. F. Healy, S. M. Kosslyn, & R. M. Shiffrin (Eds.),From learning processes to cognitive processes: Essays in honor of William K. Estes (Vol. 2, pp. 35–67). Hillsdale, NJ: Erlbaum.

    Google Scholar 

  8. Blake, M. (l973). Prediction of recognition when recall fails: Exploring the feeling-of-knowing phenomenon.Journal of Verbal Learning & Verbal Behavior,12, 311–319.

    Article  Google Scholar 

  9. Brennan, T., Baguley, T., Bright, J., &Bruce, V. (1990). Resolving semantically induced tip-of-the-tongue states for proper nouns.Memory & Cognition,18, 339–347.

    Article  Google Scholar 

  10. Brown, A. S. (1991). A review of the tip-of-the-tongue experience.Psychological Bulletin,109, 204–223.

    Article  PubMed  Google Scholar 

  11. Brown, R., &McNeill, D. (1966). The “tip of the tongue” phenomenon.Journal of Verbal Learning & Behavior,5, 325–337.

    Article  Google Scholar 

  12. Burke, D. M., MacKay, D. G., Worthley, J. S., &Wade, E. (1991). On the tip of the tongue: What causes word finding failures in young and old adults?Journal of Memory & Language,30, 542–579.

    Article  Google Scholar 

  13. Connor, L. T., Balota, D. A., &Neely, J. H. (1992). On the relation between feeling of knowing and lexical decision: Persistent subthreshold activation or topic familiarity?Journal of Experimental Psychology: Learning, Memory, & Cognition,18, 544–554.

    Article  Google Scholar 

  14. Costermans, J., Lories, G., &Ansay, C. (1992). Confidence level and feeling of knowing in question answering: The weight of inferential processes.Journal of Experimental Psychology: Learning, Memory, & Cognition,18, 142–150.

    Article  Google Scholar 

  15. Dunlosky, J., &Nelson, T. O. (1992). Importance of the kind of cue for judgments of learning (JOL) and the delayed-JOL effect.Memory & Cognition,20, 374–380.

    Article  Google Scholar 

  16. Dunlosky, J., &Nelson, T. O. (1994). Does the sensitivity of judgments of learning (JOLs) to the effects of various study activities depend on when the JOLs occur?Journal of Memory & Language,33, 545–565.

    Article  Google Scholar 

  17. Eagle, M. N. (1967). The effects of learning strategies upon free recall.American Journal of Psychology,80, 421–425.

    Article  Google Scholar 

  18. Fischhoff, B. (1975). Hindsight ≠ foresight: The effect of outcome knowledge on judgment under uncertainty.Journal of Experimental Psychology: Human Perception & Performance,1, 288–299.

    Article  Google Scholar 

  19. Freedman, J. L., &Landauer, T. K. (1966). Retrieval of long-term memory: “Tip-of-the-tongue” phenomenon.Psychonomic Science,4, 309–310.

    Google Scholar 

  20. Gardiner, J. M., Craik, F. I. M., &Bleasdale, F. A. (1973). Retrieval difficulty and subsequent recall.Memory & Cognition,1, 213–216.

    Article  Google Scholar 

  21. Gardiner, J. M., &Java, R. I. (1993). Recognising and remembering. In A. F. Collins, S. E. Gathercole, M. A. Conway, & P. E. Morris (Eds.),Theories of memory (pp. 163–188). Hillsdale, NJ: Erlbaum.

    Google Scholar 

  22. Glenberg, A. M., Sanocki, T., Epstein, W., &Morris, C. (1987). Enhancing calibration of comprehension.Journal of Experimental Psychology: General,116, 119–136.

    Article  Google Scholar 

  23. Glucksberg, S. M., &McCloskey, M. (1981). Decisions about ignorance: Knowing that you don’t know.Journal of Experimental Psychology: Human Learning & Memory,7, 311–315.

    Article  Google Scholar 

  24. Groninger, L. D. (1979). Predicting recall: The “feeling-that-I-willknow” phenomenon.American Journal of Psychology,92, 45–58.

    Article  Google Scholar 

  25. Gruneberg, M. M., &Monks, J. (1974). Feeling of knowing and cued recall.Acta Psychologica,38, 257–265.

    Article  Google Scholar 

  26. Gruneberg, M. M., &Sykes, R. N. (1978). Knowledge and retention: The feeling of knowing and reminiscence. In M. M. Gruneberg, P. E. Morris, & R. N. Sykes (Eds.),Practical aspects of memory (pp. 189–196). New York: Academic Press.

    Google Scholar 

  27. Hart, J. T. (1965). Memory and the feeling-of-knowing experience.Journal of Educational Psychology,56, 208–216.

    Article  PubMed  Google Scholar 

  28. Hart, J. T. (1966). A methodological note on feeling-of-knowing experiments.Journal of Educational Psychology,57, 347–349.

    Article  PubMed  Google Scholar 

  29. Hart, J. T. (1967a). Memory and the memory-monitoring process.Journal of Verbal Learning & Verbal Behavior,6, 685–691.

    Article  Google Scholar 

  30. Hart, J. T. (1967b). Second-try recall, recognition, and the memorymonitoring process.Journal of Educational Psychology,58, 193–197.

    Article  PubMed  Google Scholar 

  31. Jacoby, L. L. (1991). A process dissociation framework: Separating automatic from intentional influences of memory.Journal of Memory & Language,30, 513–541.

    Article  Google Scholar 

  32. Jacoby, L. L., &Brooks, L. R. (1984). Nonanalytic cognition: Memory, perception, and concept learning. In G. Bower (Ed.),The psychology of learning and motivation: Advances in research and theory (Vol. 18, pp. 1–47). New York: Academic Press.

    Google Scholar 

  33. Jacoby, L. L., &Kelley, C. M. (1987). Unconscious influences of memory for a prior event.Personality & Social Psychology Bulletin,13, 314–336.

    Article  Google Scholar 

  34. Jacoby, L. L., Kelley, C. M., &Dywan, J. (1989). Memory attributions. In H. L. Roediger, III & F. I. M. Craik (Eds.),Varieties of memory and consciousness: Essays in honour of Endel Tulving (pp. 391–422). Hillsdale, NJ: Erlbaum.

    Google Scholar 

  35. Jacoby, L. L., Woloshyn, V., &Kelley, C. M. (1989). Becoming famous without being recognized: Unconscious influences of memory provided by divided attention.Journal of Experimental Psychology: General,118, 115–125.

    Article  Google Scholar 

  36. Jameson, K. A., Narens, L., Goldfarb, K., &Nelson, T. O. (1990). The influence of near-threshold priming on metamemory and recall.Acta Psychologica,73, 55–68.

    Article  PubMed  Google Scholar 

  37. Janowsky, J. S., Shimamura, A. P., &Squire, L. R. (1989). Memory and metamemory: Comparisons between patients with frontal lobe lesions and amnesic patients.Psychobiology,17, 3–11.

    Google Scholar 

  38. Johnson, M. K., Hashtroudi, S., &Lindsay, D. S. (1993). Source monitoring.Psychological Bulletin,114, 3–28.

    Article  PubMed  Google Scholar 

  39. Johnson, M. K., &Raye, C. L. (1981). Reality monitoring.Psychological Review,88, 67–85.

    Article  Google Scholar 

  40. Jones, G. V. (1989). Back to Woodworth: Role of interlopers in the tipof-the-tongue phenomenon.Memory & Cognition,17, 69–76.

    Article  Google Scholar 

  41. Jones, G. V., &Langford, S. (1987). Phonological blocking in the tip of the tongue state.Cognition,26, 115–122.

    Article  PubMed  Google Scholar 

  42. Kelley, C. M., &Lindsay, D. S. (1993). Remembering mistaken for knowing: Ease of retrieval as a basis for confidence in answers to general knowledge questions.Journal of Memory & Language,32, 1–24.

    Article  Google Scholar 

  43. King, J. F., Zechmeister, E. B., &Shaughnessy, J. J. (1980). Judgments of knowing: The influence of retrieval practice.American Journal of Psychology,93, 329–343.

    Article  Google Scholar 

  44. Kolers, P. A., &Palef, S. R. (1976). Knowing not.Memory & Cognition,4, 553–558.

    Article  Google Scholar 

  45. Koriat, A. (1993). How do we know that we know? The accessibility account of the feeling of knowing.Psychological Review,100, 609–639.

    Article  PubMed  Google Scholar 

  46. Koriat, A. (1994). Memory’s knowledge of its own knowledge: The accessibility account of the feeling of knowing. In J. Metcalfe & A. P. Shimamura (Eds.),Metacognition: Knowing about knowing (pp. 115–136). Cambridge, MA: MIT Press.

    Google Scholar 

  47. Koriat, A., &Lieblich, I. (1974). What does a person in a “TOT” state know that a person in a “don’t know” state doesn’t know.Memory & Cognition,2, 647–655.

    Article  Google Scholar 

  48. Koriat, A., &Lieblich, I. (1977). A study of memory pointers.Acta Psychologica,41, 151–164.

    Article  Google Scholar 

  49. Krinsky, R., &Nelson, T. O. (1985). The feeling of knowing for different types of retrieval failure.Acta Psychologica,58, 141–158.

    Article  PubMed  Google Scholar 

  50. Leonesio, R. J., &Nelson, T. O. (1990). Do different metamemory judgments tap the same underlying aspects of memory?Journal of Experimental Psychology: Leaning, Memory, & Cognition,16, 464–470.

    Article  Google Scholar 

  51. Lovelace, E. A. (1984). Metamemory: Monitoring future recallability during study.Journal of Experimental Psychology: Learning, Memory, & Cognition,10, 756–766.

    Article  Google Scholar 

  52. Lupker, S. J., Harbluk, J. L., &Patrick, A. S. (1991). Memory for things forgotten.Journal of Experimental Psychology: Learning, Memory, & Cognition,17, 897–907.

    Article  Google Scholar 

  53. Mandler, G. (1980). Recognizing: The judgment of previous occurrence.Psychological Review,87, 252–271.

    Article  Google Scholar 

  54. Mazzoni, G., &Cornoldi, C. (1993). Strategies in study time allocation: Why is study time sometimes not effective?Journal of Experimental Psychology: General,122, 47–60.

    Article  Google Scholar 

  55. Mazzoni, G., Cornoldi, C., &Marchitelli, G. (1990). Do memorability ratings affect study-time allocation?Memory & Cognition,18, 196–204.

    Article  Google Scholar 

  56. Metcalfe, J. (1993). Novelty monitoring, metacognition and control in a composite holographic associative recall model: Interpretations for Korsakoff amnesia.Psychological Review,100, 3–22.

    Article  PubMed  Google Scholar 

  57. Metcalfe, J. (1994). Novelty monitoring, metacognition, and frontal lobe dysfunction: Implications of a computational model of memory. In J. Metcalfe & A. P. Shimamura (Eds.),Metacognition: Knowing about knowing (pp. 137–156). Cambridge, MA: MIT Press.

    Google Scholar 

  58. Metcalfe, J., Schwartz, B. L., &Joaquim, S. G. (1993). The cue familiarity heuristic in metacognition.Journal of Experimental Psychology: Learning, Memory, & Cognition,19, 851–861.

    Article  Google Scholar 

  59. Metcalfe, J., &Shimamura, A. P. (1994).Metacognition: Knowing about knowing. Cambridge, MA: MIT Press.

    Google Scholar 

  60. Meyer, A. S., &Bock, K. (1992). The tip-of-the-tongue phenomenon: Blocking or partial activation?Memory & Cognition,20, 715–726.

    Article  Google Scholar 

  61. Miner, A. C., &Reder, L. M. (1994). A new look at feeling of knowing: Its metacognitive role in regulating question answering. In J. Metcalfe & A. P. Shimamura (Eds.),Metacognition: Knowing about knowing (pp. 47–70). Cambridge, MA: MIT Press.

    Google Scholar 

  62. Narens, L., Jameson, K. A., &Lee, V. A. (1994). Subthreshold priming and memory monitoring. In J. Metcalfe & A. P. Shimamura (Eds.),Metacognition: Knowing about knowing (pp. 71–92). Cambridge, MA: MIT Press.

    Google Scholar 

  63. Nelson, T. O. (1988). Predictive accuracy of the feeling of knowing across different criterion tasks and across different subject populations and individuals. In M. Gruneberg, P. Morris, & R. Sykes (Eds.),Practical aspects of memory: Current research and issues (Vol. 1, pp. 190–196). New York: Wiley.

    Google Scholar 

  64. Nelson, T. O. (1992).Metacognition: Core readings. Boston: Allyn & Bacon.

    Google Scholar 

  65. Nelson, T. O. (1993). Judgments of learning and the allocation of study time.Journal of Experimental Psychology: General,122, 269–273.

    Article  Google Scholar 

  66. Nelson, T. O., &Dunlosky, J. (1991). When people’s judgments of learning (JOLs) are extremely accurate at predicting subsequent recall: The “delayed-JOL effect.”Psychological Science,2, 267–270.

    Article  Google Scholar 

  67. Nelson, T. O., &Dunlosky, J. (1992). How shall we explain the delayed-judgment-of-learning effect?Psychological Science,3, 317–318.

    Article  Google Scholar 

  68. Nelson, T. O., Gerler, D., &Narens, L. (1984). Accuracy of feelingof-knowing judgments for predicting perceptual identification and relearning.Journal of Experimental Psychology: General,113, 282–300.

    Article  Google Scholar 

  69. Nelson, T. O., &Leonesio, R. J. (1988). Allocation of self-paced study time and the ‘labor-in-vain effect.’Journal of Experimental Psychology: Learning, Memory, & Cognition, 114, 476–486.

    Article  Google Scholar 

  70. Nelson, T. O., Leonesio, R. J., Landwehr, R. S., &Narens, L. (1986). A comparison of three predictors of an individual’s memory performance: The individual’s feeling of knowing versus the normative feeling of knowing versus base-rate item difficulty.Journal of Experimental Psychology: Learning, Memory, & Cognition,12, 279–287.

    Article  Google Scholar 

  71. Nelson, T. O., Leonesio, R. J., Shimamura, A. P., Landwehr, R. S., &Narens, L. (1982). Overlearning and the feeling of knowing.Journal of Experimental Psychology: Learning, Memory, & Cognition,8, 279–288.

    Article  Google Scholar 

  72. Nelson, T. O., &Narens, L. (1980a). A new technique for investigating the feeling of knowing.Acta Psychologica,46, 69–90.

    Article  Google Scholar 

  73. Nelson, T. O., &Narens, L. (1980b). Norms of 300 generalinformation questions: Accuracy of recall, latency of recall, and feeling-of-knowing ratings.Journal of Verbal Learning & Verbal Behavior,19, 338–368.

    Article  Google Scholar 

  74. Nelson, T. O., &Narens, L. (1990). Metamemory: A theoretical framework and new findings. In G. Bower (Ed.),The psychology of learning and motivation (Vol. 26, pp. 125–141). San Diego, CA: Academic Press.

    Google Scholar 

  75. Nelson, T. O., &Narens, L. (1994). Why investigate metacognition? In J. Metcalfe & A. P. Shimamura (Eds.),Metacognition: Knowing about knowing (pp. 1–26). Cambridge, MA: MIT Press.

    Google Scholar 

  76. Rajaram, S. (1993). Remembering and knowing: Two means of access to the personal past.Memory & Cognition,21, 89–102.

    Article  Google Scholar 

  77. Reason, J. T., &Lucas, D. (1984). Using cognitive diaries to investigate naturally occurring memory blocks. In J. Harris & P. E. Morris (Eds.),Everyday memory, actions, and absent mindedness (pp. 53–70). London: Academic Press.

    Google Scholar 

  78. Reder, L. M. (1987). Selection strategies in question answering.Cognitive Psychology,19, 90–138.

    Article  Google Scholar 

  79. Reder, L. M. (1988). Strategic control of retrieval strategies. In G. Bower (Ed.),The psychology of learning and motivation (Vol. 22, pp. 227–259). San Diego, CA: Academic Press.

    Google Scholar 

  80. Reder, L. M., &Ritter, F. E. (1992). What determines initial feeling of knowing? Familiarity with question terms, not with the answer.Journal of Experimental Psychology: Learning, Memory, & Cognition,18, 435–451.

    Article  Google Scholar 

  81. Roediger, H. L., III (1974). Inhibiting effects of recall.Memory & Cognition,2, 261–269.

    Article  Google Scholar 

  82. Ryan, M. P., Petty, C. R., &Wenzlaff, R. M. (1982). Motivated remembering efforts during tip-of-the-tongue states.Acta Psychologica,51, 137–147.

    Article  Google Scholar 

  83. Schacter, D. L. (1981).Feeling of knowing and the expression of knowledge from episodic memory. Unpublished doctoral dissertation, University of Toronto.

  84. Schacter, D. L. (1983). Feeling of knowing in episodic memory.Journal of Experimental Psychology: Learning, Memory, & Cognition,9, 39–54.

    Article  Google Scholar 

  85. Schacter, D. L., &Worling, J. R. (1985). Attribute information and the feeling of knowing.Canadian Journal of Psychology,39, 467–475.

    Article  Google Scholar 

  86. Schwartz, B. L., &Bjork, R. A. (1993, November).Do people understand the relation between retrieval difficulty and subsequent recall? Paper presented at the meeting of the Psychonomic Society, Washington, DC.

  87. Schwartz, B. L., &Metcalfe, J. (1992). Cue familiarity but not target retrievability enhances feeling-of-knowing judgments.Journal of Experimental Psychology: Learning, Memory, & Cognition,18, 1074–1083.

    Article  Google Scholar 

  88. Schwartz, B. L., &Metcalfe, J. (1994). Methodological problems and pitfalls in the study of human metacognition. In J. Metcalfe & A. P. Shimamura (Eds.),Metacognition: Knowing about knowing (pp. 93–114). Cambridge, MA: MIT Press.

    Google Scholar 

  89. Shimamura, A. P. (1994). The neuropsychology of metacognition. In J. Metcalfe & A. P. Shimamura (Eds.),Metacognition: Knowing about knowing (pp. 253–276). Cambridge, MA: MIT Press.

    Google Scholar 

  90. Shimamura, A. P., &Squire, L. R. (1986). Memory and metamemory: A study of the feeling-of-knowing phenomenon in amnesic patients.Journal of Experimental Psychology: Leaning, Memory, & Cognition,12, 452–460.

    Article  Google Scholar 

  91. Slamecka, N. J., &Graf, P. (1978). The generation effect: Delineation of a phenomenon.Journal of Experimental Psychology: Human Learning & Memory,4, 592–604.

    Article  Google Scholar 

  92. Smith, S. M. (1994). Frustrated feelings of imminent recall: On the tip-of-the-tongue. In J. Metcalfe & A. P. Shimamura (Eds.),Metacognition: Knowing about knowing (pp. 27–46). Cambridge, MA: MIT Press.

    Google Scholar 

  93. Smith, S. M., Brown, J. M., &Balfour, S. P. (1991). TOTimals: A controlled experimental method for observing tip-of-the-tongue states.Bulletin of the Psychonomic Society,29, 445–447.

    Google Scholar 

  94. Spellman, B. A., &Bjork, R. A. (1992). When predictions create reality: Judgments of learning may alter what they are intended to assess.Psychological Science,3, 315–316.

    Article  Google Scholar 

  95. Tulving, E. (1983).Elements of episodic memory. New York: Oxford University Press, Clarendon Press.

    Google Scholar 

  96. Tulving, E., &Pearlstone, Z. (1966). Availability versus accessibility of information in memory for words.Journal of Verbal Learning & Verbal Behavior,5, 381–391.

    Article  Google Scholar 

  97. Underwood, B. J. (1966). Individual and group predictions of item difficulty for free learning.Journal of Experimental Psychology,71, 673–679.

    Article  PubMed  Google Scholar 

  98. Wellman, H. M. (1977). Tip of the tongue and feeling of knowing experiences: A developmental study of memory monitoring.Child Development,48, 13–21.

    Article  Google Scholar 

  99. Widner, R. L., Jr., &Smith, S. M. (1993, November).Imminence and familiarity in tip-of-the-tongue and feeling-of-knowing reports. Paper presented at the meeting of the Psychonomic Society, Washington, DC.

  100. Yaniv, I., &Meyer, D. E. (1987). Activation and metacognition of inaccessible stored information: Potential bases for incubation effects in problem solving.Journal of Experimental Psychology: Learning, Memory, & Cognition,13, 187–205.

    Article  Google Scholar 

Download references

Author information

Affiliations

Authors

Corresponding author

Correspondence to Bennett L. Schwartz.

Additional information

I gratefully acknowledge the support of National Institute of Mental Health Grant MH48066-04 to Janet Metcalfe. I thank Janet Metcalfe, Robert Bjork, and Elizabeth Bjork for useful discussion leading up to this project. I thank Ron Fisher, John Dunlosky, Tom Nelson, Asher Koriat, John Gardiner, and one anonymous reviewer for their comments on an earlier version of this manuscript. Finally, I thank my parents, Carol H. Schwartz and Foster Schwartz for all their help and guidance over the years.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Schwartz, B.L. Sources of information in metamemory: Judgments of learning and feelings of knowing. Psychonomic Bulletin & Review 1, 357–375 (1994). https://doi.org/10.3758/BF03213977

Download citation

Keywords

  • Lexical Decision
  • Free Recall
  • Journal ofExperimental Psychology
  • Journal ofEducational Psychology
  • Unrecalled Item