Psychonomic Bulletin & Review

, Volume 1, Issue 3, pp 357–375 | Cite as

Sources of information in metamemory: Judgments of learning and feelings of knowing

  • Bennett L. Schwartz


Metamnemonic judgments probe people’s awareness of their own memory processes. The research reviewed here is an examination of the sources of information that subjects use to make judgments of learning (e.g., paired-associate judgments, ease-of-recognition predictions, free-recall judgments), and feelings of knowing (e.g., speeded strategy decisions, tip-of-the-tongue states, feeling-of-knowing judgments). The general pattern in the data suggests that subjects use different sources of information to form these judgments. Target-based sources appear to be important in judgments made at the time of acquisition, whereas cue-based judgments appear to be important in judgments made at the time of retrieval. In general, these sources of information serve as useful heuristics, and metamnemonic judgments tend to be accurate.


  1. Arbuckle, T. Y., &Cuddy, L. L. (1969). Discrimination of item strength at time of presentation.Journal of Experimental Psychology,81, 126–131.CrossRefGoogle Scholar
  2. Atkinson, R. C., &Juola, J. F. (1973). Factors influencing speed and accuracy of word recognition. In S. Kornblum (Ed.),Attention and performance IV. New York: Academic Press.Google Scholar
  3. Begg, I. M., Anas, A., &Farinacci, S. (1992). Dissociation of processes in belief: Source recollection, statement familiarity, and the illusion of truth.Journal of Experimental Psychology: General,121, 446–458.CrossRefGoogle Scholar
  4. Begg, I., Duft, S., Lalonde, P., Melnick, R., &Sanvito, J. (1989). Memory predictions are based on ease of processing.Journal of Memory & Language,28, 610–632.CrossRefGoogle Scholar
  5. Begg, I. M., Martin, L. M., &Needham, D. R. (1993). Memory monitoring: How useful is self-knowledge about memory?European Journal of Cognitive Psychology,4, 195–218.CrossRefGoogle Scholar
  6. Begg, I., Vinski, E., Frankovich, L., &Holgate, B. (1991). Generating makes words memorable, but so does effective reading.Memory & Cognition,19, 487–497.CrossRefGoogle Scholar
  7. Bjork, R. A., &Bjork, E. L. (1992). A new theory of disuse and an old theory of stimulation fluctuation. In A. F. Healy, S. M. Kosslyn, & R. M. Shiffrin (Eds.),From learning processes to cognitive processes: Essays in honor of William K. Estes (Vol. 2, pp. 35–67). Hillsdale, NJ: Erlbaum.Google Scholar
  8. Blake, M. (l973). Prediction of recognition when recall fails: Exploring the feeling-of-knowing phenomenon.Journal of Verbal Learning & Verbal Behavior,12, 311–319.CrossRefGoogle Scholar
  9. Brennan, T., Baguley, T., Bright, J., &Bruce, V. (1990). Resolving semantically induced tip-of-the-tongue states for proper nouns.Memory & Cognition,18, 339–347.CrossRefGoogle Scholar
  10. Brown, A. S. (1991). A review of the tip-of-the-tongue experience.Psychological Bulletin,109, 204–223.CrossRefPubMedGoogle Scholar
  11. Brown, R., &McNeill, D. (1966). The “tip of the tongue” phenomenon.Journal of Verbal Learning & Behavior,5, 325–337.CrossRefGoogle Scholar
  12. Burke, D. M., MacKay, D. G., Worthley, J. S., &Wade, E. (1991). On the tip of the tongue: What causes word finding failures in young and old adults?Journal of Memory & Language,30, 542–579.CrossRefGoogle Scholar
  13. Connor, L. T., Balota, D. A., &Neely, J. H. (1992). On the relation between feeling of knowing and lexical decision: Persistent subthreshold activation or topic familiarity?Journal of Experimental Psychology: Learning, Memory, & Cognition,18, 544–554.CrossRefGoogle Scholar
  14. Costermans, J., Lories, G., &Ansay, C. (1992). Confidence level and feeling of knowing in question answering: The weight of inferential processes.Journal of Experimental Psychology: Learning, Memory, & Cognition,18, 142–150.CrossRefGoogle Scholar
  15. Dunlosky, J., &Nelson, T. O. (1992). Importance of the kind of cue for judgments of learning (JOL) and the delayed-JOL effect.Memory & Cognition,20, 374–380.CrossRefGoogle Scholar
  16. Dunlosky, J., &Nelson, T. O. (1994). Does the sensitivity of judgments of learning (JOLs) to the effects of various study activities depend on when the JOLs occur?Journal of Memory & Language,33, 545–565.CrossRefGoogle Scholar
  17. Eagle, M. N. (1967). The effects of learning strategies upon free recall.American Journal of Psychology,80, 421–425.CrossRefGoogle Scholar
  18. Fischhoff, B. (1975). Hindsight ≠ foresight: The effect of outcome knowledge on judgment under uncertainty.Journal of Experimental Psychology: Human Perception & Performance,1, 288–299.CrossRefGoogle Scholar
  19. Freedman, J. L., &Landauer, T. K. (1966). Retrieval of long-term memory: “Tip-of-the-tongue” phenomenon.Psychonomic Science,4, 309–310.Google Scholar
  20. Gardiner, J. M., Craik, F. I. M., &Bleasdale, F. A. (1973). Retrieval difficulty and subsequent recall.Memory & Cognition,1, 213–216.CrossRefGoogle Scholar
  21. Gardiner, J. M., &Java, R. I. (1993). Recognising and remembering. In A. F. Collins, S. E. Gathercole, M. A. Conway, & P. E. Morris (Eds.),Theories of memory (pp. 163–188). Hillsdale, NJ: Erlbaum.Google Scholar
  22. Glenberg, A. M., Sanocki, T., Epstein, W., &Morris, C. (1987). Enhancing calibration of comprehension.Journal of Experimental Psychology: General,116, 119–136.CrossRefGoogle Scholar
  23. Glucksberg, S. M., &McCloskey, M. (1981). Decisions about ignorance: Knowing that you don’t know.Journal of Experimental Psychology: Human Learning & Memory,7, 311–315.CrossRefGoogle Scholar
  24. Groninger, L. D. (1979). Predicting recall: The “feeling-that-I-willknow” phenomenon.American Journal of Psychology,92, 45–58.CrossRefGoogle Scholar
  25. Gruneberg, M. M., &Monks, J. (1974). Feeling of knowing and cued recall.Acta Psychologica,38, 257–265.CrossRefGoogle Scholar
  26. Gruneberg, M. M., &Sykes, R. N. (1978). Knowledge and retention: The feeling of knowing and reminiscence. In M. M. Gruneberg, P. E. Morris, & R. N. Sykes (Eds.),Practical aspects of memory (pp. 189–196). New York: Academic Press.Google Scholar
  27. Hart, J. T. (1965). Memory and the feeling-of-knowing experience.Journal of Educational Psychology,56, 208–216.CrossRefPubMedGoogle Scholar
  28. Hart, J. T. (1966). A methodological note on feeling-of-knowing experiments.Journal of Educational Psychology,57, 347–349.CrossRefPubMedGoogle Scholar
  29. Hart, J. T. (1967a). Memory and the memory-monitoring process.Journal of Verbal Learning & Verbal Behavior,6, 685–691.CrossRefGoogle Scholar
  30. Hart, J. T. (1967b). Second-try recall, recognition, and the memorymonitoring process.Journal of Educational Psychology,58, 193–197.CrossRefPubMedGoogle Scholar
  31. Jacoby, L. L. (1991). A process dissociation framework: Separating automatic from intentional influences of memory.Journal of Memory & Language,30, 513–541.CrossRefGoogle Scholar
  32. Jacoby, L. L., &Brooks, L. R. (1984). Nonanalytic cognition: Memory, perception, and concept learning. In G. Bower (Ed.),The psychology of learning and motivation: Advances in research and theory (Vol. 18, pp. 1–47). New York: Academic Press.Google Scholar
  33. Jacoby, L. L., &Kelley, C. M. (1987). Unconscious influences of memory for a prior event.Personality & Social Psychology Bulletin,13, 314–336.CrossRefGoogle Scholar
  34. Jacoby, L. L., Kelley, C. M., &Dywan, J. (1989). Memory attributions. In H. L. Roediger, III & F. I. M. Craik (Eds.),Varieties of memory and consciousness: Essays in honour of Endel Tulving (pp. 391–422). Hillsdale, NJ: Erlbaum.Google Scholar
  35. Jacoby, L. L., Woloshyn, V., &Kelley, C. M. (1989). Becoming famous without being recognized: Unconscious influences of memory provided by divided attention.Journal of Experimental Psychology: General,118, 115–125.CrossRefGoogle Scholar
  36. Jameson, K. A., Narens, L., Goldfarb, K., &Nelson, T. O. (1990). The influence of near-threshold priming on metamemory and recall.Acta Psychologica,73, 55–68.CrossRefPubMedGoogle Scholar
  37. Janowsky, J. S., Shimamura, A. P., &Squire, L. R. (1989). Memory and metamemory: Comparisons between patients with frontal lobe lesions and amnesic patients.Psychobiology,17, 3–11.Google Scholar
  38. Johnson, M. K., Hashtroudi, S., &Lindsay, D. S. (1993). Source monitoring.Psychological Bulletin,114, 3–28.CrossRefPubMedGoogle Scholar
  39. Johnson, M. K., &Raye, C. L. (1981). Reality monitoring.Psychological Review,88, 67–85.CrossRefGoogle Scholar
  40. Jones, G. V. (1989). Back to Woodworth: Role of interlopers in the tipof-the-tongue phenomenon.Memory & Cognition,17, 69–76.CrossRefGoogle Scholar
  41. Jones, G. V., &Langford, S. (1987). Phonological blocking in the tip of the tongue state.Cognition,26, 115–122.CrossRefPubMedGoogle Scholar
  42. Kelley, C. M., &Lindsay, D. S. (1993). Remembering mistaken for knowing: Ease of retrieval as a basis for confidence in answers to general knowledge questions.Journal of Memory & Language,32, 1–24.CrossRefGoogle Scholar
  43. King, J. F., Zechmeister, E. B., &Shaughnessy, J. J. (1980). Judgments of knowing: The influence of retrieval practice.American Journal of Psychology,93, 329–343.CrossRefGoogle Scholar
  44. Kolers, P. A., &Palef, S. R. (1976). Knowing not.Memory & Cognition,4, 553–558.CrossRefGoogle Scholar
  45. Koriat, A. (1993). How do we know that we know? The accessibility account of the feeling of knowing.Psychological Review,100, 609–639.CrossRefPubMedGoogle Scholar
  46. Koriat, A. (1994). Memory’s knowledge of its own knowledge: The accessibility account of the feeling of knowing. In J. Metcalfe & A. P. Shimamura (Eds.),Metacognition: Knowing about knowing (pp. 115–136). Cambridge, MA: MIT Press.Google Scholar
  47. Koriat, A., &Lieblich, I. (1974). What does a person in a “TOT” state know that a person in a “don’t know” state doesn’t know.Memory & Cognition,2, 647–655.CrossRefGoogle Scholar
  48. Koriat, A., &Lieblich, I. (1977). A study of memory pointers.Acta Psychologica,41, 151–164.CrossRefGoogle Scholar
  49. Krinsky, R., &Nelson, T. O. (1985). The feeling of knowing for different types of retrieval failure.Acta Psychologica,58, 141–158.CrossRefPubMedGoogle Scholar
  50. Leonesio, R. J., &Nelson, T. O. (1990). Do different metamemory judgments tap the same underlying aspects of memory?Journal of Experimental Psychology: Leaning, Memory, & Cognition,16, 464–470.CrossRefGoogle Scholar
  51. Lovelace, E. A. (1984). Metamemory: Monitoring future recallability during study.Journal of Experimental Psychology: Learning, Memory, & Cognition,10, 756–766.CrossRefGoogle Scholar
  52. Lupker, S. J., Harbluk, J. L., &Patrick, A. S. (1991). Memory for things forgotten.Journal of Experimental Psychology: Learning, Memory, & Cognition,17, 897–907.CrossRefGoogle Scholar
  53. Mandler, G. (1980). Recognizing: The judgment of previous occurrence.Psychological Review,87, 252–271.CrossRefGoogle Scholar
  54. Mazzoni, G., &Cornoldi, C. (1993). Strategies in study time allocation: Why is study time sometimes not effective?Journal of Experimental Psychology: General,122, 47–60.CrossRefGoogle Scholar
  55. Mazzoni, G., Cornoldi, C., &Marchitelli, G. (1990). Do memorability ratings affect study-time allocation?Memory & Cognition,18, 196–204.CrossRefGoogle Scholar
  56. Metcalfe, J. (1993). Novelty monitoring, metacognition and control in a composite holographic associative recall model: Interpretations for Korsakoff amnesia.Psychological Review,100, 3–22.CrossRefPubMedGoogle Scholar
  57. Metcalfe, J. (1994). Novelty monitoring, metacognition, and frontal lobe dysfunction: Implications of a computational model of memory. In J. Metcalfe & A. P. Shimamura (Eds.),Metacognition: Knowing about knowing (pp. 137–156). Cambridge, MA: MIT Press.Google Scholar
  58. Metcalfe, J., Schwartz, B. L., &Joaquim, S. G. (1993). The cue familiarity heuristic in metacognition.Journal of Experimental Psychology: Learning, Memory, & Cognition,19, 851–861.CrossRefGoogle Scholar
  59. Metcalfe, J., &Shimamura, A. P. (1994).Metacognition: Knowing about knowing. Cambridge, MA: MIT Press.Google Scholar
  60. Meyer, A. S., &Bock, K. (1992). The tip-of-the-tongue phenomenon: Blocking or partial activation?Memory & Cognition,20, 715–726.CrossRefGoogle Scholar
  61. Miner, A. C., &Reder, L. M. (1994). A new look at feeling of knowing: Its metacognitive role in regulating question answering. In J. Metcalfe & A. P. Shimamura (Eds.),Metacognition: Knowing about knowing (pp. 47–70). Cambridge, MA: MIT Press.Google Scholar
  62. Narens, L., Jameson, K. A., &Lee, V. A. (1994). Subthreshold priming and memory monitoring. In J. Metcalfe & A. P. Shimamura (Eds.),Metacognition: Knowing about knowing (pp. 71–92). Cambridge, MA: MIT Press.Google Scholar
  63. Nelson, T. O. (1988). Predictive accuracy of the feeling of knowing across different criterion tasks and across different subject populations and individuals. In M. Gruneberg, P. Morris, & R. Sykes (Eds.),Practical aspects of memory: Current research and issues (Vol. 1, pp. 190–196). New York: Wiley.Google Scholar
  64. Nelson, T. O. (1992).Metacognition: Core readings. Boston: Allyn & Bacon.Google Scholar
  65. Nelson, T. O. (1993). Judgments of learning and the allocation of study time.Journal of Experimental Psychology: General,122, 269–273.CrossRefGoogle Scholar
  66. Nelson, T. O., &Dunlosky, J. (1991). When people’s judgments of learning (JOLs) are extremely accurate at predicting subsequent recall: The “delayed-JOL effect.”Psychological Science,2, 267–270.CrossRefGoogle Scholar
  67. Nelson, T. O., &Dunlosky, J. (1992). How shall we explain the delayed-judgment-of-learning effect?Psychological Science,3, 317–318.CrossRefGoogle Scholar
  68. Nelson, T. O., Gerler, D., &Narens, L. (1984). Accuracy of feelingof-knowing judgments for predicting perceptual identification and relearning.Journal of Experimental Psychology: General,113, 282–300.CrossRefGoogle Scholar
  69. Nelson, T. O., &Leonesio, R. J. (1988). Allocation of self-paced study time and the ‘labor-in-vain effect.’Journal of Experimental Psychology: Learning, Memory, & Cognition, 114, 476–486.CrossRefGoogle Scholar
  70. Nelson, T. O., Leonesio, R. J., Landwehr, R. S., &Narens, L. (1986). A comparison of three predictors of an individual’s memory performance: The individual’s feeling of knowing versus the normative feeling of knowing versus base-rate item difficulty.Journal of Experimental Psychology: Learning, Memory, & Cognition,12, 279–287.CrossRefGoogle Scholar
  71. Nelson, T. O., Leonesio, R. J., Shimamura, A. P., Landwehr, R. S., &Narens, L. (1982). Overlearning and the feeling of knowing.Journal of Experimental Psychology: Learning, Memory, & Cognition,8, 279–288.CrossRefGoogle Scholar
  72. Nelson, T. O., &Narens, L. (1980a). A new technique for investigating the feeling of knowing.Acta Psychologica,46, 69–90.CrossRefGoogle Scholar
  73. Nelson, T. O., &Narens, L. (1980b). Norms of 300 generalinformation questions: Accuracy of recall, latency of recall, and feeling-of-knowing ratings.Journal of Verbal Learning & Verbal Behavior,19, 338–368.CrossRefGoogle Scholar
  74. Nelson, T. O., &Narens, L. (1990). Metamemory: A theoretical framework and new findings. In G. Bower (Ed.),The psychology of learning and motivation (Vol. 26, pp. 125–141). San Diego, CA: Academic Press.Google Scholar
  75. Nelson, T. O., &Narens, L. (1994). Why investigate metacognition? In J. Metcalfe & A. P. Shimamura (Eds.),Metacognition: Knowing about knowing (pp. 1–26). Cambridge, MA: MIT Press.Google Scholar
  76. Rajaram, S. (1993). Remembering and knowing: Two means of access to the personal past.Memory & Cognition,21, 89–102.CrossRefGoogle Scholar
  77. Reason, J. T., &Lucas, D. (1984). Using cognitive diaries to investigate naturally occurring memory blocks. In J. Harris & P. E. Morris (Eds.),Everyday memory, actions, and absent mindedness (pp. 53–70). London: Academic Press.Google Scholar
  78. Reder, L. M. (1987). Selection strategies in question answering.Cognitive Psychology,19, 90–138.CrossRefGoogle Scholar
  79. Reder, L. M. (1988). Strategic control of retrieval strategies. In G. Bower (Ed.),The psychology of learning and motivation (Vol. 22, pp. 227–259). San Diego, CA: Academic Press.Google Scholar
  80. Reder, L. M., &Ritter, F. E. (1992). What determines initial feeling of knowing? Familiarity with question terms, not with the answer.Journal of Experimental Psychology: Learning, Memory, & Cognition,18, 435–451.CrossRefGoogle Scholar
  81. Roediger, H. L., III (1974). Inhibiting effects of recall.Memory & Cognition,2, 261–269.CrossRefGoogle Scholar
  82. Ryan, M. P., Petty, C. R., &Wenzlaff, R. M. (1982). Motivated remembering efforts during tip-of-the-tongue states.Acta Psychologica,51, 137–147.CrossRefGoogle Scholar
  83. Schacter, D. L. (1981).Feeling of knowing and the expression of knowledge from episodic memory. Unpublished doctoral dissertation, University of Toronto.Google Scholar
  84. Schacter, D. L. (1983). Feeling of knowing in episodic memory.Journal of Experimental Psychology: Learning, Memory, & Cognition,9, 39–54.CrossRefGoogle Scholar
  85. Schacter, D. L., &Worling, J. R. (1985). Attribute information and the feeling of knowing.Canadian Journal of Psychology,39, 467–475.CrossRefGoogle Scholar
  86. Schwartz, B. L., &Bjork, R. A. (1993, November).Do people understand the relation between retrieval difficulty and subsequent recall? Paper presented at the meeting of the Psychonomic Society, Washington, DC.Google Scholar
  87. Schwartz, B. L., &Metcalfe, J. (1992). Cue familiarity but not target retrievability enhances feeling-of-knowing judgments.Journal of Experimental Psychology: Learning, Memory, & Cognition,18, 1074–1083.CrossRefGoogle Scholar
  88. Schwartz, B. L., &Metcalfe, J. (1994). Methodological problems and pitfalls in the study of human metacognition. In J. Metcalfe & A. P. Shimamura (Eds.),Metacognition: Knowing about knowing (pp. 93–114). Cambridge, MA: MIT Press.Google Scholar
  89. Shimamura, A. P. (1994). The neuropsychology of metacognition. In J. Metcalfe & A. P. Shimamura (Eds.),Metacognition: Knowing about knowing (pp. 253–276). Cambridge, MA: MIT Press.Google Scholar
  90. Shimamura, A. P., &Squire, L. R. (1986). Memory and metamemory: A study of the feeling-of-knowing phenomenon in amnesic patients.Journal of Experimental Psychology: Leaning, Memory, & Cognition,12, 452–460.CrossRefGoogle Scholar
  91. Slamecka, N. J., &Graf, P. (1978). The generation effect: Delineation of a phenomenon.Journal of Experimental Psychology: Human Learning & Memory,4, 592–604.CrossRefGoogle Scholar
  92. Smith, S. M. (1994). Frustrated feelings of imminent recall: On the tip-of-the-tongue. In J. Metcalfe & A. P. Shimamura (Eds.),Metacognition: Knowing about knowing (pp. 27–46). Cambridge, MA: MIT Press.Google Scholar
  93. Smith, S. M., Brown, J. M., &Balfour, S. P. (1991). TOTimals: A controlled experimental method for observing tip-of-the-tongue states.Bulletin of the Psychonomic Society,29, 445–447.Google Scholar
  94. Spellman, B. A., &Bjork, R. A. (1992). When predictions create reality: Judgments of learning may alter what they are intended to assess.Psychological Science,3, 315–316.CrossRefGoogle Scholar
  95. Tulving, E. (1983).Elements of episodic memory. New York: Oxford University Press, Clarendon Press.Google Scholar
  96. Tulving, E., &Pearlstone, Z. (1966). Availability versus accessibility of information in memory for words.Journal of Verbal Learning & Verbal Behavior,5, 381–391.CrossRefGoogle Scholar
  97. Underwood, B. J. (1966). Individual and group predictions of item difficulty for free learning.Journal of Experimental Psychology,71, 673–679.CrossRefPubMedGoogle Scholar
  98. Wellman, H. M. (1977). Tip of the tongue and feeling of knowing experiences: A developmental study of memory monitoring.Child Development,48, 13–21.CrossRefGoogle Scholar
  99. Widner, R. L., Jr., &Smith, S. M. (1993, November).Imminence and familiarity in tip-of-the-tongue and feeling-of-knowing reports. Paper presented at the meeting of the Psychonomic Society, Washington, DC.Google Scholar
  100. Yaniv, I., &Meyer, D. E. (1987). Activation and metacognition of inaccessible stored information: Potential bases for incubation effects in problem solving.Journal of Experimental Psychology: Learning, Memory, & Cognition,13, 187–205.CrossRefGoogle Scholar

Copyright information

© Psychonomic Society, Inc. 1994

Authors and Affiliations

  • Bennett L. Schwartz
    • 1
  1. 1.Department of PsychologyFlorida International UniversityUniversity Park, Miami

Personalised recommendations