Abstract
It is important to know that one knows, to be able to discriminate what one knows from what one does not, since that is a basis for making decisions about using and augmenting one's knowledge. A measure of knowing that one knows has been proposed, the detectability of correctness, the ability to discriminate those answers that one gives that are correct from those that are incorrect. This paper presents the background of the problem of knowing that one knows, points out how previous efforts at measurement have been faulty and presents empirical results that indicate that detectability of correctness is a valid and stable measure.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bamber, D. (1975). “The area above the ordinal dominance graph and the area below the receiver operating characteristic graph”, Journal of Mathematical Psychology 12: 387–415.
Brown, A. (1977). “Development, schooling and the acquisition of knowledge”, in R. Anderson, R. Spiro and W. Montague (eds.), Schooling and the Acquisition of Knowledge. Hillsdale, NJ: Lawrence Erlbaum Associates.
Brown, A. (1981). “Metacognitive development and reading”, in R. J. Spiro, B. Bruce and W. F. Brewer (eds.), Theoretical Issues in Reading Comprehension. Hillsdale, NJ: Lawrence Erlbaum Associates.
Brown, R. and McNeill, D. (1966). “The ‘tip of the tongue’ phenomenon”, Journal of Verbal Learning and Verbal Behavior 5: 325–337.
Eysenck, M. W. (1979). “The feeling of knowing a word's meaning”, British Journal of Psychology 70, part 2: 243–251.
Ferrell, W. R. (1972). “Student self-assessment”, Proceedings of the 1972 Conference on Frontiers of Education, Tucson, AZ. The Institute of Electrical and Electronics Engineers, 47–52.
Ferrell, W. R. and McGoey, P. J. (1980). “A model of calibration for subjective probabilities”, Organizational Behavior and Human Performance 26: 32–53.
Flavell, J. H. (1976). “Metacognitive aspects of problem solving”, in L. B. Resnick (ed.), The Nature of Intelligence. Hillsdale, NJ: Lawrence Erlbaum Associates.
Flavell, J. H. (1978). “Metacognitive development”, in J. M. Scandura and C. J. Brainerd (eds.), Structural/Process Models of Complex Human Behavior. Alphen aan den Rijn, The Netherlands: Sijthoff and Noordhoff.
Green, D. M. and Swets, J. A. (1966). Signal Detection Theory and Psychophysics. New York: McGraw Hill.
Hart, J. T. (1965). “Memory and the feeling of knowing experience”, Journal of Educational Psychology 56: 208–216.
Hart, J. T. (1967). “Memory and memory monitoring processes”, Journal of Verbal Learning and Verbal Processing 6: 685–691.
Hintikka, J. (1962). Knowledge and Belief. Ithaca, NY: Cornell University Press.
Holt, H. H. (1964). How Children Fail. New York: Dell.
Hosseini-Ardehali, J. (1981). Detectability of Correctness: A Signal Detection Measure of Knowing that one Knows. Unpublished doctoral dissertation, Tucson, AZ: The University of Arizona.
Hunt, D. P. (in press). “Effects of human self-assessment responding on learning”, Journal of Applied Psychology.
Lemmon, E. J. (1967). “If I know, do I know that I know?” in A. Stroll (ed.), Epistemology. New York: Harper and Row.
Lichtenstein, S. and Fischhoff, B. (1977). “Do those who know more also know more about how much they know?” Organizational Behavior and Human Performance 20: 159–183.
Lichtenstein, S., Fischhoff, R. and Phillips, L. (1981). “Calibration of probabilities: the state of the art to 1980”, in D. Kahneman, P. Slovic and A. Tversky (eds.), Judgment Under Uncertainty: Heuristics and Biases. New York: Cambridge University Press.
McNicol, D. (1972). A Primer of Signal Detection Theory. London: George Allen and Unwin.
Nelson, T. O. and Norens, L. (1980). “Norms of 300 general information questions: accuracy of recall and feeling of knowing ratings”, Journal of Verbal Learning and Verbal Behavior 29: 338–368.
Pastore, R. E. and Scheirer, C. J. (1974). “Signal detection theory: considerations for general application”, Psychological Bulletin 81: 945–958.
Pollack, I. and Hsieh, R. (1969). “Sampling variability of the area under the ROC curve and d′e”, Psychological Bulletin 71: 161–173.
ShufordJr., H. A. and Brown, T. A. (1975). “Elicitation of personal probabilities and their assessment”, Instructional Science 4: 137–188.
Smith, M. and Ferrell, W. R. (1981). “The effect of base rate on calibration of subjective probability for true-false items: model and experiment”, paper presented at the Eighth Research Conference on Subjective Probability, Utility and Decision Making, Budapest, August 1981.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Hosseini, J., Ferrell, W.R. Detectability of correctness: A measure of knowing that one knows. Instr Sci 11, 113–127 (1982). https://doi.org/10.1007/BF00154881
Issue Date:
DOI: https://doi.org/10.1007/BF00154881