Abstract
Many modern descriptions of signal detection theory (SDT) are, at best, distorted caricatures of the Gaussian equal-variance model of SDT (G-SDT). The distortions have sometimes led to important, but unwarranted, conclusions about the nature of cognitive processes. Some researchers reject using ď and β because of concerns about the validity of explicit underlying assumptions (that are shared with most inferential statistics), instead using either the supposedly “nonparametric” measures ofA′ andB″ or measures known to confound ability and bias. The origins, development, and underlying assumptions of SDT are summarized, then contrasted with modern distortions and misconceptions. The nature and interpretation of common descriptive statistics for sensitivity and bias are described along with important pragmatic considerations about use. A deeper understanding of SDT provides researchers with tools that better evaluate both their own findings and the validity of conclusions drawn by others who have utilized SDT measures and analyses.
Article PDF
Similar content being viewed by others
References
Balakrishnan, J. D. (1999). Decision processes in discrimination: Fundamental misrepresentations of signal detection theory.Journal of Experimental Psychology: Human Perception & Performance,25, 1–18.
Berliner, J. E., &Durlach, N. I. (1973). Intensity perception. Resolution in roving-level discrimination.Journal of the Acoustical Society of America,53, 1270–1287.
Braida, L. D., &Durlach, N. I. (1972). Intensity perception: II. Resolution in one-interval paradigms.Journal of the Acoustical Society of America,51, 483–502.
Coren, S., Ward, L. M., &Enns, J. T. (1999).Sensation and perception. New York: Harcourt Brace.
Durlach, N. I., &Braida, L. D. (1969). Intensity perception: I. Pre liminary theory of intensity resolution.Journal of the Acoustical Society of America,46, 372–383.
Egan, J. P. (1975).Signal detection theory and ROC analysis. New York: Academic Press.
Goldinger, S. D. (1998). Signal detection comparisons of phonemic and phonetic priming: The flexible-bias problem.Perception & Psychophysics,60, 952–965.
Goldstein, E. B. (1999).Sensation and perception (5th ed). Pacif ic Grove, CA: Brooks/Cole.
Goldstein, E. B. (2002).Sensation and perception (6th ed). Pacif ic Grove, CA: Wadsworth.
Green, D. M. (1964). General prediction relating yes—no and forcedchoice results [Abstract].Journal of the Acoustical Society of America,36, 1042.
Green, D. M., &Moses, F. L. (1966). On the equivalence of two recognition measures of short-term memory.Psychological Bulletin,66, 228–234.
Green, D. M., &Swets, J. A. (1966).Signal detection theory and psychophysics. New York: Wiley.
Grier, J. B. (1971). Nonparametric indices for sensitivity and bias: Computing formulas.Psychological Bulletin,98, 185–199.
Haberlandt, K. (1994).Cognitive psychology. Boston: Allyn & Bacon.
Hays, W. L. (1963).Statistics for psychologists. New York: Holt, Rinehart & Winston.
Hicks, J. L., &Marsh, R. L. (2000). Toward specifying the attentional demands of recognition memory.Journal of Experimental Psychology: Learning, Memory, & Cognition,26, 1483–1498.
Irwin, R. J., &Hautus, M. J. (1997). Likelihood-ratio decision strategy for independent observations in thesame— different task: An approximation to the detection-theoretic model.Perception & Psychophysics,59, 313–316.
Irwin, R. J., Hautus, M. J., &Francis, M. A. (2001). Indices of response bias in thesame-different experiment.Perception & Psychophysics,63, 1091–1100.
Jahnke, J. C., &Nowaczyk, R. H. (1998).Cognition. Upper Saddle River, NJ: Prentice-Hall.
Kadlec, H., &Townsend, J. T. (1992). Signal detection analyses of dimensional interactions. In F. G. Ashby (Ed.).Multidimensional models of perception and cognition (pp.181–227). Hillsdale, NJ: Erlbaum.
Kantowitz, B. H., Roediger, H. L., III, &Elmes, D. G. (2001).Experimental Psychology (7th ed.). Pacif ic Grove, CA: Wadsworth.
Laming, D. (1986).Sensory analysis. London: Academic Press.
Levine, M. W., &Shefner, J. M. (1991).Fundamentals of sensation and perception (2nd ed.). Pacif ic Grove, CA: Brooks/Cole.
Licklider, J. C. R. (1964). Theory of signal detection. In J. Swets (Ed.),Signal detection and recognition by human observers (pp. 92–121). New York: Wiley.
Luce, R. D. (1963). Detection and recognition. In R. D. Luce, R. R. Bush, & E. Galanter (Eds.),Handbook of mathematical psychology (Vol. 1, pp. 103–189). New York: Wiley.
Macmillan, N. A., Braida, L. D., &Goldberg, R. F. (1987). Central and peripheral processes in the perception of speech and nonspeech sounds. In M. E. H. Schouten (Ed.),The psychophysics of speech perception (pp. 28–45). Dordrecht: Martinus Nijhoff.
Macmillan, N. A., &Creelman, C. D. (1990). Response bias: Characteristics of detection theory, threshold theory, and “nonparametric” indexes.Psychological Bulletin,107, 401–413.
Macmillan, N. A., &Creelman, C. D. (1991).Detection theory: A user’s guide. New York: Cambridge University Press.
Macmillan, N. A., &Creelman, C. D. (1996). Triangles in ROC space: History and theory of “nonparametric” measures of sensitivity and response bias.Psychonomic Bulletin & Review,3, 164–170.
Macmillan, N. A., Goldberg, R. F., &Braida, L. D. (1988). Resolution for speech sounds: Basic sensitivity and context memory on vowel and consonant continua.Journal of the Acoustical Society of America,84, 1262–1280.
Macmillan, N. A., &Kaplan, H. L. (1985). Detection theory analysis of group data: Estimating sensitivity from average hit and false-alarm rates.Psychological Bulletin,98, 185–199.
Masson, M. E. J., &Borowsky, R. (1998). More than meets the eye: Context effects in word identification.Memory & Cognition,26, 1245–1269.
McNicol, D. (1972).A primer of signal detection theory. London: George Allen & Unwin.
Miller, M. B., &Wolford, G. I. (1999). Theoretical commentary: The role of criterion shift in false memory.Psychological Review,106, 398–405.
Mood, A. M., &Graybill, F. A. (1963).Introduction to the theory of Statistics. New York: McGraw-Hill.
Noreen, D. L. (1981). Optimal decision rules for some common psychophysical paradigms. In S. Grossberg (Ed.),Proceedings of the Symposium in Applied Mathematics of the American Mathematical Society and the Society for Industrial and Applied Mathematics (Vol. 12, pp. 237–279). Providence, RI: American Mathematical Society.
Norris, D. (1986). Word recognition: Context effects without priming.Cognition,22, 93–136.
Norris, D. (1995). Signal detection theory and modularity: On being sensitive to the power of bias models of semantic priming.Journal of Experimental Psychology: Human Perception & Performance,21, 935–939.
Norris, D., McQueen, J. M., &Cutler, A. (2000). Merging information in speech recognition: Feedback is never necessary.Behavioral & Brain Sciences,23, 299–370.
Pastore, R. E., &Scheirer, C. J. (1974). Signal detection theory: Considerations for general applications.Psychological Bulletin,81, 945–958.
Payne, D. G., &Wenger, M. J. (1998).Cognitive psychology. New York: Houghton Mifflin.
Peterson, W. W., &Birdsall, T. G. (1953).The theory of signal dectectability (Tech. Rep. No. 13). Ann Arbor: University of Michigan, Electronic Defense Group.
Pollack, I., &Hsieh, R. (1969). Sampling variability of the area under the ROC-curve and ofd e’ .Psychological Bulletin,71, 161–173.
Pollack, I., &Norman, D. A. (1964). A non-parametric analysis of recognition experiments.Psychonomic Science,1, 125–126.
Rhodes, G., Parkin, A.J., &Tremewan, T. (1993). Semantic priming and sensitivity in lexical decision.Journal of Experimental Psychology: Human Perception & Performance,15, 154–165.
Roediger, H. L., III, &McDermott, K. B. (1995). Creating false memories: Remembering words not presented in lists.Journal of Experimental Psychology: Learning, Memory, & Cognition,21, 803–814.
Roediger, H. L., III, &McDermott, K. B. (1999). False alarms about false memories.Psychological Review,106, 406–410.
Schiffman, H. R. (2000).Sensation and perception: An integrated approach. New York: Wiley.
Sekuler, R., &Blake, R. (1990).Perception. New York: McGraw-Hill.
Sekuler, R., &Blake, R. (2002).Perception (4th ed.). New York: McGraw-Hill.
Snodgrass, J. G., &Corwin, J. (1988). Pragmatics of measuring recognition memory: Applications to dementia and amnesia.Journal of Experimental Psychology: General,117, 34–50.
Sorkin, R. D., &Dai, H. (1994). Signal detection analysis of the ideal group.Organizational Behavior & Human Decision Processes,60, 1–13.
Sorkin, R. D., Hays, C. J., &West, R. (2001). Signal detection analysis of group decision making.Psychological Review,108, 183–203.
Stevens, S. S. (1961). In W. A. Rosenblith (Ed.),Sensory communication: Contributions to the symposium on principles of sensory communication (pp. 1–34). Cambridge, MA: MIT Press.
Stretch, V., &Wixted, J. T. (1998). Decision rules for recognition memory confidence judgments.Journal of Experimental Psychology: Learning, Memory, & Cognition,24, 1397–1410.
Swets, J. A. (Ed.) (1964).Signal detection and recognition by human observers: Contemporary readings. New York: Wiley.
Swets, J. A. (1986). Indicies of discrimination or diagnostic accuracy: Their ROCs and implied models.Psychological Bulletin,99, 100–117.
Swets, J. A. (1996).Signal detection theory and ROC analysis in psychology and diagnostics: Collected papers. Mahwah, NJ: Erlbaum.
Swets, J. A., Dawes, R. M., &Monahan, J. (2000). Psychological science can improve diagnostic decisions.Psychological Science in the Public Interest,1, 1–26.
Swets, J. A., Tanner, W. P., Jr., &Birdsall, T. (1961). Decision processes in perception.Psychological Review,68, 301–340.
Tanner, W. P., Jr. (1961). Physiological implications of psychophysical data. In Annals of the New York Academy of Sciences (Vol. 89, pp. 752–765). New York: New York Academy of Sciences.
Treisman, M. (2002). Is signal detection theory fundamentally flawed? A response to Balakrishnan (1998a, 1998b, 1999).Psychonomic Bulletin & Review,9, 845–857.
Wald, A. (1950).Statistical decision functions. New York: Wiley.
Wald, A. (1955). Basic ideas of a general theory of statistical decision rules. In T. W. Anderson et al. (Eds.),Selected papers in statistics and probability by Abraham Wald (pp. 656–668). New York: McGraw-Hill. (Original work published 1952)
Wickens, T. D. (2002).Elementary signal detection theory. New York: Oxford University Press.
Wickens, T. D., &Hirshman, E. (2000). False memories and statistical decision theory: Comments on Miller and Wolford (1999) and Roediger and McDermott (1999).Psychological Review,107, 377–383.
Wixted, J.T., &Stretch, V. (2000). The case against a criterion-shift account of false memory.Psychological Review,107, 368–376.
Author information
Authors and Affiliations
Corresponding author
Additional information
Preparation of this paper was supported in part by a grant from National Science Foundation
Rights and permissions
About this article
Cite this article
Pastore, R.E., Crawley, E.J., Berens, M.S. et al. “Nonparametric”A’ and other modern misconceptions about signal detection theory. Psychonomic Bulletin & Review 10, 556–569 (2003). https://doi.org/10.3758/BF03196517
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03196517