Skip to main content
Log in

A note on ROC analysis and non-parametric estimate of sensitivity

  • Published:
Psychometrika Aims and scope Submit manuscript

Abstract

In the signal detection paradigm, the non-parametric index of sensitivity A′, as first introduced by Pollack and Norman (1964), is a popular alternative to the more traditional d′ measure of sensitivity. Smith (1995) clarified a confusion about the interpretation of A′ in relation to the area beneath proper receiver operating characteristic (ROC) curves, and provided a formula (which he called A′′) for this commonly held interpretation. However, he made an error in his calculations. Here, we rectify this error by providing the correct formula (which we call A) and compare the discrepancy that would have resulted. The corresponding measure for bias b is also provided. Since all such calculations apply to “proper” ROC curves with non-decreasing slopes, we also prove, as a separate result, the slope-monotonicity of ROC curves generated by likelihood-ratio criterion.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Ashby F.G., Townsend J.T. (1986) Varieties of perceptual independence. Psychological Review, 93:154–179

    Article  PubMed  Google Scholar 

  • Balakrishnan J.D. (1998) Some more sensitive measures of sensitivity and response bias. Psychological Methods, 3:68–90

    Article  Google Scholar 

  • Balakrishnan J.D. (1999) Decision processes in discrimination: fundamental misrepresentations of signal detection theory. Journal of Experimental Psychology: Human Perception and Performance, 25:1189–1206

    Article  Google Scholar 

  • Donaldson W., Good C. (1996) A’r: An estimate of area under isosensitivity curves. Behavioral Methods, Instruments, and Computers, 28:590–597

    Google Scholar 

  • Green D.M., Swets J.A. (1964) Signal Detection Theory and Psychophysics, New York: John Wiley & Sons

    Google Scholar 

  • Macmillan N.A., Creelman C.D. (1996) Triangles in ROC space: History and theory of “non-parametric” measures of sensitivity and response bias. Psychonomic Bulletin and Review, 3:164-170

    Google Scholar 

  • Newsome W.T., Britten K.H., Movshon J.A., Shadlen M. (1989) Single neurons and the perception of visual motion. In D.M-K. Lam, C.D. Gilbert (Eds.) Proceedings of the Retina Research Foundation Symposia, Vol. 2, Neural Mechanisms of Visual Perception, (171–198). Woodlands, TX: Portfolio Publishing.

    Google Scholar 

  • Peterson W.W., Birdsall T.G., Fox W.C. (1954) The theory of signal detectability. Transactions of the IRE Professional Group on Information Theory, PGIT-4:171–212

    Google Scholar 

  • Pollack I., Hsieh R. (1969) Sampling variability of the area under ROC curve and ′. Psychological Bulletin,1:161–173

    Google Scholar 

  • Pollack L., Norman D.A. (1964) Non-parametric analysis of recognition experiments. Psychonomic Science 1:125–126

    Google Scholar 

  • Smith W.D. (1995) Clarification of sensitivity measure A′. Journal of Mathematical Psychology 39:82–89

    Google Scholar 

  • Swets J.A., Tanner W.P., Birdsall T.G. (1964). Decision process in perception. Psychological Review 68:301–340

    Article  Google Scholar 

  • Tanner W.P. Jr., Swets J.A. (1954) A decision-making theory of visual detection. Psychological Review 61:401–409

    PubMed  Google Scholar 

  • Zhang J., Riehle A., Requin J. (1997) Locus of a neural process in stimulus-response association tasks. Journal of Mathematical Psychology 41:219–236.

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jun Zhang.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Zhang, J., Mueller, S.T. A note on ROC analysis and non-parametric estimate of sensitivity. Psychometrika 70, 203–212 (2005). https://doi.org/10.1007/s11336-003-1119-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11336-003-1119-8

Keywords

Navigation