A note on ROC analysis and non-parametric estimate of sensitivity
- 501 Downloads
In the signal detection paradigm, the non-parametric index of sensitivity A′, as first introduced by Pollack and Norman (1964), is a popular alternative to the more traditional d′ measure of sensitivity. Smith (1995) clarified a confusion about the interpretation of A′ in relation to the area beneath proper receiver operating characteristic (ROC) curves, and provided a formula (which he called A′′) for this commonly held interpretation. However, he made an error in his calculations. Here, we rectify this error by providing the correct formula (which we call A) and compare the discrepancy that would have resulted. The corresponding measure for bias b is also provided. Since all such calculations apply to “proper” ROC curves with non-decreasing slopes, we also prove, as a separate result, the slope-monotonicity of ROC curves generated by likelihood-ratio criterion.
Keywordssignal detection theory A′ non-parametric estimate of sensitivity likelihood-ratio
Unable to display preview. Download preview PDF.
- Donaldson W., Good C. (1996) A’r: An estimate of area under isosensitivity curves. Behavioral Methods, Instruments, and Computers, 28:590–597Google Scholar
- Green D.M., Swets J.A. (1964) Signal Detection Theory and Psychophysics, New York: John Wiley & SonsGoogle Scholar
- Macmillan N.A., Creelman C.D. (1996) Triangles in ROC space: History and theory of “non-parametric” measures of sensitivity and response bias. Psychonomic Bulletin and Review, 3:164-170Google Scholar
- Newsome W.T., Britten K.H., Movshon J.A., Shadlen M. (1989) Single neurons and the perception of visual motion. In D.M-K. Lam, C.D. Gilbert (Eds.) Proceedings of the Retina Research Foundation Symposia, Vol. 2, Neural Mechanisms of Visual Perception, (171–198). Woodlands, TX: Portfolio Publishing.Google Scholar
- Peterson W.W., Birdsall T.G., Fox W.C. (1954) The theory of signal detectability. Transactions of the IRE Professional Group on Information Theory, PGIT-4:171–212Google Scholar
- Pollack I., Hsieh R. (1969) Sampling variability of the area under ROC curve and ′. Psychological Bulletin,1:161–173Google Scholar
- Pollack L., Norman D.A. (1964) Non-parametric analysis of recognition experiments. Psychonomic Science 1:125–126Google Scholar
- Smith W.D. (1995) Clarification of sensitivity measure A′. Journal of Mathematical Psychology 39:82–89Google Scholar