Perception & Psychophysics

, Volume 66, Issue 3, pp 406–421

The sampling distributions of Gaussian ROC statistics

  • Neil A. Macmillan
  • Caren M. Rotello
  • Jeff O. Miller
Article

DOI: 10.3758/BF03194889

Cite this article as:
Macmillan, N.A., Rotello, C.M. & Miller, J.O. Perception & Psychophysics (2004) 66: 406. doi:10.3758/BF03194889
  • 258 Downloads

Abstract

For a discrimination experiment, a plot of the hit rate against the false-alarm rate—the ROC curve— summarizes performance across a range of confidence levels. In many content areas, ROCs are well described by a normal-distribution model and thez-transformed hit and false-alarm rates are approximately linearly related. We examined the sampling distributions of three parameters of this model when applied to a ratings procedure: the area under the ROC (Az), the normalized difference between the means of the underlying signal and noise distributions (da), and the slope of the ROC onz-coordinates (s). Statistical bias (the degree to which the mean of the sampling distribution differed from the true value) was trivial forAz, small but noticeable forda, and substantial fors. Variability of the sampling distributions decreased with the number of trials and was also affected by the number of response categories available to the participant and by the overall sensitivity level. Figures in the article and tables available on line can be used to construct confidence intervals around ROC statistics and to test statistical hypotheses.

Download to read the full article text

Supplementary material

Macmillan-PP-2004 link.txt (1 kb)
Supplementary material, approximately 340 KB.

Copyright information

© Psychonomic Society, Inc. 2004

Authors and Affiliations

  • Neil A. Macmillan
    • 1
  • Caren M. Rotello
    • 1
  • Jeff O. Miller
    • 2
  1. 1.Department of Psychology, Tobin HallUniversity of MassachusettsAmherst
  2. 2.University of OtagoDunedin

Personalised recommendations