Skip to main content
Download PDF

Functions for traditional and multilevel approaches to signal detection theory

Behavior Research Methods volume 41, pages 257–267 (2009)Cite this article

Abstract

In the present article, functions written in the freeware R are presented that calculate several measures from traditional signal detection theory for each individual in a sample, along with summary statistics for the sample. Bias-corrected and accelerated bootstrap confidence intervals are also produced. Arguments are made for using an alternative approach—multilevel generalized linear models—and a function is presented for it. These functions are part of the R package sdtalt, which is available on the Comprehensive R Archive Network. Recent data from memory recognition studies are used to illustrate these functions.

References

  • Baayen, R. H., Davidson, D. J., & Bates, D. M. (2008). Mixed-effects modeling with crossed random effects for subjects and items. Journal of Memory & Language, 59, 390–412.

    Article  Google Scholar 

  • Banks, W. P. (1970). Signal detection theory and human memory. Psychological Bulletin, 74, 81–99.

    Article  Google Scholar 

  • Bates, D., Maechler, M., & Dai, B. (2008). lme4: Linear mixed-effects models using S4 classes (Version 0.999375-20) [Computer software]. Available at http://cran.r-project.org/.

  • Blozis, S. A., & Traxler, M. J. (2007). Analyzing individual differences in sentence processing performance using multilevel models. Behavior Research Methods, 39, 31–38.

    Article  PubMed  Google Scholar 

  • Canty, A., & Ripley, B. (2008). boot: Bootstrap R (S-Plus) Functions (R package Version 1.2-32) [Computer software]. Available at http:// cran.r-project.org/.

  • Chambers, J. M. (2008). Software for data analysis: Programming with R. New York: Springer.

    Book  Google Scholar 

  • Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational & Psychological Measurement, 20, 37–46.

    Article  Google Scholar 

  • Crawley, M. J. (2007). The R book. Chichester, U.K.: Wiley.

    Book  Google Scholar 

  • DeCarlo, L. T. (1998). Signal detection theory and generalized linear models. Psychological Methods, 3, 186–205.

    Article  Google Scholar 

  • Doran, H., Bates, D., Bliese, P., & Dowling, M. (2007). Estimating the multilevel Rasch model: With the lme4 package. Journal of Statistical Software, 20 (2).

  • Efron, B., & Tibshirani, R. J. (1993). An introduction to the bootstrap. Boca Raton, FL: Chapman & Hall/CRC.

    Google Scholar 

  • Goldstein, H. (2003). Multilevel statistical methods (3rd ed.). London: Edward Arnold.

    Google Scholar 

  • Goodman, L. A., & Kruskal, W. H. (1979). Measures of association for cross classifications. New York: Springer.

    Google Scholar 

  • Hoffman, L., & Rovine, M. J. (2007). Multilevel models for the experimental psychologist: Foundations and illustrative examples. Behavior Research Methods, 39, 101–117.

    Article  PubMed  Google Scholar 

  • Horry, R., & Wright, D. B. (2008). I know your face but not where I saw you: Context memory is impaired for other race faces. Psychonomic Bulletin & Review, 15, 610–614.

    Article  Google Scholar 

  • Kraemer, H. C. (2006). Correlation coefficients in medical research: From product moment correlation to the odds ratio. Statistical Methods in Medical Research, 15, 525–545.

    Article  PubMed  Google Scholar 

  • Locker, L., Hoffman, L., & Bovaird, J. A. (2007). On the use of multilevel modeling as an alternative to item analysis in psycholinguistic research. Behavior Research Methods, 39, 723–730.

    Article  PubMed  Google Scholar 

  • McCullagh, P., & Nelder, J. A. (1989). Generalized linear models (2nd ed.). London: Chapman and Hall.

    Google Scholar 

  • Pinheiro, J. C., & Bates, D. M. (2000). Mixed-effects models in S and S-Plus. New York: Springer.

    Book  Google Scholar 

  • R Development Core Team (2008). R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing. Available at www.R-project.org.

    Google Scholar 

  • Skagerberg, E. M., & Wright, D. B. (2008). Manipulating power can affect memory conformity. Applied Cognitive Psychology, 22, 207–216.

    Article  Google Scholar 

  • Stanislaw, H., & Todorov, N. (1999). Calculation of signal detection theory measures. Behavior Research Methods, Instruments, & Computers, 31, 137–149.

    Article  Google Scholar 

  • Swets, J. A. (1996). Signal detection theory and ROC analysis in psychology and diagnostics: Collected papers. Mahwah, NJ: Erlbaum.

    Google Scholar 

  • Wickens, T. D. (2002). Elementary signal detection theory. New York: Oxford University Press.

    Google Scholar 

  • Wilcox, R. R. (2004). Introduction to robust estimation and hypothesis testing (2nd ed.). San Diego: Academic Press.

    Google Scholar 

  • Wilkinson, L. & the Task Force on Statistical Inference, American Psychological Association, Science Directorate, Washington DC, US. (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54, 594–604.

    Article  Google Scholar 

  • Wright, D. B. (1998). Modelling clustered data in autobiographical memory research: The multilevel approach. Applied Cognitive Psychology, 12, 339–357.

    Article  Google Scholar 

  • Wright, D. B., Gabbert, F., Memon, A., & London, K. (2008). Changing the criterion for memory conformity in free recall and recognition. Memory, 16, 137–148.

    Article  PubMed  Google Scholar 

  • Wright, D. B., & London, K. (2009). Modern regression techniques using R: A practical guide for students and researchers. London: Sage.

    Google Scholar 

  • Wright, D. B., & London, K. (in press). Multilevel modelling: Beyond the basic applications. British Journal of Mathematical and Statistical Psychology.

  • Wright, D. B., London, K., & Waechter, M. (in press). Social recognition memory and social anxiety. Applied Cognitive Psychology.

  • Wright, D. B., Mathews, S. A., & Skagerberg, E. M. (2005). Social recognition memory: The effect of other people’s responses for previously seen and unseen items. Journal of Experimental Psychology: Applied, 11, 200–209.

    Article  PubMed  Google Scholar 

  • Zhou, X.-H., Obuchowski, N. A., & McClish, D. K. (2002). Statistical methods in diagnostic medicine. New York: Wiley.

    Book  Google Scholar 

Download references

Author information

Affiliations

  1. Department, Florida International University, 33265, Miami, FL

    Daniel B. Wright

  2. University of Sussex, Brighton, England

    Ruth Horry & Elin M. Skagerberg

Authors
  1. Daniel B. Wright
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ruth Horry
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Elin M. Skagerberg
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Daniel B. Wright.

Additional information

An R package for the functions described in the present article, along with a manual, are available at http://cran.r-project.org/web/packages/ sdtalt/index.html.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Wright, D.B., Horry, R. & Skagerberg, E.M. Functions for traditional and multilevel approaches to signal detection theory. Behavior Research Methods 41, 257–267 (2009). https://doi.org/10.3758/BRM.41.2.257

Download citation

  • Received:

  • Accepted:

  • Issue Date:

  • DOI: https://doi.org/10.3758/BRM.41.2.257

Keywords

  • False Alarm
  • Signal Detection Theory
  • Correct Rejection
  • Multilevel Approach
  • Lmer Function