Skip to main content

Validations

  • Chapter
  • First Online:
  • 453 Accesses

Part of the book series: Computational Approaches to Cognition and Perception ((CACP))

Abstract

In this chapter, we provide assurance that the likelihood-free algorithms we have described in the previous chapters can correctly recover posterior distributions for a number of cognitive modeling applications. First, we show how the parameters of a popular model of episodic memory can be accurately recovered using the ABCDE algorithm. Second, we show how a hierarchical version of the classic signal detection theory model can be recovered using the Gibbs ABC algorithm and a kernel-based approach. Finally, we show how the parameters of the Linear Ballistic Accumulator model, a simple model of perceptual decision making, can be accurately estimated using the PDA method, but not using the synthetic likelihood approach. Through each of these validations, we demonstrate that the likelihood-free algorithms can accurately recover the true posterior distributions.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    We treated the correct and incorrect RT distributions as the accumulators themselves, rather than the response alternatives.

References

  1. M.D. Lee, Psychon. Bull. Rev. 15, 1 (2008)

    Article  PubMed  Google Scholar 

  2. J.N. Rouder, J. Lu, Psychon. Bull. Rev. 12, 573 (2005)

    Article  PubMed  Google Scholar 

  3. C.F. Sheu, J. Math. Psychol. 36, 592 (1992)

    Article  Google Scholar 

  4. B.M. Turner, P.B. Sederberg, Psychon. Bull. Rev. 21, 227 (2014)

    Article  PubMed  PubMed Central  Google Scholar 

  5. S. Wood, Nature 466, 1102 (2010)

    Article  PubMed  Google Scholar 

  6. C.P. Robert, G. Casella, Monte Carlo Statistical Methods (Springer, New York, NY, 2004)

    Book  Google Scholar 

  7. R.D. Wilkinson, Biometrika 96, 983 (2008)

    Google Scholar 

  8. B.M. Turner, P.B. Sederberg, J. Math. Psychol. 56, 375 (2012)

    Article  Google Scholar 

  9. B.M. Turner, P.B. Sederberg, S. Brown, M. Steyvers, Psychol. Methods 18, 368 (2013)

    Article  PubMed  PubMed Central  Google Scholar 

  10. C.J.F. ter Braak, Stat. Comput. 16, 239 (2006)

    Article  Google Scholar 

  11. B.M. Turner, T. Van Zandt, Psychometrika 79, 185 (2014)

    Article  PubMed  Google Scholar 

  12. D.M. Green, J.A. Swets, Signal Detection Theory and Psychophysics (Wiley, New York, 1966)

    Google Scholar 

  13. S. Dennis, M.S. Humphreys, Psychol. Rev. 108, 452 (2001)

    Article  PubMed  Google Scholar 

  14. B.M. Turner, S. Dennis, T. Van Zandt, Psychol. Rev. 120, 667 (2013)

    Article  PubMed  PubMed Central  Google Scholar 

  15. S. Brown, A. Heathcote, Cogn. Psychol. 57, 153 (2008)

    Article  PubMed  Google Scholar 

  16. J.I. Myung, M. Montenegro, M.A. Pitt, J. Math. Psychol. 51, 198 (2007)

    Article  PubMed  PubMed Central  Google Scholar 

  17. M. Plummer, N. Best, K. Cowles, K. Vines, R News 6(1), 7 (2006). http://CRAN.R-project.org/doc/Rnews/

    Google Scholar 

  18. R Core Team, R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna (2012). http://www.R-project.org. ISBN: 3-900051-07-0

  19. N.A. Macmillan, C.D. Creelman, Detection Theory: A User’s Guide (Lawrence Erlbaum Associates, Mahwah, NJ, 2005)

    Google Scholar 

  20. M. Usher, J.L. McClelland, Psychol. Rev. 108, 550 (2001)

    Article  PubMed  Google Scholar 

  21. S. Brown, A. Heathcote, Psychol. Rev. 112, 117 (2005)

    Article  PubMed  Google Scholar 

  22. M. Stone, Psychometrika 25, 251 (1960)

    Article  Google Scholar 

  23. R. Ratcliff, Psychol. Rev. 85, 59 (1978)

    Article  Google Scholar 

  24. B.U. Forstmann, G. Dutilh, S. Brown, J. Neumann, D.Y. von Cramon, K.R. Ridderinkhof, E.J. Wagenmakers, Proc. Natl. Acad. Sci. 105, 17538 (2008)

    Article  PubMed  PubMed Central  Google Scholar 

  25. C. Donkin, L. Averell, S. Brown, A. Heathcote, Behav. Res. Methods 41, 1095 (2009)

    Article  PubMed  Google Scholar 

  26. C. Donkin, A. Heathcote, S. Brown, in 9th International Conference on Cognitive Modeling – ICCM2009, ed. by A. Howes, D. Peebles, R. Cooper, Manchester (2009)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Palestro, J.J., Sederberg, P.B., Osth, A.F., Zandt, T.V., Turner, B.M. (2018). Validations. In: Likelihood-Free Methods for Cognitive Science. Computational Approaches to Cognition and Perception. Springer, Cham. https://doi.org/10.1007/978-3-319-72425-6_4

Download citation

Publish with us

Policies and ethics