Abstract
Robust modeling in cognitive science is a laudable goal. Unfortunately, we will never know if we are achieving it if we continue to be vague about what it means to be robust. In this commentary, I point to a previously published domain-agnostic definition of robustness, describe mechanisms for robustness derived from a multi-disciplinary literature review, and call for quantitative measures of robustness and of the functions our models and modeling practices are intended to achieve.
Similar content being viewed by others
References
Anderson, J. R. (1990). The adaptive character of thought. Hillsdale, NJ: Erlbaum.
Doran, S. M., van Dongen, H. P., & Dinges, D. F. (2001). Sustained attention performance during sleep deprivation: evidence of state instability. Archives of Italian Biology: Neuroscience, 139, 253–267.
Drummond, S. P., Brown, G. G., Salamat, J. S., & Gillin, J. C. (2004). Increasing task difficulty facilitates the cerebral compensatory response to total sleep deprivation. Sleep, 27, 445–451.
Gigerenzer, G., & Brighton, H. (2009). Homo heuristicus: why biased minds make better inferences. Topics in Cognitive Science, 1, 107–143.
Gluck, K. A., McNamara, J. M., Brighton, H., Dayan, P., Kareev, Y., Krause, J., Kurzban, R., Selten, R., Stevens, J. R., Voelkl, B., & Wimsatt, W. C. (2012). Robustness in a variable environment. In J. R. Stevens & P. Hammerstein (Eds.) Evolution and the mechanisms of decision making (pp. 195–214). Strüngmann Forum Report, vol. 11, J. Lupp, Series ed. Cambridge, MA: MIT Press.
Gunzelmann, G., Gross, J. B., Gluck, K. A., & Dinges, D. F. (2009). Sleep deprivation and sustained attention performance. Integrating mathematical and cognitive modeling. Cognitive Science, 33, 880–910.
Price, C. J., & Friston, K. J. (2002). Degeneracy and cognitive anatomy. Trends in Cognitive Sciences, 6, 416–421.
Rogers, T. T., & McClelland, J. L. (2004). Semantic cognition: a parallel distributed processing approach. Cambridge, MA: MIT Press.
Rumelhart, D. E., & Todd, P. M. (1993). Learning and connectionist representations. In D. E. Meyer & S. Kornblum (Eds.), Attention and performance XIV: synergies in experimental psychology, artificial intelligence, and cognitive neuroscience (pp. 3–30). Cambridge, MA: MIT Press.
Saper, C. B., Scammell, T. E., & Lu, J. (2005). Hypothalamic regulation of sleep and circadian rhythms. Nature, 437, 1257–1263.
Shiffrin, R. M., Lee, M. D., Kim, W., & Wagenmakers, E.-J. (2008). A survey of model evaluation approaches with a tutorial on hierarchical Bayesian methods. Cognitive Science, 32, 1248–1284.
Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning: an introduction. Cambridge, MA: MIT Press.
Walsh, M. W., Einstein, E. H., & Gluck, K. A. (2013). A quantification of robustness. Journal of Applied Research in Memory and Cognition, 2, 137–148. https://doi.org/10.1016/j.jarmac.2013.07.002.
Walsh, M. W., & Gluck, K. A. (2014). Mechanisms for robust cognition. Cognitive Science, 39(6), 1131–1171. https://doi.org/10.1111/cogs.12192.
Walsh, M. W., Gunzelmann, G., & van Dongen, H. P. A. (2014). Comparing accounts of psychomotor vigilance impairment due to sleep loss. In Proceedings of the 36th Annual Conference of the Cognitive Science Society. Quebec City.
Yin, H. H., Knowlton, B. J., & Balleine, B. W. (2004). Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. European Journal of Neuroscience, 19, 181–189.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Gluck, K.A. What Does It Mean for Psychological Modeling to Be More Robust?. Comput Brain Behav 2, 154–156 (2019). https://doi.org/10.1007/s42113-019-00065-8
Published:
Issue Date:
DOI: https://doi.org/10.1007/s42113-019-00065-8