Abstract
Limitations in visual working memory (VWM) have been extensively studied in psychophysical tasks, but not well understood in terms of how these memory limits translate to performance in more natural domains. For example, in reaching to grasp an object based on a spatial memory representation, overshooting the intended target may be more costly than undershooting, such as when reaching for a cup of hot coffee. The current body of literature lacks a detailed account of how the costs or consequences of memory error influence what we encode in visual memory and how we act on the basis of remembered information. Here, we study how externally imposed monetary costs influence behavior in a motor decision task that involves reach planning based on recalled information from VWM. We approach this from a decision theoretic perspective, viewing decisions of where to aim in relation to the utility of their outcomes given the uncertainty of memory representations. Our results indicate that subjects accounted for the uncertainty in their visual memory, showing a significant difference in their reach planning when monetary costs were imposed for memory errors. However, our findings indicate that subjects memory representations per se were not biased by the imposed costs, but rather subjects adopted a near-optimal post-mnemonic decision strategy in their motor planning.
Similar content being viewed by others
References
Bays PM (2014) Noise in neural populations accounts for errors in working memory. J Neuro-Sci 34(10):3632–3645
Brouwer A-M, Knill DC (2007) The role of memory in visually guided reaching. J Vis 7(5):6
Brouwer A-M, Knill DC (2009) Humans use visual and remembered information about object location to plan pointing movements. J Vis 9(1):24
Franconeri SL, Alvarez GA, Cavanagh P (2013) Flexible cognitive resources: competitive content maps for attention and memory. Trends Cogn Sci 17(3):134–141
Goldstone RL, Hendrickson AT (2010) Categorical perception. Wiley Interdiscip Rev Cogn Sci 1(1):69–78
Hayhoe MM, Shrivastava A, Mruczek R, Pelz JB (2003) Visual memory and motor planning in a natural task. J Vis 3(1):6
Hayhoe MM, Rothkopf CA (2011) Vision in the natural world. Wiley Interdiscip Rev Cogn Sci 2(2):158–166
Hollingworth A, Richard AM, Luck SJ (2008) Understanding the function of visual short-term memory: transsaccadic memory, object correspondence, and gaze correction. J Exp Psychol Gen 137(1):163
Hudson TE, Wolfe U, Maloney LT (2012) Speeded reaching movements around invisible obstacles. P-LOS Computational Biology
Körding K (2007) Decision theory: what “should” the nervous system do? Science 318(5850):606–610
Luck SJ (2008) Visual short-term memory. In: Luck SJ, Hollingworth A (eds) Visual memory. Oxford University Press, Oxford, pp 43–85
Luck SJ, Vogel EK (2013) Visual working memory capacity: From psychophysics and neurobiology to individual differences. Trends Cogn Sci 17(8):391–400
Lu Z-L, Dosher B (2014) Visual psychophysics: from laboratory to theory. MIT Press, Massachusetts
Ma WJ, Husain M, Bays PM (2014) Changing concepts of working memory. Nat Neurosci 17(3):347–356
Maloney LT, Zhang H (2010) Decision-theoretic models of visual perception and action. Vis Res 50(23):2362–2374
Orhan AE, Sims CR, Jacobs RA, Knill DC (2014) The adaptive nature of visual working memory. Curr Dir Psychol Sci 23(3):164–170
Richards W, Rubin JM (2015) Color vision: Representing material categories. Encyclopedia of Color Science and Technology
Roberson D, Davies I, Davidoff J (2000) Color categories are not universal: replications and new evidence from a stone-age culture. J Exp Psychol Gen 129(3):369
Sims CR, Jacobs RA, Knill DC (2012) An ideal observer analysis of visual working memory. Psychol Rev 119(4):807
Sims CR (2015) The cost of misremembering: Inferring the loss function in visual working memory. J Vis 15(3):2
Trommershäuser J, Maloney LT, Landy MS (2008) Decision making, movement planning and statistical decision theory. Trends Cogn Sci 12(8):291–297
Wolpert DM, Landy MS (2012) Motor control is decision-making. Curr Opin Neurobiol 22(6):996–1003
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Lerch, R.A., Sims, C.R. Decision theory, motor planning, and visual memory: deciding where to reach when memory errors are costly. Exp Brain Res 234, 1589–1597 (2016). https://doi.org/10.1007/s00221-016-4553-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00221-016-4553-4