Abstract
Bayesian decision-making theory presumes that humans can maximize the expected gains by trading off risk-returns in a predefined gain function. Recent findings from spatial reaching and coincident timing tasks have challenged this theory by revealing that humans exhibited risk-seeking or risk-aversive rather than risk-neutral tendency (i.e., failed to achieve Bayesian optimality) in asymmetric gain functions (the gain/loss asymmetric to the target time/position). The debate on why these participants’ performances were sub-optimal remains unsettled. In the current paper, we argue that the abrupt change (i.e., gain volatility, a.k.a., risk magnitude) around the optimal point in the gain function, rather than its asymmetry, is a significant factor of this phenomenon, and that sub-optimality is resolved with an “adaptive risk control” where individual participants voluntarily adjust risk-return trade-off through a controllable task variable. We propose that the relationship between risk sensitivity and risk magnitude determines optimal motor planning.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Schoemaker, P.J.: The expected utility model: Its variants, purposes, evidence and limitations. J. Econ. Lit. 20, 529–563 (1982)
Weise, K., Woger, W.: A Bayesian theory of measurement uncertainty. Meas. Sci. Technol. 4(1), 1–11 (1993). https://doi.org/10.1088/0957-0233/4/1/001
Kahneman, D., Tversky, A.: Prospect theory: An analysis of decision under risk. Econometrica 47(2), 263 (1979). https://doi.org/10.2307/1914185
Kahneman, D., Tversky, A.: Prospect theory: An analysis of decision under risk. In: Handbook of the Fundamentals of Financial Decision Making: Part I, pp. 99–127 (2013)
Maloney, L., Landy, M., Trommershäuser, J.: Statistical decision theory and trade-offs in the control of motor response. Spat. Vis. 16(3), 255–275 (2003). https://doi.org/10.1163/156856803322467527
Trommershäuser, J., Maloney, L.T., Landy, M.S.: Statistical decision theory and the selection of rapid, goal-directed movements. J. Opt. Soc. Am. A 20(7), 1419 (2003). https://doi.org/10.1364/josaa.20.001419
Trommershäuser, J., Gepshtein, S., Maloney, L.T., Landy, M.S., Banks, M.S.: Optimal compensation for changes in task-relevant movement variability. J. Neurosci. 25(31), 7169–7178 (2005)
Trommershäuser, J., Landy, M.S., Maloney, L.T.: Humans rapidly estimate expected gain in movement planning. Psychol. Sci. 17(11), 981–988 (2006). https://doi.org/10.1111/j.1467-9280.2006.01816.x
Wu, S.W., Trommershäuser, J., Maloney, L.T., Landy, M.S.: Limits to human movement planning in tasks with asymmetric gain landscapes. J. Vis. 6(1), 5 (2006). https://doi.org/10.1167/6.1.5
Ota, K., Shinya, M., Maloney, L.T., Kudo, K.: Sub-optimality in motor planning is not improved by explicit observation of motor uncertainty. Sci. Rep. 9(1), 1–11 (2019). https://doi.org/10.1038/s41598-019-50901-x
Ota, K., Shinya, M., Kudo, K.: Sub-optimality in motor planning is retained throughout 9 days practice of 2250 trials. Sci. Rep. 6(1), 37181 (2016). https://doi.org/10.1038/srep37181
Nagengast, A.J., Braun, D.A., Wolpert, D.M.: Risk sensitivity in a motor task with speed-accuracy trade-off. J. Neurophysiol. 105(6), 2668–2674 (2011). https://doi.org/10.1152/jn.00804.2010
Yao, Q., Sakaguchi, Y.: Humans achieve bayesian optimality in controlling risk-return tradeoff of coincident timing task. In: Proceedings of JNNS2018, pp. 24–25 (2018)
Yao, Q., Sakaguchi, Y.: Humans achieve Bayesian optimality in controlling risk-return tradeoff of spatial reaching task. In: Proceedings of JNNS2019, pp. 59–60 (2019)
Yao, Q., Sakaguchi, Y.: Optimizing motor timing decision through adaptive risk-return control (2020, submitted)
Ota, K., Shinya, M., Kudo, K.: Motor planning under temporal uncertainty is suboptimal when the gain function is asymmetric. Front. Comput. Neurosci. 9(9), 88 (2015). https://doi.org/10.3389/fncom.2015.00088
Aumann, R.J., Serrano, R.: An economic index of riskiness. J. Polit. Econ. 116(5), 810–836 (2008). https://doi.org/10.1086/591947
Lejarraga, T., Gonzalez, C.: Effects of feedback and complexity on repeated decisions from description (2011). https://doi.org/10.1016/j.obhdp.2011.05.001
Neyedli, H.F., Welsh, T.N.: People are better at maximizing expected gain in a manual aiming task with rapidly changing probabilities than with rapidly changing payoffs. J. Neurophysiol. 111(5), 1016–1026 (2014). https://doi.org/10.1152/jn.00163.2013
Neyedli, H.F., Welsh, T.N.: Optimal weighting of costs and probabilities in a risky motor decision-making task requires experience. J. Exp. Psychol. Hum. Percept. Perform. 39(3), 638–645 (2013). https://doi.org/10.1037/a0030518
Hertwig, R., Barron, G., Weber, E.U., Erev, I.: Decisions from experience and the effect of rare events in risky choice. Psychol. Sci. 15(8), 534–539 (2004). https://doi.org/10.1111/j.0956-7976.2004.00715.x
Jessup, R.K., Bishara, A.J., Busemeyer, J.R.: Feedback produces divergence from prospect theory in descriptive choice. Psychol. Sci. 19(10), 1015–1022 (2008). https://doi.org/10.1111/j.1467-9280.2008.02193.x
Acknowledgments
The research was supported by the fundamental fund for research and education of graduate students to Y. Sakaguchi from the University of Electro-Communications.
Author information
Authors and Affiliations
Contributions
Q. Yao performed the simulations and analyzed the results. Q. Yao prepared the original draft. Y. Sakaguchi commented and revised the manuscript.
Corresponding author
Editor information
Editors and Affiliations
Ethics declarations
The authors declare no competing financial interest.
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Yao, Q., Sakaguchi, Y. (2020). Adaptive Risk-Return Control in Motor Planning. In: Yang, H., Pasupa, K., Leung, A.CS., Kwok, J.T., Chan, J.H., King, I. (eds) Neural Information Processing. ICONIP 2020. Lecture Notes in Computer Science(), vol 12533. Springer, Cham. https://doi.org/10.1007/978-3-030-63833-7_2
Download citation
DOI: https://doi.org/10.1007/978-3-030-63833-7_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-63832-0
Online ISBN: 978-3-030-63833-7
eBook Packages: Computer ScienceComputer Science (R0)