Abstract
One of the key problems of motor control is the redundancy problem, in particular how the central nervous system (CNS) chooses an action out of infinitely many possible. A promising way to address this question is to assume that the choice is made based on optimization of a certain cost function. A number of cost functions have been proposed in the literature to explain performance in different motor tasks: from force sharing in grasping to path planning in walking. However, the problem of uniqueness of the cost function(s) was not addressed until recently. In this article, we analyze two methods of finding additive cost functions in inverse optimization problems with linear constraints, so-called linear-additive inverse optimization problems. These methods are based on the Uniqueness Theorem for inverse optimization problems that we proved recently (Terekhov et al., J Math Biol 61(3):423–453, 2010). Using synthetic data, we show that both methods allow for determining the cost function. We analyze the influence of noise on the both methods. Finally, we show how a violation of the conditions of the Uniqueness Theorem may lead to incorrect solutions of the inverse optimization problem.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Abbeel P, Ng AY (2004) Apprenticeship learning via inverse reinforcement learning. In: Proceedings of the twenty-first international conference on machine learning. ACM Press, New York
Ait-Haddou R, Binding P, Herzog W (2000) Theoretical considerations on cocontraction of sets of agonistic and antagonistic muscles. J Biomech 33(9): 1105–1111
Ait-Haddou R, Jinha A, Herzog W, Binding P (2004) Analysis of the force-sharing problem using an optimization model. Math Biosci 191(2):111–122. doi:10.1016/j.mbs.2004.05.003, url:http://dx.doi.org/10.1016/j.mbs.2004.05.003
Amarantini D, Rao G, Berton E (2010) A two-step emg-and-optimization process to estimate muscle force during dynamic movement. J Biomech 43(9):1827–1830. doi:10.1016/j.jbiomech.2010.02.025, url:http://dx.doi.org/10.1016/j.jbiomech.2010.02.025
Anderson FC, Pandy MG (1999) A dynamic optimization solution for vertical jumping in three dimensions. Comput Methods Biomech Biomed Eng 2(3): 201–231
Anderson FC, Pandy MG (2003) Individual muscle contributions to support in normal walking. Gait Posture 17(2): 159–169
Aoki T, Niu X, Latash ML, Zatsiorsky VM (2006) Effects of friction at the digit-object interface on the digit forces in multi-finger prehension. Exp Brain Res 172(4):425–438. doi:10.1007/s00221-006-0350-9, url:http://dx.doi.org/10.1007/s00221-006-0350-9
Ben-Itzhak S, Karniel A (2008) Minimum acceleration criterion with constraints implies bang-bang control as an underlying principle for optimal trajectories of arm reaching movements. Neural Comput 20(3):779–812. doi:10.1162/neco.2007.12-05-077, url:http://dx.doi.org/10.1162/neco.2007.12-05-077
Bernstein NA (1967) The coordination and regulation of movements. Pergamon, Oxford
Berret B, Darlot C, Jean F, Pozzo T, Papaxanthis C, Gauthier JP (2008) The inactivation principle: mathematical solutions minimizing the absolute work and biological implications for the planning of arm movements. PLoS Comput Biol 4(10):e1000194. doi:10.1371/journal.pcbi.1000194, url:http://dx.doi.org/10.1371/journal.pcbi.1000194
Biess A, Liebermann DG, Flash T (2007) A computational model for redundant human three-dimensional pointing movements: integration of independent spatial and temporal motor plans simplifies movement dynamics. J Neurosci 27(48): 13,045–13,064
Binding P, Jinha A, Herzog W (2000) Analytic analysis of the force sharing among synergistic muscles in one- and two-degree-of-freedom models. J Biomech 33(11): 1423–1432
Bottasso CL, Prilutsky BI, Croce A, Imberti E, Sartirana S (2006) A numerical procedure for inferring from experimental data the optimization cost functions using a multibody model of the neuro-musculoskeletal system. Multibody Syst Dyn 16: 123–154
Buchanan TS, Shreeve DA (1996) An evaluation of optimization techniques for the prediction of muscle activation patterns during isometric tasks. J Biomech Eng 118(4): 565–574
Challis JH (1997) Producing physiologically realistic individual muscle force estimations by imposing constraints when using optimization techniques. Med Eng Phys 19(3): 253–261
Collins JJ (1995) The redundant nature of locomotor optimization laws. J Biomech 28(3): 251–267
Crevecoeur F, McIntyre J, Thonnard JL, Lefevre P (2010) Movement stability under uncertain internal models of dynamics. J Neurophysiol. doi:10.1152/jn.00315.2010, url:http://dx.doi.org/10.1152/jn.00315.2010
Crowninshield RD, Brand RA (1981) A physiologically based criterion of muscle force prediction in locomotion. J Biomech 14(11): 793–801
Cruse H, Wischmeyer E, Brwer M, Brockfeld P, Dress A (1990) On the cost functions for the control of the human arm movement. Biol Cybern 62(6): 519–528
Czaplicki A, Silva M, Ambrsio J, Jesus O, Abrantes J (2006) Estimation of the muscle force distribution in ballistic motion based on a multibody methodology. Comput Methods Biomech Biomed Eng 9(1):45–54. doi:10.1080/10255840600603625, url:http://dx.doi.org/10.1080/10255840600603625
Davy DT, Audu ML (1987) A dynamic optimization technique for predicting muscle forces in the swing phase of gait. J Biomech 20(2): 187–201
De Groote F, Pipeleers G, Jonkers I, Demeulenaere B, Patten C, Swevers J, De Schutter J (2009) A physiology based inverse dynamic analysis of human gait: potential and perspectives. Comput Methods Biomech Biomed Eng 12(5):563–574. doi:10.1080/10255840902788587, url:http://dx.doi.org/10.1080/10255840902788587
Ding J, Wexler AS, Binder-Macleod SA (2000) Development of a mathematical model that predicts optimal muscle activation patterns by using brief trains. J Appl Physiol 88(3): 917–925
Dul J, Johnson GE, Shiavi R, Townsend MA (1984a) Muscular synergism. II. A minimum-fatigue criterion for load sharing between synergistic muscles. J Biomech 17(9): 675–684
Dul J, Townsend MA, Shiavi R, Johnson GE (1984b) Muscular synergism. I. On criteria for load sharing between synergistic muscles. J Biomech 17(9): 663–673
Engelbrecht S (2001) Minimum principles in motor control. J Math Psychol 45(3): 497–542
Fagg AH, Shah A, Barto AG (2002) A computational model of muscle recruitment for wrist movements. J Neurophysiol 88(6):3348–3358. doi:10.1152/jn.00621.2001, url:http://dx.doi.org/10.1152/jn.00621.2001
Flash T, Hogan N (1985) The coordination of arm movements: an experimentally confirmed mathematical model. J Neurosci 5(7): 1688–1703
Friedman J, Flash T (2009) Trajectory of the index finger during grasping. Exp Brain Res 196(4):497–509. doi:10.1007/s00221-009-1878-2, http://dx.doi.org/10.1007/s00221-009-1878-2
Guigon E (2010) Active control of bias for the control of posture and movement. J Neurophysiol. doi:10.1152/jn.00162.2010, url:http://dx.doi.org/10.1152/jn.00162.2010
Happee R, der Helm FCV (1995) The control of shoulder muscles during goal directed movements, an inverse dynamic analysis. J Biomech 28(10): 1179–1191
Harris CM, Wolpert DM (1998) Signal-dependent noise determines motor planning. Nature 394(6695):780–784. doi:10.1038/29528, url:http://dx.doi.org/10.1038/29528
Heintz S, Gutierrez-Farewik EM (2007) Static optimization of muscle forces during gait in comparison to emg-to-force processing approach. Gait Posture 26(2):279–288. doi:10.1016/j.gaitpost.2006.09.074, url:http://dx.doi.org/10.1016/j.gaitpost.2006.09.074
Herzog W (1987) Individual muscle force estimations using a non-linear optimal design. J Neurosci Methods 21(2-4): 167–179
Herzog W, Leonard TR (1991) Validation of optimization models that estimate the forces exerted by synergistic muscles. J Biomech 24(Suppl 1): 31–39
Hoff B, Arbib MA (1993) Models of trajectory formation and temporal interaction of reach and grasp. J Mot Behav 25(3): 175–192
Hughes RE, Chaffin DB (1995) The effect of strict muscle stress limits on abdominal muscle force predictions for combined torsion and extension loadings. J Biomech 28(5): 527–533
Hughes RE, Chaffin DB, Lavender SA, Andersson GB (1994) Evaluation of muscle force prediction models of the lumbar trunk using surface electromyography. J Orthop Res 12(5):689–698. doi:10.1002/jor.1100120512, url:http://dx.doi.org/10.1002/jor.1100120512
Kaufman KR, An KW, Litchy WJ, Chao EY (1991) Physiological prediction of muscle forces. I. Theoretical formulation. Neuroscience 40(3): 781–792
Körding KP, Wolpert DM (2004) The loss function of sensorimotor learning. Proc Natl Acad Sci USA 101(26):9839–9842. doi:10.1073/pnas.0308394101, http://dx.doi.org/10.1073/pnas.0308394101
Kuo AD, Zajac FE (1993) Human standing posture: multi-joint movement strategies based on biomechanical constraints. Prog Brain Res 97: 349–358
Kuzelicki J, Zefran M, Burger H, Bajd T (2005) Synthesis of standing-up trajectories using dynamic optimization. Gait Posture 21(1): 1–11
Lee SW, Zhang X (2005) Development and evaluation of an optimization-based model for power-grip posture prediction. J Biomech 38(8):1591–1597. doi:10.1016/j.jbiomech.2004.07.024, url:http://dx.doi.org/10.1016/j.jbiomech.2004.07.024
Liu CK, Hertzmann A, Popović Z (2005) Learning physics-based motion style with nonlinear inverse optimization. ACM Trans Graph 24(3): 1071–1081. doi:10.1145/1073204.1073314
Martin L, Cahout V, Ferry M, Fouque F (2006) Optimization model predictions for postural coordination modes. J Biomech 39(1):170–176. doi:10.1016/j.jbiomech.2004.10.039, url:http://dx.doi.org/10.1016/j.jbiomech.2004.10.039
Menegaldo LL, de Toledo Fleury A, Weber HI (2006) A ’cheap’ optimal control approach to estimate muscle forces in musculoskeletal systems. J Biomech 39(10):1787–1795. doi:10.1016/j.jbiomech.2005.05.029, url:http://dx.doi.org/10.1016/j.jbiomech.2005.05.029
Mombaur K, Truong A, Laumond JP (2010) From human to humanoid locomotion—an inverse optimal control approach. Auton Robots 28(3): 369–383. doi:10.1007/s10514-009-9170-7
Niu X, Latash ML, Zatsiorsky VM (2009) Effects of grasping force magnitude on the coordination of digit forces in multi-finger prehension. Exp Brain Res 194(1):115–129. doi:10.1007/s00221-008-1675-3, url:http://dx.doi.org/10.1007/s00221-008-1675-3
Nubar Y, Contini R (1961) A minimal principle in biomechanics. Bull Math Biol 23:377–391. url:http://dx.doi.org/10.1007/BF02476493, 10.1007/BF02476493
Nussbaum MA, Chaffin DB, Rechtien CJ (1995) Muscle lines-of-action affect predicted forces in optimization-based spine muscle modeling. J Biomech 28(4): 401–409
O’Sullivan I, Burdet E, Diedrichsen J (2009) Dissociating variability and effort as determinants of coordination. PLoS Comput Biol 5(4):e1000345. doi:10.1371/journal.pcbi.1000345, url:http://dx.doi.org/10.1371/journal.pcbi.1000345
Pandy MG (2001) Computer modeling and simulation of human movement. Annu Rev Biomed Eng 3:245–273. doi:10.1146/annurev.bioeng.3.1.245, url:http://dx.doi.org/10.1146/annurev.bioeng.3.1.245
Park J, Zatsiorsky VM, Latash ML (2010) Optimality vs. variability: an example of multi-finger redundant tasks. Exp Brain Res 207(1–2):119–132. doi:10.1007/s00221-010-2440-y, url:http://dx.doi.org/10.1007/s00221-010-2440-y
Pataky TC (2005) Soft tissue strain energy minimization: a candidate control scheme for intra-finger normal-tangential force coordination. J Biomech 38(8):1723–1727. doi:10.1016/j.jbiomech.2004.07.020, url:http://dx.doi.org/10.1016/j.jbiomech.2004.07.020
Pataky TC, Latash ML, Zatsiorsky VM (2004) Prehension synergies during nonvertical grasping. II. Modeling and optimization. Biol Cybern 91(4): 231–242
Pedersen DR, Brand RA, Cheng C, Arora JS (1987) Direct comparison of muscle force predictions using linear and nonlinear programming. J Biomech Eng 109(3): 192–199
Pham QC, Hicheur H, Arechavaleta G, Laumond JP, Berthoz A (2007) The formation of trajectories during goal-oriented locomotion in humans. II. a maximum smoothness model. Eur J Neurosci 26(8): 2391–2403
Pierce JE, Li G (2005) Muscle forces predicted using optimization methods are coordinate system dependent. J Biomech 38(4):695–702. doi:10.1016/j.jbiomech.2004.05.016, url:http://dx.doi.org/10.1016/j.jbiomech.2004.05.016
Plamondon R, Alimi AM, Yergeau P, Leclerc F (1993) Modelling velocity profiles of rapid movements: a comparative study. Biol Cybern 69(2): 119–128
Prilutsky BI (2000) Coordination of two- and one-joint muscles: functional consequences and implications for motor control. Motor Control 4(1): 1–44
Prilutsky BI, Gregory RJ (2000) Analysis of muscle coordination strategies in cycling. IEEE Trans Rehabil Eng 8(3): 362– 370
Prilutsky BI, Zatsiorsky VM (2002) Optimization-based models of muscle coordination. Exerc Sport Sci Rev 30(1): 32–38
Prilutsky BI, Herzog W, Allinger TL (1997) Forces of individual cat ankle extensor muscles during locomotion predicted using static optimization. J Biomech 30(10): 1025–1033
Prilutsky BI, Isaka T, Albrecht AM, Gregor RJ (1998) Is coordination of two-joint leg muscles during load lifting consistent with the strategy of minimum fatigue. J Biomech 31(11): 1025– 1034
Raikova RT (2000) Some mechanical considerations on muscle coordination. Motor Control 4(1):89–96; discussion 97–116
Raikova RT, Aladjov HT (2002) Hierarchical genetic algorithm versus static optimization-investigation of elbow flexion and extension movements. J Biomech 35(8): 1123–1135
Schappacher-Tilp G, Binding P, Braverman E, Herzog W (2009) Velocity-dependent cost function for the prediction of force sharing among synergistic muscles in a one degree of freedom model. J Biomech 42(5):657–660. doi:10.1016/j.jbiomech.2008.12.013, url:http://dx.doi.org/10.1016/j.jbiomech.2008.12.013
Seth A, Pandy MG (2007) A neuromusculoskeletal tracking method for estimating individual muscle forces in human movement. J Biomech 40(2):356–366. doi:10.1016/j.jbiomech.2005.12.017, url:http://dx.doi.org/10.1016/j.jbiomech.2005.12.017
Terekhov AV, Pesin YB, Niu X, Latash ML, Zatsiorsky VM (2010) An analytical approach to the problem of inverse optimization with additive objective functions: an application to human prehension. J Math Biol 61(3):423–453. doi:10.1007/s00285-009-0306-3, url:http://dx.doi.org/10.1007/s00285-009-0306-3
Tsirakos D, Baltzopoulos V, Bartlett R (1997) Inverse optimization: functional and physiological considerations related to the force-sharing problem. Crit Rev Biomed Eng 25(4–5): 371–407
Uno Y, Kawato M, Suzuki R (1989) Formation and control of optimal trajectory in human multijoint arm movement. minimum torque-change model. Biol Cybern 61(2): 89–101
van Bolhuis BM, Gielen CC (1999) A comparison of models explaining muscle activation patterns for isometric contractions. Biol Cybern 81(3): 249–261
van den Bogert AJ (1994) Analysis and simulation of mechanical loads on the human musculoskeletal system: a methodological overview. Exerc Sport Sci Rev 22: 23–51
van Dieën JH, Kingma I (2005) Effects of antagonistic co-contraction on differences between electromyography based and optimization based estimates of spinal forces. Ergonomics 48(4):411–426. doi:10.1080/00140130512331332918, url:http://dx.doi.org/10.1080/00140130512331332918
Vigouroux L, Quaine F, Labarre-Vila A, Amarantini D, Moutet F (2007) Using emg data to constrain optimization procedure improves finger tendon tension estimations during static fingertip force production. J Biomech 40(13):2846–2856. doi:10.1016/j.jbiomech.2007.03.010, url:http://dx.doi.org/10.1016/j.jbiomech.2007.03.010
Vilimek M (2007) Musculotendon forces derived by different muscle models. Acta Bioeng Biomech 9(2): 41–47
Zatsiorsky VM, Latash ML (2008) Multifinger prehension: an overview. J Mot Behav 40(5): 446–476
Zatsiorsky VM, Gregory RW, Latash ML (2002) Force and torque production in static multifinger prehension: biomechanics and control. II. Control. Biol Cybern 87(1): 40–49
Zheng N, Fleisig GS, Escamilla RF, Barrentine SW (1998) An analytical model of the knee for estimation of internal forces during exercise. J Biomech 31(10): 963–967
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Terekhov, A.V., Zatsiorsky, V.M. Analytical and numerical analysis of inverse optimization problems: conditions of uniqueness and computational methods. Biol Cybern 104, 75–93 (2011). https://doi.org/10.1007/s00422-011-0421-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00422-011-0421-2