Abstract
Sit-to-stand (STS) transfers are a common human task which involves complex sensorimotor processes to control the highly nonlinear musculoskeletal system. In this paper, typical unassisted and assisted human STS transfers are formulated as optimal feedback control problem that finds a compromise between task end-point accuracy, human balance, energy consumption, smoothness of motion and control and takes further human biomechanical control constraints into account. Differential dynamic programming is employed, which allows taking the full, nonlinear human dynamics into consideration. The biomechanical dynamics of the human is modeled by a six link rigid body including leg, trunk and arm segments. Accuracy of the proposed modelling approach is evaluated for different human healthy and patient/elderly subjects by comparing simulations and experimentally collected data. Acceptable model accuracy is achieved with a generic set of constant weights that prioritize the different criteria. Finally, the proposed STS model is used to determine optimal assistive strategies suitable for either a person with specific body segment weakness or a more general weakness. These strategies are implemented on a robotic mobility assistant and are intensively evaluated by 33 elderlies, mostly not able to perform unassisted STS transfers. The validation results show a promising STS transfer success rate and overall user satisfaction.
Similar content being viewed by others
Notes
Stiffness of the human segments, specially arms, is neglected in the model assuming that the human willingly accomplishes the STS task and thus, reacts very stiff to external forces.
Please note that a precise study of the human balance behavior during a STS is out of focus of this paper, but is a very interesting biomechanical research question. Currently no study focusing on the balance criteria used during a human STS transfer that could inform the selection of these criteria could be found in literature and therefore regulation of the human ZMP position has been considered as a postural regulator as proposed by Li et al. (2011).
The base of support (BOS), which determines the values of \(\varvec{p}^{min}_{zmp}\) and \(\varvec{p}^{max}_{zmp}\)), typically includes the size of the feet and the room between them for a human without external support, respectively unassisted STS. For the assisted case, when the human firmly grasps the robot handles a larger BOS area can be considered. Since this, however, requires detecting whether the human stably grasps the handles and the current robotic platform is not equipped with proper sensors to do so, we decided to simplify the problem and to consider the most restrictive case defined by the BOS of the human user only.
Please note that the same values for all diagonal elements are considered for each weighting matrix.
This required that the image-based 3D-recordings of the trials were cleaned from gaps, phantom markers, flickering and other inconsistencies which occurred due to occlusions, reflections, loose clothes of the patient, missing markers, and other unexpected incidences during the recordings. Moreover, marker trajectories that have been mismatched by the automatic marker identification algorithms of the software had to be identified and reassigned manually.
Please note that at the time of performing experiments no detailed information on anthropometric data and mass distributions in elderlies was available in literature and thus, the parameters in Zatsiorsky et al. were considered to approach the problem. However, very recently (in Sep 2015) a new study by Hoang and Mombaur (2015) proposed an adaptation of the parameters defined in De Leva (1996) specifically for elderlies. Using these adapted formulas may lead to a better estimation of the anthropometric data of elderly subjects.
The box constraints in the bilevel optimization (Eq. 7) were considered to be in the range of \(W_i * 10^{-2}\) to \(W_i * 10^{-2}\) in order to consider a relatively large search space.
Please note that no correlation analysis has been performed on other weighting factors of the cost function.
Please note that although subjects were asked to minimize variation, still non-negligible differences were observed, especially for initial upper body inclination and feet positions.
In Tassa et al. (2012), Li and Todorov (2004) authors proposed different improvements to the iterative LQG method including solutions to the invertability problem of \(\varvec{S}_{k}\) that have been also considered in the above-mentioned DDP implementation, but are not explicitly mentioned here because of space limitations.
References
Bahrami, F., Riener, R., Jebedar-Maralani, P., & Schmidt, G. (2000). Biomechanical anaylsis of sit-to-stand transfer in healthy and paraplegic subjects. Clinical Biomechanics, 15, 123–133.
Chugo, D., Asawa, T., Kitamura, T., Jia, S., & Takase, K. (2008). A rehabilitation walker with standing and walking assistance. In IEE/RSJ International conference on intelligent robots and systems, Nice, France
Chugo, D., Morita, Y., Sakaida, Y., Yokota, S., & Takase, K. (2012). A robotic walker for standing assistance with realtime estimation of patients load. In 12th IEEE international workshop on advanced motion control, Sarajevo, Bosnia and Herzegovina
Chuy, O. J., Hirata, Y., Wang, Z., & Kosuge, K. (2006). Approach in assisting a sit-to-stand movement using robotic walking support system. In IEE/RSJ international conference on intelligent robots and systems, China
De Leva, P. (1996). Adjustments to Zatsiorsky-Seluyanov’s segment inertia parameters. Journal of Biomechanics, 29(9), 1223–1230.
Dreben, O. (2006). Introduction to physical therapy for physical therapist assistants, Jones & Bartlett Pub, chap patient positioning, body mechanics and transfer techniques (pp. 217–234)
Folstein, M. F., Folstein, S. E., & McHugh, P. R. (1975). mini-mental state: A practical method for grading the cognitive state of patients for the clinician. Journal of Psychiatric Research, 12(3), 189–198.
Galli, M., Cimolin, V., Crivellini, M., & Campanini, I. (2008). Quantitative analysis of sit to stand movement: Experimental set-up definition and application to healthy and hemiplegic adults. Gait and Posture, 28(1), 80–85.
Guralnik, J. M., Simonsick, E. M., Ferrucci, L., Glynn, R. J., Berkman, L. F., Blazer, D. G., et al. (1994). A short physical performance battery assessing lower extremity function: Association with self-reported disability and prediction of mortality and nursing home admission. Journal of Gerontology, 49(2), M85–M94.
Hirshfeld, H., Thorsteinsdottir, M., & Olsson, E. (1999). Coordinated ground forces exerted by buttocks and feet re adequately programmed for weight transfer during sit-to-stand. Journal of Neurophysiology, 82, 3021–3029.
Hoang, K. L. H., & Mombaur, K. D. (2015). Optimal design of a physical assistive device to support sit-to-stand motions. In IEEE international conference on robotics and automation (ICRA) (pp. 5891–5897). IEEE.
Hoang, K. L. H., & Mombaur, K. (2015). Adjustments to de leva-anthropometric regression data for the changes in body proportions in elderly humans. Journal of Biomechanics, 48(13), 3732–3736.
Ikeda, E. R., Schenkman, M. L., Relay, P. O., & Hodge, A. (1991). Influence of age in dynamics of raising from a chair. Physical Therapy, 71, 473–481.
Iqbal, K., & Roy, A. (2004). Stabilizing PID controllers for a single-link biomechanical model with position, velocity, and force feedback. ASME Transactions on Biomechanical Engineering, 126, 838–843.
Janssen, W. G. M., Bussmann, H. B. J., & Stam, H. J. (2002). Determinants of the sit-to-stand movement: A review. Physical Therapy, 82(9), 866–879.
Jun, H. G., Chang, Y. Y., Dan, B. J., Yang, H., Song, W.-K., & Kin, J. (2011). Walking and sit-to-stand support system for elderly and disabled. In IEEE international conference on rehabilitation robotics, Zurich, Switzerland
Kerr, K. M., White, J. A., Mollan, R., & Baird, H. E. (1991). Rising from a chair: A review of the literature. Physiotherapy, 77, 15–19.
Kim, I., Cho, W., Yuk, G., Jo, B. R., & Min, B. H. (2011). Kinematic analysis of sit-to-stand assistive device for the elderly and disabled. In IEEE international conference on rehabilitation robotics, Zurich, Switzerland
Kotake, T., Dohi, N., Kajiwara, T., Sumi, N., Koyama, Y., & Miura, T. (1993). An analysis of sit-to-stand movements. Archives of Physical Medicine and Rehabilitation, 74, 1095–1099.
Kralj, A., Jaeger, R. J., & Munih, M. (1990). Analysis of standing up and sitting down in humans—Definitions and normative data presentation. Journal of Biomechanics, 23(11), 1123–1138.
Kuzelicki, J., Zefran, M., Burger, H., & Bajd, T. (2005). Synthesis of standing-up trajectories using dynamic optimization. Gait and Posture, 21, 1–11.
Li, W., & Todorov, E. (2004). Iterative linear quadratic regulator applied to nonlinear biological movement systems. 1st international conference on informatics in control, automation and robotics (pp. 222–229)
Li, Y., Levine, W. S., Yang, Y., & He, C. (2011). A nonlinear optimal human postural regulator. In American Control Conference (ACC) (pp. 5420–5425). IEEE
Liao, Z. L., & Shoemaker, C. A. (1992). Advantages of differential dynamic programming over Newton’s method for discrete-time optimal control problems. Ithaca: Cornell University.
Lindemann, U., Claus, H., Stuber, M., Augat, P., Muche, R., Nikolaus, T., et al. (2003). Measuring power during the sit-to-stand transfer. European Journal of Applied Physiology, 89(5), 466–470.
Mathiyakom, W., McNitt-Gray, J., Requejo, P., & Costa, K. (2005). Modifying center of mass trajectory during sit-to-stand tasks redistributes the mechanical demand across the lower extremity joints. Clinical Biomechanics, 20, 105–111.
Mayne, D. (1966). A second-order gradiant method of optimizing non-linear discrete time systems. International Journal of Control, 3, 85–95.
Mederic, P., Pasqui, V., Plumet, F., & Bidaud, P. (2004). Sit to stand transfer assisting by an intelligent walking-aid. In 7th international conference on climbing and walking robots, Madrid, Espagne
Mederic, P., Pasqui, V., Plumet, F., Bidaud, P., & Guinot, J. (2005). Elderly people sit to stand transfer experimental analysis. In International conference on climbing and walking robots (Clawar’05) (pp. 953–960)
Millington, P., Myklebust, B. M., & Shambes, G. M. (1992). Biomechanical analysis of the sit-to-stand motion in elderly persons. Archives of Physical Medicine and Rehabilitation, 73, 09–17.
Mombaur, K. (2014). Optimization of sit to stand motions of elderly people for the design and control of physical assistive devices. PAMM, 14(1), 805–806.
Mombaur, K., Truong, A., & Laumond, J. P. (2010). From human to humanoid locomotionan inverse optimal control approach. Autonomous Robots, 28(3), 369–383.
Mughal, A. M., & Iqbal, K. (2005). A fuzzy biomechanical model for \(\text{ H }_\infty \) suboptimal control of sit-to-stand movement. In 8th international IASTED conference on intelligent systems and control (pp. 374–379)
Mughal, A. M., & Iqbal, K. (2006). A fuzzy biomechanical model with \({H_{2}}\) optimal control of sit to stand movement. In American control conference, Minneapolis, MN, USA (pp. 3427–3432)
Mughal, A. M., & Iqbal, K. (2008a). Bipedal modeling with decoupled optimal control design of biomechanical sit-to-stand transfer. In International workshop on robotic and sensors environments, Ottawa, ON, Canada
Mughal, A. M., & Iqbal, K. (2008b). Synthesis of angular profiles for bipedal sit-to-stand movement. In 40th southeastern symposium on system theory, New Orleans, LA, USA. (pp. 374–379)
Mughal, A. M., Perviaz, S., & Iqbal, K. (2011). LMI based physiological cost optimization for biomechanical sts transfer. In IEEE international conference on systems, man, and cybernetics (SMC) (pp. 1508–1513)
Pasqui, V., Saint-Bauzel, L., & Bidaud, P. (2007). Postural stability control for robot-human cooperation for sit-to-stand assistance. In 10th international conference on climbing and walking robots and the supporting technologies for mobile machines, Singapore (pp. 409–416)
Pasqui, V., Saint-Bauzel, L., & Sigaud, O. (2010). Characterization of a least effort user-centered trajectory for sit-to-stand assistance user-centered trajectory for sit-to-stand assistance. In Symposium on dynamics modeling and interaction control in virtual and real environments (pp. 197–204)
Rodosky, M. W., Andriachhi, T., & Andersson, G. (1989). The influence of chair height on lower limb mechanism during rising. Journal of Orthopedic Research, 7, 66–71.
Roetenberg, D., Luinge, H., & Slycke, P. (2013). Xsens MVN: Full 6 DOF human motion tracking using miniature inertial sensors. XSENS technologies
Schenkman, M., Berger, R. A., Riley, P. O., Mann, R. W., & Hodge, W. A. (1990). Whole-body movements during rising to standing from sitting. Physical Therapy, 70(10), 638–648.
Schwickert, L., Klenk, J., Stähler, A., Becker, C., & Lindemann, U. (2011). Robotic-assisted rehabilitation of proximal humerus fractures in virtual environments. Zeitschrift für Gerontologie und Geriatrie, 44(6), 387–392.
Tassa, Y., Erez, T., & Todorov, E. (2012). Synthesis and stabilization of complex behaviors through online trajectory optimization. In IEEE/RSJ international conference on intelligent robots and systems, Vilamoura, Portugal
Todorov, E., & Jordan, M. (2002). Optimal feedback control as a theory of motor coordination. Nature Neuroscience, 5, 1226–1235.
Vukobratovic, M., & Borovac, B. (2004). Zero-moment point thirty five years of its life. International Journal of Humanoid Robotics, 1(1), 157–173.
Yoshioka, S., Nagano, A., Himeno, R., & Fukashiro, S. (2007). Computation of the kinematics and the minimum peak joint moments of sit-to-stand movements. Biomedical Engineering Online, 6, 26.
Yoshioka, S., Nagano, A., Hay, D. C., & Fukashiro, S. (2009). Biomechanical analysis of the relation between movement time and joint moment development during a sit-to-stand task. Biomedical Engineering Online, 8, 27.
Zatsiorsky, V., & Seluyanov, V. (1983). The mass and inertia characteristics of the main segments of the human body. Biomechanics, IIIB, 1152–1159.
Acknowledgments
This work is supported in part by the MOBOT project within the 7th Framework Programme of the European Union, under the Grant Agreement No. 600796 and the Institute of Advanced Studies of the Technische Universität München.
Author information
Authors and Affiliations
Corresponding author
Additional information
This is one of several papers published in Autonomous Robots comprising the “Special Issue on Assistive and Rehabilitation Robotics”.
Appendices
Appendix 1
Differential dynamic programming (DDP) first proposed in Mayne (1966) and recently reformulated by Tassa et al. (2012) is used to solve the optimal control problem formulated in this paper. DDP iteratively and quadratically approximates the costs and the nonlinear system dynamics around the current trajectory. Then, an approximately optimal control law is found by designing an affine controller for the approximated system that enforces formulated control constraints. For our specific STS transfer problem we consider pure gravity compensating forces as an initial guess of the control sequence, which is then iteratively improved by the algorithm with respect to the formulated cost function. The iterative approach is implemented as follows:
First, the cost function is time-discretized
with \(N = T/\Delta t\). Then, each iteration starts with an open loop control sequence \(\hat{\varvec{\tau }}_k\) that is applied to the deterministic nonlinear and discretized forward dynamics \(\hat{\varvec{x}}_{k+1} = \hat{\varvec{x}}_{k} + \Delta t f(\hat{\varvec{x}}_{k} , \hat{\varvec{\tau }}_{k}\)) using standard Euler integration at sample k. Then, the dynamics and the cost function are quadratically approximated in the vicinity of the current trajectory. Both aforementioned approximations are expressed in terms of state and control deviations, i.e. \(\delta \varvec{x}_k = \varvec{x}_k - \hat{\varvec{x}}_{k}\) and \(\delta \varvec{\tau }_k = \varvec{\tau }_k - \hat{\varvec{\tau }}_{k}\), and are computed as follows,
with \(\texttt {func}^{\texttt {vars}}\) the partial derivative of function \(\texttt {func}\) with respect to variables ordered by \({\texttt {vars}}\) and evaluated at (\(\hat{\varvec{x}}_k, \hat{\varvec{\tau }}_k\)).
At each moment k, the cost for the optimal control of the system from the current state \(\varvec{x}_k\) to the final state \(\varvec{x}_N\) is defined by:
where \(\varvec{\tau }_{i}^{*}\) is the optimal control decision. This local approximation of the original optimal control problem can then be efficiently solved by evaluating the Hamilton-Jacobi-Bellman equation
where
Minimizing the right side of (13) with respect to \(\delta \varvec{\tau }_{k}\) determines the optimal control policy as follows,
The resulting control law is of affine form \(\delta \varvec{\tau }_k^{*}=\mathbf {l}_k + \mathbf {L}_k \delta \varvec{x}_k \) with an open loop term (\(\mathbf {l}_k = -\varvec{S}_{k}^{-1} \varvec{R}_{k}\)) and a feedback term (\(\mathbf {L}_k \delta \varvec{x}_k = - \varvec{S}_{k}^{-1} \varvec{T}_{k}\delta \varvec{x}_{k}\)). Additional control constraints are taken into account by enforcing the open loop terms to lie inside of a constrained boundary.
For each iteration i the approximate optimal control sequence \(\hat{\varvec{\tau }}^{(i+1)}_k\) is finally obtained by adding the newly calculated corrective control term and the control term of the last iteration \(\hat{\varvec{\tau }}^{(i+1)}_k = \delta \varvec{\tau }^{(i)}_k + \hat{\varvec{\tau }}^{(i)}_k\), and then the new nominal state and control trajectories are computed using the dynamic equations of the system.Footnote 10
Appendix 2
The body measurements of the healthy and elderly participants in the validation of the STS transfer model (Tables 3, 4).
Rights and permissions
About this article
Cite this article
Geravand, M., Korondi, P.Z., Werner, C. et al. Human sit-to-stand transfer modeling towards intuitive and biologically-inspired robot assistance. Auton Robot 41, 575–592 (2017). https://doi.org/10.1007/s10514-016-9553-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10514-016-9553-5