Skip to main content
SpringerLink
Log in

Real-Time Control Strategy of Exoskeleton Locomotion Trajectory Based on Multi-modal Fusion

  • Research Article
  • Published:
Journal of Bionic Engineering Aims and scope Submit manuscript

Abstract

The exoskeleton robot is a typical man–machine integration system in the human loop. The ideal man–machine state is to achieve motion coordination, stable output, strong personalization, and reduce man–machine confrontation during motion. In order to achieve an ideal man–machine state, a Time-varying Adaptive Gait Trajectory Generator (TAGT) is designed to estimate the motion intention of the wearer and generate a personalized gait trajectory. TAGT can enhance the hybrid intelligent decision-making ability under human–machine collaboration, promote good motion coordination between the exoskeleton and the wearer, and reduce metabolic consumption. An important feature of this controller is that it utilizes a multi-layer control strategy to provide locomotion assistance to the wearer, while allowing the user to control the gait trajectory based on human–robot Interaction (HRI) force and locomotion information. In this article, a Temporal Convolutional Gait Prediction (TCGP) model is designed to learn the personalized gait trajectory of the wearer, and the control performance of the model is further improved by fusing the predefined gait trajectory method with an adaptive interactive force control model. A human-in-the-loop control strategy is formed with the feedback information to stabilize the motion trajectory of the output joints and update the system state in real time based on the feedback from the inertial and interactive force signal. The experimental study employs able-bodied subjects wearing the exoskeleton for motion trajectory control to evaluate the performance of the proposed TAGT model in online adjustments. Data from these evaluations demonstrate that the controller TAGT has good motor coordination and can satisfy the subject to control the motor within a certain range according to the walking habit, guaranteeing the stability of the closed-loop system.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Data Availability

The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.

References

  1. Elprama, S. A., Vanderborght, B., & An, J. (2022). An industrial exoskeleton user acceptance framework based on a literature review of empirical studies. Applied Ergonomics. https://doi.org/10.1016/j.apergo.2021.103615

    Article  Google Scholar 

  2. Proud, J. K., Lai, D., Mudie, K. L., Carstairs, G. L., Billing, D. C., Garofolini, A., & Begg, R. K. (2022). Exoskeleton application to military manual handling tasks. Human Factors: The Journal of Human Factors and Ergonomics Society, 64, 527–554.

    Article  Google Scholar 

  3. Hernández-Sierra, L. J., Mendoza-Gutierrez, M. O., & Mejía-Rodríguez, A. R. (2020). Design of a haptic system for medical image manipulation using augmented reality. Health and technology, 10(2), 447–451.

    Article  Google Scholar 

  4. Zhu, Y., Wu, Q., Chen, B., & Zhao, Z. (2022). Design and voluntary control of variable stiffness exoskeleton based on sEMG driven model. IEEE Robotics and Automation Letters, 7(2), 5787–5794.

    Article  Google Scholar 

  5. Li, W. T., Liu, K. P., Li, C. X., Sun, Z. B., Liu, S., & Gu, J. (2022). Development and evaluation of a wearable lower limb rehabilitation robot. Journal of Bionic Engineering, 19(3), 688–699.

    Article  Google Scholar 

  6. He, C., Xiong, C. H., Chen, Z. J., Fan, W., Huang, X. L., & Fu, C. (2021). Preliminary assessment of a postural synergy-based exoskeleton for post-stroke upper limb rehabilitation. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 29, 1795–1805.

    Article  Google Scholar 

  7. Alberto, E. (2017). Powered exoskeletons for walking assistance in persons with central nervous system injuries: A narrative review. PM & R: The Journal of Injury, Function, and Rehabilitation, 9(1), 46–62.

    Article  Google Scholar 

  8. Hartigan, C., Kandilakis, C., Dalley, S., Clausen, M., Wilson, E., Morrison, S., Etheridge, S., & Farris, R. (2015). Mobility outcomes following five training sessions with a powered exoskeleton. Topics in Spinal Cord Injury Rehabilitation., 21(2), 93–99.

    Article  Google Scholar 

  9. Esquenazi, A., Talaty, M., Packel, A., & Saulino, M. (2012). The ReWalk powered exoskeleton to restore ambulatory function to individuals with thoracic-level motor-complete spinal cord injury. American Journal of Physical Medicine & Rehabilitation., 91(11), 911–921.

    Article  Google Scholar 

  10. Meng, Q., Xu, R., Xie, Q., Mahmutjan, B., Li, S., & Yu, H. (2023). Driving power for a portable elbow exoskeleton based on gravity-balancing coupled model. Journal of Bionic Engineering, 20(1), 146–157.

    Article  Google Scholar 

  11. Buesing, C., Fisch, G., O’Donnell, M., Shahidi, I., Thomas, L., Mummidisetty, C. K., Williams, K. J., Takahashi, H., Rymer, W. Z., & Jayaraman, A. (2015). Effects of a wearable exoskeleton stride management assist system (sma®) on spatiotemporal gait characteristics in individuals after stroke: A randomized controlled trial. Journal of Neuroengineering & Rehabilitation, 12, 69.

    Article  Google Scholar 

  12. Suzuki, K., Mito, G., Kawamoto, H., Hasegawa, Y., & Sankai, Y. (2007). Intention-based walking support for paraplegia patients with Robot Suit HAL. Advanced Robotics., 21(12), 1441–1469.

    Article  Google Scholar 

  13. McGibbon, C. A., Sexton, A., Jayaraman, A., Deems-Dluhy, S., Gryfe, P., Novak, A., Dutta, T., Fabara, E., Adans-Dester, C., & Bonato, P. (2018). Evaluation of the Keeogo exoskeleton for assisting ambulatory activities in people with multiple sclerosis: An open-label, randomized, cross-over trial. Journal of NeuroEngineering and Rehabilitation, 15, 117.

    Article  Google Scholar 

  14. Wu, X., Liu, D. X., Chen, C. J., & Guo, H. (2018). Individualized gait pattern generation for sharing lower limb exoskeleton robot. IEEE Transactions on Automation Science and Engineering, 15, 1459–1470.

    Article  Google Scholar 

  15. Hong, J., Chun, C., Kim, S. J., & Park, F. C. (2019). Gaussian process trajectory learning and synthesis of individualized gait motions. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 27(6), 1236–1245.

    Article  Google Scholar 

  16. Israel, J. F., Campbell, D. D., Kahn, J. H., & Hornby, T. G. (2006). Metabolic costs and muscle activity patterns during robotic- and therapist-assisted treadmill walking in individuals with incomplete spinal cord injury. Physical Therapy, 86(11), 1466–1478.

    Article  Google Scholar 

  17. Shushtari, M., Nasiri, R., & Arami, A. (2022). Online reference trajectory adaptation: A personalized control strategy for lower limb exoskeletons. IEEE Robotics and Automation Letters, 7(1), 128–134.

    Article  Google Scholar 

  18. Wang, L., Chen, C., Li, Z., Dong, W., Du, Z., Shen, Y., & Zhao, G. (2018). High precision data-driven force control of compact elastic module for a lower extremity augmentation device. Journal of Bionic Engineering, 15(5), 805–819.

    Article  Google Scholar 

  19. de Jesús, M., & F., Joan, L. P., Erik, P., Josep, M. F., Laura, M. C. (2023). Control strategies used in lower limb exoskeletons for gait rehabilitation after brain injury: A systematic review and analysis of clinical effectiveness. Journal of Neuroengineering and Rehabilitation, 20(1), 23.

    Article  Google Scholar 

  20. Sharifi, M., Mehr, J. K., Mushahwar, V. K., & Tavakoli, M. (2022). Autonomous locomotion trajectory shaping and nonlinear control for lower limb exoskeletons. IEEE/ASME Transactions on Mechatronics, 27(2), 645–655.

    Article  Google Scholar 

  21. Wang, J. Q., Wu, D. M., Gao, Y. Z., Wang, X. R., Li, X. Q., Xu, G. Q., & Dong, W. (2022). Integral real-time locomotion mode recognition based on GA-CNN for lower limb exoskeleton. Journal of Bionic Engineering, 19(5), 1359–1373.

    Article  Google Scholar 

  22. Zheng, T., Zhu, Y., Zhang, Z., Zhao, S., Chen, J., & Zhao, J. (2018). Parametric gait online generation of a lower-limb exoskeleton for individuals with paraplegia. Journal of Bionic Engineering, 15(6), 941–949.

    Article  Google Scholar 

  23. Park, K. W., Choi, J., & Kong, K. (2022). Hybrid filtered disturbance observer for precise motion generation of a powered exoskeleton. IEEE Transactions on Industrial Electronics, 70(1), 646–656.

    Article  Google Scholar 

  24. Kang, I., Molinaro, D. D., Choi, G., Camargo, J., & Young, A. J. (2022). Subject-independent continuous locomotion mode classification for robotic hip exoskeleton applications. IEEE Transactions on Biomedical Engineering, 69(10), 3234–3242.

    Article  Google Scholar 

  25. Liu, K., Li, L., Li, W., Gu, J., & Sun, Z. (2022). Compliant control of lower limb rehabilitation exoskeleton robot based on flexible transmission. Journal of Bionic Engineering, 20(3), 1021–1035.

    Article  Google Scholar 

  26. Zoss, A. B., Kazerooni, H., & Chu, A. (2006). Biomechanical design of the Berkeley lower extremity exoskeleton (BLEEX). IEEE/ASME Transactions on Mechatronics, 11(2), 128–138.

    Article  Google Scholar 

  27. Yun, Y., Kim, H. C., Shin, S. Y., Lee, J., Deshpande, A. D., & Kim, C. (2014). Statistical method for prediction of gait kinematics with gaussian process regression. Journal of Biomechanics, 47(1), 186–192.

    Article  Google Scholar 

  28. Kang, I., Molinaro, D. D., Duggal, S., Chen, Y., Kunapuli, P., & Young, A. J. (2021). Real-time gait phase estimation for robotic hip exoskeleton control during multimodal locomotion. IEEE Robotics and Automation Letters., 6(2), 3491–3497.

    Article  Google Scholar 

  29. Fineberg, D. B. (2013). Vertical ground reaction force-based analysis of powered exoskeleton-assisted walking in persons with motor-complete paraplegia. The Journal of Spinal Cord Medicine, 36(4), 313–321.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. College of Engineering, Beijing Forestry University, No. 35, East Qinghua Road, Beijing, 100083, China

    Tao Zhen & Lei Yan

Authors
  1. Tao Zhen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lei Yan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Lei Yan.

Ethics declarations

Conflict of Interest

The authors declare that there is no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhen, T., Yan, L. Real-Time Control Strategy of Exoskeleton Locomotion Trajectory Based on Multi-modal Fusion. J Bionic Eng 20, 2670–2682 (2023). https://doi.org/10.1007/s42235-023-00397-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s42235-023-00397-z

Keywords

Search

Navigation