Skip to main content

Brief Review of Reinforcement Learning Control for Cable-Driven Parallel Robots

  • Conference paper
  • First Online:
Cable-Driven Parallel Robots (CableCon 2023)

Part of the book series: Mechanisms and Machine Science ((Mechan. Machine Science,volume 132))

Included in the following conference series:

  • 482 Accesses

Abstract

Reinforcement Learning (RL) is a branch of machine learning applied to many applications, such as mechatronics and robotics. RL allows more challenges to be resolved in robotics due to the high capacity for problem definition and active environmental interaction. Another notable property of RL is the capacity to include a variety of mathematical models, which the best-fitted model can be employed for solving any challenge. This characteristic of RL is highly beneficial for cable-driven parallel robots (CDPR) with applications in industry, construction and rehabilitation, in which the robot’s task space contains uncertainties. Recently many researchers have employed RL for various control tasks in CDPRs. Since RL has been applied to CDPRs’ different control challenges and satisfying results have been achieved, the future of RL in CDPR applications seems promising. In this paper, the applications of RL in CDPR control will be studied, and the most reported RL methods for these robots in the literature will be discussed. The promising future research subject will be described as well.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 189.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 249.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Qian, S., Zi, B., Shang, W.W., Xu, Q.S.: A review on cable-driven parallel robots. Chin. J. Mech. Eng. 31(4), 66 (2018)

    Article  Google Scholar 

  2. Sancak, C., Yamac, F., Tik, M.: Position control of a planar cable-driven parallel robot using reinforcement learning. Robotica 40(10), 3378–3395 (2022)

    Article  Google Scholar 

  3. Notash, L.: Artificial neural network prediction of deflection maps for cable-driven robots. In: Proceedings of the ASME Design Engineering Technical Conference and Computers and Information in Engineering Conference IDETC/CIE2020, 17–19 August 2020 (2020)

    Google Scholar 

  4. Sun, H., Tang, X., Hou, S., Wang, X.: Vibration suppression for large-scale flexible structures based on cable-driven parallel robots. JVC/J. Vib. Control 27(21–22), 2536–2547 (2021)

    Article  MathSciNet  Google Scholar 

  5. Sun, H., Tang, X., Wei, J.: Vibration suppression for large-scale flexible structures using deep reinforcement learning based on cable-driven parallel robots. In: ASME International Mechanical Engineering Congress and Exposition, Proceedings (IMECE), 7A-2020 (2021)

    Google Scholar 

  6. Grimshaw, A., Oyekan, J.: Applying deep reinforcement learning to cable driven parallel robots for balancing unstable loads: a ball case study. Front. Rob. AI 7, 212 (2021)

    Google Scholar 

  7. Xie, C., Zhou, J., Song, R., Xu, T.: Deep reinforcement learning based cable tension distribution optimization for cable-driven rehabilitation robot. In: 2021 6th IEEE International Conference on Advanced Robotics and Mechatronics (ICARM), Chongqing, China, pp. 318–322 (2021)

    Google Scholar 

  8. Lu, Y., Wu, C., Yao, W., Sun, G., Liu, J., Wu, L.: Deep reinforcement learning control of fully constrained cable-driven parallel robots. IEEE Trans. Ind. Electron. 70, 7194–7204 (2022)

    Article  Google Scholar 

  9. Wang, W., Wang, X., Shen, C., Lin, Q.: Reinforcement learning-based composite controller for cable-driven parallel suspension system at high angles of attack. IEEE Access 10, 36373–36384 (2022)

    Article  Google Scholar 

  10. Yang, R., Zheng, J., Song, R.: Continuous mode adaptation for cable-driven rehabilitation robot using reinforcement learning. Front. Neurorob. 16, 1068706 (2022)

    Article  Google Scholar 

  11. Aref, M.M., Mattila, J.: Automated calibration of planar cable-driven parallel manipulators by reinforcement learning in joint-space. In: 6th RSI International Conference on Robotics and Mechatronics (ICROM), Tehran, Iran, pp. 172–177 (2018)

    Google Scholar 

  12. Zhang, T., Mo, H.: Reinforcement learning for robot research: a comprehensive review and open issues. Int. J. Adv. Rob. Syst. (2021)

    Google Scholar 

  13. Polydoros, A.S., Nalpantidis, L.: Survey of model-based reinforcement learning: applications on robotics. J. Intell. Rob. Syst. 86(2), 153–173 (2017). https://doi.org/10.1007/s10846-017-0468-y

    Article  Google Scholar 

  14. Sutton, R.S., Barto, A.G.: Introduction to Reinforcement Learning, 2nd edn. MIT press, Cambridge (2018)

    MATH  Google Scholar 

  15. Pal, C.V., Leon, F.: Brief survey of model-based reinforcement learning techniques. In: 2020 24th International Conference on System Theory, Control and Computing (ICSTCC), Sinaia, Romania, pp. 92–97 (2020)

    Google Scholar 

  16. Tai, L., Zhang, J., Liu, M., Boedecker, J., Burgard, W.: A survey of deep network solutions for learning control in robotics: from reinforcement to imitation (2016)

    Google Scholar 

  17. Arulkumaran, K., Deisenroth, M.P., Brundage, M., Bharath, A.A.: Deep reinforcement learning: a brief survey. IEEE Signal Process. Mag. 34(6), 26–38 (2017)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Pegah Nomanfar .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Nomanfar, P., Notash, L. (2023). Brief Review of Reinforcement Learning Control for Cable-Driven Parallel Robots. In: Caro, S., Pott, A., Bruckmann, T. (eds) Cable-Driven Parallel Robots. CableCon 2023. Mechanisms and Machine Science, vol 132. Springer, Cham. https://doi.org/10.1007/978-3-031-32322-5_13

Download citation

Publish with us

Policies and ethics