Abstract
Reinforcement Learning (RL) is a branch of machine learning applied to many applications, such as mechatronics and robotics. RL allows more challenges to be resolved in robotics due to the high capacity for problem definition and active environmental interaction. Another notable property of RL is the capacity to include a variety of mathematical models, which the best-fitted model can be employed for solving any challenge. This characteristic of RL is highly beneficial for cable-driven parallel robots (CDPR) with applications in industry, construction and rehabilitation, in which the robot’s task space contains uncertainties. Recently many researchers have employed RL for various control tasks in CDPRs. Since RL has been applied to CDPRs’ different control challenges and satisfying results have been achieved, the future of RL in CDPR applications seems promising. In this paper, the applications of RL in CDPR control will be studied, and the most reported RL methods for these robots in the literature will be discussed. The promising future research subject will be described as well.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Qian, S., Zi, B., Shang, W.W., Xu, Q.S.: A review on cable-driven parallel robots. Chin. J. Mech. Eng. 31(4), 66 (2018)
Sancak, C., Yamac, F., Tik, M.: Position control of a planar cable-driven parallel robot using reinforcement learning. Robotica 40(10), 3378–3395 (2022)
Notash, L.: Artificial neural network prediction of deflection maps for cable-driven robots. In: Proceedings of the ASME Design Engineering Technical Conference and Computers and Information in Engineering Conference IDETC/CIE2020, 17–19 August 2020 (2020)
Sun, H., Tang, X., Hou, S., Wang, X.: Vibration suppression for large-scale flexible structures based on cable-driven parallel robots. JVC/J. Vib. Control 27(21–22), 2536–2547 (2021)
Sun, H., Tang, X., Wei, J.: Vibration suppression for large-scale flexible structures using deep reinforcement learning based on cable-driven parallel robots. In: ASME International Mechanical Engineering Congress and Exposition, Proceedings (IMECE), 7A-2020 (2021)
Grimshaw, A., Oyekan, J.: Applying deep reinforcement learning to cable driven parallel robots for balancing unstable loads: a ball case study. Front. Rob. AI 7, 212 (2021)
Xie, C., Zhou, J., Song, R., Xu, T.: Deep reinforcement learning based cable tension distribution optimization for cable-driven rehabilitation robot. In: 2021 6th IEEE International Conference on Advanced Robotics and Mechatronics (ICARM), Chongqing, China, pp. 318–322 (2021)
Lu, Y., Wu, C., Yao, W., Sun, G., Liu, J., Wu, L.: Deep reinforcement learning control of fully constrained cable-driven parallel robots. IEEE Trans. Ind. Electron. 70, 7194–7204 (2022)
Wang, W., Wang, X., Shen, C., Lin, Q.: Reinforcement learning-based composite controller for cable-driven parallel suspension system at high angles of attack. IEEE Access 10, 36373–36384 (2022)
Yang, R., Zheng, J., Song, R.: Continuous mode adaptation for cable-driven rehabilitation robot using reinforcement learning. Front. Neurorob. 16, 1068706 (2022)
Aref, M.M., Mattila, J.: Automated calibration of planar cable-driven parallel manipulators by reinforcement learning in joint-space. In: 6th RSI International Conference on Robotics and Mechatronics (ICROM), Tehran, Iran, pp. 172–177 (2018)
Zhang, T., Mo, H.: Reinforcement learning for robot research: a comprehensive review and open issues. Int. J. Adv. Rob. Syst. (2021)
Polydoros, A.S., Nalpantidis, L.: Survey of model-based reinforcement learning: applications on robotics. J. Intell. Rob. Syst. 86(2), 153–173 (2017). https://doi.org/10.1007/s10846-017-0468-y
Sutton, R.S., Barto, A.G.: Introduction to Reinforcement Learning, 2nd edn. MIT press, Cambridge (2018)
Pal, C.V., Leon, F.: Brief survey of model-based reinforcement learning techniques. In: 2020 24th International Conference on System Theory, Control and Computing (ICSTCC), Sinaia, Romania, pp. 92–97 (2020)
Tai, L., Zhang, J., Liu, M., Boedecker, J., Burgard, W.: A survey of deep network solutions for learning control in robotics: from reinforcement to imitation (2016)
Arulkumaran, K., Deisenroth, M.P., Brundage, M., Bharath, A.A.: Deep reinforcement learning: a brief survey. IEEE Signal Process. Mag. 34(6), 26–38 (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Nomanfar, P., Notash, L. (2023). Brief Review of Reinforcement Learning Control for Cable-Driven Parallel Robots. In: Caro, S., Pott, A., Bruckmann, T. (eds) Cable-Driven Parallel Robots. CableCon 2023. Mechanisms and Machine Science, vol 132. Springer, Cham. https://doi.org/10.1007/978-3-031-32322-5_13
Download citation
DOI: https://doi.org/10.1007/978-3-031-32322-5_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-32321-8
Online ISBN: 978-3-031-32322-5
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)