Skip to main content

Online Static Obstacle Avoidance and Offline Static Obstacle Avoidance Framework Based on Interaction Probabilistic Movement Primitives

  • Conference paper
  • First Online:
Cognitive Computation and Systems (ICCCS 2022)

Abstract

How to make robots self-adaptive to obstacle avoidance in the process of human-robot collaboration is one of the challenges in the community. In an actual environment, robots often encounter unanticipated obstacles that make it difficult to complete a task. So we in this paper proposed an obstacle avoidance framework based on Interaction Probabilistic Movement Primitives (iProMP), which combines online static obstacle avoidance with offline static obstacle avoidance. For unanticipated obstacles in human-robot collaboration, we find obstacle avoidance trajectories by solving the Lagrange equation, and then the product of Gaussian distribution is used to fuse the two iProMP trajectories to smoothly switch from the original trajectory to the obstacle avoidance trajectory to achieve fast online static obstacle avoidance. However, the obstacle avoidance trajectory is not optimal. When human-robot collaboration is over, the obstacle is usually not immediately cleared, and the unanticipated obstacles become the anticipated obstacles. In order to obtain a better obstacle avoidance trajectory, Path Integral Policy Improvement with Covariance Matrix Adaptation algorithm is used to train the demonstration trajectories to obtain new iProMP parameters, using the new parameters of human-robot cooperation to realize offline static obstacle avoidance. Experimental results based on two-dimensional trajectory obstacle avoidance and UR5 obstacle avoidance demonstrate the feasibility and effectiveness of the proposed framework.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Schaal, S.: Dynamic movement primitives -A framework for motor control in humans and humanoid robotics. https://doi.org/10.1007/4-431-31381-8_23

  2. Paraschos, A., Daniel, C., Peters, J., Neumann, G.: Probabilistic movement primitives. In: NIPS (2013)

    Google Scholar 

  3. Maeda, G., Ewerton, M., Lioutikov, R., Ben Amor, H., Peters, J., Neumann, G.: Learning interaction for collaborative tasks with probabilistic movement primitives. In: 2014 IEEE-RAS International Conference on Humanoid Robots, pp. 527–534 (2014). https://doi.org/10.1109/HUMANOIDS.2014.7041413

  4. Fu, J., Du, J., Teng, X., Fu, Y., Wu, L.: Adaptive multi-task human-robot interaction based on human behavioral intention. IEEE Access 9, 133762–133773 (2021). https://doi.org/10.1109/ACCESS.2021.3115756

    Article  Google Scholar 

  5. Fu, J., Wang, C.Q., Du, J.Y., Luo, F.: Concurrent probabilistic motion primitives for obstacle avoidance and human-robot collaboration. In: Yu, H., Liu, J., Liu, L., Ju, Z., Liu, Y., Zhou, D. (eds.) ICIRA 2019. LNCS (LNAI), vol. 11745, pp. 701–714. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-27529-7_59

    Chapter  Google Scholar 

  6. Koert, D., Maeda, G., Lioutikov, R., Neumann, G., Peters, J.: Demonstration based trajectory optimization for generalizable robot motions. In: 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids), pp. 515–522 (2016). https://doi.org/10.1109/HUMANOIDS.2016.7803324

  7. Colomé, A., Torras, C.: Demonstration-free contextualized probabilistic movement primitives, further enhanced with obstacle avoidance. In: 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 3190–3195 (2017). https://doi.org/10.1109/IROS.2017.8206151

  8. Qian, K., Xu, X., Liu, H., Bai, J., Luo, S.: Environment-adaptive learning from demonstration for proactive assistance in human-robot collaborative tasks. Robot. Auton. Syst. 151, 104046 (2022). https://doi.org/10.1016/j.robot.2022.104046.https://www.sciencedirect.com/science/article/pii/S0921889022000185

  9. Shyam, R.A., Lightbody, P., Das, G., Liu, P., Gomez-Gonzalez, S., Neumann, G.: Improving local trajectory optimisation using probabilistic movement primitives. In: 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 2666–2671 (2019). https://doi.org/10.1109/IROS40897.2019.8967980

  10. A. Theodorou, E., Buchli, J., Schaal, S.: A generalized path integral control approach to reinforcement learning. J. Mach. Learn. Res. 11(11), 3137–3181 (2010)

    Google Scholar 

  11. Stulp, F., Sigaud, O.: Path integral policy improvement with covariance matrix adaptation. ArXiv abs/1206.4621 (2012)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jian Fu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Fu, J., Yang, F., Zhong, Y., Yang, Z. (2023). Online Static Obstacle Avoidance and Offline Static Obstacle Avoidance Framework Based on Interaction Probabilistic Movement Primitives. In: Sun, F., Li, J., Liu, H., Chu, Z. (eds) Cognitive Computation and Systems. ICCCS 2022. Communications in Computer and Information Science, vol 1732. Springer, Singapore. https://doi.org/10.1007/978-981-99-2789-0_30

Download citation

  • DOI: https://doi.org/10.1007/978-981-99-2789-0_30

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-99-2788-3

  • Online ISBN: 978-981-99-2789-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics