Skip to main content

Advertisement

SpringerLink
Log in

An intelligent manufacturing cell based on human–robot collaboration of frequent task learning for flexible manufacturing

  • ORIGINAL ARTICLE
  • Published:
The International Journal of Advanced Manufacturing Technology Aims and scope Submit manuscript

Abstract

The trend of short-run production and personalized customization is more and more popular in the manufacturing industry. And the robots in these production lines must conduct task adjustment efficiently when learning new tasks. Thus, this paper developed the intelligent manufacturing cell based on the human–robot collaboration (HRC-IMC) which can enhance the learning ability of cobots by introducing the intelligence of human. The HRC-IMC was composed with four modules: the imitating learning module, the human–robot safety planning module, the task planning module and the visual inferring module. All of the four modules were designed to provide a set of systematic and effective methods. That was conductive to the efficiency improvement of the task adjustment for cobots’ new task learning. The experimental results indicated that the efficiency of task adjustment can be increased by 42.8 % when the HRC-IMC was employed than that of Moveit. All in all, this study is of great significance for improving the efficiency of new task adjustment of cobots by imitating the manipulation experience of human via combining four algorithm modules.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

Availability of data and material

All data generated or analysed during this study are included in this published article.

References

  1. Zhong R, Xun X, Klotz E, Newman S (2017) Intelligent manufacturing in the context of industry 4.0: a review. Engineering 3(5):616–630

  2. Zhou J, Li P, Zhou Y, Wang B, Meng L (2018) Toward new-generation intelligent manufacturing. Engineering 4(4):11–20

    Article  Google Scholar 

  3. Zhu H, Gupta A, Rajeswaran A, Levine S, Kumar V (2019) Dexterous manipulation with deep reinforcement learning: Efficient, general, and low-cost. In: 2019 International Conference on Robotics and Automation (ICRA), IEEE, p 3651–3657

  4. Karami A, Sadeghian H, Keshmiri M, Oriolo G (2018) Hierarchical tracking task control in redundant manipulators with compliance control in the null-space. Mechatronics 55:171–179

    Article  Google Scholar 

  5. Sheng L, Bao L, Wu P (2018) Application of heuristic approaches in the robot path planning and optimization: a review. Electron Opt Control

  6. Raessa M, Chen J, Wan W, Harada K (2020) Human-in-the-loop robotic manipulation planning for collaborative assembly. arXiv 17(4):1800–1814

  7. Wang X, Kemny Z, Vncza J, Wang L (2017) Human robot collaborative assembly in cyber-physical production: Classification framework and implementation. Cirp Ann Manuf Technol 66(1):5–8

    Article  Google Scholar 

  8. Weitschat R, Aschemann H (2018) Safe and efficient human crobot collaboration part ii: Optimal generalized human-in-the-loop real-time motion generation. IEEE Robot Automation Lett 3(4):3781–3789

    Article  Google Scholar 

  9. Music S, Salvietti G, Dohmann P, Chinello F, Hirche S (2019) Human–robot team interaction through wearable haptics for cooperative manipulation. IEEE Trans Haptics 12(3):350–362

    Article  Google Scholar 

  10. Rahman S (2019) Cognitive cyber-physical system (c-cps) for human–robot collaborative manufacturing. In: 2019 14th Annual Conference System of Systems Engineering (SoSE)

  11. Nunes D, Silva J, Boavida F (2018) A practical introduction to human-in-the-loop cyber-physical systems. John Wiley & Sons, Hoboken

    Google Scholar 

  12. Schirner G, Erdogmus D, Chowdhury K, Padir T (2013) The future of human-in-the-loop cyber-physical systems. Computer 46(1):36–45

    Article  Google Scholar 

  13. Sowe S, Simmon E, Zettsu K, Vaulx F, Bojanova I (2016) Cyber-physical-human systems: Putting people in the loop. IT Professional 18(1):10–13

    Article  Google Scholar 

  14. Krugh M, Mears L (2018) A complementary cyber-human systems framework for industry 4.0 cyber-physical systems. Manuf Lett 15:89–92

    Article  Google Scholar 

  15. Zhou J, Zhou Y, Wang B, Zang J (2019) Human cyber physical systems (hcpss) in the context of new-generation intelligent manufacturing. Engineering

  16. Wang L, Gao R, Vncza J, Krger J, Chryssolouris G (2019) Symbiotic human–robot collaborative assembly. CIRP Ann - Manuf Technol 68(2):701–726

    Article  Google Scholar 

  17. Anupma Y, Jayswal S (2018) Modelling of flexible manufacturing system: a review. Int J Prod Res 56(7–8):2464–2487

    Google Scholar 

  18. Ajoudani A, Zanchettin AM, Ivaldi S, Albu-Schffer A, Kosuge K, Khatib O (2017) Progress and prospects of the human–robot collaboration. Auton Robots 42(5):957–975

    Article  Google Scholar 

  19. Maurtua I, Ibarguren A, Kildal J, Susperregi L, Sierra B (2017) Human–robot collaboration in industrial applications: Safety, interaction and trust. Int J Adv Robot Syst 14(4):1–10

    Google Scholar 

  20. Ioannis K, Andreas K, Dimitrios G, Dimitrios T (2017) Robot’s workspace enhancement with dynamic human presence for socially-aware navigation. In: International Conference on Computer Vision Systems, p 279–288

  21. Christoph S, Boris L, Patrick P, Wolfram B (2017) An accurate and efficient navigation system for omnidirectional robots in industrial environments. Auton Robots 41(2):473–493

    Article  Google Scholar 

  22. Lotsaris K, Fousekis N, Koukas S, Aivaliotis S, Makris S (2021) Augmented reality (ar) based framework for supporting human workers in flexible manufacturing. Proc CIRP 96:301–306

    Article  Google Scholar 

  23. Fabrizio F, Torsten K, Alessandro D, Oussama K (2015) A depth space approach for evaluating distance to objects. J Intell Robot Syst 80(1):7–22

    Google Scholar 

  24. Emanuele M, Federica F, Jacopo R, Fabio P, Alessandro D, Francesco L (2020) Human–robot coexistence and interaction in open industrial cells. Robot Comput-Integr Manuf 61:1–19

    Google Scholar 

  25. Nikolaos N, Vasilis M, Sotiris M (2019) A cyber physical system (cps) approach for safe human–robot collaboration in a shared workplace. Robot Comput-Integr Manuf 56:233–243

    Article  Google Scholar 

  26. Azfar K, Kirisci P, Khan Z, Zied G, Klausdieter T, Jurgen P (2018) Security framework for industrial collaborative robotic cyber-physical systems. Comput Ind 97:132–145

    Article  Google Scholar 

  27. Michalos G, Kousi N, Karagiannis P, Gkournelos C, Dimoulas K, Koukas S, Mparis K, Papavasileiou A, Makris S (2018) Seamless human robot collaborative assembly an automotive case study. Mechatronics 55

  28. Aivaliotis P, Aivaliotis S, Gkournelos C, Kokkalis K, Michalos G, Makris S (2019) Power and force limiting on industrial robots for human–robot collaboration. Robot Comput-Integr Manuf 59:346–360

    Article  Google Scholar 

  29. Zhou Y, Dong H, Saddik A (2020) Learning to estimate 3d human pose from point cloud. IEEE Sens J 99:1–1

    Google Scholar 

  30. Shi H, Chen J, Pan W, Hwang K, Cho Y (2019) Collision avoidance for redundant robots in position-based visual servoing. IEEE Syst J 13(3):3479–3489

    Article  Google Scholar 

  31. Zhu L, Chi Z, Zhou F, Zhuang C (2019) Dynamic motion planning algorithm in human–robot collision avoidance. In: International Conference on Intelligent Robotics and Applications, p 655–666

  32. Edmonds M, Gao F, Xie X, Liu H, Qi S, Zhu Y, Rothrock B, Zhu S (2017) Feeling the force: Integrating force and pose for fluent discovery through imitation learning to open medicine bottles. In: 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, pp 3530–3537

  33. Pham T, Nikolaos K, Argyros A, Abderrahmane K (2017) Hand-object contact force estimation from markerless visual tracking. IEEE Trans Patt Analysis Mach Intell 40(12):2883–2896

    Article  Google Scholar 

  34. Pham T, Abderrahmane K, Ammar Q, Argyros A (2015) Towards force sensing from vision: Observing hand-object interactions to infer manipulation forces. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, p 2810–2819

  35. Omid T, Nima G, Black M, Dimitrios T (2020) GRAB: a dataset of whole-body human grasping of objects. In: European Conference on Computer Vision (ECCV)

  36. Brahmbhatt S, Tang C, Twigg C, Kemp C, James H (2020) Contactpose: a dataset of grasps with object contact and hand pose. arXiv preprint: 2007.09545v1

  37. Chang G, Kulic D (2013) Robot task learning from demonstration using petri nets. In: RO-MAN, 2013 IEEE, p 31–36

  38. Casalino A, Cividini F, Zanchettin A, Piroddi L, Rocco P (2018) Human–robot collaborative assembly: a use-case application - sciencedirect. IFAC-PapersOnLine 51(11):194–199

    Article  Google Scholar 

  39. Dantam N, Kingston Z, Chaudhuri S, Kavraki L (2016) Incremental task and motion planning: a constraint-based approach. Robot: Sci Syst 12:1–6

    Google Scholar 

  40. Dantam N, Kingston Z, Chaudhuri S (2018) An incremental constraint-based framework for task and motion planning. Int J Robot Res 37(10):1134–1151

    Article  Google Scholar 

  41. Evangelou G, Dimitropoulos N, Michalos G, Makris S (2021) An approach for task and action planning in human collaborative cells using AI. Proc CIRP

  42. Tsarouchi P, Matthaiakis A, Makris S, George C (2017) On a human–robot collaboration in an assembly cell. Int J Comput Integr Manuf 30(6):580–589

    Article  Google Scholar 

  43. Li S, Zhang S, Fu Y, Wang H, Han K (2020) Task-based obstacle avoidance for uncertain targets based on semantic object matrix. Control Eng Pract 105:104649

    Article  Google Scholar 

  44. Li S, Zhang S, Fu Y, Xiong Y, Xie Z (2021) Grasp2hardness: Fuzzy hardness inference of cylindrical objects for grasp force adjustment of force sensor-less robots. Intell Serv Robot 14(2):129–141

    Article  Google Scholar 

  45. Pan J, Sachin C, Dinesh M (2012) Fcl: a general purpose library for collision and proximity queries. In: 2012 IEEE International Conference on Robotics and Automation, p 3859–3866

  46. Morgan Q, Ken C, Brian G, Josh F, Tully F, Jeremy L, Rob W, Andrew N (2009) Ros: an open-source robot operating system. In: ICRA Workshop on Open Source Software (vol. 3), Kobe, Japan, p 5

  47. Gary B (2000) The opencv library. Dr. Dobb’s J: Softw Tools Professional Programmer 25(11):120–123

  48. Bogdan R, Cousins S (2011) 3D is here: Point cloud library (PCL). In: 2011 IEEE International Conference on Robotics and Automation, IEEE, p 1–4

  49. Martín A, Paul B, Chen J, Chen Z, Davis A, Jeffrey D, Matthieu D, Sanjay G, Geoffrey I, Michael I (2016) Tensorflow: a system for large-scale machine learning. In: 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16), p 265–283

Download references

Acknowledgements

We acknowledge the support received from the HUST & UBTECH Intelligent Service Robots Joint Lab.

Author information

Authors and Affiliations

  1. Center for Psychological Sciences, Zhejiang University, Hangzhou, 310058, China

    Shuai Zhang

  2. School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan, 430074, China

    Shiqi Li, Haipeng Wang & Xiao Li

  3. HUST & UBTECH Intelligent Service Robots Joint Lab, Huazhong University of Science and Technology, Wuhan, 430074, China

    Xiao Li

Authors
  1. Shuai Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shiqi Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Haipeng Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Xiao Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Shuai Zhang and Shiqi Li conceived and designed the study. Shuai Zhang and Xiao Li performed the experiments. Shuai Zhang wrote the paper. Shuai Zhang, Shiqi Li and Haipeng Wang reviewed and edited the manuscript. All authors read and approved the manuscript.

Corresponding author

Correspondence to Shiqi Li.

Ethics declarations

Ethics approval

Not applicable.

Consent to participate

Informed consent was taken from the family to participate in the study.

Consent for publication

Informed consent was taken from family to publish the data in an anonymized manner.

Conflict of interest

We declare that we have no financial and personal relationships with other people or organizations that can inappropriately influence our work. There is no professional or other personal interest of any nature or kind in any product, service and/or company that could be construed as influencing the position presented in, or the review of, the manuscript entitled.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, S., Li, S., Wang, H. et al. An intelligent manufacturing cell based on human–robot collaboration of frequent task learning for flexible manufacturing. Int J Adv Manuf Technol 120, 5725–5740 (2022). https://doi.org/10.1007/s00170-022-09005-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00170-022-09005-6

Keywords

Search

Navigation