Skip to main content
SpringerLink
Log in

A teaching-free welding method based on laser visual sensing system in robotic GMAW

  • ORIGINAL ARTICLE
  • Published:
The International Journal of Advanced Manufacturing Technology Aims and scope Submit manuscript

Abstract

At present, the majority of welding robots belong to the teach-and-playback category in welding manufacturing engineering applications; trajectory teaching in advance of welding is time-consuming and lack of efficiency. The currently published welding seam tracking methods are also based on existing trajectories. Intelligent Welding Manufacturing (IWM) is the current research focus in welding manufacturing. The core technology of IWM is Intelligent Robot Welding Technology (IRWT). A sensing-technology-based system was the key to realize IRWT. In this paper, a teaching-free welding method based on laser visual sensing system (LVSS) for robotic gas metal arc welding (GMAW) is studied. First, a LVSS was established. A fast-unified calibration method for LVSS is proposed to improve the calibration efficiency. Then, using an image processing method based on prior knowledge, feature point with sub-pixel accuracy can be obtained in real-time. Finally, an online welding trajectory planning method is proposed to implement teaching-free welding. In order to verify the accuracy and robustness of the proposed method, experiments on V-grooves and fillet welds were performed. The results showed that the control accuracy on the V-groove and the fillet welds is suitable for most robot welding applications.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24
Fig. 25
Fig. 26
Fig. 27
Fig. 28
Fig. 29
Fig. 30
Fig. 31
Fig. 32
Fig. 33

Similar content being viewed by others

References

  1. Chen S (2015) On Intelligentized welding manufacturing, the advances in intelligent systems and computing, vol 363. Springer Verlag, pp 3–34

  2. Chen S, Wu J (2009) Intelligentized methodology for arc welding dynamical processes[M] Springer-Verlag Berlin Heidelberg, Germany, Lecture Notes in Electrical and Engineering, LNEE 29

  3. Chen S, Lv N (2014) Research evolution on intelligentized technologies for arc welding process. J Manuf Process 16:109–122

    Article  Google Scholar 

  4. Chen S (2011) Research evolution on intelligentized technologies for robotic welding at SJTU. Lecture Notes in Electrical Engineering, Robotic Welding, Intelligence and Automation, LNEE v 88:3–14

    Article  Google Scholar 

  5. Shen H, Wu J, Lin T, Chen S (2008) Arc welding robot system with seam tracking and weld pool control based on passive vision. Int J Adv Manuf Technol 39(7–8):669–678

    Article  Google Scholar 

  6. Chen S (2007) On the key intelligentized technologies of welding robot, Lecture Notes in Control and Information Sciences, LNCIS 362, pp.105–116

  7. Larkin N, Short A, Pan Z, van Duin S (2018) Automated programming for robotic welding. Trans Intell Welding Manuf:48–59

  8. Erdős G, Kardos C, Kemény Z, Kovács A, Váncza J (2016) Process planning and offline programming for robotic remote laser welding systems. Int J Comput Integr Manuf 29(12):1287–1306

    Article  Google Scholar 

  9. Zhang T, Ouyang F (2012) Offline motion planning and simulation of two-robot welding coordination. Front Mech Eng 7(1):81–92

    Article  Google Scholar 

  10. Liu Y, Shi L, Tian X (2018) Weld seam fitting and welding torch trajectory planning based on NURBS in intersecting curve welding. Int J Adv Manuf Technol 95(5–8):2457–2471

    Article  Google Scholar 

  11. Jeong SK, Lee GY, Lee WK, Kim SB (2001) Development of high speed rotating arc sensor and seam tracking controller for welding robots. IEEE ISIE 2001 2:845–850

    Google Scholar 

  12. Shi YH, Yoo WS, Na SJ (2006) Mathematical modelling of rotational arc sensor in GMAW and its applications to seam tracking and endpoint detection. Sci Technol Weld Join 11(6):723–730

    Article  Google Scholar 

  13. Wang J, Chen B, Chen H, Chen S (2009) Analysis of arc sound characteristics for gas tungsten argon welding. Sens Rev 29(3):240–249

    Article  Google Scholar 

  14. Song S, Chen H, Lin T, Wu D, Chen S (2016) Penetration state recognition based on the double-sound-sources characteristic of VPPAW and hidden Markov model. J Mater Process Technol 234:33–44

    Article  Google Scholar 

  15. Huang Y, Wu D, Zhang Z, Chen H, Chen S (2017) EMD-based pulsed TIG welding process porosity defect detection and defect diagnosis using GA-SVM. J Mater Process Technol 239:92–102

    Article  Google Scholar 

  16. Huang Y, Wu D, Lv N, Chen H, Chen S (2017) Investigation of porosity in pulsed GTAW of aluminum alloys based on spectral and X-ray image analyses. J Mater Process Technol 243:365–373

    Article  Google Scholar 

  17. Shao W, Liu X, Wu Z (2019) A robust weld seam detection method based on particle filter for laser welding by using a passive vision sensor. Int J Adv Manuf Technol 104(5–8):2971–2980

    Article  Google Scholar 

  18. Nilsen M, Sikström F, Christiansson AK, Ancona A (2019) Robust vision-based joint tracking for laser welding of curved closed-square-butt joints. Int J Adv Manuf Technol 101(5–8):1967–1978

    Article  Google Scholar 

  19. Xu Y, Yu H, Zhong J, Lin T, Chen S (2012) Real-time image capturing and processing of seam and pool during robotic welding process. Ind Rob Int J 39.5(2012):513–523

    Article  Google Scholar 

  20. Xu Y, Yu H, Zhong J, Lin T, Chen S (2012) Real-time seam tracking control technology during welding robot GTAW process based on passive vision sensor. J Mater Process Technol 212(8):1654–1662

    Article  Google Scholar 

  21. Shen H, Ma H, Lin T, Chen S (2007) Research on weld pool control of welding robot with computer vision. Ind Rob Int J 34(6):467–475

    Article  Google Scholar 

  22. He Y, Yu Z, Li J, Ma G (2019) Weld seam profile extraction using top-down visual attention and fault detection and diagnosis via EWMA for the stable robotic welding process. Int J Adv Manuf Technol 104(9–12):3883–3897

    Article  Google Scholar 

  23. Du R, Xu Y, Hou Z, Shu J, Chen S (2019) Strong noise image processing for vision-based seam tracking in robotic gas metal arc welding. Int J Adv Manuf Technol 101(5–8):2135–2149

    Article  Google Scholar 

  24. Xu P, Xu G, Tang X, Yao S (2008) A visual seam tracking system for robotic arc welding. Int J Adv Manuf Technol 37(1–2):70–75

    Article  Google Scholar 

  25. Luo H, Chen X (2005) Laser visual sensing for seam tracking in robotic arc welding of titanium alloys. Int J Adv Manuf Technol 26(9–10):1012–1017

    Article  Google Scholar 

  26. Fang Z, Xu D, Tan M (2011) A vision-based self-tuning fuzzy controller for fillet weld seam tracking. IEEE/ASME Trans mechatron 16(3):540–550

    Article  Google Scholar 

  27. Zou Y, Chen X, Gong G, Li J (2018) A seam tracking system based on a laser vision sensor. Measurement 127:489–500

    Article  Google Scholar 

  28. Zou Y, Chen T (2018) Laser vision seam tracking system based on image processing and continuous convolution operator tracker. Opt Laser Eng 105:141–149

    Article  Google Scholar 

  29. Xu Y, Fang G, Chen S, Zou J, Ye Z (2014) Real-time image processing for vision-based weld seam tracking in robotic GMAW. Int J Adv Manuf Technol 73(9–12):1413–1425

    Article  Google Scholar 

  30. Zhang Z (2000) A flexible new technique for camera calibration. IEEE Trans Pattern Anal Machine Intell 22

  31. Huang S (2017) Research on typical weld seam feature extraction and real-time seam tracking based on active vision M.S. thesis, Department of material science and engineering, Shanghai Jiao Tong University

  32. Wu Q, Lee J, Park M, Jin B, Kim D, Park C, Kim I (2015) A study on the modified Hough algorithm for image processing in weld seam tracking. J Mech Sci Technol 29(11):4859–4865

    Article  Google Scholar 

  33. Steger C (1998) An unbiased detector of curvilinear structures. IEEE Trans Pattern Anal Machine Intell 20(2):113–125

    Article  Google Scholar 

  34. Zwiggelaar R, Astley S, Boggis C, Taylor C (2004) Linear structures in mammographic images: detection and classification. IEEE Trans Med Imag 23(9):1077–1086

    Article  Google Scholar 

  35. Matsopoulos G, Asvestas P, Mouravliansky N, Delibasis K (2004) Multimodal registration of retinal images using self organizing maps. IEEE Trans Med Imag 23(12):1557–1563

    Article  Google Scholar 

  36. Navab N, Genc Y, Appel M (2000) Lines in one orthographic and two perspective views. IEEE Conf CVPR 2000 (Cat. No. PR00662) 2. IEEE

  37. Sun X, Gao G, Tian B et al (2019) Intelligent recognition of production date based on machine vision. Journal of Physics: Conference Series. IOP Publishing 1267(1):012041

    Google Scholar 

Download references

Funding

This work is partly supported by the National Natural Science Foundation of China under the grant no. 61873164 and 61973213, and the Shanghai Natural Science Foundation (18ZR1421500).

Author information

Authors and Affiliations

  1. Shanghai Key Laboratory of Materials Laser Processing and Modification, School of Materials Science and Engineering, Shanghai Jiao Tong University, Shanghai, 200240, People’s Republic of China

    Zhen Hou, Yanling Xu, Runquan Xiao & Shanben Chen

Authors
  1. Zhen Hou
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yanling Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Runquan Xiao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Shanben Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yanling Xu.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hou, Z., Xu, Y., Xiao, R. et al. A teaching-free welding method based on laser visual sensing system in robotic GMAW. Int J Adv Manuf Technol 109, 1755–1774 (2020). https://doi.org/10.1007/s00170-020-05774-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00170-020-05774-0

Keywords

Search

Navigation