Skip to main content
SpringerLink
Log in

Precise seam tracking in robotic welding by an improved image processing approach

  • ORIGINAL ARTICLE
  • Published:
The International Journal of Advanced Manufacturing Technology Aims and scope Submit manuscript

Abstract

The intelligent welding robots have been widely developed and applied into the industrial production lines to improve the manufacturing efficiency. The main and important factor to improve the robotic welding performance, quality, and intelligence is the seam recognition accuracy. Higher industrial production and demands of higher precision in gas metal arc welding (GMAW) process have increased robot use. Vision feedback in robotic welding provides flexibility, productivity, and precision and promotes vaster range of applicability. In this case, machine vision techniques that are widely used to identify and locate the welding seam allow planning an industrial robot path. Previous investigations have proposed various approaches to address the precise tracking of welding seam curve. In majority of cases, the simultaneous uses of laser-based and optical lighting approaches to determine the location of the seam were suggested. However, complex seams remain a big challenge in robotic welding, and no definite way has been proposed to produce a precise robot path. This paper aims to develop a comprehensive robot trajectory extraction method for complex welding seam through processing of noisy images and laser data. Since the structured light on laser basis and stereo vision propose more possibility in specifying the place of the seam, this study considers a two-source processing for GMAW. A new improved edge detection algorithm is also proposed to enclose the weld zone and determine the seam and the pool parameters. To evaluate the performance of this method, experimenting different types of work pieces under random welding conditions are carried out, and the results are verified. A considerable improvement in speed and detection of error between the measured and real seam coordinates is reported.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24
Fig. 25
Fig. 26
Fig. 27
Fig. 28
Fig. 29
Fig. 30
Fig. 31
Fig. 32
Fig. 33
Fig. 34
Fig. 35
Fig. 36
Fig. 37

Similar content being viewed by others

References

  1. Chen B, Feng J (2014) Modeling of underwater wet welding process based on visual and arc sensor. Ind Robot 41(3):311–317

    Article  Google Scholar 

  2. Chen, S.B., Zhang, Y., Qiu, T. et al. (2003) " Robotic welding systems with vision-sensing and self-learning neuron control of arc welding dynamic process": Journal of Intelligent and Robotic Systems 36, 191–208.

  3. Shao WJ, Liu XF, ZiJun W (2019) A robust weld seam detection method based on particle filter for laser welding by using a passive vision sensor. Int J Adv Manuf Technol 104(5-8):2971–2980

    Article  Google Scholar 

  4. Wei S, Kong M, Lin T, Chen S (2011) Three-dimensional weld seam tracking for robotic welding by composite sensing technology. Ind Robot 38(5):500–508

    Article  Google Scholar 

  5. Rout A, Deepak BBVL, Biswal BB (2019) Advances in weld seam tracking techniques for robotic welding: a review. Robot Comput Integr Manuf 56:12–37

    Article  Google Scholar 

  6. Ye Z, Fang G, Chen S, Zou JJ (2013) Passive vision based seam tracking system for pulse-MAG welding. Int J Adv Manuf Technol 67:1987–1996

    Article  Google Scholar 

  7. Zhang Z, Yu H, Lv N, Chen S (2013) Real-time defect detection in pulsed GTAW of Al alloys through on-line spectroscopy. J Mater Process Technol 213(7):1146–1156

    Article  Google Scholar 

  8. Lv N, Xu Y, Zhang Z, Wang J, Chen B, Chen S (2013) Audio sensing and modeling of arc dynamic characteristic during pulsed Al alloy GTAW process. Sens Rev 33(2):141–156

    Article  Google Scholar 

  9. Zhang Y, Gao X (2014) Analysis of characteristics of molten pool using cast shadow during high-power disk laser welding. Int J Adv Manuf Technol 70:1979–1988

    Article  Google Scholar 

  10. Chen Z, Gao X (2014) Detection of weld pool width using infrared imaging during high-power fiber laser welding of type 304 austenitic stainless steel. Int J Adv Manuf Technol 74:1247–1254

    Article  Google Scholar 

  11. Gu WP, Xiong ZY, Wan W (2013) Autonomous seam acquisition and tracking system for multi-pass welding based on vision sensor. Int J Adv Manuf Technol 69:451–460

    Article  Google Scholar 

  12. Fang Z, Xu D, Tan M (2011) A vision-based self-tuning fuzzy controller for fillet weld seam tracking. IEEE/ASME Transactions on Mechatronics 16(3):540–550

    Article  Google Scholar 

  13. Tian Y-Z, Liu H-F, Li L, Wang W-B, Feng J-C, Xi F-F, Yuan G-J (2020) Robust identification of weld seam based on region of interest operation. Adv Manuf 8(4):473–485

    Article  Google Scholar 

  14. Zou Y, Wang Y, Zhou W, Chen X (2018) Real-time seam tracking control system based on line laser visions. Opt Laser Technol 103:182–192

    Article  Google Scholar 

  15. Wu K, Wang T, He J, Liu Y, Jia Z (2020) Autonomous seam recognition and feature extraction for multi-pass welding based on laser stripe edge guidance network. Int J Adv Manuf Technol 111(9):2719–2731

    Article  Google Scholar 

  16. Yang L, Liu Y, Peng J (2020) Advances techniques of the structured light sensing in intelligent welding robots: a review. Int J Adv Manuf Technol:1–20

  17. Huang Y et al (2017) A novel dual-channel weld seam tracking system for aircraft T-joint welds. Int J Adv Manuf Technol 91(1-4):751–761

    Article  Google Scholar 

  18. Zhang L, Ke W, Ye Q, Jiao J (2014) A novel laser vision sensor for weld line detection on wall-climbing robot. Opt Laser Technol 60:69–79

    Article  Google Scholar 

  19. Shao WJ, Yu H, Zhang Y (2018) A novel weld seam detection method for space weld seam of narrow butt joint in laser welding. Opt Laser Technol 99:39–51

    Article  Google Scholar 

  20. Xu Y, Fang G, Lv N, Chen S, Jia Zou J (2015) Computer vision technology for seam tracking in robotic GTAW and GMAW. Robot Comput Integr Manuf 32:25–36

    Article  Google Scholar 

  21. Xue B et al (2019) A vision based detection method for narrow butt joints and a robotic seam tracking system. Sensors 19.5:1144

    Article  Google Scholar 

  22. Fang Z, Xu D, Tan M (2010) A vision-based self-tuning fuzzy controller for fillet weld seam tracking. IEEE/ASME Transactions on mechatronics 16(3):540–550

    Article  Google Scholar 

  23. Xu Y, Yu H, Zhong J, Lin T, Chen S (2012) Real-time seam tracking control technology during welding robot GTAW process based on passive vision sensor. J Mater Process Technol 212(8):1654–1662

    Article  Google Scholar 

  24. Lee J-P et al (2014) A study on optimal algorithms to find joint tracking in GMA welding. Int J Eng Sci Innov Technol 3:370–380

    Google Scholar 

  25. Iakovou D, Aarts R, Meijer J (2005) Sensor integration for robotic laser welding processes. International Congress on Applications of Lasers & Electro-Optics. Vol. 2005. No. 1. Laser Institute of America

  26. Bandari YK, Williams SW, Ding J, Martina F (2015) Additive manufacture of large structures: Robotic or CNC systems. Proceedings of the 26th International Solid Freeform Fabrication Symposium, pp.12-14

  27. Dennis JH et al (1997) The effects of welding parameters on ultraviolet light emissions, ozone and CrVI formation in MIG welding. The Annals of occupational hygiene 41(1):95–104

    Google Scholar 

  28. Agapiou G, Kasiouras C, Serafetinides AA (1999) A detailed analysis of the MIG spectrum for the development of laser-based seam tracking sensors. Opt Laser Technol 31(2):157–161

    Article  Google Scholar 

  29. Zou Y, Chen T (2018) Laser vision seam tracking system based on image processing and continuous convolution operator tracker. Opt Lasers Eng 105:141–149

    Article  Google Scholar 

  30. Xiao R et al (2019) An adaptive feature extraction algorithm for multiple typical seam tracking based on vision sensor in robotic arc welding. Sensors Actuators A Phys 297:111533

    Article  Google Scholar 

  31. Wang, Nianfeng et al (2020) A robust weld seam recognition method under heavy noise based on structured-light vision. Robot Comput Integr Manuf 61:101821

    Article  Google Scholar 

  32. He Y, Xu Y, Chen Y, Chen H, Chen S (2016) Weld seam profile detection and feature point extraction for multi-pass route planning based on visual attention model. Robot Comput Integr Manuf 37:251–261

    Article  Google Scholar 

  33. Xu Y, Lv N, Zhong J, Chen H, Chen S (2012) Research on the real-time tracking information of three-dimension welding seam in robotic GTAW process based on composite sensor technology. J Intell Robot Syst 68(2):89–103

    Article  Google Scholar 

  34. Xu Y, Lv N, Fang G, du S, Zhao W, Ye Z, Chen S (2017) Welding seam tracking in robotic gas metal arc welding. J Mater Process Technol 248:18–30

    Article  Google Scholar 

  35. Wang Q, Cheng Y, Jiao W, Johnson MT, Zhang YM (2019) Virtual reality human-robot collaborative welding: a case study of weaving gas tungsten arc welding. J Manuf Process 48:210–217

    Article  Google Scholar 

  36. Xu Y, Fang G, Chen S, Zou JJ, Ye Z (2014) Real-time image processing for vision-based weld seam tracking in robotic GMAW. Int J Adv Manuf Technol 73(9-12):1413–1425

    Article  Google Scholar 

  37. Ye Z, Fang G, Chen S, Dinham M (2013) A robust algorithm for weld seam extraction based on prior knowledge of weld seam. Sens Rev 33(2):125–133

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. New Technologies Research Center, Amirkabir University of Technology, Tehran, Iran

    Nahid Banafian & Rasul Fesharakifard

  2. Electrical Engineering Department, Amirkabir University of Technology, Tehran, Iran

    Mohammad Bagher Menhaj

Authors
  1. Nahid Banafian
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rasul Fesharakifard
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mohammad Bagher Menhaj
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Rasul Fesharakifard.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Banafian, N., Fesharakifard, R. & Menhaj, M.B. Precise seam tracking in robotic welding by an improved image processing approach. Int J Adv Manuf Technol 114, 251–270 (2021). https://doi.org/10.1007/s00170-021-06782-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00170-021-06782-4

Keywords

Search

Navigation