Skip to main content
SpringerLink
Log in

Additive seam tracking technology based on laser vision

  • ORIGINAL ARTICLE
  • Published:
The International Journal of Advanced Manufacturing Technology Aims and scope Submit manuscript

Abstract

With the development of manufacturing industry and technology, traditional manual welding technology is gradually unable to meet the need for industrial mass production in the field of fusion welding and additive manufacturing. As a result, an automatic welding method using robots to replace manual welding is needed. This paper studies the additive weld seam tracking technology based on laser vision and designs a welding seam tracking system. The images of linear structure light which reflect welding seam information are collected by vision sensor. The structure light extraction algorithm window is selected under the guidance of the over-exposure characteristics of all kinds of noises. The ERFNet network is applied for the structure light and its corresponding feature point extraction. The accurate center line of structure light is extracted from strong background noise and the feature point of weld seam is obtained through regression. It realizes the online path planning and deviation correction of the weld seam tracking in real-time. The proposed algorithm is demonstrated by the weld feature extraction experiment and welding seam tracking experiment based on groove additive task. It shows that the offset is within one pixel and the distance is within 0.25 mm between the welding feature points extracted by ERFNet and the manually marked welding points. The proposed algorithm has the performance of high robustness, strong adaptability and can meet the practical welding requirements.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

Availability of data and materials

Our data sets are not exposed.

References

  1. Muhammad J, Altun H, Abo-Serie E (2018) A robust butt welding seam finding technique for intelligent robotic welding system using active laser vision[J]. Int J Adv Manuf Technol 94(1-4):13–29

    Article  Google Scholar 

  2. Arizmendi C, Garcia W, Quintero M (2015) Automatic welding detection by an intelligent tool pipe inspection[C] Journal of Physics: Conference Series. IOP Publishing 628(1):012082

    Google Scholar 

  3. Aviles-Viñas JF, Rios-Cabrera R, Lopez-Juarez I (2016) On-line learning of welding bead geometry in industrial robots[J]. Int J Adv Manuf Technol 83(1-4):217–231

    Article  Google Scholar 

  4. Gao X, Mo L, Xiao Z, Chen X, Katayama S (2016) Seam tracking based on Kalman filtering of micro-gap weld using magneto-optical image[J]. Int J Adv Manuf Technol 83(1-4):21–32

    Article  Google Scholar 

  5. Kawahara M (1983) Tracking control system using image sensor for arc welding[J]. Automatica 19(4):357–363

    Article  Google Scholar 

  6. Li Y, Xu D, Shen Y, Tan M (2006) Multi-features selection and extraction of structured light images of vision sensor for seam tracking [J]. Chinese J Sens Actuators 19(6):2676–2681

    Google Scholar 

  7. Fang Z, Xu D, Tan M (2013) Visual seam tracking system for butt weld of thin plate[J]. Int J Adv Manuf Technol 49(5-8):519–526

    Article  Google Scholar 

  8. Huang Y, Xiao Y, Wang P, Li M (2013) A seam-tracking laser welding platform with 3D and 2D visual information fusion vision sensor system[J]. Int J Adv Manuf Technol 67(1-4):415–426

    Article  Google Scholar 

  9. Huang W, Kovacevic R (2012) Development of a real-time laser-based machine vision system to monitor and control welding processes[J]. Int J Adv Manuf Technol 63(1-4):235–248

    Article  Google Scholar 

  10. Gao X, Zhong X, You D, Katayama S (2012) Kalman filtering compensated by radial basis function neural network for seam tracking of laser welding[J]. IEEE Trans Control Syst Technol 21(5):1916–1923

    Google Scholar 

  11. Zou Y, Chen X, Gong G, Li J (2018) A seam tracking system based on a laser vision sensor[J]. Measurement 127:489–500

    Article  Google Scholar 

  12. Lv X, Gu D, Wang Y, Qu Y, Qin C, Huang F (2018) Feature extraction of welding seam image based on laser vision[J]. IEEE Sensors J 18(11):4715–4724

    Article  Google Scholar 

  13. Moriyasu M, Hiramoto S, Ohmine M (1993) Development of a multi-pass welding program for arc welding robots and its application to heavy electrical section pieces[J]. Trans Jpn Weld Soc 24(1):24–29

    Google Scholar 

  14. Xu P, Tang X, Yao S (2008) Application of circular laser vision sensor (CLVS) on welded seam tracking[J]. J Mater Process Technol 205(1-3):404–410

    Article  Google Scholar 

  15. Miao X, Wang S, Li X, Peng X (2010) Track fitting for multi-path/multi-layer big frame intersection line welding robot [J]. Mater Sci Technol 5

  16. Yang C, Huang H, Zhang H, Chen Y, Chen S (2012) Multi-pass route planning for thick plate of low alloy high strength steel by double-sided double arc welding[J]. Adv Mater Res: 28-34

  17. Xiupin W (2015) Research of welding seam tracking system using laser vision and double queues[J]. Comput Eng Appl

  18. Xu Y, Lv N, Fang G, Du S, Zhao W, Ye Z, Chen S (2017) Welding seam tracking in robotic gas metal arc welding[J]. J Mater Process Technol 248:18–30

    Article  Google Scholar 

  19. Shi L, Tian X, Zhang C (2015) Automatic programming for industrial robot to weld intersecting pipes[J]. Int J Adv Manuf Technol 81(9-12):2099–2107

    Article  Google Scholar 

  20. He Y, Chen Y, Xu Y, Huang Y, Chen S (2016) Autonomous detection of weld seam profiles via a model of saliency-based visual attention for robotic arc welding[J]. J Intell Robot Syst 81(3-4):395–406

    Article  Google Scholar 

  21. Zou Y, Zhou W, Chen X (2017) Research of laser vision seam detection and tracking system based on depth hierarchical feature[J]. Chin J Lasers 44(4):95–106

    Google Scholar 

  22. Zhan Y, Yang G, Wang Q, Ma L, Wang Y (2019) Weld feature extraction based on fully convolutional networks[J]. Chin J Lasers 46(3)

  23. Xiao R, Xu Y, Hou Z, Chen C, Chen S (2019) An adaptive feature extraction algorithm for multiple typical seam tracking based on vision sensor in robotic arc welding[J]. Sensors Actuators A Phys 297:111533

    Article  Google Scholar 

  24. Zou Y, Li J, Chen X, Lan R (2018) Learning Siamese networks for laser vision seam tracking[J]. Journal of the Optical Society of America A Optics Image Science & Vision 35(11):1805–1813

Download references

Funding

This work is supported by The Natural Science Foundations of China 61727802, 61901220 and Jiangsu postdoctoral research funding program, 2019K216.

Author information

Author notes

  1. Zhuang Zhao and Jun Luo contributed equally to this work.

Authors and Affiliations

  1. Jiangsu Key Laboratory of Spectral Imaging and Intelligent Sense, Nanjing University of Science and Technology, Nanjing, 210094, China

    Zhuang Zhao, Jun Luo, Yeyu Wang, Lianfa Bai & Jing Han

Authors
  1. Zhuang Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jun Luo
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yeyu Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Lianfa Bai
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jing Han
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Author contributions are listed as follows: conceptualization, methodology, writing—original draft, Jun Luo; investigation, writing—review and editing, Zhuang Zhao and Yeyu Wang; supervision, Lianfa Bai and Jing Han. All authors have read and agreed to the published version of the manuscript.

Corresponding author

Correspondence to Zhuang Zhao.

Ethics declarations

Ethics approval and consent to participate

This paper is our original unpublished work, and it has not been submitted to any other journal for reviews. The manuscript has been read and approved by all named authors and that there are no other persons who satisfied the criteria for authorship but are not listed. The order of authors listed in the manuscript has been approved by all of us.

Consent for publication

All authors consent to publish the content in the final manuscript.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhao, Z., Luo, J., Wang, Y. et al. Additive seam tracking technology based on laser vision. Int J Adv Manuf Technol 116, 197–211 (2021). https://doi.org/10.1007/s00170-021-07380-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00170-021-07380-0

Keywords

Search

Navigation