Skip to main content
SpringerLink
Log in

A weld line detection robot based on structure light for automatic NDT

  • ORIGINAL ARTICLE
  • Published:
The International Journal of Advanced Manufacturing Technology Aims and scope Submit manuscript

Abstract

In automatic non-destructive testing (NDT), weld bead tracking is usually performed outside. However, irregular weld boundaries, unconstrained illumination, and rough metal surfaces can cause noise, which increases the difficulty of seam tracking. In this paper, a method of parallel structured light (PSL) sensing based on deep learning and information fusion is proposed to detect weld lines. First, a camera is used to capture the laser stripe image projected by the PSL on the weld bead. Then, a MobileNet-SSD deep learning model is trained to extract the regions of interest (ROIs) to de-noise the laser stripe image. Finally, the weld line is obtained by fusing information from multiple weld boundaries.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23

Similar content being viewed by others

References

  1. Zhang L, Sun J, Yin G, Zhao J, Han Q (2015) A cross structured light sensor and stripe segmentation method for visual tracking of a wall climbing robot. Sensors 15(6):13725–13751

    Article  Google Scholar 

  2. Zhang L, Ye Q, Yang W, Jiao J (2014) Weld line detection and tracking via spatial-temporal cascaded hidden Markov models and cross structured light. IEEE Trans Instrum Meas 63(4):742–753

    Article  Google Scholar 

  3. Zou Y, Du D, Zeng J, Zhang W (2008) Visual method for weld seam recognition based on multi-feature extraction and information fusion. Trans China Weld Inst 34:33–36

    Google Scholar 

  4. Krämer S, Fiedler W, Drenker A, Abels P (2014) Seam tracking with texture based image processing for laser material processing. In: Proceedings of the International Society for Optics and Photonics, High-Power Laser Materials Processing: Lasers, Beam Delivery, Diagnostics and Applications III, San Francisco, CA, USA; vol 8963, pp 89630P-1-9

  5. Yan T (2016) Research on identification method of pipeline weld and design of weld ultrasonic scanning equipment (in Chinese). Shenzhen University, MA thesis. https://kns.cnki.net/KCMS/detail/detail.aspx?dbname=CMFD201701&filename=1016763844.nh

  6. Liu X, Xu G, Fei Y (2017) Image processing algorithm for intersecting line weld inspection robot. Transducer Microsystem Technol 36(7):146–153

    Google Scholar 

  7. Li X, Li X, Ge S, Khyam MO, Luo C (2017) Automatic welding seam tracking and identification. IEEE Trans Ind Electron (99):1–1

  8. Zeng J, Chang B, Du D, Wang L, Chang S, Peng G et al (2018) A weld position recognition method based on directional and structured light information fusion in multi-layer/multi-pass welding. Sensors:18(1)

  9. Molleda J, Usamentiaga R, Garcia DF, Bulnes FG, Ema L (2011) Shape measurement of steel strips using a laser-based three-dimensional reconstruction technique. IEEE Trans Ind Appl 47(4):1536–1544

    Article  Google Scholar 

  10. Molleda J, Usamentiaga R, Bulnes FG, Granda JC, Ema L (2012) Uncertainty propagation analysis in 3-d shape measurement using laser range finding. IEEE Trans Instrum Meas 61(5):1160–1172

    Article  Google Scholar 

  11. Usamentiaga R, Molleda J, García DF (2012) Fast and robust laser stripe extraction for 3d reconstruction in industrial environments. Mach Vis Appl 23(1):179–196

    Article  Google Scholar 

  12. Duran O, Althoefer K, Seneviratne LD (2007) Automated pipe defect detection and categorization using camera/laser-based profiler and artificial neural network. IEEE Trans Autom Sci Eng 4(1):118–126

    Article  Google Scholar 

  13. Liang L, Ordonez C, Collins EG Jr, Coyle E, Palejiya D (2011) Terrain surface classification with a control mode update rule using a 2d laser stripe-based structured light sensor. Robot Auton Syst 59(11):954–965

    Article  Google Scholar 

  14. Saito K, Miyoshi T, Yoshikawa H (1991) Noncontact 3-d digitizing and machining system for free-form surfaces. CIRP Ann Manuf Technol 40(1):483–486

    Article  Google Scholar 

  15. Li L, Fu L, Zhou X, Li X (2007) Image processing of seam tracking system using laser vision. Robot Weld Intell Autom 362:319–324

    Article  Google Scholar 

  16. Gu W, Xiong Z, Wan W (2013) Autonomous seam acquisition and tracking system for multi-pass welding based on vision sensor. Int J Adv Manuf Technol 69:451–460

    Article  Google Scholar 

  17. Li Y, Li Y, Wang Q, Xu D, Tan M (2010) Measurement and defect detection of the weld bead based on online vision inspection. IEEE Trans Instrum Meas 59:1841–1849

    Article  Google Scholar 

  18. Zeng J, Chang B, Du D, Hong Y, Chang S, Zou Y (2016) A precise visual method for narrow butt detection in specular reflection workpiece welding. Sensors 16:1480

    Article  Google Scholar 

  19. Muhammad J, Altun H, Abo-Serie E (2016) A robust butt welding seam finding technique for intelligent robotic welding system using active laser vision. Int J Adv Manuf Technol 94:1–17

    Article  Google Scholar 

  20. Fang Z, Xu D (2009) Image-based visual seam tracking system for fillet joint. In Proceedings of the IEEE International Conference on Robotics and Biomimetics, Guilin, China, pp 1230–1235

  21. Fang Z, Xu D, Tan M (2010) Visual seam tracking system for butt weld of thin plate. Int J Adv Manuf Technol 49:519–526

    Article  Google Scholar 

  22. Zhang L, Jiao J, Ye Q, Han Z, Yang W (2012) Robust weld line detection with cross structured light and Hidden Markov Model. In: Proceedings of the IEEE International Conference on Mechatronics and Automation, Chengdu, China, pp 1411–1416

  23. Huang W, Kovacevic R (2012) Development of a real-time laser-based machine vision system to monitor and control welding processes. Int J Adv Manuf Technol 63:235–248

    Article  Google Scholar 

  24. Kim J, Bae H (2005) A study on a vision sensor system for tracking the I-butt weld joints. J Mech Sci Technol 19:1856–1863

    Article  Google Scholar 

  25. Sung K, Lee H, Choi YS, Rhee S (2009) Development of a multiline laser vision sensor for joint tracking in welding. Weld J 88:79 s–85 s

    Google Scholar 

  26. Shi Y, Wang G, Li G (2007) Adaptive robotic welding system using laser vision sensing for underwater engineering. In Proceedings of the IEEE International Conference on Control and Automation, Guangzhou, China, pp 1213–1218

  27. Chu H, Wang Z (2017) Study on dimension measurement and defect detection of weld based on active vision. Hot Work Technol 46(21):206–209

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Shenzhen University, Shenzhen, China

    Zhaoxuan Dong, Zhiheng Mai, Shiqi Yin, Jie Wang, Jie Yuan & Yuenong Fei

Authors
  1. Zhaoxuan Dong
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhiheng Mai
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shiqi Yin
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jie Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jie Yuan
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Yuenong Fei
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yuenong Fei.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Dong, Z., Mai, Z., Yin, S. et al. A weld line detection robot based on structure light for automatic NDT. Int J Adv Manuf Technol 111, 1831–1845 (2020). https://doi.org/10.1007/s00170-020-05964-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00170-020-05964-w

Keywords

Search

Navigation