Skip to main content
SpringerLink
Log in

Groove depth measurement based on laser extraction and vision system

  • ORIGINAL ARTICLE
  • Published:
The International Journal of Advanced Manufacturing Technology Aims and scope Submit manuscript

Abstract

Laser is a very useful technology in the field of welding to obtain the deepest point of the metal being joined by providing a light source at the weld seam. However, laser imaging may be challenging because there are various laser reflection profiles on the workpiece that make it difficult to extract the desired laser image. In this paper, an extension study on feature point extraction was proposed to determine the depth of the V-groove. By taking use of laser image which has intensity noise around the edges, a noise rejection technique is applied to improve the quality of laser image. A data fitting method for the purpose of extracting feature points based on the reference row has been proposed because it is suitable for use after the laser centerline search. Then, the feature points are obtained by assigning the orientation position based on the “V” shape. Afterward, the extension study from feature point extraction looks on how to determine the V-groove depth by using the intersection and distance measurement method. To validate the accuracy of the proposed method, several samples of straight line and half-moon line types were tested. The performance of the system was evaluated against the actual value. It was observed that the proposed method is acceptable when subjected to laser reflection and lighting variations. The proposed method matches accurately when the respective line types showed an error percentage within 2 to 6%. This study is an extension step from feature point extraction, which can provide further analysis for weld seam tracking applications

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24
Fig. 25

Similar content being viewed by others

References

  1. Wu J, Smith J, Lucas J (1996) Weld bead placement system for multipass welding. IEEE Proc-Sci Meas Technol 143(2):85–90

    Article  Google Scholar 

  2. Shen X, Teng W (2011) A rapid image processing algorithm for structured light stripe welding seam tracking in laser welding. 30th International Congress on Laser Materials Processing, Laser Microprocessing and Nanomanufacturing, pp 118–124

  3. Xiao R, Xu Y, Hou Z, Chen C, Chen S (2019) An adaptive feature extraction algorithm for multiple typical seam tracking based on vision sensor in robotic arc welding. Sensors and Actuators A: Physical 297

  4. Fan J, Deng S, Jing F, Zhou C, Yang L, Long T, Tan Min (2020) An initial point alignment and seam-tracking system for narrow weld. IEEE Trans Ind Inf 16:877–886

    Article  Google Scholar 

  5. Manorathna P, Phairatt P, Ogun P, Widjanarko T, Chamberlain M, Justham L, Marimuthu S, Jackson MR (2014) Feature extraction and tracking of a weld joint for adaptive robotic welding. International Conference on Control Automation Robotics & Vision (ICARCV), pp1368–1372

  6. Shah HNM, Sulaiman M, Shukor AZ, Khamis Z, Rahman AA (2018) Butt welding joints recognition and location identification by using local thresholding. Robotics and Computer-Integrated Manufacturing 51:181–188

    Article  Google Scholar 

  7. Shah HNM, Sulaiman M, Shukor AZ, Rashid MZA (2017) Recognition of butt welding joints using background subtraction seam path approach for welding robot. International Journal of Mechanical & Mechatronics Engineering 17(01):57–62

    Google Scholar 

  8. Shah HNM, Sulaiman M, Shukor AZ, Khamis Z (2018) An experiment of detection and localization in tooth saw shape for butt joint using KUKA welding robot. Int J Adv Manuf Technol 97(5):3153–3162

    Article  Google Scholar 

  9. Liu X, Liu C (2017) Research on image processing in weld seam tracking with laser structured light. International Forum on Energy, Environment Science and Materials (IFEESM 2017) 120:803–807

  10. Muhammad J, Altun H, Abo-Serie E (2018) A robust butt welding seam finding technique for intelligent robotic welding system using active laser vision. International Journal of Advanced Manufacturing Technology 94:13–29

    Article  Google Scholar 

  11. Liangyu L, Lingjian F, Xin Z, Xiang L (2007) Image processing of seam tracking system using laser vision. Robotic Welding, Intelligence and Automation 319–324

  12. Du R, Xu Y, Hou Z, Shu J, Chen S (2019) Strong noise image processing for vision-based seam tracking in robotic gas metal arc welding. Int J Adv Manuf Technol 101(11):2135–2149

    Article  Google Scholar 

  13. Li X, Li X, Khyam MO, Ge SS (2017) Robust welding seam tracking and recognition. IEEE Sensors J 17:5609–5617

    Article  Google Scholar 

  14. Qin T, Zhang K, Deng J, Jin X (2011) Image processing methods for V-shape weld seam based on laser structured light. Foundations of Intelligent Systems, AISC 122:527–536

    Article  Google Scholar 

  15. Wang Z, Jing F, Fan J (2018) Weld seam type recognition system based on structured light vision and ensemble learning. IEEE International Conference on Mechatronics and Automation (ICMA) 866–871

  16. Fan J, Jing F, Yang L, Long T, Tan M (2019) An initial point alignment method of narrow weld using laser vision sensor. Int J Adv Manuf Technol 102:201–212

    Article  Google Scholar 

  17. Fang Z, Xu D, Tan M (2010) Visual seam tracking system for butt weld of thin plate. Int J Adv Manuf Technol 49:519–526

    Article  Google Scholar 

  18. Park MH, Wu QQ, Park CK, Lee JP, Kim IS (2015) A study on image processing algorithms for seam tracking system in GMA welding. Adv Mater Res 1088:819–823

    Article  Google Scholar 

  19. Wu QQ, Lee JP, Park MH, Jin BJ, Kim DH, Park CK, Kim IS (2015) A study on the modified Hough algorithm for image processing in weld seam tracking. J Mech Sci Technol 29(11):4859–4865

    Article  Google Scholar 

  20. Li C, Gong G (2018) Research on the adaptive recognition and location of the weld based on the characteristics of laser stripes. 10th International Conference on Intelligent Human-Machine Systems and Cybernetics, pp 163–166

  21. Sung K, Lee H, Choi YS, Rhee S (2009) Development of a multiline laser vision sensor for joint tracking in welding. Weld J 88(4):79–85

  22. Xiao Z (2011) Research on a trilines laser vision sensor for seam tracking in welding. In: Lecture Notes in Electrical Engineering book series (LNEE,volume 88), pp. 139-144

  23. Xiuping W, Ruilin B, Ziteng L (2014) Weld seam detection and feature extraction based on laser vision. Proceedings of the 33rd Chinese Control Conference, pp.8249–8252

  24. Kiddee P, Fang Z, Tan M (2016) An automated weld seam tracking system for thick plate using cross mark structured light. Int J Adv Manuf Technol 87:3589–3603

    Article  Google Scholar 

  25. Li X, Li X, Ge SS, Khyam MO, Luo C (2017) Automatic welding seam tracking and identification. IEEE Transactions on Industrial Electronics 64(9):7261–7271

    Article  Google Scholar 

  26. Sun JD, Cao GZ, Huang SD, Chen K, Yang JJ (2016) Welding seam detection and feature point extraction for robotic arc welding using laser-vision. 13th International Conference on Ubiquitous Robots and Ambient Intelligence (URAl), pp. 64–67

  27. Wang X, Shi Y, Yu G, Liang B, Li Y (2016) Groove-center detection in gas metal arc welding using a template-matching method. Int J Adv Manuf Technol 86:2791–2801

    Article  Google Scholar 

  28. Lü X, Gu D, Wang Y, Yan Qu, Qin C, Huang F (2018) Feature extraction of weld groove image based on laser vision. IEEE Sensor J 18(11):4715–4724

    Article  Google Scholar 

  29. Yanbiao Z, Yanbo W, Weilin Z, Xiangzhi C (2018) Real-time seam tracking control system based on line laser visions. Optics & Laser Technology 103:182–192

    Article  Google Scholar 

  30. Lee JP, Wu QQ, Park MH, Park C, Kim IS (2014) A study on optimal algorithms to find joint tracking in GMA welding. International Journal of Engineering Science and Innovative Technology (IJESIT) 3:370–380

    Google Scholar 

  31. Cibicik A, Tingelstad L, Egeland O (2021) Laser scanning and parametrization of weld grooves with reflective surfaces. Sensors (Basel) 21(14):4791

    Article  Google Scholar 

  32. Cibicik A, Njaastad EB, Tingelstad L, Egeland O (2022) Robotic weld groove scanning for large tubular T joints using a line laser sensor. Int J Adv Manuf Technol 120:4525–4538

    Article  Google Scholar 

  33. Said KAM, Jambek AB, Sulaiman N (2016) A study of image processing using morphological opening and closing processes. Int J Control Theory Appl 9(31):15–21

    Google Scholar 

Download references

Funding

The authors are grateful for the support granted by the Center for Robotics and Industrial Automation, Universiti Teknikal Malaysia Melaka (UTeM) in conducting this research through grant RACER/2019/FKE-CeRIA/F00399 and the Ministry of Higher Education.

Author information

Authors and Affiliations

  1. Center of Robotics and Industrial Automation, Faculty of Electrical Technology and Engineering, Universiti Teknikal Malaysia Melaka, Jalan Hang Tuah Jaya, 76100, Durian Tunggal, Melaka, Malaysia

    Nurul Fatiha Johan, Hairol Nizam Mohd Shah, Marizan Sulaiman & Osamah Abdullah Ahmed Mohammed Naji

  2. Neuro Dynamics Enterprise, No.20-1,Jalan KNMP 3, Kompleks Niaga Melaka Perdana, 75450, Bukit Katil, Melaka, Malaysia

    Mohd Ali Arshad

Authors
  1. Nurul Fatiha Johan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hairol Nizam Mohd Shah
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Marizan Sulaiman
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Osamah Abdullah Ahmed Mohammed Naji
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Mohd Ali Arshad
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hairol Nizam Mohd Shah.

Ethics declarations

Ethics approval

All professional ethics have been followed.

Consent to participate

Not applicable

Consent for publication

Not applicable

Conflict of interest

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Johan, N.F., Shah, H.N.M., Sulaiman, M. et al. Groove depth measurement based on laser extraction and vision system. Int J Adv Manuf Technol 130, 4151–4167 (2024). https://doi.org/10.1007/s00170-023-12914-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00170-023-12914-9

Keywords

Search

Navigation