Skip to main content
SpringerLink
Log in

Vision-based deviation extraction for three-dimensional control in robotic welding with steel sheet

  • ORIGINAL ARTICLE
  • Published:
The International Journal of Advanced Manufacturing Technology Aims and scope Submit manuscript

Abstract

Effective multidirectional extraction of the deviations between the welding torch and the tracking point is prerequisite for three-dimensional control in robotic automatic welding. This paper presents a vision-based method to determine the logical tracking point and further to extract the deviations of the welding torch in two directions for robotic pulse metal active gas welding with steel sheet in real time. Images from passive vision sensors include two edges of the groove, the joint line, and complete arc. A scheme is proposed to accurately discern the joint line based on the local grayscale maximum within the region of interest using orientation feature maps. The geometric center of complete arc is used to reflect the position of the welding torch, and the intersection of the extracted joint line and the line that passes through the geometric center and is vertical to the former is regarded as the desired tracking point. It is transformed to the three-dimensional world coordinate via vision calibration techniques, and the deviations in two directions are yielded when contrasted with the real-time, recorded coordinate of the welding torch from the robot control system. The experiment results show the effectiveness of the proposed method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. YL X, Fang G, Chen SB, Zou JJ, Ye Z (2014) Real-time image processing for vision-based weld seam tracking in robotic GMAW. Int J Adv Manuf Technol 73:1413–1425

    Article  Google Scholar 

  2. Gu WP, Xiong ZY, Wan W (2013) Autonomous seam acquisition and tracking system for multi-pass welding based on vision sensor. Int J Adv Manuf Technol 69(1-4):451–460. https://doi.org/10.1007/s00170-013-5034-6

    Article  Google Scholar 

  3. Gong Y, Dai X, Li X (2010) Structured-light based joint recognition using bottom-up and top-down combined visual processing. International Conference on Image Analysis and Signal Processing, Zhejiang, China, April 9-11, 2010 pp: 507–512

  4. Fang ZJ, Xu D, Tan M (2013) Vision-based initial weld point positioning using the geometric relationship between two seams. Int J Adv Manuf Technol 66(9-12):1535–1543. https://doi.org/10.1007/s00170-012-4437-0

    Article  Google Scholar 

  5. Nguyen HC, Lee BR (2014) Laser-vision-based quality inspection system for small-bead laser welding. Int J Precis Eng Manuf 15(3):415–423. https://doi.org/10.1007/s12541-014-0352-7

    Article  Google Scholar 

  6. Wang XP, Bai RL, Liu ZT (2014) Weld seam detection and feature extraction based on laser vision. Control Conference, 33rd Chinese, Nanjing, China, July 28–30, 2014 pp: 8249–8252

  7. Huang W, Kovacevic R (2012) Development of a real-time laser-based machine vision system to monitor and control welding processes. Int J Adv Manuf Technol 63(1-4):235–248. https://doi.org/10.1007/s00170-012-3902-0

    Article  Google Scholar 

  8. YL X, HW Y, Zhong JY, Lin T, Chen SB (2012) Real-time seam tracking control technology during welding robot GTAW process based on passive vision sensor. J Mater Process Technol 212:1654–1662

    Article  Google Scholar 

  9. Ye Z, Fang G, Chen SB, Zou JJ (2013) Passive vision based seam tracking system for pulse-MAG welding. Int J Adv Manuf Technol 67(9-12):1987–1996. https://doi.org/10.1007/s00170-012-4625-y

    Article  Google Scholar 

  10. Xu YL, Lv N, Fang G, Du SF, Zhao WJ, Ye Z, Chen SB (2017) Welding seam tracking in robotic gas metal arc welding. J Mater Process Technol

  11. Guo B, Shi YH, GQ Y, Liang B, Wang K (2016) Weld deviation detection based on wide dynamic range vision sensor in MAG welding process. Int J Adv Manuf Technol 87(9-12):3397–3410. https://doi.org/10.1007/s00170-016-8721-2

    Article  Google Scholar 

  12. Zou Y, Jiang LB, Li YH, Xue LH, Huang JF, Huang JQ (2016) Welding deviation detection algorithm based on extremum of molten pool image contour. CHN J Mech Eng 29:74–83

    Article  Google Scholar 

  13. Gao XD, Chen YQ, You DR, Xiao ZL, Chen XH (2017) Detection of micro gap weld joint by using magneto-optical imaging and Kalman filtering compensated with RBF neural network. Mech Syst Signal Process 84:570–583. https://doi.org/10.1016/j.ymssp.2016.07.041

    Article  Google Scholar 

  14. Gao XD, Mo L, You DR, Li ZM (2017) Tight butt joint weld detection based on optical flow and particle filtering of magneto-optical imaging. Mech Syst Signal Process 96:16–30. https://doi.org/10.1016/j.ymssp.2017.04.001

    Article  Google Scholar 

  15. He YS, YL X, Chen YX, Chen HB, Chen SB (2015) Weld seam profile detection and feature point extraction for multi-pass route planning based on visual attention model. Robot Comput Integr Manuf 37:251–261

    Article  Google Scholar 

  16. He YS, Chen HB, Huang YM, Wu D, Chen SB (2016) Parameter self-optimizing clustering for autonomous extraction of the weld seam based on orientation saliency in robotic MAG welding. J Intell Robot Syst 83(2):219–237. https://doi.org/10.1007/s10846-015-0331-y

    Article  Google Scholar 

  17. He YS, Chen YX, YL X, Huang YM, Chen SB (2016) Autonomous detection of weld seam profiles via a model of saliency-based visual attention for robotic arc welding. J Intell Robot Syst 81(3-4):395–406. https://doi.org/10.1007/s10846-015-0226-y

    Article  Google Scholar 

  18. He YS, Zhou H, Wang JW, Wu D, Chen SB (2016) Weld seam profile extraction of T-joints based on orientation saliency for path planning and seam tracking. Advanced Robotics and ITS Social Impacts IEEE, pp 110–115

  19. Liu SY, Wang GR (2008) Fast calibration for robot welding system with laser vision. In Robotics, automation and mechatronics, 2008 I.E. Conference on, pp 706–710

Download references

Funding

This work is supported by the National Natural Science Foundation of China under the Grant No. 51405298 and 51575348.

Author information

Authors and Affiliations

  1. Institute of Technology, East China Jiao Tong University, Nanchang, 330100, China

    Zhuohua Yu

  2. School of Environment and Chemical Engineering, Nanchang University, Nanchang, 330031, China

    Yinshui He

  3. School of Materials Science and Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China

    Yanling Xu & Huabin Chen

Authors
  1. Zhuohua Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yinshui He
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yanling Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Huabin Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yinshui He.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yu, Z., He, Y., Xu, Y. et al. Vision-based deviation extraction for three-dimensional control in robotic welding with steel sheet. Int J Adv Manuf Technol 95, 4449–4458 (2018). https://doi.org/10.1007/s00170-017-1546-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00170-017-1546-9

Keywords

Search

Navigation