On-line learning of welding bead geometry in industrial robots

  • Jaime F. Aviles-Viñas
  • Reyes Rios-Cabrera
  • Ismael Lopez-Juarez


In this paper, we propose an architecture based on an artificial neural network (ANN), to learn welding skills automatically in industrial robots. With the aid of an optic camera and a laser-based sensor, the bead geometry (width and height) is measured. We propose a real-time computer vision algorithm to extract training patterns in order to acquire knowledge to later predict specific geometries. The proposal is implemented and tested in an industrial KUKA KR16 robot and a GMAW type machine within a manufacturing cell. Several data analysis are described as well as off-line and on-line training, learning strategies, and testing experimentation. It is demonstrated during our experiments that, after learning the skill, the robot is able to produce the requested bead geometry even without any knowledge about the welding parameters such as arc voltage and current. We implemented an on-line learning test, where the whole experiments and learning process take only about 4 min. Using this knowledge later, we obtained up to 95 % accuracy in prediction.


ANN Computer vision Bead geometry Industrial robots Robotics on-line learning Robotics welding 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    World Robotics 2013 (2013) Industrial Robots, International Federation of RoboticsGoogle Scholar
  2. 2.
    Gorle P, Clive A (2013) Positive impact of industrial robots on employment, international federation of robotics, METRA MARTECH LimitedGoogle Scholar
  3. 3.
    Ganjigatti JP, Pratihar DK, RoyChoudhury A (2008) Modeling of the MIG welding process using statistical approaches. Int J Adv Manuf Technol 35:1166–1190CrossRefGoogle Scholar
  4. 4.
    Luo H, Chen X (2005) Laser visual sensing for seam tracking in robotic arc welding of titanium alloys. Int J Adv Manuf Technol 26:1012–1017CrossRefGoogle Scholar
  5. 5.
    Horvat J, Prezelj J, Polajnar I, Cudina M (2011) Monitoring gas metal arc welding process by using audible sound signal. Strojniski vestnik- J Mech Eng 57(3):267–278CrossRefGoogle Scholar
  6. 6.
    Cudina M, Prezelj J, Polajnar I (2008) Use of audible sound for on-line monitoring of gas metal arc welding process. Metalurgia 47(2):81–85Google Scholar
  7. 7.
    Lv N, Xu Y, Zhong J, Chen H (2013) Research on detection of welding penetration state during robotic GTAW process based on audible arc sound. Ind Robot Int J 40(/5):474–493CrossRefGoogle Scholar
  8. 8.
    Kolahan F, Heidari M (2010) A New Approach for Predicting and Optimizing Weld Bead Geometry in GMAW. International. J Mech Syst Sci Eng 2:2:138–142Google Scholar
  9. 9.
    Sreeraj P, Kannan T, Maji S (2013) Prediction and control of weld bead geometry in gas metal arc welding process using simulated annealing algorithm. Int J Comput Eng Res 3(1):213–222Google Scholar
  10. 10.
    Ma H, Wei S, Lin T, Chen S, Li L (2010) Binocular vision system for both weld pool and root gap in robot welding process. Sens Rev 30(2):116–123CrossRefGoogle Scholar
  11. 11.
    Grossberg S, Markuzon N, Reynolds JH, Carpenter GA, Rosen DB (1992) Fuzzy ARTMAP: a neural network architecture for incremental supervised learning of analog multidimensional maps. IEEE Trans Neural Netw 3(5)Google Scholar
  12. 12.
    Kim I-S, Son J-S, Lee S-H, Yarlagadda PKDV (2004) Optimal design of neural networks for control in robotic arc welding. Robot Comput Integr Manuf 20(1):57–63CrossRefzbMATHGoogle Scholar
  13. 13.
    Ismail MIS, Okamoto Y, Okada A (2013) Neural Network modeling for prediction of weld bead geometry in laser microwelding. Advances in Optical Technologies 2013:7. Article ID 415837CrossRefGoogle Scholar
  14. 14.
    Iqbal A, Khan SM, Mukhtar HS (2011) ANN assisted prediction of weld bead geometry in gas tungsten arc welding of HSLA steels. In: Proceedings of the World Congress on Engineering, Vol I, WCE 2011, July 6–8, 2011, London, U.KGoogle Scholar
  15. 15.
    Huang W, Kovacevic R (2011) A laser-based vision system for weld quality inspection. Journal Sensors 11:506–521CrossRefGoogle Scholar
  16. 16.
    Chan B, Pacey J, Bibby M (1999) Modelling gas metal arc weld geometry using artificial neural network technology. Can Metall Q 38(1):43–51Google Scholar
  17. 17.
    Kim IS, Kwon WH, Siores E (1996) An investigation of a mathematical model for predicting weld bead geometry. Can Metall Q 35(4):385–392CrossRefGoogle Scholar
  18. 18.
    Hardle W, Steiger W (1995) Algorithm AS 296: optimal median smoothing. Appl Stat 44(2):258CrossRefGoogle Scholar
  19. 19.
    Sreeraj P, Kannan T (2012) Modelling and prediction of stainless steel clad bead geometry deposited by GMAW using regression and artificial neural network models. Adv Mech Eng 2012:1–12. Article ID 237379Google Scholar
  20. 20.
    Akkas N, Karayel D, Ozkan SS, Ogur A, Topal B (2013) Modeling and Analysis of the Weld Bead Geometry in Submerged Arc Welding by Using Adaptive Neurofuzzy Inference System Mathematical Problems in Engineering, Vol. 2013, Article ID 473495, 10 pagesGoogle Scholar
  21. 21.
    Xu Y, Yu H, Zhong J, Lin T, Chen S (2012) Real-time image capturing and processing of seam and pool during robotic welding process. Ind Robot Int J 39(5):513–523CrossRefGoogle Scholar
  22. 22.
    Ye Z, Fang G, Chen S, Dinham M (2013) A robust algorithm for weld seam extraction based on prior knowledge of weld seam. Sens Rev 33(2):125–133CrossRefGoogle Scholar
  23. 23.
    Fang Z, Xu D, Ta M (2013) Vision-based initial weld point positioning using the geometric relationship between two seams. Int J Adv Manuf Technol 66:1535–1543CrossRefGoogle Scholar
  24. 24.
    Xu Y, Fang G, Chen S, Zou JJ, Ye Z (2014) Real-time image processing for vision-based weld seam tracking in robotic GMAW. Int J Adv Manuf Technol 73:1413–1425CrossRefGoogle Scholar

Copyright information

© Springer-Verlag London 2015

Authors and Affiliations

  • Jaime F. Aviles-Viñas
    • 1
  • Reyes Rios-Cabrera
    • 1
  • Ismael Lopez-Juarez
    • 1
  1. 1.Centro de Investigacion y de Estudios Avanzados del IPN (CINVESTAV)CoahuilaMexico

Personalised recommendations