Abstract
Visual sensor plays an important part in intelligentized welding systems, and the calibration of the vision sensor is the indispensable part of visual systems. Aiming at the problem of the tedious calibration process, this paper describes an automatic calibration algorithm. First, the robot motion equation and the motion range constraint equation are proposed to ensure that the collected images of calibration grid and laser line meet the calibration requirements. Based on these two equations, the automatic collection procedure can be realized. Second, the simplified visual servoing method and the Extended Kalman filter were used to adjust the images and rectify system parameters, respectively, which will improve the stability of the calibration motion. Third, to reduce the impact of the complex welding environments, a robustness feature extraction algorithm based on local threshold is studied. And then, the laser plane and hand-eye matrix are fitted with optimization algorithms to ensure calibration accuracy. Finally, the simulation experiments prove the feasibility and stability of the proposed algorithm. And the actual calibration tests suggest that the algorithm can significantly improve calibration efficiency. Moreover, the experimental results of welding guidance and seam tracking confirm that the calibration precision has met the welding requirement.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Abu-Nabah, B. A., ElSoussi, A. O., & Al Alami, A. E. K. (2016). Simple laser vision sensor calibration for surface profiling applications. Optics and Lasers in Engineering, 84, 51–61.
Antonello, M., Gobbi, A., Michieletto, S., Ghidoni, S., & Menegatti, E. (2017). A fully automatic hand-eye calibration system. In 2017 European conference on mobile robots (ECMR) (pp. 1–6). IEEE.
Chen, S. B. (2015). On intelligentized welding manufacturing. The Advances in Intelligent Systems and Computing, 363, 3–34.
Diao, C., Ding, J., Williams, S., & Zhao, Y. (2017). A passive imaging system for geometry measurement for the plasma arc welding process. IEEE Transactions on Industrial Electronics, 64(9), 7201–7209.
Ding, Y., Huang, W., & Kovacevic, R. (2016). An on-line shape-matching weld seam tracking system. Robotics and Computer-Integrated Manufacturing, 42, 103–112.
Fan, J., Deng, S., Jing, F., Zhou, C., Yang, L., Long, T., & Tan, M. (2019). An initial point alignment and seam-tracking system for narrow weld. IEEE Transactions on Industrial Informatics, 16(2), 877–886.
Gong, Z., Tao, B., Yang, H., Yin, Z., & Ding, H. (2017). An uncalibrated visual servo method based on projective homography. IEEE Transactions on Automation Science and Engineering, 15(2), 806–817.
Heller, J., Havlena, M., & Pajdla, T. (2015). Globally optimal hand-eye calibration using branch-and-bound. IEEE Transactions on Pattern Analysis and Machine Intelligence, 38(5), 1027–1033.
Hu, J. S., & Chang, Y. J. (2012). Automatic calibration of hand-eye–workspace and camera using hand-mounted line laser. IEEE/ASME Transactions on Mechatronics, 18(6), 1778–1786.
Huynh, D. Q., Owens, R. A., & Hartmann, P. E. (1999). Calibrating a structured light stripe system: A novel approach. International Journal of Computer Vision, 33(1), 73–86.
Kwon, O., Kim, H. G., Ham, M. J., Kim, W., Kim, G. H., Cho, J. H., et al.. (2020). A deep neural network for classification of melt-pool images in metal additive manufacturing. Journal of Intelligent Manufacturing, 31(2), 375–386.
Li, X., Li, X., Ge, S. S., Khyam, M. O., & Luo, C. (2017). Automatic welding seam tracking and identification. IEEE Transactions on Industrial Electronics, 64(9), 7261–7271.
Liu, F., Wang, Z., & Ji, Y. (2018). Precise initial weld position identification of a fillet weld seam using laser vision technology. The International Journal of Advanced Manufacturing Technology, 99(5–8), 2059–2068.
Liu, G., Gao, X., You, D., & Zhang, N. (2019). Prediction of high power laser welding status based on PCA and SVM classification of multiple sensors. Journal of Intelligent Manufacturing, 30(2), 821–832.
Park, F. C., & Martin, B. J. (1994). Robot sensor calibration: solving AX=XB on the Euclidean group. IEEE Transactions on Robotics and Automation, 10(5), 717–721.
Sauvola, J., & Pietikäinen, M. (2000). Adaptive document image binarization. Pattern Recognition, 33(2), 225–236.
Sharifzadeh, S., Biro, I., & Kinnell, P. (2020). Robust hand-eye calibration of 2D laser sensors using a single-plane calibration artefact. Robotics and Computer-Integrated Manufacturing, 61, 101823.
Suyi, L., & Guorong, W. (2008). Fast calibration for robot welding system with laser vision. In 2008 IEEE conference on robotics, automation and mechatronics (pp. 706–710). IEEE.
Tsai, R. Y., & Lenz, R. K. (1989). A new technique for fully autonomous and efficient 3D robotics hand/eye calibration. IEEE Transactions on Robotics and Automation, 5(3), 345–358.
Wang, H., Lu, X., Hu, Z., & Li, Y. (2015). A vision-based fully-automatic calibration method for hand-eye serial robot. Industrial Robot: An International Journal, 42(1), 64–73.
Wang, X., & Li, R. (2014). Intelligent modelling of back-side weld bead geometry using weld pool surface characteristic parameters. Journal of Intelligent Manufacturing, 25(6), 1301–1313.
Wang, Z., Fan, J., Jing, F., Deng, S., Zheng, M., & Tan, M. (2020). An efficient calibration method of line structured light vision sensor in robotic eye-in-hand system. IEEE Sensors Journal, 20(11), 6200–6208.
Xiong, J., Zhang, Y., & Pi, Y. (2020). Control of deposition height in WAAM using visual inspection of previous and current layers. Journal of Intelligent Manufacturing. https://doi.org/10.1007/s10845-020-01634-6.
Xu, Y., Lv, N., Fang, G., Du, S., Zhao, W., Ye, Z., & Chen, S. (2017). Welding seam tracking in robotic gas metal arc welding. Journal of Materials Processing Technology, 248, 18–30.
Ye, Z., Fang, G., Chen, S., & Zou, J. J. (2013). Passive vision based seam tracking system for pulse-MAG welding. The International Journal of Advanced Manufacturing Technology, 67(9–12), 1987–1996.
Zhang, X., Tsang, W. M., Yamazaki, K., & Mori, M. (2013). A study on automatic on-machine inspection system for 3D modeling and measurement of cutting tools. Journal of Intelligent Manufacturing, 24(1), 71–86.
Zhang, Z., & Chen, S. (2017). Real-time seam penetration identification in arc welding based on fusion of sound, voltage and spectrum signals. Journal of Intelligent Manufacturing, 28(1), 207–218.
Zou, Y., & Chen, X. (2018). Hand-eye calibration of arc welding robot and laser vision sensor through semidefinite programming. Industrial Robot: An International Journal, 45(5), 597–610.
Zou, Y., & Lan, R. (2020). An end-to-end calibration method for welding robot laser vision systems with deep reinforcement learning. IEEE Transactions on Instrumentation and Measurement, 69(7), 4270–4280. https://doi.org/10.1109/Tim.2019.2942533.
Acknowledgements
This work is partly supported by the National Natural Science Foundation of China under the Grant Nos. 61873164, 61973213, the Shanghai Natural Science Foundation (18ZR1421500), and the Opening Project of Shanghai Robot Industry R&D and Transformation Functional Platform.
Author information
Authors and Affiliations
Corresponding authors
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Xiao, R., Xu, Y., Hou, Z. et al. An automatic calibration algorithm for laser vision sensor in robotic autonomous welding system. J Intell Manuf 33, 1419–1432 (2022). https://doi.org/10.1007/s10845-020-01726-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10845-020-01726-3