Skip to main content
SpringerLink
Log in

A Path Correction Method Based on Global and Local Matching for Robotic Autonomous Systems

  • Short paper
  • Published:
Journal of Intelligent & Robotic Systems Aims and scope Submit manuscript

Abstract

Normally, small batch parts, especially by manual assembly, are difficult to be manufactured automatically(e.g., welded, polished, sprayed) by robots because of deviation from a pre-taught path, which results from shape error and clamping error. To correct the pre-taught path, visual sensors can be used to detect it and guide the robots. However, some of the paths cannot be continuously detected due to work space limitation, and therefore, only part of them can be detected. As a result, it is difficult to directly match the incompleted detected path to pre-taught path with location errors and shape errors, which cause residual deviation after correction. This paper proposes an efficient and robust path correction method, that can be applied to robotic autonomous systems. The main contribution of this work is adopting global matching to maintain the original shape of the pre-taught path, which deals with location errors, and the local matching relaxes this constraint and addressed the shape errors. Structured light vision is used to detect the deviation of path to improve the detecting accuracy and reduce detection data size simultaneously. And a path-matching method taking account of both global and local features is developed based on iterative closest point algorithm (ICP). The proposed method consists of four steps: path scanning, global matching, local matching and data updating. Several robotic welding experiments are applied to verify the proposed method performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Fang, Z., Xu, D., Tan, M.: A vision-based self-tuning fuzzy controller for fillet weld seam tracking. IEEE-ASME Trans. Mechatron. 16(3), 540–550 (2011)

    Article  Google Scholar 

  2. Tutsoy, O., Barkana, D.E., Colak, S.: Learning to balance an nao robot using reinforcement learning with symbolic inverse kinematic. Trans. Inst. Meas. Control. 39(11), 1735–1748 (2017)

    Article  Google Scholar 

  3. Tutsoy, O.: Cpg based rl algorithm learns to control of a humanoid robot leg. Int. J. Robot. Autom. 30(2), 1–7 (2015)

    Google Scholar 

  4. Svenman, E., Runnemalm, A.: A complex response inductive method for improved gap measurement in laser welding. Int. Adv. Manuf. Technol. 88(1), 175–184 (2017)

    Article  Google Scholar 

  5. Seong, U., Ryu, S., Kim, W., Bae, S., Cho, B., Won, J.: Multi ultrasonic probe for scanning welded zone of tube, Google Patents (2021)

  6. Gomez Munoz, C.Q., Arcos Jimenez, A., Garcia Marquez, F.P., Kogia, M., Cheng, L., Mohimi, A., Papaelias, M.: Cracks and welds detection approach in solar receiver tubes employing electromagnetic acoustic transducers. Struct. Health Monit. 17(5), 1046–1055 (2018)

    Article  Google Scholar 

  7. Guo, B., Shi, Y., Yu, G., Liang, B., Wang, K.: Weld deviation detection based on wide dynamic range vision sensor in mag welding process. Int. J. Adv. Manuf. Technol. 87(9-12), 3397–3410 (2016)

    Article  Google Scholar 

  8. Chang, D., Son, D., Lee, J., Lee, D., Kim, T.W., Lee, K.Y., Kim, J.: A new seam-tracking algorithm through characteristic-point detection for a portable welding robot. Robot. Comput. Integr. Manuf. 28(1), 1–13 (2012)

    Article  Google Scholar 

  9. Nele, L., Sarno, E., Keshari, A.: An image acquisition system for real-time seam tracking. Int. J. Adv. Manuf. Technol. 69(9-12), 2099–2110 (2013)

    Article  Google Scholar 

  10. Li, H., Zhang, X., Zhu, B., Lu, Y., Wu, H.: Micro-motion detection of the 3-dof precision positioning stage based on iterative optimized template matching. Appl. Opt. 56(34), 9435–9443 (2017)

    Article  Google Scholar 

  11. Li, H., Zhang, X.-M., Zeng, L., Huang, Y.-J.: A monocular vision system for online pose measurement of a 3rrr planar parallel manipulator. J. Intell. Robot. Syst. 92(1), 3–17 (2018)

    Article  Google Scholar 

  12. Shah, H.N.M., Sulaiman, M., Shukor, A.Z., Kamis, Z., Rahman, A.A.: Butt welding joints recognition and location identification by using local thresholding. Robot. Comput. Integr. Manuf. 51, 181–188 (2018)

    Article  Google Scholar 

  13. Xu, Y., Fang, G., Chen, S., Zou, J.J., Ye, Z.: Real-time image processing for vision-based weld seam tracking in robotic gmaw. Int. J. Manuf. Technol. 73(9), 1413–1425 (2014)

    Article  Google Scholar 

  14. Gu, W.P., Xiong, Z.Y., Wan, W.: Autonomous seam acquisition and tracking system for multi-pass welding based on vision sensor. Int. J. Adv. Manuf. Technol. 69(1-4), 451–460 (2013)

    Article  Google Scholar 

  15. Muhammad, J., Altun, H., Abo-Serie, E.: Welding seam profiling techniques based on active vision sensing for intelligent robotic welding. Int. J. Adv. Manuf. Technol., 1–19 (2016)

  16. Ding, Y., Huang, W., Kovacevic, R.: An on-line shape-matching weld seam tracking system. Robot. Integr. Manuf. 42, 103–112 (2016)

    Article  Google Scholar 

  17. He, Y., Chen, Y., Xu, Y., Huang, Y., Chen, S.: Autonomous detection of weld seam profiles via a model of saliency-based visual attention for robotic arc welding. J. Intell. Robot. Syst. 81(3-4), 395–406 (2016)

    Article  Google Scholar 

  18. Guo, J., Zhu, Z., Sun, B., Yu, Y.: Principle of an innovative visual sensor based on combined laser structured lights and its experimental verification. Opt. Laser Technol. 111, 35–44 (2019)

    Article  Google Scholar 

  19. Xue, B., Chang, B., Peng, G., Gao, Y., Tian, Z., Du, D., Wang, G.: A vision based detection method for narrow butt joints and a robotic seam tracking system. Sensors 19(5), 1144 (2019)

    Article  Google Scholar 

  20. Huang, W., Kovacevic, R.: Development of a real-time laser-based machine vision system to monitor and control welding processes. Int. J. Adv. Manuf. Technol. 63(1-4), 235–248 (2012)

    Article  Google Scholar 

  21. Nguyen, H.C., Lee, B.R.: Laser-vision-based quality inspection system for small-bead laser welding. Int. J. Precis. Eng. Manuf. 15(3), 415–423 (2014)

    Article  Google Scholar 

  22. Ye, G., Guo, J., Sun, Z., Li, C., Zhong, S.: Weld bead recognition using laser vision with model-based classification. Robot. Comput. Integr. Manuf. 52, 9–16 (2018)

    Article  Google Scholar 

  23. Aliev, R.: Sensor integration for robotic laser welding processes. J. Mater. Eng. Perform. 19(4), 553–557 (2017)

    Google Scholar 

  24. Xu, P., Xu, G., Tang, X., Yao, S.: A visual seam tracking system for robotic arc welding. Int. J. Adv. Manuf. Technol. 37(1-2), 70–75 (2008)

    Article  Google Scholar 

  25. Zhang, L., Ye, Q., Yang, W., Jiao, J.: Weld line detection and tracking via spatial-temporal cascaded hidden markov models and cross structured light. IEEE Trans. Instrum. Meas. 63(4), 742–753 (2014)

    Article  Google Scholar 

  26. Xiao, Z.: Research on a trilines laser vision sensor for seam tracking in welding. Lect. Notes Electr. Eng. 88, 139–144 (2011)

    Article  Google Scholar 

  27. Shao, W.J., Huang, Y., Zhang, Y.: A novel weld seam detection method for space weld seam of narrow butt joint in laser welding. Opt. Laser Technol. 99, 39–51 (2018)

    Article  Google Scholar 

  28. Besl, P.J., McKay, N.D.: A method for registration of 3-d shapes. IEEE Trans. Pattern Anal. Mach. Intell. 14(2), 239–256 (1992)

    Article  Google Scholar 

  29. Xie, Z., Zhang, C., Zhang, Q.: A simplified method for the extrinsic calibration of structured-light sensors using a single-ball target. Int. J. Mach. Tools Manuf. 44(11), 1197–1203 (2004)

    Article  Google Scholar 

  30. Al-Isawi, M.M.A., Sasiadek, J.Z.: Guidance and control of a robot capturing an uncooperative space target. J. Intell. Robot. Syst. 93(3), 713–721 (2019)

    Article  Google Scholar 

  31. Sobreira, H., Costa, C.M., Sousa, I., Rocha, L., Lima, J., Farias, P.C.M.A., Costa, P., Moreira, A.P.: Map-matching algorithms for robot self-localization: A comparison between perfect match, iterative closest point and normal distributions transform. J. Intell. Robot. Syst. 93(3), 533–546 (2019)

    Article  Google Scholar 

  32. Ferreira, L.A., Figueira, Y.L., Iglesias, I.F., Souto, M.A.: Offline cad-based robot programming and welding parametrization of a flexible and adaptive robotic cell using enriched cad/cam system for shipbuilding. Procedia Manuf. 11, 215–223 (2017)

    Article  Google Scholar 

  33. Neto, P., Mendes, N.: Direct off-line robot programming via a common cad package. Robot. Auton. Syst. 61(8), 896–910 (2013)

    Article  Google Scholar 

  34. Pan, Z., Polden, J., Larkin, N., Duin, S.V., Norrish, J.: Recent progress on programming methods for industrial robots. In: ISR 2010 (41st International Symposium on Robotics) and ROBOTIK 2010 (6th German Conference on Robotics), pp. 1–8 (2010)

Download references

Acknowledgements

This work is supported by National Natural Science Foundation of China (Grant Nos. U1713207, 51575187), Science and Technology Planning Project of Guangdong Province (2017A010102005), the Fundamental Research Funds for the Central University and Natural Science Foundation of Guangdong Province (S2013030013355).

Author information

Authors and Affiliations

  1. Guangdong Key Laboratory of Precision Equipment and Manufacturing Technology, School of Mechanical and Automotive Engineering, South China University of Technology, Guangzhou, 510640, People’s Republic of China

    Nianfeng Wang, Xiaodong Shi, Kaifan Zhong & Xianmin Zhang

  2. Shenzhen Polytechnic, Shenzhen, 518055, People’s Republic of China

    Wei Chen

Authors
  1. Nianfeng Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xiaodong Shi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kaifan Zhong
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Xianmin Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Wei Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Nianfeng Wang or Wei Chen.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, N., Shi, X., Zhong, K. et al. A Path Correction Method Based on Global and Local Matching for Robotic Autonomous Systems. J Intell Robot Syst 104, 7 (2022). https://doi.org/10.1007/s10846-021-01537-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10846-021-01537-5

Keywords

Search

Navigation