Skip to main content
SpringerLink
Log in

Fast 6D object pose estimation of shell parts for robotic assembly

  • ORIGINAL ARTICLE
  • Published:
The International Journal of Advanced Manufacturing Technology Aims and scope Submit manuscript

Abstract

Shell parts which have symmetric structure, even surface and flat color are common in industrial manufacturing applications. Moreover, the inner and outer surface of them are of similar shape and close to each other. These features make the pose estimation process of the shell parts challenging. Aiming at 6D pose error compensation of parts in high-precision robotic assembly tasks, this work proposes a fast 6D pose estimation method tailored for the shell parts. With a binocular structured light camera to acquire the point cloud data, the proposed method consists of two phases, namely the initial pose estimation phase and local pose estimation phase. In the former phase, principle component analysis algorithm is utilized to calculate a primary pose estimation. An initial pose correction and translation offset methods serve to solve the local optimal estimation problem of the iterative closest point (ICP) algorithm. In the latter phase, the voxel sampling and a novel weighted point-to-plane ICP algorithms are applied to boost the efficiency of the pose estimation method. With two typical shell parts, a simulation and an experiment of pose estimation are conducted to validate the effectiveness of the proposed method. Experiment results prove that both the accuracy and efficiency of the pose estimation method meet the requirement of the given assembly tasks.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19

Similar content being viewed by others

References

  1. Bazin JC, Seo Y, Pollefeys M (2012) Globally optimal consensus set maximization through rotation search. In: Asian conference on computer vision. Springer, pp 539–551

  2. Besl PJ, Mckay HD (1992) A method for registration of 3-d shapes. IEEE Trans Pattern Anal Mach Intell 14(2):239–256

    Article  Google Scholar 

  3. Chang WC (2018) Robotic assembly of smartphone back shells with eye-in-hand visual servoing. Robot Comput Integr Manuf 50:102–113

    Article  Google Scholar 

  4. Cohen Y, Naseraldin H, Chaudhuri A, Pilati F (2019) Assembly systems in industry 4.0 era: a road map to understand assembly 4.0. Int J Adv Manuf Technol 105(9):4037–4054

    Article  Google Scholar 

  5. Cong Y, Tian D, Feng Y, Fan B, Yu H (2018) Speedup 3-d texture-less object recognition against self-occlusion for intelligent manufacturing. IEEE Trans Cybern 49(11):3887–3897

    Article  Google Scholar 

  6. Dong D, Yang X, Hu H, Lou Y (2019) Pose estimation of components in 3c products based on point cloud registration. In: IEEE international conference on robotics and biomimetics, pp 339–344

  7. Gu W, Yang X, Dong D, Lou Y (2020) Pose ambiguity elimination algorithm for 3c components assembly pose estimation in point cloud. In: Chinese intelligent systems conference. Springer, pp 251–260

  8. Hinterstoisser S, Cagniart C, Ilic S, Sturm P, Navab N, Fua P, Lepetit V (2011) Gradient response maps for real-time detection of textureless objects. IEEE Trans Pattern Anal Mach Intell 34 (5):876–888

    Article  Google Scholar 

  9. Hinterstoisser S, Lepetit V, Ilic S, Holzer S, Bradski G, Konolige K, Navab N (2012) Model based training, detection and pose estimation of texture-less 3d objects in heavily cluttered scenes. In: Asian conference on computer vision. Springer, pp 548–562

  10. Li CHG, Chang YM (2019) Automated visual positioning and precision placement of a workpiece using deep learning. Int J Adv Manuf Technol 104(9):4527–4538

    Article  Google Scholar 

  11. Li W, Song P (2015) A modified ICP algorithm based on dynamic adjustment factor for registration of point cloud and cad model. Pattern Recogn Lett 65:88–94

    Article  Google Scholar 

  12. Lin C, Tsai C, Lai Y, Li S, Wong C (2018) Visual object recognition and pose estimation based on a deep semantic segmentation network. IEEE Sensors J 18(22):9370–9381

    Article  Google Scholar 

  13. Lin HY, Liang SC, Chen YK (2020) Robotic grasping with multi-view image acquisition and model-based pose estimation. IEEE Sensors J :1–1

  14. Low KL (2004) Linear least-squares optimization for point-to-plane icp surface registration. Chapel Hill Univ N C 4(10):1–3

    Google Scholar 

  15. Lyu C, Li P, Wang D, Yang S, Lai Y, Congying S (2020) High-speed optical 3d measurement sensor for industrial application. IEEE Sensors J :1–1

  16. Ma Y, Liu X, Zhang J, Xu D, Zhang D, Wu W (2020) Robotic grasping and alignment for small size components assembly based on visual servoing. Int J Adv Manuf Technol 106(11):4827–4843

    Article  Google Scholar 

  17. Murphy KP (2012) Machine learning: a probabilistic perspective. MIT Press, Cambridge

    MATH  Google Scholar 

  18. Nuchter A, Lingemann K, Hertzberg J (2007) Cached kd tree search for ICP algorithms. In: Sixth international conference on 3-D digital imaging and modeling (3DIM 2007). IEEE, pp 419–426

  19. Ravishankar S, Dutt H, Gurumoorthy B (2010) Automated inspection of aircraft parts using a modified ICP algorithm. Int J Adv Manuf Technol 46(1-4):227–236

    Article  Google Scholar 

  20. Rusinkiewicz S (2019) A symmetric objective function for ICP. ACM Trans Graph (TOG) 38 (4):1–7

    Article  Google Scholar 

  21. Rusinkiewicz S, Levoy M (2001) Efficient variants of the ICP algorithm. In: Proceedings third international conference on 3-D digital imaging and modeling. IEEE, pp 145–152

  22. Rusu RB, Blodow N, Beetz M (2009) Fast point feature histograms (fpfh) for 3d registration. In: 2009 IEEE international conference on robotics and automation. IEEE, pp 3212– 3217

  23. Sahin C, Kouskouridas R, Kim TK (2016) Iterative hough forest with histogram of control points for 6 dof object registration from depth images. In: 2016 IEEE/RSJ international conference on intelligent robots and systems (IROS). IEEE, pp 4113– 4118

  24. Segal A, Haehnel D, Thrun S (2009) Generalized-icp. In: Robotics: science and systems, vol 2, Seattle, WA, p 435

  25. Serafin J, Grisetti G (2015) Nicp: Dense normal based point cloud registration. In: 2015 IEEE/RSJ international conference on intelligent robots and systems (IROS). IEEE, pp 742–749

  26. Song HC, Kim YL, Song JB (2014) Automated guidance of peg-in-hole assembly tasks for complex-shaped parts. In: 2014 IEEE/RSJ international conference on intelligent robots and systems. IEEE, pp 4517–4522

  27. Wang Y, Zhang S, Wan B, He W, Bai X (2018) Point cloud and visual feature-based tracking method for an augmented reality-aided mechanical assembly system. Int J Adv Manuf Technol 99 (9-12):2341–2352

    Article  Google Scholar 

  28. Wang Z, Fan J, Jing F, Liu Z, Tan M (2019) A pose estimation system based on deep neural network and ICP registration for robotic spray painting application. Int J Adv Manuf Technol 104(1-4):285–299

    Article  Google Scholar 

  29. Wang Z, Xu Y, He Q, Fang Z, Xu G, Fu J (2020) Grasping pose estimation for scara robot based on deep learning of point cloud. Int J Adv Manuf Technol 108(4):1217–1231

    Article  Google Scholar 

  30. Wei L, Jiao Z (2008) Visual location system for placement machine based on machine vision. In: 2008 Fifth IEEE international symposium on embedded computing. IEEE, pp 141–146

  31. Yang J, Li H, Campbell D, Jia Y (2015) Go-icp: A globally optimal solution to 3d ICP point-set registration. IEEE Trans Pattern Anal Mach Intell 38(11):2241–2254

    Article  Google Scholar 

  32. Zhao Y, Ye X, Wang L, Yu X, Zhang H (2019) Research on pose point cloud matching error compensation method for confocal image assembly. In: Journal of physics: Conference series, vol 1303. IOP Publishing, p 012073

  33. Zhou QY, Park J, Koltun V (2016) Fast global registration. In: European conference on computer vision. Springer, pp 766–782

  34. Zinßer T, Schmidt J, Niemann H (2003) A refined icp algorithm for robust 3-d correspondence estimation. In: Proceedings 2003 international conference on image processing (Cat. No. 03CH37429), vol 2. IEEE, pp II–695

Download references

Funding

This work was supported by NSFC-Shenzhen Robotics Basic Research Center Program Grant U1713202.

Author information

Author notes

    Authors and Affiliations

    1. School of Mechanical Engineering and Automation, Harbin Institute of Technology Shenzhen, HIT Campus, University Town of Shenzhen, Nanshan, Shenzhen, China

      Haopeng Hu, Weikun Gu, Xiansheng Yang, Nan Zhang & Yunjiang Lou

    Authors
    1. Haopeng Hu
      View author publications

      You can also search for this author in PubMed Google Scholar

    2. Weikun Gu
      View author publications

      You can also search for this author in PubMed Google Scholar

    3. Xiansheng Yang
      View author publications

      You can also search for this author in PubMed Google Scholar

    4. Nan Zhang
      View author publications

      You can also search for this author in PubMed Google Scholar

    5. Yunjiang Lou
      View author publications

      You can also search for this author in PubMed Google Scholar

    Corresponding author

    Correspondence to Yunjiang Lou.

    Ethics declarations

    Ethics approval

    Not applicable

    Consent to participate

    We consent.

    Consent for publication

    We consent.

    Conflict of interest

    The authors declare no competing interests.

    Additional information

    Publisher’s note

    Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

    Author contribution

    Haopeng Hu and Weikun Gu contributed more to this work. Xiansheng Yang, Nan Zhang and Yunjiang Lou contributed less to this work.

    Haopeng Hu and Weikun Gu contributed equally to this work.

    Rights and permissions

    Reprints and permissions

    About this article

    Check for updates. Verify currency and authenticity via CrossMark

    Cite this article

    Hu, H., Gu, W., Yang, X. et al. Fast 6D object pose estimation of shell parts for robotic assembly. Int J Adv Manuf Technol 118, 1383–1396 (2022). https://doi.org/10.1007/s00170-021-07960-0

    Download citation

    • Received:

    • Accepted:

    • Published:

    • Issue Date:

    • DOI: https://doi.org/10.1007/s00170-021-07960-0

    Keywords

    Search

    Navigation