Skip to main content
Log in

Method for visual localization of oil and gas wellhead based on distance function of projected features

  • Research Article
  • Published:
International Journal of Automation and Computing Aims and scope Submit manuscript

Abstract

A localization method based on distance function of projected features is presented to solve the accuracy reduction or failure problem due to occlusion and blurring caused by smog, when dealing with vision based localization for target oil and gas wellhead (OGWH). Firstly, the target OGWH is modeled as a cylinder with marker, and a vector with redundant parameter is used to describe its pose. Secondly, the explicit mapping relationship between the pose vector with redundant parameter and projected features is derived. Then, a 2D-point-to-feature distance function is proposed, as well as its derivative. Finally, based on this distance function and its derivative, an algorithm is proposed to estimate the pose of target OGWH directly according to the 2D image information, and the validity of the method is verified by both synthetic data and real image experiments. The results show that this method is able to accomplish the localization in the case of occlusion and blurring, and its anti-noise ability is good especially with noise ratio of less than 70%.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. J. H. Su, H. Qiao, Z. C. Ou, Z. Y. Liu. Vision-based caging grasps of polyhedron-like workpieces with a binary industrial gripper. IEEE Transactions on Automation Science and Engineering, vol. 12, no. 3, pp. 1033–1046, 2015.

    Article  Google Scholar 

  2. F. Zhou, W. Zheng, Z. F. Wang. Adaptive noise identification in vision-assisted motion estimation for unmanned aerial vehicles. International Journal of Automation and Computing, vol. 12, no. 4, pp. 413–420, 2015.

    Article  Google Scholar 

  3. C. L. Wang, T. M. Wang, J. H. Liang, Y. C. Zhang, Y. Zhou. Bearing-only visual SLAM for small unmanned aerial vehicles in GPS-denied environments. International Journal of Automation and Computing, vol. 10, no. 5, pp. 387–396, 2013.

    Article  Google Scholar 

  4. L. Wang, J. F. Cao, C. Z. Han. Superquadrics modelbased 3D object localization algorithm. Robot, vol. 35, no. 4, pp. 439–448, 2013. (in Chinese)

    Article  Google Scholar 

  5. M. Y. Liu, O. Tuzel, A. Veeraraghavan, Y. Taguchi, T. K. Marks, R. Chellappa. Fast object localization and pose estimation in heavy clutter for robotic bin picking. The International Journal of Robotics Research, vol. 31, no. 8, pp. 951–973, 2012.

    Article  Google Scholar 

  6. R. Safaee-Rad, I. Tchoukanov, K. C. Smith, B. Benhabib. Three-dimensional location estimation of circular features for machine vision. IEEE Transactions on Robotics and Automation, vol. 8, no. 5, pp. 624–640, 1992.

    Article  Google Scholar 

  7. Z. Chen, J. B. Huang. A vision-based method for the circle pose determination with a direct geometric interpretation. IEEE Transactions on Robotics and Automation, vol. 15, no. 6, pp. 1135–1140, 1999.

    Article  Google Scholar 

  8. W. F. Xu, Q. Xue, H. D. Liu, X. D. Du, B. Liang. A pose measurement method of a non-cooperative GEO spacecraft based on stereo vision. In Proceedings of the 12th International Conference on Control Automation Robotics & Vision, IEEE, Guangzhou, China, pp. 966–971, 2012.

    Google Scholar 

  9. Z. Z. Wei, G. J. Zhang. Distortion error model of image of ellipse center in 3D visual inspection. Journal of Beijing University of Aeronautics and Astronautics, vol. 29, no. 2, pp. 140–143, 2003. (in Chinese)

    MathSciNet  Google Scholar 

  10. Y. C. Shiu, C. Huang. Pose determination of circular cylinders using elliptical and side projections. In Proceedings of IEEE International Conference on Systems Engineering, IEEE, Dayton, USA, pp. 265–268, 1991.

    Google Scholar 

  11. C. Doignon, M. de Mathelin. A degenerate conic-based method for a direct fitting and 3D pose of cylinders with a single perspective view. In Proceedings of International Conference on Robotics and Automation, IEEE, Roma, Italy, pp. 4220–4225, 2007.

    Google Scholar 

  12. Z. X. Wang, Z. Q. Wu, X. J. Zhen, R. D. Yang, J. T. Xi. Iteration-based direct ellipse-specific algebraic fitting method of incomplete spots for onsite threedimensional measurement. Optical Engineering, vol. 54, no. 1, pp. 013109, 2015.

    Article  Google Scholar 

  13. S. P. Fu, J. B. Zhao, R. B. Xia, W. J. Liu. Annular mirror based extrinsic camera automatic calibration. Robot, vol. 37, no. 3, pp. 277–285, 2015.

    Google Scholar 

  14. C. Liu, W. D. Hu. Relative pose estimation for cylindershaped spacecrafts using single image. IEEE Transactions on Aerospace and Electronic Systems, vol. 50, no. 4, pp. 3036–3056, 2014.

    Article  Google Scholar 

  15. L. M. Zhu, Z. H. Xiong, H. Ding, Y. L. Xiong. A distance function based approach for localization and profile error evaluation of complex surface. Journal of Manufacturing Science and Engineering, vol. 126, no. 3, pp. 542–554, 2004.

    Article  Google Scholar 

  16. R. Hartley, A. Zisserman. Multiple View Geometry in Computer Vision, Cambridge, UK: Cambridge University Press, pp. 322, 2003.

    MATH  Google Scholar 

  17. F. Bergamasco, L. Cosmo, A. Albarelli, A. Torsello. A robust multi-camera 3D ellipse fitting for contactless measurements. In Proceedings of the 2nd International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission, IEEE, Zurich, Switzerland, pp. 168–175, 2012.

    Google Scholar 

  18. G. Taubin. Estimation of planar curves, surfaces, and nonplanar space curves defined by implicit equations with applications to edge and range image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 13, no. 11, pp. 1115–1138, 1991.

    Article  Google Scholar 

  19. D. W. Marquardt. An algorithm for least-squares estimation of nonlinear parameters. Journal of the Society for Industrial and Applied Mathematics, vol. 11, no. 2, pp. 431–441, 1963.

    Article  MathSciNet  MATH  Google Scholar 

  20. M. A. Fischler, R. C. Bolles. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM, vol. 24, no. 6, pp. 381–395, 1981.

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgement

The authors would like to thank Gang Rao and Dan Huang of Tsinghua University for their help in the real image experiment.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xiang-Dong Yang.

Additional information

This work was supported by National Natural Science Foundation of China (No. 61403226), and the State Key Laboratory of Tribology of China (No. SKLT09A03).

Recommended by Associate Editor De Xu

Ying Xie received the B. Sc. degree in mechanical engineering from Shanghai Jiao Tong University, China in 2010. He is currently a Ph. D. degree candidate in the Department of Mechanical Engineering, Tsinghua University, China.

His research interests include robot vision, robot localization, and robot calibration.

ORCID iD: 0000-0002-2812-9311

Xiang-Dong Yang received the B. Sc., M. Sc. and Ph.D. degree degrees in mechanical engineering from Tsinghua University, China in 1989, 1990 and 1995, respectively. Currently, he is an associate professor in the Department of Mechanical Engineering at Tsinghua University, China. He is a senior member of Chinese Mechanical Engineering Society (CMES).

His research interests include robotics and automatic control system.

ORCID iD: 0000-0002-9976-8591

Zhi Liu received the B. Sc. degree in mechanical engineering from Central South University, China in 2010. He is currently a Ph.D. degree candidate in mechanical engineering of Department of Mechanical Engineering, Tsinghua University, China.

His research interests include robot assembly, robot control, and robot vision.

Shu-Nan Ren received the B. Sc. degree in mechanical engineering from Harbin Institute of Technology, China in 2011. He is currently a Ph. D. degree candidate in mechanical engineering of Department of Mechanical Engineering, Tsinghua University, China.

His research interests include robot painting, robot control and planning.

Ken Chen received the B. Sc. degree in mechanical engineering from Sichuan University, China in 1981, the M. Sc. and Ph.D. degrees in mechanical engineering from Zhejiang University, China in 1984 and 1987, respectively. Currently, he is a professor in the Department of Mechanical Engineering at Tsinghua University, China. He has published over 200 journal and conference papers. He is a member of ASME and IEEE, senior member of Chinese Mechanical Engineering Society (CMES), and member of Life-electronic Sciences Committee and National Mechanical Higher education Direction Committee.

His research interests include robotics and bionics, special manipulating and mobile robots, humanoid robots and bio-robots, integration and automation for mechatronic system.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xie, Y., Yang, XD., Liu, Z. et al. Method for visual localization of oil and gas wellhead based on distance function of projected features. Int. J. Autom. Comput. 14, 147–158 (2017). https://doi.org/10.1007/s11633-017-1063-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11633-017-1063-1

Keywords

Navigation