Skip to main content
Log in

Vision navigation for aircrafts based on 3D reconstruction from real-time image sequences

  • Article
  • Published:
Science China Technological Sciences Aims and scope Submit manuscript

Abstract

In this paper, we propose a novel vision navigation method based on three-dimensional (3D) reconstruction from real-time image sequences. It adapts 3D reconstruction and terrain matching to establish the correspondence between image points and 3D space points and the terrain reference (by using a digital elevation map (DEM)). An adaptive weighted orthogonal iterative pose estimation method is employed to calculate the position and attitude angle of the aircraft. Synthesized and real experiments show that the proposed method is capable of providing accurate navigation parameters for a long-endurance flight without using a global positioning system or an inertial navigation system (INS). Moreover, it can be combined with an INS to achieve an improved navigation result.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Wang J L, Garratt M, Lambert A, et a1. Intergration of GPS/NS/VISION sensors to navigate unmanned aerial vehicles. In: The International Archives of the Photogrammetry Remote Sensing and Spatial Information Sciences, 2008. 963–969

    Google Scholar 

  2. Stevens M R, Snorrason M, Eaton R, et a1. Motion imagery navigation using terrain estimates. In: Proceedings of the 17th International Conference on Pattern Recognition, Cambridge. 2004, 1: 272–275

    Google Scholar 

  3. Sim D G, Park R H, Kim R C, et al. Integrated position estimation using aerial image sequences. IEEE T Pattern Anal, 2002, 24: 1–18

    Article  Google Scholar 

  4. Sim D G, Park R H. Localization based on DEM matching using multiple aerial image pairs. IEEE T Image Process, 2002, 11: 52–56

    Article  Google Scholar 

  5. Golden J P. Terrain contour matching (TERCOM): A cruise missile guidance aid. Image Process Missile Guid, 1980, 238: 10–18

    Article  Google Scholar 

  6. Behzad K P, Behrooz K P. Vehicle localization on gravity maps. In: Proceedings of SPIE-The International Society for Optical Engineering, Orlando, Florida, 1999. 3693: 182–191

    Google Scholar 

  7. Rodriguez, J J, Aggarwal J K. Matching aerial images to 3-D terrain maps. IEEE T Pattern Anal, 1990, 12: 1138–1149

    Article  Google Scholar 

  8. Li L C, Yu Q F, Shang Y et al. A new navigation approach of terrain contour matching based on 3-D terrain reconstruction from onboard image sequence. Sci China Tech Sci, 2010, 53: 1176–1183

    Article  Google Scholar 

  9. Li L C, Yuan Y, Gui Y, et al, Scale Invariant terrain matching based on oriented terrain-surface feature. Comput Eng Appl, 2010, 46: 236–239

    Google Scholar 

  10. Li L C, Yuan Y, Li Y, et al, Invariant feature vector description for 3D terrain and its application to terrain contour matching. Acta Aeronaut Astronaut Sinca, 2009, 30: 2143–2148

    Google Scholar 

  11. Lerner R, Rivlin E, Rotstein H P. Pose and motion recovery from feature correspondences and a digital terrain map. IEEE T Pattern Anal, 2006, 28: 1404–1417

    Article  Google Scholar 

  12. Lerner R, Rivlin E, Rotstein P H. Pose estimation using feature correspondences and DTM. In: Image Processing International Conference on Image Processing, Singapore, 2004. 2603–2606

    Google Scholar 

  13. Lerner R, Rivlin E. Direct method for video-based navigation using a digital terrain map. IEEE T Pattern Anal, 2011, 33: 406–411

    Article  Google Scholar 

  14. Matas J, Chum O, Urban M, et al. Robust wide-baseline stereo from maximally stable extremal regions. Image Vision Comput, 2004, 22: 761–767

    Article  Google Scholar 

  15. Lu C P, Hager G D, Mjolsness E. Fast and globally convergent pose estimation from video images. IEEE T Pattern Anal, 2000, 22: 610–622

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to ZunShang Zhu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhu, Z., Su, A., Liu, H. et al. Vision navigation for aircrafts based on 3D reconstruction from real-time image sequences. Sci. China Technol. Sci. 58, 1196–1208 (2015). https://doi.org/10.1007/s11431-015-5828-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11431-015-5828-x

Keywords

Navigation