Abstract
Relative pose estimation has become a fundamental and important problem in visual simultaneous localization and mapping. This paper statistically optimizes the solution for the homography-based relative pose estimation problem. Assuming a known gravity direction and a dominant ground plane, the homography representation in the normalized image plane enables a least squares pose estimation between two views. Furthermore, an iterative estimation method of the camera trajectory is developed for visual odometry. The accuracy and robustness of the proposed algorithm are experimentally tested on synthetic and real data in indoor and outdoor environments. Various metrics confirm the effectiveness of the proposed method in practical applications.
Similar content being viewed by others
References
Mur-Artal R, Montiel J M M, Tardos J D. ORB-SLAM: a versatile and accurate monocular SLAM system. IEEE Trans Robot, 2015, 31: 1147–1163
Qu Y H, Zhang F, Wu X W, et al. Cooperative geometric localization for a ground target based on the relative distances by multiple UAVs. Sci China Inf Sci, 2019, 62: 010204
Liu S H, Wang S Q, Shi W H, et al. Vehicle tracking by detection in UAV aerial video. Sci China Inf Sci, 2019, 62: 024101
Nister D. An efficient solution to the five-point relative pose problem. IEEE Trans Pattern Anal Machine Intell, 2004, 26: 756–770
Kneip L, Siegwart R, Pollefeys M. Finding the exact rotation between two images independently of the translation. In: Proceedings of the European Conference on Computer Vision, 2012. 696–709
Hartley R, Zisserman A. Multiple View Geometry in Computer Vision. Cambridge: Cambridge University Press, 2003
Hartley R. In defense of the eight-point algorithm. IEEE Trans Pattern Anal Mach Intell, 1997, 19: 580–593
Li H, Hartley R, Kim J H. A linear approach to motion estimation using generalized camera models. In: Proceedings of the International Conference on Computer Vision and Pattern Recognition, 2008. 1–8
Kneip L, Lynen S. Direct optimization of frame-to-frame rotation. In: Proceedings of the International Conference on Computer Vision, 2013. 2352–2359
Fischler M A, Bolles R C. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun ACM, 1981, 24: 381–395
Kneip L, Furgale P. OpenGV: a unified and generalized approach to real-time calibrated geometric vision. In: Proceedings of the International Conference on Robotics and Automation, 2014. 1–8
Zhang S J, Cao X B, Zhang F, et al. Monocular vision-based iterative pose estimation algorithm from corresponding feature points. Sci China Inf Sci, 2010, 53: 1682–1696
Fraundorfer F, Tanskanen P, Pollefeys M. A minimal case solution to the calibrated relative pose problem for the case of two known orientation angles. In: Proceedings of the European Conference on Computer Vision, 2010. 269–282
Kalantari M, Hashemi A, Jung F, et al. A new solution to the relative orientation problem using only 3 points and the vertical direction. J Math Imag Vis, 2011, 39: 259–268
Lee G H, Pollefeys M, Fraundorfer F. Relative pose estimation for a multi-camera system with known vertical direction. In: Proceedings of the International Conference on Computer Vision and Pattern Recognition, 2014. 540–547
Naroditsky O, Zhou X S, Gallier J, et al. Two efficient solutions for visual odometry using directional correspondence. IEEE Trans Pattern Anal Mach Intell, 2012, 34: 818–824
Horn B K P, Hilden H M, Negahdaripour S. Closed-form solution of absolute orientation using orthonormal matrices. J Opt Soc Am A, 1988, 5: 1127–1135
Li H, Duan H B. Verification of monocular and binocular pose estimation algorithms in vision-based UAVs autonomous aerial refueling system. Sci China Technol Sci, 2016, 59: 1730–1738
Kneip L, Chli M, Siegwart R Y. Robust real-time visual odometry with a single camera and an IMU. In: Proceedings of the British Machine Vision Conference, 2011. 1–11
Bazin J, Li H D, Kweon I S, et al. A branch-and-bound approach to correspondence and grouping problems. IEEE Trans Pattern Anal Mach Intell, 2013, 35: 1565–1576
Guan B, Vasseur P, Demonceaux C, et al. Visual odometry using a homography formulation with decoupled rotation and translation estimation using minimal solutions. In: Proceedings of the International Conference on Robotics and Automation, 2018. 2320–2327
Saurer O, Vasseur P, Boutteau R, et al. Homography based egomotion estimation with a common direction. IEEE Trans Pattern Anal Mach Intell, 2017, 39: 327–341
Saurer O, Fraundorfer F, Pollefeys M. Homography based visual odometry with known vertical direction and weak Manhattan world assumption. In: Proceedings of IROS Workshop on Visual Control of Mobile Robots (ViCoMoR 2012), Vilamoura, 2012. 25–30
Urban S, Leitloff J, Hinz S. MLPNP-a real-time maximum likelihood solution to the perspective-n-point problem. ISPRS Ann Photogramm Remote Sens Spatial Inf Sci, 2016, 3: 131–138
Conrad D, Desouza G N. Homography-based ground plane detection for mobile robot navigation using a modified EM algorithm. In: Proceedings of the International Conference on Robotics and Automation, 2010. 910–950
Faessler M, Fontana F, Forster C, et al. Autonomous, vision-based flight and live dense 3D mapping with a quadrotor micro aerial vehicle. J Field Robotics, 2016, 33: 431–450
Lowe D G. Distinctive image features from scale-invariant keypoints. Int J Comput Vision, 2004, 60: 91–110
Zhao C, Fan B, Tian L, et al. Statistical optimization feature matching algorithm based on epipolar geometry (in Chinese). Acta Aeronautica et Astronaut Sin, 2018, 39: 158–166
Sturm J, Engelhard N, Endres F, et al. A benchmark for the evaluation of RGB-D SLAM slam systems. In: Proceedings of the International Conference on Intelligent Robots and Systems, 2012. 573–580
Huang A S, Bachrach A, Henry P, et al. Visual odometry and mapping for autonomous flight using an RGB-D camera. In: Proceedings of the International Conference on Robotics Research, 2017. 235–252
Acknowledgements
This work was partially supported by National Natural Science Foundation of China (Grant Nos. 61603303, 61803309, 61703343), Natural Science Foundation of Shaanxi Province (Grant No. 2018JQ6070), China Postdoctoral Science Foundation (Grant No. 2018M633574), and Fundamental Research Funds for the Central Universities (Grant Nos. 3102019ZDHKY02, 3102018JCC003).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zhao, C., Fan, B., Hu, J. et al. Homography-based camera pose estimation with known gravity direction for UAV navigation. Sci. China Inf. Sci. 64, 112204 (2021). https://doi.org/10.1007/s11432-019-2690-0
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s11432-019-2690-0