Skip to main content

Recovering Scale in Monocular DSO Using Multi-sensor Data

  • Conference paper
  • First Online:
Advances in Swarm Intelligence (ICSI 2019)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 11656))

Included in the following conference series:

  • 853 Accesses

Abstract

Monocular visual odometry like DSO (Direct Sparse Odometry) or visual SLAM can be used for UAV navigation. But the scale of DSO is set more or less arbitrarily during its initialization, because the absolute scale is unobservable by using a single-camera. Therefore, the map reconstructed by DSO and the pose estimated by DSO can’t be used directly. In order to recover the scale, firstly, we use IMU, GPS and ultrasonic data and Kalman filter algorithm to calculate the position and pose of UAV. Particularly, we improve the Kalman filtering algorithm instead of using the original algorithm. After the calculation, we get the position and pose of UAV with real scale, and then estimate the proportion between DSO’s scale and real scale by least square method. Finally, using this proportion to correct the scale of point cloud, we can get the point cloud map with real scale which can be used for UAV navigation in the future work.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 79.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Liu, H.M., Zhang, G.F., Bao, H.J.: A survey of monocular simultaneous localization and mapping. J. Comput.-Aided Des. Comput. Graph. 29(6), 855–868 (2016)

    Google Scholar 

  2. Wang, R., Schwörer, M., Cremers, D.: Stereo DSO: large-scale direct sparse visual odometry with stereo cameras. In: International Conference on Computer Vision (ICCV) (2017)

    Google Scholar 

  3. Qin, T., Li, P.L., Yang, Z.F., Shen, S.J.: VINS-Mono: a robust and versatile monocular visual-inertial state estimator. IEEE Trans. Rob. 34(4), 1004–1020 (2018)

    Article  Google Scholar 

  4. Qin, T., Shen, S.J.: Online temporal calibration for monocular visual-inertial systems. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2018) (2018)

    Google Scholar 

  5. Scaramuzza, D., Fraundorfer, F., Pollefeys, M., Siegwart, R.: Absolute scale in structure from motion from a single vehicle mounted camera by exploiting nonholonomic constraints. In: Proceedings of the 12th IEEE International Conference on Computer Vision, pp. 1413–1419 (2009)

    Google Scholar 

  6. Kitt, B., Geiger, A., Lategahn, H.: Visual odometry based on stereo image sequences with RANSAC-based outlier rejection scheme. In: Proceedings of the Intelligent Vehicles Symposium III, pp. 486–492 (2010)

    Google Scholar 

  7. Geiger, A., Ziegler, J., Stiller, C.: StereoScan: dense 3D reconstruction in real-time. In: Proceedings of the IEEE Intelligent Vehicles Symposium IV, pp. 963–968 (2011)

    Google Scholar 

  8. von Stumberg, L., Usenko, V., Cremers, D.: Direct sparse visual-inertial odometry using dynamic marginalization. In: International Conference on Robotics and Automation (ICRA) (2018)

    Google Scholar 

  9. Engel, J., Koltun, V., Cremers, D.: Direct sparse odometry. IEEE Trans. Pattern Anal. Mach. Intell. 40(3), 611–625 (2018)

    Article  Google Scholar 

  10. Gao, X., Zhang, T., Liu, Y., Yan, Q.R.: 14 Lectures of Visual SLAM: From Theory to Practice. Publishing House of Electronics Industry, Beijing (2017)

    Google Scholar 

  11. Engel, J., Usenko, V., Cremers, D.: A photometrically calibrated benchmark for monocular visual odometry (2016)

    Google Scholar 

  12. Zhe, X.: Design and implementation of four-rotor UAV control system. Nanjing University of Technology (2017)

    Google Scholar 

  13. Boxin, Z.: Research on the UAV localization based on the low-cost and micro sensors. National University of Defense Technology (2016)

    Google Scholar 

  14. Pan, Z.: Motion estimation of four-rotor vehicle based on multi-sensor fusion. China University of Science and Technology (2014)

    Google Scholar 

  15. Zhang, X.: Research on attitude and navigation information fusion algorithms for multi-rotor UAV. University of Chinese Academy of Sciences (2015)

    Google Scholar 

  16. Chende, F., Qinyun, L.: Design and implementation of integrated navigation scheme based on MEMS-IMU/GPS/GPRS. Sig. Process Syst. 22(5), 24–28 (2016)

    Google Scholar 

  17. Chi, X.W.: Research on MES-IMU/GPS integrated attitude measurement system for miniature UAV. Harbin Engineering University (2016)

    Google Scholar 

  18. Zhong, L.Q.: Conversion method and accuracy analysis of WGS-84 coordinate system to local coordinate system. Urban Reconnaissance, pp. 109–111 (2016)

    Google Scholar 

Download references

Acknowledgment

This work was supported in part by the National Natural Science Foundation of China (61433004, 61703289).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jianru Huo .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Fang, S., Luo, Y., Huo, J., Zeng, Y., Song, Z. (2019). Recovering Scale in Monocular DSO Using Multi-sensor Data. In: Tan, Y., Shi, Y., Niu, B. (eds) Advances in Swarm Intelligence. ICSI 2019. Lecture Notes in Computer Science(), vol 11656. Springer, Cham. https://doi.org/10.1007/978-3-030-26354-6_36

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-26354-6_36

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-26353-9

  • Online ISBN: 978-3-030-26354-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics