Skip to main content
Log in

Performance evaluation of mobile stereonet for real time navigation in autonomous mobile robots

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract 

This research focuses on the performance evaluation of mobile stereonet for real-time navigation in mobile robots. The use of mobile stereonet for depth estimation and path planning has become increasingly important in the field of robotics. The research is conducting by implementing the mobile stereonet algorithm for real time navigation on a Raspberry Pi 4 and integrating it with a stereo camera to capture live video frames. The objective of this research is to evaluate the effectiveness of mobile stereonet in navigating mobile robots in different real time environments. The study will include the development of a mobile stereonet-based depth estimation and path planning system and its evaluation through simulations and experiments. The performance of the system will be evaluated based on various metrics, such as accuracy, efficiency, and robustness. The results of this study will provide insights into the potential applications of mobile stereonet in the field of robotics and contribute to the development of better navigation system for mobile robots using stereo vision technology. Implemented real time map generation using mobile stereonet is available on Github.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20

Similar content being viewed by others

Data Availability

The data used to support the findings of this study is real time data collected on real time during experimentations.

References

  1. WangY, Lai Z, Huang G, Wang BH, Van Der Maaten L, Campbell M, Weinberger KQ (2019) Anytime stereo image depth estimation on mobile devices. In: 2019 International Conference on Robotics and Automation (ICRA) (pp. 5893–5900). IEEE

  2. Aнтoщyк CГ, Кoндpaтьєв CБ, Щepбaкoвa ГЮ, Гoдoвичeнкo MA (2022) Depth map generation for mobile navigation systems based on objects localization in images. Bicник cyчacниx iнфopмaцiйниx тexнoлoгiй 5(1):11–18

    Google Scholar 

  3. Xiang Y, Yang XQ, Yang WW, Miao WH (2020) Localization and Mapping Algorithm for the Indoor Mobile Robot Based on LIDAR. In: IOP Conference Series: Materials Science and Engineering. 831(1):012021. IOP Publishing

  4. Hamzah RA, Hamid AMA, Salim SIM (2010). The solution of stereo correspondence problem using block matching algorithm in stereo vision mobile robot. In: 2010 Second International Conference on Computer Research and Development pp. 733–737. IEEE

  5. Sanchez-Rodriguez JP, Aceves-Lopez A (2018) A survey on stereo vision-based autonomous navigation for multi-rotor MUAVs. Robotica 36(8):1225–1243

    Article  Google Scholar 

  6. Koschan A, Rodehorst V, Spiller K (1996) Color stereo vision using hierarchical block matching and active color illumination. In Proceedings of 13th International Conference on Pattern Recognition 1, 835–839. IEEE

  7. Tao T, Koo JC, Choi HR (2008) A fast block matching algorthim forstereo correspondence. In: 2008 IEEE Conference on Cybernetics and Intelligent Systems pp. 38–41. IEEE

  8. Konolige K, Agrawal M, Bolles RC, Cowan C, Fischler M, Gerkey B (2008). Outdoor mapping and navigation using stereo vision. In: Experimental robotics. Springer, Berlin, Heidelberg. 179–190

  9. Ramírez-Hernández LR, Rodríguez-Quinoñez JC, Castro-Toscano MJ, Hernández-Balbuena D, Flores-Fuentes W, Rascón-Carmona R, Sergiyenko O (2020) Improve three-dimensional point localization accuracy in stereo vision systems using a novel camera calibration method. Int J Adv Robot Syst 17(1):1729881419896717

    Article  Google Scholar 

  10. Juan-RouH, Zhan-Qing W (2020). The Implementation of IMU/Stereo Vision SLAM System for Mobile Robot. In: 2020 27th Saint Petersburg International Conference on Integrated Navigation Systems (ICINS) pp. 1–4. IEEE

  11. O’Riordan A, Newe T, Dooly G, Toal D (2018) Stereo vision sensing: Review of existing systems. In: 2018 12th International Conference on Sensing Technology (ICST) (pp. 178–184). IEEE

  12. DengH, Dong P, Li Z, Lyu H, Zhang Y, Luo Y, An F (2020) Robot navigation based on pseudo-binocular stereo vision and linear fitting. In: 2020 IEEE International Conference on Integrated Circuits, Technologies and Applications (ICTA) (pp. 174–175). IEEE

  13. Bebeselea-Sterp E, Brad R, Remus B (2017) A comparative study of stereo vision algorithms. Int J Adv Comput Sci Appl, 8(11)

  14. Murray D, Little JJ (2000) Using real-time stereo vision for mobile robot navigation. Autonomous Robots 8(2):161–171

    Article  Google Scholar 

  15. Fauadi MHFM, Akmal S, Ali MM, Anuar NI, Ramlan S, Noor AZM, Awang N (2018) Intelligent vision-based navigation system for mobile robot: A technological review. Periodic Eng Nat Sci (PEN) 6(2):47–57

    Google Scholar 

  16. Shamsafar, F., Woerz, S., Rahim, R., & Zell, A. (2022). Mobilestereonet: Towards lightweight deep networks for stereo matching. In Proceedings of the ieee/cvf winter conference on applications of computer vision pp. 2417- 2426

  17. Yang H, Li J, Zhou Z, Li H (2020) Real-time dense stereo matching on mobile devices. Pattern Recogn Lett 129:214–221

    Google Scholar 

  18. Zhang X, Liu S, Zhao G (2021) MobileNetStereo: A Lightweight Stereo Matching Network for MobileDevices. In Proceedings of the IEEE International Conference on Computer Vision (ICCV)

  19. Liu Y, Wu X, Li L, Li H (2021) Learning-Based Stereo Matching for Mobile Devices: A Review. IEEE Access 9:183968–183985

    Google Scholar 

  20. Zhang S, Xu H, Zhu L, Liu X, Wang J (2021) Mobile real-time stereo vision system with feature extraction and deep learning. J Real-Time Image Proc 18(2):685–696

    Google Scholar 

  21. Gao R, Chen Z, Liu Q, Zhang D (2021) Mobile Stereo Vision System for Obstacle Detection and Navigation. Sensors 21(8):2825

    Google Scholar 

  22. Luo S, Yu H, Zhu Y, Wu F (2022) A real-time stereo vision system for mobile robots using a dual-camera smartphone. Sensors 22(3):1078

    Google Scholar 

  23. Xie Y, Wang X, Tian X, Lu X (2022) MobileNetV2Stereo: A Lightweight Stereo Matching Network for Mobile Devices. In: Proceedings of the IEEE International Conference on Multimedia and Expo (ICME)

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Imran Sarwar Bajwa.

Ethics declarations

Conflict of interest

The authors have no conflicts of interest to declare.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yaqoob, I., Bajwa, I.S. Performance evaluation of mobile stereonet for real time navigation in autonomous mobile robots. Multimed Tools Appl 83, 35043–35072 (2024). https://doi.org/10.1007/s11042-023-16710-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-16710-1

Keywords

Navigation