Abstract
This research focuses on the performance evaluation of mobile stereonet for real-time navigation in mobile robots. The use of mobile stereonet for depth estimation and path planning has become increasingly important in the field of robotics. The research is conducting by implementing the mobile stereonet algorithm for real time navigation on a Raspberry Pi 4 and integrating it with a stereo camera to capture live video frames. The objective of this research is to evaluate the effectiveness of mobile stereonet in navigating mobile robots in different real time environments. The study will include the development of a mobile stereonet-based depth estimation and path planning system and its evaluation through simulations and experiments. The performance of the system will be evaluated based on various metrics, such as accuracy, efficiency, and robustness. The results of this study will provide insights into the potential applications of mobile stereonet in the field of robotics and contribute to the development of better navigation system for mobile robots using stereo vision technology. Implemented real time map generation using mobile stereonet is available on Github.
Similar content being viewed by others
Data Availability
The data used to support the findings of this study is real time data collected on real time during experimentations.
References
WangY, Lai Z, Huang G, Wang BH, Van Der Maaten L, Campbell M, Weinberger KQ (2019) Anytime stereo image depth estimation on mobile devices. In: 2019 International Conference on Robotics and Automation (ICRA) (pp. 5893–5900). IEEE
Aнтoщyк CГ, Кoндpaтьєв CБ, Щepбaкoвa ГЮ, Гoдoвичeнкo MA (2022) Depth map generation for mobile navigation systems based on objects localization in images. Bicник cyчacниx iнфopмaцiйниx тexнoлoгiй 5(1):11–18
Xiang Y, Yang XQ, Yang WW, Miao WH (2020) Localization and Mapping Algorithm for the Indoor Mobile Robot Based on LIDAR. In: IOP Conference Series: Materials Science and Engineering. 831(1):012021. IOP Publishing
Hamzah RA, Hamid AMA, Salim SIM (2010). The solution of stereo correspondence problem using block matching algorithm in stereo vision mobile robot. In: 2010 Second International Conference on Computer Research and Development pp. 733–737. IEEE
Sanchez-Rodriguez JP, Aceves-Lopez A (2018) A survey on stereo vision-based autonomous navigation for multi-rotor MUAVs. Robotica 36(8):1225–1243
Koschan A, Rodehorst V, Spiller K (1996) Color stereo vision using hierarchical block matching and active color illumination. In Proceedings of 13th International Conference on Pattern Recognition 1, 835–839. IEEE
Tao T, Koo JC, Choi HR (2008) A fast block matching algorthim forstereo correspondence. In: 2008 IEEE Conference on Cybernetics and Intelligent Systems pp. 38–41. IEEE
Konolige K, Agrawal M, Bolles RC, Cowan C, Fischler M, Gerkey B (2008). Outdoor mapping and navigation using stereo vision. In: Experimental robotics. Springer, Berlin, Heidelberg. 179–190
Ramírez-Hernández LR, Rodríguez-Quinoñez JC, Castro-Toscano MJ, Hernández-Balbuena D, Flores-Fuentes W, Rascón-Carmona R, Sergiyenko O (2020) Improve three-dimensional point localization accuracy in stereo vision systems using a novel camera calibration method. Int J Adv Robot Syst 17(1):1729881419896717
Juan-RouH, Zhan-Qing W (2020). The Implementation of IMU/Stereo Vision SLAM System for Mobile Robot. In: 2020 27th Saint Petersburg International Conference on Integrated Navigation Systems (ICINS) pp. 1–4. IEEE
O’Riordan A, Newe T, Dooly G, Toal D (2018) Stereo vision sensing: Review of existing systems. In: 2018 12th International Conference on Sensing Technology (ICST) (pp. 178–184). IEEE
DengH, Dong P, Li Z, Lyu H, Zhang Y, Luo Y, An F (2020) Robot navigation based on pseudo-binocular stereo vision and linear fitting. In: 2020 IEEE International Conference on Integrated Circuits, Technologies and Applications (ICTA) (pp. 174–175). IEEE
Bebeselea-Sterp E, Brad R, Remus B (2017) A comparative study of stereo vision algorithms. Int J Adv Comput Sci Appl, 8(11)
Murray D, Little JJ (2000) Using real-time stereo vision for mobile robot navigation. Autonomous Robots 8(2):161–171
Fauadi MHFM, Akmal S, Ali MM, Anuar NI, Ramlan S, Noor AZM, Awang N (2018) Intelligent vision-based navigation system for mobile robot: A technological review. Periodic Eng Nat Sci (PEN) 6(2):47–57
Shamsafar, F., Woerz, S., Rahim, R., & Zell, A. (2022). Mobilestereonet: Towards lightweight deep networks for stereo matching. In Proceedings of the ieee/cvf winter conference on applications of computer vision pp. 2417- 2426
Yang H, Li J, Zhou Z, Li H (2020) Real-time dense stereo matching on mobile devices. Pattern Recogn Lett 129:214–221
Zhang X, Liu S, Zhao G (2021) MobileNetStereo: A Lightweight Stereo Matching Network for MobileDevices. In Proceedings of the IEEE International Conference on Computer Vision (ICCV)
Liu Y, Wu X, Li L, Li H (2021) Learning-Based Stereo Matching for Mobile Devices: A Review. IEEE Access 9:183968–183985
Zhang S, Xu H, Zhu L, Liu X, Wang J (2021) Mobile real-time stereo vision system with feature extraction and deep learning. J Real-Time Image Proc 18(2):685–696
Gao R, Chen Z, Liu Q, Zhang D (2021) Mobile Stereo Vision System for Obstacle Detection and Navigation. Sensors 21(8):2825
Luo S, Yu H, Zhu Y, Wu F (2022) A real-time stereo vision system for mobile robots using a dual-camera smartphone. Sensors 22(3):1078
Xie Y, Wang X, Tian X, Lu X (2022) MobileNetV2Stereo: A Lightweight Stereo Matching Network for Mobile Devices. In: Proceedings of the IEEE International Conference on Multimedia and Expo (ICME)
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors have no conflicts of interest to declare.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Yaqoob, I., Bajwa, I.S. Performance evaluation of mobile stereonet for real time navigation in autonomous mobile robots. Multimed Tools Appl 83, 35043–35072 (2024). https://doi.org/10.1007/s11042-023-16710-1
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-023-16710-1