Abstract
We present the processing pipeline of a monocular vision system that successfully performs the task of detecting, identifying and localizing a city bus electric charger station. This task is essential to the operation of an advanced driver assistance system that helps the driver to dock the long vehicle at the charging station. The focus is on the role of machine learning techniques in developing a robust detection and classification procedure that allows our system to localize the camera with respect to the charger even from long distances. We demonstrate that the learned detection procedure improves robustness of the vision techniques for monocular localization, while the geometric relations estimated by our system can be used to improve the learning results.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ćwian, K.: Feature-Based Laser Simultaneous Localization and Mapping for Automotive Applications. Agencja Wydawnicza Impuls, Kraków (2019)
Geiger, A., Lenz, P., Urtasun, R.: Are we ready for autonomous driving? the KITTI vision benchmark suite. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Rhode Island, pp. 3354–3361 (2012)
Girshick, R., Donahue, J., Darrell, T., Malik, J.: Rich feature hierarchies for accurate object detection and semantic segmentation. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, pp. 580–587 (2014)
Hartley, R.I., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge (2004)
He, K., Gkioxari, G., Dollár, P., Girshick, R.: Mask R-CNN. In: IEEE International Conference on Computer Vision (ICCV), Venice, pp. 2980–2988 (2017)
Kim, J., Cho, H., Hwangbo, M., Choi, J., Canny, J., Kwon, Y.P.: Deep traffic light detection for self-driving cars from a large-scale dataset. In: IEEE International Conference on Intelligent Transportation Systems, Maui, pp. 280–285 (2018)
Marchand, E., Spindler, F., Chaumette, F.: ViSP for visual servoing: a generic software platform with a wide class of robot control skills. IEEE Robot. Autom. Mag. 12(4), 40–52 (2005)
Mur-Artal, R., Montiel, J.M.M., Tardós, J.D.: ORB-SLAM: a versatile and accurate monocular SLAM system. IEEE Trans. Robot. 31(5), 1147–1163 (2015)
Nilwong, S., Hossain, D., Kaneko, S., Capi, G.: Deep learning-based landmark detection for mobile robot outdoor localization. Machines 7(2), 25 (2019)
Nowak, T., Nowicki, M., Ćwian, K., Skrzypczyński, P.: How to improve object detection in a driver assistance system applying explainable deep learning. In: IEEE Intelligent Vehicles Symposium, Paris, pp. 226–231 (2019)
Nowicki, M., Nowak, T., Skrzypczyński, P.: Laser-based localization and terrain mapping for driver assistance in a city bus. In: Szewczyk, R., et al. (eds.) Automation 2019 Progress in Automation, Robotics and Measurement Technique, AISC 920, pp. 502–512. Springer (2019)
Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: Towards real-time object detection with region proposal networks. In: Advances in Neural Information Processing Systems (NIPS), pp. 91–99 (2015)
Royer, E., Lhuillier, M., Dhome, M., Chateau T.: Localization in urban environments: monocular vision compared to a differential GPS sensor. In: IEEE Conference on Computer Vision and Pattern Recognition CVPR, San Diego (2005)
Zhang, Q., Zhu, S.: Visual interpretability for deep learning: a survey, frontiers of information technology & electronic. Engineering 19(1), 27–39 (2018)
Zhu, N., Marais, J., Betaille, D., Berbineau, M.: GNSS position integrity in urban environments: a review of literature. IEEE Trans. Intell. Transp. Syst. 19(9), 2762–2778 (2018)
Acknowledgement
This work was funded by the National Centre for Research and Development grant POIR.04.01.02-00-0081/17.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Nowak, T., Nowicki, M.R., Ćwian, K., Skrzypczyński, P. (2020). Leveraging Object Recognition in Reliable Vehicle Localization from Monocular Images. In: Szewczyk, R., Zieliński, C., Kaliczyńska, M. (eds) Automation 2020: Towards Industry of the Future. AUTOMATION 2020. Advances in Intelligent Systems and Computing, vol 1140. Springer, Cham. https://doi.org/10.1007/978-3-030-40971-5_18
Download citation
DOI: https://doi.org/10.1007/978-3-030-40971-5_18
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-40970-8
Online ISBN: 978-3-030-40971-5
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)