Abstract
Semantic mapping in mobile robotics has gained significant attention recently for its important role in equipping robots with a comprehensive understanding of their surroundings. This understanding involves enriching metric maps with semantic data, covering object categories, positions, models, relations, and spatial characteristics. This augmentation enables robots to interact with humans, navigate semantically using high-level instructions, and plan tasks efficiently. This study presents a novel real-time RGBD-based semantic mapping method designed for autonomous mobile robots. It focuses specifically on 2D semantic mapping in environments where prior knowledge of object models is available. Leveraging RGBD camera data, our method generates a primitive object representation using convex polygons, which is then refined by integrating prior knowledge. This integration involves utilizing predefined bounding boxes derived from real 3D object dimensions to cover real object surfaces. The evaluation, conducted in two distinct office environments (a simple and a complex setting) utilizing the MIR mobile robot, demonstrates the effectiveness of our approach. Comparative analysis showcases our method outperforming a similar state-of-the-art approach utilizing only RGBD data for mapping. Our approach accurately estimates occupancy zones of partially visible or occluded objects, resulting in a semantic map closely aligned with the ground truth.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
MiR ROS packages: https://www.github.com/dfki-ric/mir_robot/tree/melodic.
References
Achour, A., Al-Assaad, H., Dupuis, Y., El Zaher, M.: Collaborative mobile robotics for semantic mapping: a survey. Appl. Sci. 12(20), 10316 (2022)
Crespo, J., Castillo, J.C., Mozos, O.M., Barber, R.: Semantic information for robot navigation: a survey. Appl. Sci. 10(2), 497 (2020)
Liu, W., Daruna, A., Patel, M., Ramachandruni, K., Chernova, S.: A survey of semantic reasoning frameworks for robotic systems. Robot. Auton. Syst. 159, 104294 (2023)
Stark, R., Fresemann, C., Lindow, K.: Development and operation of digital twins for technical systems and services. CIRP Ann. 68(1), 129–132 (2019)
Purcell, W., Neubauer, T.: Digital twins in agriculture: a state-of-the-art review. Smart Agric. Technol. 3, 100094 (2023)
Verdouw, C., Tekinerdogan, B., Beulens, A., Wolfert, S.: Digital twins in smart farming. Agric. Syst. 189, 103046 (2021)
Grinvald, M., et al.: Volumetric instance-aware semantic mapping and 3D object discovery. IEEE Robot. Autom. Lett. 4(3), 3037–3044 (2019)
Sünderhauf, N., Pham, T.T., Latif, Y., Milford, M., Reid, I.: Meaningful maps with object-oriented semantic mapping. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 5079–5085 (2017)
Zaenker, T., Verdoja, F., Kyrki, V.: Hypermap mapping framework and its application to autonomous semantic exploration. In: IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI), pp. 133–139 (2020)
Zhao, C., Mei, W., Pan, W.: Building a grid-semantic map for the navigation of service robots through human-robot interaction. Digit. Commun. Netw. 1(4), 253–266 (2015)
Qi, X., et al.: Building semantic grid maps for domestic robot navigation. Int. J. Adv. Robot. Syst. 17(1) (2020)
Barber, C.B., Dobkin, D.P., Huhdanpaa, H.: The quickhull algorithm for convex hulls. ACM Trans. Math. Softw. (TOMS) 22(4), 469–483 (1996)
Dengler, N., Zaenker, T., Verdoja, F., Bennewitz, M.: Online object-oriented semantic mapping and map updating with modular representations. CoRR, vol. abs/2011.06895 (2020)
Hernandez, A.C., Gomez, C., Barber, R., Mozos, O.M.: Exploiting the confusions of semantic places to improve service robotic tasks in indoor environments. Robot. Auton. Syst. 159, 104290 (2023)
Hiller, M., Qiu, C., Particke, F., Hofmann, C., Thielecke, J.: Learning topometric semantic maps from occupancy grids. In: 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 4190–4197. IEEE (2019)
Kaleci, B., Turgut, K., Dutagaci, H.: 2DLaserNet: a deep learning architecture on 2D laser scans for semantic classification of mobile robot locations. Eng. Sci. Technol. Int. J. 28, 101027 (2022)
Posada, L.F., Velasquez-Lopez, A., Hoffmann, F., Bertram, T.: Semantic mapping with omnidirectional vision. In: 2018 IEEE International Conference on Robotics and Automation (ICRA), pp. 1901–1907. IEEE (2018)
Weiler, K., Atherton, P.: Hidden surface removal using polygon area sorting. ACM SIGGRAPH Comput. Graph. 11(2), 214–222 (1977)
He, K., Gkioxari, G., Dollár, P., Girshick, R.: Mask R-CNN. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2961–2969 (2017)
Krasin, I., et al.: OpenImages: a public dataset for large-scale multi-label and multi-class image classification, vol. 2, no. 3, p. 18 (2017). Dataset https://github.com/openimages
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Achour, A., Al Assaad, H., Dupuis, Y., El Zaher, M. (2024). Improving Semantic Mapping with Prior Object Dimensions Extracted from 3D Models. In: Filipe, J., Röning, J. (eds) Robotics, Computer Vision and Intelligent Systems. ROBOVIS 2024. Communications in Computer and Information Science, vol 2077. Springer, Cham. https://doi.org/10.1007/978-3-031-59057-3_8
Download citation
DOI: https://doi.org/10.1007/978-3-031-59057-3_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-59056-6
Online ISBN: 978-3-031-59057-3
eBook Packages: Computer ScienceComputer Science (R0)