Abstract
Cities are one of the most pertinent application spaces for current Augmented Reality systems but have proven to be technically challenging. They are abundant with information, while also requiring occlusion of that same information at different levels of depth. With more and more detailed 3D city models becoming available through the CityGML standard, we introduce an approach that can display contextual multimedia annotations on buildings in AR and properly occlude them without depending on complex computer vision analysis. Our approach also integrates directly with CityGML through an Application Domain Extension (ADE). We implement a prototype that allows for the dynamic textual labeling of urban environments on a variety of AR-capable smartphones using the Unity game engine.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
The code for this paper is published at: http://github.com/Postert/CityGML-AR.
References
Azuma, R., Furmanski, C.: Evaluating label placement for augmented reality view management. In: The Second IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR), 2003. Proceedings, pp. 66–75. IEEE, Tokyo, Japan (2003). https://doi.org/10.1109/ISMAR.2003.1240689
Blut, C., Blankenbach, J.: Three-dimensional CityGML building models in mobile augmented reality: a smartphone-based pose tracking system. Int. J. Digital Earth, pp. 1–20 (2020). https://doi.org/10.1080/17538947.2020.1733680
Blut, C., Blut, T., Blankenbach, J.: CityGML goes mobile: application of large 3d CityGML models on smartphones. Int. J. Digital Earth 12(1), 25–42 (2019). https://doi.org/10.1080/17538947.2017.1404150
Carter, N., Brauer, D.: Depthmask. Unify Community Wiki (2018). http://wiki.unity3d.com/index.php?title=DepthMask. Accessed 30 Apr 2020
Christensen, J., Marks, J., Shieber, S.: An empirical study of algorithms for point-feature label placement. ACM Trans. Graphics (TOG) 14(3), 203–232 (1995). https://doi.org/10.1145/212332.212334
Gröger, G., Kolbe, T.H., Nagel, C., Häfele, K.H.: OGC City Geography Markup Language (CityGML) Encoding Standard, 2.0.0 edn. Open Geospatial Consortium (2012)
Hirzer, M., Arth, C., Roth, P., Lepetit, V.: Efficient 3d tracking in urban environments with semantic segmentation. In: Proceedings of the British Machine Vision Conference (BMVC), London, UK (2017)
Langlotz, T., Nguyen, T., Schmalstieg, D., Grasset, R.: Next-generation augmented reality browsers: rich, seamless, and adaptive. Proc. IEEE 102(2), 155–169 (2014). https://doi.org/10.1109/JPROC.2013.2294255
Löwner, M.O., Gröger, G., Benner, J., Biljecki, F., Nagel, C.: Proposal for a new lod and multi-representation concept for CityGML. In: ISPRS Annals of Photogrammetry, Remote Sensing & Spatial Information Sciences, vol. IV-2/W1, pp. 3–12 (2016). https://doi.org/10.5194/isprs-annals-IV-2-W1-3-2016
Löwner, M.O., Casper, E., Becker, T., Benner, J., Gröger, G., Gruber, U., Häfele, K.H., Kaden, R., Schlüter, S.: Citygml 2.0 – ein internationaler standard für 3d-stadtmodelle, teil 2: Citygml in der praxis. Zeitschrift für Geodäsie, Geoinformation und Landmanagement 2(2013), 131–143 (2013)
McNamara, A., Boyd, K., George, J., Jones, W., Oh, S., Suther, A.: Information placement in virtual reality. In: Teather, R., Itoh, Y., Gabbard, J. (eds.) Proceedings, 26th IEEE Conference on Virtual Reality and 3D User Interfaces, pp. 1765–1769. IEEE, Osaka, Japan (2019). https://doi.org/10.1109/VR.2019.8797891
Reitmayr, G., Drummond, T.W.: Going out: robust model-based tracking for outdoor augmented reality. In: 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality, pp. 109–118. IEEE, Santa Barbard, CA, USA (2006). https://doi.org/10.1109/ISMAR.2006.297801
Schöps, T., Sattler, T., Häne, C., Pollefeys, M.: 3d modeling on the go: Interactive 3d reconstruction of large-scale scenes on mobile devices. In: 2015 International Conference on 3D Vision, pp. 291–299. IEEE, Lyon, France (2015). https://doi.org/10.1109/3DV.2015.40
Yao, Z., Kolbe, T.H.: Dynamically extending spatial databases to support citygml application domain extensions using graph transformations. In: T.P. Kersten (ed.) Kulturelles Erbe erfassen und bewahren - Von der Dokumentation zum virtuellen Rundgang, 37. Wissenschaftlich-Technische Jahrestagung der DGPF, Publikationen der Deutschen Gesellschaft für Photogrammetrie, Fernerkundung und Geoinformation (DGPF) e.V, vol. 26, pp. 316–331. Deutsche Gesellschaft für Photogrammetrie, Fernerkundung und Geoinformation e.V, Würzburg (2017)
Zama Ramirez, P., Poggi, M., Tosi, F., Mattoccia, S., Di Stefano, L.: Geometry meets semantics for semi-supervised monocular depth estimation. In: Jawahar, C.V., Li, H., Mori, G., Schindler, K. (eds.) Computer Vision – ACCV 2018, pp. 298–313. Springer International Publishing, Cham (2019). https://doi.org/10.1007/978-3-030-20893-6_19
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Postert, P., Berger, M., Bill, R. (2021). Utilizing CityGML for AR-Labeling and Occlusion in Urban Spaces. In: Kamilaris, A., Wohlgemuth, V., Karatzas, K., Athanasiadis, I.N. (eds) Advances and New Trends in Environmental Informatics. Progress in IS. Springer, Cham. https://doi.org/10.1007/978-3-030-61969-5_15
Download citation
DOI: https://doi.org/10.1007/978-3-030-61969-5_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-61968-8
Online ISBN: 978-3-030-61969-5
eBook Packages: Computer ScienceComputer Science (R0)