Abstract
Building recognition from images and video streams of mobile devices to texturize and refine an existing 3D city model is an open challenge, since such models most often do not completely represent the actual buildings. We present ways to extract buildings from images enabling improvement of the existing model. The approach is based on edge detection on images to detect walls, pure use of sensor data by creating an overlay to the video stream with the 3D model renderer from current position by a server, and the use of structure from motion algorithms to create point clouds and recognize a building via the support of the device’s sensors. We show that we are thus able to texturize and refine an existing 3D city model.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ackermann, J., Goesele, M.: A survey of photometric stereo techniques. Found. Trends Comput. Graph. Vis. 9(3–4), 149–254 (2015)
Akbarzadeh, A., Frahm, J., Mordohai, P., Clipp, B., Engels, C., Gallup, D., Merrell, P., Phelps, M., Sinha, S.N., Talton, B., Wang, L., Yang, Q., Stewénius, H., Yang, R., Welch, G., Towles, H., Nistér, D., Pollefeys, M.: Towards urban 3D reconstruction from video. In: 3rd International Symposium on 3D Data Processing, Visualization and Transmission (3DPVT 2006), 14–16 June 2006, Chapel Hill, North Carolina, USA, pp. 1–8 (2006)
Arth, C., Pirchheim, C., Ventura, J., Schmalstieg, D., Lepetit, V.: Instant outdoor localization and SLAM initialization from 2.5D maps. IEEE Trans. Vis. Comput. Graph. 21(11), 1309–1318 (2015)
Canny, J.: A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 8(6), 679–698 (1986)
von Gioi, R.G., Jakubowicz, J., Morel, J., Randall, G.: LSD: a fast line segment detector with a false detection control. IEEE Trans. Pattern Anal. Mach. Intell. 32(4), 722–732 (2010)
Harris, C., Stephens, M.: A combined corner and edge detector. In: Proceedings of the Alvey Vision Conference, AVC 1988, Manchester, UK, pp. 1–6, September 1988
Kahn, S., Bockholt, U., Kuijper, A., Fellner, D.W.: Towards precise real-time 3D difference detection for industrial applications. Comput. Ind. 64(9), 1115–1128 (2013)
Lucas, B.D., Kanade, T.: An iterative image registration technique with an application to stereo vision. In: Proceedings of the 7th International Joint Conference on Artificial Intelligence, IJCAI 1981, Vancouver, BC, Canada, pp. 674–679, 24–28 August 1981
Martinovic, A., Knopp, J., Riemenschneider, H., Gool, L.J.V.: 3D all the way: semantic segmentation of urban scenes from start to end in 3D. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015, pp. 4456–4465 (2015)
Nistér, D., Naroditsky, O., Bergen, J.R.: Visual odometry for ground vehicle applications. J. Field Robot. 23(1), 3–20 (2006)
Pollefeys, M., Gool, L.J.V., Vergauwen, M., Verbiest, F., Cornelis, K., Tops, J., Koch, R.: Visual modeling with a hand-held camera. Int. J. Comput. Vis. 59(3), 207–232 (2004)
Pollefeys, M., Nistér, D., Frahm, J., Akbarzadeh, A., Mordohai, P., Clipp, B., Engels, C., Gallup, D., Kim, S.J., Merrell, P., Salmi, C., Sinha, S.N., Talton, B., Wang, L., Yang, Q., Stewénius, H., Yang, R., Welch, G., Towles, H.: Detailed real-time urban 3D reconstruction from video. Int. J. Comput. Vis. 78(2–3), 143–167 (2008)
Snavely, N., Simon, I., Goesele, M., Szeliski, R., Seitz, S.M.: Scene reconstruction and visualization from community photo collections. Proc. IEEE 98(8), 1370–1390 (2010)
Szeliski, R.: Computer Vision - Algorithms and Applications. Springer, Heidelberg (2011). Texts in Computer Science
Tomasi, C., Kanade, T.: Shape and motion from image streams : a factorization method. part 3, detection and tracking of point features. Technical Report CMU-CS-91-132, Carnegie-Mellon University, Computer science, Pittsburgh (PA US) (1991)
Wientapper, F., Wuest, H., Kuijper, A.: Composing the feature map retrieval process for robust and ready-to-use monocular tracking. Compute. Graph. 35(4), 778–788 (2011)
Wientapper, F., Wuest, H., Kuijper, A.: Reconstruction and accurate alignment of feature maps for augmented reality. In: 3DIMPVT 2011, pp. 140–147. IEEE (2011)
Xiao, J., Fang, T., Tan, P., Zhao, P., Ofek, E., Quan, L.: Image-based faÇade modeling. ACM Trans. Graph. 27(5), 161:1–161:10 (2008)
Xiao, J., Fang, T., Zhao, P., Lhuillier, M., Quan, L.: Image-based street-side city modeling. ACM Trans. Graph. 28(5), 114:1–114:12 (2009)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Gutbell, R., Kuehnel, H., Kuijper, A. (2017). Texturizing and Refinement of 3D City Models with Mobile Devices. In: Blanc-Talon, J., Penne, R., Philips, W., Popescu, D., Scheunders, P. (eds) Advanced Concepts for Intelligent Vision Systems. ACIVS 2017. Lecture Notes in Computer Science(), vol 10617. Springer, Cham. https://doi.org/10.1007/978-3-319-70353-4_27
Download citation
DOI: https://doi.org/10.1007/978-3-319-70353-4_27
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-70352-7
Online ISBN: 978-3-319-70353-4
eBook Packages: Computer ScienceComputer Science (R0)