Abstract
Outdoor augmented reality applications project information of interest onto views of the world in real-time. Their core challenge is recognizing the meaningful objects present in the current view and retrieving and overlaying pertinent information onto such objects. In this paper we report on the development of a framework for mobile outdoor augmented reality application, applied to the overlay of peak information onto views of mountain landscapes. The resulting app operates by estimating the virtual panorama visible from the viewpoint of the user, using an online Digital Terrain Model (DEM), and by matching such panorama to the actual image framed by the camera. When a good match is found, meta-data from the DEM (e.g., peak name, altitude, distance) are projected in real time onto the view. The application, besides providing a nice experience to the user, can be employed to crowdsource the collection of annotated mountain images for environmental applications.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
- 2.
- 3.
- 4.
- 5.
The data set is available at http://snowwatch.polimi.it.
References
Baatz, G., Saurer, O., Köser, K., Pollefeys, M.: Large scale visual geo-localization of images in mountainous terrain. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part II. LNCS, vol. 7573, pp. 517–530. Springer, Heidelberg (2012)
Baboud, L., Cadik, M., Eisemann, E., Seidel, H.P.: Automatic photo-to-terrain alignment for the annotation of mountain pictures. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 41–48. IEEE (2011)
Billinghurst, M., Clark, A.J., Lee, G.A.: A survey of augmented reality. Found. Trends Hum. Comput. Interact. 8(2–3), 73–272 (2015)
Briechle, K., Hanebeck, U.D.: Template matching using fast normalized cross correlation. In: Aerospace/Defense Sensing, Simulation, and Controls, pp. 95–102. International Society for Optics and Photonics (2001)
Dähne, P., Karigiannis, J.N.: Archeoguide: system architecture of a mobile outdoor augmented reality system. In: null, p. 263. IEEE (2002)
Degrossi, L.C., Albuquerque, J., Fava, M.C., Mendiondo, E.M.: Flood citizen observatory: a crowdsourcing-based approach for flood risk management in brazil. In: 26th International Conference on Software Engineering and Knowledge Engineering (2014)
Dizerens, C., Hüsler, F., Wunderle, S.: Webcam imagery rectification and classification: potential for complementing satellite-derived snow maps over switzerland
Fedorov, R., Camerada, A., Fraternali, P., Tagliasacchi, M.: Estimating snow cover from publicly available images. IEEE Trans. Multimedia 18(6), 1187–1200 (2016)
Fedorov, R., Fraternali, P., Pasini, C.: SnowWatch: a multi-modal citizen science application. In: Bozzon, A., Cudré-Mauroux, P., Pautasso, C. (eds.) ICWE 2016. LNCS, vol. 9671, pp. 538–541. Springer, Heidelberg (2016). doi:10.1007/978-3-319-38791-8_43
Fedorov, R., Fraternali, P., Tagliasacchi, M.: Mountain peak identification in visual content based on coarse digital elevation models. In: Proceedings of the 3rd ACM International Workshop on Multimedia Analysis for Ecological Data (2014)
Goodchild, M.F.: Citizens as sensors: the world of volunteered geography. Geo J. 69(4), 211–221 (2007)
Hyvärinen, O., Saltikoff, E.: Social media as a source of meteorological observations. Mon. Weather Rev. 138(8), 3175–3184 (2010)
Jain, P., Manweiler, J., Roy Choudhury, R.: Overlay: practical mobile augmented reality. In: Proceedings of the 13th Annual International Conference on Mobile Systems, Applications, and Services, pp. 331–344. ACM (2015)
Lie, W.N., Lin, T.C.I., Lin, T.C., Hung, K.S.: A robust dynamic programming algorithm to extract skyline in images for navigation. Pattern Recogn. Lett. 26(2), 221–230 (2005)
Memarsadeghi, N.: Citizen science [guest editors’ introduction]. Comput. Sci. Eng. 17(4), 8–10 (2015)
Murdock, C., Jacobs, N., Pless, R.: Webcam2satellite: estimating cloud maps from webcam imagery. In: 2013 IEEE Workshop on Applications of Computer Vision (WACV), pp. 214–221. IEEE (2013)
NatureServe, F.: Natureserve explorer: an online encyclopedia of life (2012)
Porzi, L., Buló, S.R., Valigi, P., Lanz, O., Ricci, E.: Learning contours for automatic annotations of mountains pictures on a smartphone. In: Proceedings of the International Conference on Distributed Smart Cameras, p. 13. ACM (2014)
Poser, K., Dransch, D.: Volunteered geographic information for disaster management with application to rapid flood damage estimation. Geomatica (2010)
Reddy, S., Shilton, K., Burke, J., Estrin, D., Hansen, M., Srivastava, M.: Evaluating participation and performance in participatory sensing. UrbanSense08, p. 1 (2008)
Reitmayr, G., Drummond, T.: Going out: robust model-based tracking for outdoor augmented reality. In: Proceedings of the 5th IEEE and ACM International Symposium on Mixed and Augmented Reality (2006)
Rüfenacht, D., Brown, M., Beutel, J., Süsstrunk, S.: Temporally consistent snow cover estimation from noisy, irregularly sampled measurements. In: Proceedings of the 9th International Conference on Computer Vision Theory and Applications (2014)
Sakaki, T., Okazaki, M., Matsuo, Y.: Earthquake shakes twitter users: real-time event detection by social sensors. In: Proceedings of the 19th International Conference on World Wide Web, pp. 851–860. ACM (2010)
Salvatori, R., Plini, P., Giusto, M., et al.: Snow cover monitoring with images from digital camera systems. Ital. J. Remote Sens. 43, 137–145 (2011)
Schnebele, E., Cervone, G., Waters, N.: Road assessment after flood events using non-authoritative data. Nat. Hazards Earth Syst. Sci. 14(4), 1007–1015 (2014)
Sullivan, B.L., Wood, C.L., Iliff, M.J., Bonney, R.E., Fink, D., Kelling, S.: ebird: a citizen-based bird observation network in the biological sciences. Biol. Conserv. 142(10), 2282–2292 (2009)
Wang, J., Korayem, M., Crandall, D.J.: Observing the natural world with flickr. In: 2013 IEEE International Conference on Computer Vision Workshops (ICCVW), pp. 452–459. IEEE (2013)
Zhang, H., Korayem, M., Crandall, D.J., LeBuhn, G.: Mining photo-sharing websites to study ecological phenomena. In: Proceedings of the 21st International Conference on World Wide Web, pp. 749–758. ACM (2012)
Zook, M., Graham, M., Shelton, T., Gorman, S.: Volunteered geographic information and crowdsourcing disaster relief: a case study of the haitian earthquake. Available at SSRN 2216649 (2010)
Acknowledgment
This work has been partially funded by European Commission and by the Lombardy Region through the PROACTIVE FESR Project (http://www.proactiveproject.eu) and by the FP7 CHEST Project (http://www.chest-project.eu) open call grant.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Fedorov, R., Frajberg, D., Fraternali, P. (2016). A Framework for Outdoor Mobile Augmented Reality and Its Application to Mountain Peak Detection. In: De Paolis, L., Mongelli, A. (eds) Augmented Reality, Virtual Reality, and Computer Graphics. AVR 2016. Lecture Notes in Computer Science(), vol 9768. Springer, Cham. https://doi.org/10.1007/978-3-319-40621-3_21
Download citation
DOI: https://doi.org/10.1007/978-3-319-40621-3_21
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-40620-6
Online ISBN: 978-3-319-40621-3
eBook Packages: Computer ScienceComputer Science (R0)