Abstract
Augmented Reality (AR) applications hold great promise for mobile users in the near future, but mobile devices cannot yet deliver on this promise. Even the quite substantial processing capabilities of modern mobile devices are not at the level needed for running the latest object recognition, tracking, or rendering methods. Furthermore, the resultant power consumption drains the battery fast. To ensure a great user experience, AR algorithms have to cope with real-world conditions like illumination, jitter, scale, rotation, and noise. The fusion of different optimized AR technologies like 2D or 3D feature tracking, edge detection, gravity awareness, or SLAM should be able to handle these issues to the satisfaction of the end-user but current mobile devices cannot handle these complex algorithms running in real-time and in an “always on–always Augmented mode”. With the “always on–always Augmented” scenario, AR applications need to work on various devices such as smartphones, tablets, PC, etc., and at different form factors such as wearables and head mounted displays. Additionally, technology enablers such as dedicated hardware to accelerate feature tracking and matching that keep the power consumption to an acceptable level, along with easy-to-use software tools and user interfaces designed for non-experts would be the key to provide a low-cost and high volume AR solution. The “always on–always Augmented” scenario also needs considerable cloud support to offload computations and provide a seamless AR experience. To implement these technologies, hardware (HW) architectures have to evolve in parallel to provide efficient resources that can keep power consumption at an acceptable level. In this chapter we discuss the challenges and solutions in embedded processing for a seamless AR user experience in the context of the “always on–always Augmented” use case.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Azuma RT (1997) A survey of augmented reality. Presence: Teleoperators Virtual Env 6(4):355–385 (Earlier version appeared in Course Notes #9: Developing Advanced Virtual Reality Applications, ACM SIGGRAPH ’95 (Los Angeles, 6–11 August 1995), 20–1 to 20–38.)
Bay H, Ess A, Tuytelaars T, Van Gool L (2008) SURF: speeded up robust features. Comput Vis Image Underst (CVIU) 110(3):346–359
http://studierstube.icg.tugraz.at/thesis/Wagner_PhDthesis_final.pdf
Kurz D, Benhimane S (2011) Gravity-aware handheld augmented reality. In: Proceedings of the IEEE and ACM International symposium on mixed and augmented reality (ISMAR2011). Basel, Switzerland, pp 111–120
Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110
Milgram P, Kishino F (1994) A taxonomy of mixed Reality visual displays. EICE Trans Inf Syst E77-D(12):1321–1329
Platonov J, Heibel H, Meier P, Grollmann B (2006) A mobile markerless AR system for maintenance and repair. In: The fifth IEEE and ACM International symposium on mixed and augmented reality, Santa Barbara, 22–25 October 2006
Rosten E, Drummond T (2006) Machine learning for high-speed corner detection. In: European conference on computer vision, vol 1. pp 430–443
Wilson T, Dipert B (2013) Embedded vision on mobile devices. IEEE J. http://www.eejournal.com/archives/articles/20130731-embvision/
Wilson T, Dipert B, Jacobs M, Droz T (2014) Augmented reality: a compelling mobile embedded vision opportunity. IEEE J. http://www.eejournal.com/archives/articles/20140401-Augmented
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Narasimha, R., Stöffler, N., Stanimirović, D., Meier, P., Tremmel, M. (2014). Challenges in Embedded Vision for Augmented Reality. In: Kisačanin, B., Gelautz, M. (eds) Advances in Embedded Computer Vision. Advances in Computer Vision and Pattern Recognition. Springer, Cham. https://doi.org/10.1007/978-3-319-09387-1_7
Download citation
DOI: https://doi.org/10.1007/978-3-319-09387-1_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-09386-4
Online ISBN: 978-3-319-09387-1
eBook Packages: Computer ScienceComputer Science (R0)