Abstract
An Augmented Reality (AR) book is an application that applies AR technologies to physical books for providing a new experience to users. In this paper, we propose a new marker-less tracking method for the AR book. The main goal of the tracker is not only to recognize many pages, but also to compute 6 DOF camera pose. As a result, we can augment different virtual contents according to the corresponding page. For this purpose, we use a multi-core programming approach that separates the page recognition module from the tracking module. In the page recognition module, highly distinctive Scale Invariant Features Transform (SIFT) features are used. In the tracking module, a coarse-to-fine approach is exploited for fast frame-to-frame matching. Our tracker provides more than 30 frames per second. In addition to the tracker, we explain multi-layer based data structure for maintaining the AR book. A GUI-based authoring tool is also shown to validate feasibility of the tracker and data structures. The proposed algorithm would be helpful to create various AR applications that require multiple planes tracking.
Chapter PDF
Similar content being viewed by others
References
Billinghurst, M., Kato, H., Poupyrev, I.: The magicbook - moving seamlessly between reality and virtuality. IEEE Computer Graphics and Applications 21(3), 6–8 (2001)
Taketa, N., Hayashi, K., Kato, H., Noshida, S.: Virtual pop-up book based on augmented reality. In: Smith, M.J., Salvendy, G. (eds.) HCII 2007. LNCS, vol. 4558, pp. 475–484. Springer, Heidelberg (2007)
Scherrer, C., Pilet, J., Fua, P., Lepetit, V.: The haunted book. In: IEEE/ACM International Symposium on Mixed and Augmented Reality, ISMAR 2008, pp. 163–164 (2008)
Lepetit, V., Lagger, P., Fua, P.: Randomized trees for real-time keypoint recognition. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005, May 2005, vol. 2, pp. 775–781 (2005)
Yang, H.S., Cho, K., Soh, J., Jung, J., Lee, J.: Hybrid visual tracking for augmented books. In: Stevens, S.M., Saldamarco, S.J. (eds.) ICEC 2008. LNCS, vol. 5309, pp. 161–166. Springer, Heidelberg (2008)
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60(2), 91–110 (2004)
Rosten, E., Drummond, T.: Fusing points and lines for high performance tracking. In: Tenth IEEE International Conference on Computer Vision, ICCV 2005, September 2005, vol. 2, pp. 508–1515 (2005)
Vacchetti, L., Lepetit, V., Fua, P.: Stable real-time 3d tracking using online and offline information. IEEE Transactions on Pattern Analysis and Machine Intelligence 26(10), 1385–1391 (2004)
Reitmayr, G., Drummond, T.: Going out: robust model-based tracking for outdoor augmented reality. In: IEEE/ACM International Symposium on Mixed and Augmented Reality, ISMAR 2006, October 2006, pp. 109–118 (2006)
Ozuysal, M., Fua, P., Lepetit, V.: Fast keypoint recognition in ten lines of code. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2007, May 2007, pp. 1–8 (2007)
Davison, A.J., Reid, I.D., Molton, N.D., Stasse, O.: Monoslam: Real-time single camera slam. IEEE Transactions on Pattern Analysis and Machine Intelligence 29(6), 1052–1067 (2007)
Williams, B., Klein, G., Reid, I.: Real-time slam relocalisation. In: IEEE International Conference on Computer Vision, ICCV 2007, September 2007, pp. 1–8 (2007)
Castle, R., Gawley, D., Klein, G., Murray, D.: Video-rate recognition and localization for wearable cameras. In: British Machine Vision Conf. (January 2007)
Klein, G., Murray, D.: Parallel tracking and mapping for small ar workspaces. In: IEEE/ACM International Symposium on Mixed and Augmented Reality, ISMAR 2007, October 2007, pp. 225–234 (2007)
Bay, H., Ess, A., Tuytelaars, T., Vangool, L.: Speeded-up robust features (surf). Computer Vision and Image Understanding 110(3), 346–359 (2008)
Lee, T., Hollerer, T.: Hybrid feature tracking and user interaction for markerless augmented reality. In: IEEE Virtual Reality, VR 2008, February 2008, pp. 145–152 (2008)
Pilet, J., Geiger, A., Lagger, P., Lepetit, V., Fua, P.: An all-in-one solution to geometric and photometric calibration. In: IEEE/ACM International Symposium on Mixed and Augmented Reality, ISMAR 2006, September 2006, pp. 69–78 (2006)
Openscenegraph, http://www.openscenegraph.org
Open computer vision library, http://sourceforge.net/projects/opencvlibrary/
Siftgpu, http://cs.unc.edu/~ccwu/siftgpu/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 IFIP International Federation for Information Processing
About this paper
Cite this paper
Kim, K., Park, J., Woo, W. (2009). Marker-Less Tracking for Multi-layer Authoring in AR Books. In: Natkin, S., Dupire, J. (eds) Entertainment Computing – ICEC 2009. ICEC 2009. Lecture Notes in Computer Science, vol 5709. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04052-8_5
Download citation
DOI: https://doi.org/10.1007/978-3-642-04052-8_5
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-04051-1
Online ISBN: 978-3-642-04052-8
eBook Packages: Computer ScienceComputer Science (R0)