Abstract
Three-dimensional models of objects and their creation process are central for a variety of applications in Augmented Reality. In this article, we present a system that is designed for in-situ modeling using interactive techniques for two generic versions of handheld devices equipped with cameras. The system allows online building of 3D wireframe models through a combination of user interaction and automated methods. In particular, we concentrate in rigorous evaluation of the two devices and interaction methods in the context of 3D feature selection. We present the key components of our system, discuss our findings and results and identify design recommendations.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bastian J, Ward B, Hill R, van den Hengel A, Dick A (2010) Interactive modelling for ar applications. In: Proceedings of the Sixth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR’10), Seoul, Korea
Bowman D, Kruijff E, Violla JL, Poupyrev I (2005) 3D user interfaces theory and practice. Addison Wesley, Boston
Brown M, Drummond T, Cipolla R (2000) 3d model acquisition by tracking 2d wireframes. In: British Machine Vision Conference BMVC, pp 11–14
Bunnun P, Mayol-Cuevas W (2008) Outlinar: an assisted interactive model building system with reduced computational effort. In: Proceedings of the IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR’08)
Chekhlov D, Gee AP, Calway A, Mayol-Cuevas W (2007) Ninja on a plane: automatic discovery of physical planes for Augmented Reality using visual slam. In: Proceedings of the IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR’07)
Comport AI, Marchand E, Pressigout M, Chaumette F (2006) Real-time markerless tracking for Augmented Reality: the virtual visual servoing framework. IEEE Trans Vis Comput Graph 12(4)
Davison AJ, Mayol W, Murray D (2003) Real-time localisation and mapping with wearable active vision. In: International Symposium on Mixed and Augmented Reality
Debevec PE, Taylor CJ, Malik J (1996) Modeling and rendering architecture from photographs. In: SIGGRAPH96
Drummond T, Cipolla R (2002) Real-time visual tracking of complex structures. IEEE Trans on PAMI 24(7):932–946
Faugeras O, Lustman F (1988) Motion and structure from motion in a piecewise planar environment. Technical report, INRIA
Freeman R, Steed A (2006) Interactive modelling and tracking for mixed and Augmented Reality. In: Proceedings of ACM Virtual Reality Software and Technology, Cyprus, pp 61–64
Gee AP, Mayol-Cuevas W (2006) Real-time model-based slam using line segments. In: International Symposium on Visual Computing
Grossman T, Balakrishnan R (2006) The design and evaluation of selection techniques for 3D volumetric displays. In: Proceedings of the 19th Annual ACM Symposium on User interface Software and Technology
van den Hengel A, Dick A, Thormahlen T, Ward B, Torr PHS (2007) Videotrace: rapid interactive scene modelling from video. In: Proceedings of SIGGRAPH
van den Hengel A, Hill R, Ward B, Dick A (2009) In situ image-based modeling. In: Proceedings of the IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR’09)
Kim K, Lepetit V, Woo W (2010) Keyframe-based modeling and tracking of multiple 3D objects. In: Proceeding of the Sixth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR’10), Seoul, Korea
Kim S, DiVerdi S, Chang JS, Kang T, Iltis R, Höllerer T (2007) Implicit 3D modeling and tracking for anywhere augmentation. In: VRST ’07: proceedings of the 2007 ACM symposium on virtual reality software and technology, ACM, pp 19–28
Klein G, Murray D (2007) Parallel tracking and mapping for small AR workspaces. In: Proceedings of the IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR’07), Japan
Lepetit V, Vacchetti L, Thalmann D, Fua P (2003) Fully automated and stable registration for Augmented Reality applications. In: Proceedings of the Second IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR’03), Tokyo, Japan
Neubert J, Pretlove J, Drummond T (2007) Semi-autonomous generation of appearance-based edge models from image sequences. In: Proceedings of the IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR’07), Nara, Japan
Newcombe R, Davison A (2010) Live dense reconstruction with a single moving camera. In: Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on, IEEE, pp 1498–1505
Pan Q, Reitmayr G, Drummond T (2009) ProFORMA: probabilistic feature-based on-line rapid model acquisition. In: Proceedings of the 20th British Machine Vision Conference (BMVC), London
Reitmayr G, Eade E, Drummond T (2007) Semi-automatic annotations in unknown environments. In: Proceeding of the Sixth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR’07), Nara, Japan
Rother C, Kolmogorov V, Blake A (2004) Grabcut: interactive foreground extraction using iterated graph cuts. ACM Trans Graph 23(3):309–314
Simon G (2006) Automatic online walls detection for immediate use in AR tasks. In: International Symposium on Mixed and Augmented Reality
Tukey JW (1977) Explortary Data Analysis. Addison-Wesley, Boston
Vacchetti L, Lepetit V, Fua P (2004) Combining edge and texture information for real-time accurate 3D camera tracking. In: International Symposium on Mixed and Augmented Reality
Varadarajan V (1974) Lie groups, Lie algebras, and their representations. Prentice-Hall Inc., Inglewood Cliffs
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Bunnun, P., Subramanian, S. & Mayol-Cuevas, W.W. In-Situ interactive image-based model building for Augmented Reality from a handheld device. Virtual Reality 17, 137–146 (2013). https://doi.org/10.1007/s10055-011-0206-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10055-011-0206-x