Virtual Reality

, Volume 17, Issue 2, pp 137–146

In-Situ interactive image-based model building for Augmented Reality from a handheld device

  • Pished Bunnun
  • Sriram Subramanian
  • Walterio W. Mayol-Cuevas
SI: Mixed and Augmented Reality

Abstract

Three-dimensional models of objects and their creation process are central for a variety of applications in Augmented Reality. In this article, we present a system that is designed for in-situ modeling using interactive techniques for two generic versions of handheld devices equipped with cameras. The system allows online building of 3D wireframe models through a combination of user interaction and automated methods. In particular, we concentrate in rigorous evaluation of the two devices and interaction methods in the context of 3D feature selection. We present the key components of our system, discuss our findings and results and identify design recommendations.

Keywords

Model building Augmented Reality Handheld device 

References

  1. Bastian J, Ward B, Hill R, van den Hengel A, Dick A (2010) Interactive modelling for ar applications. In: Proceedings of the Sixth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR’10), Seoul, KoreaGoogle Scholar
  2. Bowman D, Kruijff E, Violla JL, Poupyrev I (2005) 3D user interfaces theory and practice. Addison Wesley, BostonGoogle Scholar
  3. Brown M, Drummond T, Cipolla R (2000) 3d model acquisition by tracking 2d wireframes. In: British Machine Vision Conference BMVC, pp 11–14Google Scholar
  4. Bunnun P, Mayol-Cuevas W (2008) Outlinar: an assisted interactive model building system with reduced computational effort. In: Proceedings of the IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR’08)Google Scholar
  5. Chekhlov D, Gee AP, Calway A, Mayol-Cuevas W (2007) Ninja on a plane: automatic discovery of physical planes for Augmented Reality using visual slam. In: Proceedings of the IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR’07)Google Scholar
  6. Comport AI, Marchand E, Pressigout M, Chaumette F (2006) Real-time markerless tracking for Augmented Reality: the virtual visual servoing framework. IEEE Trans Vis Comput Graph 12(4)Google Scholar
  7. Davison AJ, Mayol W, Murray D (2003) Real-time localisation and mapping with wearable active vision. In: International Symposium on Mixed and Augmented RealityGoogle Scholar
  8. Debevec PE, Taylor CJ, Malik J (1996) Modeling and rendering architecture from photographs. In: SIGGRAPH96Google Scholar
  9. Drummond T, Cipolla R (2002) Real-time visual tracking of complex structures. IEEE Trans on PAMI 24(7):932–946CrossRefGoogle Scholar
  10. Faugeras O, Lustman F (1988) Motion and structure from motion in a piecewise planar environment. Technical report, INRIAGoogle Scholar
  11. Freeman R, Steed A (2006) Interactive modelling and tracking for mixed and Augmented Reality. In: Proceedings of ACM Virtual Reality Software and Technology, Cyprus, pp 61–64Google Scholar
  12. Gee AP, Mayol-Cuevas W (2006) Real-time model-based slam using line segments. In: International Symposium on Visual ComputingGoogle Scholar
  13. Grossman T, Balakrishnan R (2006) The design and evaluation of selection techniques for 3D volumetric displays. In: Proceedings of the 19th Annual ACM Symposium on User interface Software and TechnologyGoogle Scholar
  14. van den Hengel A, Dick A, Thormahlen T, Ward B, Torr PHS (2007) Videotrace: rapid interactive scene modelling from video. In: Proceedings of SIGGRAPHGoogle Scholar
  15. van den Hengel A, Hill R, Ward B, Dick A (2009) In situ image-based modeling. In: Proceedings of the IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR’09)Google Scholar
  16. Kim K, Lepetit V, Woo W (2010) Keyframe-based modeling and tracking of multiple 3D objects. In: Proceeding of the Sixth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR’10), Seoul, KoreaGoogle Scholar
  17. Kim S, DiVerdi S, Chang JS, Kang T, Iltis R, Höllerer T (2007) Implicit 3D modeling and tracking for anywhere augmentation. In: VRST ’07: proceedings of the 2007 ACM symposium on virtual reality software and technology, ACM, pp 19–28Google Scholar
  18. Klein G, Murray D (2007) Parallel tracking and mapping for small AR workspaces. In: Proceedings of the IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR’07), JapanGoogle Scholar
  19. Lepetit V, Vacchetti L, Thalmann D, Fua P (2003) Fully automated and stable registration for Augmented Reality applications. In: Proceedings of the Second IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR’03), Tokyo, JapanGoogle Scholar
  20. Neubert J, Pretlove J, Drummond T (2007) Semi-autonomous generation of appearance-based edge models from image sequences. In: Proceedings of the IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR’07), Nara, JapanGoogle Scholar
  21. Newcombe R, Davison A (2010) Live dense reconstruction with a single moving camera. In: Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on, IEEE, pp 1498–1505Google Scholar
  22. Pan Q, Reitmayr G, Drummond T (2009) ProFORMA: probabilistic feature-based on-line rapid model acquisition. In: Proceedings of the 20th British Machine Vision Conference (BMVC), LondonGoogle Scholar
  23. Reitmayr G, Eade E, Drummond T (2007) Semi-automatic annotations in unknown environments. In: Proceeding of the Sixth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR’07), Nara, JapanGoogle Scholar
  24. Rother C, Kolmogorov V, Blake A (2004) Grabcut: interactive foreground extraction using iterated graph cuts. ACM Trans Graph 23(3):309–314CrossRefGoogle Scholar
  25. Simon G (2006) Automatic online walls detection for immediate use in AR tasks. In: International Symposium on Mixed and Augmented RealityGoogle Scholar
  26. Tukey JW (1977) Explortary Data Analysis. Addison-Wesley, BostonGoogle Scholar
  27. Vacchetti L, Lepetit V, Fua P (2004) Combining edge and texture information for real-time accurate 3D camera tracking. In: International Symposium on Mixed and Augmented RealityGoogle Scholar
  28. Varadarajan V (1974) Lie groups, Lie algebras, and their representations. Prentice-Hall Inc., Inglewood CliffsMATHGoogle Scholar

Copyright information

© Springer-Verlag London Limited 2011

Authors and Affiliations

  • Pished Bunnun
    • 1
  • Sriram Subramanian
    • 1
  • Walterio W. Mayol-Cuevas
    • 1
  1. 1.Department of Computer ScienceUniversity of BristolBristolUK

Personalised recommendations