Advertisement

Camera-Based In-situ 3D Modeling Techniques for AR Diorama in Ubiquitous Virtual Reality

  • Atsushi Umakatsu
  • Hiroyuki Yasuhara
  • Tomohiro Mashita
  • Kiyoshi Kiyokawa
  • Haruo Takemura
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6773)

Abstract

We have been studying an in-situ 3D modeling and authoring system, AR Diorama. In the AR Diorama system, a user is able to reconstruct a 3D model of a real object of concern and describe behaviors of the model by stroke input. In this article, we will introduce two ongoing studies on interactive 3D reconstruction techniques. First technique is feature-based. Natural feature points are first extracted and tracked. A convex hull is then obtained from the feature points based on Delaunay tetrahedralisation. The polygon mesh is carved to approximate the target object based on a feature-point visibility test. Second technique is region-based. Foreground and background color distribution models are first estimated to extract an object region. Then a 3D model of the target object is reconstructed by silhouette carving. Experimental results show that the two techniques can reconstruct a better 3D model interactively compared with our previous system.

Keywords

AR authoring AR Diorama 3D reconstruction 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Tateishi, T., Mashita, T., Kiyokawa, K., Takemura, H.: A 3D Reconstruction System using a Single Camera and Pen-Input for AR Content Authoring. In: Proc. of Human Interface Symposium 2009, vol. 0173 (2009) (in Japanese)Google Scholar
  2. 2.
    Lee, G.A., Nelles, C., Billinghurst, M., Kim, G.J.: Immersive Authoring of Tangible Augmented Reality Applications. In: Proc. of the 3rd IEEE International Symposium on Mixed and Augmented Reality, pp. 172–181 (2004)Google Scholar
  3. 3.
    Fudono, K., Sato, T., Yokoya, N.: Interactive 3-D Modeling System with Capturing Support Interface Using a Hand-held Video Camera. Transaction of the Virtual Reality Society of Japan 10(4), 599–608 (2005) (in Japanese)Google Scholar
  4. 4.
    Pan, Q., Reitmayr, G., Drummond, T.: ProFORMA: Probabilistic Feature-based On-line Rapid Model Acquisition. In: Proc. of the 20th British Machine Vision Conference (2009)Google Scholar
  5. 5.
    Bastian, J., Ward, B., Hill, R., Hengel, A., Dick, A.: Interactive Modelling for AR Applications. In: Proc. of the 9th IEEE and ACM International Symposium on Mixed and Augmented Reality, pp. 199–205 (2010)Google Scholar
  6. 6.
    Hengel, A., Dick, A., Thormählen, T., Ward, B., Torr, P.H.S.: VideoTrace: Rapid Interactive Scene Modelling from Video. ACM Transactions on Graphics 26(3), Article 86 (2007)Google Scholar
  7. 7.
    Klein, G., Murray, D.: Parallel Tracking and Mapping for Small AR Workspaces. In: Proc. of the 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, pp. 1–10 (2007)Google Scholar
  8. 8.
    Boykov, Y., Kolmogorov, V.: An Experimental Comparison of Min-cut/max-flow Algorithms for Energy Minimization in Vision. IEEE Transactions on Pattern Analysis and Machine Intelligence 26(9), 1124–1137 (2004)CrossRefzbMATHGoogle Scholar
  9. 9.
    Thorne, M., Burke, D., van de Panne, M.: Motion Doodles: An Interface for Sketching Character Motion. ACM Transactions on Graphics 23(3), 424–431 (2004)CrossRefGoogle Scholar
  10. 10.
    Cohen, J.M., Hughes, J.F., Zeleznik, R.C.: Harold: a world made of drawings. In: Proc. of the 1st International Symposium on Non-photorealistic Animation and Rendering, pp. 83–90 (2000)Google Scholar
  11. 11.
    Bergig, O., Hagbi, N., El-Sana, J., Billinghurst, M.: In-place 3D Sketching for Authoring and Augmenting Mechanical Systems. In: Proc. of the 8th IEEE International Symposium on Mixed and Augmented Reality, pp. 87–94 (2009)Google Scholar
  12. 12.
    Popovic, J., Seitz, S.M., Erdmann, M., Popovic, Z., Witkin, A.: Interactive Manipulation of Rigid Body Simulations. In: Proc. of the 27th Annual Conference on Computer Graphics and Interactive Techniques, pp. 209–217 (2000)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Atsushi Umakatsu
    • 1
  • Hiroyuki Yasuhara
    • 1
  • Tomohiro Mashita
    • 1
    • 2
  • Kiyoshi Kiyokawa
    • 1
    • 2
  • Haruo Takemura
    • 1
    • 2
  1. 1.Graduate School of Information Science and TechnologyOsaka UniversitySuitaJapan
  2. 2.Cybermedia CenterOsaka UniversityToyonakaJapan

Personalised recommendations