Interactive 3-D indoor modeler for virtualizing service fields

Abstract

This paper describes an interactive 3-D indoor modeler that effectively creates photo-realistic 3-D indoor models from multiple photographs. This modeler supports the creation of 3-D models from photographs by implementing interaction techniques that use geometric constraints estimated from photographs and visualization techniques that help to easily understand shapes of 3-D models. We evaluated the availability and usability by applying the modeler to model service fields where actual workers provide services and an experience-based exhibit. Our results confirmed that the modeler enables the creation of large-scale indoor environments such as hot-spring inns and event sites at a relatively modest cost. We also confirmed that school children could learn modeling operations and create 3-D models from a photograph for approximately 20 min because of the easy operations. In addition, we describe additional functions that increase the effectiveness of 3-D modeling based on knowledge from service-field modeling. We present applications for behavior analysis of service workers and for 3-D indoor navigation using augmented virtuality (AV)-based visualization realized by photo-realistic 3-D models.

This is a preview of subscription content, log in to check access.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21

References

  1. Bay H, Ess A, Tuytelaars T, Gool L (2008) Speeded-up robust features (SURF). Comput Vis Image Underst 110(3):346–359

    Article  Google Scholar 

  2. Bunnum P, Mayol-Cuevas W (2008) Outlin AR: an assisted interactive model building system with reduced computational effort. In: Proceedings of IEEE/ACM international symposium on mixed and augmented reality, pp 61–64

  3. Criminisi A, Reid I, Zisserman A (2000) Single view metrology. Int J Comput Vis 40(2):123–148

    MATH  Article  Google Scholar 

  4. Criminisi A, Perez P, Toyama K (2004) Region filling and object removal by exemplar-based image inpainting. IEEE Trans Image Process 13:1200–1212

    Article  Google Scholar 

  5. Debevec P, Taylor C, Malik J (1996) Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach. In: Proceedings of SIGGRAPH, pp 11–20

  6. Fischler M, Bolles R (1981) Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun ACM 24(6):381–395

    MathSciNet  Article  Google Scholar 

  7. Furukawa Y, Curless B, Seitz M, Szeliski R (2009) Reconstructing building interiors from images. In: Proceedings of international conference on computer vision, pp 80–87

  8. Gee A, Chekhlov D, Calway A, Mayol-Cuevas W (2008) Discovering higher level structure in Visual SLAM. IEEE Trans Robot 26(5):980–990

    Article  Google Scholar 

  9. Goesele M, Snavely N, Curless B, Hppe H, Seitz M (2007) Multi-view stereo for community photo collections. In: Proceedings of international conference on computer vision, pp 14–20

  10. Google (2011) Google SketchUp, http://sketchup.google.com/

  11. Hartley R, Zisserman A (2000) Multiple view geometry in computer vision. Cambridge University Press, ISBN: 0521623049

  12. Ishikawa T, Kourogi M, Kurata T (2011) Economic and synergistic pedestrian tracking system with service cooperation for indoor environments. Int J Organ Collect Intell 2(1):1–20

    Google Scholar 

  13. Kitajima M, Nakajima M, Toyota M (2010) Cognitive chrono-ethnography: a method for studying behavioral selections in daily activities. In: Proceedings of annual meeting of human factors and ergonomics society

  14. Kourogi M, Sakata N, Okuma T, Kurata T (2006) Indoor/outdoor pedestrian navigation with an embedded GPS/RFID/self-contained sensor system. In: Proceedings of the 16th international conference on artificial reality and telexistence, pp 1310–1321

  15. Kurata T, Kourogi M, Ishikawa T, Hyun J, Park A, (2010) Service cooperation and co-creative intelligence cycles based on mixed-reality technology. In: Proceedings of international conference on industrial informatics, pp. 967–972

  16. Lowe D (2004) Distinctive image features from scale-invariant keypoints, Int. J Comput Vis 60(2):91–110

    Article  Google Scholar 

  17. Neubert J, Pretlove J, Drummond T (2007) Semi-autonomous generation of appearance-based edge models from image sequences. In: Proceedings of IEEE/ACM international symposium on mixed and augmented reality, pp 79–89

  18. Oh B, Chen M, Dorsey J, Durand F (2001) Image-based modeling and photo editing. In: Proceedings of SIGGRAPH, pp 433–442

  19. Oh J, Stuerzlinger W, Danahy J (2005) Comparing SESAME and sketching for conceptual 3D design. In: Proceedings eurographics workshop on sketch based interface and modeling, pp 81–88

  20. Simon G (2010) In situ 3D sketching using a video camera as an interaction and tracking device. In: Proceedings of eurographics

  21. Sinha SN, Steedly D, Szeliski R, Agrawala M, Pollefeys M (2008) Interactive 3D architectural modeling from unordered photo collections. ACM Trans Graph 27(5):159:1–159:10. doi:10.1145/1409060.1409112

  22. Snavely N, Seitz M, Szeliski R (2008) Modeling the world from internet photo collections. Int J Comput Vis 80:189–210

    Article  Google Scholar 

  23. van den Hengel A, Dick A, Thormählen T, Ward B, Torr PHS (2007) VideoTrace: rapid interactive scene modeling from video. ACM Trans Graph 26(3). doi:10.1145/1276377.1276485

  24. van den Hengel A, Hill R, Ward B, Dick A (2009) In situ image-based modeling. In: Proceedings of IEEE/ACM international symposium on mixed and augmented reality, pp 107–110

  25. Williams L (1978) Casting curved shadows on curved surfaces. In: Proceedings of SIGGRAPH, pp 270–274

Download references

Acknowledgments

This research was entrusted by the Ministry of Economy, Trade and Industry (METI) in Japan.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Tomoya Ishikawa.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Ishikawa, T., Thangamani, K., Kourogi, M. et al. Interactive 3-D indoor modeler for virtualizing service fields. Virtual Reality 17, 89–109 (2013). https://doi.org/10.1007/s10055-011-0202-1

Download citation

Keywords

  • Interaction
  • 3-D indoor model
  • Service field
  • Augmented virtuality