Virtual Reality

, Volume 17, Issue 2, pp 89–109 | Cite as

Interactive 3-D indoor modeler for virtualizing service fields

  • Tomoya IshikawaEmail author
  • Kalaivani Thangamani
  • Masakatsu Kourogi
  • Andrew P. Gee
  • Walterio Mayol-Cuevas
  • Jungwoo Hyun
  • Takeshi Kurata
SI: Mixed and Augmented Reality


This paper describes an interactive 3-D indoor modeler that effectively creates photo-realistic 3-D indoor models from multiple photographs. This modeler supports the creation of 3-D models from photographs by implementing interaction techniques that use geometric constraints estimated from photographs and visualization techniques that help to easily understand shapes of 3-D models. We evaluated the availability and usability by applying the modeler to model service fields where actual workers provide services and an experience-based exhibit. Our results confirmed that the modeler enables the creation of large-scale indoor environments such as hot-spring inns and event sites at a relatively modest cost. We also confirmed that school children could learn modeling operations and create 3-D models from a photograph for approximately 20 min because of the easy operations. In addition, we describe additional functions that increase the effectiveness of 3-D modeling based on knowledge from service-field modeling. We present applications for behavior analysis of service workers and for 3-D indoor navigation using augmented virtuality (AV)-based visualization realized by photo-realistic 3-D models.


Interaction 3-D indoor model Service field Augmented virtuality 



This research was entrusted by the Ministry of Economy, Trade and Industry (METI) in Japan.


  1. Bay H, Ess A, Tuytelaars T, Gool L (2008) Speeded-up robust features (SURF). Comput Vis Image Underst 110(3):346–359CrossRefGoogle Scholar
  2. Bunnum P, Mayol-Cuevas W (2008) Outlin AR: an assisted interactive model building system with reduced computational effort. In: Proceedings of IEEE/ACM international symposium on mixed and augmented reality, pp 61–64Google Scholar
  3. Criminisi A, Reid I, Zisserman A (2000) Single view metrology. Int J Comput Vis 40(2):123–148zbMATHCrossRefGoogle Scholar
  4. Criminisi A, Perez P, Toyama K (2004) Region filling and object removal by exemplar-based image inpainting. IEEE Trans Image Process 13:1200–1212CrossRefGoogle Scholar
  5. Debevec P, Taylor C, Malik J (1996) Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach. In: Proceedings of SIGGRAPH, pp 11–20Google Scholar
  6. Fischler M, Bolles R (1981) Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun ACM 24(6):381–395MathSciNetCrossRefGoogle Scholar
  7. Furukawa Y, Curless B, Seitz M, Szeliski R (2009) Reconstructing building interiors from images. In: Proceedings of international conference on computer vision, pp 80–87Google Scholar
  8. Gee A, Chekhlov D, Calway A, Mayol-Cuevas W (2008) Discovering higher level structure in Visual SLAM. IEEE Trans Robot 26(5):980–990CrossRefGoogle Scholar
  9. Goesele M, Snavely N, Curless B, Hppe H, Seitz M (2007) Multi-view stereo for community photo collections. In: Proceedings of international conference on computer vision, pp 14–20Google Scholar
  10. Google (2011) Google SketchUp,
  11. Hartley R, Zisserman A (2000) Multiple view geometry in computer vision. Cambridge University Press, ISBN: 0521623049Google Scholar
  12. Ishikawa T, Kourogi M, Kurata T (2011) Economic and synergistic pedestrian tracking system with service cooperation for indoor environments. Int J Organ Collect Intell 2(1):1–20Google Scholar
  13. Kitajima M, Nakajima M, Toyota M (2010) Cognitive chrono-ethnography: a method for studying behavioral selections in daily activities. In: Proceedings of annual meeting of human factors and ergonomics societyGoogle Scholar
  14. Kourogi M, Sakata N, Okuma T, Kurata T (2006) Indoor/outdoor pedestrian navigation with an embedded GPS/RFID/self-contained sensor system. In: Proceedings of the 16th international conference on artificial reality and telexistence, pp 1310–1321Google Scholar
  15. Kurata T, Kourogi M, Ishikawa T, Hyun J, Park A, (2010) Service cooperation and co-creative intelligence cycles based on mixed-reality technology. In: Proceedings of international conference on industrial informatics, pp. 967–972Google Scholar
  16. Lowe D (2004) Distinctive image features from scale-invariant keypoints, Int. J Comput Vis 60(2):91–110CrossRefGoogle Scholar
  17. Neubert J, Pretlove J, Drummond T (2007) Semi-autonomous generation of appearance-based edge models from image sequences. In: Proceedings of IEEE/ACM international symposium on mixed and augmented reality, pp 79–89Google Scholar
  18. Oh B, Chen M, Dorsey J, Durand F (2001) Image-based modeling and photo editing. In: Proceedings of SIGGRAPH, pp 433–442Google Scholar
  19. Oh J, Stuerzlinger W, Danahy J (2005) Comparing SESAME and sketching for conceptual 3D design. In: Proceedings eurographics workshop on sketch based interface and modeling, pp 81–88Google Scholar
  20. Simon G (2010) In situ 3D sketching using a video camera as an interaction and tracking device. In: Proceedings of eurographicsGoogle Scholar
  21. Sinha SN, Steedly D, Szeliski R, Agrawala M, Pollefeys M (2008) Interactive 3D architectural modeling from unordered photo collections. ACM Trans Graph 27(5):159:1–159:10. doi: 10.1145/1409060.1409112
  22. Snavely N, Seitz M, Szeliski R (2008) Modeling the world from internet photo collections. Int J Comput Vis 80:189–210CrossRefGoogle Scholar
  23. van den Hengel A, Dick A, Thormählen T, Ward B, Torr PHS (2007) VideoTrace: rapid interactive scene modeling from video. ACM Trans Graph 26(3). doi: 10.1145/1276377.1276485
  24. van den Hengel A, Hill R, Ward B, Dick A (2009) In situ image-based modeling. In: Proceedings of IEEE/ACM international symposium on mixed and augmented reality, pp 107–110Google Scholar
  25. Williams L (1978) Casting curved shadows on curved surfaces. In: Proceedings of SIGGRAPH, pp 270–274Google Scholar

Copyright information

© Springer-Verlag London Limited 2011

Authors and Affiliations

  • Tomoya Ishikawa
    • 1
    Email author
  • Kalaivani Thangamani
    • 1
  • Masakatsu Kourogi
    • 1
  • Andrew P. Gee
    • 2
  • Walterio Mayol-Cuevas
    • 2
  • Jungwoo Hyun
    • 1
  • Takeshi Kurata
    • 1
  1. 1.Center for Service Research, National Institute of Advanced Industrial Science and TechnologyTsukubaJapan
  2. 2.University of BristolBristolUK

Personalised recommendations