Guidance Method to Allow a User Free Exploration with a Photorealistic View in 3D Reconstructed Virtual Environments

  • Sho IwasakiEmail author
  • Takuji Narumi
  • Tomohiro Tanikawa
  • Michitaka Hirose
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10291)


Architectural reconstruction based on photographs is important for digitally archiving historic buildings. In addition, freely exploring a reconstructed Virtual Environment (VE) enhances users’ understanding of and interest in the background cultural information. However, reconstructed models often have errors as well as terribly distorted views when viewed from a point distant from where the pictures were taken. Because of this problem, it is difficult to allow users to freely explore in a VE while keeping photorealistic views.

In this study, we propose a new method that enables both free exploration and high rendering quality by implicitly guiding users to the well-rendered viewpoints. First, we evaluate the rendering quality of the reconstructed model with view-dependent texture mapping. Second, by combining the evaluation results, we create a type of potential field that defines which direction to guide the users. Experimental results suggest that our proposed method can decrease the distortion in the views during VE exploration, and can possibly allow free exploration in VEs.


User guidance Image-based rendering 3D reconstruction Virtual environment Digital museum 



This research and development work was supported by the MIC/SCOPE#162303009.


  1. 1.
    Cairncross, S., Mannion, M.: Interactive multimedia and learning: realizing the benefits. Innovations Educ. Teach. Int. 38(2), 156–164 (2001)CrossRefGoogle Scholar
  2. 2.
    Narumi, T., Hayashi, O., Kasada, K., Yamazaki, M., Tanikawa, T., Hirose, M.: Digital diorama: AR exhibition system to convey background information for museums. In: Shumaker, R. (ed.) VMR 2011. LNCS, vol. 6773, pp. 76–86. Springer, Heidelberg (2011). doi: 10.1007/978-3-642-22021-0_10 CrossRefGoogle Scholar
  3. 3.
    Snavely, N., Seitz, S.M., Szeliski, R.: Photo tourism: exploring photo collections in 3D. In: ACM Transactions on Graphics (TOG), vol. 25, pp. 835–846. ACM (2006)Google Scholar
  4. 4.
    Musialski, P., Wonka, P., Aliaga, D.G., Wimmer, M., Gool, L.V., Purgathofer, W.: A survey of urban reconstruction. In: Computer Graphics Forum, vol. 32, no. 6, pp. 146–177. Wiley Online Library (2013)Google Scholar
  5. 5.
    Tanaka, R., Narumi, T., Tanikawa, T., Hirose, M.: Guidance field: potential field to guide users to target locations in virtual environments. In: 2016 IEEE Symposium on 3D User Interfaces (3DUI), pp. 39–48. IEEE (2016)Google Scholar
  6. 6.
    Microsoft Corporation. Photosynth.
  7. 7.
    Snavely, N., Garg, R., Seitz, S.M., Szeliski, R.: Finding paths through the world’s photos. In: ACM Transactions on Graphics (TOG), vol. 27, no. 3, p. 15 (2008)Google Scholar
  8. 8.
    Furukawa, Y., Curless, B., Seitz, S.M., Szeliski, R.: Reconstructing building interiors from images. In: 2009 IEEE 12th International Conference on Computer Vision, pp. 80–87. IEEE (2009)Google Scholar
  9. 9.
    Xiao, J., Furukawa, Y.: Reconstructing the worlds museums. Int. J. Comput. Vis. 110(3), 243–258 (2014)CrossRefGoogle Scholar
  10. 10.
    Galyean, T.A.: Guided navigation of virtual environments. In: Proceedings of the 1995 Symposium on Interactive 3D Graphics, p. 103-ff. ACM (1995)Google Scholar
  11. 11.
    Agisoft PhotoScan User Manual, Professional Edition, Version 1.2.
  12. 12.
    Kazhdan, M., Bolitho, M., Hoppe, H.: Poisson surface reconstruction. In: Proceedings of the Fourth Eurographics Symposium on Geometry Processing, vol. 7, pp. 61–70 (2006)Google Scholar
  13. 13.
    Cignoni, P., Callieri, M., Corsini, M., Dellepiane, M., Ganovelli, F., Ranzuglia, G.: MeshLab: an open-source mesh processing tool. In: Scarano, V., De Chiara, R., Erra, U. (eds.) Eurographics Italian Chapter Conference. The Eurographics Association (2008)Google Scholar
  14. 14.
    Debevec, P.E., Taylor, C.J., Malik, J.: Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach. In: Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, pp. 11–20, ACM. (1996)Google Scholar
  15. 15.
    Buehler, C., Bosse, M., McMillan, L., Gortler, S., Cohen, M.: Unstructured lumigraph rendering. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, pp. 425–432. ACM (2001)Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Sho Iwasaki
    • 1
    Email author
  • Takuji Narumi
    • 1
  • Tomohiro Tanikawa
    • 1
  • Michitaka Hirose
    • 1
  1. 1.Graduate School of Information Science and TechnologyThe University of TokyoBunkyo-ku, TokyoJapan

Personalised recommendations