Construction of Mixed Reality Story Environment Based on Real Space Shape
- 1.2k Downloads
Abstract
We propose a system to construct Mixed Reality (MR) environments based on actual environments. Our goal is to develop MR content in which users and characters can coexist in an actual room and experience a story. This study represents a preliminary step in the development of such an MR experience. We proposed a method to construct an MR environment that uses three-dimensional information acquired from the actual environment based on rules. We extract valid plane information from three-dimensional information and use it. Virtual objects used for MR content can be placed in real space automatically. Rules are created by specifying the area and height of the plane of the real space. In this study, we placed seven types of objects in two types of rooms and confirmed that it is possible to construct an environment using a transmission-type head mount-ed display. However, under the current system, users cannot experience a story.
Keywords
Mixed Reality 3D recognition Dynamic constructionReferences
- 1.Cavazza, M., Charles, F., Mead, S.J.: Character-based interactive storytelling. IEEE Intell. Syst. 17, 17–24 (2002)CrossRefGoogle Scholar
- 2.Nakano, A., Koumura, J., Miura, E., Hoshino, J.: Spilant world: interactive emergent story game using episode tree. J. Soc. Art Sci. 6(3), 145–153 (2007)CrossRefGoogle Scholar
- 3.Mateas, M., Stern, A.: Façade: an experiment in building a fully-realized interactive drama. In: Game Developer’s Conference: Game Design Track (2003)Google Scholar
- 4.Dow, S., Mehta, M., Lausier, A., MacIntyre, B., Mateas, M.: Initial lessons from AR Façade, an interactive augmented reality drama. In: ACM SIGCHI International Conference on Advances in Computer Entertainment Technology (2006)Google Scholar
- 5.Nakevska, M., van der Sanden, A., Funk, M., Hu, J., Rauterberg, M.: Interactive storytelling in a mixed reality environment: the effects of interactivity on user experiences. In: Pisan, Y., Sgouros, N.M., Marsh, T. (eds.) ICEC 2014. LNCS, vol. 8770, pp. 52–59. Springer, Heidelberg (2014). https://doi.org/10.1007/978-3-662-45212-7_7CrossRefGoogle Scholar
- 6.Sra, M., Garrido-Jurado, S., Schmandt, C., Maes, P.: Procedurally generated virtual reality from 3D reconstructed physical space. In: Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology, pp. 191–200. ACM (2016)Google Scholar