Cinévoqué: Design of a Passively Responsive Framework for Seamless Evolution of Experiences in Immersive Live-Action Movies

  • Jayesh S. PillaiEmail author
  • Amarnath Murugan
  • Amal Dev
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11746)


In this paper, we present a passively responsive framework for immersive movies, called Cinévoqué. The framework seamlessly alters the narrative and visual elements within an immersive live-action movie, based on real-time passive data, such as gaze direction and system time, obtained during the experience. The paper primarily focuses on the design and storytelling aspects of Cinévoqué, such as possible narrative structures and the design challenges involved in creating responsive experiences. We further examine the potential of this framework through two prototypes of varying complexity and responsive features, and the insights from them are used to suggest approaches that can lead to effective seamless narrative experiences.


Virtual reality VR storytelling Responsive narrative Presence 

Supplementary material

Supplementary material 1 (MP4 26825 kb)


  1. 1.
    Brillhart, J.: The Language of VR: Concepts and Ideas. Accessed 05 Apr 2019
  2. 2.
    Alger, M.: Visual Design Methods for Virtual Reality. Accessed 07 Apr 2019
  3. 3.
    Pillai, J.S., Ismail, A., Charles, H.P.: Grammar of VR storytelling: visual cues. In: Proceedings of the Virtual Reality International Conference-Laval Virtual 2017, p. 7. ACM (2017)Google Scholar
  4. 4.
    Bender, S.: Headset attentional synchrony: tracking the gaze of viewers watching narrative virtual reality. Media Pract. Educ. 1–20 (2018)Google Scholar
  5. 5.
    Brillhart, J.: In the Blink of a Mind - Attention. The Language of VR. Accessed 05 Apr 2019
  6. 6.
    Brillhart, J.: In the Blink of a Mind - Engagement. The Language of VR. Accessed 05 Apr 2019
  7. 7.
    Nielsen, L.T., et al.: Missing the point: an exploration of how to guide users’ attention during cinematic virtual reality. In: Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology, pp. 229–232. ACM (2016)Google Scholar
  8. 8.
    Fearghail, Colm O., Ozcinar, C., Knorr, S., Smolic, A.: Director’s cut - analysis of aspects of interactive storytelling for VR films. In: Rouse, R., Koenitz, H., Haahr, M. (eds.) ICIDS 2018. LNCS, vol. 11318, pp. 308–322. Springer, Cham (2018). Scholar
  9. 9.
    Rouse, R., Dionisio, M.: Looking Forward, Looking Back: Interactive Digital Storytelling and Hybrid Art Approaches, pp 93–108 (2018)Google Scholar
  10. 10.
    Vesterby, T., Voss, J.C., Hansen, J.P., Glenstrup, A.J., Hansen, D.W., Rudolph, M.: Gaze-guided viewing of interactive movies. Dig. Creativity 16(04), 193–204 (2005)CrossRefGoogle Scholar
  11. 11.
    Kirke, A., et al.: Unconsciously interactive Films in a cinema environment—a demonstrative case study. Dig. Creativity 29(2–3), 165–181 (2018)CrossRefGoogle Scholar
  12. 12.
    Tikka, P., Vuori, R., Kaipainen, M.: Narrative logic of enactive cinema: Obsession. Dig. Creativity 17(4), 205–212 (2006)CrossRefGoogle Scholar
  13. 13.
    Rico Garcia, O.D., Tag, B., Ohta, N., Sugiura, K.: Seamless multithread films in virtual reality. In: Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction, pp. 641–646. ACM (2017)Google Scholar
  14. 14.
    The Cinematic VR Field Guide, Jaunt Studios. Accessed 07 Apr 2019

Copyright information

© IFIP International Federation for Information Processing 2019

Authors and Affiliations

  1. 1.IDC School of Design, IIT BombayMumbaiIndia
  2. 2.Next Tech LabSRM Institute of Science and TechnologyChennaiIndia
  3. 3.Design Discipline, IIITDM JabalpurKhamariaIndia

Personalised recommendations