Comparing Effects of Different Cinematic Visualization Strategies on Viewer Comprehension

  • Arnav Jhala
  • R. Michael Young
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5915)

Abstract

Computational storytelling systems have mainly focused on the construction and evaluation of textual discourse for communicating stories. Few intelligent camera systems have been built in 3D environments for effective visual communication of stories. The evaluation of effectiveness of these systems, if any, has focused mainly on the run-time performance of the camera placement algorithms. The purpose of this paper is to present a systematic cognitive-based evaluation methodology to compare effects of different cinematic visualization strategies on viewer comprehension of stories. In particular, an evaluation of automatically generated visualizations from Darshak, a cinematic planning system, against different hand-generated visualization strategies is presented. The methodology used in the empirical evaluation is based on QUEST, a cognitive framework for question-answering in the context of stories, that provides validated predictors for measuring story coherence in readers. Data collected from viewers, who watch the same story renedered with three different visualization strategies, is compared with QUEST’s predictor metrics. Initial data analysis establishes significant effect on choice of visualization strategy on story comprehension. It further shows a significant effect of visualization strategy selected by Darshak on viewers’ measured story coherence.

Keywords

Intelligent Camera Control Computational Models of Narrative Discourse Comprehension Visual Discourse 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Amerson, D., Kime, S., Young, R.M.: Real-time Cinematic Camera Control for Interactive Narratives. In: ACM ACE, Valencia, Spain, p. 369 (2005)Google Scholar
  2. 2.
    Bares, W., Lester, J.: Cinematographic User Models for Automated Realtime Camera Control in Dynamic 3D Environments. In: User Modeling, Vienna, Austria, pp. 215–226 (1997)Google Scholar
  3. 3.
    Bares, W., McDermott, S., Boudreaux, C., Thainimit, S.: Virtual 3D Camera Composition from Frame Constraints. In: ACM Multimedia, Los Angeles, USA, pp. 177–186 (2000)Google Scholar
  4. 4.
    Callaway, C.: Narrative Prose Generation. Artificial Intelligence 139, 213–252 (2002)CrossRefGoogle Scholar
  5. 5.
    Christian, D., Young, R.M.: Comparing Cognitive and Computational Models of Narrative Structure. In: AAAI, San Jose, USA, pp. 385–390 (2004)Google Scholar
  6. 6.
    Christianson, D., Anderson, S., He, L., Salesin, D., Weld, D., Cohen, M.: Declarative Camera Control for Automatic Cinematography. In: AAAI/IAAI, Portland, USA, pp. 148–155 (1996)Google Scholar
  7. 7.
    Christie, M., Machap, R., Normand, J.-M., Olivier, P., Pickering, J.: Virtual Camera Planning: A Survey. In: Smart Graphics, Munich, Germany, pp. 40–52 (2005)Google Scholar
  8. 8.
    Graesser, A.C., Lang, K.L., Roberts, R.M.: Question Answering in the Context of Stories. Journal of Experimental Psychology: General 120(3), 254–277 (1991)CrossRefGoogle Scholar
  9. 9.
    Jhala, A., Young, R.M.: A Discourse Planning Approach to Cinematic Camera Control for Narratives in Virtual Environments. In: AAAI, Pittsburgh, USA, pp. 307–312 (2005)Google Scholar
  10. 10.
    Jhala, A., Young, R.M.: Representational Requirements for a Plan-Based Approach to Virtual Cinematography. In: AIIDE, Marina Del Rey, USA, pp. 36–41 (2006)Google Scholar
  11. 11.
    Meehan, J.R.: Tale-Spin, An Interactive Program that Writes Stories. In: IJCAI, Cambridge, USA, pp. 91–98 (1977)Google Scholar
  12. 12.
    Halper, N., Helbing, S., Strothotte, T.: A Camera Engine for Computer Games: Managing the Trade-off Between Constraint Satisfaction and Frame Coherence. In: Eurographics, Manchester, UK, vol. 20, pp. 174–183 (2001)Google Scholar
  13. 13.
    Riedl, M.O., Young, R.M.: An Intent-Driven Planner for Multi-Agent Story Generation. In: AAMAS, New York (2004)Google Scholar
  14. 14.
    Chatman, S.: Story and Discourse: Narrative Structure in Fiction and Film. Cornell University Press, Ithaca (1980)Google Scholar
  15. 15.
    Schank, R.C., Abelson, R.P.: Scripts, Plans, Goals and Understanding: an Inquiry into Human Knowledge Structures. L. Erlbaum, Hillsdale (1977)MATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Arnav Jhala
    • 1
  • R. Michael Young
    • 2
  1. 1.University of CaliforniaSanta Cruz
  2. 2.North Carolina State UniversityRaleigh

Personalised recommendations