Objective Metrics for Interactive Narrative

  • Nicolas Szilas
  • Ioana Ilea
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8832)


This paper describes, implements and assesses a series of user-log indicators for automatic interactive narrative evaluation. The indicators include length and duration, diversity, renewal, choice range, choice frequency, and choice variety. Based on a laboratory experiment with players, a significant positive correlation has been observed between two indicators and some aspects of the interactive narrative experience measured by validated scales based on questionnaires.


interactive storytelling interactive narrative interactive drama evaluation metrics analytics 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Aylett, R., Louchart, S.: Being There: Participants and Spectators in Interactive Narrative. In: Cavazza, M., Donikian, S. (eds.) ICVS-VirtStory 2007. LNCS, vol. 4871, pp. 117–128. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  2. 2.
    Ben, S., McCoy, J., Treanor, M., Reed, A., Wardrip-Fruin, N., Mateas, M.: Story Sampling: A New Approach to Evaluating and Authoring Interactive Narrative. In: Foundations of Digital Games 2014, FDG 2014 (2014)Google Scholar
  3. 3.
    Cavazza, M., Charles, F., Mead, S.J.: Characters in Search of an author: AI-based Virtual Storytelling. In: Balet, O., Subsol, G., Torguet, P. (eds.) ICVS 2001. LNCS, vol. 2197, pp. 145–154. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  4. 4.
    Cheong, Y.-G., Young, R.M.: Narrative Generation for Suspense: Modeling and Evaluation. In: Spierling, U., Szilas, N. (eds.) ICIDS 2008. LNCS, vol. 5334, pp. 144–155. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  5. 5.
    Habonneau, N., Richle, U., Szilas, N., Dumas, J.E.: 3D Simulated Interactive Drama for Teenagers Coping with a Traumatic Brain Injury in a Parent. In: Oyarzun, D., Peinado, F., Young, R.M., Elizalde, A., Méndez, G. (eds.) ICIDS 2012. LNCS, vol. 7648, pp. 174–182. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  6. 6.
    Klimmt, C., Roth, C., Vermeulen, I., Vorderer, P.: The Empirical Assessment of The User Experience In Interactive Storytelling: Construct Validation of Candidate Evaluation Measures - IRIS FP7 D7.2,
  7. 7.
    Laurel, B.: Computers as Theatre. Addison-Wesley Professional, New York (1993)Google Scholar
  8. 8.
    Lester, J.C., Rowe, J.P., Mott, B.W.: Narrative-Centered Learning Environments: A Story-Centric Approach to Educational Games. In: Emerging Technologies for the Classroom, pp. 223–237. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  9. 9.
    Marsella, S.C., Johnson, W.L., LaBore, C.: Interactive pedagogical drama. In: Proceedings of the fourth International Conference on Autonomous agents - AGENTS 2000, pp. 301–308. ACM Press, New-York (2000)CrossRefGoogle Scholar
  10. 10.
    Mateas, M., Stern, A.: Integrating Plot, Character and Natural Language Processing in the Interactive Drama Façade. In: Göbel, S., et al. (eds.) Proceedings of the Technologies for Interactive Digital Storytelling and Entertainment (TIDSE) Conference, pp. 139–151. Fraunhofer IRB, Darmstadt (2003)Google Scholar
  11. 11.
    Miller, L.C., Marsella, S., Dey, T., Appleby, P.R., Christensen, J.L., Klatt, J., Read, S.J.: Socially Optimized Learning in Virtual Environments (SOLVE). In: André, E. (ed.) ICIDS 2011. LNCS, vol. 7069, pp. 182–192. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  12. 12.
    Murray, J.H.: Hamlet on the Holodeck: The Future of Narrative in Cyberspace. Free Press, New York (1997)Google Scholar
  13. 13.
    Porteous, J., Charles, F., Cavazza, M.: NetworkING: Using Character Relationships for Interactive Narrative Generation. In: Gini, et al. (eds.) Proceedings of the 2013 International Conference on Autonomous Agents and Multi-agent Systems, pp. 595–602. IFAAMAS, Richland (2013)Google Scholar
  14. 14.
    Riedl, M.O., Young, R.M.: From Linear Story Generation to Branching Story Graphs. IEEE Comput. Graph. Appl. 26(3), 23–31 (2006)CrossRefGoogle Scholar
  15. 15.
    Roth, C., Klimmt, C., Vermeulen, I.E., Vorderer, P.: The experience of interactive storytelling: Comparing “Fahrenheit” with “Façade”. In: Anacleto, J.C., Fels, S., Graham, N., Kapralos, B., Saif El-Nasr, M., Stanley, K. (eds.) ICEC 2011. LNCS, vol. 6972, pp. 13–21. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  16. 16.
    Schoenau-Fog, H.: Hooked! – Evaluating Engagement as Continuation Desire in Interactive Narratives. In: André, E., et al. (eds.) ICIDS 2011. LNCS, vol. 7069, pp. 219–230. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  17. 17.
    Seif El-Nasr, M., Drachen, A., Canossa, A.: Game Analytics - Maximizing the Value of Player Data. Springer, Heidelberg (2013)Google Scholar
  18. 18.
    Seif El-Nasr, M., Milam, D., Maygoli, T.: Experiencing interactive narrative: A qualitative analysis of Façade. Entertain. Comput. 4(1), 39–52 (2013)CrossRefGoogle Scholar
  19. 19.
  20. 20.
    Szilas, N.: A Computational Model of an Intelligent Narrator for Interactive Narratives. Appl. Artif. Intell. 21(8), 753–801 (2007)CrossRefGoogle Scholar
  21. 21.
    Szilas, N.: IDtension: a narrative engine for Interactive Drama. In: Göbel, S., et al. (eds.) Proceedings of the Technologies for Interactive Digital Storytelling and Entertainment (TIDSE) Conference, pp. 187–203. Fraunhofer IRB, Darmstadt (2003)Google Scholar
  22. 22.
    Szilas, N.: Requirements for Computational Models of Interactive Narrative. In: Finlayson, M. (ed.) Computational Models of Narrative, papers from the 2010 AAAI Fall Symposium, pp. 62–68. AAAI Press, Menlo Park (2010)Google Scholar
  23. 23.
    Szilas, N., Dumas, J., Richle, U., Habonneau, N., Boggini, T.: Nothing For Dinner,
  24. 24.
    Vermeulen, I., Roth, C., Vorderer, P., Klimmt, C.: Measuring user responses to interactive stories: Towards a standardized assessment tool. In: Aylett, R., Lim, M.Y., Louchart, S., Petta, P., Riedl, M. (eds.) ICIDS 2010. LNCS, vol. 6432, pp. 38–43. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  25. 25.
    Wardrip-Fruin, N., Mateas, M., Dow, S., Sali, S.: Agency reconsidered. In: Proceedings of DiGRA 2009 (2009)Google Scholar
  26. 26.
    Zhu, J.: Designing an Interdisciplinary User Evaluation for the Riu Computational Narrative System. In: Oyarzun, D., Peinado, F., Young, R.M., Elizalde, A., Méndez, G. (eds.) ICIDS 2012. LNCS, vol. 7648, pp. 126–131. Springer, Heidelberg (2012)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Nicolas Szilas
    • 1
  • Ioana Ilea
    • 1
  1. 1.TECFA, FPSE, University of GenevaGenève 4Switzerland

Personalised recommendations