User Modeling and User-Adapted Interaction

, Volume 18, Issue 5, pp 417–453 | Cite as

A stroll with Carletto: adaptation in drama-based tours with virtual characters

  • Rossana Damiano
  • Cristina Gena
  • Vincenzo Lombardo
  • Fabrizio Nunnari
  • Antonio Pizzo
Original Paper


In this paper, we present an application for character-based guided tours on mobile devices. The application is based on the Dramatour methodology for information presentation, which incorporates a dramatic attitude in character-based presentations. The application has been developed for a historical site and is based on a virtual character, “Carletto”, a spider with an anthropomorphic aspect, who engages in a dramatized presentation of the site. Content items are delivered in a location-aware fashion, relying on a wireless network infrastructure, with visitors who can stroll freely. The selection of contents keeps track of user location and of the interaction history, in order to deliver the appropriate type and quantity of informative items, and to manage the given/new distinction in discourse. The communicative strategy of the character is designed to keep it believable along the interaction with the user, while enforcing dramatization effects. The design of the communicative strategy relies on the fact that the units of the presentation are tagged with metadata concerning their content and communicative function. The description of the application is accompanied by an evaluation study based on a sample of about 300 visitors, carried out in April 2006, when the installation was open to the public for 1 week.


Interactive drama Virtual characters Cultural heritage Mobile computing Adaptive applications 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Adomavicius G., Tuzhilin A.: Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions. IEEE Trans. Knowl. Data Eng. 17(6), 734–749 (2005)CrossRefGoogle Scholar
  2. Aoki, P.M., Grinter, R.E., Hurst, A., Szymanski, M.H., Thornton, J.D., Woodruff, A.: Sotto voce: exploring the interplay of conversation and mobile audio spaces. In: Proceedings of the SIECHI Conference on Human Factors in Computing Systems, pp. 431–438. ACM, USA (2002)Google Scholar
  3. Aroyo, L., Brussee, R., Gorgels, P., Rutledge, L., Stash, N., Wang, Y.: Personalized museum experience: the rijksmuseum use case. In: Trant, J., Bearman, D. (eds.) Proceedings of Museums on the Web 2007: Selected Papers from an International Conference. San Francisco, CA, USA. (2007). Accessed May, 2008
  4. Bianchi, A., Zancanaro, M.: Tracking users’ movements in an artistic physical space. In: Proceedings of the i3 Annual Conference, European network for intelligent information interfaces, pp. 103–106 (1999)Google Scholar
  5. Bickmore, T., Cassel, J.: Social dialogue with embodied conversational agents. In: Advances in Natural Multimodal Dialogue Systems, vol. 30, pp. 23–54. Springer, Netherlands (2005)Google Scholar
  6. Borriello G., Chalmers M., LaMarca A., Nixon P.: Delivering real-world ubiquitous location systems. Commun. ACM 48(3), 36–41 (2005)CrossRefGoogle Scholar
  7. Bruner J.: The narrative construction of reality. Crit. Inq. 18(1), 1–21 (1991)CrossRefGoogle Scholar
  8. Callaway C., Not E., Novello A., Rocchi C., Stock O., Zancanaro M.: Automatic cinematography and multilingual NLG for generating video documentaries. Artif. Intell. 165, 57–89 (2005)CrossRefGoogle Scholar
  9. Carmagnola, F., Cena, F., Console, L., Cortassa, O., Gena, C., Goy, A., Torre, I., Toso, A., Vernero, F.: Tag-based user models for social multi-device adaptive guides (2008, this issue)Google Scholar
  10. Carroll J., Rosson M.: The paradox of the active user. In: Carrol, J.(eds) Interfacing Thought: Cognitive Aspects of Human-Computer Interaction, pp. 80–111. MIT Press, Cambridge (1987)Google Scholar
  11. Cassel J., Bickmore T., Campbell L., Vilhjamlmsson H., Yan H.: Human conversation as a system framework: designing embodied converational agents. In: Cassell, J., Sullivan, J., Prevost, S., Churchill, E.(eds) Embodied Conversational Agents, pp. 29–63. The MIT Press, Cambridge (2000)Google Scholar
  12. Cheverst, K., Davies, N., Mitchell, K., Smith, P.: Providing tailored (context-aware) information to city visitors. In: Brusilovsky, P., Stock, O., Strapparava, C. (eds.) AH. Lecture Notes in Computer Science, vol. 1892, pp. 73–85 (2000)Google Scholar
  13. Clark, K.: Inspired 3D Character Animation. Premier Press (2002)Google Scholar
  14. Clark H.H., Schaefer E.F.: Contributing to discourse. Cogn. Sci. 13, 259–294 (1989)CrossRefGoogle Scholar
  15. Cohen, P.R., Levesque, H.J.: Rational interaction as the basis for communication. In: Cohen, P.R., Morgan, J., Pollack, M.E. (eds.) Intentions in communication, pp. 221–255. MIT Press (1990)Google Scholar
  16. Cramer, H., Evers, V., Ramlal, S., van Someren, M., Wielinga, B., Rutledge, L., Stash, N., Aroyo, L.: The effects of transparency on trust in and acceptance of a content-based art recommender (2008, this issue)Google Scholar
  17. Damiano, R., Galia, C., Lombardo, V.: Virtual tours across different media in DramaTour project. In: Proceedings of the First European Workshop on Intelligent Technologies for Cultural Heritage Exploitation (Ecai 2006). Riva del Garda, Italy, pp. 31–35 (2006a)Google Scholar
  18. Damiano R., Lombardo V., Pizzo A., Nunnari F.: Dramatization meets narrative presentations. In: Brewka, G., Coradeschi, S., Perini, A., Traverso, P.(eds) ECAI, pp. 31–35. Riva Del Garda, Italy (2006)Google Scholar
  19. Damiano R., Lombardo V., Nunnari F., Pizzo A.: Ontological domain coding for cultural heritage mediation. In: Lesmo, L., Borgo, S.(eds) Proceedings of FOMI 08 Frontiers in Artificial Intelligence and Applications, vol 174, pp. 88–99. Turin, Italy (2008)Google Scholar
  20. Dourish P.: Where the action is: The Foundations of Embodied Interaction. MIT Press, Cambridge (2001)Google Scholar
  21. Dybkjær, H., Dybkjær, L.: Design and first tests of a chatter. In: André, E., Dybkjær, L., Minker, W., Heisterkamp, P. (eds.) ADS. Lecture Notes in Computer Science, vol. 3068, pp. 166–177 (2004)Google Scholar
  22. Esslin M.: 1988 The field of drama. Methuen, London (1987)Google Scholar
  23. Gennari J., Musen M., Fergerson R., Grosso W., Crubézy M., Eriksson H., Noy N., Tu S.: The evolution of Protégé: an environment for knowledge-based systems development. Int. J. Hum.-Comput. Stud. 58(1), 89–123 (2003)CrossRefGoogle Scholar
  24. Gershon N., Page W.: What storytelling can do for information visualization. Commun. ACM 44(8), 31–37 (2001)CrossRefGoogle Scholar
  25. Geurts, J., Bocconi, S., van Ossenbruggen, J., Hardman, L.: Towards ontology-driven discourse: from semantic graphs to multimedia presentations. In: Fensel, D., Sycara, K.P., Mylopoulos, J. (eds.) International Semantic Web Conference. Lecture Notes in Computer Science, vol. 2870, pp. 597–612 (2003)Google Scholar
  26. Goodwin C.: Conversational organization: Interaction between Speakers and Hearers. Academic Press, New York (1981)Google Scholar
  27. Grosz B.J., Sidner C.L.: Attention, intentions, and the structure of discourse. Comput. Linguist. 12, 175–204 (1986)Google Scholar
  28. Grosz, B.J., Sidner, C.L.: Plans for discourse. In: Cohen, P.R., Morgan, J., Pollack, M.E. (eds.) Intentions in Communication, pp. 417–443. MIT Press (1990)Google Scholar
  29. Gustafson, J., Lindberg, N., Lundeberg, M.: The August spoken dialogue system. In: Proceedings of Eurospeech’99, pp. 1211–1214. Budapest, Hungary (1999)Google Scholar
  30. Haeberlen, A., Flannery, E., Ladd, A.M., Rudys, A., Wallach, D.S., Kavraki, L.E.: Practical robust localization over large-scale 802.11 wireless networks. In: MobiCom ’04: Proceedings of the 10th Annual International Conference on Mobile Computing and Networking, pp. 70–84. New York, NY, USA (2004)Google Scholar
  31. Hajicova E., Partee B.H., Sgall P.: Topic-focus articulation, tripartite structures, and semantic content. Kluwer, Dordrecht (1998)Google Scholar
  32. Hardman, L.: Canonical processes of media production. In: MHC ’05: Proceedings of the ACM Workshop on Multimedia for Human Communication, pp. 1–6. New York, NY, USA (2005)Google Scholar
  33. Hoffmann P., Herczeg M.: Distributed storytelling for narrative in spacious areas. In: Goebel, S., Braun, N., Spierling, U., Dechau, J., Diener, H.(eds) Technologies for interactive digital storytelling and entertainment 2003, pp. 346–350. Frauenhofer, Stuttgart (2003)Google Scholar
  34. Huang, Z.: Extensions to the K-means algorithm for clustering large datasets with categorical values. In: Data Mining and Knowledge Discovery, vol. 2, pp. 283–304 (1998)Google Scholar
  35. Ieronutti L., Chittaro L.: Employing virtual humans for education and training in X3D/VRML worlds. Comput. Educ. 49(1), 93–109 (2007)CrossRefGoogle Scholar
  36. Jakobson, R.: The speech event and the functions of language. In: Waugh, L., Monville-Burston, M. (eds.) On Language. Harvard University Press (1990)Google Scholar
  37. Johnson, B.: Place-based storytelling tools: a new look at Monticello. In: Trant, J., Bearman, D. (eds.) Museums and the Web 2005: Proceedings. (2004). Accessed May, 2008
  38. Keppel, G., Saufley, W.H., Tokunaga, H.: Introduction to design and analysis, a student’s handbook. W. H. Freeman and Co. (1998)Google Scholar
  39. Kobsa A., Koenemann J., Pohl W.: Personalized hypermedia presentation techniques for improving online customer relationships. Knowl. Eng. Rev. 16(2), 111–155 (2001)zbMATHCrossRefGoogle Scholar
  40. Kopp, S., Gesellensetter, L., Krämer, N.C., Wachsmuth, I.: A conversational agent as museum guide—design and evaluation of a real-world application. In: Panayiotopoulos, T., Gratch, J., Aylett, R., Ballin, D., Olivier, P., Rist, T. (eds.) IVA. Lecture Notes in Computer Science, vol. 3661, pp. 329–343 (2005)Google Scholar
  41. Kuflik, T., Callaway, C.B., Goren-Bar, D., Rocchi, C., Stock, O., Zancanaro, M.: Non-intrusive user modeling for a multimedia museum visitors guide system. In: Ardissono, L., Brna, P., Mitrovic, A. (eds.) User Modeling. Lecture Notes in Computer Science, vol. 3538, pp. 236–240 (2005)Google Scholar
  42. Laurel B.: Computer as Theater. Addison Wesley Longman, Reading, MA (1993)Google Scholar
  43. Leon, J., Fisher, M.: The use of virtual characters to generate teachable moments. In: Trant, J., Bearman, D. (eds.) Museums and the Web 2006: Proceedings, Toronto. (2006). Accessed May, 2008
  44. Lester J.C., Towns S.G., Callaway C.B., Voerman J.L., FitzGerald P.J.: Deictic and emotive communication in animated pedagogical agents. In: Cassell, J., Sullivan, J., Prevost, S., Churchill, E.(eds) Embodied Conversational Agents, pp. 123–154. The MIT Press, Cambridge (2000)Google Scholar
  45. Lombardo, V., Biral, F., Damiano, R., Pizzo, A.: Cyrano goes to hollywood: a drama-based metaphor for information presentation. In: Krueger, A. (ed.) AIMS 03 Workshop (Artificial Intelligence in Mobile Systems), pp. 17–24. Seattle (2003)Google Scholar
  46. Maestri, G.: Digital Character Animation. New Riders (1996)Google Scholar
  47. Mann W.C.: Dialogue games. Conventions of human interaction. Argumentation 2, 511–532 (1988)CrossRefGoogle Scholar
  48. Mateas, M., Senger, P.: Narrative intelligence: an introduction to the NI symposium. In: Mateas, M., Senger, P. (eds.) Working notes of the Narrative Intelligence Symposium. (1999). Accessed May, 2008
  49. Maudet N., Chaib-draa B.: Trends in agent communication language. Comput. Intell. 18(2), 89–101 (2002)CrossRefGoogle Scholar
  50. McKee R.: Story. Harper Collins, New York (1997)Google Scholar
  51. Murray J.: Hamlet on the holodeck. The Future of Narrative in Cyberspace. The MIT Press, Cambridge, MA (1998)Google Scholar
  52. Nunnari, F., Lombardo, V., Damiano, R., Pizzo, A., Gena, C.: The canonical processes of a dramtized approach to information presenation. In: Multimedia Systems. Special Issue on the Canonical Processes of Multimedia Production. (2008, Forthcoming)Google Scholar
  53. Pechenizkiy, M., Calders, T.: A framework for guiding the museum tours personalization. In: Aroyo, L., Kuflik, T., Stock, O., Zancanaro, M. (eds.) Proceeding of PATCH Workshop on Personalized Access to Cultural Heritage. Corfu, Greece. (2007). Accessed May, 2008
  54. Pelachaud, C.: Multimodal expressive embodied conversational agents. In: ACM Multimedia, pp. 683–689 (2005)Google Scholar
  55. Petrelli, D., Angeli, A.D., Convertino, G.: A user-centered approach to user modeling. In: UM ’99: Proceedings of the Seventh International Conference on User Modeling, pp. 255–264. Secaucus, NJ, USA (1999a)Google Scholar
  56. Petrelli, D., Not, E., Sarini, M., Stock, O., Strapparava, C., Zancanaro, M.: HyperAudio: location-awareness + adaptivity. In: CHI ’99: CHI ’99 Extended Abstracts on Human Factors in Computing Systems, pp. 21–22. New York, NY, USA (1999b)Google Scholar
  57. Picard, R.: Affective Computing. MIT Press (1997)Google Scholar
  58. Pospischil, G., Umlauft, M., Michlmayr, E.: Designing LoL@, a mobile tourist guide for UMTS’. In: Paternò, F. (ed.) Mobile HCI. Lecture Notes in Computer Science, vol. 2411, pp. 140–154 (2002)Google Scholar
  59. Proctor, N.: Off base or On target? Wireless and location-aware applications in the museum. In: Proceedings of International Cultural Heritage Informatics Meeting (ICHIM 05). Paris. (2005). Accessed May, 2008
  60. Raptis, D., Tselios, N., Avouris, N.: Context-based design of mobile applications for museums: a survey of existing practices. In: Proceedings of the 7th International Conference on Human Computer Interaction with Mobile Devices & Services Table of Contents, pp. 153–160. Salzburg, Austria (2005)Google Scholar
  61. Schegloff E.A., Sacks H.: Opening up closings. Semiotica 4(7), 289–327 (1973)CrossRefGoogle Scholar
  62. Searle J.: Speech acts: an essay in the Philosophy of Language. Cambridge University Press, Cambridge (UK) (1969)Google Scholar
  63. Seger L.: Creating Unforgettable Characters. Henry Holt and Company, New York (1990)Google Scholar
  64. Sirkin, M.: Statistics for the social sciences. Sage Publications (2005)Google Scholar
  65. Solon, A., McKevitt, P., Curran, K.: Mobile multiModal presentation. In: Schulzrinne, H., Dimitrova, N., Sasse, M.A., Moon, S.B., Lienhart, R. (eds.) ACM Multimedia, pp. 440–443 (2004)Google Scholar
  66. Sparacino, F.: The museum wearable: real-time sensor-driven understanding of visitors’ interests for personalized visually-augmented museum experiences. In: Bearman, D., Trant, J., Sparacino, F. (eds.) Proceedings of Museums and the Web 2002, pp. 17–20. (2002)Google Scholar
  67. Springer, J., Kajder, S., Brazas, J.B.: Digital storytelling at the national gallery of arts. In: Trant, J., Bearman, D. (eds.) Proceedings of Museums and the Web 2004. (2004). Accessed May, 2008
  68. Stock, O., Zancanaro, M.: Multimodal intelligent information presentation. Springer (2005)Google Scholar
  69. Strauss A., Corbin J.: Basics of qualitative research: grounded theory procedures and techniques. Sage Publications, Newbury Park, Calif. (1990)Google Scholar
  70. van Ossenbruggen, J., Amin, A., Hardman, L., Hildebrand, M., van Assem, M., Omelayenko, B., Schreiber, G., Tordai, A., de Boer, V., Wielinga, B., Wielemaker, J., de Niet, M., Taekema, J., van Orsouw, M., Teesing, A.: Searching and annotating virtual heritage collections with semantic-web techniques. In: Trant, J., Bearman, D. (eds.) Museums on the web. San Francisco, CA. (2007). Accessed May, 2008
  71. Waterfield, G.: The modern visitor and the historical palace: is an understanding possible? In: Abitare la storia. Turin, Italy. Conference Papers (1999)Google Scholar
  72. Zancanaro, M., Kuflik, T., Boger, Z., Goren-Bar, D., Goldwasser, D.: Analyzing museum visitors’ behavior patterns. In: Conati, C., McCoy, K.F., Paliouras, G. (eds.) User modeling. Lecture Notes in Computer Science, vol. 4511, pp. 238–246 (2007)Google Scholar
  73. Zimmermann, A., Lorenz, A.: LISTEN: a user-adaptive audio-augmented museum guide (2008, this issue)Google Scholar

Copyright information

© Springer Science+Business Media B.V. 2008

Authors and Affiliations

  • Rossana Damiano
    • 1
    • 3
  • Cristina Gena
    • 1
    • 3
  • Vincenzo Lombardo
    • 1
    • 3
  • Fabrizio Nunnari
    • 4
  • Antonio Pizzo
    • 2
    • 3
  1. 1.Dipartimento di InformaticaUniversità di TorinoTorinoItaly
  2. 2.Dipartimento DAMSUniversità di TorinoTorinoItaly
  3. 3.CIRMA, Centro Interdipartimentale di Ricerca per la Multimedialità e l’AudiovisivoUniversità di TorinoTorinoItaly
  4. 4.Virtual Reality and Multi Media ParkTorinoItaly

Personalised recommendations