Adaptive, intelligent presentation of information for the museum visitor in PEACH

Abstract

The study of intelligent user interfaces and user modeling and adaptation is well suited for augmenting educational visits to museums. We have defined a novel integrated framework for museum visits and claim that such a framework is essential in such a vast domain that inherently implies complex interactivity. We found that it requires a significant investment in software and hardware infrastructure, design and implementation of intelligent interfaces, and a systematic and iterative evaluation of the design and functionality of user interfaces, involving actual visitors at every stage. We defined and built a suite of interactive and user-adaptive technologies for museum visitors, which was then evaluated at the Buonconsiglio Castle in Trento, Italy: (1) animated agents that help motivate visitors and focus their attention when necessary, (2) automatically generated, adaptive video documentaries on mobile devices, and (3) automatically generated post-visit summaries that reflect the individual interests of visitors as determined by their behavior and choices during their visit. These components are supported by underlying user modeling and inference mechanisms that allow for adaptivity and personalization. Novel software infrastructure allows for agent connectivity and fusion of multiple positioning data streams in the museum space. We conducted several experiments, focusing on various aspects of PEACH. In one, conducted with 110 visitors, we found evidence that even older users are comfortable interacting with a major component of the system.

This is a preview of subscription content, access via your institution.

References

  1. Abowd G., Atkeson C., Hong J., Long S., Kooper R. and Pinkerton M. (1997). Cyberguide: a mobile context-aware tour guide. Wirel. Netw. 3(5): 421–433

    Article  Google Scholar 

  2. Albertini, A., Brunelli, R., Stock, O., Zancanaro, M.: Communicating user’s focus of attention by image processing as input for a mobile museum guide. The 10th International Conference on Intelligent User Interfaces, pp. 299–301. San Diego, CA (2005)

  3. Alfaro I., Nardon M., Pianesi F., Stock O. and Zancanaro M. (2004). Using cinematic techniques on mobile devices for cultural tourism. Inform. Technol. Tourism 7(2): 61–71

    Article  Google Scholar 

  4. Andreatta, C., Lecca, M., Messelodi, S.: Memory-based object recognition in digital images. The 10th International Fall Workshop – Vision, Modeling, and Visualization, pp. 33–40. Erlangen, Germany (2005)

  5. Aoki, P.M., Grinter, R.E., Hurst, A., Szymanski, M.H., Thornton, J.D., Woodruff, A.: Sotto Voce: exploring the interplay of conversation and mobile audio spaces. In: Wixon, D. (ed.) The SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, pp. 431–438. ACM Press, New York (2002)

  6. Arijon D. (1976). Grammar of the Film Language. Communication Arts Books. Hasting House, New York

    Google Scholar 

  7. Bares, W., Grégoire, J., Lester, J.: Realtime constraint-based cinematography for complex interactive 3d worlds. The Tenth National Conference on Innovative Applications of Artificial Intelligence, pp. 1101–1106. Madison, Wisconsin, USA (1998)

  8. Baus J., Cheverst K. and Kray C. (2005). A survey of map-based mobile guides. In: Meng., L., Zipf, A., and Reichenbacher, T. (eds) Map-based Mobile Services – Theories, Methods and Implementations., pp 197–213. Springer, Heidelberg

    Google Scholar 

  9. Bellotti F., Berta R., Margarone M. and Gloria A. (2002). User testing a hypermedia tour guide. IEEE Pervasive Comput. 1(2): 33–41

    Article  Google Scholar 

  10. Benelli, G., Bianchi, A., Marti, P., Not, E., Sennati, D.: HIPS: hypen-interaction within physical space. International Conference on Multimedia Computing and Systems, pp. 1075–1078. Florence, Italy (1999)

  11. Berkovich, M., Date, J., Keeler, R., Louw, M., O’Toole, M.: Discovery point: enhancing the museum experience with technology. Conference on Human Factors in Computing Systems, pp. 994–995. Florida, USA (2003)

  12. Berkovsky, S., Gorfinkel, A., Kuflik, T., Manevitz, L.: Case-based to content-based user model mediation. Workshop on Ubiquitous User Modeling, held in conjunction with ECAI-2006. Riva delGarda, Italy (2006)

  13. Bohnenberger, T., Jacobs, O., Jameson, A., Aslan, I.: Decision-theoretic planning meets user requirements: enhancements and studies of an intelligent shopping guide. Pervasive computing: Third International Conference, pp. 279–196. Munich, Germany (2005)

  14. Busetta, P., Donà, A., Nori, M.: Channeled multicast for group communications. The First International Joint Conference on Autonomous Agents and Multiagent Systems, pp. 1280–1287. Bologna, Italy (2002)

  15. Busetta, P., Merzi, M., Rossi, S., Legras, F.: Intra-role coordination using group communication: a preliminary report. International Workshop on Agent Communication Languages and Conversation Policies, pp. 231–253. Melbourne, Australia (2003)

  16. Butz, A.: Anymation with CATHI. The Fourteenth National Conference on Artificial Intelligence and Ninth Innovative Applications of Artificial Intelligence Conference, pp. 957–962. Providence, Rhode Island, USA (1997)

  17. Callaway C. and Lester J. (2002). Narrative Prose Generation. Artif. Intell. 139(2): 213–252

    Article  Google Scholar 

  18. Callaway C., Not E., Novello A., Rocchi C., Stock O. and Zancanaro M. (2005a). Automatic Cinematography and Multilingual NLG for Generating Video Documentaries. Artif. Intell. 165(1): 57–89

    Article  Google Scholar 

  19. Callaway, C., Kuflik, T., Not, E., Novello, A., Stock, O., Zancanaro, M.: Personal reporting of a museum visit as an entrypoint to future cultural experience. The 10th International Conference on Intelligent User Interfaces, pp. 275–277. San Diego, CA (2005b)

  20. Cheverst, K., Davies, N., Mitchell, K., Friday, A., Efstratiou, C.: Developing a context-aware electronic tourist guide: some issues and experiences. The CHI 2000 Conference on Human factors in computing systems, pp. 17–24. The Hague, Netherlands (2000)

  21. Cheverst K., Mitchell K. and Davies N. (1999). Design of an object model for a context sensitive tourist guide. Comput. Graph. 23(6): 883–891

    Article  Google Scholar 

  22. Csikszentmihalyi M. (1990). Flow: The Psychology of Optimal Experience. Harper and Row, New York

    Google Scholar 

  23. Davis F.D. (1989). Perceived usefulness, perceived ease of use and user acceptance of information technology. MIS Quart. 13: 319–340

    Article  Google Scholar 

  24. Dey A., Salber D. and Abowd G. (2001). A conceptual framework and a toolkit for supporting the rapid prototyping of context-aware applications. Hum-Comput. Interact. J. 16(2–4): 97–166

    Article  Google Scholar 

  25. Efstratiou, C., Friday, A., Davies, N., Cheverst, K.: A platform supporting coordinated adaptation in mobile systems. The 4th IEEE Workshop on Mobile Computing Systems and Applications, pp. 128–137. Callicoon, New York (2003)

  26. Friedman, D.A., Feldman, Y.A.: Knowledge-based cinematography and its applications. The 16th European Conference on Artificial Intelligence, pp. 256–262. Valencia, Spain (2004)

  27. Gena C. (2005). Methods and techniques for the evaluation of user-adaptive systems. Knowledge Eng. Rev. 20(1): 1–37

    Article  Google Scholar 

  28. Gena C. and Torre I. (2004). The importance of adaptivity to provide on-board services. A preliminary evaluation of an adaptive tourist information service on board vehicles. Appl. Artif. Intell. 18(6): 549–580

    Google Scholar 

  29. Goren-Bar D., Graziola I., Pianesi F. and Zancanaro M. (2006). The influence of personality factors on visitor attitudes towards adaptivity dimensions for mobile museum guides. User Model. User-Adapt. Interact. 16(1): 31–62

    Article  Google Scholar 

  30. Goren-Bar D., Graziola I., Rocchi C., Pianesi F., Stock O. and Zancanaro M. (2005). Designing and redesigning an affective interface for an adaptive museum guide. In: Tao, J., Tan, T., and Picard, R. (eds) Affective Computing and Intelligent Interaction ACII-2005 First International Conference on Affective Computing and Intelligent Interaction., pp. Beijing, China

    Google Scholar 

  31. Goren-Bar, D., Prete, M.: Report on a museum tour report. In: Maybury M., Stock O., Wahlster W. (eds.) INTETAIN 2005: First Conference on Intelligent Technologies for Interactive Entertainment, pp. 230–234. Springer, LNAI 3814

  32. Grinter, E., Aoki, P. M., Hurst, A., Szymanski, M.H., Thornton, J.D., Woodruff, A.: Revisiting the visit: Understanding how technology can shape the museum visit. ACM Conference on Computer Supported Cooperative Work, pp. 146–155. New Orleans, LA (2002)

  33. Halliday, M.A.K., Hasan, R.: Language, Context and Text: Aspects of Language in a Social-Semiotic Perspective. Deakin University Press. (1985)

  34. Halper, N., Oliver, P.: CamPlan: A camera planning agent. The AAAI Spring Symposium Workshop on Smart Graphics, pp. 92–100. Stanford, USA (2000)

  35. Hatala, M., Kalantari, L., Wakkary, R., Newby, K.: Ontology and rule based retrieval of sound objects in augmented audio reality system for museum visitors. The 2004 ACM Symposium on Applied computing, pp. 1045–1050. Nicosia, Cyprus (2004)

  36. Heckmann, D., Schwartz, T., Brandherm, B., Schmitz, M.: von Wilamowitz-Moellendorff, M.: GUMO – the general user model ontology. The 10th International Conference on User Modelling, pp. 428–432. Edinburgh, UK (2005)

  37. Höök K. (2000). Steps to take before IUIs become real. J. Interact. Comput. 12(4): 409–426

    Article  Google Scholar 

  38. Jameson A. and Schwarzkopf E. (2002). Pros and cons of controllability: An empirical study. In: Brusilovsky, P. and Conejo, E. (eds) Adaptive Hypermedia and Adaptive Web-based Systems: AH2002., pp 193–202. Springer Verlag, Heidelberg

    Google Scholar 

  39. Karp, P., Feiner, S.: Automated presentation planning of animation using task decomposition with heuristic reasoning. Graphics Interface’93, pp. 118–127. Toronto, Ontario Canada (1993)

  40. Katz, S., Kahanov, Y., Kashtan, N., Kuflik T., Graziola, I., Rocchi, C., Stock, O., Zancanaro, M.: Preparing personalized multimedia presentations for a mobile museum visitors guide – a methodological approach. In: Trant, J., Bearman, D. (eds.) Museums and the Web 2006, Archives & Museum Informatics, Toronto: published March 1, 2006 at http://www.archimuse.com/mw2006/papers/katz/katz.html. (2006)

  41. Kay J., Kummerfeld B. and Lauder P. (2005a). Consistent modelling of users, devices and sensors in a ubiquitous computing environment. User Model. User-Adapt. Interact. 15(3–4): 197–234

    Google Scholar 

  42. Kay, J., Lum, A., Niu, W.: A scrutable museum tour guide system. The 2nd Workshop on Multi-User and Ubiquitous User Interfaces, Sonderforschungsbereich 378, Saarland, pp. 19–20 (2005b)

  43. Krüger, A., Butz, A., Müller, C., Stahl, C., Wasinger, R., Steinberg, K., Dirschl, A.: The connected user interface: realizing a personal situated navigation service. The 9th International Conference on Intelligent User Interfaces, pp. 161–168. Madeira, Portugal (2004)

  44. Krüger, A., Kruppa, M., Müller, C., Wasinger, R.: Readapting multimodal presentations to heterogenous user groups. AAAI-Workshop on Intelligent and Situation-Aware Media and Presentations, T. R. WS-02–08, AAAI Press, pp. 46–54. (2002)

  45. Kruppa, M., Aslan, I.: Parallel presentations for heterogeneous user groups – an initial user study. In: Maybury, M., Stock O., Wahlster, W. (eds.) INTETAIN 2005: First Conference on Intelligent Technologies for Interactive Entertainment, pp. 54–63. Springer, LNAI 3814 (2005)

  46. Kruppa, M., Krüger, A.: Concepts for a combined use of personal digitalassistants and large remote displays. Simulation und Visualisierung, pp. 349–361. Magdeburg, Germany (2003)

  47. Long, S., Aust, D., Abowd, G., Atkeson, C.: Cyberguide: Prototyping context-aware mobile applications. Conference on Human Factors in Computing Systems, pp. 293–294. Vancouver, Canada (1996)

  48. Malaka R. and Zipf A. (2000). DEEP MAP – Challenging IT research in the framework of a tourist information System. In: Fesenmaier, D., Klein, S. and Buhalis, D. (eds) Informaton and Communication Technologies in Tourism 2000: ENTER 2000., pp 15–27. Springer, Wien

    Google Scholar 

  49. Mann, W., Thompson, S.: Rhetorical structure theory: a theory of text organization. T. R. ISI/RS87–190, USC/ISI, Marina del Rey, CA (1987)

  50. McCrae R.R. and John O.P. (1992). An introduction to the five-factors model and its applications. J. Personality 60: 175–215

    Article  Google Scholar 

  51. McKeown K.R. (1985). Text Generation: Using Discourse Strategies and Focus Constraints to Generate Natural Language Text. Cambridge University Press, London, UK

    Google Scholar 

  52. Nardon, M., Pianesi, F., Zancanaro, M.: Interactive documentaries: first usability studies. The 2nd Workshop on Personalization in Future TV, Malaga, Spain, available online at: http://itv.eltrun.aueb.gr/topics/ah02tv02/ (2002)

  53. Niederee, C., Stewart, A., Mehta, B., Hemmje, M.: A multi-dimensional, unified user model for cross-system personalization. Workshop On Environments For Personalized Information Access, pp. 34–54. Gallipoli, Italy (2004)

  54. Norman D.A. (1998). The Invisible Computer. MIT Press, Cambridge, MA

    Google Scholar 

  55. Not E., Petrelli D., Sarini M., Stock O., Strapparava C. and Zancanaro M. (1998). Hypernavigation in the physical space: adapting presentations to the user and to the situational context. New Rev. Hypermedia Multimedia 4: 33–45

    Google Scholar 

  56. Novak T.P., Hoffman D.L. and Yung Y.F. (2000). Measuring the customer experience in on-line environments: a structural modeling approach. Marketing Science 19: 22–44

    Article  Google Scholar 

  57. Oberlander J., O’Donnell M., Knott A. and Mellish C. (1998). Conversation in the museum: experiments in dynamic hypermedia with the intelligent labelling explorer. New Rev. Hypermedia Multimedia. 4: 11–32

    Google Scholar 

  58. Petrelli D. and Not E. (2005). User-centered design of flexible hypermedia for a mobile guide: reflections on the hyperaudio experience. User Model. User-Adapt. Interact. 15(3–4): 303–338

    Article  Google Scholar 

  59. Popovich P.M., Hyde K.R., Zakrajsek T. and Blumer C. (1987). The development of the attitudes toward computer usage scale. Educ. Psychol. Meas. 47: 261–269

    Article  Google Scholar 

  60. Potonniee, O.: Ubiquitous personalization: a smart card based approach. The 4th Gemplus Developer Conference, Singapore, available online at: http://www.gemplus.com/smart/rd/publications/pdf/Pot02per.pdf. (2002)

  61. Raptis, D., Tselios, N., Avouris, N.: Context-based design of mobile applications for museums: a survey of existing practices. The 7th International Conference on Human Computer Interaction with Mobile Devices & Services, pp. 153–160. Salzburg, Austria (2005)

  62. Reiter, E.: Has a consensus NL generation architecture appeared, and is it psycholinguistically plausible? The Seventh International Workshop on Natural Language Generation, pp. 163–170. Kennebunkport, ME (1994)

  63. Rocchi, C., Zancanaro, M.: Adaptive Video Documentaries. The HyperText Conference, pp. 36–37. Nottingham, UK (2003).

  64. Rocchi, C., Zancanaro, M.: Template-based adaptive video documentaries. Artifical Intelligence in Mobile Systems, pp. 79–83. Nottingham, UK (2004)

  65. Rocchi, C., Stock, O., Zancanaro, M., Kruppa, M., Krüger, A.: The museum visit: generating seamless personalized presentations on multiple devices. The 2004 Conference on Intelligent User Interfaces, pp. 316–318. Madeira, Portugal (2004)

  66. Rotter J.B. (1966). Generalized Expectancies for Internal Versus External Control of Reinforcement. Psychol. Monogr. 80: 1–28

    Google Scholar 

  67. Sarini, M., Strapparava, C.: Building a user model for a museum exploration and information-providing adaptive system. In: Brusilovsky, P., De Bra, P. (eds.) The 2nd Workshop on Adaptive Hypertext and Hypermedia, Report No. 98/12, CS Reports, Eindhoven University of Technology, Eindhoven, The Netherlands, pp. 63–68 (1998)

  68. Shneiderman, B.: (1998) Eight Golden Rules for Interface Design. Designing the User Interface, 3rd edn. Addison Wesley, Reading MA

  69. Stock, O.: The ALFRESCO Project Team.: ALFRESCO: enjoying the combination of NLP and hypermedia for information exploration. In: Maybury, M.T. (ed.) Intelligent Multimedia Interfaces, pp. 197–224. AAAI Press, Menlo Park, CA (1993)

  70. Stokmans M.J.W. (1999). Reading attitude and its effect on leisure time reading. Poetics 26: 245–261

    Article  Google Scholar 

  71. Totterdell P. and Boyle E. (1990). The evaluation of adaptive systems. In: Browne, D., Totterdell, P. and Norman, M. (eds) Adaptive User Interfaces., pp 161–194. Academic Press, London

    Google Scholar 

  72. van Mulken, S., André, E., Mueller, J.: The persona effect: how substantial is it. Human Computer Interaction Conference, pp. 53–58. Berlin, Germany (1998)

  73. Want, R., Schilit, B., Adams, N., Gold, R., Petersen, K., Ellis, J., Goldberg, D., Weiser, M.: The PARCTab ubiquitous computing experiment. T.R.CSL-95–1. Xerox PARC, Palo Alto, CA (1995)

Download references

Author information

Affiliations

Authors

Corresponding author

Correspondence to Oliviero Stock.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Stock, O., Zancanaro, M., Busetta, P. et al. Adaptive, intelligent presentation of information for the museum visitor in PEACH. User Model User-Adap Inter 17, 257–304 (2007). https://doi.org/10.1007/s11257-007-9029-6

Download citation

Keywords

  • Adaptive mobile guides
  • Multimodal user interfaces
  • Personalized information presentation
  • Personal visit report