User Modeling and User-Adapted Interaction

, Volume 24, Issue 3, pp 175–217 | Cite as

A case study of intended versus actual experience of adaptivity in a tangible storytelling system

  • Karen Tanenbaum
  • Marek Hatala
  • Joshua Tanenbaum
  • Ron Wakkary
  • Alissa Antle
Original Paper


This article presents a case study of an adaptive, tangible storytelling system called “The Reading Glove”. The research addresses a gap in the field of adaptivity for ubiquitous systems by taking a critical look at the notion of “adaptivity” and how users experience it. The Reading Glove is an interactive storytelling system featuring a wearable, glove-based interface and a set of narratively rich objects. A tabletop display provides adaptive recommendations which highlight objects to select next, functioning as an expert storytelling system. The recommendation engine can be run in three different configurations to examine the effects of different adaptive methods. The study of the design process as well as the user experience of the Reading Glove allows us to develop a deeper understanding of the experience of adaptivity that is useful for designers of intelligent systems, particularly those with ubiquitous and tangible forms of interaction.


Adaptivity Tangible computing User models  Recommendation systems Expert systems User experience 


  1. Baxter, P., Jack, S.: Qualitative case study methodology: study design and implementation for novice researchers. Qual. Rep. 13(4), 544–559 (2008)Google Scholar
  2. Corbin, J., Strauss, A.: Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory, 3rd edn. Sage, Thousand Oaks (2008)Google Scholar
  3. Creswell, J.: Research Design: Qualitative, Quantitative, and Mixed Methods Approaches, 2nd edn. Sage, Thousand Oaks (2003)Google Scholar
  4. Damiano, R., Gena, C., Lombardo, V., Nunnari, F., Pizzo, A.: A stroll with Carletto: adaptation in drama-based tours with virtual characters. User Model. User Adapt. Interact. 18(5), 417–453 (2008)CrossRefGoogle Scholar
  5. Edwards, W.K., Grinter, R.E.: At home with ubiquitous computing: seven challenges. In: Abowd, G.D., Brumitt, B., Shafer, S.A.N. (eds.) Proceedings of Ubicomp 2001, pp. 262–272. Springer, Berlin (2001)Google Scholar
  6. Hatala, M., Wakkary, R.: Ontology-based user modeling in an augmented audio reality system for museums. User Model. User Adapt. Interact. 15(3–4), 339–380 (2005)CrossRefGoogle Scholar
  7. Hatala, M., Tanenbaum, K., Wakkary, R., Muise, K., Mohabbati, B., Corness, G., Budd, J., Loughin, T.: Experience structuring factors affecting learning in family visits to museums. In: Cress, U., Dimitrova, V., Specht, M. (eds.) “Learning in the Synergy of Multiple Disciplines”, Proceedings of the 4th European Conference on Technology Enhanced Learning (ECTEL09). LNCS, vol. 5794, pp. 37–51. Springer, New York (2009)Google Scholar
  8. Hermann, M., Weber, M.: When three worlds collide: a model of the tangible interaction process. In: Proceedings of the 21st Annual Conference of the Australian Computer–Human Interaction Special Interest Group (OZCHI ’09), Melbourne, Australia, pp. 341–344. ACM Press, New York (2009)Google Scholar
  9. Holmquist, L.E., Helander, M., Dixon, S.: Every object tells a story: physical interfaces for digital storytelling. In: Nordic Conference on Computer–Human Interaction (NordiCHI), Stockholm, Sweden, ACM Press, New York (2000)Google Scholar
  10. Hornecker, E., Buur, J.: Getting a grip on tangible interaction: a framework on physical space and social interaction. In: Conference on Human Factors in Computing Systems (CHI), Montreal, Canada, pp. 437–446. ACM Press, New York (2006)Google Scholar
  11. Klemmer, S.R., Hartmann B., Takayama, L.: How bodies matter: five themes for interaction design. In: Proceedings of the 6th Conference on Designing Interactive Systems (DIS), University Park, PA, USA, pp. 140–149. ACM Press, New York (2006)Google Scholar
  12. Konkel, M., Leung, V., Ullmer, B., Hu, C.: Tagaboo: a collaborative children’s game based upon wearable RFID technology. Pers. Ubiq. Comput. 8(5), 382–384 (2004)Google Scholar
  13. Kuflik, T., Rocchi, O.: User modeling and adaptation for a museum visitor’s guide. In: Stock, O., Zancanaro, M. (eds.) PEACH-Intelligent Interfaces for Museum Visits, pp. 121–144. Springer, Berlin (2007)Google Scholar
  14. Lustig, C., Novatchkov, H., Dunne, L., McHugh, M., Coyle, L.: Using colocation to support human memory. In: Workshop on Supporting Human Memory with Interactive Systems, HCI Conference, Lancaster, UK, pp. 41–44 (2007)Google Scholar
  15. Martins, T., Sommerer, C., Mignonneau, L., Correia, N.: Gauntlet: A wearable interface for ubiquitous gaming. In: International Conference on Human–Computer Interaction with Mobile Devices and Services, Amsterdam The Netherlands, pp. 367–370. ACM Press, New York (2008)Google Scholar
  16. Mateas, M., Stern, A.: Procedural authorship: a case-study of the interactive drama facade. In: Digital Arts and Culture (DAC), Copenhagen, Denmark (2005)Google Scholar
  17. Mazalek, A., Wood, A., Ishii, H.: genieBottles: an interactive narrative in bottles. In: ACM SIGGRAPH Conference, Los Angeles, California, p. 189. ACM Press, New York (2001)Google Scholar
  18. Mazalek, A., Davenport, G., Ishii, H.: Tangible viewpoints: a physical approach to multimedia stories. In: ACM Multimedia, Juan-les-Pins, France, pp. 153–160. ACM Press, New York (2002)Google Scholar
  19. Miles, M.B., Huberman, M.: Qualitative Data Analysis: An Expanded Sourcebook, 2nd edn. Sage, Thousand Oaks (1994)Google Scholar
  20. Natkin, S., Yan, C.: User model in multiplayer mixed reality entertainment applications. In: Advances in Computer Entertainment (ACE), Hollywood, CA. ACM Press, New York (2006)Google Scholar
  21. Norman, D.: The Design of Everyday Things. Basic Books, New York (1988)Google Scholar
  22. Riedl, M.: Towards integrating AI story controllers and game engines: reconciling world state representations. In: International Joint Conference on Artificial Intelligence (IJCAI) Workshop on Reasoning, Representation, and Learning in Computer Games, Edinburgh, Scotland (2005)Google Scholar
  23. Roberts, D., Furst, M., Isbell, C.: Using influence and persuasion to shape player experience. In: The 4th ACM SIGGRAPH Conference on Video Games, Louisiana, New Orleans. ACM Press, New York (2009)Google Scholar
  24. Seif El-Nasr, M.: A user centric adaptive story architecture-borrowing from acting theories. In: International Conference on Advances in Computer Entertainment Technology (ACE), Singapore, pp. 109–116. ACM Press, New York (2004)Google Scholar
  25. Sharma, M., Ontanon, S., Strong, C., Mehta, M., Ram, A.: Towards player preference modeling for drama management in interactive stories. In: Twentieth International FLAIRS Conference, Key West, FL, pp. 571–576. AAAI Press, New York (2007)Google Scholar
  26. Stake, R.: Qualitative case studies. In: Denzin, N.K., Lincoln, Y. (eds.) The Sage Handbook of Qualitative Research, 3rd edn. Sage, Thousand Oaks (2005)Google Scholar
  27. Star, S.L., Griesemer, J.R.: Institutional ecology, ‘translations’ and boundary objects: amateurs and professionals in Berkeley’s museum of vertebrate zoology, 1907–39. Soc. Stud. Sci. 19(3), 387–420 (1989)CrossRefGoogle Scholar
  28. Svanaes, D., Verplank, W.: In search of metaphors for tangible user interfaces. In: Designing Augmented Reality Environments, Elsinore, Denmark (2000)Google Scholar
  29. Swanborn, P.: Case Study Research: What, Why, and How?. Sage, Thousand Oaks (2010)Google Scholar
  30. Swartout, W., Hill, R., Gratch, J., Johnson, W.L., Kyriakakis, C., LaBore, C., Lindheim, R., Marsella, S., Miraglia, D., Moore, B., Morie, J., Rickel, J., Thiebaux, M., Tuch, L., Whitney, R., Douglas, J.: Toward the holodeck: integrating graphics, sound, character and story. In: International Conference on Autonomous Agents, Montreal, QC, Canada. ACM Press, New York (2001)Google Scholar
  31. Szilas, N.: IDtension: A narrative engine for interactive drama. In: TIDSE’03: Technologies for Interactive Digital Storytelling and Entertainment, Darmstadt, Germany. Frauenhofer IRB Verlag, Stuttgart (2003)Google Scholar
  32. Szilas, N.: The future of interactive drama. In: Second Australasian Conference on Interactive Entertainment, pp. 193–199. Creativity & Cognition Studios Press, Sydney (2005)Google Scholar
  33. Tanenbaum, J., Tomizu, A.: Affective interaction design and narrative presentation. In: AAAI Fall Symposium on Intelligent Narrative Technologies, Arlington, VA. AAAI Press, Menlo Park (2007)Google Scholar
  34. Tanenbaum, J., Tanenbaum, K., Antle, A.: The Reading Glove: designing interactions for object-based tangible storytelling. In: Augmented Human, Megeve, France, pp. 132–140. ACM Press, New York (2010a)Google Scholar
  35. Tanenbaum, J., Tanenbaum, K., Seif El-Nasr, M., Hatala, M.: Authoring tangible interactive narratives using cognitive hyperlinks. In: 3rd Workshop on Intelligent Narrative Technologies (INT3) at Foundations of Digital Games Conference (FDG), Monterey, CA, p. 8. ACM Press, New York (2010b)Google Scholar
  36. Tanenbaum, K., Hatala, M., Tanenbaum, J.: User perceptions of adaptivity in an interactive narrative. In: User Modeling, Adaption, and Personalization (UMAP), Girona, Spain. ACM Press, New York (2011a)Google Scholar
  37. Tanenbaum, K., Tanenbaum, J., Antle, A., Seif El-Nasr, M., Hatala, M.: Experiencing the Reading Glove. In: Tangible, Embodied and Embedded Interaction, Madeira, Portugal. ACM Press, New York (2011b)Google Scholar
  38. Thue, D., Bulitko, V., Spetch, M., Wasylishen, E.: Interactive storytelling: a player modelling approach. In: Artificial Intelligence and Interactive Digital Entertainment Conference (AIIDE), Stanford, CA, pp. 43–48 (2007a)Google Scholar
  39. Thue, D., Bulitko, V., Spetch, M., Wasylishen, E.: Learning player preferences to inform delayed authoring. In: AAAI Fall Symposium on Intelligent Narrative Technologie, Arlington, VA. AAAI Press, Menlo Park (2007b)Google Scholar
  40. Ullmer, B., Ishii, H.: Emerging frameworks for tangible user interfaces. In: Carrol, J.M. (ed.) Human–Computer Interaction in the New Millennium, pp. 579–601. Addison-Wesley, New York (2001)Google Scholar
  41. Vildjiounaite, E., Koesis, O., Kyllonen, V., Kladis, B.: Context-dependent user modelling for smart homes. In: Conati, C., McCoy, K., Paliouras, G. (eds.) User Modeling. LNAI 4511. Springer, New York (2007)Google Scholar
  42. Williams, A., Kabisch, E., Dourish, P.: From interaction to participation: configuring space through embodied interaction. In: Ubicomp 2005, Toyko, Japan, pp. 287–304 (2005)Google Scholar
  43. Yin, R.K.: Case Study Research: Design and Methods, 3rd edn. Sage, Thousand Oaks (2002)Google Scholar
  44. Yin, R.K.: Case Study Research: Design and Methods, 4th edn. Sage, Thousand Oaks (2009)Google Scholar
  45. Zimmerman, A., Lorenz, A.: LISTEN: a user-adaptive audio-augmented museum guide. User Model. User Adapt. Interact. 18(5), 386–416 (2008)CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media Dordrecht 2013

Authors and Affiliations

  • Karen Tanenbaum
    • 1
  • Marek Hatala
    • 1
  • Joshua Tanenbaum
    • 1
  • Ron Wakkary
    • 1
  • Alissa Antle
    • 1
  1. 1.School of Interactive Arts & TechnologySimon Fraser UniversitySurreyCanada

Personalised recommendations