Skip to main content

A case study of intended versus actual experience of adaptivity in a tangible storytelling system

A Correction to this article was published on 16 April 2020

This article has been updated


This article presents a case study of an adaptive, tangible storytelling system called “The Reading Glove”. The research addresses a gap in the field of adaptivity for ubiquitous systems by taking a critical look at the notion of “adaptivity” and how users experience it. The Reading Glove is an interactive storytelling system featuring a wearable, glove-based interface and a set of narratively rich objects. A tabletop display provides adaptive recommendations which highlight objects to select next, functioning as an expert storytelling system. The recommendation engine can be run in three different configurations to examine the effects of different adaptive methods. The study of the design process as well as the user experience of the Reading Glove allows us to develop a deeper understanding of the experience of adaptivity that is useful for designers of intelligent systems, particularly those with ubiquitous and tangible forms of interaction.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Change history


  1. Baxter, P., Jack, S.: Qualitative case study methodology: study design and implementation for novice researchers. Qual. Rep. 13(4), 544–559 (2008)

    Google Scholar 

  2. Corbin, J., Strauss, A.: Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory, 3rd edn. Sage, Thousand Oaks (2008)

    Book  Google Scholar 

  3. Creswell, J.: Research Design: Qualitative, Quantitative, and Mixed Methods Approaches, 2nd edn. Sage, Thousand Oaks (2003)

    Google Scholar 

  4. Damiano, R., Gena, C., Lombardo, V., Nunnari, F., Pizzo, A.: A stroll with Carletto: adaptation in drama-based tours with virtual characters. User Model. User Adapt. Interact. 18(5), 417–453 (2008)

    Article  Google Scholar 

  5. Edwards, W.K., Grinter, R.E.: At home with ubiquitous computing: seven challenges. In: Abowd, G.D., Brumitt, B., Shafer, S.A.N. (eds.) Proceedings of Ubicomp 2001, pp. 262–272. Springer, Berlin (2001)

  6. Hatala, M., Wakkary, R.: Ontology-based user modeling in an augmented audio reality system for museums. User Model. User Adapt. Interact. 15(3–4), 339–380 (2005)

    Article  Google Scholar 

  7. Hatala, M., Tanenbaum, K., Wakkary, R., Muise, K., Mohabbati, B., Corness, G., Budd, J., Loughin, T.: Experience structuring factors affecting learning in family visits to museums. In: Cress, U., Dimitrova, V., Specht, M. (eds.) “Learning in the Synergy of Multiple Disciplines”, Proceedings of the 4th European Conference on Technology Enhanced Learning (ECTEL09). LNCS, vol. 5794, pp. 37–51. Springer, New York (2009)

  8. Hermann, M., Weber, M.: When three worlds collide: a model of the tangible interaction process. In: Proceedings of the 21st Annual Conference of the Australian Computer–Human Interaction Special Interest Group (OZCHI ’09), Melbourne, Australia, pp. 341–344. ACM Press, New York (2009)

  9. Holmquist, L.E., Helander, M., Dixon, S.: Every object tells a story: physical interfaces for digital storytelling. In: Nordic Conference on Computer–Human Interaction (NordiCHI), Stockholm, Sweden, ACM Press, New York (2000)

  10. Hornecker, E., Buur, J.: Getting a grip on tangible interaction: a framework on physical space and social interaction. In: Conference on Human Factors in Computing Systems (CHI), Montreal, Canada, pp. 437–446. ACM Press, New York (2006)

  11. Klemmer, S.R., Hartmann B., Takayama, L.: How bodies matter: five themes for interaction design. In: Proceedings of the 6th Conference on Designing Interactive Systems (DIS), University Park, PA, USA, pp. 140–149. ACM Press, New York (2006)

  12. Konkel, M., Leung, V., Ullmer, B., Hu, C.: Tagaboo: a collaborative children’s game based upon wearable RFID technology. Pers. Ubiq. Comput. 8(5), 382–384 (2004)

    Google Scholar 

  13. Kuflik, T., Rocchi, O.: User modeling and adaptation for a museum visitor’s guide. In: Stock, O., Zancanaro, M. (eds.) PEACH-Intelligent Interfaces for Museum Visits, pp. 121–144. Springer, Berlin (2007)

  14. Lustig, C., Novatchkov, H., Dunne, L., McHugh, M., Coyle, L.: Using colocation to support human memory. In: Workshop on Supporting Human Memory with Interactive Systems, HCI Conference, Lancaster, UK, pp. 41–44 (2007)

  15. Martins, T., Sommerer, C., Mignonneau, L., Correia, N.: Gauntlet: A wearable interface for ubiquitous gaming. In: International Conference on Human–Computer Interaction with Mobile Devices and Services, Amsterdam The Netherlands, pp. 367–370. ACM Press, New York (2008)

  16. Mateas, M., Stern, A.: Procedural authorship: a case-study of the interactive drama facade. In: Digital Arts and Culture (DAC), Copenhagen, Denmark (2005)

  17. Mazalek, A., Wood, A., Ishii, H.: genieBottles: an interactive narrative in bottles. In: ACM SIGGRAPH Conference, Los Angeles, California, p. 189. ACM Press, New York (2001)

  18. Mazalek, A., Davenport, G., Ishii, H.: Tangible viewpoints: a physical approach to multimedia stories. In: ACM Multimedia, Juan-les-Pins, France, pp. 153–160. ACM Press, New York (2002)

  19. Miles, M.B., Huberman, M.: Qualitative Data Analysis: An Expanded Sourcebook, 2nd edn. Sage, Thousand Oaks (1994)

    Google Scholar 

  20. Natkin, S., Yan, C.: User model in multiplayer mixed reality entertainment applications. In: Advances in Computer Entertainment (ACE), Hollywood, CA. ACM Press, New York (2006)

  21. Norman, D.: The Design of Everyday Things. Basic Books, New York (1988)

    Google Scholar 

  22. Riedl, M.: Towards integrating AI story controllers and game engines: reconciling world state representations. In: International Joint Conference on Artificial Intelligence (IJCAI) Workshop on Reasoning, Representation, and Learning in Computer Games, Edinburgh, Scotland (2005)

  23. Roberts, D., Furst, M., Isbell, C.: Using influence and persuasion to shape player experience. In: The 4th ACM SIGGRAPH Conference on Video Games, Louisiana, New Orleans. ACM Press, New York (2009)

  24. Seif El-Nasr, M.: A user centric adaptive story architecture-borrowing from acting theories. In: International Conference on Advances in Computer Entertainment Technology (ACE), Singapore, pp. 109–116. ACM Press, New York (2004)

  25. Sharma, M., Ontanon, S., Strong, C., Mehta, M., Ram, A.: Towards player preference modeling for drama management in interactive stories. In: Twentieth International FLAIRS Conference, Key West, FL, pp. 571–576. AAAI Press, New York (2007)

  26. Stake, R.: Qualitative case studies. In: Denzin, N.K., Lincoln, Y. (eds.) The Sage Handbook of Qualitative Research, 3rd edn. Sage, Thousand Oaks (2005)

    Google Scholar 

  27. Star, S.L., Griesemer, J.R.: Institutional ecology, ‘translations’ and boundary objects: amateurs and professionals in Berkeley’s museum of vertebrate zoology, 1907–39. Soc. Stud. Sci. 19(3), 387–420 (1989)

    Article  Google Scholar 

  28. Svanaes, D., Verplank, W.: In search of metaphors for tangible user interfaces. In: Designing Augmented Reality Environments, Elsinore, Denmark (2000)

  29. Swanborn, P.: Case Study Research: What, Why, and How?. Sage, Thousand Oaks (2010)

    Book  Google Scholar 

  30. Swartout, W., Hill, R., Gratch, J., Johnson, W.L., Kyriakakis, C., LaBore, C., Lindheim, R., Marsella, S., Miraglia, D., Moore, B., Morie, J., Rickel, J., Thiebaux, M., Tuch, L., Whitney, R., Douglas, J.: Toward the holodeck: integrating graphics, sound, character and story. In: International Conference on Autonomous Agents, Montreal, QC, Canada. ACM Press, New York (2001)

  31. Szilas, N.: IDtension: A narrative engine for interactive drama. In: TIDSE’03: Technologies for Interactive Digital Storytelling and Entertainment, Darmstadt, Germany. Frauenhofer IRB Verlag, Stuttgart (2003)

  32. Szilas, N.: The future of interactive drama. In: Second Australasian Conference on Interactive Entertainment, pp. 193–199. Creativity & Cognition Studios Press, Sydney (2005)

  33. Tanenbaum, J., Tomizu, A.: Affective interaction design and narrative presentation. In: AAAI Fall Symposium on Intelligent Narrative Technologies, Arlington, VA. AAAI Press, Menlo Park (2007)

  34. Tanenbaum, J., Tanenbaum, K., Antle, A.: The Reading Glove: designing interactions for object-based tangible storytelling. In: Augmented Human, Megeve, France, pp. 132–140. ACM Press, New York (2010a)

  35. Tanenbaum, J., Tanenbaum, K., Seif El-Nasr, M., Hatala, M.: Authoring tangible interactive narratives using cognitive hyperlinks. In: 3rd Workshop on Intelligent Narrative Technologies (INT3) at Foundations of Digital Games Conference (FDG), Monterey, CA, p. 8. ACM Press, New York (2010b)

  36. Tanenbaum, K., Hatala, M., Tanenbaum, J.: User perceptions of adaptivity in an interactive narrative. In: User Modeling, Adaption, and Personalization (UMAP), Girona, Spain. ACM Press, New York (2011a)

  37. Tanenbaum, K., Tanenbaum, J., Antle, A., Seif El-Nasr, M., Hatala, M.: Experiencing the Reading Glove. In: Tangible, Embodied and Embedded Interaction, Madeira, Portugal. ACM Press, New York (2011b)

  38. Thue, D., Bulitko, V., Spetch, M., Wasylishen, E.: Interactive storytelling: a player modelling approach. In: Artificial Intelligence and Interactive Digital Entertainment Conference (AIIDE), Stanford, CA, pp. 43–48 (2007a)

  39. Thue, D., Bulitko, V., Spetch, M., Wasylishen, E.: Learning player preferences to inform delayed authoring. In: AAAI Fall Symposium on Intelligent Narrative Technologie, Arlington, VA. AAAI Press, Menlo Park (2007b)

  40. Ullmer, B., Ishii, H.: Emerging frameworks for tangible user interfaces. In: Carrol, J.M. (ed.) Human–Computer Interaction in the New Millennium, pp. 579–601. Addison-Wesley, New York (2001)

  41. Vildjiounaite, E., Koesis, O., Kyllonen, V., Kladis, B.: Context-dependent user modelling for smart homes. In: Conati, C., McCoy, K., Paliouras, G. (eds.) User Modeling. LNAI 4511. Springer, New York (2007)

  42. Williams, A., Kabisch, E., Dourish, P.: From interaction to participation: configuring space through embodied interaction. In: Ubicomp 2005, Toyko, Japan, pp. 287–304 (2005)

  43. Yin, R.K.: Case Study Research: Design and Methods, 3rd edn. Sage, Thousand Oaks (2002)

    Google Scholar 

  44. Yin, R.K.: Case Study Research: Design and Methods, 4th edn. Sage, Thousand Oaks (2009)

    Google Scholar 

  45. Zimmerman, A., Lorenz, A.: LISTEN: a user-adaptive audio-augmented museum guide. User Model. User Adapt. Interact. 18(5), 386–416 (2008)

    Article  Google Scholar 

Download references

Author information



Corresponding author

Correspondence to Karen Tanenbaum.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Tanenbaum, K., Hatala, M., Tanenbaum, T. et al. A case study of intended versus actual experience of adaptivity in a tangible storytelling system. User Model User-Adap Inter 24, 175–217 (2014).

Download citation


  • Adaptivity
  • Tangible computing
  • User models
  • Recommendation systems
  • Expert systems
  • User experience