From Design Fiction to Design Fact: Developing Future User Experiences with Proto-Tools

  • Alessio MaliziaEmail author
  • Alan Chamberlain
  • Ian Willcock
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10901)


Envision a future where the physical and digital become seamlessly intertwined producing unbounded possibilities from interactions with autonomous cars to the advent of smart cities. Tools and methods to explore the design and development of such emergent hybrid spaces will need to be highly inclusive involving engineers, social scientists, up to citizens. Such methods and tools might support the so-called fictitious scenarios in form of digitally augmented physical prototypes set in a near-future reality.

In this paper, we introduce the concept of “proto-tool”: multi-purpose digitally augmented artefacts with no constraints and seemingly limitless uses (e.g. virtual and augmented reality devices, digitally augmented surfaces and objects, etc.) that will be modeled on current and fictitious scenarios able to interact both with physical and digital spaces de facto enabling rapid prototyping of Cyber-Physical Interactions.


Physical-Cyber systems Design fictions Rapid prototyping User experience 


  1. 1.
    Forshaw, S., Cruickshank, L., Dix, A.: Collaborative communication tools for designing: physical-cyber environments. In: Fourth International Workshop on Physicality (2012)Google Scholar
  2. 2.
    Vavoula, G.N., Sharples, M., Rudman, P.D.: Developing the ‘future technology workshop’ method. In: Proceedings of the International Workshop on Interaction Design and Children, pp. 28–29, August 2002Google Scholar
  3. 3.
    Bleecker, J.: Design Fiction. A Short Essay on Design, Science, Fact and Fiction. Near Future Laboratory (2009)Google Scholar
  4. 4.
    Shedroff, N., Noessel, C.: Make It So: Interaction Design Lessons from Science Fiction. Rosenfeld Media, Brooklyn (2012)CrossRefGoogle Scholar
  5. 5.
    Johnson, B.D.: Science Fiction Prototyping: Designing the Future with Science Fiction, 1st edn. Morgan & Claypool Publishers, San Rafael (2011)Google Scholar
  6. 6.
    Schmidt, A.: Understanding and researching through making: a plea for functional prototypes. Interactions 24(3), 78–81 (2017)MathSciNetCrossRefGoogle Scholar
  7. 7.
    Strober, M.: Interdisciplinary Conversations: Challenging Habits of Thought. Stanford University Press, Stanford (2011)Google Scholar
  8. 8.
    Schon, D.A.: The Reflective Practitioner: How Professionals Think in Action, vol. 5126. Basic books, New York (1984)Google Scholar
  9. 9.
    Lindley, J., Potts, R., Sharma, D.: Operationalizing design fiction with anticipatory ethnography. In: Ethnographic Praxis in Industry Conference (2015)CrossRefGoogle Scholar
  10. 10.
    Hutchins, E.: Cognition in the Wild. MIT Press, Cambridge (1995)Google Scholar
  11. 11.
    Norman, D.A.: Cognitive artifacts. In: Carroll, J.M. (ed.) Designing Interaction, pp. 17–38. Cambridge University Press, New York (1991)Google Scholar
  12. 12.
    Dourish, P.: Where the Action Is: The Foundations of Embodied Interaction. MIT Press, Cambridge (2001)Google Scholar
  13. 13.
    McCarthy, J., Wright, P.: Technology as experience. Interactions 11(5), 42–43 (2004)CrossRefGoogle Scholar
  14. 14.
    Collins, A.M., Ferguson, W.: Epistemic forms and epistemic games: structures and strategies to guide inquiry. Educ. Psychol. 28(1), 25–42 (1993)CrossRefGoogle Scholar
  15. 15.
    Rosch, E.: Principles of categorization. In: Rosch, E., Lloyd, B.B. (eds) Cognition and Categorization, pp. 27–48. Lawrence Erlbaum Associates, Publishers, Hillsdale (1978)Google Scholar
  16. 16.
    Atzori, L., Iera, A., Morabito, G.: The internet of things: a survey. Comput. Netw. 54(15), 2787–2805 (2010)CrossRefGoogle Scholar
  17. 17.
    Goldschmidt, G.: The dialectics of sketching. Creat. Res. J. 4(2), 123–143 (1991)CrossRefGoogle Scholar
  18. 18.
    Blackwell, A.F., Edge, D., Dubuc, L., Rode, J.A., Stringer, M., Toye, E.F.: Using solid diagrams for tangible interface prototyping. IEEE Pervasive Comput. 4(4), 74–77 (2005)CrossRefGoogle Scholar
  19. 19.
    Nam, T.-J.: Sketch-based rapid prototyping platform for hardware-software integrated interactive products. In: Extended Abstracts on Human Factors in Computing Systems, CHI 2005, pp. 1689–1692. ACM, New York (2005)Google Scholar
  20. 20.
    Wiethoff, A., Schneider, H., Rohs, M., Butz, A., Greenberg, S.: Sketch-a-TUI: low cost prototyping of tangible interactions using cardboard and conductive ink. In: Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction, pp. 309–312. ACM, New York (2012)Google Scholar
  21. 21.
    Ballagas, R., Ringel, M., Stone, M., Borchers, J.: iStuff: a physical user interface toolkit for ubiquitous computing environments. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 537–544. ACM, New York (2003)Google Scholar
  22. 22.
    Collective, B.M., Shaw, D.: Makey makey: improvising tangible and nature-based user interfaces. In: Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction, pp. 367–370. ACM, New York (2012)Google Scholar
  23. 23.
    Gellersen, H., Kortuem, G., Schmidt, A., Beigl, M.: Physical prototyping with smart-its. IEEE Pervasive Comput. 3(3), 74–82 (2004)CrossRefGoogle Scholar
  24. 24.
    Kimura, H., Tokunaga, E., Okuda, Y., Nakajima, T.: CookieFlavors: easy building blocks for wireless tangible input. In: Extended Abstracts on Human Factors in Computing Systems, CHI 2006, pp. 965–970 (2006)Google Scholar
  25. 25.
    Kaufmann, B., Buechley, L.: Amarino: a toolkit for the rapid prototyping of mobile ubiquitous computing. In: Proceedings of the 12th International Conference on Human Computer Interaction with Mobile Devices and Services, pp. 291–298. ACM, New York (2010)Google Scholar
  26. 26.
    Moll, C., Hermen, J., Maquil, V., Rangel, H., Hill, J.-N.: Prototyping connected tangible interactions with Kniwwelino. In: CEUR Workshop Proceedings of the Third European Tangible Interaction Studio (ETIS) (2017)Google Scholar
  27. 27.
    Hornecker, E., Psik, T.: Using ARToolKit markers to build tangible prototypes and simulate other technologies. In: Costabile, M.F., Paternò, F. (eds.) INTERACT 2005. LNCS, vol. 3585, pp. 30–42. Springer, Heidelberg (2005). Scholar
  28. 28.
    Diewald, S., Roalter, L., Möller, A., Kranz, M.: Simulation of tangible user interfaces with the ROS middleware. In: Adjunct Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction, TEI 2014, vol. 14 (2014)Google Scholar
  29. 29.
    Gohlke, K., Hlatky, M., de Jong, B.: Physical construction toys for rapid sketching of tangible user interfaces. In: Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction, pp. 643–648, New York (2015)Google Scholar
  30. 30.
    Vissers, J., Geerts, D.: TUIkit: evaluating physical and functional experiences of tangible user interface prototypes. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, pp. 1267–1276. ACM, New York (2015)Google Scholar
  31. 31.
    Desolda, G., Ardito, C., Matera, M.: EFESTO: a platform for the end-user development of interactive workspaces for data exploration. In: Daniel, F., Pautasso, C. (eds.) RMC 2015. CCIS, vol. 591, pp. 63–81. Springer, Cham (2016). Scholar
  32. 32.
    Malizia, A., Turchi, T., Olsen, K.A.: Block-oriented programming with tangibles: An engaging way to learn computational thinking skills. In: 2017 IEEE Blocks and Beyond Workshop (B&B), Raleigh, NC, pp. 61–64 (2017)Google Scholar
  33. 33.
    Chamberlain, A., Crabtree, A., Rodden, T., Jones, M., Rogers, Y.: Research in the wild: understanding ‘in the wild’ approaches to design and development. In: Proceedings of the Designing Interactive Systems Conference, DIS 2012, pp. 795–796. ACM, New York (2012)Google Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  • Alessio Malizia
    • 1
    Email author
  • Alan Chamberlain
    • 2
  • Ian Willcock
    • 1
  1. 1.School of Creative ArtsUniversity of HertfordshireHatfieldUK
  2. 2.Mixed Reality Laboratory, School of Computer Science and ITUniversity of NottinghamNottinghamUK

Personalised recommendations