Touchscreen Poetry: Analyzing Gestural Digital Poems

  • Gabriele Ferri
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9445)


Interactive Poetry is a lively genre within E-Lit and interactive digital narrative that was made more accessible by the diffusion of tablets with “multitouch” screens allowing relatively complex gestural UIs on consumer-level hardware. This paper leverages pragmatist aesthetics to critically interrogate three exemplar pieces (Strange Rain, What They Speak When They Speak to Me? and Vniverse) that produce poetic effects by inviting gestural interactions. In conclusion, two critical concepts (“isomorphism” and “heteromorphism”) are demonstrated for future design and research.


Poetry Gestural interfaces Pragmatism Aesthetics Semiotics 


  1. 1.
    Koenitz, H., Ferri, G., Haahr, M., Sezen, D., Sezen, T.I. (eds.): Interactive Digital Narrative: History, Theory and Practice. Routledge, New York (2015)Google Scholar
  2. 2.
    Kac, E.: Media Poetry: An International Anthology. Intellect Books, Bristol (2007)Google Scholar
  3. 3.
    Jakobson, R.: What is poetry? Lang. Lit. 368–378 (1976)Google Scholar
  4. 4.
    Murray, J.H.: Hamlet on the Holodeck: the Future of Narrative in Cyberspace. Free Press, New York (1997)Google Scholar
  5. 5.
    Hayles, K.: Electronic Literature: What is it? (1997).
  6. 6.
    Grigar, D.: The Present [Future] of electronic literature. In: Adams, R., Gibson, S., Arisona, S.M. (eds.) DAW/IF 2006/2007. CCIS, vol. 7, pp. 127–142. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  7. 7.
    Ryan, M.-L.: Narrative across Media: The Languages of Storytelling. University of Nebraska Press, Lincoln (2004)Google Scholar
  8. 8.
    Borràs, L., Memmott, T., Raley, R., Stefans, B. (eds.) Electronic Literature Collection 2. Electronic Literature Organization (2011)Google Scholar
  9. 9.
    Hayles, K., Montfort, N., Rettberg, S., Strickland, S. (eds.) Electronic Literature Collection 1. Electronic Literature Organization (2006)Google Scholar
  10. 10.
    Fritsch, J., Pold, S.B., Vestergaard, L.S., Lucas, M.: Ink: designing for performative literary interactions. Pers. Ubiquitous Comput. 18, 1551–1565 (2014)CrossRefGoogle Scholar
  11. 11.
    Bogost, I.: A Slow Year (2010).
  12. 12.
    Benmergui, D.: Today I Die (2009).
  13. 13.
    Arawjo, I.A., Mitchell, C., Camlot, J.: PoetryLab: a close listening game for iOS. In: Proceedings of the First ACM SIGCHI Annual Symposium on Computer-Human Interaction in Play, pp. 311–314. ACM, New York (2014)Google Scholar
  14. 14.
    Helgason, I.: Beat haiku: interactive poetry application. In: Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design, pp. 777–778. ACM, New York (2012)Google Scholar
  15. 15.
    Merhi, Y.: Super atari poetry. In: Proceedings of the 16th ACM International Conference on Multimedia, pp. 1137–1138. ACM, New York (2008)Google Scholar
  16. 16.
    Sezen, D.: Narrative explorations in videogame poetry. In: Koenitz, H., Ferri, G., Haahr, M., Sezen, D., Sezen, T.I. (eds.) Interactive Digital Narrative: History, Theory and Practice. Routledge, New York (2015)Google Scholar
  17. 17.
    Ishii, H., Ullmer, B.: Tangible bits: towards seamless interfaces between people, bits and atoms. In: Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems, pp. 234–241. ACM, New York (1997)Google Scholar
  18. 18.
    Hornecker, E.: Tangible Interaction (2012).
  19. 19.
    Saffer, D.: Designing Gestural Interfaces: Touchscreens and Interactive Devices. O’Reilly Media, Beijing; Cambridge (2008)Google Scholar
  20. 20.
    Tanenbaum, J., Tanenbaum, K.: The reading glove: a non-linear adaptive tangible narrative. In: Si, M., Thue, D., André, E., Lester, J., Tanenbaum, J., Zammitto, V. (eds.) ICIDS 2011. LNCS, vol. 7069, pp. 346–349. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  21. 21.
    Chow, K.K.N., Harrell, D.F.: Enduring interaction: an approach to analysis and design of animated gestural interfaces in creative computing systems. In: Proceedings of the 8th ACM Conference on Creativity and Cognition, pp. 95–104. ACM, New York (2011)Google Scholar
  22. 22.
    Arellano, D., Helzle, V.: The muses of poetry. In: CHI 2014 Extended Abstracts on Human Factors in Computing Systems, pp. 383–386. ACM, New York (2014)Google Scholar
  23. 23.
  24. 24.
    Lewis, J.E., Nadeau, B.: What They Speak When They Speak to Me (2010).
  25. 25.
    Strickland, S., Hatcher, I.: Vniverse (2014).
  26. 26.
    Strickland, S.: V : WaveTercets/Losing L’una. SpringGun Press, Denver (2014)Google Scholar
  27. 27.
  28. 28.
    Greimas, A.J., Courtés, J.: Sémiotique: dictionnaire raisonné de la théorie du langage. Hachette, Paris (1979)Google Scholar
  29. 29.
    Budniakiewicz, T.: Fundamentals of Story Logic: Introduction to Greimassian Semiotics. John Benjamins Publishing, Amsterdam (1992)CrossRefGoogle Scholar
  30. 30.
    Bertrand, D.: Précis de sémiotique littéraire. Nathan Université, Paris (2000)Google Scholar
  31. 31.
    Dewey, J.: Art as Experience. Perigee Books, New York (1934)Google Scholar
  32. 32.
    Wright, P., Wallace, J., McCarthy, J.: Aesthetics and experience-centered design. ACM Trans. Comput. Hum. Interact. 15, 18:1–18:21 (2008)CrossRefGoogle Scholar
  33. 33.
    McCarthy, J., Wright, P.: Technology as Experience. MIT Press, Cambridge (2004)Google Scholar
  34. 34.
    Boehner, K., Sengers, P., Warner, S.: Interfaces with the ineffable: meeting aesthetic experience on its own terms. ACM Trans. Comput. Hum. Interact. 15, 12:1–12:29 (2008)CrossRefGoogle Scholar
  35. 35.
    Karhulahti, V.-M.: Fiction puzzle: storiable challenge in pragmatist videogame aesthetics. Philos. Technol. 27, 201–220 (2014)CrossRefGoogle Scholar
  36. 36.
    Ferri, G.: Narrative structures in IDN authoring and analysis. In: Koenitz, H., Ferri, G., Haahr, M., Sezen, D., Sezen, T.I. (eds.) Interactive Digital Narrative: History, Theory and Practice. Routledge, New York (2015)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  1. 1.Hogeschool van AmsterdamAmsterdamThe Netherlands

Personalised recommendations