Speech-Enabled Intelligent Mobile Interfaces to Support Older Adults’ Storytelling Around Digital Family Pictures

  • Benett Axtell
  • Cosmin Munteanu
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 617)


Seniors’ needs or interests are often ignored in the design and development of new technologies, causing many new applications that may benefit them to be overlooked. Digital storytelling is one such emerging application that is based on oral, written, or artefact-based storytelling, which in its traditional format has been shown to increase socialization in older adults. In our work we propose a new multimodal interface that incentivizes seniors to tell stories from family photos. The proposed authoring tool is based on speech interaction, and allows for the creation of unstructured, free-flowing stories by older adult users as guided by the app. This tool is intended to act as a trigger for storytelling by being enjoyable to use and by having shareable outputs (i.e. multimedia stories and robust photo tags) that preserve family memories. This solution is expected to increase socialization among seniors and preserve family knowledge without undue effort.


Digital storytelling Multimodal interaction Speech and audio interfaces Technologies for ageing Social connectivity 


  1. 1.
    Balabanović, M., Chu, L.L., Wolff, G.J.: Storytelling with digital photographs. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 564–571. ACM, April 2000Google Scholar
  2. 2.
    Fleck, M.: Eavesdropping on storytelling. Technical report HPL-2004-44, HP Laboratories Palo Alto (2004)Google Scholar
  3. 3.
    Harrand, A.G., Bollstetter, J.J.: Developing a community-based reminiscence group for the elderly. Clin. Nurse Spec. 14(1), 17–22 (2000)CrossRefGoogle Scholar
  4. 4.
    Kim, J., Zimmerman, J.: Cherish: smart digital photo frames for sharing social narratives at home. In: CHI 2006 Extended Abstracts on Human Factors in Computing Systems, pp. 953–958. ACM, April 2006Google Scholar
  5. 5.
    Lee, H.C., Cho, S.Y., Cheng, Y.F., Tang, H.H., Hsu, Y.J., Chen, C.H.: Picgo: a reminiscence physical-digital photo annotation service for the elderly. Gerontechnology 13(2), 236 (2014)Google Scholar
  6. 6.
    Lindley, S.E.: Before i forget: from personal memory to family history. Hum. Comput. Interact. 27(1–2), 13–36 (2012)Google Scholar
  7. 7.
    Ludlow, B.A., Ladly, M.J.: Postcard memories: developing a mobile postcard application using a novel approach to multi-level system design (2014)Google Scholar
  8. 8.
    Nicholson, N.R.: A review of social isolation: an important but underassessed condition in older adults. J. Prim. Prevent. 33(2–3), 137–152 (2012)CrossRefGoogle Scholar
  9. 9.
    Piper, A.M., Weibel, N., Hollan, J.D.: Designing audio-enhanced paper photos for older adult emotional wellbeing in communication therapy. Int. J. Hum. Comput. Stud. 72(8), 629–639 (2014)CrossRefGoogle Scholar
  10. 10.
    Robinson, J.A.: Personal narratives reconsidered. J. Am. Folklore 94(371), 58–85 (1981)CrossRefGoogle Scholar
  11. 11.
    Shen, C., Lesh, N., Vernier, F., Forlines, C., Frost, J.: Building and sharing digital group histories. In: CSCW Videos, p. 3, November 2002Google Scholar
  12. 12.
    Thiry, E., Rosson, M.B.: Unearthing the family gems: design requirements for a digital reminiscing system for older adults. In: CHI 2012 Extended Abstracts on Human Factors in Computing Systems, pp. 1715–1720. ACM, May 2012Google Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  1. 1.TAGlabUniversity of TorontoTorontoCanada
  2. 2.Institute of Communication, Culture, Information and TechnologyUniversity of Toronto MississaugaMississaugaCanada

Personalised recommendations