Supporting Audiography: Design of a System for Sentimental Sound Recording, Classification and Playback
It is now commonplace to capture and share images in photography as triggers for memory. In this paper we explore the possibility of using sound in the same sort of way, in a practice we call audiography. We report an initial design activity to create a system called Audio Memories comprising a ten second sound recorder, an intelligent archive for auto-classifying sound clips, and a multi-layered sound player for the social sharing of audio souvenirs around a table. The recorder and player components are essentially user experience probes that provide tangible interfaces for capturing and interacting with audio memory cues. We discuss our design decisions and process in creating these tools that harmonize user interaction and machine listening to evoke rich memories and conversations in an exploratory and open-ended way.
KeywordsAudiography Sound souvenirs Design Machine listening
This work was funded by a grant from the Engineering and Physical Sciences Research Council, as part of the Making Sense of Sounds Project (EP/N014111/1). We would like to thank our other colleagues on that project for their input to the design ideas in this paper.
- 1.Aslam S.: Facebook by the numbers: stats, demographics and fun facts. Omnicore online magazine (2018). https://www.omnicoreagency.com/facebook-statistics/
- 2.Bijsterveld, K., van Dijck, J. (eds.): Sound Souvenirs: Audio Technologies, Memory and Cultural Practices, vol. 2. Amsterdam University Press, Amsterdam (2009)Google Scholar
- 4.Dib, L., Petrelli, D., Whittaker, S.: Sonic souvenirs: exploring the paradoxes of recorded sound for family remembering. In: Proceedings of the 2010 ACM Conference on Computer Supported Cooperative Work, pp. 391–400. ACM (2010)Google Scholar
- 8.Odom, W.T., Sellen, A.J., Banks, R., Kirk, D.S., Regan, T., Selby, M., Zimmerman, J.: Designing for slowness, anticipation and re-visitation: a long term field study of the photobox. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1961–1970. ACM, April 2014Google Scholar
- 9.Oleksik, G., Frohlich, D., Brown, L.M., Sellen, A.: Sonic interventions: understanding and extending the domestic soundscape. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1419–1428. ACM (2008)Google Scholar
- 10.Oleksik, G., Brown, L.M.: Sonic gems: exploring the potential of audio recording as a form of sentimental memory capture. In: Proceedings of the 22nd British HCI Group Annual Conference on People and Computers: Culture, Creativity, Interaction, vol. 1, pp. 163–172. British Computer Society (2008)Google Scholar
- 11.Petrelli, D., Villar, N., Kalnikaite, V., Dib, L., Whittaker, S.: FM radio: family interplay with sonic mementos. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2371–2380. ACM, April 2010Google Scholar