Abstract
Perfect memory is a dream long sought and which has become especially prevalent in our knowledge society. While only a few are blessed with a photographic memory, most people compensate for the fallacies of their memory with the use of tools and tricks to organize information, schedule reminders and remember facts. Most aspects of our lives, however, leave behind some sort of data trail. We explicitly document our trips and experiences while our phones implicitly record our movements and messages. The sum of these recordings paints a holistic picture of our activities in a so-called lifelog. Lifelogging technologies have long been praised for extending our memory’s capacity by allowing us to recall and browse our recorded experiences. But despite positive, well-documented effects on memory and well-being, lifelogging largely remains a niche activity with few commercially successful applications. Over recent years, we built a series of prototypes to investigate the challenges and opportunities of lifelogging technologies. We investigated the positioning of on-body cameras, the collection of implicit and explicit lifelogging data, requirements for effective lifelog reviews, automated summaries and ways to navigate multimedia lifelogs. In this chapter, we discuss the potential of these technologies to augment memory and the obstacles of bringing memory prosthetics to a broad audience.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
References
Barsalou LW (1988) Remembering reconsidered: ecological and traditional approaches to the study of memory, pp 193–243
Browne G, Berry E, Kapur N, Hodges S, Smyth G, Watson P, Wood K (2011) Memory 19(7):713–722. https://doi.org/10.1080/09658211.2011.614622
Burt CD (1992) Appl Cogn Psychol 6(5):389–404
Bush V (1979) ACM SIGPC Notes 1(4):36–44
Clinch S, Davies N, Mikusz M, Metzger P, Langheinrich M, Schmidt A, Ward G (2016) IEEE Pervasive Comput 15(1):58–67
Cohen G, Faulkner D (1986) Br J Dev Psychol 4(2):187–197
Czerwinski M, Gage DW, Gemmell J, Marshall CC, Pérez-Quiñones MA, Skeels MM, Catarci T (2006) Commun ACM 49(1):44–50
Dempster FN (1987) Effects of variable encoding and spaced presentations on vocabulary learning. J Edu Psych 79(2):162
Dingler T, Agroudy PE, Matheis G, Schmidt A (2016a) Reading-based screenshot summaries for supporting awareness of desktop activities. In: Proceedings of the 7th augmented human international conference 2016, pp 1–5
Dingler T, El Agroudy P, Le HV, Schmidt A, Niforatos E, Bexheti A, Langheinrich M (2016b) IEEE MultiMedia 23(2):4–11
Dingler T, Weber D, Pielot M, Cooper J, Chang C-C, Henze N (2017) Language learning on-the-go: Opportune moments and design of mobile microlearning sessions. In: Proceedings of the 19th international conference on human-computer interaction with mobile devices and services, MobileHCI’17. Association for Computing Machinery, New York, NY, USA. ISBN 9781450350754. https://doi.org/10.1145/3098279.3098565
Dingler T, Tag B, Lehrer S, Schmidt A (2018) Reading scheduler: proactive recommendations to help users cope with their daily reading volume. In: Proceedings of the 17th international conference on mobile and ubiquitous multimedia, MUM 2018. Association for Computing Machinery, New York, NY, USA, pp 239–244. ISBN 9781450365949. https://doi.org/10.1145/3282894.3282917
Ebbinghaus H (2013) Ann Neurosci 20(4):155
Fathi A, Farhadi A, Rehg JM (2011a) Understanding egocentric activities. In: 2011 IEEE international conference on computer vision (ICCV). IEEE, pp 407–414. https://doi.org/10.1109/ICCV.2011.6126269
Fathi A, Ren X, Rehg JM (2011b) Learning to recognize objects in egocentric activities. In 2011 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 3281–3288. https://doi.org/10.1109/CVPR.2011.5995444
Fleck R, Fitzpatrick G (2009) Int J Hum Comput Stud 67(12), 1024–1036. ISSN 1071-5819. https://doi.org/10.1016/j.ijhcs.2009.09.004. http://dx.doi.org/10.1016/j.ijhcs.2009.09.004
Gemmell J, Bel, G, Lueder R, Drucker S, Wong C (2002) Mylifebits: fulfilling the memex vision. In Proceedings of the tenth ACM international conference on multimedia. ACM, pp 235–238
Gemmell J, Bell G, Lueder R (2006) Commun ACM 49(1):88–95
Gentry C, Boneh D (2009) A fully homomorphic encryption scheme, vol 20. Stanford university Stanford
Godwin-Jones R (2010) Lang Learn Technol 14(2):4–11
Gurrin C, Jones GJF, Lee H, O’Hare N, Smeaton AF, Murphy N (2005) Mobile access to personal digital photograph archives. In Proceedings of the 7th international conference on human computer interaction with mobile devices & services, MobileHCI’05. ACM, New York, NY, USA, pp 311–314. ISBN 1-59593-089-2. https://doi.org/10.1145/1085777.1085842. http://doi.acm.org/10.1145/1085777.1085842
Harper R, Randall D, Smyth N, Evans C, Heledd L, Moore R (2008) The past is a different place: they do things differently there. In: Proceedings of the 7th ACM Conference on designing interactive systems, DIS’08. ACM, New York, NY, USA, pp 271–280. ISBN 978-1-60558-002-9. https://doi.org/10.1145/1394445.1394474. http://doi.acm.org/10.1145/1394445.1394474
Hodges S, Williams L, Berry E, Izadi S, Srinivasan J, Butler A, Smyth G, Kapur N, Wood K (2006) Sensecam: a retrospective memory aid. In: International conference on ubiquitous computing. Springer, Berlin, pp 177–193
Isaacs E, Konrad A, Walendowski A, Lennig T, Hollis V, Whittaker S (2013) Echoes from the past: how technology mediated reflection improves well-being. In: Proceedings of the SIGCHI conference on human factors in computing systems, CHI’13. Association for Computing Machinery, New York, NY, USA, pp 1071–1080. ISBN 9781450318990. https://doi.org/10.1145/2470654.2466137
Lamming M, Brown P, Carter K, Eldridge M, Flynn M, Louie G, Robinson P, Sellen A (1994) Comput J 37(3):153–163
Langheinrich M (2001) Privacy by designâATprinciples of privacy-aware ubiquitous systems. In: International conference on ubiquitous computing. Springer, Berlin, pp 273–291
Le HV, Clinch S, Sas C, Dingler T, Henze N, Davies N (2016) Impact of video summary viewing on episodic memory recall: design guidelines for video summarizations. In: Proceedings of the 2016 CHI conference on human factors in computing systems, pp 4793–4805
Li I, Forlizzi J, Dey A (2010) Know, thyself: monitoring and reflecting on facets of one’s life. In CHI’10 extended abstracts on human factors in computing systems, CHI EA’10. Association for Computing Machinery, New York, NY, USA, pp 4489–4492. ISBN 9781605589305. https://doi.org/10.1145/1753846.1754181
Li I, Dey AK, Forlizzi J (2011) Understanding my data, myself: supporting self-reflection with ubicomp technologies. In: Proceedings of the 13th international conference on ubiquitous computing, UbiComp’11. Association for Computing Machinery, New York, NY, USA, pp 405–414. ISBN 9781450306300. https://doi.org/10.1145/2030112.2030166
Luchetti M, Sutin AR (2016) Memory 24(5):592–602
Mann S (1997) Computer 30(2):25–32
Mann S (1998) ’wearcam’(the wearable camera): personal imaging systems for long-term use in wearable tetherless computer-mediated reality and personal photo/videographic memory prosthesis. In: Second international symposium on wearable computers. Digest of Papers. IEEE, pp 124–131 (1998)
Nakata T (2008) ReCALL 20(1):3–20. https://doi.org/10.1017/S0958344008000219
O’Loughlin G, Cullen SJ, McGoldrick A, O’Connor S, Blain R, O’Malley S, Warrington GD (2013) Am J Preventive Med 44(3):297–301. https://doi.org/10.1016/j.amepre.2012.11.007
Pielot M, Dingler T, Pedro JS, Oliver N (2015) When attention is not scarce-detecting boredom from mobile phone usage. In: Proceedings of the 2015 ACM international joint conference on pervasive and ubiquitous computing, UbiComp’15. Association for Computing Machinery, New York, NY, USA, pp 825–836. ISBN 9781450335744. https://doi.org/10.1145/2750858.2804252
Pirsiavash H, Ramanan D (2012) Detecting activities of daily living in first-person camera views. In: 2012 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 2847–2854. https://doi.org/10.1109/CVPR.2012.6248010
Robinson JA (1976) Cogn Psychol 8(4):578–595
Rzayev R, Dingler T, Henze N (2018) Reflectivediary: fostering human memory through activity summaries created from implicit data collection. In: Proceedings of the 17th international conference on mobile and ubiquitous multimedia, MUM 2018. Association for Computing Machinery, New York, NY, USA, pp 285–291. ISBN 9781450365949. https://doi.org/10.1145/3282894.3282907
Schacter DL (1999) Am Psychol 54(3):182
Sellen AJ, Whittaker S (2010) Commun ACM 53(5):70–77
Sellen AJ, Fogg A, Aitken M, Hodges S, Rother C, Wood K (2007) Do life-logging technologies support memory for the past? An experimental study using sensecam. In: Proceedings of the SIGCHI conference on human factors in computing systems, CHI’07. Association for Computing Machinery, New York, NY, USA, pp 81–90. ISBN 9781595935939. https://doi.org/10.1145/1240624.1240636
Silva AR, Pinho S, Macedo LM, Moulin CJ (2013) Am J Preventive Medi 44(3):302–307. https://doi.org/10.1016/j.amepre.2012.11.005
Squire LR (1992) J Cogn Neurosci 4(3):232–243
Tulving E et al (1972) Organ Mem 1:381–403
Wagenaar WA (1986) Cogn Psychol 18(2):225–252
Wilson TD, Dunn EW (2004) Ann Rev Psychol 55
Wolf K, Schmidt A, Bexheti A, Langheinrich M (2014) IEEE Pervasive Comput 13(3):8–12
Wolf K, Abdelrahman Y, Schmid D, Dingler T, Schmidt A (2015) Effects of camera position and media type on lifelogging images. In: Proceedings of the 14th international conference on mobile and ubiquitous multimedia, MUM’15. Association for Computing Machinery, New York, NY, USA, pp 234–244. ISBN 9781450336055. https://doi.org/10.1145/2836041.2836065
Wolf K, Lischke L, Sas C, Schmidt A (2016) The value of information cues for lifelog video navigation. In: Proceedings of the 15th international conference on mobile and ubiquitous multimedia, MUM’16. Association for Computing Machinery, New York, NY, USA, pp 153–157. ISBN 9781450348607. https://doi.org/10.1145/3012709.3012712
Zijlstra FR, Van Doorn L (1985) The construction of a scale to measure subjective effort. Delft, Netherlands 43:124–139
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Dingler, T., Agroudy, P.E., Rzayev, R., Lischke, L., Machulla, T., Schmidt, A. (2021). Memory Augmentation Through Lifelogging: Opportunities and Challenges. In: Dingler, T., Niforatos, E. (eds) Technology-Augmented Perception and Cognition. Human–Computer Interaction Series. Springer, Cham. https://doi.org/10.1007/978-3-030-30457-7_3
Download citation
DOI: https://doi.org/10.1007/978-3-030-30457-7_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-30456-0
Online ISBN: 978-3-030-30457-7
eBook Packages: Computer ScienceComputer Science (R0)