Skip to main content
SpringerLink
Log in

Next-Generation Personal Memory Aids

  • Published:
BT Technology Journal

Abstract

Personal memory assistance is a natural application of ubiquitous computing. Portable computers are decreasing in size, increasing in capability, and the barriers constraining earlier computer-based memory aids are rapidly diminishing. With each engineering advance, a new generation of 'personal memory aids' is enabled. This paper presents iRemember, our prototype wearable 'memory prosthesis'. It allows the wearer to capture and accrue daily experiences (primarily audio) and attempts to remedy a limited set of common memory problems by providing tools to find memory triggers within such collections. This is an early step in an area ripe for growth and controversy. The social and legal implications of ubiquitous recording are discussed and additional memory aids designed to address other memory problems are proposed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Sabbag R: 'The reluctant retiree', Boston Globe Magazine (November 2003).

  2. Kletz T: 'Lessons from disaster: how organisations have no memory and accidents recur', Institution of Chemical Engineers, Rugby, Warwickshire, UK (1993).

    Google Scholar 

  3. Loftus E F: 'Eyewitness testimony', Harvard Univ Press, Cambridge, Massachusetts (1996).

    Google Scholar 

  4. Walsh J P and Ungson G R: 'Organizational Memory', Academy of Management Review, 16, No 1, pp 57—91 (January 1991).

    Google Scholar 

  5. Bush V: 'As we may think', Atlantic Monthly, 76, No 1, pp 101— 108 (July 1945).

    Google Scholar 

  6. Hindus D and Schmandt C: 'Ubiquitous audio: capturing spontaneous collaboration', Proc CSCW '92, pp 210—217 (1992).

  7. Gemmell J, Bell G, Lueder R, Drucker S and Wong C: 'MyLifeBits: fulfilling the Memex vision', Proc ACM Multimedia '02, Juan-les-Pins, France, pp 235—238 (2002).

  8. Gerasimov V: 'Every Sign of Life', PhD thesis, MIT program in Media Arts and Sciences (2003).

  9. LifeBlog, Nokia — http://www.nokia.com/nokia/0,54628,00.html

  10. LifeLog — http://www.darpa.mil/ipto/programs/lifelog/

  11. Lin W and Hauptmann A: 'A wearable digital library of personal conversations', JCDL 2002, pp 277—278 (2002).

  12. Weiser M: 'The computer for the twenty-first century', Scientific American, pp 94—10 (September 1991).

  13. Reder S and Schwab R G: 'The temporal structure of cooperative activity', in Proc CSCW 1990, pp 303—316 (1990).

  14. Schacter D L: 'The Seven Sins of Memory: Insights from Psychology and Cognitive Neuroscience', American Psychologist, 54, No 3, pp 182—203 (1999).

    Google Scholar 

  15. Terry S S: 'Everyday forgetting: Data from a diary study', Psychological Reports, 62, pp 299—303 (1988).

    Google Scholar 

  16. Eldridge M, Sellen A and Bekerian D: 'Memory problems at work: their range, frequency, and severity', Technical Report EPC-1992-129, Rank Xerox Research Centre (1992).

  17. Wagenaar W A: 'My memory: a study of autobiographical memory over six years', in Cognitive Psychology, 18, pp 225—252 (1986).

    Google Scholar 

  18. Loftus E F and Marburger W: 'Since the eruption of Mt St Helens, did anyone beat you up? Improving the accuracy of retrospective reports with landmark events', Memory and Cognition, 11, pp 114—120 (1983).

    Google Scholar 

  19. Rhodes B and Maes P: 'Just-in-time information retrieval agents', in IBM Systems Journal special issue on the MIT Media Laboratory, 39, Nos 3 and 4, pp 685—704 (2000).

    Google Scholar 

  20. Lamming M, Brown P, Carter P, Eldridge M, Flynn M, Louie P, Robinson P and Sellen A: 'The design of a human memory prosthesis', The Computer Journal, 37, No 3, pp 153—163 (1994).

    Google Scholar 

  21. Stifelman L, Arons B and Schmandt C: 'The audio notebook: paper and pen interaction with structured speech', in Proceedings of the SIG-CHI on Human Factors in Computing Systems, pp 182—189. (2001).

  22. Mann S: 'Wearable Tetherless Computer-Mediated Reality: WearCam as a wearable face-recogniser, and other applications for the disabled', in Proceedings of AAAI Fall Symposium on Developing Assistive Technology for People with Disabilities, (November 1996).

  23. Lockerd A and Mueller F: 'LAFCam: Leveraging Affective Feedback Camcorder', in Proc CHI 2002 (2002).

  24. Healey J and Picard R: 'StartleCam: a cybernetic wearable camera', in Proc of the Second International Symposium on Wearable Computers (1998).

  25. Williams L: 'SenseCam', — http://research.microsoft.com/ hwsystems/

  26. Abowd G D: 'Classroom 2000: an experiment with the instrumentation of a living educational environment', IBM Systems Journal, 38, No 4, pp 508—530 (1999).

    Google Scholar 

  27. Morgan N, Baron D, Edwards J, Ellis D, Gelbart D, Janin A, Pfau T, Shriberg E and Stolcke A: 'The Meeting Project at ICSI', Human Language Technologies Conference (2001).

  28. Whittaker S, Hirschberg J, Amento B, Stark L, Bacchiani M, Isenhour P, Stead L, Zamchick G and Rosenberg A: 'SCANMail: a voicemail interface that makes speech browsable, readable and searchable', Proc CHI 2002, pp 275—282 (y2002).

  29. Rabiner L and Juang B: 'Fundamentals of Speech Recognition', Englewood Cliffs, NJ, Prentice-Hall (1993).

    Google Scholar 

  30. Campbell Jr J P: 'Speaker recognition: a tutorial', Proc IEEE, 85, pp 1436—1462 (September 1997).

    Google Scholar 

  31. Chellappa R, Wilson C L and Sirohey S: 'Human and machine recognition of faces: a survey', in Proceedings of the IEEE, 83, No 5, pp 705—740 (1995).

    Google Scholar 

  32. Dimitrova N: 'Multimedia content analysis and indexing for filtering and retrieval applications', in Informing Science, Special Issue on Multimedia Informing Technologies, 2, No 4 (1999).

  33. Orwant J: 'Heterogenous learning in the Doppelgänger user modeling system', User Modeling and User-Adapted Interaction, 4, No 2, pp 107—130 (1995).

    Google Scholar 

  34. Monty M L: 'Issues for Supporting Notetaking and Note Using in the Computer Environment', PhD thesis, Department of Psychology, University of California, San Diego, CA (1990).

    Google Scholar 

  35. Fernandez R: 'A Computational Model for the Automatic Recognition of Affect in Speech', PhD thesis, MIT program in Media Arts and Sciences (February 2004).

  36. Heeman P A, Byron D and Allen J F: 'Identifying discourse markers in spoken dialog', Proc AAAI 1998_Spring Symposium on Applying Machine Learning to Discourse Processing (1998)

  37. Moran T P, Palen L, Harrison S, Chiu P, Kimber D, Minneman S, van Melle W and Zellweger P: 'I'll get that off the audio: A case study of salvaging multimedia meeting records', Proc of CHI'97 (1997).

  38. Garofolo J, Auzanne C and Voorhees E: 'The TREC spoken document retrieval track: a success story', in Proc TREC, 8, pp 107—130 (1999).

    Google Scholar 

  39. ViaVoice — http://www-3.ibm.com/software/speech/

  40. Lucene — http://jakarta.apache.org/lucene/

  41. Wechsler M, Munteanu E and Schäuble P: 'New techniques for open-vocabulary spoken document retrieval', Proc SIGIR 1998, pp 20—27 (1998).

  42. CMU Pronouncing Dictionary (cmudict0.6d) — http:// www.speech.cs.cmu.edu/cgi-bin/cmudict

  43. Arons B: 'SpeechSkimmer: interactively skimming recorded speech', Proc UIST 1993, pp 187—196 (1993).

  44. Witbrock M: 'Lycos', (1999) — http://infonortics.com/ searchengines/boston1999/witbrock/index.htm

  45. Wong B A, Starner T E and McGuire R M: 'Towards conversational speech recognition for a wearable computer based appointment scheduling agent', GVU Tech Report GIT-GVU-02-17 (2002).

  46. Vemuri S, Schmandt C, Bender W, Tellex S and Lassey B: 'An audio-based personal memory aid', To appear in Proc of Ubicomp 2004 (2004).

  47. Foulke W and Sticht T G: 'Review of research on the intelligibility and comprehension of accelerated speech', Psychological Bulletin, 72, pp 50—62 (1969).

    Google Scholar 

  48. Vemuri S, DeCamp P, Bender W and Schmandt C: 'Improving speech playback using time-compression and speech recognition', in Proc CHI 2004, pp 295—302 (2004).

  49. Ringel M, Cutrell E, Dumais S T and Horvitz E: 'Milestones in time: the value of landmarks in retrieving information from personal stores', Proc Interact 2003 (2003).

  50. Brin D: 'Transparent Society', Addison-Wesley (1998).

  51. 'Hidden Cameras, Hidden Microphones: At the Crossroads of Journalism, Ethics, and the Law', — http://www.rtnda.org/ resources /hiddencamera/allstates.html

  52. Johnson C: 'Privacy lost: the supreme court's failure to secure privacy in that which is most private — personal diaries', McGeorge Law Rev, 129 (2001).

  53. Rogers M G: 'Bodily intrusion in search of evidence: a study in Fourth Amendment decision-making', 62_Ind LJ, pp 1181 (1987).

  54. Baddeley A D: 'Essentials of Human Memory', Psychology Press Ltd (1999).

  55. Craik F I M and Lockert R S: 'Levels of processing: A framework for memory research', in Journal of Verbal Learning and Verbal Behaviour, 11, pp 671—684 (1972).

    Google Scholar 

  56. Ebbinghaus H: 'Memory: a contribution to experimental psychology', trans by Ruber H A and Bussenius C E, New York, Dover (original work published 1885) (1964).

  57. Linton M: 'Memory for real-world events', in Norman D A and Rumelhart D E (Eds): 'Explorations in cognition', (Chapter 14) San Francisco, Freeman (1975).

    Google Scholar 

  58. Baddeley A D and Hitch G J: 'Recency re-examined', in Dornic S (Ed): 'Attention and performance', Hillsdale, NJ, Lawrence Erlbaum Associates Inc, pp 647—667_(1977).

    Google Scholar 

  59. Smeaton A F and Over P: 'The TREC-2002_Video Track Report', Proc TREC, 11 (November 2002).

  60. LeDoux J E: 'Emotion, memory, and the brain', Scientific American, pp 50—57_(June 1994).

  61. Finkenauer C, Luminet O, Gisle L, El-Ahmadi A, Van Der Linden M and Philippot P: 'Flashbulb memories and the underlying mechanisms of their formation: Towards an emotional-integrative model', Memory & Cognition, 26, No 3, pp 516—531 (1998).

    Google Scholar 

  62. Sinoff G and Werner P: 'Anxiety disorder and accompanying subjective memory loss in the elderly as a predictor of future cognitive decline', Int J Geriatr Psychiatry, 18, No 10, pp 951— 959 (Oct 2003).

    Google Scholar 

  63. Balota D A, Dolan P O and Ducheck J M: 'Memory changes in healthy older adults', in Tulving E and Craik F I M (Eds): 'The Oxford Handbook of Memory', Oxford University Press, pp 395— 409 (2000).

  64. Hadis M: 'From generation to generation: family stories, computers and genealogy', Masters Thesis, MIT Media Arts and Sciences (2002).

  65. Levin T Y, Frohne U and Weibel P (Eds):, The MIT Press (2002).

Download references

Authors
  1. S Vemuri
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. W Bender
    View author publications

    You can also search for this author in PubMed Google Scholar

About this article

Cite this article

Vemuri, S., Bender, W. Next-Generation Personal Memory Aids. BT Technology Journal 22, 125–138 (2004). https://doi.org/10.1023/B:BTTJ.0000047591.29175.89

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/B:BTTJ.0000047591.29175.89

Keywords

Search

Navigation