Out of the Lab and into the Fray: Towards Modeling Emotion in Everyday Life

  • Jennifer Healey
  • Lama Nachman
  • Sushmita Subramanian
  • Junaith Shahabdeen
  • Margaret Morris
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6030)

Abstract

We conducted a 19 participant study using a system comprised of wireless galvanic skin response (GSR), heart rate (HR), activity sensors and a mobile phone for aggregating sensor data and enabling affect logging by the user. Each participant wore the sensors daily for five days, generating approximately 900 hours of continuous data. We found that analysis of emotional events was highly dependent on correct windowing and report results on synthesized windows around annotated events. Where raters agreed on the timing and quality of the emotion we were able to recognize 85% of the high and low energy emotions and 70% of the positive and negative emotions. We also gained many insights regarding participant’s perception of their emotional state and the complexity of emotion in real life.

Keywords

Affective computing emotional sensing mood detection 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Langer, E.J.: Mindfulness. Perseus Books, USA (1989)Google Scholar
  2. 2.
    Kabat-Zinn, J.: Coming to Our Senses: Healing Ourselves and the World Through Mindfulness. Hyperion Books, New York (2005)Google Scholar
  3. 3.
    James, W.: William James writings 1878-1899, chapter on emotion, The Library of America, p. 1992 (1890)Google Scholar
  4. 4.
    Jung, C.G., Montague, D.E.: Studies in Word Association. Routledge and K. Paul (1969)Google Scholar
  5. 5.
    Marston, W.M.: The Lie Detector Test. R.R. Smith, New York (1938)Google Scholar
  6. 6.
    van den Broek, E., Janssen, J.H., Westerink, J.H.D.M.: Guidelines for Affective Signal Processing (ASP): From Lab to Life. In: Proceedings of the International Conference on Affective Computing and Intelligent Interaction, September 10-12, vol. 1, pp. 217–222. IEEE, Los Alamitos (2009)Google Scholar
  7. 7.
    Healey, J.A., Picard, R.W.: Detecting stress during real-world driving tasks using physiological sensors. IEEE Transactions on Intelligent Transportation Systems 6(2), 156–166 (2005)Google Scholar
  8. 8.
    Oatley, K., Duncan, E.: The Experience of Emotion in Everyday Life. Cognition & Emotion 8(4), 369–381 (1994)CrossRefGoogle Scholar
  9. 9.
    Morris, M., Guilak, F.: Mobile Heart Health: Project Highlights. IEEE Pervasive Computing 8(2), 57–61 (2009)CrossRefGoogle Scholar
  10. 10.
    Holter, N.J., Gengerelli, J.A.: Remote Recording of Physiological Data by Radio. Rocky Mountain Medical Journal Colorado Medical Society 46, 749–752 (1949)Google Scholar
  11. 11.
    Fahrenberg, J., Myrtek, M. (eds.): Progress in Ambulatory Assessment. Hogrefe and Huber Publishers (2001)Google Scholar
  12. 12.
    Hofmann, S.G., Barlow, D.H.: Ambulatory psychophysiological monitoring: A potentially useful tool when treating panic relapse. Cognitive and Behavioral Practice 3(1), 53–61 (1996)CrossRefGoogle Scholar
  13. 13.
    Healey, J.A., Picard, R.W.: Affective Wearables. In: Proceedings of the IEEE 1st International Symposium on Wearable Computers, ISWC, Cambridge, MA USA, October 13-14, pp. 91–97 (1997)Google Scholar
  14. 14.
    Westerink, J., Ouwerkerk, M., de Vries, G., de Waele, S., van den Eerenbeemd, J., van Boven, M.: Emotion measurement platform for daily life situations. In: Proceedings of the International Conference on Affective Computing and Intellignet Interaction, September 10-12, vol. 1, pp. 704–708. IEEE, Los Alamitos (2009)Google Scholar
  15. 15.
    Hedman, E., Poh, M., Wilder-Smith, O., Fletcher, R., Goodwin, M.S., Picard, R.: iCalm: Measuring Electrodermal Activity in Almost Any Setting. In: Proceedings of the International Conference on Affective Computing and Intellignet Interaction, September 10-12, vol. 1, pp. 594–595. IEEE, Los Alamitos (2009)Google Scholar
  16. 16.
    Morris, M.: Technologies for Heart and Mind: New Directions in Embedded Assesssment. Intel. Technology Journal 11(1) (2007)Google Scholar
  17. 17.
    MSP Platform description, http://seattle.intel-research.net/MSP/
  18. 18.
    Choudhury, T., Consolvo, S., Harrison, B., Hightower, J., LaMarca, A., LeGrand, L., Rahimi, A., Rea, A., Bordello, G., Hemingway, B., Klasnja, P., Koscher, K., Landay, J.A., Lester, J., Wyatt, D., Haehnel, D.: The Mobile Sensing Platform: An Embedded Activity Recognition Syste. IEEE Pervasive Computing 7(2), 32–41 (2008)CrossRefGoogle Scholar
  19. 19.
  20. 20.
    Picard, R.W., Vyzas, E., Healey, J.: Toward Machine Emotional Intelligence: Analysis of Affective Physiological State. IEEE Transactions on Pattern Analysis and Machine Intelligence 23(10), 1175–1191 (2001)CrossRefGoogle Scholar
  21. 21.
    Stern, R.M., Ray, W.J., Quigley, K.S.: Psychophysiological Recording, ch. 13, 2nd edn. Oxford University Press, Oxford (2001)Google Scholar
  22. 22.
  23. 23.
    Wan, C., Sai, P.: Challenges to Building Bluetooth-based Sensing Solutions. In: International Conference on Body Area Networks (April 2009)Google Scholar
  24. 24.
    Russel, J.A., Mehrabian, A.: Evidence for a three-factor theory of emotions. Journal of Research in Personality 11, 273–294 (1977)CrossRefGoogle Scholar
  25. 25.
    Levenson, R.W.: Autonomic Nervous System Differences Among Emotions. American Psychological Society 3(1), 23–27 (1992)Google Scholar
  26. 26.
    Ekman, P., Levenson, R.W., Friesen, W.V.: Autonomic Nervous System Activity Distinguishes Among Emotions. Science (221), 1208–1210 (1983)CrossRefGoogle Scholar
  27. 27.
    Witten, I.H., Frank, E.: Data Mining: Practical Machine Learning Tools and Techniques with Java Implementations. Morgan Kaufmann, San Francisco (1999)Google Scholar
  28. 28.
    Cooper, D.G., Arroyo, I., Park Woolf, B., Muldner, K., Burleson, W., Christopherson, R.: Sensors Model Student Self Concept in the Classroom. In: Houben, G.-J., McCalla, G., Pianesi, F., Zancanaro, M. (eds.) UMAP 2009. LNCS, vol. 5535, pp. 30–41. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  29. 29.
    Carroll, J.M., Russell, J.A.: Do facial expressions signal specific emotions? Judging emotion from the face in context. Journal of Personality and Social Psychology 70, 205–218 (1996)CrossRefGoogle Scholar
  30. 30.
    Paradiso, R., Loriga, G., Taccini, N.: A wearable health care system based on knitted integrated sensors. IEEE Transactions on Information Technology in Biomedicine 9(3), 337–344 (2005)CrossRefGoogle Scholar
  31. 31.
    Blaney, P.H.: Affect and memory: a review. Psychological Bulletin 99, 229–246 (1986)CrossRefGoogle Scholar
  32. 32.
    Bower, G.H.: Mood and memory. American Psychologist 36, 129–148 (1981)CrossRefGoogle Scholar
  33. 33.
    Morris, M., Kathawala, Q., Leen, T., Gorenstein, E.Q., Guilak, K., Deleeuw, B., Labhard, M.: Mobile therapy and mood sampling: Case study evaluations of a cell phone application for emotional self-awareness (submitted)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Jennifer Healey
    • 1
  • Lama Nachman
    • 1
  • Sushmita Subramanian
    • 1
  • Junaith Shahabdeen
    • 1
  • Margaret Morris
    • 2
  1. 1.Intel LabsFuture Technology ResearchSanta Clara
  2. 2.Digital Health Group, Intel Corp.Portland

Personalised recommendations