Portable Device for Bi-emotional State Identification Using Heart Rate Variability

  • Sun K. Yoo
  • ChungKi Lee
  • GunKi Lee
  • ByungChae Lee
  • KeeSam Jeong
  • YoonJung Park
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4239)


For the Ubiquitous computing system, a well designed computer interface should have the ability of making the user feel comfortable so as to encourage user performance. In order to do this, systems should be able to identify the emotional state of the user. Thus, the identification of the user’s emotional state is of importance in developing context-related devices, which offer the optimal feedback to the user depending on the user’s emotional state. Those devices require portability and continuous measurement for daily use, which is particularly essential for an ubiquitous healthcare device. In this paper, the portable device for bi-emotional state identification was designed using heart rate variability (HRV) extracted from beat-to-beat photoplethysmography (PPG) waveforms. A portable wrist-band type PPG measuring device was equipped with a Bluetooth communication interface to provide mobility. HRV was estimated from smoothed differentiated PPG waveforms by the absolute value of the successive beat-to-beat interval difference. Two emotional states are artificially induced by a composed video clip, and then validated by the self-assessment Manikin method. The designed device was then applied to a respiration training device to adjust the balance level of the autonomous nervous system throughout the respiration pager, whose level changes in proportion to the estimated ratio between negative and positive emotional states. Experimentation using 19 male and six female participants demonstrated the feasibility of a ubiquitous emotional feedback control device.


Heart Rate Variability Autonomic Nerve System Portable Device Ubiquitous Service Respiration Training 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Picard, R.W., Vyzas, E., Healey, J.: Toward Machine Emotional Intelligence: Analysis of Affective Physiological State. IEEE Transactions on Pattern Analysis and Machine Intelligence 23(10) (October 2001)Google Scholar
  2. 2.
    Sinha, R., Parsons, O.: Multivariate response patterning of fear and anger. Cognition and Emotion 10(2), 173–198 (1996)CrossRefGoogle Scholar
  3. 3.
    Lang, P.J., Bradley, M.M., Cuthbert, B.N.: NIMH: Center for the Study of Emotion and Attention, international Affective Picture System (IAPS) Technical Manual and Affective Ratings (1995)Google Scholar
  4. 4.
    Lisetti, C.L., Nasoz, F.: Using Noninvasive Wearable Computers to Recognize Human Emotions form Physiological Signals. EURASIP Journal on Applied Signal Processing 11, 1672–1687 (2004)Google Scholar
  5. 5.
    Jiapupan, Tompkins, W.J.: A Real Time QRS Detection Algorithm. IEEE Transactions on Biomedical Engineering BME 32(3) (March 1985)Google Scholar
  6. 6.
    Tarvainen, M.P., Ranta-aho, P.O., Karjalainen, P.A.: An advanced detrending method with application to HRV analysis. IEEE Trans. Biomed. Eng. 49(2), 172–175 (2002)CrossRefGoogle Scholar
  7. 7.
    Levenson, R.W., Ekman, P., Friesen, W.V.: Voluntary facial action generates emotion-specific autonomic nervous systemactivity. Psychophysiology 27, 363–384 (1990)CrossRefGoogle Scholar
  8. 8.
    Cacioppo, J.T., Berntson, G.G., Larsen, J.T., Poehlmann, K.M., Ito, T.A.: The psychophysiology of Emotion. In: The handbook of emotion, 2nd edn., pp. 173–191. Guilford Press, New YorkGoogle Scholar
  9. 9.
    Andreassi, J.L.: Psychophysiology human behavior and physiological response. Lawrence Erlbaum Associates, New Jersey (2000)Google Scholar
  10. 10.
    Wang, F., Sagawa, K., Inooka, H.: Time domain HRV index for accessment of Dynamic stress. Computers in Cardiology (1998)Google Scholar
  11. 11.
    Kim, K.H., Bang, S.W., Kim, S.R.: Emotion recognition system using short-term monitoring of physiological signals. Medical & Biological Engineering &Computing 42, 419–427 (2004)CrossRefGoogle Scholar
  12. 12.
    Picard, R.W.: Affective Computing. MIT Press, London (1997)Google Scholar
  13. 13.
    Min, Y.-K., Chung, S.-C., Min, B.C.: Physiological Evaluation on Emotional Change Induced by Imagination. Psychophysiology and Biofeedback 30(2) (June 2005)Google Scholar
  14. 14.
    Yoo, S.K., Lee, C.K., Park, Y.J., Kim, N.H., Lee, B.C., Jeong, K.S.: Neural Network Based Emotion Estimation Using Heart Rate Variability and Skin Resistance. In: Wang, L., Chen, K., S. Ong, Y. (eds.) ICNC 2005. LNCS, vol. 3610, pp. 818–824. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  15. 15.
    Shusterman, V., Barnea, O.: Analysis of skin-temperature variability compared to variability of blood pressure and heart rate. In: IEEE Ann. Conf. Engineering Medicine Biology Society, pp. 1027–1028 (1995)Google Scholar
  16. 16.
    Task Force of The European Society of Cardiology and The North American Society of Pacing and Electrophysiology: Heart rate variability, Standards of measurement, physiological interpretation, and clinical use, American Heart Association Inc. European Society of Cardiology (1996)Google Scholar
  17. 17.
    Picard, R.W., Healey, J.: Affective Wearables. In: IEEE Proceedings of the First International Symposium on Wearable Computers, ISWC 1997 (October 1997)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Sun K. Yoo
    • 1
  • ChungKi Lee
    • 1
    • 2
  • GunKi Lee
    • 3
  • ByungChae Lee
    • 4
  • KeeSam Jeong
    • 4
  • YoonJung Park
    • 1
    • 5
  1. 1.Dept of Medical Engineering, College of MedicineYonsei UniversitySeoulKorea
  2. 2.Human Identification Research CenterYonsei UniversitySeoulKorea
  3. 3.Depart of Electronic Engineering. Gyeongsang National UniversityKorea
  4. 4.Dept of Medical Information SystemYongin Songdam CollegeGyeonggiKorea
  5. 5.Center for Signal Processing ResearchYonsei UniversitySeoulKorea

Personalised recommendations