A Real Time Human Emotion Recognition System Using Respiration Parameters and ECG

  • C. M. Naveen KumarEmail author
  • G. ShivakumarEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11278)


In the field of research on computer identification of emotion, physiological signals play an important role. The selection of the specific physiological input is dependent on its contribution to the emotion. In this research paper, light has been thrown on fusion of paramount physiological signals. The four types of physiological signals taken into account are: Electrocardiogram (ECG), Respiratory Rate (RR), Blood Pressure and Inhale-Exhale temperature of respiration. The research work done on this area is found to be minimal For first three signals, time domain features were extracted with a sensor system and an Intelligent processor. The system was trained using a feedback neural network and tested with unknown class inputs. To elicit emotion, short video sequences of 180 s are used. The videos were played in a laptop and kept at a distance of 1 m away from the subject under investigation. The results obtained are encouraging with the highest accuracy of 96.6% for happy and lowest of 70.38% for disgust with an average accuracy of 80.28%.


Emotions Respiration inhale exhale temperature Respiration rate Electrocardiogram Stimuli Autonomous nervous system 



Authors take this opportunity to thank the authorities of Malnad College of Engineering, Hassan and Technical Education Quality Improvement Programme for supporting this research work.


  1. 1.
    Jonghwa, K., Elisabeth, A.: Emotion recognition based on physiological changes in music listening. IEEE Trans. Pattern Anal. Mach. Intell. 30, 2067–2083 (2008)CrossRefGoogle Scholar
  2. 2.
    Selvaraj, J., Murugappan, M., Wan, K., Yaacob, S.: Classification of emotional states from electrocardiogram signals: a non-linear approach based on hurst. Biomed. Eng. Online 12, 3481–3499 (2013)CrossRefGoogle Scholar
  3. 3.
    Nasoz, F., Alvarez, K., Lisetti, C.L., Finkelstein, N.: Emotion recognition from physiological signals using wireless sensors for presence technologies. Cogn. Technol. Work 6, 4–14 (2004)CrossRefGoogle Scholar
  4. 4.
    Vyzas, E., Picard, R.W.: Affective pattern classification. In: Emotional and Intelligent the Tangled Knot of Cognition, pp. 176–182 (2010)Google Scholar
  5. 5.
    D’Mello, S., Graesser, A., Schuller, B., Martin, J.-C. (eds.): ACII 2011. LNCS, vol. 6974. Springer, Heidelberg (2011). Scholar
  6. 6.
    Koelstra, S., et al.: DEAP: a database for emotion analysis; using physiological signals. IEEE Trans. Affect. Comput. 3(1), 18–31 (2012)CrossRefGoogle Scholar
  7. 7.
    Agrafioti, F., Hatzinakos, D., Anderson, A.: ECG pattern analysis for emotion detection. IEEE Trans. Affect. Comput. 3(1), 102–115 (2012)CrossRefGoogle Scholar
  8. 8.
    Valenza, G., Citi, L., Lanatá, A., Scilingo, E.P., Barbieri, R.: Revealing real-time emotional responses: a personalized assessment based on heart beat dynamics. Sci. Rep. 4, 4998 (2014)Google Scholar
  9. 9.
    Goshvarpour, A., Abbasi, A., Goshvarpour, A.: Affective visual stimuli: characterization of the picture sequences impacts by means of nonlinear approaches. Basic Clin. Neurosci. 6(4), 209–222 (2015)Google Scholar
  10. 10.
    Wu, C.-K., Chung, P.-C., Wang, C.-J.: Representative segment-based emotion analysis and classification with automatic respiration signal segmentation. IEEE Trans. Affect. Comput. 3(4), 482–495 (2012)CrossRefGoogle Scholar
  11. 11.
    Valenza, G., Lanatá, A., Scilingo, E.P.: Improving emotion recognition systems by embedding cardio respiratory coupling. Physiol. Meas. 34(4), 449 (2013)CrossRefGoogle Scholar
  12. 12.
    Betella, A., et al.: Inference of human affective states from psycho physiological measurements extracted under ecologically valid conditions. Front. Neurosci. 8, 286 (2014).
  13. 13.
    Whitman, B.: How music recommendation works - and doesn’t work (2012).

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  1. 1.Department of E&I EngineeringMalnad College of EngineeringHassanIndia

Personalised recommendations