Skip to main content
SpringerLink
Log in

Analysis of affective ECG signals toward emotion recognition

  • Published:
Journal of Electronics (China)

Abstract

Recently, as recognizing emotion has been one of the hallmarks of affective computing, more attention has been paid to physiological signals for emotion recognition. This paper presented an approach to emotion recognition using ElectroCardioGraphy (ECG) signals from multiple subjects. To collect reliable affective ECG data, we applied an arousal method by movie clips to make subjects experience specific emotions without external interference. Through precise location of P-QRS-T wave by continuous wavelet transform, an amount of ECG features was extracted sufficiently. Since feature selection is a combination optimization problem, Improved Binary Particle Swarm Optimization (IBPSO) based on neighborhood search was applied to search out effective features to improve classification results of emotion states with the help of fisher or K-Nearest Neighbor (KNN) classifier. In the experiment, it is shown that the approach is successful and the effective features got from ECG signals can express emotion states excellently.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. R. Horlings. Emotion recognition using brain activity. [Ph.D. Dissertation]. Delft University of Technology, 2008.

  2. J. Wagner, J. Kim, and E. Andre. From physiological signals to emotions: implementing and comparing selected methods for feature extraction and classification. Proceedings of IEEE International Conference on Multimedia & Expo, Amsterdam, Netherlands, 2005, 940–943.

  3. O. Villon and C. Lisetti. Toward recognizing individual’s subjective emotion from physiological signals in practical application. Proceedings of the twentieth IEEE International Symposium on Computer-Based Medical Systems (CBMS’ 2007), Maribor, Slovenia, 2007, 357–362.

  4. A. Haag, S. Goronzy, P. Schaich, et al.. Emotion recognition using Bio-Sensors: first steps towards an automatic system. Proceedings of Affective Dialogue Systems, Tutorial and Research Workshop, Kloster Irsee, Germany, 2004, 36–48.

  5. R. W. Picard, E. Vyzas, and J. Healey. Toward machine emotional intelligence: analysis of affective physiological state. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(2001)10, 1175–1191.

    Article  Google Scholar 

  6. J. Rong, G. Li, and Y. P. Chen. Acoustic feature selection for automatic emotion recognition from speech. Information Processing & Management, 45(2009)3, 315–328.

    Article  Google Scholar 

  7. N. P. Utama, A. Takemoto, Y. Koike, and K. Nakamura. Phased processing of facial emotion: An ERP study. Neuroscience Research, 64(2009), 30–40.

    Article  Google Scholar 

  8. L. Li and J. H. Chen. Emotion recognition using physiological signals from multiple subjects. Proceedings of IEEE International Conference on Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP’ 06), USA, 2006, 355–358.

  9. S. Ktata, K. Ouni, and N. Ellouze. ECG signal maxima detection using wavelet transform. Proceedings of IEEE International Symposium on Industrial Electronics, Montreal, Canada, 2006, 700–703.

  10. Z. X. Ge and S. Wei. Wavelet Analysis Theory and the Realization of MATLAB2007. Beijing, Publishing House of Electronic Industry, 2007, 33–39 (in Chinese). 葛哲学, 沙威. 小波分析理论与MATLAB2007 实现. 北京, 电子工业出版社, 2007, 33–39.

    Google Scholar 

  11. J. Kennedy and R. Eberhart. Particle swarm optimization. Proceedings of 1995 IEEE International Conference on Neural Networks, Perth, Western Australia, 1995, 1942–1948.

  12. D. F. Cheng, G. Y. Liu, and Y. H. Qiu. Applications of particle swarm optimization and K-Nearest neighbors to emotion recognition from physiological signals. Proceeding of 2008 International Conference on Computational Intelligence and Security, Suzhou, China, 2008, 52–56.

  13. J. Kennedy and R. C. Eberhart. A discrete binary version of the particle swarm algorithm. Proceeding of 1997 IEEE International Conference on Systems, Man and Cybernetics, USA 1997, Vol. 5, 4104–4108.

  14. S. Y. Yang. Image Pattern Recognition. Beijing, Tsinghua University Press, 2006, 95–101 (in Chinese). 杨淑莹. 图像模式识别. 北京, 清华大学出版社, 2006, 95–101.

    Google Scholar 

  15. L. Feng, S. P. Yan, and T. Sun. A local-search-based particle swarm optimization algorithm and its performance analysis. Computer Engineering & Science, 28(2006)12, 72–73 (in Chinese). 冯林, 颜世鹏, 孙焘. 邻域搜索的粒子群优化算法及其 性能分析. 计算机工程与科学, 28(2006)12, 72–73.

    Google Scholar 

  16. C. Li. District power grid’s real time reactive power optimization by orthogonal genetic algorithm based on small ecology environment. Guangdong Power Transmission Technology, 11(2009)2, 8–12 (in Chinese). 李聪. 基于小生境正交遗传算法的地区电网实时无功 优化. 广东输电与变电技术, 11(2009)2, 8–12.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Electronic and Information Engineering, Southwest University, Chongqing, 400715, China

    Ya Xu, Guangyuan Liu, Min Hao & Wanhui Wen

  2. School of Psychology, Southwest University, Chongqing, 400715, China

    Xiting Huang

Authors
  1. Ya Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Guangyuan Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Min Hao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Wanhui Wen
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Xiting Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Guangyuan Liu.

Additional information

Supported by the National Natural Science Foundation of China (No. 60873143) and the National Key Subject Foundation for Basic Psychology (No. NKSF07003).

Communication author: Liu Guangyuan, born in 1961, male, Ph.D..

About this article

Cite this article

Xu, Y., Liu, G., Hao, M. et al. Analysis of affective ECG signals toward emotion recognition. J. Electron.(China) 27, 8–14 (2010). https://doi.org/10.1007/s11767-009-0094-3

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11767-009-0094-3

Key words

CLC index

Search

Navigation