Advertisement

Repeatability of facial electromyography (EMG) activity over corrugator supercilii and zygomaticus major on differentiating various emotions

  • Jun-Wen Tan
  • Steffen Walter
  • Andreas Scheck
  • David Hrabal
  • Holger Hoffmann
  • Henrik Kessler
  • Harald C. Traue
Original Research

Abstract

Recent affective computing findings indicated that effectively identifying users’ emotional responses is an important issue to improve the quality of ambient intelligence. In the current study, two bipolar facial electromyography (EMG) channels over corrugator supercilii and zygomaticus major were employed for differentiating various emotional states in two dimensions of valence (negative, neutral and positive) and arousal (high and low) while participants looked at affective visual stimuli. The results demonstrated that corrugator EMG and zygomaticus EMG efficiently differentiated negative and positive emotions from others, respectively. Moreover, corrugator EMG discriminated emotions on valence clearly, whereas zygomaticus EMG was ambiguous in neutral and negative emotional states. However, there was no significant statistical evidence for the discrimination of facial EMG responses in the dimension of arousal. Furthermore, correlation analysis proved significant correlations between facial EMG activities and ratings of valence performed by participants and other samples, which strongly supported the consistency of facial EMG reactions and subjective emotional experiences. In addition, the repeatability of facial EMG indicated by intraclass correlation coefficient (ICC) were provided, in which corrugator EMG held an excellent level of repeatability, and zygomaticus EMG grasped only a poor level of repeatability. Considering these results, facial EMG is reliable and effective to identify negative and positive emotional experiences elicited by affective visual stimuli, which may offer us an alternative method in building a basis for automated classification of users’ affective states in various situations.

Keywords

Repeatability Facial electromyography Emotion Affective visual stimuli Valence 

Notes

Acknowledgments

This research was supported by grants from the Transregional Collaborative Research Center SFB/TRR 62 “Companion-Technology for Cognitive Technical System” funded by the German Research Foundation (DFG) and a doctoral scholarship by the China Scholarship Council (CSC) for Jun-Wen Tan.

References

  1. Bradley MM, Lang PJ (2008) International affective picture system (IAPS) in the study of emotion and attention. In Coan JA and Allen JJ (Eds), Handbook of emotion elicitation and assessment. Oxford university press, pp 29–46Google Scholar
  2. Bradley MM, Cuthbert BN, Lang PJ (1996) Picture media and emotion: effects of a sustained affective context. Psychophysiology 33:662–670CrossRefGoogle Scholar
  3. Cacioppo JT, Berntson GG (1994) Relationship between attitudes and evaluative space: a critical review, with emphasis on the separability of positive and negative substrates. Psychol Bull 115:401–423CrossRefGoogle Scholar
  4. Cacioppo JT, Petty RE (1981) Electromyograms as measures of extent and affectivity of information processing. Am Psychol 36(5):441–456CrossRefGoogle Scholar
  5. Cacioppo JT, Petty RE, Losch ME, Kim HS (1986) Electromyographic activities over facial muscle region can differentiate the valence and intensity of affective reactions. J Pers Soc Psychol 50:260–268CrossRefGoogle Scholar
  6. Davis WJ, Rahman MA, Smith LJ, Burns A, Senecal L, McArthur D et al (1995) Properties of human affect induced by static color slides (IAPS): dimensional, categorical and electromyographic analysis. Biol Psychol 41:229–253CrossRefGoogle Scholar
  7. Dimberg U (1990) Facial eletromyography and emotion reactions. Psychophysiology 27(5):481–494CrossRefGoogle Scholar
  8. Ekman P, Friesen WV (1975) Unmasking the face: a guide to recognizing emotions from facial clues. Prentice-Hall, Englewood CliffsGoogle Scholar
  9. Ekman P, Friesen WV, Ancoli S (1980) Facial signs of emotional experience. J Pers Soc Psychol 39(6):1125–1134CrossRefGoogle Scholar
  10. Falla D, Dall’Alba P, Rainoldi A, Merletti R, Jull G (2002) Repeatability of surface EMG variables in the sternocleidomastoid and anterior scalene muscles. Eur J Appl Physiol 87(6):542–549CrossRefGoogle Scholar
  11. Frantzidis CA, Bratsas C, Klados MA, Konstantinidis E, Lithari CD, Vivas AB, Papadelis CL, Kaldoudi E, Pappas C, Bamidis PD (2010) On the classification of emotional biosignals evoked while viewing affective pictures: an integrated data-mining-based approach for healthcare applications. IEEE Trans Inf Technol Biomed 14(2):309–318CrossRefGoogle Scholar
  12. Fridlund AJ, Cacioppo JT (1986) Guidelines for human electromyographic research. Psychophysiology 23:567–589CrossRefGoogle Scholar
  13. Granata KP, Padua DA, Abel MF (2005) Repeatability of surface EMG during gait in children. Gait & Posture 22:346–350CrossRefGoogle Scholar
  14. Lang PJ, Bradley MM, Cuthbert BN (1990) Emotion, attention, and the startle reflex. Psychol Rev 97:377–395CrossRefGoogle Scholar
  15. Lang PJ, Greenwald MK, Bradley MM, Hamm AO (1993) Looking at pictures: affective, facial, visceral, and behavioral reactions. Psychophysiology 30:261–273CrossRefGoogle Scholar
  16. Lang PJ, Bradley MM, Cuthbert BN (2008) International affective picture system (IAPS): affective ratings of pictures and instruction manual. Technical Report A-8. University of Florida, GainesvilleGoogle Scholar
  17. Larsen JT, Norris JI (2009) A facial electromyographic investigation of affective contrast. Psychophysiology 46:831–842CrossRefGoogle Scholar
  18. Larsen JT, Norris CJ, Cacioppo JT (2003) Effects of positive and negative affect on electromyographic activity over zygomaticus major and corrugator supercilii. Psychophysiology 40:776–785CrossRefGoogle Scholar
  19. Mauss IB, Robinson MD (2009) Measures of emotion: a review. Cognition and Emotion 23(2):209–237CrossRefGoogle Scholar
  20. Mehrabian A (1995) Framework for a comprehensive description and measurement of emotional states. Genet Soc Gen Psychol 121(3):339–361Google Scholar
  21. Neta M, Norris CJ, Whalen PJ (2009) Corrugator muscle responses are associated with individual differences in positivity-negativity bias. Emotion 9(5):640–648CrossRefGoogle Scholar
  22. Rainoldi A, Galardi G, Maderna L, Comi G, Lo Conte L, Merletti R (1999) Repeatability of surface EMG variables during voluntary isometric. J Electromyogr Kinesiol 9:105–119CrossRefGoogle Scholar
  23. Sato W, Fujimura T, Suzuki N (2008) Enhanced facial EMG activity in response to dynamic facial expressions. Int J Psychophysiol 70(1):70–74CrossRefGoogle Scholar
  24. Suvinen TI, Malmberg J, Forster C, Kemppainen P (2009) Postural and dynamic masseter and anterior temporalis muscle EMG repeatability in serial assessments. J Oral Rehabil 36:814–820CrossRefGoogle Scholar
  25. Tassinary LG, Cacioppo JT, Vanman EJ (2007) The skeleto-motor system: surface electromyography. In: Cacioppo JT, Tassinary LG, Berntson GG (eds) Handbook of psychophysiology, 3rd edn. Cambridge University Press, New York, pp 267–302Google Scholar
  26. Teixeira-Silva F, Prado GB, Ribeiro LC, Leite JR (2004) Theanxiogenic video-recorded Stroop Color-Word Test: psychological and physiological alterations and effects of diazepam. Physiol Behav 82(2–3):215–230CrossRefGoogle Scholar
  27. Unz DC, Schwab F (2005) Viewers viewed: facial expression patternswhile watching TV news. In: Anolli L, JR Duncan S, Riva G (eds) The hidden structure of interaction: from neurons to culture patterns. IOS press, Amsterdam, pp 253–264Google Scholar
  28. Van Boxtel A (2010) Facial EMG as a tool for inferring affective states. In: Proceedings of measuring behavior 2010, Eindhoven, the Netherlands, August 24–27, 2010Google Scholar
  29. Walter S, Kessler H, Gruss S, Jerg-Bretzke L, Scheck A, Stroebel J, Hoffmann H, Traue HC (2011) The influence of neuroticism and psychological symptoms on the assessment of images in three dimensional emotion space. GMS Psychosoc Med 8:Doc04 (20060606)Google Scholar
  30. Wolak ME, Fairbairn DJ, Paulsen YR (2011) Guidelines for estimating repeatability. Methods Ecol Evol. doi  10.1111/j.2041-210X.2011.00124.x

Copyright information

© Springer-Verlag 2011

Authors and Affiliations

  • Jun-Wen Tan
    • 1
  • Steffen Walter
    • 1
  • Andreas Scheck
    • 1
  • David Hrabal
    • 1
  • Holger Hoffmann
    • 1
  • Henrik Kessler
    • 1
  • Harald C. Traue
    • 1
  1. 1.Emotion Laboratory, Section of Medical PsychologyUniversity of UlmUlmGermany

Personalised recommendations