Skip to main content
SpringerLink
Log in

Recognition of Facial Patterns Using Surface Electromyography—A Preliminary Study

  • Conference paper
  • First Online:
XXVII Brazilian Congress on Biomedical Engineering (CBEB 2020)

Part of the book series: IFMBE Proceedings ((IFMBE,volume 83))

Included in the following conference series:

  • 45 Accesses

Abstract

Facial expressions are considered as a universal language method with non-verbal communication between humans. The surface Electromyography (sEMG) is a technique to acquire and processing signals obtained from the electrical activity of the contraction of voluntary muscles. From that, this work presents a preliminary study of recognition of facial expression obtained from sEMG signals. Signals from 4 subjects were acquired for six basic facial expressions that expresses the following emotions: happiness, surprise, sadness, angry, disgust, and fear. The sEMG signals were acquired from two muscles: zygomaticus major and corrugator of the eyebrow. Three feature sets for sEMG and four different classifiers were evaluated. The best combination was found with the TD9 feature set and SVM with radial basis function kernel classifier, reaching 79.8% of accuracy. Among the expressions, the best recognition was happiness, with individual accuracy of 99.2%. The most difficult expression to classify was the expression of disgust.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 509.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Cai Y, Guo Y, Jiang H, Huang M-C (2018) Machine-learning approaches for recognizing muscle activities involved in facial expressions captured by multi-channels surface electromyogram. Smart Health 5–6:15–25

    Article  Google Scholar 

  2. Nasor M, Rahman KKM, Zubair MM, Ansari H, Mohamed F (2018) Eye-controlled mouse cursor for physically disabled individual. In: 2018 advances in science and engineering technology international conferences (ASET), 1–4

    Google Scholar 

  3. Maria H, Harri P, Arto V (2015) Current state of digital signal processing in myoelectric interfaces and related applications. Biomed Sig Process Control 18:334–359

    Article  Google Scholar 

  4. Nazmi N, Rahman MA, Yamamoto S-I, Ahmad S, Zamzuri H, Mazlan S (2016) A review of classification techniques of EMG signals during isotonic and isometric contractions Sensors 16:1304

    Google Scholar 

  5. Enoka RM Bases neuromecânicas da cinesiologia. Manole 2000. Google-Books-ID: Az7JQwAACAAJ

    Google Scholar 

  6. Kamen G, Gabriel D (2010) Essentials of electromyography. Hum Kinet. Google-Books-ID: 9izzXnnKzJoC

    Google Scholar 

  7. Maisarah S, Aizreena A, Azli Y (2020) Influence of individual physical activity on EMG muscle activation pattern. In: Hassan MHA, Che MAM, Fahriza MAN et al (eds) Enhancing health and sports performance by design. Springer, Lecture Notes in Bioengineering (Singapore), pp 215–222

    Google Scholar 

  8. Aoi M, Kamijo M, Yoshida H (2011) Relationship between facial expression and facial electromyogram (f-EMG) analysis in the expression of drowsiness. In: 2011 international conference on biometrics and kansei engineering, 65–70

    Google Scholar 

  9. Ang LBP, Belen EF, Bernardo RA, Boongaling ER, Briones GH, Coronel JB (2004) Facial expression recognition through pattern analysis of facial muscle movements utilizing electromyogram sensors. In: 2004 IEEE region 10 conference TENCON 2004, vol 3; C:600–603

    Google Scholar 

  10. Hamedi M, Salleh S-H, Ting C-M, Astaraki M, Noor AM (2018) Robust facial expression recognition for MuCI: a comprehensive neuromuscular signal analysis. IEEE Transactions on Affective Computing. 2018;9:102–115. Conference Name

    Google Scholar 

  11. Mithbavkar SA, Shah MS (2019) Recognition of emotion through facial expressions using EMG signal. In: 2019 international conference on nascent technologies in engineering (ICNTE), pp 1–6

    Google Scholar 

  12. Passardi S, Peyk P, Rufer M, Wingenbach Tanja SH, Pfaltz Monique C (2019) Facial mimicry, facial emotion recognition and alexithymia in post-traumatic stress disorder. Behav Res Therapy 122:

    Article  Google Scholar 

  13. Kordsachia CC, Labuschagne I, Andrews SC, Stout JC (2018) Diminished facial EMG responses to disgusting scenes and happy and fearful faces in Huntington’s disease. Cortex 106:185–199

    Article  Google Scholar 

  14. Hermens HJ, Freriks B, Disselhorst-Klug C, Rau G (2000) Development of recommendations for SEMG sensors and sensor placement procedures. J Electromyogr Kinesiol 10:361–374

    Article  Google Scholar 

  15. Künecke J, Hildebrandt A, Recio G, Sommer W, Wilhelm O (2014) Facial EMG responses to emotional expressions are related to emotion perception ability. PloS one 9:e84053–e84053. 24489647[pmid]

    Google Scholar 

  16. Louisa K, Dennis F, Annekathrin S (2020) A comparison of the affectiva iMotions facial expression analysis software with EMG for identifying facial expressions of emotion. Front Psychol 11:329

    Google Scholar 

  17. Gordon BJ (2013) Anatotomy and phisiology: a case study approach. OpenStax

    Google Scholar 

  18. Hamedi M, Mohammad RI, Firoozabadi M (2011) Facial gesture recognition using two-channel bio-sensors configuration and fuzzy classifier: a pilot study. In: International conference on electrical, control and computer engineering (InECCE), pp 338–343

    Google Scholar 

  19. Hamedi M, Salleh S, Tan TS (2011) Surface electromyography-based facial expression recognition in bi-polar configuration. J Comput Sci 7:1407–1415

    Article  Google Scholar 

  20. Hamedi M, Sh-Hussain Salleh, Tan TS et al (2011) Human facial neural activities and gesture recognition for machine-interfacing applications. Int J Nanomed 6:3461–3472

    Google Scholar 

  21. Scott M (2006) Making comics: storytelling secrets of comics, manga and graphic novels, 1st edn. Harper, New York

    Google Scholar 

  22. Ekman P (1992) An argument for basic emotions. Cognit Emotion 6:169–200

    Article  Google Scholar 

  23. Ekman P (2005) Basic emotions, ch. 3. Wiley, pp 45–60

    Google Scholar 

  24. Magda K, Monika W (2017) Basic emotions:1–6. Springer International Publishing, Cham

    Google Scholar 

  25. Dušan S, Miloš T, Charles F (2018) Facial expressions in comics: an empirical consideration of McCloud’s proposal. Vis Commun 17:407–432

    Article  Google Scholar 

  26. Wang K, Hoosain R, Lee Tatia MC, Meng Y, Fu J, Yang R (2006) Perception of six basic emotional facial expressions by the Chinese. J Cross-Cult Psychol 37:623–629

    Article  Google Scholar 

  27. Murata A, Saito H, Schug J, Ogawa K, Kameda T (2016) Spontaneous facial mimicry is enhanced by the goal of inferring emotional states: evidence for moderation of “Automatic” mimicry by higher cognitive processes. PLoS ONE 11

    Google Scholar 

  28. Oyedotun OK, Demisse G, Shabayek AER, Aouada D, Ottersten B (2017) Facial expression recognition via joint deep learning of RGB-depth map latent representations. In: 2017 IEEE international conference on computer vision workshops (ICCVW), pp 3161–3168

    Google Scholar 

  29. Spindler O (2003) Affective space interfaces Master’s thesisFakultät für Informatik der Technischen Universität WienA-1040 Wien

    Google Scholar 

  30. Ruiliang Su, Chen Xiang, Cao Shuai, Zhang Xu (2016) Random forest-based recognition of isolated sign language subwords using data from accelerometers and surface electromyographic sensors. Sensors 16:100

    Article  Google Scholar 

  31. Hudgins B, Parker P, Scott RN (1993) A new strategy for multifunction myoelectric control. IEEE Trans Bio-Med Eng 40:82–94

    Article  Google Scholar 

  32. Phinyomark A, Khushaba Rami N, Scheme E (2018) Feature extraction and selection for myoelectric control based on wearable EMG sensors, vol 18. Sensors (Basel, Switzerland)

    Google Scholar 

  33. Theodoridis S, Pikrakis A, Koutroumbas K, Cavouras D (2010) Introduction to pattern recognition: a matlab approach, 1st edn. Academic Press, Burlington

    Google Scholar 

  34. Huang G-B, Zhu Q-Y, Siew C-K (2006) Extreme learning machine: theory and applications Neurocomputing 70:489–501

    Google Scholar 

  35. Chang CC, Lin CJ (2011) LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol 2:1–27. Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm

  36. Freitas MLB, Mendes Alves JJ, Campos DP, Stevan SL (2019) Hand gestures classification using multichannel sEMG armband. In: Costa-Felix R, Machado JC, Alvarenga AV (eds) XXVI Brazilian congress on biomedical engineering. IFMBE proceedings, Singapore, Springer, pp 239–246

    Chapter  Google Scholar 

  37. Mendes JJJA, Freitas Melissa LB, Siqueira Hugo V, Lazzaretti André E, Pichorim Sergio F, Stevan Sergio L (2020) Feature selection and dimensionality reduction: An extensive comparison in hand gesture classification by sEMG in eight channels armband approach. Biomed Sig Process Control 59:

    Article  Google Scholar 

  38. Kehri V, Ingle R, Patil S, Awale RN (2019) Analysis of facial EMG signal for emotion recognition using wavelet packet transform and SVM. In: Tanveer M, Pachori RB (eds) Machine intelligence and signal analysis. Advances in intelligent systems and computing, Singapore, Springer, pp 247–257

    Chapter  Google Scholar 

  39. Jerritta S, Murugappan M, Wan K, Yaacob S (2014) Emotion recognition from facial EMG signals using higher order statistics and principal component analysis. J Chin Inst Eng 37:385–394

    Article  Google Scholar 

Download references

Acknowledgements

This study was financed in part by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior - Brasil (CAPES) - Finance Code 001, of Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq), from Fundação Araucária (FA), and from Financiadora de Estudos e Projetos (FINEP).

Author information

Authors and Affiliations

  1. Graduate Program in Biomedical Engineering (PPGEB), Federal University of Technology—Paraná (UTFPR), Curitiba, Brazil

    M. R. Lima, J. J. A. Mendes Júnior & D. P.  Campos

  2. Graduate Program in Electrical Engineering and Industrial Informatic (CPGEI), Federal University of Technology—Paraná (UTFPR), Curitiba, Brazil

    M. R. Lima, J. J. A. Mendes Júnior & D. P.  Campos

Authors
  1. M. R. Lima
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. J. J. A. Mendes Júnior
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. D. P.  Campos
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to D. P.  Campos .

Editor information

Editors and Affiliations

  1. Department of Electrical Engineering, Universidade Federal do Espírito Santo, Vitória, Brazil

    Teodiano Freire Bastos-Filho

  2. Department of Electrical Engineering, Universidade Federal do Espírito Santo, Vitória, Brazil

    Eliete Maria de Oliveira Caldeira

  3. Department of Electrical Engineering, Universidade Federal do Espírito Santo, Vitória, Brazil

    Anselmo Frizera-Neto

Ethics declarations

The authors declare that they have no conflict of interest.

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Lima, M.R., Mendes Júnior, J.J.A., Campos, D.P. (2022). Recognition of Facial Patterns Using Surface Electromyography—A Preliminary Study. In: Bastos-Filho, T.F., de Oliveira Caldeira, E.M., Frizera-Neto, A. (eds) XXVII Brazilian Congress on Biomedical Engineering. CBEB 2020. IFMBE Proceedings, vol 83. Springer, Cham. https://doi.org/10.1007/978-3-030-70601-2_300

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-70601-2_300

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-70600-5

  • Online ISBN: 978-3-030-70601-2

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation