Fuzzy emotion: a natural approach to automatic facial expression recognition from psychological perspective using fuzzy system
- 120 Downloads
Many studies in automatic facial expression recognitions merely limit their focus on recognizing basic emotions, ignoring the fact that humans show various emotions in their daily life. Moreover, from psychological perspective humans express multiple emotions simultaneously. Up to now, researchers recognize two basic emotions at the same time, called mixed emotions. Nevertheless, the mixed emotion still does not reflect how humans express the emotion naturally. This paper advances the concept of mixed emotion into a generalized fuzzy emotion. Fuzzy emotion captures multiple emotions in a single image using fuzzy inference engine. We propose a fuzzy emotion framework which consists of processing system and knowledge system. The processing system extracts facial expression parameters, and the knowledge system employs a fuzzy knowledge-based engine, elicited from the psychologist knowledge to recognize facial expressions. Some advantages are offered: (1) no facial template comparison; (2) no training efforts needed; (3) moreover, fuzzy emotion can recognize ambiguous facial expressions adaptively. The experiment gives a recognition result with the highest accuracy rate of 0.90. A research agenda for future study of mixed emotion recognition is proposed.
KeywordsArtificial intelligence Affective computing Emotion recognition Facial expression Fuzzy emotion Fuzzy system
The authors would like to thank all the contributors as well as participants in this research. The first author would also like to thank the Indonesia Endowment Fund for Education (LPDP) for the doctoral study sponsorship.
This study was funded by the Indonesia Ministry of Research Technology and Higher Education through the Postgraduate Team Grant number 120/SP2H/PTNBH/DRPM/2018.
Compliance with ethical standards
Conflict of interest
The authors declare that they have no conflict of interest.
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Declaration of Helsinki and its later amendments or comparable ethical standards.
Informed consent was obtained from all individual participants included in the study.
- Ekman P, Friesen WV (1975) Unmasking the face: a guide to recognizing emotions from facial clues. Prentice-Hall, OxfordGoogle Scholar
- Kamachi M, Lyons M, Gyoba J (1997) The Japanese female facial expression (jaffe) database. http://www.kasrl.org/jaffe.html. Accessed 3 Oct 2018
- Liliana DY, Widyanto MR, Basaruddin T (2016) Human emotion recognition based on active appearance model and semi-supervised fuzzy C-means. In: 2016 international conference on advanced computer science and information systems (ICACSIS), pp 439–445Google Scholar
- Liliana DY, Basaruddin C, Widyanto MR (2017) Mix emotion recognition from facial expression using SVM-CRF sequence classifier. In: Proceedings of international conference on algorithms, computing and systems - ICACS’17, pp 27–31. https://doi.org/10.1145/3127942.3127958
- Loconsole C, Miranda CR, Augusto G et al (2014) Real-time emotion recognition—novel method for geometrical facial features extraction. In: Proceedings of the 9th international conference on computer vision theory and applications, pp 378–385Google Scholar
- Lucey P, Cohn JF, Kanade T et al (2010) The extended Cohn–Kanade dataset (CK+): a complete dataset for action unit and emotion-specified expression. In: 2010 IEEE computer society conference on computer vision and pattern recognition-workshops, CVPRW, pp 94–101. https://doi.org/10.1109/cvprw.2010.5543262
- Nicolai A, Choi A (2015) Facial emotion recognition using fuzzy systems. In: 2015 IEEE international conference on systems, man, and cybernetics, pp 2216–2221. https://doi.org/10.1109/smc.2015.387
- Sadeghi H, Raie A-A, Mohammadi M-R (2013) Facial expression recognition using geometric normalization and appearance representation. In: 2013 8th Iranian conference on machine vision and image processing (MVIP). IEEE, pp 159–163Google Scholar
- Tzimiropoulos G, Pantic M (2013) Optimization problems for fast AAM fitting in-the-wild. In: 2013 IEEE international conference on computer vision, pp 593–600Google Scholar
- Vinciarelli A, Salamin H, Pantic M (2009) Social signal processing: understanding social actions through nonverbal behaviour analysis. In: 2009 IEEE computer society conference on computer vision and pattern recognition workshops, vol 3, pp 42–49. https://doi.org/10.1109/cvprw.2009.5204290