Abstract
Effective expression analysis hugely depends upon the accurate representation of facial features. Proper identification and tracking of different facial muscles irrespective of pose, face shape, illumination, and image resolution is very much essential for serving the purpose. However, extraction and analysis of facial and appearance based features fails with improper face alignment and occlusions. Few existing works on these problems mainly determine the facial regions which contribute towards discrimination of expressions based on the training data. However, in these approaches, the positions and sizes of the facial patches vary according to the training data which inherently makes it difficult to conceive a generic system to serve the purpose. This paper proposes a novel facial landmark detection technique as well as a salient patch based facial expression recognition framework based on ACNN with significant performance at different image resolutions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Mollahosseini, A., Chan, D., Mahoor, M.H.: Going deeper in facial expression recognition using deep neural networks. In: 2016 IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 1–10. IEEE, March 2016
Happy, S.L., Routray, A.: Automatic facial expression recognition using features of salient facial patches. IEEE Trans. Affect. Comput. 6(1), 1–12 (2014)
Kotsia, I., Buciu, I., Pitas, I.: An analysis of facial expression recognition under partial facial image occlusion. Image Vis. Comput. 26(7), 1052–1067 (2008)
Li, Y., Zeng, J., Shan, S., Chen, X.: Patch-gated CNN for occlusion-aware facial expression recognition. In: 2018 24th International Conference on Pattern Recognition (ICPR), pp. 2209–2214. IEEE, August 2018
Li, Y., Zeng, J., Shan, S., Chen, X.: Occlusion aware facial expression recognition using CNN with attention mechanism. IEEE Trans. Image Process. 28(5), 2439–2450 (2018)
Lyons, M.J., Akamatsu, S., Kamachi, M., Gyoba, J., Budynek, J.: The Japanese female facial expression (JAFFE) database. In: FG, pp. 14–16 (2005)
Zhang, J., Kan, M., Shan, S., Chen, X.: Occlusion-free face alignment: deep regression networks coupled with de-corrupt autoencoders. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3428–3437 (2016)
S. F. Cotter, Sparse representation for accurate classification of corrupted and occluded facial expressions, Proc. ICASSP, pp. 838–841, Apr. (2010)
S. F. Cotter, Weighted voting of sparse representation classifiers for facial expression recognition, Proc. Signal Process. Eur. Conf., pp. 1164–1168, (2010)
Wang, K., Peng, X., Yang, J., Meng, D., Qiao, Y.: Region attention networks for pose and occlusion robust facial expression recognition. IEEE Trans. Image Process. 29, 4057–4069 (2020)
Wang, C., et al.: Lossless attention in convolutional networks for facial expression recognition in the wild. arXiv preprint. arXiv:2001.11869 (2020)
Yolcu, G., Oztel, I., Kazan, S., Oz, C., Bunyak, F.: Deep learning-based face analysis system for monitoring customer interest. J. Ambient Intell. Hum. Comput. 11(1), 237–248 (2019). https://doi.org/10.1007/s12652-019-01310-5
Sajjad, M., Zahir, S., Ullah, A., Akhtar, Z., Muhammad, K.: Human behavior understanding in big multimedia data using CNN based facial expression recognition. Mob. Netw. Appl. 25(4), 1611–1621 (2019). https://doi.org/10.1007/s11036-019-01366-9
Wei, X., Wang, H., Scotney, B., Wan, H.: Minimum margin loss for deep face recognition. Pattern Recogn. 97, 107012 (2020)
Wang, P., Fei, S., Zhao, Z., Guo, Y., Zhao, Y., Zhuang, B.: Deep class-skewed learning for face recognition. Neurocomputing 363, 35–45 (2019)
Acknowledgements
This Publication is an outcome of the R&D work undertaken in the project under the Visvesvaraya Ph.D. Scheme (Unique Awardee Number: VISPHD-MEITY-2959) of Ministry of Electronics & Information Technology, Government of India, being implemented by Digital India Corporation (formerly Media Lab Asia).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 IFIP International Federation for Information Processing
About this paper
Cite this paper
Engoor, S., Selvaraju, S., Christopher, H.S., Guruvayur Suryanarayanan, M., Ranganathan, B. (2020). Effective Emotion Recognition from Partially Occluded Facial Images Using Deep Learning. In: Chandrabose, A., Furbach, U., Ghosh, A., Kumar M., A. (eds) Computational Intelligence in Data Science. ICCIDS 2020. IFIP Advances in Information and Communication Technology, vol 578. Springer, Cham. https://doi.org/10.1007/978-3-030-63467-4_17
Download citation
DOI: https://doi.org/10.1007/978-3-030-63467-4_17
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-63466-7
Online ISBN: 978-3-030-63467-4
eBook Packages: Computer ScienceComputer Science (R0)
