Skip to main content
SpringerLink
Log in

Dense SIFT-Based Facial Expression Recognition Using Machine Learning Techniques

  • Conference paper
  • First Online:
Proceedings of the 6th International Conference on Advance Computing and Intelligent Engineering

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 428))

Abstract

Facial analysis is an active research topic in examining the emotional state of humans over the past few decades. It is still a challenging task in computer vision due to its high intra-class variation, head pose, suitable environment conditions like lighting and illumination factors in behaviour prediction and recommendation systems. This paper proposes a novel facial emotion representation approach based on dense descriptors for recognizing facial dynamics on image sequences. Initially, the face is detected using the Haar cascade classifer to extract the temporal information from the facial frame by applying a scale invariant feature transform by combining a bag of visual words. Later, the extracted high-level features are fed to machine learning algorithms to classify the seven emotions from the MUG dataset. The proposed dense SIFT clustering performance was evaluated on four different machine learning algorithms and achieved a high rate of recognition accuracy in all classes. In the experimental results, K-NN exhibits the proposed architecture’s effectiveness with an accuracy rate of 91.8% for the MUG dataset, 89% for SVM, 87.6% for Naive Bayes, and 85.7% decision tree, respectively.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Huang, Y., Chen, F., Lv, S., & Wang, X. (2019). Facial expression recognition: A survey. Symmetry, 11(10), 1189.

    Article  Google Scholar 

  2. Vaijayanthi, S., & Arunnehru, J. (2021). Synthesis approach for emotion recognition from cepstral and pitch coefficients using machine learning. In International Conference on Communication, Computing and Electronics Systems (pp. 515–528). Springer.

    Google Scholar 

  3. Arunnehru, J., & Kalaiselvi Geetha, M. (2017). Automatic human emotion recognition in surveillance video. In Intelligent techniques in signal processing for multimedia security (pp. 321–342). Springer.

    Google Scholar 

  4. Ekman, P., & Rosenberg, E. L. (1997). What the face reveals: Basic and applied studies of spontaneous expression using the Facial Action Coding System (FACS). Oxford University Press, USA.

    Google Scholar 

  5. Youssif, A. A. A., & Asker, W. A. A. (2011). Automatic facial expression recognition system based on geometric and appearance features. Computer and Information Science, 4(2), 115.

    Article  Google Scholar 

  6. Arunnehru, J., Nandhana Davi, A. K., Raghul Sharan, R., & Nambiar, P. G. (2019). Human pose estimation and activity classification using machine learning approach. In International Conference on Soft Computing and Signal Processing (pp. 113–123). Springer.

    Google Scholar 

  7. Arunnehru, J., Kumar, A., & Verma, J. P. (2019). Early prediction of brain tumor classification using convolution neural networks. In International Conference on Computational Intelligence, Security and Internet of Things (pp. 16–25). Springer.

    Google Scholar 

  8. Revina, I. M., & Sam Emmanuel, W. R. (2021). A survey on human face expression recognition techniques. Journal of King Saud University-Computer and Information Sciences, 33(6), 619–628.

    Google Scholar 

  9. Li, S., Deng, W. (2020). Deep facial expression recognition: A survey. IEEE Transactions on Affective Computing.

    Google Scholar 

  10. Martinez, B., Valstar, M. F., Jiang, B., & Pantic, M. (2017). Automatic analysis of facial actions: A survey. IEEE transactions on affective computing, 10(3), 325–347.

    Google Scholar 

  11. Patel, K., Mehta, D., Mistry, C., Gupta, R., Tanwar, S., Kumar, N., & Alazab, M. (2020). Facial sentiment analysis using AI techniques: State-of-the-art, taxonomies, and challenges. IEEE Access, 8, 90495–90519.

    Article  Google Scholar 

  12. Majumder, A., Behera, L., & Subramanian, V. K. (2014). Emotion recognition from geometric facial features using self-organizing map. Pattern Recognition, 47(3), 1282–1293.

    Google Scholar 

  13. Liu, X., Cheng, X., & Lee, K. (2020). Ga-svm-based facial emotion recognition using facial geometric features. IEEE Sensors Journal, 21(10), 11532–11542.

    Article  Google Scholar 

  14. Liliana, D. Y., Widyanto, M. R., & Basaruddin, T. (2016). Human emotion recognition based on active appearance model and semi-supervised fuzzy c-means. In 2016 International Conference on Advanced Computer Science and Information Systems (ICACSIS) (pp. 439–445). IEEE.

    Google Scholar 

  15. Kalsum, T., Anwar, S. M., Majid, M., Khan, B., & Ali, S. M. (2018). Emotion recognition from facial expressions using hybrid feature descriptors. IET Image Processing, 12(6), 1004–1012.

    Google Scholar 

  16. Wang, J. G., Li, J., Lee, C. Y., & Yau, W. Y. (2010). Dense sift and gabor descriptors-based face representation with applications to gender recognition. In 2010 11th International Conference on Control Automation Robotics & Vision (pp. 1860–1864). IEEE.

    Google Scholar 

  17. Li, C., Qi, Z., Jia, N., & Wu, J. (2017). Human face detection algorithm via haar cascade classifier combined with three additional classifiers. In 2017 13th IEEE International Conference on Electronic Measurement & Instruments (ICEMI) (pp. 483–487). IEEE.

    Google Scholar 

  18. Lowe, D. G. (2004). Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2), 91–110.

    Google Scholar 

  19. Kahou, S. E., Bouthillier, X., Lamblin, P., Gulcehre, C., Michalski, V., Konda, K., Jean, S., Froumenty, P., Dauphin, Y., Boulanger-Lewandowski, N., et al. (2016). Emonets: Multimodal deep learning approaches for emotion recognition in video. Journal on Multimodal User Interfaces, 10(2), 99–111.

    Google Scholar 

  20. Arunnehru, J., Vidhyasagar, B. S., & Basha, H. A. (2020). Plant leaf diseases recognition using convolutional neural network and transfer learning. In International Conference on Communication, Computing and Electronics Systems (pp. 221–229). Springer.

    Google Scholar 

  21. Arunnehru, J., & Geetha, M. K. (2013). Behavior recognition in surveillance video using temporal features. In 2013 Fourth International Conference on Computing, Communications and Networking Technologies (ICCCNT) (pp. 1–5). IEEE.

    Google Scholar 

  22. Noroozi, F., Corneanu, C. A., Kaminska, D., Sapinski, T., Escalera, S., & Anbarjafari, G. (2018). Survey on emotional body gesture recognition. IEEE Transactions on Affective Computing.

    Google Scholar 

  23. Aifanti, N., Papachristou, C., & Delopoulos, A. (2010). The mug facial expression database. In 11th International Workshop on Image Analysis for Multimedia Interactive Services WIAMIS 10 (pp. 1–4). IEEE.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, SRM Institute of Science and Technology, Vadapalani, Chennai, Tamil Nadu, India

    S. Vaijayanthi & J. Arunnehru

Authors
  1. S. Vaijayanthi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. J. Arunnehru
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to S. Vaijayanthi .

Editor information

Editors and Affiliations

  1. Department of Computer Science, Rama Devi Women’s University, Bhubaneswar, India

    Bibudhendu Pati

  2. Department of Computer Science, Rama Devi Women’s University, Bhubaneswar, India

    Chhabi Rani Panigrahi

  3. University of California, Davis, CA, USA

    Prasant Mohapatra

  4. Department of Computer Science and Information Engineering, Providence University, Taichung, Taiwan

    Kuan-Ching Li

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Vaijayanthi, S., Arunnehru, J. (2023). Dense SIFT-Based Facial Expression Recognition Using Machine Learning Techniques. In: Pati, B., Panigrahi, C.R., Mohapatra, P., Li, KC. (eds) Proceedings of the 6th International Conference on Advance Computing and Intelligent Engineering. Lecture Notes in Networks and Systems, vol 428. Springer, Singapore. https://doi.org/10.1007/978-981-19-2225-1_27

Download citation

  • DOI: https://doi.org/10.1007/978-981-19-2225-1_27

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-19-2224-4

  • Online ISBN: 978-981-19-2225-1

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation