Convolutional Neural Networks based Method for Improving Facial Expression Recognition

  • Tarik A. RashidEmail author
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 530)


Recognizing facial expressions via algorithms has been a problematic mission among researchers from fields of science. Numerous methods of emotion recognition were previously proposed based on one scheme using one data set or using the data set as it is collected to evaluate the system without performing extra preprocessing steps such as data balancing process that is needed to enhance the generalization and increase the accuracy of the system. In this paper, a technique for recognizing facial expressions using different imbalanced data sets of facial expression is presented. The data is preprocessed, then, balanced, next, a technique for extracting significant features of face is implemented. Finally, the significant features are used as inputs to a classifier model. Four main classifier models are selected, namely; Decision Tree (DT), Multi-Layer Perceptron (MLP) and Convolutional Neural Network (CNN). The Convolutional Neural Network is determined to produce the best recognition accuracy.


Facial Behaviors Recognition Convolutional Neural Networks Human Computer Interaction 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Pantic, M.: Facial Expression Analysis by Computational Intelligence Techniques, Ph.D. Thesis, Faculty Electrical Engineering, Mathematics and Computer Science, Delft University of Technology, Delft, Netherlands, (2001).Google Scholar
  2. 2.
    Ekman, P.: Universal Facial Expressions of Emotions, California Mental Health Research Digest, (1940), 8(4), 151-158.Google Scholar
  3. 3.
    Hwan, M. Joo, H., Park, B.: Emotion Detection Algorithm Using Frontal Face Image, 12th International Conference on Computer Applications in Shipbuilding, (2005); KINTEX, Gyeonggi-Do, Korea.Google Scholar
  4. 4.
    Chatterjee, S., Shi, H.: A Novel Neuro Fuzzy Approach to Human Emotion Determination, International Conference on Digital Image Computing: Techniques and Applications, Sydney, Australia, (2010), 282-287.Google Scholar
  5. 5.
    Raheja, L. Kumar, U.: Human Facial Expression Detection from Detected in Captured Image Using Back Propagation Neural Network, International Journal of Computer Science and Information Technologies, (2010), 2(1), 116-123.Google Scholar
  6. 6.
    Metri, P., Ghorpade, J., Butalia, A.: Facial Emotion Recognition Using Context Based Multimodal Approach, International Journal of Emerging Sciences, (2012), 2 (1), 171-182.Google Scholar
  7. 7.
    Savran, A., Alyüz, N., Dibeklioğlu, H., Çeliktutan, O. Gökberk, B. Sankur, B. Akarun, L.: Bosphorus Database for 3D Face Analysis, First European Workshop on Biometrics and Identity Management, Roskilde, Denmark, (2008), 47-56.Google Scholar
  8. 8.
    Lyons, J., Akamatsu, S., Kamachi, M., Gyoba, J.: Coding Facial Expressions with Gabor Wavelets, Proceedings of 3rd IEEE International Conference on Automatic Face and Gesture Recognition, Nara Japan, IEEE Computer Society, (1998), 200-205.Google Scholar
  9. 9.
    Japkowicz, N.: Learning from Imbalanced Data Sets: A Comparison of Various Strategies, AAAI Press, (2000), 10-15.Google Scholar
  10. 10.
    Nitesh V. Chawla, K.W.B., Lawrence O. Hall, W. Philip Kegelmeyer, SMOTE: Synthetic Minority Over-sampling Technique, Journal of Artificial Intelligence Research, (2002), 16, 321–357.Google Scholar
  11. 11.
    Luxand Inc., Luxand FaseSDK, Detect and Recognize Faces with Luxand FaceSDK, Available from:, (Accessed: 7 May 2012).
  12. 12.
    Ahmed, H., Rashid, T., Sidiq, A.: Face Behavior Recognition through Support Vector Machines, International Journal of Advanced Computer Science and Applications, (2016), 7(1), 101-108.Google Scholar
  13. 13.
    Khandait, P. Thool, C. Khandait, D.: Automatic Facial Feature Extraction and Expression Recognition Based on Neural Network, International Journal of Advanced Computer Science and Applications, (2011), 2(1), 113-118.Google Scholar
  14. 14.
    Siddiqi, H. Lee, S., Lee, K., Mehmood, A. Truc, H.: Hierarchical Recognition Scheme for Human Facial Expression Recognition Systems, Sensors (2013), 13 (12), 16682-16713.Google Scholar
  15. 15.
    Engelbrecht, P.: Computational Intelligence: An Introduction, 2nd Edition, John Wiley & Sons, Ltd, Chichester, England, (2007).Google Scholar
  16. 16.
    HSSINA, B., et al.: A comparative study of decision tree ID3 and C4.5, International Journal of Advanced Computer Science and Applications. (2014), 4(2), 13-19.Google Scholar
  17. 17.
    Galathiya, A., A. Ganatra, and C. Bhensdadia: Classification with an improved Decision Tree Algorithm. International Journal of Computer Applications, (2012), 46.Google Scholar
  18. 18.
    George, N.: Deep Neural Network Toolkit & Event Spotting in Video using DNN features, master thesis, department of computer science and engineering, Indian institute of technology madras, (2015).Google Scholar
  19. 19.
    LISA Lab: DeepLearning 0.1 Documentation, Convolutional Neural Networks, Retrieved October, 20, 2015, from, (2015).Google Scholar
  20. 20.
    Stutz, D: Understanding Convolutional Neural Networks, (Seminar Report, Fakultät für Mathematik, Informatik und Naturwissenschaften Lehr- und Forschungsgebiet Informatik VIII Computer Vision, (2014).Google Scholar

Copyright information

© Springer International Publishing AG 2016

Authors and Affiliations

  1. 1.Software and Informatics EngineeringSalahaddin UniversityKurdistanIraq

Personalised recommendations