Convolutional Neural Networks based Method for Improving Facial Expression Recognition
Recognizing facial expressions via algorithms has been a problematic mission among researchers from fields of science. Numerous methods of emotion recognition were previously proposed based on one scheme using one data set or using the data set as it is collected to evaluate the system without performing extra preprocessing steps such as data balancing process that is needed to enhance the generalization and increase the accuracy of the system. In this paper, a technique for recognizing facial expressions using different imbalanced data sets of facial expression is presented. The data is preprocessed, then, balanced, next, a technique for extracting significant features of face is implemented. Finally, the significant features are used as inputs to a classifier model. Four main classifier models are selected, namely; Decision Tree (DT), Multi-Layer Perceptron (MLP) and Convolutional Neural Network (CNN). The Convolutional Neural Network is determined to produce the best recognition accuracy.
KeywordFacial Behaviors Recognition Convolutional Neural Networks Human Computer Interaction
Unable to display preview. Download preview PDF.
- 1.Pantic, M.: Facial Expression Analysis by Computational Intelligence Techniques, Ph.D. Thesis, Faculty Electrical Engineering, Mathematics and Computer Science, Delft University of Technology, Delft, Netherlands, (2001).Google Scholar
- 2.Ekman, P.: Universal Facial Expressions of Emotions, California Mental Health Research Digest, (1940), 8(4), 151-158.Google Scholar
- 3.Hwan, M. Joo, H., Park, B.: Emotion Detection Algorithm Using Frontal Face Image, 12th International Conference on Computer Applications in Shipbuilding, (2005); KINTEX, Gyeonggi-Do, Korea.Google Scholar
- 4.Chatterjee, S., Shi, H.: A Novel Neuro Fuzzy Approach to Human Emotion Determination, International Conference on Digital Image Computing: Techniques and Applications, Sydney, Australia, (2010), 282-287.Google Scholar
- 5.Raheja, L. Kumar, U.: Human Facial Expression Detection from Detected in Captured Image Using Back Propagation Neural Network, International Journal of Computer Science and Information Technologies, (2010), 2(1), 116-123.Google Scholar
- 6.Metri, P., Ghorpade, J., Butalia, A.: Facial Emotion Recognition Using Context Based Multimodal Approach, International Journal of Emerging Sciences, (2012), 2 (1), 171-182.Google Scholar
- 7.Savran, A., Alyüz, N., Dibeklioğlu, H., Çeliktutan, O. Gökberk, B. Sankur, B. Akarun, L.: Bosphorus Database for 3D Face Analysis, First European Workshop on Biometrics and Identity Management, Roskilde, Denmark, (2008), 47-56.Google Scholar
- 8.Lyons, J., Akamatsu, S., Kamachi, M., Gyoba, J.: Coding Facial Expressions with Gabor Wavelets, Proceedings of 3rd IEEE International Conference on Automatic Face and Gesture Recognition, Nara Japan, IEEE Computer Society, (1998), 200-205.Google Scholar
- 9.Japkowicz, N.: Learning from Imbalanced Data Sets: A Comparison of Various Strategies, AAAI Press, (2000), 10-15.Google Scholar
- 10.Nitesh V. Chawla, K.W.B., Lawrence O. Hall, W. Philip Kegelmeyer, SMOTE: Synthetic Minority Over-sampling Technique, Journal of Artificial Intelligence Research, (2002), 16, 321–357.Google Scholar
- 11.Luxand Inc., Luxand FaseSDK, Detect and Recognize Faces with Luxand FaceSDK, Available from: http://www.luxand.com/facesdk/, (Accessed: 7 May 2012).
- 12.Ahmed, H., Rashid, T., Sidiq, A.: Face Behavior Recognition through Support Vector Machines, International Journal of Advanced Computer Science and Applications, (2016), 7(1), 101-108.Google Scholar
- 13.Khandait, P. Thool, C. Khandait, D.: Automatic Facial Feature Extraction and Expression Recognition Based on Neural Network, International Journal of Advanced Computer Science and Applications, (2011), 2(1), 113-118.Google Scholar
- 14.Siddiqi, H. Lee, S., Lee, K., Mehmood, A. Truc, H.: Hierarchical Recognition Scheme for Human Facial Expression Recognition Systems, Sensors (2013), 13 (12), 16682-16713.Google Scholar
- 15.Engelbrecht, P.: Computational Intelligence: An Introduction, 2nd Edition, John Wiley & Sons, Ltd, Chichester, England, (2007).Google Scholar
- 16.HSSINA, B., et al.: A comparative study of decision tree ID3 and C4.5, International Journal of Advanced Computer Science and Applications. (2014), 4(2), 13-19.Google Scholar
- 17.Galathiya, A., A. Ganatra, and C. Bhensdadia: Classification with an improved Decision Tree Algorithm. International Journal of Computer Applications, (2012), 46.Google Scholar
- 18.George, N.: Deep Neural Network Toolkit & Event Spotting in Video using DNN features, master thesis, department of computer science and engineering, Indian institute of technology madras, (2015).Google Scholar
- 19.LISA Lab: DeepLearning 0.1 Documentation, Convolutional Neural Networks, Retrieved October, 20, 2015, from http://deeplearning.net/tutorial/lenet.html, (2015).Google Scholar
- 20.Stutz, D: Understanding Convolutional Neural Networks, (Seminar Report, Fakultät für Mathematik, Informatik und Naturwissenschaften Lehr- und Forschungsgebiet Informatik VIII Computer Vision, (2014).Google Scholar