Abstract
Deep Neural Network is a large scale neural network. Deep Learning, refers to training very large Neural Networks in order to discover good representations, at multiple levels, with higher-level learned features. The rise of deep learning is especially due to the technological evolution and huge amounts of data. Since that, it becomes a powerful tool that everyone can use specifically on supervised learning, because it’s by far the dominant form of deep learning today. Many works based on Deep learning have already been proposed. However, these works have not given any explanation on the choice of the number of the network layers. This makes it difficult to decide on the appropriate deep of the network and its performances for a specific classification problem. In this paper the objective is threefold. The first objective was to study the effect of facial expressions on facial features deformations and its consequences on gender recognition. The second objective is to evaluate the use of Deep learning in the form of transfer learning for binary classification on small datasets (containing images with different Facial expressions). Our third goal is then to find a compromise between too much capacity and not enough capacity of the used deep Neural Network in order to don’t over fit nor under fit. Three different architectures were tested: a shallow convolutional neural network (CNN) with 6 layers, a deep CNN VGG16 (16 layers) and very deep CNN RESNET50 (50 Layers). Many conclusions have been drawn.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Russakovsky, O., et al.: ImageNet large scale visual recognition challenge. arXiv:1409.0575 (2014). ImageNet https://github.com/itf/imagenet-download
Chollet, F.: Deep Learning with Python. Manning Publications, USA (2018)
van de Wolfshaar, J., Karaaba, M.F., Wiering, M.A.: Deep convolutional neural networks and support vector machines for gender recognition. In: IEEE Symposium Series on Computational Intelligence (2015)
Ozbulak, G., Aytar, Y., Ekenel, H.K.: How transferable are CNN-based features for age and gender classification? In: IEEE International Conference on Biometrics Special Interest Group (BIOSIG), pp. 1–6 (2016)
Rodriguez, P., Cucurull, G., Gonfaus, J.M., Roca, F.X,. Gonzalez, J.: Age and gender recognition in the wild with deep attention. Pattern Recogn. (2017). https://doi.org/10.1016/j.patcog.2017.06.028
Antipov, G., Baccouche, M., Berrani, S.A., Dugelay, J.-L.: Effective training of convolutional neural networks for face-based gender and age prediction. Pattern Recogn. (2017). https://doi.org/10.1016/j.patcog.2017.06.031
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. ArXiv https://arxiv.org/abs/1409.1556 (2014)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), USA (2016)
Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. Comput. Vis. Pattern Recognit. 511–518 (2001). https://doi.org/10.1109/CVPR.2001.990517
Keras. https://keras.io/
Ghanem, K., Caplier, A.: Towards a full emotional system. Behav. Inf. Technol. J. 32(8), 783–799 (2013)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Ghanem, K. (2019). Towards a Better Compromise Between Shallow and Deep CNN for Binary Classification Problems of Unstructured Data. In: Renault, É., Mühlethaler, P., Boumerdassi, S. (eds) Machine Learning for Networking. MLN 2018. Lecture Notes in Computer Science(), vol 11407. Springer, Cham. https://doi.org/10.1007/978-3-030-19945-6_16
Download citation
DOI: https://doi.org/10.1007/978-3-030-19945-6_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-19944-9
Online ISBN: 978-3-030-19945-6
eBook Packages: Computer ScienceComputer Science (R0)