Abstract
The research on automatic emotional recognition has been increased drastically because of its significant influence on various applications such as treatment of the illness, educational practices, decision making, and the development of commercial applications. Using Machine Learning (ML) models, we have been trying to determine the emotion accurately and precisely from the facial expressions. But it requires a colossal number of resources in terms of data as well as computational power and can be time-consuming during its training. To solve these complications, meta-learning has been introduced to train a model on a variety of learning tasks, which assists the model to generalize the novel learning tasks using a restricted amount of data. In this paper, we have applied one of the meta-learning techniques and proposed a model called MLARE(Meta Learning Approach to Recognize Emotions) that recognizes emotions using our in-house developed dataset AED-2 (Amrita Emotion Dataset-2) which has 56 images of subjects expressing seven basic emotions viz., disgust, sad, fear, happy, neutral, anger, and surprise. It involves the implementation of the Siamese network which estimates the similarity between the inputs. We could achieve 90.6% of overall average accuracy in recognizing emotions with the state-of-the-art method of one-shot learning tasks using the convolutional neural network in the Siamese network.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Palaniswamy, S., Suchitra: A robust pose & illumination invariant emotion recognition from facial images using deep learning for human-machine interface. In: 4th International Conference on Computational Systems and Information Technology for Sustainable Solutions (CSITSS), Bengaluru, India, pp. 1–6 (2019)
Sai Prathusha, S., Suja, P., Tripathi, S., Louis, L.: Emotion recognition from facial expressions of 4D videos using curves and surface normals. In: Basu, A., Das, S., Horain, P., Bhattacharya, S. (eds.) IHCI 2016. LNCS, vol. 10127, pp. 51–64. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-52503-7_5
Swetha, K.M., Suja, P.: A geometric approach for recognizing emotions from 3D images with pose variations. In: International Conference on Smart Technologies for Smart Nation (SmartTechCon), pp. 805–809. IEEE (2017)
Suja, P., Tripathi, S.: Emotion recognition from facial expressions using images with pose, illumination and age variations for human-computer/robot interaction. J. ICT Res. Appl. 12(1), 14–34 (2018)
Keshari, T., Palaniswamy, S.: Emotion recognition using feature-level fusion of facial expressions and body gestures. In: 2019 4th International Conference on Communication and Electronics Systems, Coimbatore, TamilNadu, India, pp. 1184–1189 (2019)
Akkaya, I., et al.: Solving Rubik’s cube with a robot hand. arXiv preprint arXiv:1910.07113 (2019)
Koch, G., Zemel, R., Salakhutdinov, R.: Siamese neural networks for one-shot image recognition. In: ICML Deep Learning Workshop (2015)
Vinyals, O., Blundell, C., Lillicrap, T., Kavukcuoglu, K., Wierstra, D.: Matching networks for one shot learning. In: Proceedings of the 30th International Conference on Neural Information Processing Systems (NIPS 2016), pp. 3637–3645. Curran Associates Inc., Red Hook (2016)
Snell, J., Swersky, K., Zemel, R.: Prototypical networks for few-shot learning. In: Proceedings of the 31st International Conference on Neural Information Processing Systems (NIPS 2017), pp. 4080–4090. Curran Associates Inc., Red Hook (2017)
Sung, F., Yang, Y., Zhang, L., Xiang, T., Torr, P.H., Hospedales, T.M.: Learning to compare: relation network for few-shot learning. In: Computer Vision and Pattern Recognition (CVPR), pp. 1199–1208 (2018)
Allen, K.R., Shelhamer, E., Shin, H., Tenenbaum, J.B.: Infinite mixture prototypes for few-shot learning. arXiv preprint arXiv:1902.04552 (2019)
Santoro, A., Bartunov, S., Botvinick, M., Wierstra, D., Lillicrap, T.: Meta-learning with memory-augmented neural networks. In: Proceedings of the 33rd International Conference on International Conference on Machine Learning, ICML 2016, vol. 48, pp. 1842–1850. JMLR.org (2016)
Munkhdalai, T., Yu, H.: Meta networks. In: Proceedings of the 34th International Conference on Machine Learning, ICML 2017, vol. 70, pp. 2554–2563. JMLR.org (2017)
Finn, C., Abbeel, P., Levine, S.: Model-agnostic meta-learning for fast adaptation of deep networks. In: Proceedings of the 34th International Conference on Machine Learning, ICML 2017, vol. 70, pp. 1126–1135. JMLR.org (2017)
Kim, J., et al.: Auto-meta: automated gradient based meta learner search. arXiv preprint arXiv:1806.06927 (2018)
Li, Z., Zhou, F., Chen, F., Li, H.: Meta-SGD: learning to learn quickly for few-shot learning. arXiv preprint arXiv:1707.09835 (2017)
Behl, H.S., Baydin, A.G., Torr, P.H.S.: Alpha MAML: adaptive model-agnostic meta-learning. arXiv preprint arXiv:1905.07435 (2019)
Bromley, J., Guyon, I., LeCun, Y., Säckinger, E., Shah, R.: Signature verification using a “siamese” time delay neural network. In: Advances in Neural Information Processing Systems, pp. 737–744 (1994)
Wu, H., Xu, Z., Zhang, J., Yan, W., Ma, X.: Face recognition based on convolution siamese networks. In: 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI), Shanghai, pp. 1–5 (2017) https://doi.org/10.1109/CISP-BMEI.2017.8302003
Bukovčiková, Z., Sopiak, D., Oravec, M., Pavlovičová, J.: Face verification using convolutional neural networks with Siamese architecture. In: International Symposium ELMAR, Zadar, pp. 205–208 (2017). https://doi.org/10.23919/ELMAR.2017.8124469
Hao, H., Pei, M., Zhao, M.: Face liveness detection based on client identity using siamese network. In: Lin, Z., et al. (eds.) PRCV 2019. LNCS, vol. 11857, pp. 172–180. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-31654-9_15
Acknowledgement
We express our sincere gratitude to Mr. Pranav B. Sreedhar, for his constant support extended towards this work. His suggestions and exceptional knowledge in the field of meta-learning helped us to explore meta-learning and to complete the work successfully. We are indebted to Chiranjiv, Pranav, Ronak, Sailakshmi, Srilakshmi, Vinayak, Vasuman, and Srivathsan for expressing the required emotions for the dataset and we are thankful to Anupam for coordinating the dataset preparation.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Maddula, N.V.S.S., Nair, L.R., Addepalli, H., Palaniswamy, S. (2021). Emotion Recognition from Facial Expressions Using Siamese Network. In: Thampi, S.M., Piramuthu, S., Li, KC., Berretti, S., Wozniak, M., Singh, D. (eds) Machine Learning and Metaheuristics Algorithms, and Applications. SoMMA 2020. Communications in Computer and Information Science, vol 1366. Springer, Singapore. https://doi.org/10.1007/978-981-16-0419-5_6
Download citation
DOI: https://doi.org/10.1007/978-981-16-0419-5_6
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-16-0418-8
Online ISBN: 978-981-16-0419-5
eBook Packages: Computer ScienceComputer Science (R0)