Skip to main content

Capsule Network-Based Facial Expression Recognition Method for a Humanoid Robot

  • Conference paper
  • First Online:
Recent Trends in Intelligent Computing, Communication and Devices

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 1006))

Abstract

Compared to the classical convolutional neural network (CNN), the capsule net Hinton put forward can use fewer network layers to achieve the classification tasks very well and arrive at the convergence with a faster speed. The principle of the capsule net is based on the CNN, and it is just that the neuron form is converted from the scalar to the vector, which is a capsule, and then chooses the suitable capsule for the final output through the dynamic routing method (Sabour in Dynamic routing between capsules, [1]). In this paper, on the basis of the capsule net, use deconvolution to restore images and optimize the error between original images and restored images. The classical facial emotions database named Cohn-Kanade Database Plus (CK+) that is processed through Data Augmentation is used to conduct experiments. Lately, the classification results are combined with the NAO robot. The NAO robot is able to visualize the emotion by changing its eyes colors and speaking the results, achieving the purpose of combining theory with practice.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Sabour, S., Frosst, N., Hinton, G.E.: Dynamic Routing Between Capsules (2017)

    Google Scholar 

  2. Wang, T., Tao, Y., Chen, Y.: Research status and development trends of the service robotic technology. Sci. Sin. (Informationis) 42(09), 1049–1066 (2012)

    Article  Google Scholar 

  3. Xie, L., Wen, H., Xiao, N.: Affective computing model based on HMM for home-service robot. Comput. Eng. Des. 33(01), 322–327 (2012)

    Google Scholar 

  4. Hinton, G.E., Krizhevsky, A., Wang, S.D. (2011, June). Transforming auto-encoders. In: International Conference on Artificial Neural Networks, pp. 44–51. Springer, Berlin, Heidelberg

    Google Scholar 

  5. Li, R., Liang, L., Zhao, L.: Research on service robot oriented facial expression recognition based on vision. Mechatronics 16(02), 43–48 (2010)

    Google Scholar 

  6. Osuna, E., Freund, R., Girosi, F.: Training svm: An application to face detection (1997)

    Google Scholar 

  7. Mishra, B., Fernandes, S.L., Abhishek, K., et al.: Facial expression recognition using feature based techniques and model based techniques: A survey. In: International Conference on Electronics and Communication Systems. IEEE, pp. 589–594 (2015)

    Google Scholar 

  8. Hamester, D., Barros, P., Wermter, S.: Face expression recognition with a 2-channel Convolutional Neural Network. In: International Joint Conference on Neural Networks. IEEE, pp. 1–8 (2015)

    Google Scholar 

  9. Lucey, P., Cohn, J.F., Kanade, T., et al.: The extended Cohn-Kanade dataset (CK+): a complete dataset for action unit and emotion-specified expression. In: Computer Vision and Pattern Recognition Workshops. IEEE, pp. 94–101 (2010)

    Google Scholar 

  10. NAO: Creating Interactive Robots. Robot Tech. Appl. (03), 63–65 (2014)

    Google Scholar 

  11. Odena, A., Olah, C., Shlens, J.: Conditional image synthesis with auxiliary classifier GANs (2016)

    Google Scholar 

  12. Springenberg, J.T.: Unsupervised and semi-supervised learning with categorical generative adversarial networks. Comput. Sci. (2015)

    Google Scholar 

Download references

Acknowledgements

This work was supported by the National Natural Science Foundation of China under Grant [project no. 61573145], the Public Research and Capacity Building of Guangdong Province under Grant [project no. 2014B010104001], and the Basic and Applied Basic Research of Guangdong Province under Grant [project no. 2015A 03030 8018], and the authors greatly thank these grants.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jingru Zhang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zhang, J., Xiao, N. (2020). Capsule Network-Based Facial Expression Recognition Method for a Humanoid Robot. In: Jain, V., Patnaik, S., Popențiu Vlădicescu, F., Sethi, I. (eds) Recent Trends in Intelligent Computing, Communication and Devices. Advances in Intelligent Systems and Computing, vol 1006. Springer, Singapore. https://doi.org/10.1007/978-981-13-9406-5_15

Download citation

Publish with us

Policies and ethics