Skip to main content

Advertisement

SpringerLink
Log in

Facial emotion recognition system for autistic children: a feasible study based on FPGA implementation

  • Original Article
  • Published:
Medical & Biological Engineering & Computing Aims and scope Submit manuscript

Abstract

Children with autism spectrum disorder have difficulty in understanding the emotional and mental states from the facial expressions of the people they interact. The inability to understand other people’s emotions will hinder their interpersonal communication. Though many facial emotion recognition algorithms have been proposed in the literature, they are mainly intended for processing by a personal computer, which limits their usability in on-the-move applications where portability is desired. The portability of the system will ensure ease of use and real-time emotion recognition and that will aid for immediate feedback while communicating with caretakers. Principal component analysis (PCA) has been identified as the least complex feature extraction algorithm to be implemented in hardware. In this paper, we present a detailed study of the implementation of serial and parallel implementation of PCA in order to identify the most feasible method for realization of a portable emotion detector for autistic children. The proposed emotion recognizer architectures are implemented on Virtex 7 XC7VX330T FFG1761-3 FPGA. We achieved 82.3 % detection accuracy for a word length of 8 bits.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Amedsaid A, Amira A, Bouridane A (2003) Improved SVD systolic array and implementation on FPGA. In: IEEE international conference on field-programmable technology, Australia, pp. 35–42

  2. Bos DO (2006) EEG-based emotion recognition. http://hmi.ewi.utwente.nl/verslagen/capitaselecta/CS-Oude_Bos-Danny.pdf

  3. Chakraborty A, Konar A, Kumar U, Chatterjee A (2009) Emotion recognition from facial expression and its control using fuzzy logic. IEEE Trans Syst Man Cybern A 39(4):726–743

    Article  Google Scholar 

  4. Ching-Chih T, You-Zhu C, et al (2009) Interactive emotion recognition using Support Vector Machine for human-robot interaction. In: IEEE international conference on systems, man and cybernetics, Taiwan, pp: 407–412

  5. Happe F, Briskman J (2001) Exploring the cognitive phenotype of Autism: weak “central cohenrance” in parents and sibilings of children with autistim, I: experimental tests. J Child Physiol Psychiatry Allied Disciplines 42(3):299–307

    Article  CAS  Google Scholar 

  6. Hart M (2005) Autism/Excel study, ASSETS 2005. In: The 7th international ACM SIGACCESS conference on computers and accessibility, New York, pp. 136–141

  7. Kim KH, Bang SW, Kim SR (2004) Emotion recognition system using short-term monitoring of physiological signals. Med Biol Eng Comput J 42(3):419–427

    Article  CAS  Google Scholar 

  8. Kobayashi H, Hara F (1993) The recognition of basic facial expressions by neural network. Trans Soc Instrum Contr Eng 29(1):112–118

    Article  Google Scholar 

  9. LoPresti EF, Bodine C (2008) Assistive technology for cognition [Understanding the needs of person with disabilities]. Eng Med Biol Mag 27(2):29–39

    Article  Google Scholar 

  10. Lugger K, Flotzinger D, Schlögl A, Pregenzer M, Pfurtscheller G (1998) Feature extraction for on-line EEG classification using principal components and linear discriminants. Med Biol Eng Compu 36(3):309–314

    Article  CAS  Google Scholar 

  11. Lyons M, Akamatsu S, Kamachi M, Gyoba J (1998) Coding facial expressions with Gabor wavelets. In: 3rd IEEE international conference on automatic face and gesture recognition, Nara, Japan, pp. 200–205

  12. Orini M, Bailón R, Enk R, Koelsch S, Mainardi LT, Laguna P (2010) A method for continuously assessing the autonomic response to music-induced emotions through HRV analysis. Med Biol Eng Comput J 48:423–433

    Article  Google Scholar 

  13. Santi-Jones P, Gu D (2006) Static face detection and emotion recognition with FPGA support. In: 3rd International conference on informatics in control, automation and robotics, robotics and automation, Setúbal, Portugal, pp. 390–397

  14. Shan C, Gong S, McOwan P (2009) Facial expression recognition based on Local Binary Patterns: a comprehensive study. Image Vis Comput 27(6):803–816

    Article  Google Scholar 

  15. Smitha KG, Vinod AP (2013) Hardware efficient FPGA implementation of emotion recognizer for autistic children. In: IEEE international conference on electronics, computer and communication technologies, pp. 1–4, Bangalore, India

  16. Smitha KG, Vinod AP (2013) Low complexity FPGA implementation of emotion detection for autistic children. In: The 7th IEEE international symposium on medical information and communication technology, Tokyo, Japan

  17. Tie Y, Ling G (2010) Human emotion recognition using real 3D visual features from Gabor library. In: IEEE international workshop on multimedia signal processing (MMSP), pp. 505–510

  18. Turk M, Pentland A (1991) Eigenfaces for recognition. J Cogn Neurosci 3(1):71–86

    Article  CAS  PubMed  Google Scholar 

  19. Uljarevic M, Hamilton A (2013) Recognition of emotions in autism: a formal meta-analysis. J Autism Dev Disord 43(7):1517–1526. doi:10.1007/s10803-012-1695-5

    Article  PubMed  Google Scholar 

  20. Wang T, Wei P (2010) Hardware efficient architectures of improved Jacobi method to solve the Eigen problem. In: International conference on computer engineering and technology, Chengdu, China, vol. 6, pp. 22–25

  21. Yacoub S, Simske S, Lin X, Burns J (2003) Recognition of emotions in interactive voice response systems. In: 8th European conference on speech communication and technology, Euro speech 2003, Geneva, Switzerland, pp. 1–4

  22. Yamada T, Watanabe T (2002) Effects of facial color on virtual facial image synthesis for dynamic facial color and expression under laughing emotion. Trans Human Interface Soc 4(1):1–8

    Google Scholar 

  23. Yang JB, Bohme JF (1991) Reducing the computations of the singular value decomposition array given by Brent and Luk. SIAM J Matrix Anal Appl 12(4):713–725

    Article  Google Scholar 

  24. Zhang L, Tjondronegoro D (2011) Facial expression recognition using facial movement features. IEEE Trans Affect Comput 2(4):219–229

    Article  CAS  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Computer Engineering, Nanyang Technological University, Singapore, Singapore

    K. G. Smitha & A. P. Vinod

Authors
  1. K. G. Smitha
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. A. P. Vinod
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to K. G. Smitha.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Smitha, K.G., Vinod, A.P. Facial emotion recognition system for autistic children: a feasible study based on FPGA implementation. Med Biol Eng Comput 53, 1221–1229 (2015). https://doi.org/10.1007/s11517-015-1346-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11517-015-1346-z

Keywords

Search

Navigation