Skip to main content
SpringerLink
Log in

AI System in Monitoring of Emotional State of a Student with Autism

  • Conference paper
  • First Online:
Advances in Intelligent Systems and Computing V (CSIT 2020)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 1293))

Included in the following conference series:

Abstract

This article is an overview of a practical implementation of monitoring the emotional state of a student with autism. In this article, we present an in-depth review of current technologies for detecting human emotions. The purpose of this work is to create an AI system to help teachers and psychologists to observe children with autism while they are learning or passing tests. The object is the methods and tools for emotion recognition. This system is designed to solve the problems of recognizing the emotional state of the student and helping him to properly respond to the emotional manifestations of other people. The subject of this system are processes of activity of this AI. We conclude the investigation by highlighting the aspects that require further research and development.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Isard, K.: Psychology of Emotions. Piter, St. Petersburg (1999)

    Google Scholar 

  2. Labunskaya, V.: Human Expression: Communication and Interpersonal Perception. Phoenix, Rostov-on-Don (1999)

    Google Scholar 

  3. Petrovskaya, L.: Competence in Communication. Socio-psychological training. Publishing house of Moscow University, Moscow (1989)

    Google Scholar 

  4. Batenkina, O., Inozemtseva, K.: A method for recognizing the emotions of preschool children using facial expressions. Omsk Sci. J. 6, 146–150 (2017)

    Google Scholar 

  5. Ekman, P.: Telling Lies: Clues to Deceit in the Marketplace, Politics, and Marriage. Piter, Saint Petersburg (1999)

    Google Scholar 

  6. Ekman, P., Friesen, W.: Constants across cultures in the face and emotion. J. Pers. Soc. Psychol. 17, 124–129 (1971)

    Article  Google Scholar 

  7. Ekman, P., Friesen, W.: Nonverbal leakage and clues to deception. Psychiatry 32, 88–106 (1969)

    Article  Google Scholar 

  8. Ekman, P., Friesen, W.: Detecting deception from the body or face. J. Pers. Soc. Psychol. 29, 288–298 (1974)

    Article  Google Scholar 

  9. Zakharov, A.: Day and Night Fears in Children. UNION, Saint Petersburg (2000)

    Google Scholar 

  10. Zamorev, S.: Game Therapy. Not childish problems at all. Speech, Saint Petersburg (2002)

    Google Scholar 

  11. Kiseleva, M.: Art Therapy for Children: A Guide for Child Psychologists, Educators, Doctors, and Specialists Working with Children. Speech, Saint Petersburg (2006)

    Google Scholar 

  12. Kostina, L.: Game Therapy with Anxious Children. Speech, Saint Petersburg (2003)

    Google Scholar 

  13. Zaboleeva-Zotova, A., Orlova, Y., Bobkov, A.: Development of a system for automated determination of emotions and possible areas of application. Open Educ. 2, 59–62 (2011)

    Google Scholar 

  14. Kryazheva, I.: The Development of the Emotional World of Children. A popular guide for parents and educators. Development Academy, Yaroslavl (1996)

    Google Scholar 

  15. Andrunyk, V., Shestakevych, T., Kunanets, N., Pasichnyk, V.: Information technologies for teaching students with ASD. In: Journal of National University of Lviv Polytechnic. Information systems and networks, pp. 76–88 (2018)

    Google Scholar 

  16. Makarenko, A., Calaida, V.: Face image localization technique for video monitoring systems based on a neural network. News of Tomsk Poly. Univ. 309, 113–118 (2006)

    Google Scholar 

  17. González-Hernández, F., Zatarain-Cabada, R., Barrón-Estrada, M., Rodríguez-Rangel, H.: Recognition of learning-centered emotions using a convolutional neural network. J. Intell. Fuzzy Syst. 34, 3325–3336 (2018)

    Article  Google Scholar 

  18. Mamaichuk, I.: Psychocorrectional Technologies for Children with Developmental Problems: A Textbook for Universities, 2nd edn. Yurait Publishing House, Moscow (2019)

    Google Scholar 

  19. Šarmanová, J., Kostolányová, K.: Adaptive E-Learning: From Theory to Practice. Int. J. Inf. Commun. Technol. Educ. 4, 34–47 (2015)

    Google Scholar 

  20. Anwar, S., Milanova, M.: Real time face expression recognition of children with autism. Int. Acad. Eng. Med. Res. 1, 1–7 (2016)

    Google Scholar 

  21. erwin Business Process (earlier Casewise Corporate Modeler Suite) (2020). www.interface.ru, http://www.interface.ru/home.asp?artId=102. Accessed 21 Apr 2020

  22. Chen, Y., Hwang, R., Wang, C.: Development and evaluation of a Web 2.0 annotation system as a learning tool in an e-learning environment. Comput. Educ. 58, 1094–1105 (2012)

    Google Scholar 

  23. Torrado, J., Gomez, J., Montoro, G.: Emotional self-regulation of individuals with autism spectrum disorders: smartwatches for monitoring and interaction. Sensors 17, 1–29 (2017)

    Article  Google Scholar 

  24. Feidakis, M., Daradoumis, T., Caballe, S.: Emotion measurement in intelligent tutoring systems: what, when and how to measure. In: 2011 3rd International Conference on Intelligent Networking and Collaborative Systems (2011)

    Google Scholar 

  25. Davydov, M., Lozynska, O., Kunanets, N., Pasichnyk, V.: Assistive computer technologies for people with disabilities. Econtechmod 7, 39–44 (2018)

    Google Scholar 

  26. Leo, M., et al.: Computational assessment of facial expression production in ASD children. Sensors 18, 1–25 (2018)

    Article  Google Scholar 

  27. Csikszentmihalyi, M.: Flow and the Foundations of Positive Psychology. Springer, Dordrecht (2014)

    Book  Google Scholar 

  28. Southgate, E., Blackmore, K., Pieschl, S., Grimes, S., McGuire, J., Smithers, K.: Artificial Intelligence and Emerging Technologies (virtual, augmented and mixed reality) in Schools. University of Newcastle, Newcastle (2019)

    Google Scholar 

  29. Liliana, D.: Emotion recognition from facial expression using deep convolutional neural network. J. Phys. Conf. Ser. 1193, 012004 (2019)

    Article  Google Scholar 

  30. Kaulard, K., Cunningham, D., Bülthoff, H., Wallraven, C.: The MPI facial expression database — a validated database of emotional and conversational facial expressions. PLoS One 7, e32321 (2012)

    Article  Google Scholar 

  31. Grossard, C., et al.: Children with autism spectrum disorder produce more ambiguous and less socially meaningful facial expressions: an experimental study using random forest classifiers. Mol. Autism, 11, 1–14 (2020)

    Google Scholar 

  32. Artificial Intelligence in Special Education, Medium (2020). https://medium.com/@itsquiz15/artificial-intelligence-in-special-education-dab27649b9b6. Accessed 21 Apr 2020

  33. 3 Futuristic Technologies to Support Blended Learning: Artificial Intelligence, Virtual Reality, and Augmented Reality, ImagineLearning (2020). https://www.imaginelearning.com/blog/2018/10/3-futuristic-technologies-support-blended-learning-artificial-intelligence-virtual. Accessed 21 Apr 2020

  34. Margaret Mary, T., Hanumanthappa, M., Sangamithra, A.: Intelligent predicting learning disabilities in school going children using fuzzy logic k mean clustering in machine learning. Int. J. Recent Technol. Eng. 8, 1694–1698 (2019)

    Google Scholar 

  35. Davydenko, E.A.: Artificial Intelligence in Education of Children with Learning Disabilities, CS 527. Introduction to Artificial Intelligence. UNM, Albuquerque (2012)

    Google Scholar 

  36. America, Y., et al.: Using Artificial Intelligence to Help Students with Learning Disabilities Learn - The Tech Edvocate, The Tech Edvocate (2020). https://www.thetechedvocate.org/using-artificial-intelligence-help-students-learning-disabilities-learn/. Accessed 21 Apr 2020

  37. HuffPost is now a part of Verizon Media, Huffpost.com (2020). https://www.huffpost.com/entry/artificial-intelligence-poised-to-improve-lives-of_b_59662920e4b09be68c005698?guccounter=1. Accessed 21 Apr 2020

  38. Pedró, F., Subosa, M., Rivas, A., Valverde, P.: Artificial Intelligence in Education: Challenges and Opportunities for Sustainable Development. UNESCO, Paris (2019)

    Google Scholar 

  39. Mao, Q., Pan, X., Zhan, Y., Shen, X.: Using kinect for real-time emotion recognition via facial expressions. Front. Inf. Technol. Electron. Eng. 16, 272–282 (2015)

    Article  Google Scholar 

  40. Gupta, S., Jaafar, J., Ahmad, W.: Static hand gesture recognition using local gabor filter. Procedia Eng. 41, 827–832 (2012)

    Article  Google Scholar 

  41. The Affect Analysis Group at Pittsburgh, Pitt.edu (2010). http://www.pitt.edu/~emotion/ck-spread.htm. Accessed 09 Apr 2020

  42. The 7 basic emotions - Do you recognise all facial expressions? (2016). https://www.youtube.com/watch?v=embYkODkzcs. Accessed 09 Apr 2020

  43. Emotion Recognition Technology Executive, Alan Park, Joins Affectiva as Chief Revenue Officer - Affectiva, Affectiva (2016). https://www.affectiva.com/news-item/emotion-recognition-technology-executive-alan-park-joins-affectiva-as-chief-revenue-officer/. Accessed 09 Apr 2020

  44. Goodfellow, I., Bengio, Y., Courville, A.: Deep Learning. MIT Press, Massachusetts (2017)

    MATH  Google Scholar 

  45. González-Hernández, F., Zatarain-Cabada, R., Barrón-Estrada, M., Rodríguez-Rangel, H.: Recognition of learning-centered emotions using a convolutional neural network. J. Intell. Fuzzy Syst. 34, 3325–3336 (2018)

    Article  Google Scholar 

  46. Tutorial: Get Emotion Data from your next Mobile Playtest,” Blog.affectiva.com (2017). https://blog.affectiva.com/tutorial-get-emotion-data-from-your-next-mobile-playtest. Accessed 09 Apr 2020

Download references

Author information

Authors and Affiliations

  1. Lviv Polytechnic National University, Lviv, Ukraine

    Vasyl Andrunyk & Olesia Yaloveha

Authors
  1. Vasyl Andrunyk
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Olesia Yaloveha
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Vasyl Andrunyk .

Editor information

Editors and Affiliations

  1. Department of Artificial Intelligence, Lviv Polytechnic National University, Lviv, Ukraine

    Natalya Shakhovska

  2. Institute of Computer Science and Information Technologies, Lviv Polytechnic National University, Lviv, Ukraine

    Mykola O. Medykovskyy

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Andrunyk, V., Yaloveha, O. (2021). AI System in Monitoring of Emotional State of a Student with Autism. In: Shakhovska, N., Medykovskyy, M.O. (eds) Advances in Intelligent Systems and Computing V. CSIT 2020. Advances in Intelligent Systems and Computing, vol 1293. Springer, Cham. https://doi.org/10.1007/978-3-030-63270-0_7

Download citation

Publish with us

Policies and ethics

Search

Navigation