An efficient movement and mental classification for children with autism based on motion and EEG features

  • Xin DangEmail author
  • Ran Wei
  • Guohui Li
Original Research


The early intervention services for the children with autism are labor costly. To settle this problem, some activities classification based rehabilitation training system is developed. However, the mental characteristics of the children with autism are less considered. In this paper, a novel activities classification framework is proposed for the rehabilitation training of the children with autism. The movement and mental based features are obtained using the motion and electroencephalography vectors from Kinect and MindWave. Two support vector machines are integrated to perform a frame-based classification procedure. The proposed methods are tested in a dataset includes 110 recordings from five children (two with autism). The proposed algorithm achieved an accuracy of 96.2, 93.3, 94.06 and 97.40% for the good positive, NG positive, good negative, and NG negative movements, respectively.


Autism spectrum disorder (ASD) Motion-based game Movement detection EEG 



This work is supported by the National Natural Science Foundation of China (61403276), Tianjin Research Program of Application Foundation and Advanced Technology (14JCYBJC42400, 13JCYBJC37800), Tianjin Key Laboratory of Cognitive Computing and Application.


  1. Acqualagna L, Bosse S, Porbadnigk AK et al (2015) EEG-based classification of video quality perception using steady state visual evoked potentials (SSVEPs). J Neural Eng 12(2):026012CrossRefGoogle Scholar
  2. Akrami A, Solhjoo S, Motie-Nasrabadi A et al. (2005) EEG-Based Mental Task Classification: Linear and Nonlinear Classification of Movement Imagery.[C]//International Conference of the Engineering in Medicine and Biology Society. Conf Proc IEEE Eng Med Biol Soc pp 4626–9Google Scholar
  3. Baio J (2014) Prevalence of autism spectrum disorder among children aged 8 years-autism and developmental disabilities monitoring network, 11 sites, United States, 2010. Morb Mortal Wkly Rep Surveill Summar 63(2):1260Google Scholar
  4. Bartoli L, Corradi C, Garzotto F et al. (2013) Exploring motion-based touchless games for autistic children’s learning[C]//International Conference on Interaction Design and Children pp 102–111Google Scholar
  5. Bartoli L, Garzotto F, Gelsomini M et al. (2014) Designing and evaluating touchless playful interaction for ASD children[C]//Proceedings of the 2014 conference on Interaction design and children. ACM pp 17–26Google Scholar
  6. De Greef K, Van der Spek E, Bekker, T (2013) Designing Kinect games to train motor skills for mixed ability players. Games Health pp 197–205Google Scholar
  7. Buescher AVS, Cidav Z, Knapp M et al (2014) Costs of autism spectrum disorders in the United Kingdom and the United States. JAMA Pediatr 168(8):721–728CrossRefGoogle Scholar
  8. Casiez G, Roussel N, Vogel D (2012) 1€ filter: a simple speed-based low-pass filter for noisy input in interactive systems[C]//Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM pp 2527–2530Google Scholar
  9. Chang YJ, Han WY, Tsai YC (2013) A Kinect-based upper limb rehabilitation system to assist people with cerebral palsy. Res Dev Disabil 34(11):3654–3659CrossRefGoogle Scholar
  10. Chen W (2012) Multitouch tabletop technology for people with autism spectrum disorder: A review of the literature. Proced Comput Sci 14(19):198–207CrossRefGoogle Scholar
  11. Chia NKH, Li J (2012) Design of a generic questionnaire for reflective evaluation of a virtual reality-based intervention using virtual dolphins for children with autism. Int J Spec Educ 27(3):45–53Google Scholar
  12. Dong SY, Kim BK, Lee SY (2015) EEG-Based Classification of Implicit Intention During Self-Relevant Sentence Reading. Cybernetics IEEE Trans 21:1–8Google Scholar
  13. Farr W, Yuill N, Raffle H (2010) Social benefits of a tangible user interface for children with autistic spectrum conditions. Autism Int J Res Pract 14(3):237–252CrossRefGoogle Scholar
  14. Gerwin S, Mcfarland DJ, Thilo H et al (2004) BCI2000: a general-purpose brain-computer interface (BCI) system. IEEE Trans Bio-med Eng 51(6):1034–1043CrossRefGoogle Scholar
  15. Hourcade JP, Williams SR, Miller EA et al. (2013) Evaluation of tablet apps to encourage social interaction in children with autism spectrum disorders[C]//Sigchi Conference on Human Factors in Computing Systems pp 3197–3206Google Scholar
  16. Kientz J, Goodwin M, Hayes G et al. (2013) Interactive Technologies for Autism: A Review[C]//Extended Abstracts Conference on Human Factors in Computing Systems. Morgan and Claypool pp 1–177Google Scholar
  17. Lang W et al (1996) Electric and magnetic fields of the brain accompanying internal simulation of movement. Cogn Brain Res 3:125–129CrossRefGoogle Scholar
  18. Lotte F, Congedo M, Lecuyer A et al (2007) A review of classification algorithms for EEG-based brain–computer interfaces. J Neural Eng 4(2):R1–R13CrossRefGoogle Scholar
  19. Maurice CE, Green GE, Luce SC (1996) Behavioral intervention for young children with autism: A manual for parents and professionals. Pro-ed, AustinGoogle Scholar
  20. Nguyen DD, Le HS (2015) Kinect Gesture Recognition: SVM vs. RVM. In: 2015 Seventh International Conference on Knowledge and Systems Engineering (KSE), IEEE, pp 395–400Google Scholar
  21. Par N, Masri P, Wolferen GV et al (2005) Achieving dialogue with children with severe autism in an adaptive multisensory interaction: the “MEDIAte” project. IEEE Trans Vis Comput Gr 11(6):734–743CrossRefGoogle Scholar
  22. Parry I, Carbullido C, Kawada J et al (2014) Keeping up with video game technology: objective analysis of Xbox Kinect and PlayStation 3 Move for use in burn rehabilitation. Burns J Int Soc Burn Inj 40(5):852–859CrossRefGoogle Scholar
  23. Putze F, Hesslinger S, Tse CY et al (2014) Hybrid fNIRS-EEG based classification of auditory and visual perception processes. Front Neurosci 8:373CrossRefGoogle Scholar
  24. Ren Z, Yuan J, Meng J et al (2013) Robust part-based hand gesture recognition using kinect sensor. IEEE Trans Multimedia 15(5):1110–1120CrossRefGoogle Scholar
  25. Sun X, Allison C, Matthews FE et al (2013) Prevalence of autism in mainland China, Hong Kong and Taiwan: a systematic review and meta-analysis. Mol Autism 4(1):1–13CrossRefGoogle Scholar
  26. Tartaro A, Cassell J (2008) Playing with virtual peers: bootstrapping contingent discourse in children with autism[C]//International Conference on International Conference for the Learning Sciences. International Society of the Learning Sciences pp 382–389Google Scholar
  27. Valer J, Daisuke T, Ippeita D (2007) 10/20, 10/10, and 10/5 systems revisited: their validity as relative head-surface-based positioning systems. Neuroimage 34(4):1600–1611CrossRefGoogle Scholar
  28. Wolpaw JR, Birbaumer N, Heetderks WJ et al (2000) Brain-computer interface technology: a review of the first international meeting. IEEE Trans Rehabil Eng 8(2):164–173CrossRefGoogle Scholar
  29. Yasunari H, Junichi U (2013) EEG-based classification of imaginary left and right foot movements using beta rebound. Clin Neurophysiol 124(11):2153–2160CrossRefGoogle Scholar
  30. Yu YH, Lai PC, Ko LW et al. (2010) An EEG-based classification system of Passenger’s motion sickness level by using feature extraction/selection technologies[C]//Neural Networks (IJCNN), In: The 2010 International Joint Conference on IEEE pp 1–6Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2016

Authors and Affiliations

  1. 1.School of Computer Science and Software EngineeringTianjin Polytechnic UniversityTianjinChina
  2. 2.School of Electronics and InformationTianjin Polytechnic UniversityTianjinChina
  3. 3.TEDA Orking Hi-Tech Company LimitedTianjinChina

Personalised recommendations