Skip to main content
SpringerLink
Log in

Computer Vision Aided Machine Learning Framework for Detection and Analysis of Arm Flapping Stereotypic Behavior Exhibited by the Autistic Child

  • Conference paper
  • First Online:
Computational Intelligence in Data Science (ICCIDS 2023)

Part of the book series: IFIP Advances in Information and Communication Technology ((IFIPAICT,volume 673))

Included in the following conference series:

  • 145 Accesses

Abstract

Stereotypic movements such as arm flapping, spinning, and body rocking are found to be unique characteristics in the majority of autistic children. Detection and analysis of the above said stereotypic movements at an early stage could potentially help in treating autistic children before they develop severe and socially unacceptable behaviors. Taking advantage of computer vision and media pipe machine learning framework, a threshold-based data peak filtering algorithm for detection of one of the stereotypic behavior, i.e., arm flapping is proposed in this study. Flapping behavior of autistic children, such as Arm flapping intensity and its frequency, is extracted to assess the severity of autism. This crucial information helps the therapist to analyse and estimate the variations in a child’s stereotypic behavioral pattern for Autism Spectrum Disorder (ASD) therapy.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 119.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Lord, C., Elsabbagh, M., Baird, G., Veenstra-Vanderweele, J.: Autism spectrum disorder. Lancet 392(10146), 508–520 (2018)

    Article  Google Scholar 

  2. Boyd, B.A., McDonough, S.G., Bodfish, J.W.: Evidence-based behavioral interventions for repetitive behaviors in autism. J. Autism Dev. Disord. 42(6), 1236–1248 (2018)

    Article  Google Scholar 

  3. Draaisma, D.: Stereotypes of autism. Philos. Trans. R. Soc. B: Biol. Sci. 364(1522), 1475–1480 (2009)

    Article  Google Scholar 

  4. Lam, K.S., Aman, M.G.: The Repetitive Behavior Scale-Revised: independent validation in individuals with autism spectrum disorders. J. Autism Dev. Disord. 37(5), 855–866 (2007)

    Article  Google Scholar 

  5. McLaughlin, A., Fleury, V.P.: Flapping, spinning, rocking, and other repetitive behaviors: intervening with young children who engage in stereotypy. Young Except. Child. 23(2), 63–75 (2020)

    Article  Google Scholar 

  6. Noris, B.: Machine vision-based analysis of gaze and visual context: an application to visual behavior of children with autism spectrum disorders. Doctoral dissertation Verlag nicht ermittelbar (2011)

    Google Scholar 

  7. Westeyn, T., Vadas, K., Bian, X., Starner, T., Abowd, G.D.: Recognizing mimicked autistic self-stimulatory behaviors using HMMs. In: Ninth IEEE International Symposium on Wearable Computers, ISWC 2005, pp. 164–167 (2005)

    Google Scholar 

  8. Min, C.H., Tewfik, A.H.: Automatic characterization and detection of behavioral patterns using linear predictive coding of accelerometer sensor data. In: Annual International Conference of the IEEE Engineering in Medicine and Biology, pp. 220–223 (2010)

    Google Scholar 

  9. Goodwin, M.S., Intille, S.S., Albinali, F., Velicer, W.F.: Automated detection of stereotypical motor movements. J. Autism Dev. Disord. 41(6), 770–782 (2011)

    Article  Google Scholar 

  10. Gonçalves, N., Rodrigues, J.L., Costa, S., Soares, F.: Automatic detection of stereotyped hand flapping movements: two different approaches. In: The 21st IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), pp. 392–397 (2012)

    Google Scholar 

  11. Rihawi, O., Merad, D., Damoiseaux, J.L.: 3D-AD: 3D-autism dataset for repetitive behaviours with kinect sensor. In: 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 1–6 (2017)

    Google Scholar 

  12. Müller, M.: Dynamic time warping. In: Information Retrieval for Music and Motion, pp. 69–84. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-74048-3_4

  13. Jazouli, M., Majda, A., Merad, D., Aalouane, R., Zarghili, A.: Automatic detection of stereotyped movements in autistic children using the Kinect sensor. Int. J. Biomed. Eng. Technol. 29(3), 201–220 (2019)

    Article  Google Scholar 

  14. Zhang, Z.: Microsoft kinect sensor and its effect. IEEE Multimed. 19(2), 4–10 (2012)

    Article  Google Scholar 

  15. Matson, J.L., Wilkins, J., Macken, J.: The relationship of challenging behaviors to severity and symptoms of autism spectrum disorders. J. Ment. Health Res. Intellect. Disabil. 2(1), 29–44 (2008)

    Article  Google Scholar 

  16. Vismara, L., Bogin, J., Sullivan, L.: Differential reinforcement of other behaviors: steps for implementation, Sacramento, CA (2009)

    Google Scholar 

  17. Oakley, C., Mahone, E.M., Morris-Berry, C., Kline, T., Singer, H.S.: Primary complex motor stereotypies in older children and adolescents: clinical features and longitudinal follow-up. Pediatr. Neurol. 52(4), 398–403 (2015)

    Article  Google Scholar 

  18. Willemsen-Swinkels, S.H., Buitelaar, J.K., Dekker, M., van Engeland, H.: Subtyping stereotypic behavior in children: the association between stereotypic behavior, mood, and heart rate. J. Autism Dev. Disord. 28(6), 547–557 (1998)

    Article  Google Scholar 

  19. Guess, D., Carr, E.: Emergence and maintenance of stereotypy and self-injury. Am. J. Ment. Retard. 96, 299–319 (1991)

    Google Scholar 

  20. Sher, A., et al.: Automatic gait analysis during steady and unsteady walking using a smartphone. IEEE J. Biomed. Health Inform. (2021). https://doi.org/10.36227/techrxiv.16586780.v1

  21. Adam, A., Ibrahim, Z., Mokhtar, N., Shapiai, M.I., Cumming, P., Mubin, M.: Evaluation of different time domain peak models using extreme learning machine-based peak detection for EEG signal. Springerplus 5, 1–4 (2016)

    Article  Google Scholar 

  22. Sarraf, J., Vaibhaw, P.K.: Analysis of motor imagery EEG signal classification based on amplitude-based peak detection method and pisarenko harmonic decomposition. J. Theoret. Appl. Inf. Technol. 100(15), 4791–4800 (2022)

    Google Scholar 

  23. Zhang, C., Lin, H.B., Li, Y., Yang, B.J.: Seismic random noise attenuation by time-frequency peak filtering based on joint time-frequency distribution. C. R. Geosci. 345(9–10), 383–391 (2013)

    Article  Google Scholar 

  24. Rajagopalan, S., Dhall, A., Goecke, R.: Self-stimulatory behaviours in the wild for autism diagnosis. In: Proceedings of the IEEE International Conference on Computer Vision Workshops, pp. 755–761 (2013)

    Google Scholar 

  25. Pandian, D., Rajagopalan, S.S., Jayagopi, D.: Detecting a child’s stimming behaviours for autism spectrum disorder diagnosis using RGBPose-SlowFast network. In: IEEE International Conference on Image Processing (ICIP), pp. 3356–3360 (2022)

    Google Scholar 

  26. Lakkapragada, A., et al.: The classification of abnormal hand movement to aid in autism detection: machine learning study. JMIR Biomed. Eng. 7(1), e33771 (2022)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Diagnostics, Therapeutics and Assistive Devices Laboratory, Department of Electronics and Communication Engineering, Faculty of Engineering and Technology, SRM Institute of Science and Technology, Kattankulathur, 603203, Tamilnadu, India

    Umamaheswara Reddy Dundi, V. Phani Kumar Kanaparthi & Ramakrishna Bandaru

  2. SRM College of Occupational Therapy, SRM Institute of Science and Technology, Kattankulathur, 603203, Tamilnadu, India

    Ganapathy Sankar Umaiorubagam

Authors
  1. Umamaheswara Reddy Dundi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. V. Phani Kumar Kanaparthi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ramakrishna Bandaru
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ganapathy Sankar Umaiorubagam
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to V. Phani Kumar Kanaparthi .

Editor information

Editors and Affiliations

  1. Sri Sivasubramaniya Nadar College of Engineering, Chennai, India

    Sarath Chandran K R

  2. Sri Sivasubramaniya Nadar College of Engineering, Chennai, India

    Sujaudeen N

  3. Sri Sivasubramaniya Nadar College of Engineering, Chennai, India

    Beulah A

  4. Sri Sivasubramaniya Nadar College of Engineering, Chennai, India

    Shahul Hamead H

Rights and permissions

Reprints and permissions

Copyright information

© 2023 IFIP International Federation for Information Processing

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Dundi, U.R., Kanaparthi, V.P.K., Bandaru, R., Umaiorubagam, G.S. (2023). Computer Vision Aided Machine Learning Framework for Detection and Analysis of Arm Flapping Stereotypic Behavior Exhibited by the Autistic Child. In: Chandran K R, S., N, S., A, B., Hamead H, S. (eds) Computational Intelligence in Data Science. ICCIDS 2023. IFIP Advances in Information and Communication Technology, vol 673. Springer, Cham. https://doi.org/10.1007/978-3-031-38296-3_16

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-38296-3_16

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-38295-6

  • Online ISBN: 978-3-031-38296-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Societies and partnerships

Search

Navigation