Skip to main content

App4Autism: An Integrated Assistive Technology with Heart Rate Monitoring for Children with Autism

  • Conference paper
Advances in Visual Informatics (IVIC 2019)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 11870))

Included in the following conference series:


Autism Spectrum Disorder (ASD) is a neurological development disorder that affects communication and behavior. Most assistive technologies for children with autistic traits have been designed to support single, targeted activity function such as learning and communication. In this paper, we report the design and development of an assistive mobile application with heart rate monitoring to help children with ASD in their daily life activities. The integrated mobile application, App4Autism was developed using a holistic design approach with the aim of enhancing communication, interaction and learning skills while providing emotion regulation support through music listening and heart rate monitoring. A novel focus of App4Autism is on noise sensitivity; to play music upon automatic detection of loud excessive noise (in decibel) while at the same time, monitoring the user’s heart rate using a pulse sensor. The paper focuses on a study to better understand the potential use and incorporation of music listening and heart rate/anxiety level monitoring in the app. The paper provides results of investigation into which music genre is more suitable to keep users calm. Initial experiment involved a general population sample; with results showing that personal music preference might have calming effects on users in environments with excessive background noise. We further expand on the design guidelines for creating an integrated assistive technology.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others


  1. Ossmann, R., et al.: AsTeRICS, a flexible assistive technology construction set. Procedia Comput. Sci. 14, 1–9 (2012)

    Article  Google Scholar 

  2. Liffick, B.W.: Introducing assistive technology in an HCI course. In: 9th Annual SIGCSE Conference on Innovation and Technology in Computer Science Education, pp. 232–232. ACM New York (2004)

    Google Scholar 

  3. Chandra, P., Jones, J.: Assistive technology and autonomy in a cyborg world. In: 7th International Conference on Information and Communication Technologies and Development. ACM, New York (2015)

    Google Scholar 

  4. Frauenberger, C.: Disability and technology – a critical realist perspective. In: 17th International ACM SIGACCESS Conference on Computers & Accessibility, pp. 89–96. ACM, New York (2015)

    Google Scholar 

  5. Sensory integration and therapy in sensory room. Accessed 26 Sept 2018

  6. Geretsegger, M., Holck, U., Gold, C.: Randomised controlled trial of improvisational music theraphy’s effectiveness for children with autism spectrum disorders (TIME-A): study protocol. BMC Pediatr. 12(1), 536 (2012)

    Article  Google Scholar 

  7. Kamaruzaman, M.F., Rani, N.M., Md Nor, H., Azahari, M.H.H.: Developing user interface design application for children with autism. Procedia – Soc. Behav. Sci. 217, 887–894 (2016)

    Google Scholar 

  8. Hillier, A., Greher, G., Queenan, A., Marshall, S., Kopec, J.: Music, technology and adolescents with autism spectrum disorders: the effectiveness of the touch screen interface. Music Educ. Res. 18(3), 269–282 (2016)

    Article  Google Scholar 

  9. This Emotionally Intelligent Device is Helping Kids with Autism Form Bonds. Accessed 11 Dec 2018

  10. Kushki, A., et al.: Investigating the autonomic nervous system response to anxiety in children with autism spectrum disorders. PLoS ONE 8(4), e59730 (2013)

    Article  Google Scholar 

  11. Leijdekkers, P., Gay, V., Wong, F.: CaptureMyEmotion: a mobile app to improve emotion learning for autistic children using sensors. In: Proceedings of the 26th IEEE International Symposium on Computer-Based Medical Systems, pp. 381–384. IEEE, Porto, Portugal (2013)

    Google Scholar 

  12. New Tool Measures Anxiety in Children with Autism Spectrum Disorder Could Lead to New Treatments. Accessed 11 Dec 2018

  13. Mobile Apps to help individuals on the Autism spectrum 2018 Edition. Accessed 11 Dec 2018

  14. Brown, C.J., Chen, A.C.N., Dworkin, S.F.: Music in the control of human pain. Music Ther. 8(1), 47–60 (1989)

    Article  Google Scholar 

  15. Miluk-Kolasa, B., Matejek, M., Stupnicki, R.: The effects of music listening on changes in selected physiological parameters in adult pre-surgical patients. J. Music Ther. 33(3), 208–218 (1996)

    Article  Google Scholar 

  16. Stiegler, L.N., Davis, R.: Understanding sound sensitivity in individuals with autism spectrum disorders. Focus Autism Other Dev. Disabil. 25(2), 67–75 (2010)

    Article  Google Scholar 

  17. Wigram, T., Gold, C.: Music therapy in the assessment and treatment of autistic spectrum disorder: clinical application and research evidence. Child: Care Health Dev. 32(5), 535–542 (2006)

    Article  Google Scholar 

  18. Bernardi, L., Porta, C., Sleight, P.: Cardiovascular, cerebrovascular, and respiratory changes induced by different types of music in musicians and non-musicians: the importance of silence. Heart 92(4), 445–452 (2006)

    Article  Google Scholar 

  19. Moss, V.A.: The effect of music on anxiety in the surgical patient. Perioper. Nurs. Q. 3(1), 9–16 (1987)

    Google Scholar 

  20. Grandgeorge, M., Masataka, N.: Atypical color preference in children with autism spectrum disorder. Front. Psychol. 7, 1976 (2016)

    Article  Google Scholar 

  21. Hanser, S.B.: Controversy in music listening/stress reduction research. Arts Psychother. 15(3), 211–217 (1988)

    Article  Google Scholar 

  22. Fontaine, C.W., Schwalm, N.D.: Effects of familiarity of music on vigilant performance. Percept. Mot. Skills 49(1), 71–74 (1979)

    Article  Google Scholar 

  23. Rickard, N.S.: Intense emotional responses to music: a test of the physiological arousal hypothesis. Psychol. Music 32(4), 371–388 (2004)

    Article  Google Scholar 

  24. Cochrabe, T., Fantini, B., Scherer, K.R.: The Emotional Power of Music: Multidisciplinary Perspectives on Musical Arousal, Expression, and Social Control. Oxford University Press, Oxford (2013)

    Book  Google Scholar 

Download references


We would like to thank Miss Rani from the SCSOA for allowing us to conduct ethnographic studies and interviews at the childcare centre to help understand the needs of children with autism and by providing valuable suggestions and insights.

Author information

Authors and Affiliations


Corresponding author

Correspondence to Kher Hui Ng .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Cite this paper

Yap, C.Y., Ng, K.H., Cheah, Y., Lim, S.Y., Price, J., De Vries, M. (2019). App4Autism: An Integrated Assistive Technology with Heart Rate Monitoring for Children with Autism. In: Badioze Zaman, H., et al. Advances in Visual Informatics. IVIC 2019. Lecture Notes in Computer Science(), vol 11870. Springer, Cham.

Download citation

  • DOI:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-34031-5

  • Online ISBN: 978-3-030-34032-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics