An Interactive Multimedia System for Treating Autism Spectrum Disorder

  • Massimo Magrini
  • Ovidio Salvetti
  • Andrea Carboni
  • Olivia Curzio
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9914)


A system for real-time gesture tracking is presented, used in active well-being self-assessment activities and in particular applied to medical coaching and music-therapy. The system is composed of a gestural interface and a computer running own (custom) developed software. During the test sessions a person freely moves his body inside a specifically designed room. The algorithms detect and extrapolate features from the human figure, such us spatial position, arms and legs angles, etc. An operator can link these features to sounds synthesized in real time, following a predefined schema. The augmented interaction with the environment helps to improve the contact with reality in subjects having autism spectrum disorders (ASD). The system has been tested on a set of young subjects and a team of psychologists has analyzed the results of this experimentation. Moreover, we started to work on graphical feedback in order to realize a multichannel system.


Autism Spectrum Disorder Sensory Profile Observation Grid Short Sensory Profile Home Version 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Magrini, M., Carboni, A., Salvetti, O., Curzio, O.: An auditory feedback based system for treating autism spectrum disorder. In: REHAB 2015 Proceedings of the 3rd 2015 Workshop on ICTs for Improving Patients Rehabilitation Research Techniques, pp. 30–33. ACM, New York (2015)Google Scholar
  2. 2.
    Ould Mohamed, A., Courbulay, V.: Attention analysis in interactive software for children with autism. In: Proceedings of the 8th International ACM SIGACCESS Conference on Computers and Accessibility, Portland, Oregon, USA (2006)Google Scholar
  3. 3.
    Kozima, H., Nakagawa, C., Yasuda, Y.: Interactive robots for communication-care: a case-study in autism therapy. In: International IEEE Workshop on Robot and Human Interactive Communication (2005)Google Scholar
  4. 4.
    Villafuerte, L., Markova, M., Jorda, S.: Acquisition of social abilities through musical tangible user interface: children with autism spectrum condition and the reactable. In: Proceedings of CHI EA 2012–CHI 2012 Extended Abstracts on Human Factors in Computing Systems, pp. 745–760. ACM, New York (2012)Google Scholar
  5. 5.
    Riva, D., Bulgheroni, S., Zappella, M.: Neurobiology, Diagnosis & Treatment in Autism: An Update, John Libbey Eurotex (2013)Google Scholar
  6. 6.
    Pajareya, K., Nopmaneejumruslers, K.: A pilot randomized controlled trial of DIR/Floortime™ parent training intervention for pre-school children with autistic spectrum disorders. Autism 15(5), 563–577 (2011)CrossRefGoogle Scholar
  7. 7.
    Solomon, R., et al.: Pilot study of a parent training program for young children with autism The PLAY Project Home Consultation program. Autism 11(3), 205–224 (2007)Google Scholar
  8. 8.
    Wing, L., Gould, J.: Severe impairments of social interaction and associated abnormalities in children: epidemiology and classification. J. Autism Dev. Disord. 9, 11–29 (1979)CrossRefGoogle Scholar
  9. 9.
    Vismara, L.A., Rogers, S.J.: behavioral treatments in autism spectrum disorder: what do we know? Annu. Rev. Clin. Psychol. 6, 447–468 (2010)CrossRefGoogle Scholar
  10. 10.
    Kanner, L.: Autistic disturbances of affective contact. Nervous Child 2, 217–250 (1943)Google Scholar
  11. 11.
    Greenspan, S., Wieder, S.: The Child with Special Needs. Perseus. Pub., New York (1998)Google Scholar
  12. 12.
    Magrini, M., et al.: Progetto “SI RE MI” Sistema di Rieducazione Espressiva del Movimento e dell’Interazione. Autismo e disturbi dello sviluppo, Erickson (2015)Google Scholar
  13. 13.
    De Gangi, G., Berck, R.: DeGangi-Berck: Test of Sensory Integration. Western Psychological Services. Los Angeles (1983)Google Scholar
  14. 14.
    Dunn, W.: Sensory Profile-School Companion Manual. Psychological Corporation, San Antonio (2006)Google Scholar
  15. 15.
    Politi, P., Emanuele E. e Grassi, M.: The Invisible Orchestra Project. Development of the “Playing-in-Touch” (PiT) questionnaire. Neuroendocrinol. Lett. 33(5), 552–558 (2012)Google Scholar
  16. 16.
    Meini, C., Guiot, G., Maria Teresa Sindelar, M.T.: Autismo e musica. Il modello Floortime nei disturbi della comunicazione e della relazione, EricksonGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Massimo Magrini
    • 1
    • 2
  • Ovidio Salvetti
    • 1
    • 2
  • Andrea Carboni
    • 1
    • 2
  • Olivia Curzio
    • 1
    • 2
  1. 1.ISTI-CNRPisaItaly
  2. 2.IFC-CNRPisaItaly

Personalised recommendations