Skip to main content
Book cover

International Conference on Social Robotics

ICSR 2010: Social Robotics pp 265–274Cite as

Adaptive Robot Design with Hand and Face Tracking for Use in Autism Therapy

  • Conference paper

Part of the Lecture Notes in Computer Science book series (LNAI,volume 6414)

Abstract

This research explores interactive games using hand and face tracking with a robot as a tool for autism therapy. The robot is equipped with a head and two arms, each with two degrees of freedom, and a camera. We trained a classifier to detect human hands and subsequently, used this classifier along with a standard face tracker to create two interactive games. In the first game the robot waits for the child to initiate an interaction by raising one or both hands. In the second game, the robot initiates interactions. These games are designed to increase attention, promote turn-taking skills and encourage child-led verbal and non-verbal communication through simple imitative play. This research makes two specific contributions: (1) We present a low-cost robot design which measures and adapts to a child’s actions during interactive games and, (2) we train and test a hand detector, based on Haar-like features, which is usable in various kinds of human-robot interactions.

Keywords

  • Human-robot interaction
  • hand detection
  • hand tracking
  • adaptive robotics

This is a preview of subscription content, access via your institution.

Chapter
GBP   19.95
Price includes VAT (United Kingdom)
  • DOI: 10.1007/978-3-642-17248-9_28
  • Chapter length: 10 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
GBP   55.99
Price includes VAT (United Kingdom)
  • ISBN: 978-3-642-17248-9
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Barczak, A.L.C., Dadgostar, F.: Real-time hand tracking using a set of co-operative classifiers based on haar-like features. Res. Lett. Inf. Math. Sci. 7, 29–42 (2005)

    Google Scholar 

  2. Bradski, G.: The OpenCV Library. Dr. Dobb’s Journal of Software Tools, 120–126 (November 2000)

    Google Scholar 

  3. Bradski, G.R.: Computer vision face tracking for use in a perceptual user interface. Intel Technology Journal (1998)

    Google Scholar 

  4. Dautenhahn, K.: Robots as social actors: Aurora and the case of autism. In: Proc. Cognitive Technology Conference, pp. 359–374 (1999)

    Google Scholar 

  5. Dautenhahn, K., Werry, I.: Issues of robot-human interaction dynamics in the rehabilitation of children with autism. In: Proc. International Conference on the Simulation of Adaptive Behavior, pp. 519–528 (2000)

    Google Scholar 

  6. Duquette, A., Mercier, H., Michaud, F.: Investigating the use of a mobile robotic toy as an imitation agent for children with autism. In: International Conference on Epigenetic Robotics (2006)

    Google Scholar 

  7. Ferrari, E., Robins, B., Dautenhahn, K.: Therapeutic and educational objectives in robot assisted play for children with autism. In: Proc. IEEE International Symposium on Robot and Human Interactive Communication (2009)

    Google Scholar 

  8. Kozima, H., Nakagawa, C., Yasuda, Y.: Children-robot interaction: a pilot study in autism therapy. Progress in Brain Research 164, 385–400 (2007)

    CrossRef  Google Scholar 

  9. Lienhart, R., Maydt, J.: An extended set of Haar-like features for rapid object detection. In: Proc. IEEE International Conference on Image Processing, pp. 900–903 (2002)

    Google Scholar 

  10. Marti, P., Pollini, A., Rullo, A., Shibata, T.: Engaging with artificial pets. In: Proc. Conference on European Association of Cognitive Ergonomics, pp. 99–106 (2005)

    Google Scholar 

  11. Buehler, P., Everingham, M., Huttenlocher, D., Zisserman, A.: Long term arm and hand tracking for continuous sign language tv broadcasts. In: British Machine Vision Conference (2008)

    Google Scholar 

  12. Patrizia, M., Claudio, M., Leonardo, G., Alessandro, P.: A robotic toy for children with special needs: from requirements to design. In: Proc. IEEE International Conference on Rehabilitation Robotics, pp. 918–923 (2009)

    Google Scholar 

  13. Pierno, A.C., Maria, M., Lusher, D., Castiello, U.: Robotic movement elicits visuomotor priming in children with autism. Neuropsychologia 46, 448–454 (2008)

    CrossRef  Google Scholar 

  14. Robins, B., Dautenhahn, K., Boekhorst, R., Billard, A.: Robots as assistive technology - does appearance matter? In: Proc. IEEE International Workshop on Robot and Human Interactive Communication, pp. 277–282 (2004)

    Google Scholar 

  15. Robins, B., Dautenhahn, K., Dickerson, P.: From isolation to communication: a case study evaluation of robot assisted play for children with autism with a minimally expressive humanoid robot. In: Proc. International Conference on Advances in Computer-Human Interactions (2009)

    Google Scholar 

  16. Schapire, R.E.: The boosting approach to machine learning: An overview. In: Denison, D.D., Hansen, M.H., Holmes, C., Mallick, B., Yu, B. (eds.) Nonlinear Estimation and Classification. Springer, Heidelberg (2003)

    Google Scholar 

  17. Tapus, A., Tapus, C., Matarić, M.J.: User-robot personality matching and assistive robot behavior adaptation for post-stroke rehabilitation therapy. Intelligent Service Robotics Journal, 169–183 (April 2008)

    Google Scholar 

  18. Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition., vol. 1, pp. 511–518 (2001)

    Google Scholar 

  19. Viola, P., Jones, M.: Robust real-time face detection. International Journal of Computer Vision 57(2), 137–154 (2004)

    CrossRef  Google Scholar 

Download references

Author information

Affiliations

  1. Department of Computer Science and Engineering, University of South Carolina, Columbia, South Carolina, 29208, USA

    Laura Boccanfuso & Jason M. O’Kane

Authors
  1. Laura Boccanfuso
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jason M. O’Kane
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and Permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Boccanfuso, L., O’Kane, J.M. (2010). Adaptive Robot Design with Hand and Face Tracking for Use in Autism Therapy. In: Ge, S.S., Li, H., Cabibihan, JJ., Tan, Y.K. (eds) Social Robotics. ICSR 2010. Lecture Notes in Computer Science(), vol 6414. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-17248-9_28

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-17248-9_28

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-17247-2

  • Online ISBN: 978-3-642-17248-9

  • eBook Packages: Computer ScienceComputer Science (R0)