Skip to main content
SpringerLink
Log in

Enabling Learning Through Play: Inclusive Gaze-Controlled Human-Robot Interface for Joystick-Based Toys

  • Conference paper
  • First Online:
Social Robotics (ICSR 2022)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 13818))

Included in the following conference series:

  • 1013 Accesses

Abstract

A significant proportion of the world population is living with some form of disability. The most isolated section of disability spectrum are persons with severe speech and motor impairment (SSMI). They face challenges not only in everyday activities but in accessing education and proper employment in later stages of life. Persons with SSMI must rely on manual gaze-based interactions for everyday communication. This research aims to enable and support the learning and education of persons with SSMI through engaging eye-gaze-controlled playful activities. This work proposes and evaluates gaze-based interaction to drive a toy car using augmented and mixed reality interfaces. The results show improvements in otherwise dull, gaze-based generic pointing and selection tasks after performing an unrelated yet more engaging and playful car driving activity.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Alsharif, S., Kuzmicheva, O., Gräser, A.: Gaze Gesture-Based Human Robot Interface, ZweitetransdisziplinäreKonferenz,TechnischeUnterstützungssysteme, die Menschen wirklichwollen (2016)

    Google Scholar 

  2. Murthy, L.R.D., Mukhopadhyay, A., Biswas, P.: Distraction detection in automotive environment using appearance-based gaze estimation. In: ACM International Conference on Intelligent User Interfaces (IUI 2022) (2022)

    Google Scholar 

  3. Hsieh, H.C.: Effects of ordinary and adaptive toys on pre-school children with developmental disabilities. Res. Dev. Disabil. 29(5), 459–466 (2008)

    Article  Google Scholar 

  4. Prabuwono, A.S., Allehaibi, K.H.S., Kurnianingsih, K.: Assistive robotic technology: a review. Comput. Eng. Appl. J. 6(2), 71–78 (2017)

    Article  Google Scholar 

  5. Petrie, H., Carmien, S., & Lewis, A.: Assistive technology abandonment: research realities and potentials. In: International Conference on Computers Helping People With Special Needs, pp. 532–540. Springer, Cham (2018)

    Google Scholar 

  6. Murthy, L.R.D., Biswas, P.: Appearance-based Gaze Estimation using Attention and Difference Mechanism. In: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 3137–3146. IEEE (2021)

    Google Scholar 

  7. Ray, D.C., Lee, K.R., Meany-Walen, K.K., Carlson, S.E., Carnes-Holt, K.L., Ware, J.N.: Use of toys in child-centered play therapy. Int. J. Play Ther. 22(1), 43 (2013)

    Article  Google Scholar 

  8. Sposito, A.M.P., et al.: Puppets as a strategy for communication with Brazilian children with cancer. Nurs. Health Sci. 18(1), 30–37 (2016)

    Article  Google Scholar 

  9. Patrizia, M., Claudio, M., Leonardo, G., Alessandro, P.: A robotic toy for children with special needs: From requirements to design. In: 2009 IEEE International Conference on Rehabilitation Robotics, pp. 918–923. IEEE (2009)

    Google Scholar 

  10. Kim, E., Paul, R., Shic, F., Scassellati, B.: Bridging the research gap: Making HRI useful to individuals with autism (2012)

    Google Scholar 

  11. Uncular, D., Artut, S.: Design of a robotic toy and user interfaces for autism spectrum disorder risk assessment. Uludağ Üniversitesi Fen-Edebiyat Fakültesi Sosyal Bilimler Dergisi 20(36), 101–140 (2018)

    Google Scholar 

  12. Robins, B., et al.: Human-centred design methods: Developing scenarios for robot assisted play informed by user panels and field trials. Int. J. Hum Comput Stud. 68(12), 873–898 (2010)

    Article  Google Scholar 

  13. Gardeazabal, X., Abascal, J.: Use of robots for play by children with cerebral palsy. Multidiscip. Digit. Pub. Inst. Proc. 31(1), 75 (2019)

    Google Scholar 

  14. Swaminathan, M., Pal, J.: Ludic design for accessibility in the global south. In: M. Stein and J. Lazar. Assistive Technology and the Developing World. Oxford University Press (2020). https://www.microsoft.com/en-us/research/publication/ludic-design-for-accessibility

  15. Zhang, X., Sugano, Y., Fritz, M., Bulling, A.: It's written all over your face: Full-face appearance-based gaze estimation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 51–60 (2017)

    Google Scholar 

  16. Murthy, L.R.D., Mukhopadhyay, A., Anand, K., Aggarwal, S., Biswas, P.: PARKS-Gaze - a precision-focused gaze estimation dataset in the wild under extreme head poses. In: 27th International Conference on Intelligent User Interfaces (IUI 2022 Companion). Association for Computing Machinery, New York, NY, USA, pp. 81–84 (2022). https://doi.org/10.1145/3490100.3516467

  17. Baltrusaitis, T., Zadeh, A., Lim, Y. C., Morency, L. P.: Openface 2.0: Facial behavior analysis toolkit. In: 2018 13th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2018), pp. 59–66. IEEE (2018)

    Google Scholar 

Download references

Acknowledgement

We thank Mr. Sunil Nahar for Nahar Center of Robotics and Prototyping Lab and the Director and staff of Vidyasagar School, Chennai for their inputs and cooperation.

Author information

Authors and Affiliations

  1. Indian Institute of Science Bangalore, Bengaluru, India

    Vinay Krishna Sharma, L. R. D. Murthy & Pradipta Biswas

Authors
  1. Vinay Krishna Sharma
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. L. R. D. Murthy
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Pradipta Biswas
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Vinay Krishna Sharma .

Editor information

Editors and Affiliations

  1. University of Florence, Florence, Italy

    Filippo Cavallo

  2. Qatar University, Doha, Qatar

    John-John Cabibihan

  3. University of Florence, Florence, Italy

    Laura Fiorini

  4. University of Florence, Florence, Italy

    Alessandra Sorrentino

  5. Wichita State University, Wichita, KS, USA

    Hongsheng He

  6. Qingdao University, Qingdao, China

    Xiaorui Liu

  7. National Institute of Advanced Industrial Science and Technology, Tsukuba, Japan

    Yoshio Matsumoto

  8. National University of Singapore, Singapore, Singapore

    Shuzhi Sam Ge

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Sharma, V.K., Murthy, L.R.D., Biswas, P. (2022). Enabling Learning Through Play: Inclusive Gaze-Controlled Human-Robot Interface for Joystick-Based Toys. In: Cavallo, F., et al. Social Robotics. ICSR 2022. Lecture Notes in Computer Science(), vol 13818. Springer, Cham. https://doi.org/10.1007/978-3-031-24670-8_40

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-24670-8_40

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-24669-2

  • Online ISBN: 978-3-031-24670-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation