Skip to main content
SpringerLink
Log in

A New 3D Augmented Reality Application for Educational Games to Help Children in Communication Interactively

  • Conference paper
  • First Online:
Computational Science and Its Applications – ICCSA 2016 (ICCSA 2016)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 9787))

Included in the following conference series:

Abstract

In recent years, the use of technology to help children for augmented and alternative communication (AAC) is extremely a vital task. In this paper, a novel three-dimensional human-computer interaction application is presented based on augmented reality (AR) technology for assisting children with special problems in communication for social innovation. To begin with, three-dimensional human hand model is constructed to estimate and track the hand’s position of users. An extended particle filter is applied for calculating the pose of background and the positions of children. The likelihoods based on the edge map of the image and pixel color values are utilized to estimate the joint likelihood in three-dimensional model. A flexible real-time hand tracking framework using the ‘golden energy’ scoring function is integrated for capturing region of interests. An inertial tracking technique is used for calculating the quaternion. Three-dimensional models from Google SketchUp are employed. We then use a built QR-code for scanning to access the system, and then utilize for selecting a character three-dimensional designed cartoon by applying the Vidinoti image application. After that, representative three-dimensional cartoons and augmented environments are overlaid, so that it is able to entertain children. A printed coloring photo, called Augmented Flexible Tracking is designed and provided in the system for visualization. The process of the system is done in real-time. Our experiments have revealed that the system is beneficial both quantitatively and qualitatively for assisting children with special needs in communication interactively.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Tanner, P., Karas, C., Schofield, D.: Augmenting a child’s reality: using educational tablet technology. J. Inf. Technol. Educ. Innovations Pract. (JITE) 13, 45–54 (2014)

    Google Scholar 

  2. Bhatt, S.K., De Leon, N.I., Al-Jumaily, A.: Augmented reality game therapy for children with autism spectrum disorder. Int. J. Smart Sens. Intell. Syst. 7, 519–536 (2014). Massey University

    Google Scholar 

  3. Bai, Z., Blackwell, A.F., Coulouris, G.: Using augmented reality to elicit pretend play for children with autism issue. IEEE Trans. Vis. Comput. Graph. 21(05), 598–610 (2015)

    Article  Google Scholar 

  4. Magnenat, S., Ngo, D.T., Zund, F., Ryffel, M., Noris, G., Röthlin, G., Marra, A., Nitti, M., Fua, P., Gross, M., Sumner, B.: Live texturing of augmented reality characters from colored drawings. In: IEEE International Symposium on Mixed and Augmented Reality (ISMAR 2015), Fukuoka, Japan, 10 p., 29 September 2015

    Google Scholar 

  5. Giannakos, M.N., Divitini, M., Iversen, O.S., Koulouris, P.: Making as a pathway to foster joyful engagement and creativity in learning. In: Chorianopoulos, K., Divitini, M., Hauge, J.B., Jaccheri, L., Malaka, R. (eds.) ICEC 2015. LNCS, vol. 9353, pp. 566–570. Springer, Heidelberg (2015). doi:10.1007/978-3-319-24589-8_58

    Chapter  Google Scholar 

  6. Richard, E., Billaudeau, V., Richard, P., Gaudin, G.: Augmented reality for rehabilitation of cognitive disabled children: a preliminary study. IEEE Virtual Rehab. IEEE Eng. Med. Biol. Soc. pp. 102–108, Venice, Italy, 27–29 September 2007

    Google Scholar 

  7. Huanga, Y., Lia, H., Fonga, R.: Using augmented reality in early art education: a case study in Hong Kong kindergarten. Early Child Dev. Care 186(6), 879–894 (2016). doi:10.1080/03004430.2015.1067888

    Article  Google Scholar 

  8. Zünd, F., Ryffel, M., Magnenat, S., Marra, A., Nitti, M., Kapadia, M., Noris, G., Mitchell, K., Gross, M., Sumner, R.W.: Augmented creativity: bridging the real and virtual worlds to enhance creative play. In: Proceeding of ACM SIGGRAPH Asia 2015, Mobile Graphics and Interactive Applications, Article No. 21, Kobe, Japan, 2–6 November 2015

    Google Scholar 

  9. Cunha, P., Brando, J., Vasconcelos, J., Soares, F., Carvalho, V.: Augmented reality for cognitive and social skills improvement in children with ASD. In: 13th International Conference on Remote Engineering and Virtual Instrumentation (REV), pp. 334–335. IEEE Publisher, Madrid, Spain, 24–26 February 2016

    Google Scholar 

  10. Kerdvibulvech, C.: Human hand motion recognition using an extended particle filter. In: Perales, F.J., Santos-Victor, J. (eds.) AMDO 2014. LNCS, vol. 8563, pp. 71–80. Springer, Heidelberg (2014)

    Google Scholar 

  11. Grover, C.: Google SketchUp: The Missing Manual, 1 edn., 602 p. O’Reilly Media, Sebastopol, 1 June 2009

    Google Scholar 

  12. Perdikakis, A., Araya, A., Kiritsis, D.: Introducing augmented reality in next generation industrial learning tools: a case study on electric and hybrid vehicles. In: Procedia Engineering, The Manufacturing Engineering Society International Conference (MESIC), vol. 132, pp. 251–258. Elsevier Publishing, ScienceDirect (2015)

    Google Scholar 

  13. Kerdvibulvech, C.: Hand tracking by extending distance transform and hand model in real-time. Pattern Recogn. Image Anal. 25(3), 437–441 (2015). Springer Publisher

    Article  Google Scholar 

  14. Sharp, T., Keskin, C., Robertson, D., Taylor, J., Shotton, J., Kim, D., Rhemann, C., Leichter, I., Vinnikov, A., Wei, Y., Freedman, D., Kohli, P., Krupka, E., Fitzgibbon, A., Izadi, S.: Accurate, robust, and flexible real-time hand tracking. In: ACM Conference on Human Factors in Computing Systems (CHI), Seoul, Republic of Korea, 18–23 April 2015

    Google Scholar 

  15. Papoutsakisa, K.E., Argyros, A.A.: Integrating tracking with fine object segmentation. Image Vis. Comput. 31(10), 771–785 (2013)

    Article  Google Scholar 

  16. Baldi, T.L., Mohammadi, M., Scheggi, S., Prattichizzo, D.: Using inertial and magnetic sensors for hand tracking and rendering in wearable haptics. In: 2015 IEEE World Haptics Conference (WHC), Evanston, IL, pp. 381–387, 22–26 June 2015

    Google Scholar 

  17. Im, J., Jung, J., Paik, J.: Single camera-based depth estimation and improved continuously adaptive mean shift algorithm for tracking occluded objects. In: Ho, Y.S., Sang, J., Ro, Y.M., Kim, J., Wu, F. (eds.) PCM 2015. LNCS, vol. 9315, pp. 246–252. Springer International Publishing, New York (2015)

    Chapter  Google Scholar 

  18. Li, W., Lin, Y.: Adaptive randomized ensemble tracking using appearance variation and occlusion estimation. Math. Prob. Eng. 2016, 1–11 (2016). Article ID 1879489

    Google Scholar 

Download references

Acknowledgments

This research presented herein was partially supported by a research grant from the Research Center, NIDA (National Institute of Development Administration).

Author information

Authors and Affiliations

  1. Graduate School of Communication Arts and Management Innovation, National Institute of Development Administration, 118 SeriThai Road, Klong-Chan, Bangkapi, Bangkok, 10240, Thailand

    Chutisant Kerdvibulvech

  2. Graduate Institute of Information Management, National Taipei University, 151, Daxue Road, Sanxia District, New Taipei City, 23741, Taiwan

    Chih-Chien Wang

Authors
  1. Chutisant Kerdvibulvech
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chih-Chien Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chutisant Kerdvibulvech .

Editor information

Editors and Affiliations

  1. University of Perugia , Perugia, Italy

    Osvaldo Gervasi

  2. University of Basilicata , Potenza, Italy

    Beniamino Murgante

  3. Covenant University , Ota, Nigeria

    Sanjay Misra

  4. University of Minho , Braga, Portugal

    Ana Maria A.C. Rocha

  5. Polytechnic University , Bari, Italy

    Carmelo M. Torre

  6. Monash University , Clayton, Victoria, Australia

    David Taniar

  7. Kyushu Sangyo University , Fukuoka, Japan

    Bernady O. Apduhan

  8. Saint Petersburg State University , Saint Petersburg, Russia

    Elena Stankova

  9. Beijing University of Posts & Telecommunication , Beijing, China

    Shangguang Wang

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Kerdvibulvech, C., Wang, CC. (2016). A New 3D Augmented Reality Application for Educational Games to Help Children in Communication Interactively. In: Gervasi, O., et al. Computational Science and Its Applications – ICCSA 2016. ICCSA 2016. Lecture Notes in Computer Science(), vol 9787. Springer, Cham. https://doi.org/10.1007/978-3-319-42108-7_35

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-42108-7_35

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-42107-0

  • Online ISBN: 978-3-319-42108-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation