World of Knowledge: An Application for Learning Assistance in the Reading Process for Children in the Literacy Period

  • Pedro H. M. ArthurEmail author
  • Allain Hortis
  • Henrique O. Cury
  • Vinicius F. Gomes
  • Marcelo de Paiva Guimarães
  • Valéria Farinazzo Martins
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 847)


To learn to read the child must understand a process that involves sensory, emotional, intellectual, physiological, neurological as well as cultural, economic, and political aspects. Reading is the correspondence between the sounds and the graphic signals, through the deciphering of the code and the understanding of the concept or idea. Reading difficulties can occur in a variety of ways during the learning process, and acquisition of this is an extremely important factor in favoring future knowledge. The purpose of this paper is to present an application based on two different approaches - conventional (mouse/keyboard) and non-conventional (gesture) interaction (using Kinect device) that allows to assist children in the reading process. The application is a game focused on three storybooks for kids. Details about the development approach (requirements analysis, project, implementation and tests) used are presented. We also present a usability test for conventional and nonconventional devices with 15 children in the literacy period.


Kinect Teaching-Learning process Usability Gestural interfaces Serious game 


  1. 1.
    Coelho, M.T.: Problemas de aprendizagem. Editora Ática S.A, São Paulo (2009)Google Scholar
  2. 2.
    DePriest, D., Barilovits, K.: LIVE: Xbox Kinect©s virtual realities to learning games. In: 16th ANNUAL TCC Worldwide Online Conference, Hawaii, pp. 48–52 (2011)Google Scholar
  3. 3.
    Homer, B.D., et al.: Moved to learn: the effects of interactivity in a Kinect-based literacy game for beginning readers. Comput. Educ. 74, 37–49 (2014). Scholar
  4. 4.
    Mol, S.E., Bus, A.G.: Bus.: to read or not to read: a meta-analysis of print exposure from infancy to early adulthood. Psychol. Bull. 137, 267–296 (2011). Scholar
  5. 5.
    Wigdor, D., Wixon, D.: Brave NUI World: Designing Natural User Interfaces for Touch and Gesture, 1st edn. Morgan Kaufmann Publishers Inc., San Francisco (2011)Google Scholar
  6. 6.
    Kurakin, A., Zhang, Z., Liu, Z.: A real time system for dynamic hand gesture recognition with a depth sensor. In: 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO), Bucharest, pp. 1975–1979 (2012).
  7. 7.
    Baoliang, W., Zeyu, C., Jing, C.: Gesture recognition by using Kinect skeleton tracking system. In: 2013 5th International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC), vol. 1, pp. 418–422 (2013).
  8. 8.
    Boutsika, E.: Kinect in education: a proposal for children with autism. Procedia Comput. Sci., 123–129 (2014).
  9. 9.
    Martins, V.F., Sampaio, Paulo N.M., Niedermeyer, A., de Paiva Guimarães, M.: Usability evaluation of a gestural interface application for children. In: Marcus, A. (ed.) DUXU 2016. LNCS, vol. 9747, pp. 587–596. Springer, Cham (2016). Scholar
  10. 10.
    Alves, R.S., Araújo, J.O.A., Madeiro, F.: AlfabetoKinect: Um aplicativo para auxiliar na alfabetização de crianças com o uso do Kinect. In: Anais do Simpósio Brasileiro de Informática na Educação, vol. 23, No. 1 (2012).
  11. 11.
  12. 12.
  13. 13.
    Cabral, L.S.: Processos psicolinguísticos de leitura e a criança. Letras de hoje 21(1), 7–20 (1986). Accessed 4 Aug 2018
  14. 14.
    Larman, C., Basili, V.R.: Iterative and incremental developments. A brief history. Computer 36(6), 47–56 (2003). Scholar
  15. 15.
    Microsoft .NET Framework 4. Accessed 4 Aug 2018
  16. 16.
    Kinect for Windows SDK v1.8. Accessed 6 June 2018
  17. 17.
    Kinect for Windows Sensor Components and Specifications. Accessed 6 June 2018
  18. 18.
    Renton, D.: Kinect Magic Cursor and Xremote. Accessed 6 June 2018
  19. 19.
    Unity 3D. Accessed 4 June 2018
  20. 20.
    Surface Pro. Accessed 4 June 2018
  21. 21.
    Cortana. Accessed 4 June 2018
  22. 22.
    Likert, R.: A technique for the measurement of attitudes. Arch. Psychol. 140, 1–55 (1932)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.California Trinity UniversityLos AngelesUSA
  2. 2.Mestrado Profissional em Computação Aplicada e Programa de Pós-Graduação em Distúrbios do DesenvolvimentoMackenzie Presbyterian UniversitySão PauloBrazil
  3. 3.Federal University of São Paulo-(Unifesp/UAB), Mestrado do Centro Universitário Campo Limpo PaulistaSão PauloBrazil
  4. 4.Mackenzie Presbyterian UniversitySão PauloBrazil

Personalised recommendations