Skip to main content
SpringerLink
Log in

Multimodal Analysis of Preschool Children’s Embodied Interaction with a Tangible Programming Environment

  • Conference paper
  • First Online:
Human-Computer Interaction. Multimodal and Natural Interaction (HCII 2020)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12182))

Included in the following conference series:

Abstract

Direct physical interaction with the world is a key constituting factor of cognitive development during childhood. Computational technologies, such as Tangible User Interfaces (TUI), offer opportunities for physically mediated interaction in learning environments, exploiting more embodied forms of interaction through hands-on physical manipulation and exploration. Many studies have introduced young children to programming by tangibles programming environments, although they do not address the effects of embodied interaction in the learning experience. In this paper, we present a case study conducted to introduce preschool children into programming through TaPrEC+mBot, an environment that allows programming of a robot car by arranging wooden programming blocks. Drawing on the multimodal method of analysis, we investigate the embodied interaction of the children with the TaPrEC+mBot to examine if and how the embodied forms of interaction shape the learning experience. The analysis shows the role of body position, gaze, manipulation, and speech, in terms of how these aspects support the construction of strategies to tangible programs; also the implications of this interaction in the meaning-making process.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://www.makeblock.com/steam-kits/mbot.

  2. 2.

    https://www.mblock.cc/en-us/.

  3. 3.

    SD: Standard Deviation

References

  1. Barron, B., Pea, R., Engle, R.: Advancing understanding of collaborative learning with data derived from video records. In: The International Handbook of Collaborative Learning, pp. 203–219 (2013)

    Google Scholar 

  2. Bruner, J.S.: On Knowing: Essays for the Left Hand. Harvard University Press (1979)

    Google Scholar 

  3. Carbajal, M., Baranauskas, M.C.: Programação, robôs e aprendizagem criativa por meio de cenários: um estudo exploratório. In: Brazilian Symposium on Computers in Education (Simpósio Brasileiro de Informática na Educação-SBIE), vol. 29, p. 1113 (2018)

    Google Scholar 

  4. Carbajal, M.L., Baranauskas, M.C.C.: Using ethnographic data to support preschool children’s game design. In: Proceedings of the 18th Brazilian Symposium on Human Factors in Computing Systems, p. 55. ACM (2019)

    Google Scholar 

  5. Carbajal, M.L., Baranauskas, M.C.: Exploring and evaluating “TaPrEC+ mBot” environment with preschool children. In: Anais do Workshop de Informática na Escola, vol. 25, no. 1, p. 521 (2019)

    Google Scholar 

  6. Chawla, K., Chiou, M., Sandes, A., Blikstein, P.: Dr. Wagon: a ’stretchable’ toolkit for tangible computer programming. In: Proceedings of the 12th International Conference on Interaction Design and Children, pp. 561–564. ACM (2013)

    Google Scholar 

  7. Dourish, P.: Where the Action is: The Foundations of Embodied Interaction. MIT Press (2004)

    Google Scholar 

  8. Gibson, J.J.: The Theory of Affordances, vol. 1, no. 2, Hilldale (1977)

    Google Scholar 

  9. Hornecker, E., Buur, J.: Getting a grip on tangible interaction: a framework on physical space and social interaction. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 437–446 (2006)

    Google Scholar 

  10. Ionescu, T., Vasc, D.: Embodied cognition: challenges for psychology and education. Procedia Soc. Behav. Sci. 128, 275–280 (2014)

    Article  Google Scholar 

  11. Koschmann, T., Stahl, G., Zemel, A.: The video analyst’s manifesto (or the implications of Garfinkel’s policies for studying instructional practice in design-based research). In: Video Research in the Learning Sciences, pp. 133–143 (2007)

    Google Scholar 

  12. Lakoff, G., Johnson, M.: Metaphors we Live By. University of Chicago Press (1980)

    Google Scholar 

  13. MacPhail, A., Kinchin, G.: The use of drawings as an evaluative tool: students’ experiences of sport education. Phys. Educ. Sport Pedagogy 9(1), 87–108 (2004)

    Article  Google Scholar 

  14. O’Malley, C., Fraser, D.S.: Literature review in learning with tangible technologies (2004)

    Google Scholar 

  15. Papert, S.: Mindstorms: Children, Computers and Powerful Ideas. Basic Books, New York (1980)

    Google Scholar 

  16. Pea, R.D.: Seeing what we build together: distributed multimedia learning environments for transformative communications. J. Learn. Sci. 3(3), 285–299 (1994)

    Article  Google Scholar 

  17. Piaget, J., Cook, M.: The Origins of Intelligence in Children, vol. 8, no. 5. International Universities Press. New York (1952)

    Google Scholar 

  18. Piaget, J., Inhelder, B.: The Psychology of the Child. Basic books (2008)

    Google Scholar 

  19. Price, S., Jewitt, C.: A multimodal approach to examining ‘embodiment’ in tangible learning environments. In: Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction, pp. 43–50 (2013)

    Google Scholar 

  20. Resnick, M.: Technologies for lifelong kindergarten. Education Tech. Research Dev. 46(4), 43–55 (1998)

    Article  Google Scholar 

  21. Streeck, J., Goodwin, C., LeBaron, C. (eds.): Embodied Interaction: Language and Body in the Material World. Cambridge University Press (2011)

    Google Scholar 

  22. Sullivan, A., Elkin, M., Bers, M.U.: KIBO robot demo: engaging young children in programming and engineering. In: Proceedings of the 14th International Conference on Interaction Design and Children, pp. 418–421. ACM (2015)

    Google Scholar 

  23. Wilson, A.D., Golonka, S.: Embodied cognition is not what you think it is. Front. Psychol. 4, 1–13 (2013). https://doi.org/10.3389/fpsyg.2013.00058. (Article 58)

    Article  Google Scholar 

  24. Xu, D., Read, J.C., Sim, G., McManus, B.: Experience it, draw it, rate it: capture children’s experiences with their drawings. In: Proceedings of the 8th International Conference on Interaction Design and Children, pp. 266–270 (2009)

    Google Scholar 

Download references

Acknowledgments

This study was financed in part by Coordenação de Aperfeiçoamento de Pessoal de Nível Superior - Brasil (CAPES)- Finance Code 001 - scholarships #1545149/2015 and #1654045/2016, by the National Council for Scientific and Technological Development - Brazil (CNPq) through grants #140536/2019-1 and #306272/2017-2, and by the São Paulo Research Foundation (FAPESP) through grant #2015/16528-0. We would like to thank the Division of Child and Supplementary Education (DEdIC - Divisão de Educação Infantil e Complementar), the Children Living Center (CECI - Centro de Convivência Infantil) and Institute of Computing at University of Campinas.

Author information

Authors and Affiliations

  1. Institute of Computing, University of Campinas (UNICAMP), São Paulo, Brazil

    Marleny Luque Carbajal & M. Cecília C. Baranauskas

Authors
  1. Marleny Luque Carbajal
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. M. Cecília C. Baranauskas
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Marleny Luque Carbajal or M. Cecília C. Baranauskas .

Editor information

Editors and Affiliations

  1. The Open University of Japan, Chiba, Japan

    Masaaki Kurosu

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Luque Carbajal, M., Baranauskas, M.C.C. (2020). Multimodal Analysis of Preschool Children’s Embodied Interaction with a Tangible Programming Environment. In: Kurosu, M. (eds) Human-Computer Interaction. Multimodal and Natural Interaction. HCII 2020. Lecture Notes in Computer Science(), vol 12182. Springer, Cham. https://doi.org/10.1007/978-3-030-49062-1_30

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-49062-1_30

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-49061-4

  • Online ISBN: 978-3-030-49062-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation