Skip to main content
SpringerLink
Log in

Relationships Between Semiotic Representational Transformations and Performance Outcomes in Digital Math Games

  • Original research
  • Published:
Technology, Knowledge and Learning Aims and scope Submit manuscript

Abstract

The purpose of this study was to examine relationships between students’ semiotic representational transformations and students’ mathematics performance outcomes in digital math games. The study employed a convergent parallel mixed methods design. Students in Grades 4, 5, and 6 (ages 9–12) played nine digital math games. Researchers administered pretests and posttests and gathered video data. Researchers coded the video data to identify the representations used and students’ representational transformations to understand how these related to mathematics performance outcomes. The video data revealed that the most frequent type of semiotic representation used by students was images, followed by symbols. The most common type of representational transformation students made was a conversion (i.e., transforming across two different representational registers), which is more complex than a treatment (i.e., transforming within the same representational register). A difference in proportions test revealed significant differences in test scores when students made representational transformations using language, images, symbols, and gestures. The results showed that some of the digital math games prompted more representational transformations than others; However, all of the games prompted the conversion type of representational transformation. Students who progressed between the pretest and posttest were much more likely to make representational transformations. Students who did not recognize and use representations or make transformations were much more likely to regress between the pretest and posttest. These results show the importance of the recognition and use of semiotic representations and representational transformations to mathematics outcomes when students play digital math games.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  • Albano, G., Arzarello, F., & Dello Iacono, U. (2020). Digital inquiry through games. Technology, Knowledge and Learning. https://doi.org/10.1007/s10758-020-09459-1.

    Article  Google Scholar 

  • Bernabeu, M., Gagatsis, A., Moreno, M., & Llinares, S. (2019). Nine-years-old students’ understanding of 2d-shapes. In M. Graven, H. Venkat, A. Essien & P. Vale (Eds.) Volume 4 oral communications and posters from the 43rd annual meeting of the international group for the psychology of mathematics education (p. 37). Pretoria, South Africa.

  • Bieda, K. N., & Nathan, M. J. (2009). Representational disfluency in algebra: Evidence from student gestures and speech. ZDM Mathematics Education, 41, 637–650. https://doi.org/10.1007/s11858-009-0198-0.

    Article  Google Scholar 

  • Brenner, M., Mayer, R. E., Mosely, B., Brar, T., Duran, R., Reed, B. S., et al. (1997). Learning by understanding: The role of multiple representations in learning algebra. American Educational Research Journal, 34, 663–690.

    Article  Google Scholar 

  • Bullock, E., Shumway, J. F., Watts, C., & Moyer-Packenham, P. S. (2017). Affordance access matters: Preschool children’s learning progressions while interacting with touch-screen mathematics apps. Technology, Knowledge and Learning, 22(3), 1–27. https://doi.org/10.1007/s10758-017-9312-5.

    Article  Google Scholar 

  • Bullock, E. K., Roxburgh, A. L., Moyer-Packenham, P. S., Bektas, E., Webster, J., & Bullock, K. (2020). Connecting the dots: Understanding the interrelated impacts of type, quality and awareness of design features in digital math games and related learning outcomes. Journal of Computer Assisted Learning. https://doi.org/10.1111/jcal.12508.

  • Calder, N., Larkin, K., & Sinclair, N. (2018). Mobile Technologies: How might using mobile technologies reshape the learning and teaching of mathematics? In N. Calder, K. Larking, & N. Sinclair (Eds.), Using mobile technologies in the teaching and learning of mathematics 1 7. Cham: Springer.

    Chapter  Google Scholar 

  • Carbonneau, K. J., Marley, S. C., & Selig, J. P. (2013). A metaanalysis of the efficacy of teaching mathematics with concrete manipulatives. Journal of Educational Psychology, 105, 380–400.

    Article  Google Scholar 

  • Castellar, E. N., All, A., de Marez, L., & Van Looy, J. (2015). Cognitive abilities, digital games and arithmetic performance enhancement: A sudy comparing the effects of a math game and paper exercises. Computers & Education, 85, 123–133.

    Article  Google Scholar 

  • Corbin, J., & Strauss, A. (2014). Basics of qualitative research: Techniques and procedures for developing grounded theory. Sage.

  • Creswell, J. W., & Plano Clark, V. L. (2011). Designing and conducting mixed methods research (2nd ed.). Sage Publications.

  • De Bock, D., Neyens, D., & Van Dooren, W. (2017). Students’ ability to connect function properties to different types of elementary functions: An empirical study on the role of external representations. International Journal of Science and Mathematics Education, 15(5), 939–955.

    Article  Google Scholar 

  • Denham, A. R. (2015). Supporting conceptual understanding of the associative and distributive properties through digital gameplay. Journal of Computer Assisted Learning, 31(6), 706–721.

    Article  Google Scholar 

  • Dörfler, W. (2002). Formation of mathematical objects as decision making. Mathematical Thinking and Learning, 4(4), 337–350.

    Article  Google Scholar 

  • Duval, R. (2006). A Cognitive analysis of problems of comprehension in a learning of mathematics. Educational Studies in Mathematics, 61, 103–131.

    Article  Google Scholar 

  • Duval, R. (2017). Understanding the mathematical way of thinking: The registers of semiotic representations. Springer.

  • Fisher, M. J., Marshall, A. P., & Mitchell, M. (2011). Testing differences in proportions. Australian Critical Care, 24(2), 133–138.

    Article  Google Scholar 

  • Fyfe, E. R., McNeil, N. M., Son, J. Y., & Goldstone, R. L. (2014). Concreteness fading in mathematics and science instruction: A systematic review. Educational Psychology Review, 26, 9–25.

    Article  Google Scholar 

  • Goldin, G. A. (2003). Representation in school mathematics: A unifying research perspective. In J. Kilpatrick, W. G. Martin, & D. Schifter (Eds.), A research companion to principles and standards for school mathematics (pp. 275–285). NCTM.

  • Goldin G. A. (2014). Mathematical representations. In S. Lerman (Ed.), Encyclopedia of mathematics education. Dordrecht: Springer https://doi.org/10.1007/978-94-007-4978-8_103.

  • Gunpinar, Y., & Pape, S. (2018). Teachers’ instructional practices within connected classroom technology environments to support representational fluency. Journal of Computers in Mathematics and Science Teaching, 37(1), 27–52.

    Google Scholar 

  • Karakoc, B., Eryilmaz, K., Ozpolat, E. T., & Yildirim, I. (2020). The effect of game-based learning on student achievement: a meta-analysis study. Technology, Knowledge and Learning. https://doi.org/10.1007/s10758-020-09471-5.

    Article  Google Scholar 

  • Ke, F., & Clark, K. M. (2020). Game-based multimodal representations and mathematical problem solving. International Journal of Science and Mathematics Education, 18, 103–122. https://doi.org/10.1007/s10763-018-9938-3.

    Article  Google Scholar 

  • Laato, S., Lindberg, R., Laine, R. H., Vui, P., Brezovszky, B., Koivunen, L., Troyer, O. D., & Lehtinen, E. (2020). Evaluation of the pedagogical quality of mobile math games in app marketplaces [Paper presentation; Online format]. In International Conference on Engineering, Technology and Innovation (ICE/ITMC), Cardiff, UK. https://doi.org/10.1109/ICE/ITMC49519.2020.9198621.

  • Lesh, R., Post, T. R., & Behr, M. (1987). Representations and translations among representations in mathematics learning and problem solving. In C. Janiver (Ed.), Problems of representations in the teaching and learning of mathematics (pp. 33–40). Lawrence Erlbaum.

  • Litster, K., & Moyer-Packenham, P. S. (2020). How the balance of gaming and mathematics elements effects student learning in digital math games. Journal of Computers in Mathematics and Science Teaching, 39(1), 33–48.

    Google Scholar 

  • Ma, L. (1999). Knowing and teaching elementary mathematics: Teachers’ understanding of fundamental mathematics in China and the United States. Erlbaum.

  • McGee, D., & Moore-Russo, D. (2015). Using a Technology-supported approach to preservice teachers’ multi-representational fluency: Unifying mathematical concepts and their representations. Contemporary Issues in Technology and Teacher Education, 15(4), 489–513.

    Google Scholar 

  • McLeod, J., Vasinda, S., & Dondlinger, M. J. (2012). Conceptual visibility and virtual dynamics in technology-scaffolded learning environments for conceptual knowledge of mathematics. Journal of Computers in Mathematics and Science Teaching, 31(3), 283–310.

    Google Scholar 

  • Morano, S., & Riccomini, P. J. (2019). Is a picture worth 1000 words? investigating fraction magnitude knowledge through analysis of student representations. Assessment for Effective Intervention, 46(1), 27–38.

    Article  Google Scholar 

  • Moyer-Packenham, P. S., Ashby, M. J., Litster, K., Roxburgh, A. L., & Kozlowski, J. S. (2020). Examining how design features promote children’s awareness of affordances in digital math games. Journal of Computers in Mathematics and Science Teaching, 39(2), 169–180.

    Google Scholar 

  • Moyer-Packenham, P. S., & Bolyard, J. J. (2016). Revisiting the definition of a virtual manipulative. In P. S. Moyer-Packenham (Ed.), International perspectives on teaching and learning mathematics with virtual manipulatives (pp. 3–23). Springer.

  • Moyer-Packenham, P. S., Litster, K., Roxburgh, A. L., Kozlowski, J. S., & Ashby, M. J. (2019a). Relationships between mathematical language, representation connections, and learning outcomes in digital math games. In K. Graziano (Ed.), Proceedings of the society for information technology and teacher education (SITE) international conference (pp. 2201–2209). Las Vegas, NV, US: Association for the Advancement of Computing in Education (AACE).

  • Moyer-Packenham, P. S., Lommatsch, C. W., Litster, K., Ashby, J., Bullock, E. K., Roxburgh, A. L., et al. (2019b). How design features in digital math games support learning and mathematics connections. Computers in Human Behavior, 91, 316–332.

    Article  Google Scholar 

  • Nemirovsky, R., Kelton, M. L., & Rhodehamel, B. (2013). Playing mathematical instruments: Emerging perceptuomotor integration with an interactive mathematics exhibit. Journal for Research in Mathematics Education, 44(2), 372–415.

    Article  Google Scholar 

  • Ozyildirim, F., Ipek, S., & Akkus, O. (2009). Seventh grade student’s translational skills among mathematical representations. International Journal of Learning, 16(3), 197–206.

    Google Scholar 

  • Park, J., Bouck, E. C., & Fisher, M. H. (2020). Using the virtual-representational-abstract with overlearning instructional sequence to students with disabilities in mathematics. The Journal of Special Education. https://doi.org/10.1177/0022466920912527.

    Article  Google Scholar 

  • Ping, R., & Goldin-Meadow, S. (2010). Gesturing saves cognitive resources when talking about nonpresent objects. Cognitive Science, 34, 602–619.

    Article  Google Scholar 

  • Pino-Fan, L., Guzmán, I., Font, V., & Duval, R. (2017). Analysis of the underlying cognitive activity in the resolution of a task on derivability of the absolute-value function: Two theoretical perspectives. PNA, 11(2), 97–124.

    Article  Google Scholar 

  • Powell, A. B., Francisco, J. M., & Maher, C. A. (2003). An analytical model for studying the development of learners’ mathematical ideas and reasoning using videotape data. The Journal of Mathematical Behavior, 22(4), 405–435.

    Article  Google Scholar 

  • Pyke, C. L. (2003). The use of symbols, words, and diagrams as indicators of mathematical cognition: A causal model. Journal for Research in Mathematics Education, 34(5), 406–432.

    Article  Google Scholar 

  • Rau, M. A., Aleven, V., & Rummel, N. (2017). Supporting students in making sense of connections and in becoming perceptually fluent in making connections among multiple graphical representations. Journal of Educational Psychology, 109(3), 355–373.

    Article  Google Scholar 

  • Saldaña, J. (2016). The coding manual for qualitative researchers. Sage.

  • Santos-Trigo, M. (2004). The role of dynamic software in the identification and construction of mathematical relationships. Journal of Computers in Mathematics and Science Teaching, 23(4), 399–413.

    Google Scholar 

  • Schubert, C. (2009). Video analysis of practice and the practice of video analysis. In H. Knoblauch, B. Schnettler, J. Raab, & H. G. Soeffner (Eds.), Video analysis methodology and methods: Qualitative audiovisual data analysis and sociology (pp. 115–126). Peter Lang.

  • Sedig, K. (2008). From play to thoughtful learning: a design strategy to engage children with mathematical representations. The Journal of Computers in Mathematics and Science Teaching, 27(1), 65–101.

    Google Scholar 

  • Shute, V., Rahimi, S., Smith, G., Ke, F., Almond, R., Dai, C. P., Kuba, R., Liu, Z., Yang, X., & Sun, C. (2020). Maximizing learning without sacrificing the fun: Stealth assessment, adaptivity and learning supports in educational games. Journal of Computer Assisted Learning, 37(1), 1–15. https://doi.org/10.1111/jcal.12473.

    Article  Google Scholar 

  • Siew, P. H. (2018). Pedagogical change in mathematics learning: Harnessing the power of digital game-based learning. Educational Technology & Society, 21(4), 259–276.

    Google Scholar 

  • Sriutai, M., Boonlue, S., Neanchaleay, J., & Murphy, E. (2018). Using pictorial maps to scaffold problem solving in primary-grade arithmetic. International Journal of Innovation in Science and Mathematics Education, 26(5), 49–65.

    Google Scholar 

  • Tall, D., & Vinner, S. (1981). Concept image and concept definition in mathematics with particular reference to limits and continuity. Educational Studies in Mathematics, 12(2), 151–169.

    Article  Google Scholar 

  • Teddlie, C., & Tasshakori, A. (2006). A general typology of research designs featuring mixed methods. Research in the Schools, 13(1), 12–28.

    Google Scholar 

  • Trujillo, K., Chamberlin, B., Wiburg, K., & Armstrong, A. (2016). Measurement in learning games evolution: Review of methodologies used in determining effectiveness of math snacks games and animations. Technology, Knowledge and Learning, 21, 155–174.

    Article  Google Scholar 

  • Tucker, S. I., Moyer-Packenham, P. S., Westenskow, A., & Jordan, K. E. (2016). The complexity of the affordance-ability relationship when second-grade children interact with mathematics virtual manipulative apps. Technology, Knowledge and Learning, 21, 341–360.

    Article  Google Scholar 

  • Tunç-Pekkan, Z. (2015). An analysis of elementary school children’s fractional knowledge depicted with circle, rectangle, and number line representations. Educational Studies in Mathematics, 89(3), 419–441.

    Article  Google Scholar 

  • Verzosa, D. M. B., De Las Peiias, M. L. A. N., Aberin, M. A. Q., & Garces, L. P. D. M. (2018). App for addition and subtraction of integers. International Journal for Technology in Mathematics Education, 25(4), 21–33. https://doi.org/10.1564/tme_v25.4.02.

    Article  Google Scholar 

  • Vygotsky, L. S. (1978). Mind in society: The development of higher psychological processes. Harvard University Press.

  • Wilkie, K. J. (2016). Students’ use of variables and multiple representations in generalizing functional relationships prior to secondary school. Educational Studies in Mathematics, 93, 333–361.

    Article  Google Scholar 

  • Zhang, L., Shang, J., Pelton, T., & Pelton, L. F. (2020). Supporting primary students’ learning of fraction conceptual knowledge through digital games. Journal of Computer Assisted Learning, 36(4), 540–548. https://doi.org/10.1111/jcal.12422.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Utah State University, Logan, USA

    Patricia S. Moyer-Packenham, Allison L. Roxburgh & Joseph S. Kozlowski

  2. Valdosta State University, Valdosta, USA

    Kristy Litster

Authors
  1. Patricia S. Moyer-Packenham
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Allison L. Roxburgh
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kristy Litster
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Joseph S. Kozlowski
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Patricia S. Moyer-Packenham.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Moyer-Packenham, P.S., Roxburgh, A.L., Litster, K. et al. Relationships Between Semiotic Representational Transformations and Performance Outcomes in Digital Math Games. Tech Know Learn 27, 223–253 (2022). https://doi.org/10.1007/s10758-021-09506-5

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10758-021-09506-5

Keywords

Search

Navigation