Skip to main content
Log in

Examining fifth graders’ conceptual understanding of numbers and operations using an online three-tier test

  • Original Article
  • Published:
Mathematics Education Research Journal Aims and scope Submit manuscript

Abstract

This study examines the conceptual understanding of numbers and operations among 372 fifth-grade students, based on their responses to an online three-tier test designed to assess their number sense, declarative knowledge, explanatory knowledge, and confidence. The results showed that most students had low performance and low number sense, with only approximately 18% demonstrating profound conceptual understanding of numbers and operations based on their high performance in five number sense components and high confidence in their solutions. In addition, the majority of students struggled with judging the reasonableness of computational results and solving context-based problems. Furthermore, approximately 78% of participants had misconceptions, with many expressing high confidence in their answers and reasoning. The findings of this study can serve as critical references when designing teaching content and materials for elementary students by carefully considering their performance, number sense, misconceptions, and confidence. The report concludes with a discussion of the implications of the results and suggestions for future research to address critical concerns in mathematics teaching and learning.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

Data availability

The datasets generated during and/or analysed during the current study are available from the corresponding author on reasonable request.

Notes

  1. The study’s notion of profound understanding is anchored on Ma’s (2010) definition: “By profound understanding, I mean an understanding of the fundamental mathematics terrain that is deep, broad, and thorough. Although 'profound' is typically viewed as signifying intellectual depth, it’s three connotations, deep, vast, and thorough, are interconnected” (p. 120). In this research, we conceive of profound conceptual understanding as the ability to utilize efficient and flexible strategies (as defined in this study) that are derived from a deep, broad, and thorough comprehension of various topics within the numbers and operations domain. This understanding necessitates an in-depth, comprehensive understanding of the fundamental mathematics terrain and mathematical concepts in the numbers and operations domain, consistent with Ma’s (2010) definition.

References

  • Alajmi, A., & Reys, R. (2010). Examining eighth grade Kuwaiti students’ recognition and interpretation of reasonable answer. International Journal of Science and Mathematics Education, 8(1), 117–139.

    Article  Google Scholar 

  • Berch, D. B. (2005). Making sense of number sense: Implications for children with mathematical disabilities. Journal of Learning Disabilities, 38(4), 333–339.

    Article  Google Scholar 

  • Burton, L. (2004). Confidence is everything” – perspectives of teachers and students on learning mathematics. Journal of Mathematics Teacher Education, 7(4), 357–381.

    Article  Google Scholar 

  • Caleon, I., & Subramaniam, R. (2010a). Development and application of a three-tier diagnostic test to assess secondary students’ understanding of waves. International Journal of Science Education, 32(7), 939–961.

    Article  Google Scholar 

  • Caleon, I., & Subramaniam, R. (2010b). Do students know what they know and what they don’t know? Using a four-tier diagnostic test to assess the nature of students’ alternative conceptions. Research in Science Education, 40, 313–337.

    Article  Google Scholar 

  • Cetin-Dindar, A., & Geban, O. (2011). Development of a three-tier test to assess high school students’ understanding of acids and bases. Procedia-Social and Behavioral Sciences, 15, 600–604.

    Article  Google Scholar 

  • Cheung, K. L., & Yang, D.-C. (2020). Performance of sixth graders in Hong Kong on a number sense threetier test. Educational Studies, 46(1), 39–55.

    Article  Google Scholar 

  • Coleman, B. (1998). Using explanatory knowledge during collaborative problem solving in science. The Journal of the Learning Sciences, 7, 387–427.

    Article  Google Scholar 

  • Cooper, B., & Harries, A. V. (2002). Children’s responses to contrasting “realistic” mathematics problems: Just how realistic are children ready to be? Educational Studies in Mathematics, 49(1), 1–23.

  • Devlin, K. (2017). Number sense: the most important mathematical concept in 21st Century K-12 education. https://www.huffingtonpost.com/entry/number-sense-the-most-important-mathematical-concept_us_58695887e4b068764965c2e0

  • Facun, R. D., & Nool, N. R. (2012). Assessing the number sense of grade 6 pupils. Paper presented at International Conference on Education and Management Innovation, Singapore, May 05th–6th. http://www.ipedr.com/vol30/58-ICEMI%202012-M10058.pdf

  • Foxman, D. (1999). Mathematics textbooks across the world: some evidence from the third international mathematics and science study (TIMSS). NFER.

  • Gersten, R., Jordan, N. C., & Flojo, J. R. (2005). Early identification and intervention for students with mathematics difficulties. Journal of Learning Disabilities, 38(4), 293–304.

    Article  Google Scholar 

  • Gogus, A. (2013). Evaluating mental models in mathematics: A comparison of methods. Educational Technology Research and Development, 61(2), 171–195.

    Article  Google Scholar 

  • Helmy, N., & F., Johar, R., & Abidin, Z. (2018). Student’s understanding of numbers through the number sense strategy. Journal of Physics: Conf. Series, 1088, 1–6.

    Google Scholar 

  • Herman, T. (2001). Strategi mental yang digunakan siswa sekolah dasar dalam berhitung [Number sense strategies used by elementary students in counting]. Paper presented at National Conference on Mathematics Education. Yogyakarta, Indonesia.

  • Hunt, D. (2003). The concept of knowledge and how to measure it. Journal of Intellectual Capital, 4(1), 100–113.

    Article  Google Scholar 

  • Karp, A., Dubrovsky, V. N., Bulychev, V. A., Garfunkel, S., Ovsyannikova, I., Polikarpov, S. A., ... & Wasserman, N. H. (2016). Current issues in mathematics education. COMAP.

  • Khalifa, K., & Gadomski, M. (2013). Understanding as explanatory knowledge: The case of Bjorken scaling. Studies in History and Philosophy of Science Part A, 44(3), 384–392.

    Article  Google Scholar 

  • Kurdziel, J. P., Beilfuss, M., & Libarkin, J. C. (2003). Research methodologies in science education: Mental models and cognition in education. Journal of Geoscience Education, 51(1), 121–126.

    Article  Google Scholar 

  • Lembaga Peperiksaan Kementerian Pelajaran Malaysia. (2019). Pelaporan Pentaksiran Sekolah Rendah (Primary school assessment report). https://www.moe.gov.my/en/pemberitahuan/announcement/pelaporan-pentaksiran-sekolah-rendah-ppsr-2019

  • Lemmo, A., Branchetti, L., Ferretti, F., Maffia, A., & Martignone, F. (2015). Students’ difficulties dealing with number line: A qualitative analysis of a question from national standardized assessment. Quadernidi Ricerca in Didattica (mathematics), 25(2), 149–156.

    Google Scholar 

  • Li, M. N. F., & Yang, D. C. (2010). Development and validation of a computer‐administered number sense scale for fifth‐grade children in Taiwan. School Science and Mathematics, 110(4), 220–230.

  • Lin, Y. C., Yang, D. C., & Li, M. N. (2016). Diagnosing students’ misconceptions in number sense via a web-based two-tier test. Eurasia Journal of Mathematics, Science and Technology Education, 12(1), 41–55.

  • Linchevski, L., & Livneh, D. (1999). Structure sense: The relationship between algebraic and numerical contexts. Educational Studies in Mathematics, 40(2), 173–196.

    Article  Google Scholar 

  • Lodge-Scharf, S. E. (2017). Investigating student mental models at the intersection of mathematics and physical reasoning in physics. The University of Maine: https://digitalcommons.library.umaine.edu/etd/2718/

  • Ma, L. (2010). Knowing and teaching elementary mathematics: Teachers’ understanding of fundamental mathematics in China and the United States. Routledge.

    Book  Google Scholar 

  • Markovits, Z., & Sowder, J. T. (1994). Developing number sense: An intervention study in grade 7. Journal for Research in Mathematics Education, 25(1), 4–29. https://doi.org/10.2307/749290

    Article  Google Scholar 

  • McIntosh, A., Reys, B. J., & Reys, R. E. (1992). A proposed framework for examining basic number sense. For the Learning of Mathematics, 12, 2–8.

    Google Scholar 

  • McIntosh, A., Reys, B. J, Reys, R. E, Bana, J., & Farrel, B. (1997). Number sense in school mathematics: Student performance in four countries. Edith Cowan University.

  • McNeil, N. M., & Alibali, M. W. (2005). Why won’t you change your mind? Knowledge of operational patterns hinders learning and performance on equations. Child Development, 76(4), 883–899.

    Article  Google Scholar 

  • Merenluoto, K., & Lehtinen, E. (2002). Conceptual change in mathematics: understanding the real numbers. In M. Limo’n, & L. Mason (Eds.), Reconsidering conceptual change. Issues in theory and practice (pp. 233–258). Kluwer Academic publishers.

  • Merenluoto, K., & Lehtinen, E. (2004). Number concept and conceptual change: Towards a systemic model of the processes of change. Learning and Instruction, 14(5), 519–534.

    Article  Google Scholar 

  • Mullis, I. V. S., Martin, M. O., Foy, P., & Hooper, M. (2016). TIMSS 2015 international results in mathematics. Boston College, TIMSS & PIRLS International Study Center. http://timssandpirls.bc.edu/timss2015/international-results/

  • National Council of Teachers of Mathematics [NCTM]. (1989). Curriculum and evaluation standards for school mathematics. NCTM.

  • NCTM. (2000). Principles and standards for school mathematics. NCTM.

  • Odom, A. L., & Barrow, L. H. (2007). High school biology students’ knowledge and certainty about diffusion and osmosis concepts. School Science and Mathematics, 107(3), 94–101.

  • OECD. (2016). Low-performing students: Why they fall behind and how to help them succeed. https://doi.org/10.1787/9789264250246-en

  • OECD. (2019). PISA 2018 results. Where all students can succeed. Volume II. https://doi.org/10.1787/b5fd1b8f-en

  • Organisation for Economic Co-operation and Development [OECD]. (2003). The PISA 2003 assessment framework—mathematics, reading, science, and problem-solving knowledge and skills. OECD.

  • Pesman, H., & Eryilmaz, A. (2010). Development of a three-tier test to assess misconceptions about simple electric circuits. The Journal of Educational Research, 103(3), 208–222.

    Article  Google Scholar 

  • Purnomo, Y. W., Kowiyah, A., & F., & Assiti, S. S. (2014). Assessing number sense performance of Indonesian elementary school students. International Education Studies, 7(8), 74–84.

    Article  Google Scholar 

  • Renner, C. H., & Renner, M. J. (2001). But I thought I knew that: Using confidence estimation as a debasing technique to improve classroom performance. Applied Cognitive Psychology, 15, 23–32.

  • Reys, R. E., & Yang, D. C. (1998). Relationship between computational performance and number sense among sixth-and eighth-grade students in Taiwan. Journal for Research in Mathematics Education, 29(2), 225–237.

  • Sadi, A. (2007). Misconceptions in Numbers. UGRU Journal, 5, 1–7.

    Google Scholar 

  • Sahdra, B., & Thagard, P. (2003). Procedural knowledge in molecular biology. Philosophical Psychology, 16(4), 477–498.

    Article  Google Scholar 

  • Saxe, G. B., Shaughnessy, M. M., Shannon, A., Langer Osuna, J., Chinn, R., & Gearhart, M. (2007). Learning about fractions as points on a number line. In P. Elliot, W. G. Martin, & M. E. Strutchens (Eds.), NCTM sixty-ninth yearbook. NCTM.

  • Şengül, S., & Gülbağcı, H. (2012). Evaluation of number sense on the subject of decimal numbers of the secondary stage students in Turkey. International Online Journal of Educational Sciences, 4(2), 296–310.

    Google Scholar 

  • Şengül, S., & Gülbağcı, D. H. (2014). The strategies of mathematics teachers when solving number sense problems. Turkish Journal of Computer and Mathematics Education (TURCOMAT), 5(1), 73–88.  https://doi.org/10.16949/turcomat.67936

  • Sianturi, I. A. J., Ismail, Z., & Yang, D. C. (2021). A cross‐national comparison of mathematical problems on numbers and operations‐related topics in five countries. School Science and Mathematics, 121(2), 72–84.

  • Stankov, L., & Crawford, J. D. (1997). Self-confidence and performance on test of cognitive abilities. Intelligence, 25(2), 93–109.

    Article  Google Scholar 

  • Stein, M. K., Smith, M. S., Henningsen, M., & Silver, E. A. (2000). Implementing standards-based mathematics instruction: a casebook for professional development. Teachers College Press.

  • Steinle, V., & Stacey, K. (1998). The incidence of misconceptions of decimal notation amongst students in grades 5 to 10. Teaching Mathematics in New Times, MERGA, 21, 548–555.

  • Steinle, V., & Stacey, K. (2003). Grade-related trends in the prevalence and persistence of decimal misconceptions. International Group for the Psychology of Mathematics Education, 4, 259–266.

    Google Scholar 

  • Suurtamm, C., Thompson, D. R., Kim, R. Y., Moreno, L. D., Sayac, N., Schukajlow, S., ... & Vos, P. (2016). Assessment in mathematics education: large-scale assessment and classroom assessment. Springer

  • ten Berge, T., & van Hezewik, R. (1999). Procedural and declarative knowledge: An evolutionary perspective. Theory & Psychology, 9(5), 605–624.

    Article  Google Scholar 

  • Törnrros, J. (2005). Mathematics textbooks, opportunity to learn and student achievement”. Studies in Educational Evaluation, 31(4), 315–327.

    Article  Google Scholar 

  • Tsai, C.-C., & Chou, C. (2002). Diagnosing students’ alternative conceptions in science. Journal of Computer Assisted Learning, 18(2), 157–165.

    Article  Google Scholar 

  • Valverde, G. A., Bianchi, L. J., Wolfe, R. G., Schmidt, W. H., & Houang, R. T. (2002). According to the book: Using TIMSS to investigate the translation of policy into practice through the world of textbooks. Kluwer Academic Publishers.

    Book  Google Scholar 

  • Vamvakoussi, X., & Vosniadou, S. (2010). How many decimals are there between two fractions? Aspects of secondary school students’ under- standing of rational numbers and their notation. Cognition and Instruction, 28(2), 181–209.

    Article  Google Scholar 

  • Widjaja, W., Stacey, K., & Steinle, V. (2011). Locating negative decimals on the number line: Insights into the thinking of pre-service primary teachers. Journal of Mathematical Behavior, 30(1), 80–90.

    Article  Google Scholar 

  • Wijaya, A., van den Heuvel-Panhuizen, M., & Doorman, M. (2015). Opportunity-to-learn context-based tasks provided by mathematics textbooks. Educational Studies in Mathematics, 89(1), 41–65. https://doi.org/10.1007/s10649-015-9595-1

    Article  Google Scholar 

  • Yang, D. C. (2019). Development of a three-tier number sense test for fifth-grade students. Educational Studies in Mathematics, 101(3), 405–424.

  • Yang, D. C., Li, M. N., & Lin, C. I. (2008). A study of the performance of 5th graders in number sense and its relationship to achievement in mathematics. International Journal of Science and Mathematics Education, 6(4), 789–807.

  • Yang, D. C., & Sianturi, I. A. J. (2019a). Sixth grade students’ performance, misconceptions, and confidence when judging the reasonableness of computational results. International Journal of Science and Mathematics Education, 17, 1519–1540.

  • Yang, D. C., & Sianturi, I. A. J. (2019b). Assessing students' conceptual understanding using an online three‐tier diagnostic test. Journal of Computer Assisted Learning, 35(5), 678–689.

  • Yang, D. C., & Sianturi, I. A. J. (2021). Sixth grade students’ performance, misconception, and confidence on a three-tier number sense test. International Journal of Science and Mathematics Education, 19(2), 355–375.

  • Yeap, B. H. (2005). Building foundations and developing creativity: an analysis of Singapore mathematics textbooks. Paper presented at the Third East Asia Regional Conference on Mathematics Education in Shanghai, China. August 7–12.

  • Yilmaz, I., & Yalcin, N. (2012). The relationship of procedural and declarative knowledge of science teacher candidates in Newton’s laws of motion to understanding*. American International Journal of Contemporary Research, 2(3), 50–56.

    Google Scholar 

  • Zhu, Y., & Fan, L. (2006). Focus on the representation of problem types in intended curriculum: a comparison of selected mathematics textbooks from Mainland China and the United States. International Journal of Science and Mathematics Education, 4(4), 609–626. https://doi.org/10.1007/s10763-006-9036-9

Download references

Acknowledgements

This work was supported by the Ministry of Science and Technology, Taiwan, with grant no. MOST 105-2511-S-415-003-MY3. The opinions expressed in this paper are those of the authors and do not necessarily reflect the views of the Ministry of Science and Technology.

Funding

Ministry of Science and Technology, Taiwan, MOST 105-2511-S-415-003-MY3, Der-Ching Yang.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Der-Ching Yang.

Ethics declarations

Ethics approval and consent to participate

The participants provide their written informed consent to participate in this study. Declaration of Helsinki was appropriately addressed, and the study received approval from the Ethics Committee of National Chiayi University, Taiwan.

Competing interests

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sianturi, I.A.J., Ismail, Z. & Yang, DC. Examining fifth graders’ conceptual understanding of numbers and operations using an online three-tier test. Math Ed Res J (2023). https://doi.org/10.1007/s13394-023-00452-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s13394-023-00452-2

Keywords

Navigation