Abstract
According to PISA 2012, mathematics self-beliefs involve three dimensions: mathematics self-efficacy, mathematics self-concept and mathematics anxiety. This study utilized the multiple indicators, multiple causes (MIMIC) method, an approach for detecting whether there is a lack of measurement invariance or differential item functioning (DIF), to deal with multiple covariates, multiple dimensions, and ordered categorical variables with threshold structures to study DIF among mathematics self-beliefs items across Shanghai-China (N = 5177) and the USA (N = 4978) from Program for International Student Assessment (PISA) 2012. The MIMIC approach with mediators was also applied in the study, which helped to detect variables that could account for meaningful partial or complete DIF effects. Confirmatory factor analysis (CFA), a statistic method that can verify the number of latent traits of the dataset, indicated that the three-factor structure worked for the data. Both robust weighted least square (WLSMV) estimator and robust maximum likelihood (MLR) estimator were used in the parameter estimation to identify items with DIF and quantify the DIF effect size. It was found in the study with MIMIC method that in-school mathematics class periods and out-of-school study hours in PISA 2012 had partial effects on most items with meaningful DIF effects.
Similar content being viewed by others
References
Ashcraft, M. H. (2002). Math anxiety: Personal, educational, and cognitive consequences. Current Directions in Psychological Science, 11(5), 181–185.
Bandura, A. (1977). Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review, 84(2), 191.
Bandura, A. (1993). Perceived self-efficacy in cognitive development and functioning. Educational Psychologist, 28(2), 117–148.
Beilock, S. L., & Maloney, E. A. (2015). Math anxiety A factor in math achievement not to be ignored. Policy Insights from the Behavioral and Brain Sciences, 2(1), 4–12.
Bong, M., & Clark, R. E. (1999). Comparison between self-concept and self-efficacy in academic motivation research. Educational Psychologist, 34(3), 139–153.
Bong, M., & Skaalvik, E. M. (2003). Academic self-concept and self-efficacy: How different are they really? Educational Psychology Review, 15(1), 1–40.
Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136–162). Newbury Park, CA: Sage.
Cassady, J. C., & Johnson, R. E. (2002). Cognitive test anxiety and academic performance. Contemporary Educational Psychology, 27(2), 270–295.
Chen, P., & Zimmerman, B. (2007). A cross-national comparison study on the accuracy of self-efficacy beliefs of middle-school mathematics students. The Journal of Experimental Education, 75(3), 221–244.
Cheng, Y., Shao, C., & Lathrop, Q. N. (2016). The mediated MIMIC model for understanding the underlying mechanism of DIF. Educational and Psychological Measurement, 76(1), 43–63.
Chipman, S. F., Krantz, D. H., & Silver, R. (1992). Mathematics anxiety and science careers among able college women. Psychological Science, 3(5), 292–295.
Cole, S. R., Kawachi, I., Maller, S. J., & Berkman, L. F. (2000). Test of item-response bias in the CES-D scale: Experience from the New Haven EPESE study. Journal of Clinical Epidemiology, 53(3), 285–289.
Dhir, A., Kaur, P., Chen, S., & Pallesen, S. (2019). Antecedents and consequences of social media fatigue. International Journal of Information Management, 48, 193–202.
Dhir, A., Yossatorn, Y., Kaur, P., & Chen, S. (2018). Online social media fatigue and psychological wellbeing—A study of compulsive use, fear of missing out, fatigue, anxiety and depression. International Journal of Information Management, 40, 141–152.
Freitag, M., & Bauer, P. C. (2013). Testing for measurement equivalence in surveys dimensions of social trust across cultural contexts. Public Opinion Quarterly, 77(S1), 24–44.
Ganotice, F. A., Bernardo, A. B., & King, R. B. (2012). Testing the factorial invariance of the English and Filipino versions of the inventory of school motivation with bilingual students in the Philippines. Journal of Psychoeducational Assessment, 30(3), 298–303.
Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55.
Huberty, T. J. (2012). Anxiety and depression in children and adolescents: Assessment, intervention, and prevention. New York: Springer.
Kim, E. S., & Yoon, M. (2011). Testing measurement invariance: A comparison of multiple-group categorical CFA and IRT. Structural Equation Modeling, 18(2), 212–228.
Koomen, H. M., Verschueren, K., van Schooten, E., Jak, S., & Pianta, R. C. (2012). Validating the student–teacher relationship scale: Testing factor structure and measurement invariance across child gender and age in a Dutch sample. Journal of School Psychology, 50(2), 215–234.
Lee, J. (2009). Universals and specifics of math self-concept, math self-efficacy, and math anxiety across 41 PISA 2003 participating countries. Learning and Individual Differences, 19(3), 355–365.
Liang, X., Kidwai, H., & Zhang, M. (2016). How Shanghai does it: Insights and lessons from the highest-ranking education system in the world. Washington, DC: The World Bank.
Malik, A., Dhir, A., Kaur, P., & Johri, A. (2020). Correlates of social media fatigue and academic performance decrement. Information technology and people. https://doi.org/10.1108/ITP-06-2019-0289.
Marsh, H. W., Abduljabbar, A. S., Abu-Hilal, M. M., Morin, A. J., Abdelfattah, F., Leung, K. C., et al. (2013). Factorial, convergent, and discriminant validity of TIMSS math and science motivation measures: A comparison of Arab and Anglo-Saxon countries. Journal of Educational Psychology, 105(1), 108–128.
Marsh, H. W., & Craven, R. G. (2006). Reciprocal effects of self-concept and performance from a multidimensional perspective: Beyond seductive pleasure and unidimensional perspectives. Perspectives on Psychological Science: A Journal of the Association for Psychological Science, 1(2), 133–163.
OECD. (2013a). PISA 2012 assessment and analytical framework: Mathematics, reading, science, problem solving and financial literacy. PISA: OECD Publishing.
OECD. (2013b). PISA 2012 results: Ready to learn—students’ engagement, drive and self-beliefs (Vol. III). PISA: OECD Publishing.
OECD. (2014a). PISA 2012 technical report. PISA: OECD Publishing.
OECD. (2014b). Results in focus: What 15-year-olds know and what they can do with what they know. PISA: OECD Publishing.
Penfield, R. D. (2010). Explaining crossing DIF in polytomous items using differential step functioning effects. Applied Psychological Measurement, 34(8), 563–579.
Runyan, R. C., Ge, B., Dong, B., & Swinney, J. L. (2012). Entrepreneurial orientation in cross-cultural research: Assessing measurement invariance in the construct. Entrepreneurship Theory and Practice, 36(4), 819–836.
Savickas, M. L., & Porfeli, E. J. (2012). Career adapt-abilities scale: Construction, reliability, and measurement equivalence across 13 countries. Journal of Vocational Behavior, 80(3), 661–673.
Seetee, N., Chi, C., Dhir, A., & Chen, S. (2020). Validation of the science, mathematics, and English task value scales based on longitudinal data. International Journal of Science and Mathematics Education. https://doi.org/10.1007/s10763-020-10081-x
Schmitt, N., & Kuljanin, G. (2008). Measurement invariance: Review of practice and implications. Human Resource Management Review, 18(4), 210–222.
Wang, W., & Shih, C. (2010). MIMIC methods for assessing differential item functioning in polytomous items. Applied Psychological Measurement, 34(3), 166–180.
Wilkins, J. L. (2004). Mathematics and science self-concept: An international investigation. The Journal of Experimental Education, 72(4), 331–346.
Woods, C. M. (2009a). Empirical selection of anchors for tests of differential item functioning. Applied Psychological Measurement, 33(1), 42–57.
Woods, C. M. (2009b). Evaluation of MIMIC-model methods for DIF testing with comparison to two-group analysis. Multivariate Behavioral Research, 44(1), 1–27.
Woods, C. M., & Grimm, K. J. (2011). Testing for nonuniform differential item functioning with multiple indicator multiple cause models. Applied Psychological Measurement, 35(5), 339–361.
Yoshino, A. (2012). The relationship between self-concept and achievement in TIMSS 2007: A comparison between American and Japanese students. International Review of Education, 58(2), 199–219.
Zhou, Y., & Wang, D. (2016). A Chinese approach to learning? A comparative study on time use patterns of 15-year-old students in PISA 2012. In Chinese education models in a global age (pp. 105–119). Singapore: Springer.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Zhu, S., Meyer, P. A Comparative Study of Mathematics Self-Beliefs between Students in Shanghai-China and the USA. Asia-Pacific Edu Res 31, 81–91 (2022). https://doi.org/10.1007/s40299-020-00540-y
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40299-020-00540-y