IRT Scales for Self-reported Test-Taking Motivation of Swedish Students in International Surveys
This study aims at modeling the self-reported test-taking motivation items in PISA and TIMSS Advanced studies for Swedish students using an IRT approach. In the last two cycles of the assessments, six test-specific items were included in the Swedish student questionnaires to evaluate pupil’s effort, motivation and how they perceived the importance of the tests. Using a Multiple-Group Generalized Partial Credit model (MG-GPCM), we created an IRT motivation scale for each assessment. We also investigated measurement invariance for the two cycles of PISA (i.e., 2012 and 2015) and of TIMSS Advanced (i.e., 2008 and 2015). Results indicated that the proposed scales refer to unidimensional constructs and measure reliably students’ motivation (Cronbach’s alpha above 0.78). Differential item functioning across assessment cycles was restricted to two criteria (RMSD and DSF) and had more impact on the latent motivation scale for PISA than for TIMSS Advanced. Overall, the test-taking motivation items fit well the purpose of a diagnostic of test-taking motivation in these two surveys and the proposed scales highlighted the slight increase of pupils’ motivation across the assessment cycles.
KeywordsTest-taking motivation PISA TIMSS IRT
- Brown, T. A. (2014). Confirmatory factor analysis for applied research. New York: Guilford.Google Scholar
- Buuren, S. V., & Groothuis-Oudshoorn, K. (2010). Mice: Multivariate imputation by chained equations in R. Journal of Statistical Software, 45(3), 1–68.Google Scholar
- Kiefer, T., Robitzsch, A., & Wu, M. (2015). Tam: Test analysis modules. R Package.Google Scholar
- Revelle, W. (2014). Psych: Procedures for psychological, psychometric, and personality research. R Package.Google Scholar
- Wagemaker, H. (2013). International large-scale assessments: From research to policy. In L. Rutkowski, M. von Davier, & D. Rutkowski D (Eds.), Handbook of international large-scale assessment: Background, technical issues, and methods of data analysis (pp. 11–35). New York: Chapman Hall/CRC.Google Scholar