Statistical Considerations for Subscore Reporting in Multistage Testing
This study examines factors that influence the reliability of subscores and the accuracy of subscore estimates in multistage testing (MST). The factors considered in the study include the number of subtests, subtest length, correlations among subscores, item pool characteristics such as item pool size relative to the number of items required for an MST and statistical properties of items. Results indicated that the factors that most influenced subscore reliability and subscore estimates were subtest length, item pool size, and the degree of item discrimination.
KeywordsSubscore Subscore reliability Multistage testing
- American Psychological Association, National Council on Measurement in Education, & American Educational Research Association. (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association. https://doi.org/10.1037/e578562014-008.CrossRefGoogle Scholar
- Konis, K. (2009). lpSolveAPI, version 22.214.171.124 [Computer software].Google Scholar
- Von Davier, M. (2016). Software for multidimensional discrete latent traits models [computer software]. Princeton, NJ: Educational Testing Service.Google Scholar