Validating the Use of Translated and Adapted HEIghten® Quantitative Literacy Test in Russia
In responding to the need for internationally comparable data on higher education student learning outcomes, some modules of the HEIghten® Outcomes Assessment Suite, developed by Educational Testing Service, have been translated and adapted for international use. This recent development points to a critical need to validate the use of translated and adapted HEIghten assessments in international contexts. This chapter reports on validating the use of the Russian HEIghten Quantitative Literacy (QL) assessment with a representative group of students majoring in electrical engineering and computer science from 34 higher education institutions in Russia. Our findings provided preliminary evidence in support of the use of the assessment for the target population as a measure of QL. Future research is suggested to further investigate the test’s ability of reflecting changes in the target construct as a function of learning in the context of Russia.
Support from the Basic Research Program of the National Research University Higher School of Economics is gratefully acknowledged.
- American College Testing. (2012). ACT CAAP technical handbook 2011–2012. Iowa City: CAAP Program Management. Retrieved from http://www.act.org/content/dam/act/unsecured/documents/CAAP-TechnicalHandbook.pdf
- American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.Google Scholar
- Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale: L. Erlbaum Associates.Google Scholar
- Council for Aid to Education. (2015). CLA+ technical FAQs. New York: Author. Retrieved from http://cae.org/images/uploads/pdf/CLA_Plus_Technical_FAQs.pdf
- Educational Testing Service. (2010). ETS proficiency profile user’s guide. Princeton: Educational Testing Service. Retrieved from https://www.ets.org/s/proficiencyprofile/pdf/Users_Guide.pdf
- Finney, S. J., & DiStefano, C. (2013). Nonnormal and categorical data in structural equation models. In G. R. Hancock & R. O. Mueller (Eds.), Structural equation modeling: A second course (2nd ed., pp. 439–492). Charlotte: Information Age.Google Scholar
- International Test Commission. (2005). International Test Commission guidelines for translating and adapting tests. Retrieved from http://www.intestcom.org/files/guideline_test_adaptation.pdf
- Klein, S., Liu, O. L., Sconing, J. A., Bolus, R., Bridgeman, B., Kugelmass, H., & Steedle, J. (2009). Test Validity Study (TVS) Report (ETS technical report). Supported by the Fund for Improvement of postsecondary education (FIPSE). Retrieved from https://cp-files.s3.amazonaws.com/26/TVSReport_Final.pdf
- Knight, J. (2003). Updated definition of internationalization. International Higher Education, 33, 2–3.Google Scholar
- Muthén, L. K., & Muthén, B. O. (2010). Mplus user’s guide (6th ed.). Los Angeles: Authors.Google Scholar
- Organization for Economic Co-operation and Development. (2012). PISA 2012 technical report. Paris: OECD. Retrieved from https://www.oecd.org/pisa/pisaproducts/PISA-2012-technical-report-final.pdf.Google Scholar
- Roohr, K. C., Graf, E. A., & Liu, O. L. (2014). Assessing quantitative literacy in higher education: An overview of existing research and assessments with recommendations for next-generation assessment (ETS RR-14-22). Princeton: Educational Testing Service.Google Scholar
- Tremblay, K., Lalancette, D., & Roseveare, D. (2012). Assessment of higher education learning outcomes (AHELO) feasibility study report: Design and implementation (Vol. 1). Paris: Organization for Economic Co-operation and Development.Google Scholar