Skip to main content
Log in

Psychometric properties of the Metacognitive Awareness Inventory (MAI): standardization to an international spanish with 12 countries

  • Published:
Metacognition and Learning Aims and scope Submit manuscript

Abstract

Metacognition is defined as a higher-order thinking skill that enables individuals to monitor, control, and regulate their thinking and behavior. In education, this skill is important, as learners need to self-regulate their learning behaviors for successful lifelong learning. Thus, it is essential for educators and learners alike to know their metacognitive skills. Researchers can assist in this endeavor by developing sound and valid quantitative measures for psychological phenomena such as metacognition. No measure is more commonly used for this purpose than the Metacognitive Awareness Inventory (MAI). In the present study, the International Group on Metacognition validated the MAI employing a standard, international Spanish with a robust sample of 12 Spanish-speaking countries and 1,622 undergraduate university students. Results revealed a solid final baseline confirmatory factor analysis model for all 12 countries that supports the original two-factor structure reported in English-speaking samples from the United States. Additionally, multigroup measurement invariance analyses revealed that although five parameters varied slightly across some countries, chi-square difference tests indicated that the comparison model with these constraints freely estimated was not significantly better than the fully constrained null model, supporting measurement invariance across countries. Thus, our version of the MAI using standard, international Spanish is a valid and reliable tool for measuring metacognitive awareness in Spanish-speaking countries.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
€32.70 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Finland)

Instant access to the full article PDF.

Figure 1

Similar content being viewed by others

Data availability

Data associated with this research are available to anyone upon reasonable request.

Code availability

Not applicable.

References 

  • Akın, A., Abacı, R., & Çetin, B. (2007). The validity and reliability study of the turkish version of the metacognitive awareness inventory. Educational Sciences: Theory and Practice, 7(2), 671–678. https://toad.halileksi.net/wp-content/uploads/2022/07/metacognitive-awareness-inventory-toad.pdf.

    Google Scholar 

  • American Educational Research Association (AERA), American Psychological Association (APA), & National Council on Measurement in Education (NCME). (2014). Standards for educational and psychological testing (2014 ed.). American Educational Research Association. https://www.aera.net/Publications/Books/Standards-for-Educational-Psychological-Testing-2014-Edition

  • Azevedo, R., & Aleven, V. (2013). International handbook of metacognition and learning technologies. Springer. https://doi.org/10.1007/978-1-4419-5546-3

  • Baker, L., & Cerro, L. (2000). Assessing metacognition in children and adults. In G. Schraw & J. C. Impara (Eds.), Issues in the measurement of metacognition (pp. 99–145). Buros Institute of Mental Measurements.

    Google Scholar 

  • Bandura, A. (2001). Social cognitive theory: An agentic perspective. Annual Review of Psychology, 52, 1–26. https://doi.org/10.1146/annurev.psych.52.1.1

    Article  Google Scholar 

  • Bentler, P. M. (2005). EQS 6: Structural equations program manual. Multivariate Software.

  • Bosworth, A., Dowall, S., García-Dorival, I., Rickett, N., Bruce, C., Matthews, D., Fang, Y., Aljabr, W., Kenny, J., Nelson, C., Laws, T., Williamson, E., Stewart, J., Carroll, M., Hewson, R., & Hiscox, J. (2017). A comparison of host gene expression signatures associated with infection in vitro by the Makona and Ecran (Mayinga) variants of Ebola virus. Scientific Reports, 7(1), 43144. https://doi.org/10.1038/srep43144

    Article  Google Scholar 

  • Brown, A. (1987). Metacognition, executive control, self-regulation, and other more mysterious mechanisms. In F. Weinert & R. Kluwe (Eds.), Metacognition, motivación and understanding (pp. 65–116). Lawrence erlbaum.

    Google Scholar 

  • Buratti, S., & Allwood, C. (2015). Regulating metacognitive processes-support for a meta-metacognitive ability. In A. Peña-Ayala (Ed.), Metacognition: Fundaments, applications and trends. A prolife of the current state -of-the-art (pp. 17–35). Springer.

    Chapter  Google Scholar 

  • Byrne, B. M. (2006). Structural equation modeling with EQS: Basic concepts, applications, and programming (2nd ed.). Lawrence Erlbaum Associates Publishers.

  • Cheng, E., & Chan, J. (2021). Developing metacognitive teaching strategies through lesson study. Springer.

    Book  Google Scholar 

  • Craig, K., Hale, D., Grainger, C., & Stewart, M. (2020). Evaluating metacognitive self-reports: systematic reviews of the value of self-report in metacognitive research. Metacognition and Learning, 15, 155–213. https://doi.org/10.1007/s11409-020-09222-y

    Article  Google Scholar 

  • Cross, D., & Paris, S. (1988). Developmental and instructional analyses of children’s metacognition and reading comprehension. Journal of Educational Psychology, 80(2), 131–142. https://doi.org/10.1037/0022-0663.80.2.131

    Article  Google Scholar 

  • Dinsmore, D. L., Alexander, P. A., & Loughlin, S. M. (2008). Focusing the conceptual lens on metacognition, self-regulation, and self-regulated learning. Educational Psychology Review, 20, 391–409. https://doi.org/10.1007/s10648-008-9083-6

    Article  Google Scholar 

  • Double, K., & Birney, D. (2019). Reactivity to measures of metacognition. Frontiers in Psychology, 10(2755), 1–10. https://doi.org/10.3389/fpsyg.2019.02755

    Article  Google Scholar 

  • Dunlosky, J., & Rawson, K. A. (Eds.). (2019). The Cambridge Handbook of Cognition and Education. London: Cambridge University Press. https://doi.org/10.1017/9781108235631

    Book  Google Scholar 

  • Efklides, A. (2006). Metacognition and affect: What can metacognitive experiences tell us about the learning process? Educational Research Review, 1(1), 3–14. https://doi.org/10.1016/j.edurev.2005.11.001

    Article  Google Scholar 

  • Efklides, A. (2008). Metacognition: Defining its facets and levels of func- tioning in relation to self-regulation and co-regulation. European Psychologist, 13(4), 277–287. https://doi.org/10.1027/1016-9040.13.4.277

    Article  Google Scholar 

  • Efklides, A., & Misailidi, P. (2010). Introduction: The present and future in metacognition. In A. Efklides & P. Misailidi (Eds.), Trends and prospects in metacognition research (pp. 1–20). Springer.

    Chapter  Google Scholar 

  • Elosua, P. (2017). Avances, proyectos y retos internacionales ligados al uso de tests en Psicología. Estudos de Psicologia Campinas, 34(2), 201–210. https://doi.org/10.1590/1982-02752017000200002

  • Flavell, J. H. (1976). Metacognitive aspects of problem solving. In L. B. Resnick (Ed.), The nature of intelligence (pp. 231–235). Lawrence Erlbaum.

    Google Scholar 

  • Flores, J., Ostrosky, F., & Lozano, A. (2008). Batería de funciones frontales y ejecutivas: presentación. Revista de Neuropsicología, Neuropsiquiatría y Neurociencias, 8(1), 141–158. Recuperado de https://aalfredoardila.files.wordpress.com/2013/07/ardila-a-ed-2008-funciones-ejecutivas-neuropsicologia-neuropsiquiatria-y-neurociencias-vol-8-n1.pdf. Accessed 19 Mar 2024

  • Flores-Lázaro, J., Castillo-Preciado, R., & Jiménez-Miramonte, N. (2014a). Desarrollo de funciones ejecutivas, de la niñez a la juventud. Anales de Psicología, 30(2), 463–473. https://doi.org/10.6018/analesps.30.2.155471

    Article  Google Scholar 

  • Flores-Lázaro, J., Ostrosky-Schejet, F., & Lozano-Gutiérrez, A. (2014b). BANFE - 2. Batería neuropsicológica de funciones ejecutivas y lóbulos frontales. Manual Moderno.

    Google Scholar 

  • Follmer, D. J., & Sperling, R. (2016). The mediating role of metacognition in the relationship between executive function and self-regulated learning. British Journal of Educational Psychology, 86(4), 1–17. https://doi.org/10.1111/bjep.12123

    Article  Google Scholar 

  • Garner, R. (1990). When children and adults do not use learning strategies: Toward a theory of settings. Review of Educational Research, 60(4), 517–529. https://doi.org/10.3102/00346543060004517

    Article  Google Scholar 

  • Garrido, J. (2010). Lengua y globalización: inglés global y español pluricéntrico. Historia y Comunicación Social, 15, 67–102. https://revistas.ucm.es/index.php/HICS/article/view/HICS1010110063A

  • González-Cabañes, E., García, T., Álvarez-García, D., Fernández, E., & Rodríguez, C. (2022). Validation of the shortened version of the metacognitive awareness inventory in spanish university students. Psicothema, 34(3), 454–462. https://doi.org/10.7334/psicothema2022.75

    Article  Google Scholar 

  • Gutierrez de Blume, A. P., & Montoya Londoño, D. (2021). Validación y examen de la estructura factorial del Metacognitive Awareness Inventory (MAI) en español con una muestra colombiana de estudiantes universitarios. Revista psicogente, 24(46), 1–28. https://doi.org/10.17081/psico.24.46.4881

    Article  Google Scholar 

  • Gutierrez de Blume, A., Schraw, G., Kuch, F., & Richmond, A. (2020). General accuracy and general error factors in metacognitive monitoring and the role of time on task in predicting metacognitive judgments. Rev CES Psico, 14(2), 179–208. https://doi.org/10.21615/cesp.5494

    Article  Google Scholar 

  • Gutierrez de Blume, A. P., Montoya Londoño, D. M., Daset, L., Cuadro, A., Molina Delgado, M., Morán Núñez, O., García de la Cadena, C., Beltrán Navarro, M. B., Arias Trejo, N., Ramirez Balmaceda, A., Jiménez Rodríguez, V., Puente Ferreras, A., Urquijo, S., Arias, W. L., Rivera, L. I., Schulmeyer, M., & Rivera-Sanchez, J. (2023). Normative data and standardization of an international protocol for the evaluation of metacognition in Spanish-speaking university students: A cross-cultural analysis. Metacognition and Learning, 18(2), 495–526. https://doi.org/10.1007/s11409-023-09338-x

    Article  Google Scholar 

  • Gutierrez, A. P., & Price, A. F. (2017). Calibration between undergraduate students’ prediction of and actual performance: The role of gender and performance attributions. The Journal of Experimental Education, 85, 486–500. https://doi.org/10.1080/00220973.2016.1180278

    Article  Google Scholar 

  • Gutierrez, A. P., & Schraw, G. (2015). Effects of strategy training and incentives on students’ performance, confidence, and calibration. The Journal of Experimental Education, 83, 386–404. https://doi.org/10.1080/00220973.2014.907230

    Article  Google Scholar 

  • Hambleton, R. K. (1996). Adaptación de tests para su uso en diferentes idiomas y culturas: fuentes de error, posibles soluciones y directrices prácticas. En J. Muñiz (Coor.), Psicometría. Universitas.

  • Harrison, G., & Vallin, L. (2018). Evaluating the metacognitive awareness inventory using empirical factor-structure evidence. Metacognition Learning, 13, 15–38. https://doi.org/10.1007/s11409-017-9176-z

    Article  Google Scholar 

  • Hernández, A., Elosua, P., Fernández-Hermida, J., & Muñiz, J. (2022). Comisión de Test: Veinticinco años velando por la calidad de los test. Papeles del psicólogo, 43(1), 55–62. https://doi.org/10.23923/pap.psicol.2978

    Article  Google Scholar 

  • Huertas, A., Vesga, G., & Galindo, M. (2014). Validación del instrumento “inventario de habilidades metacognitivas (MAI)” con estudiantes Colombianos. Paxis, 5, 55–74.

    Google Scholar 

  • Jacobs, J., & Paris, S. (1987). Children’s metacognition about reading: Issues in definition, measurement, and instruction. Educational Psychologist, 22(3–4), 255–278. https://doi.org/10.1207/s15326985ep2203&4_4

  • Kline, R. B. (2005). Principles and practice of structural equation modeling (2nd ed.). Guilford Press.

  • Lima Filho, R., & Bruni, A. (2015). Metacognitive awareness inventory: Trans- lation and validation from a confirmatory analysis. Psicologia: Ciência e Profissão, 35(4), 1275–1293. https://doi.org/10.1590/1982-3703002292013

    Article  Google Scholar 

  • Livingston, J. A. (2003). Metacognition: An overview. (ED474273) ERIC. https://eric.ed.gov/?id=ED474273

  • López Morales, H. (2010). La andadura del español por el mundo. Taurus.

    Google Scholar 

  • Magno, C. (2010). The role of metacognitive skills in developing critical thinking. Metacognition and Learning, 5(2), 137–156. https://doi.org/10.1007/s11409-010-9054-4

    Article  Google Scholar 

  • Massodi, M. (2020). Metacognitive awareness in university studies: the comparative study of lithuanian and iranian cases. Mykolas Romeris University. https://repository.mruni.eu/handle/007/16501. Accessed 19 Mar 2024

  • Metcalfe, J., & Greene, M. (2007). Metacognition of agency. Journal of experimental psychology General, 136(2), 184–99. https://doi.org/10.1037/0096-3445.136.2.184

    Article  Google Scholar 

  • Muñiz, J., Elosua, P., & Hambleton, R. (2013). Directrices para la traducción y adapta- ción de los tests: segunda edición. Psicothema, 25(2), 151–157. https://doi.org/10.7334/psicothema2013.24

    Article  Google Scholar 

  • Muñiz, J., Hernández, A., & Ponsoda, V. (2015). Nuevas directrices sobre el uso de los tests: investigación, control de calidad y seguridad. Papeles del Psicólogo, 36(3), 161–173. https://repositorio.uam.es/handle/10486/671956.

    Google Scholar 

  • Muñiz, J., Elosua, P., Padilla, J. L., & Hambleton, R. K. (2016). Test adaptation standards for cross-lingual assessment. In C. S. Wells & M. Faulkner-Bond (Eds.), Educational measurement: From foundations to future (pp. 291–304). The Guilford Press.

    Google Scholar 

  • Omprakash, A., Kumar, A., Kuppusamy, M., Sathiyasekaran, B., Ravinder, T., & Ramaswamy, P. (2021). Validation of Metacognitive Awareness Inventory from a Private Medical University in India. Journal of education and health promotion, 10, 324. https://doi.org/10.4103/jehp.jehp_39_21

    Article  Google Scholar 

  • Ozturk, N. (2017). Assessing metacognition: theory and practices. International Journal of Assessment Tools in Education, 4(2), 134–148. https://doi.org/10.21449/ijate.298299

    Article  Google Scholar 

  • Pandey, K., & Mohan, A. (2023). Unveiling the Subtle Strength of "Metacognition" in the domain of Education. YMER, 22(3), 1131–1146. https://www.researchgate.net/publication/371176452_Unveiling_the_Subtle_Strength_of_Metacognition_in_the_domain_of_Education. Accessed 19 Mar 2024

  • Perikova, E., & Byzova, M. (2022). Factor structure of the russian version of the metacognitive awareness inventory. Кul’turno-istoricheskaya psikhologiya = Cultural-Historical Psychology, 18(2), 116–126. https://doi.org/10.17759/chp.2022180213

    Article  Google Scholar 

  • Pintrich, P. R., Wolters, C. A., & Baxter, G. P. (2000). Assessing metacognition and self- regulated learning. In G. Schraw & J. C. Impara (Eds.), Assessing metacognition and self-regulated learning (pp. 43–97). Buros Institute of Mental Measurements.

    Google Scholar 

  • Pour, A. V., & Ghanizadeh, A. (2017). Validating the Persian version of metacognitive awareness inventory and scrutinizing the role of its components in IELTS academic Reading achievement. Modern Journal Of Language Teaching Methods, 7(3), 46–63.

    Google Scholar 

  • Quinn, J., McEachen, J., Fullan, M., Gardner, M., & Drummy, M. (2021). Sumergirse en el aprendizaje profundo. Herramientas atractivas. Morata.

    Google Scholar 

  • Schraw, G. (1998). Promoting general metacognitive awareness. Instructional Science, 26(1), 113–125. https://doi.org/10.1023/A:1003044231033

    Article  Google Scholar 

  • Schraw, G. (2000). Assessing metacognition: Implications of the Buros symposium. In G. Schraw & J. C. Impara (Eds.), Issues in the measurement of metacognition (pp. 297–321). Buros Institute of Mental Measurements.

    Google Scholar 

  • Schraw, G. (2002). Promoting general metacognitive awareness. In H. Hartman (Ed.), Metacognition in learning and instruction: Theory, research and practice (pp. 3–16). Kluwer Academic.

    Google Scholar 

  • Schraw, G. (2009a). A conceptual analysis of five measures of metacognitive monitoring. Metacognition and Learning, 4(1), 33–45. https://doi.org/10.1007/s11409-008-9031-3

    Article  Google Scholar 

  • Schraw, G. (2009b). Measuring metacognitive judgment. In D. Hacker, J. Dunlosky, & A. Graesser (Eds.), Handbook of Metacognition in Education (pp. 415–429). Routledge Taylor & Francis Group.

    Google Scholar 

  • Schraw, G., & Dennison, R. (1994). Assessing metacognitive awareness. Contemporary Educational Psychology, 19, 460–475. https://doi.org/10.1006/ceps.1994.1033

    Article  Google Scholar 

  • Serra, M., & Metcalfe, J. (2009). Effective implementation of metacognition. In D. Hacker, J. Dunlosky, & A. Graesser (Eds.), Handbook of Metacognition in Education (pp. 278–298). Erlbaum. https://doi.org/10.4324/9780203876428

    Chapter  Google Scholar 

  • Tarricone, P. (2011). The Taxonomy of Metacognition. Psychology press.

    Book  Google Scholar 

  • Teo, T., & Lee, C. B. (2012). Assessing the factorial validity of the metacognitive awareness inventory (MAI) in an Asian country: A confirmatory factor analysis. International Journal of Educational and Psychological Assessment, 10(2), 92–103.

    Google Scholar 

  • Tobias, S., & Everson, H. (2009). The importance of knowing what you know: A knowledge monitoring framework for studying metacognition in education. In D. J. Hacker, J. Dunlosky, & A. Graesser (Eds.), Handbook of Metacognition in Education (pp. 107–228). Routledge.

    Google Scholar 

  • Torres, A. (2013). Del castellano de «un pequeño rincón» al español internacional. Revista de Estudios Lingüísticos Hispánicos, 3, 205-224. https://ojs.uv.es/index.php/normas/article/view/4679/4538

  • Ulloa Ordaya, M. (2019). Propiedades psicométricas del Inventario de Conciencia Metacognitiva (MAI) en estudiantes de secundaria de una institución educativa, UGEL 07, Lima. [Título profesional en psicología, Universidad Cesar Vallejo, Lima.Perú]. Repositorio Académico de la Universidad Cesar Vallejo. https://repositorio.ucv.edu.pe/handle/20.500.12692/44663

  • Veenman, M. V. J. (2005). The assessment of metacognitive skills. In B. Moschner & C. Artelt (Eds.), Lernstrategien und Metakognition: Implikationenfür Forschung und Praxis (pp. 75–97). Waxmann.

    Google Scholar 

  • Veenman, M., Van Hout-Wolters, B., & Afflerbach, P. (2006). Metacognition and learning: Conceptual and methodological considerations. Metacognition and Learning, 1(1), 3–14. https://doi.org/10.1007/s11409-006-6893-0

    Article  Google Scholar 

  • Veenman, M., Bavelaar, L., De Wolf, L., & Van Haaren, M. (2014). The on-line assessment of metacognitive skills in a computerized learning environment. Learning and Individual Differences, 29, 123–130. https://doi.org/10.1016/j.lindif.2013.01.003

    Article  Google Scholar 

  • Wang, M. C., Haertel, G. D., & Walberg, H. J. (1990). What influences learning? A content analysis of review literature. The Journal of Educational Research, 84(1), 30–43. https://doi.org/10.1080/00220671.1990.10885988

    Article  Google Scholar 

  • Werts, C. E., Linn, R. L., & Jöreskog, K. G. (1974). Intraclass Reliability Estimates: Testing Structural Assumptions. Educational and Psychological Measurement, 34(1), 25–33. https://doi.org/10.1177/001316447403400104

    Article  Google Scholar 

  • Whitebread, D., Coltman, P., Pasternak, D. P., Sangster, C., Grau, V., Bingham, S., & Demetriou, D. (2009). The development of two observational tools for assessing metacognition and self-regulated learning in young children. Metacognition and Learning, 4(1), 63–85. https://doi.org/10.1007/s11409-008-9033-1

    Article  Google Scholar 

  • Winne, P., & Azevedo, R. (2014). Metacognition. In K. Sawyer (Ed.), The Cambridge Handbook of the Learning Sciences (pp. 63–87). Cambridge University Press.

    Chapter  Google Scholar 

  • Winne, P. H., & Perry, N. E. (2005). Measuring self-regulated learning. In M. Boekaerts, P. R. Pintrich, & M. Zeidner (Eds.), Handbook of self-regulation (pp. 531–566). Elsevier Academic Press.

    Google Scholar 

  • Xethakis, L. (2020). The psychometric properties of the Metacognitive Awareness Inventory in the Japanese EFL context. 熊本大学社会文化研究, 18, 121–146.

  • Zohar, A. (2020). Scaling-up higher order thinking. Springer.

    Google Scholar 

  • Zohar, A., & Dori, Y. (2012). Metacognition in Science education. Trends in current research. Springer.

    Google Scholar 

Download references

Funding

There is no funding to report.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Antonio P. Gutierrez de Blume.

Ethics declarations

Conflicts of interest/competing interests

None of the authors have any conflicts of interest to report.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendices

Appendix A

Original English Version of the MAI

Metacognitive Awareness Inventory

Directions: Please move the slider to the point on the continuous line under each statement that best corresponds to how true each statement is about you.

figure afigure afigure afigure afigure afigure afigure afigure afigure a

Appendix B

Spanish Version of the MAI Translated via the Translation-Back Translation Method

Inventario de Conocimiento Metacognitivo (Schraw & Dennison, 1994)

Indicaciones: Por favor dibuje una línea vertical sobre la línea continua en cada uno de los enunciados, que mejor corresponda a qué tan cierto es cada una de las siguientes indicaciones sobre usted.

figure bfigure bfigure bfigure b

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gutierrez de Blume, A.P., Montoya Londoño, D.M., Jiménez Rodríguez, V. et al. Psychometric properties of the Metacognitive Awareness Inventory (MAI): standardization to an international spanish with 12 countries. Metacognition Learning 19, 793–825 (2024). https://doi.org/10.1007/s11409-024-09388-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11409-024-09388-9

Keywords

Navigation