Abstract
Intelligence is a psychological dimension that predicts other important variables, such as educational, social, and economic performance. Despite being one of the most studied constructs in the field of psychology, few instruments in Brazil measure intelligence in more than one dimension and quickly. This study aims to construct the Abstract and Spatial Reasoning Test (TRAE) and to check for evidence of internal structure validity. The study sample consisted of 1069 secondary education students between 11 and 17 years of age. The discrimination (a) and difficulty (b) parameters of the items, estimated based on the IRT, presented mean coefficients close to 1.00 and .70, respectively. The information curve suggests that the test is more reliable to assess adolescents with theta coefficients between 1 and 2. Factor analyses indicated that the structure of the test permits estimating two first-order factors, as well as one general factor associated with fluid intelligence. In sum, the results indicated that the test has adequate psychometric properties.
Resumen
La inteligencia es un constructo psicológico que predice otras variables importantes, como el rendimiento académico, social y económico. A pesar de ser uno de los constructos más estudiados en el campo de la psicología, existen pocos instrumentos en Brasil que midan la inteligencia en más de una dimensión y rápidamente. Este estudio tiene como objetivo construir El Teste de razonamiento abstracto y espacial (TRAE) y la verificación de las evidencias de validez de la estructura interna. La muestra del estudio consistió en 1,069 estudiantes de 11 a 17 años. Los parámetros de discriminación (a) y dificultad (b) de los ítems, estimados por TRI, presentaron media cercana a 1.00 y 0.70, respectivamente. La curva de información sugiere que los escores del instrumento son más fiables para evaluar los adolescentes con thetas entre 1 y 2. El análisis factorial indicó que el instrumento tiene una estructura que permite la estimación de dos factores específicos, así como un factor general asociado con la inteligencia fluida. En resumen, los resultados indicaron que el instrumento tiene propiedades psicométricas adecuadas y es capaz de medir la inteligencia de forma multidimensional.
Resumo
A inteligência é um construto psicológico que prediz diversas variáveis importantes, como desempenho educacional, social e econômico. Apesar de ser um dos construtos mais estudados da área da psicologia, são poucos os instrumentos no Brasil que mensuram a inteligência em mais de uma dimensão e de forma rápida. O presente estudo tem como objetivo a construção do Teste de Raciocínio Abstrato e Espacial (TRAE) e a verificação das evidências de validade de estrutura interna. A amostra do estudo foi composta por 1.069 estudantes do ensino fundamental com idades entre 11 e 17 anos. Os parâmetros de discriminação (a) e dificuldade (b) dos itens, estimados por meio da TRI, apresentaram médias próximas de 1,00 e 0,70, respectivamente. A curva de informação sugere que o instrumento é mais preciso para avaliar os adolescentes com thetas entre 1 e 2. As análises fatoriais indicaram que o instrumento possui uma estrutura que permite a estimação de dois fatores específicos, bem como um fator geral associado à inteligência fluida. Em suma, os resultados indicam que o instrumento possui propriedades psicométricas adequadas.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Alves, I. C. B., Rosa, H. R., Silva, M. A., & Sardinha, L. S. (2016). Avaliação da inteligência: revisão de literatura de 2005 a 2014. Avaliação Psicológica: Interamerican Journal of Psychological Assessment, 15(2), 89–97. https://doi.org/10.15689/ap.2016.15ee.09.
Caemmerer, J. M., Keith, T. Z., & Reynolds, M. R. (2020). Beyond individual intelligence tests: Application of Cattell-Horn-Carroll theory. Intelligence, 79, 101433. https://doi.org/10.1016/j.intell.2020.101433.
Cardoso, M., Lopes, I. X., De Oliveira, C., & Braga, A. P. (2017). Análise da Produção Científica Brasileira sobre o Teste das Matrizes Progressivas de Raven. Psicologia: Ciência e Profissão, 37(1), 62–77. https://doi.org/10.1590/1982-3703000212015.
Carroll, J. B. (1993). Human cognitive abilities: A survey of factor-analytic studies. Cambridge: Cambridge University Press.
Cattell, R. B. (1943). The measurement of adult intelligence. Psychological Bulletin, 40(3), 153–193.
Cattell, R. B. (1963). Theory of fluid and crystallized intelligence: a critical experiment. Journal of Educational Psychology, 54(1), 1–22.
Cormier, D. C., Bulut, O., McGrew, K. S., & Frison, J. (2016). The role of Cattell-Horn-Carroll (CHC) cognitive abilities in predicting writing achievement during the school-age years. Psychology in the Schools, 53(8), 787–803. https://doi.org/10.1002/pits.21945.
Cormier, D. C., Bulut, O., McGrew, K. S., & Singh, D. (2017). Exploring the relations between Cattell–Horn–Carroll (CHC) cognitive abilities and mathematics achievement. Applied Cognitive Psychology, 31(5), 530–538. https://doi.org/10.1002/acp.3350.
Cronbach, L. J. (1996). Fundamentos da testagem psicológica (5th ed.). Porto Alegre: Artes Médicas.
de Ayala, R. J. (2009). The theory and practice of item response theory. New York: Guilford Press.
DeMars, C. E. (2018). Classical test theory and item response theory. In P. Irwing, T. Booth, & D. J. Hughes (Eds.), The Wiley handbook of psychometric testing (1st ed., pp. 49–74). New York: Wiley-Blackwell. https://doi.org/10.1002/9781118489772.ch18.
Dombrowski, S. C., Mcgill, R. J., & Canivez, G. L. (2018). An alternative conceptualization of the theoretical structure of the woodcock-Johnson IV tests of cognitive abilities at school age : a confirmatory factor analytic investigation. Archives of Scientific Psycholog, 6(1), 1–13. https://doi.org/10.1037/arc0000039.
Gignac, G. E., & Watkins, M. W. (2013). Bifactor modeling and the estimation of model-based reliability in the WAIS-IV. Multivariate Behavioral Research, 48(5), 639–662. https://doi.org/10.1080/00273171.2013.804398.
Gottfredson, L. S. (1997). Mainstream science on intelligence: an editorial with 52 signatories, history and bibliography. Intelligence, 24(1), 13–23. https://doi.org/10.1016/S0160-2896(97)90011-8.
Irwing, P., & Hughes, D. J. (2018). Test development. In P. Irwing, T. Booth, & D. J. Hughes (Eds.), The Wiley handbook of psychometric testing (1st ed., pp. 3–48). New York, NY: Wiley-Blackwell. https://doi.org/10.1002/9781118489772.ch18.
Kamata, A., & Bauer, D. J. (2008). A note on the relation between factor analytic and item response theory models. Structural Equation Modeling, 15(1), 136–153. https://doi.org/10.1080/10705510701758406.
Kamphaus, R. W., Winsor, A. P., Rowe, E. W., & Kim, S. (2018). A history of intelligence test interpretation. In D. P. Flanagan & E. M. McDonough (Eds.), Contemporary intellectual assessment (4th ed., pp. 56–72). New York: The Guilford Press.
Karino, C. A., Laros, J. A., & de Jesus, G. R. (2011). Evidências de validade convergente do SON-R 2½-7[a] com o WPPSI-III e WISC-III. Psicologia: Reflexão e Crítica, 24(4), 621–629. https://doi.org/10.1590/s0102-79722011000400001.
Kim, E. S., Yoon, M., & Lee, T. (2012). Testing measurement invariance using MIMIC: likelihood ratio test with a critical value adjustment. Educational and Psychological Measurement, 72(3), 469–492. https://doi.org/10.1177/0013164411427395.
Laros, J. A., Tellegen, P. J., Jesus, G. R., & Karino, C. A. (2015). SON-R 2½-7[a] Teste não-verbal de inteligência: Manual com normatização e validação brasileira. São Paulo: Casa do Psicólogo.
Mcgill, R. J., & Busse, R. T. (2015). Incremental validity of the WJ III COG : limited predictive effects beyond the GIA-E. School Psychology Quarterly, 30(3), 353–365. https://doi.org/10.1037/spq0000094.
McGill, R. J., & Dombrowski, S. C. (2019). Critically reflecting on the origins, evolution, and impact of the Cattell-Horn-Carroll (CHC) model. Applied Measurement in Education, 32(3), 216–231. https://doi.org/10.1080/08957347.2019.1619561.
McGrew, K. S., & Flanagan, D. P. (1998). The intelligence test desk reference (ITDR) - Gc-Gf cross battery assessment. Boston: Allyn and Bacon.
Niileksela, C. R., Reynolds, M. R., & Kaufman, A. S. (2013). An alternative Cattell-Horn-Carrol (CHC) factor structure of the WAIS-IV : age invariance of an alternative model for ages 70-90. Psychological Assessment, 25(2), 391–404. https://doi.org/10.1037/a0031175.
Ortiz, S. O. (2015). CHC theory of intelligence. In J. A. Naglieri & S. Goldstein (Eds.), Handbook of intelligence: evolutionary theory, historical perspective, and current concepts (pp. 209–228). New York: Springer. https://doi.org/10.1007/978-1-4939-1562-0_30.
Peng, P., Wang, T., Wang, C. C., & Lin, X. (2019). A meta-analysis on the relation between fluid intelligence and reading/mathematics: effects of tasks, age, and social economics status. Psychological Bulletin, 145(2), 189–236. https://doi.org/10.1037/bul0000182.
Pornprasertmanit, S., Lee, J., & Preacher, K. J. (2014). Ignoring clustering in confirmatory factor analysis: some consequences for model fit and standardized parameter estimates. Multivariate Behavioral Research, 49(6), 518–543. https://doi.org/10.1080/00273171.2014.933762.
Primi, R., & Almeida, L. S. (2000). Estudo de validaçäo da bateria de provas de raciocínio (BPR-5). Psicologia: Teoria e Pesquisa, 16(2), 165–173 Retrieved from http://www.scielo.br/pdf/ptp/v16n2/4379.pdf.
Primi, R., Couto, G., Almeida, L. S., Guisande, M. A., & Miguel, F. K. (2012). Intelligence, age and schooling: data from the Battery of Reasoning Tests (BRT-5). Psicologia: Reflexão e Crítica, 25(1), 79–88. https://doi.org/10.1590/S0102-79722012000100010.
Primi, R., Silva, M. C. R., Santana, P. R., Muniz, M., & Almeida, L. S. (2013). The use of the bi-factor model to test the uni-dimensionality of a battery of reasoning tests. Psicothema, 25, 115–122 Retrieved from https://www.redalyc.org/articulo.oa?id=72725690019.
Primi, R., Correia, T. A., & Almeida, L. S. (2018). Bateria de Provas de Raciocínio (BPR-5). In C. S. Hutz, D. R. Bandeira, & C. M. Trentini (Eds.), Avaliação psicológica da inteligência e da personalidade (1st ed., pp. 109–122). Porto Alegre, RS: Grupo A Educação.
Reise, S. P., Bonifay, W., & Haviland, M. G. (2018). Bifactor modelling and the evaluation of scale scores. In P. Irwing, T. Booth, & D. Hughes (Eds.), The Wiley handbook of psychometric testing (pp. 677–708). London: Wiley-Blackwell.
Richerson, L. P., Watkins, M. W., & Alexander Beaujean, A. (2014). Longitudinal invariance of the wechsler intelligence scale for children–fourth edition in a referral sample. Journal of Psychoeducational Assessment, 32(7), 597–609. https://doi.org/10.1177/0734282914538802.
Rueda, F. J. M., Santos, A. A. A., & Noronha, A. P. P. (2016). Evidencia de validez de constructo para el WISC-IV con muestra brasileña. Universitas Psychologica, 15(4), 1–10. https://doi.org/10.11144/Javeriana.upsy15-4.evcm.
Schneider, W. J., & McGrew, K. S. (2018). The Cattell–Horn–Carroll theory of cognitive abilities. In D. P. Flanagan & E. M. McDonough (Eds.), Contemporary intellectual assessment (4th ed., pp. 73–163). New York: Guilford Press.
Spearman, C. (1904). “General intelligence,” objectively determined and measured. The American Journal of Psychology, 15(2), 201–292. https://doi.org/10.2307/1412107.
Sprague, B. N., Hyun, J., & Molenaar, P. C. M. (2017). Revisiting measurement invariance in intelligence testing in aging research: evidence for almost complete metric invariance across age groups. Journal for Person-Oriented Research, 3(2), 86–100. https://doi.org/10.17505/jpor.2017.08.
Thompson, B. (2004). Exploratory and confirmatory factor analysis: Understanding concepts and applications. Washington: American Psychological Association.
Thurstone, L. L. (1938). Primary mental abilities. Chicago: University of Chicago Press.
Valentini, F., Gomes, C. M. A., Muniz, M., Mecca, T. P., Laros, J. A., & Andrade, J. M. (2015). Confiabilidade dos Índices Fatoriais da Wais-III Adaptada para a População Brasileira. Psicologia - Teoria e Prática, 17(2), 123–139. https://doi.org/10.15348/1980-6906/psicologia.v17n2p123-139.
van der Maas, H. L., Dolan, C. V., Grasman, R. P., Wicherts, J. M., Huizenga, H. M., & Raijmakers, M. E. (2006). A dynamical model of general intelligence: the positive manifold of intelligence by mutualism. Psychological Review, 113(4), 842–861. https://doi.org/10.1037/0033-295X.113.4.842.
van der Maas, H. L., Kan, K. J., & Borsboom, D. (2014). Intelligence is what the intelligence test measures. Seriously. Journal of Intelligence, 2(1), 12–15. https://doi.org/10.3390/jintelligence2010012.
Vargas, A. A. F. (2017). A informatização do Teste de Raciocínio Abstrato e Espacial (TRAE) (Master's thesis, University San Francisco, Campinas, Brazil). Retrieved from http://www.revista.universo.edu.br/index.php?journal=2013EAD1&page=article&op=viewArticle&path%5B%5D=7643. Accessed 1 July 2020.
Watkins, M. W., & Beaujean, A. A. (2014). Bifactor structure of the wechsler preschool and primary scale of intelligence-fourth edition. School Psychology Quarterly, 29(1), 52–63. https://doi.org/10.1037/spq0000038.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
The project was submitted to the Research Ethics Committee of the University of Brasilia and approved under case No. 03-06 / 2012. Participants signed the Informed Consent Form (TALE), and the institutions authorized data collection.
Rights and permissions
About this article
Cite this article
Valentini, F., Laros, J.A. & de Barros Mose, L. Validity Evidence of the Abstract and Spatial Reasoning Test. Trends in Psychol. 29, 139–154 (2021). https://doi.org/10.1007/s43076-020-00056-w
Published:
Issue Date:
DOI: https://doi.org/10.1007/s43076-020-00056-w