Abstract
The aim of this study was to identify support for convergent validity for the Test for Identification of Signs of Dyslexia (TISD). This validity is part of a great field named “evidence of validity based on relations with external criteria”. The support of validity studies for the TISD is still ongoing, and this research is a part of them. The total sample (N = 421) was composed of two groups: sample 1 (n = 371), aged between 6 and 16 years (M = 10.10, SD = 2.33); sample 2 (n = 50), aged between 6 and 10 years (M = 7.94, SD = 0.73). Participants in the two samples were evaluated using TISD and two different test protocols. Convergent validity of the TISD was investigated by comparing subtests of the TISD with already validated instruments, which are assumed to measure the same cognitive abilities, through the Pearson’s correlation and simple linear regression analysis. Pearson’s correlations obtained in the samples showed values between 0.22 (with small effect size, r2 = 0.04) and 0.71 (with large effect size, r2 = 0.50). Linear regression analysis revealed predictions of the TISD regarding the other instruments explaining between 8 and 51% of variance in these measures (with effect sizes between medium and large). These analyses corroborate the convergent validity of the TISD. Considering the prediction of its subtests regarding performance in the domains investigated, the TISD can comprise an important screening tool in the Brazilian context.
Resumen
El objetivo de este estudio fue identificar evidencia de validez convergente para la Prueba para la Identificación de Señales de Dislexia (TISD). Esta validez es parte del amplio campo de la “evidencia de validez basada en relaciones con criterios externos”. Los estudios de validez para TISD todavía están en progreso, este estudio es parte de ellos. La muestra total (N = 421) fue compuesta por: Muestra 1 (n = 371), entre seis y 16 años (M = 10,10, DP = 2,33); Muestra 2 (n = 50), de siete a 10 años (M = 7,94, SD = 0,73). Los participantes en las dos muestras fueron evaluados utilizando TISD y dos protocolos de prueba diferentes. La validez convergente de TISD se investigó correlacionando sus subpruebas con instrumentos ya validados, que evaluaban las mismas habilidades cognitivas, utilizando la Correlación de Pearson y la Regresión lineal simple. Las correlaciones de Pearson obtenidas se encontraron entre 0,22 (com pequeño tamaño del efecto, r2 = 0,04) y 0,71 (com gran tamaño, r2 = 0,50). El análisis de regresión lineal indicó predicciones del TISD para los otros instrumentos, explicando entre 8 a 51% de la varianza en estas medidas (con un tamaño de efecto entre medio y moderado). Estos análisis corroboran la validez convergente del TISD. Dada la predicción de sus subpruebas sobre los desempeños en los constructos investigados, el TISD puede configurarse como importante herramienta de detección en el contexto brasileiro.
Resumo
O objetivo deste estudo foi identificar evidências de validade convergente para o Teste para Identificação de Sinais de Dislexia (TISD). Essa validade faz parte do grande campo das “evidências de validade baseadas nas relações com critérios externos”. Estudos de validade para o TISD se encontram em andamento, esse estudo constitui parte deles. A amostra total (N = 421) foi composta por: Amostra 1 (n = 371), indivíduos entre seis e 16 anos (M = 10,10; DP = 2,33); Amostra 2 (n = 50), entre sete e 10 anos (M = 7,94; DP = 0,73). Participantes das duas amostras foram avaliados com o TISD e dois diferentes protocolos de testes. A validade convergente do TISD foi investigada correlacionando seus subtestes com instrumentos já validados, que avaliavam as mesmas habilidades cognitivas, por meio da Correlação de Pearson e da Regressão Linear Simples. As correlações de Pearson obtidas nas amostras demonstraram valores entre 0,22 (com pequeno tamanho do efeito, r2 = 0,04) e 0,71 (com grande tamanho do efeito, r2 = 0,50). A análise de regressão linear indicou predições significativas do TISD para os outros instrumentos, explicando entre 8 a 51% da variância nessas medidas (com tamanho de efeito entre médio e grande). Tais análises corroboram a validade convergente do TISD. Dada a predição de seus subtestes sobre os desempenhos nos domínios investigados, o TISD pode configurar-se como importante ferramenta de triagem no contexto nacional.
Similar content being viewed by others
References
Alves, M. N., Lima, R. F., Alves, R. J. R., Salgado-Azoni, C. A., Nakano, T. C., & Ciasca, S. M. (2013). Estudo piloto de validação do teste de identificação de sinais de dislexia (TISD). Estudos Interdisciplinares em Psicologia, 4(2), 217–239. https://doi.org/10.5433/2236-6407.2013v4n2p217.
Alves, R. J. R., Lima, R. F., Salgado-Azoni, C. A., Carvalho, M. C., & Ciasca, S. M. (2015). Teste para Identificação de Sinais de Dislexia: processo de construção. Estudos de Psicologia (Campinas), 32(3), 383–393. https://doi.org/10.1590/0103-166X2015000300004.
American Educational Research Association (AERA), American Psychological Association (APA), & National Council on Measurement in Education (NCME). (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
American Psychological Association (APA). (2013). Diagnostic and statistical manual of mental disorders: DSM-V. Washington, DC: American Psychiatric Association.
Athayde, M. L., Giacomoni, C. H., Zanon, C., & Stein, L. M. (2014). Evidências de validade do subteste de leitura do teste de desempenho escolar. Psicologia: teoria e prática, 16(2), 131–140. https://doi.org/10.15348/1980-6906/psicologia.v16n2p131-140.
Berninger, V. W., Abbott, R. D., Nagy, W., & Carlisle, J. (2010). Growth in phonological, orthographic, and morphological awareness in grades 1 to 6. Journal of Psycholinguistic Research, 39(2), 141–163. https://doi.org/10.1007/s10936-009-9130-6.
Bjornsdottir, G., Halldorsson, J. G., Steinberg, S., Hansdottir, I., Kristjansson, K., Stefansson, H., & Stefansson, K. (2014). The Adult Reading History Questionnaire (ARHQ) in Icelandic: Psychometric properties and factor structure. Journal of Learning Disabilities, 47, 532–542. https://doi.org/10.1177/0022219413478662.
Capovilla, F. C., & Seabra, A. G. (2012). Prova de Consciência Fonológica por escolha de Figuras. In: A. G. Seabra & N. M. Dias (Orgs.), Avaliação Neuropsicológica Cognitiva: Linguagem oral (pp. 132-165). São Paulo: Memnon.
Cavalli, E., Colé, P., Leloup, G., Poracchia-George, F., Sprenger-Charolles, L., & El Ahmadi, A. (2018). Screening for dyslexia in French-Speaking University students: An evaluation of the detection accuracy of the Alouette test. Journal of Learning Disabilities, 51(3), 268–282. https://doi.org/10.1177/0022219417704637.
Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2013). Applied multiple regression/correlation analysis for the behavioral sciences. Mahwah, New Jersey: Routledge.
Cronk, B. C. (2017). How to use SPSS®: A step-by-step guide to analysis and interpretation. New York, NY: Routledge.
Fawcett, A., Lee, R., & Nicolson, R. (2014). Sustained benefits of a multi-skill intervention for preschool children at risk of literacy difficulties. Asian Pacific Journal of Developmental differences, 1, 62–68. https://doi.org/10.3850/S2345734114000064.
Giacomoni, C. H., de Lima Athayde, M., Zanon, C., & Stein, L. M. (2015). Teste do Desempenho Escolar: evidências de validade do subteste de escrita. Psico-USF, 20(1), 133–140. https://doi.org/10.1590/1413-82712015200112.
Guzman-Orth, D., Grimm, R., Gerber, M., Orosco, M., Swanson, H. L., & Lussier, C. (2015). Psychometric properties of the working memory rating scale for Spanish-speaking English language learners. Journal of Psychoeducational Assessment, 33(6), 555–567. https://doi.org/10.1177/0734282914558710.
Hatta, T., Yoshizaki, K., Ito, Y., Mase, M., & Kabasawa, H. (2012). Reliability and validity of the digit cancellation test, a brief screen of attention. Psychologia, 55(4), 246–256. https://doi.org/10.2117/psysoc.2012.246.
Kaurani, P., & Marwah, N. (2020). Research methodology in dentistry. New Delhi, Delhi: Blue Rose Pu.
McGrath, L. M., Peterson, R. L., & Pennington, B. F. (2019). The multiple deficit model: Progress, problems, and prospects. Scientific Studies of Reading, 24(1), 7–13. https://doi.org/10.1080/10888438.2019.1706180.
Mertler, C. A., & Reinhart, R. V. (2016). Advanced and multivariate statistical methods: Practical application and interpretation. New York, NY: Routledge.
Moura, O., Simões, M. R., & Pereira, M. (2014). WISC-III cognitive profiles in children with developmental dyslexia: Specific cognitive disability and diagnostic utility. Dyslexia, 20(1), 19–37. https://doi.org/10.1002/dys.1468.
Norton, E. S., & Wolf, M. (2012). Rapid automatized naming (RAN) and reading fluency: Implications for understanding and treatment of reading disabilities. Annual Review of Psychology, 63, 427–452. https://doi.org/10.1146/annurev-psych-120710-100431.
Organização Mundial de Saúde (OMS). (1993). CID-10: Classificação de transtornos mentais e de comportamento: descrições clínicas e diretrizes diagnósticas. Porto Alegre: Artes Médicas.
Peng, P., Namkung, J., Barnes, M., & Sun, C. (2016). A meta-analysis of mathematics and working memory: Moderating effects of working memory domain, type of mathematics skill, and sample characteristics. Journal of Educational Psychology, 108(4), 455–473. https://doi.org/10.1037/edu0000079.
Pennington, B. F. (2006). From single to multiple deficit models of developmental disorders. Cognition, 101(2), 385–413. https://doi.org/10.1016/j.cognition.2006.04.008.
Pennington, B. F., Santerre-Lemmon, L., Rosenberg, J., MacDonald, B., Boada, R., Friend, A., Leopold, D. R., Samuelsson, S., Byrne, B., Willcutt, E. G., & Olson, R. K. (2012). Individual prediction of dyslexia by single versus multiple deficit models. Journal of Abnormal Psychology, 121(1), 212–224. https://doi.org/10.1037/a0025823.
Peterson, R. L., & Pennington, B. F. (2015). Developmental dyslexia. Annual Review of Clinical Psychology, 11, 283–307. https://doi.org/10.1146/annurev-clinpsy-032814-112842.
Pinto, L. P., & Noronha, A. P. P. (2015). Maturidade perceptomotora e sua relação com idade e variáveis contextuais: um estudo com o Bender (B-SPG). Encontro: Revista de Psicologia, 13(19), 145–155 Retrieved from: http://pgsskroton.com.br/seer/index.php/renc/article/download/2522/2413.
Roama-Alves, R. J., Pellisson, S., Nakano, T. C., Salgado-Azoni, C. A., Dias, T. L., & Ciasca, S. M. (2019). Test for identification of signs of dyslexia: Effects of developmental variables. Avaliação Psicológica, 18(3), 219–228. https://doi.org/10.15689/ap.2019.1803.15604.01.
Roebuck-Spencer, T. M., Glen, T., Puente, A. E., Denney, R. L., Ruff, R. M., Hostetter, G., & Bianchini, K. J. (2017). Cognitive screening tests versus comprehensive neuropsychological test batteries: A national academy of neuropsychology education paper. Archives of Clinical Neuropsychology, 32(4), 491–498. https://doi.org/10.1093/arclin/acx021.
Rueda, F. J. M., Noronha, A. P. P., Sisto, F. F., Santos, A. A. A., & Castro, N. R. (2013). WISC-IV: Escala Wechsler de Inteligência para crianças. São Paulo: Casa do Psicólogo.
Seabra, A. G., & Capovilla, F. C. (2012). Prova de consciência fonológica por produção oral. In A. Seabra & N. Dias (Orgs.), Avaliação neuropsicológica cognitiva: linguagem oral (pp.117-122). São Paulo: Memnon.
Seabra, A. G., & Dias, N. M. (2012). Avaliação neuropsicológica cognitiva: linguagem oral. São Paulo: Memnon.
Silva, P. B., Mecca, T. P., & Macedo, E. C. (2018). Teste de Nomeação Automática. São Paulo: Hogrefe.
Sisto, F. S., Noronha, A. P. P., & Santos, A. A. A. (2005). Teste Gestáltico Visomotor de Bender: Sistema de Pontuação Gradual (B-SPG) - manual. São Paulo: Vetor.
Sobreira, E., Pena-Pereira, M. A., Eckeli, A. L., Sobreira-Neto, M. A., Chagas, M. H., Foss, M. P., Cholerton, B., Zabetian, C. P., Mata, I. F., & Tumas, V. (2015). Screening of cognitive impairment in patients with Parkinson's disease: Diagnostic validity of the Brazilian versions of the Montreal cognitive assessment and the Addenbrooke's cognitive examination-revised. Arquivos de Neuro-Psiquiatria, 73(11), 929–933. https://doi.org/10.1590/0004-282X20150156.
Stein, L. M. (1994). Teste de desempenho escolar. São Paulo: Casa do Psicólogo.
Stein, J. (2019). The current status of the magnocellular theory of developmental dyslexia. Neuropsychologia, 130, 66–77. https://doi.org/10.1016/j.neuropsychologia.2018.03.022.
Wolf, M., & Denckla, M. B. (2005). RAN/RAS: The rapid automatized naming and rapid alternating stimulus tests. Austin: Pro-ed.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
This study was approved by the Research Ethics Committee of the Institute of Human and Social Sciences of the Federal University of Rondonópolis, in agreement with the Resolution of the National Health Council No. 510, of April 7, 2016 (CAAE of the Plataforma Brasil: 63121916.4.0000.8088). All parents/guardians consented to the participation of their children, and the children aged 10 participated in the study voluntarily. The composition and use of the database of the “Neuro-Learning Difficulties Outpatient Clinic” was approved by the Research Ethics Committee of the State University of Campinas (Authorization No. 946/2011).
Rights and permissions
About this article
Cite this article
Roama-Alves, R.J., de Souza Oliveira, S., Dias, N.M. et al. Test for Identification of Signs of Dyslexia: Convergent Validity. Trends in Psychol. 28, 585–602 (2020). https://doi.org/10.1007/s43076-020-00038-y
Published:
Issue Date:
DOI: https://doi.org/10.1007/s43076-020-00038-y