Abstract
The objective of this study was to validate the NIH Toolbox Cognition Battery (NIHTB-CB) in Zambian children with and without HIV-infection. Children living with HIV and HIV-exposed, uninfected (HEU) children completed traditional neuropsychological and NIHTB-CB tasks. Using pairwise correlation and a linear regression model we measured associations between traditional measure composite scores and parental ratings of children’s abilities, and NIHTB-CB scores. A Receiver Operating Characteristic (ROC) curve was developed to identify participants with impairment. 389 children, 8–17 years old participated. NIHTB-CB and traditional measures converged well as a whole and when comparing analogous individual tests across the two batteries. The NIHTB-CB composite score discriminated between the groups and was positively associated with external criteria for cognitive function: parental ratings of intelligence and school performance. Some English vocabulary and/or an unfamiliar cultural context presented challenges. NIHTB-CB was associated with children’s everyday cognitive abilities, though future use may require linguistic and cultural adaptation.
Similar content being viewed by others
Availability of data and material
The data that support the findings of this study are available on reasonable request from the corresponding author. The data are not publicly available due to privacy or ethical restrictions.
Code availability
Not Applicable
Change history
25 May 2022
A Correction to this paper has been published: https://doi.org/10.1007/s10461-022-03699-1
References
Boivin MJ, Barlow-Mosha L, Chernoff MC, et al. Neuropsychological performance in African children with HIV enrolled in a multisite antiretroviral clinical trial. AIDS. 2018;32(2):189–204.
Burkey MD, Murray SM, Bangirana P, et al. Executive function and attention-deficit/hyperactivity disorder in Ugandan children with perinatal HIV exposure. Glob Ment Health. 2015;2:e4.
Debeaudrap P, Bodeau-Livinec F, Pasquier E, et al. Neurodevelopmental outcomes in HIV-infected and uninfected African children. AIDS. 2018;32(18):2749–57.
Milligan R, Cockcroft K. Working memory profiles in HIV-exposed, uninfected and HIV-infected children: A comparison with neurotypical controls. Front Hum Neurosci. 2017;11(348):1–13.
Phillips N, Amos T, Kuo C, et al. HIV-associated cognitive impairment in perinatally infected children: a meta-analysis. Pediatrics. 2016;138(5):e20160893.
Hoare J, Myer L, Heany S, et al. Cognition, structural brain changes, and systemic inflammation in adolescents living with HIV on antiretroviral therapy. J Acq Immun Def Synd. 2020;84(1):114–21.
Hermetet-Lindsay KD, Correia KF, Williams PL, et al. Contributions of disease severity, psychosocial factors, and cognition to behavioral functioning in US youth perinatally exposed to HIV. AIDS Behav. 2017;21(9):2703–15.
Struyf T, Dube Q, Cromwell EA, Sheahan AD, Heyderman RS, Van Rie A. The effect of HIV infection and exposure on cognitive development in the first two years of life in Malawi. Eur J Paediatr Neuro. 2020;25:157–64.
UNAIDS. HIV, Estimates AIDS. Country factsheets ZAMBIA 2019. Available at: http://www.unaids.org/en/regionscountries/countries/zambia. Accession date March 3, 2022.
Avert HIV. and AIDS in Zambia (2018). Available at: https://www.avert.org/professionals/hiv-around-world/sub-saharan-africa/zambia 2021. Accession date March 3, 2022.
World Population Review. Zambia Population 2020 Available at: https://worldpopulationreview.com/countries/zambia-population. Accession date March 3, 2022.
Boivin MJ, Green SD, Davies AG, Giordani B, Mokili JK, Cutting WA. A preliminary evaluation of the cognitive and motor effects of pediatric HIV infection in Zairian children. Health Psychol. 1995;14(1):13–21.
Brahmbhatt H, Boivin M, Ssempijja V, et al. Impact of HIV and antiretroviral therapy on neurocognitive outcomes among school-age children. J Acq Immun Def Synd. 2017;75(1):1–8.
Ruisenor-Escudero H, Sikorskii A, Familiar-Lopez I, et al. Neurodevelopmental outcomes in preschool children living with HIV-1 subtypes A and D in Uganda. Pediatr Infect Dis J. 2018;37(12):e298–303.
Phillips NJ, Hoare J, Stein DJ, Myer L, Zar HJ, Thomas KGF. HIV-associated cognitive disorders in perinatally infected children and adolescents: a novel composite cognitive domains score. AIDS Care. 2018;30(sup1):8–16.
Kaufman A, Kaufman N. Kaufman Assessment Battery for Children: Administration and scoring manual. Circle Pines: American Guidance Services Inc.; 1983.
Kaufman A, Kaufman N. Manual for the Kaufman assessment battery for children, 2nd edition. Circle Pines, MN: American Guidance Service Publishing/Pearson Products; 2004.
Bracken B, McCallum R. Universal Nonverbal Intelligence Test. Itasca: Riverside; 1998.
Bracken B, McCallum R. Universal Nonverbal Intelligence Test, Second edition. Austin, TX: PRO-ED; 2016.
Weintraub S, Bauer PJ, Zelazo PD, et al. I. NIH Toolbox Cognition Battery (CB): introduction and pediatric data. Monogr Soc Res Child. 2013;78(4):1–15.
Weintraub S, Dikmen SS, Heaton RK, et al. Cognition assessment using the NIH Toolbox. Neurology. 2013;80(11 Suppl 3):54–64.
Adams H, Mwanza-Kabaghe S, Mbewe E, et al. The HIV-Associated Neurocognitive Disorders in Zambia (HANDZ) study: protocol of a research program in pediatric HIV in sub-Saharan Africa. J HIV/AIDS Infect Dis. 2019;5:1–18.
Dean O, Buda A, Adams HR, et al. Brain magnetic resonance imaging findings associated with cognitive impairment in children and adolescents with human immunodeficiency virus in Zambia. Pediatr Neurol. 2020;102:28–35.
Buda A, Dean O, Adams HR, et al. Neurocysticercosis among Zambian children and adolescents with human immunodeficiency virus: A geographic information systems approach. Pediatr Neurol. 2020;102:36–43.
Schneider CL, Mohajeri-Moghaddam S, Mbewe EG, et al. Cerebrovascular disease in children perinatally infected with human immunodeficiency virus in Zambia. Pediatr Neurol. 2020;112:14–21.
Blackstone K, Moore DJ, Franklin DR, et al. Defining neurocognitive impairment in HIV: deficit scores versus clinical ratings. Clin Neuropsychol. 2012;26(6):894–908.
Mbewe E, Kabundula P, Mwanza-Kabaghe S, et al. Socioeconomic status and cognitive function in children with HIV: Evidence from the HIV-Associated Neurocognitive Disorders in Zambia (HANDZ) Study. J Acq Immun Def Synd. 2022;89(1):56–63.
DeVon HA, Block ME, Moyle-Wright P, et al. A psychometric toolbox for testing validity and reliability. J Nurs Scholarship. 2007;39(2):155–64.
Franzen M. Reliability and validity in neuropsychological assessment. Second ed. New York: Kluwer Academic/Plenum Publishers; 2000.
Boivin MJ, Chernoff M, Fairlie L, et al. African Multi-Site 2-Year Neuropsychological study of school-age children perinatally infected, exposed, and unexposed to human immunodeficiency virus. Clin Infect Dis. 2020;71(7):e105–14.
Laughton B, Cornell M, Boivin M, Van Rie A. Neurodevelopment in perinatally HIV-infected children: a concern for adolescence. J Int AIDS Soc. 2013;16:18603.
Oluwatayo J. Validity and reliability issues in educational research. JESR. 2012;2:391–400.
Bauer PJ, Zelazo PD. IX. NIH Toolbox Cognition Battery (CB): summary, conclusions, and implications for cognitive development. Monogr Soc Res Child. 2013;78(4):133–46.
Gershon RC, Cella D, Fox NA, Havlik RJ, Hendrie HC, Wagster MV. Assessment of neurological and behavioural function: the NIH Toolbox. Lancet Neurol. 2010;9(2):138–9.
Gershon RC, Wagster MV, Hendrie HC, Fox NA, Cook KF, Nowinski CJ. NIH Toolbox for assessment of neurological and behavioral function. Neurology. 2013;80(11 Suppl 3):2–6.
Ziemnik R, Suchy Y. Ecological validity of performance-based measures of executive functions: is face validity necessary for prediction of daily functioning? Psychol Assess. 2019;31:1307–18.
Mwanza-Kabaghe S. Preschool, executive functioning and oral language as predictors of literacy and numeracy in the first grade. University of Zambia; 2015.
Mwanza-Kabaghe S, Mubanga E, Matafwali B, Kasonde-Ngandu S, Bus A. Zambia preschools: a boost for early literacy? Engl Linguist Res. 2015;4(4) doi:https://doi.org/10.5430/elr.v4n4p1 URL: http://dx.doi.org/10.5430/elr.v4n4p1.
McKown S, Acquadro C, Arnold B, et al. Good practices for the translation, cultural adaptation, and linguistic validation of clinician-reported outcome, observer-reported outcome, and performance outcome measures. J Patient-Rep Outcomes. 2020;89:1–8.
Watts AD, Shuttleworth-Edwards AB. Neuropsychology in South Africa: confronting the challenges of specialist practice in a culturally diverse developing country. Clin Neuropsychol. 2016;30(8):1305–24.
Puente A, Agranovich AV. The cultural in cross-cultural neuropsychology. In: Goldstein G, Beers SR, Hersen M, editors. Comprehensive Handbook of Psychological Assessment. 1: Intellectual and Neuropsychological Assessment. John Wiley & Sons, Inc.; 2013:321–32.
Matafwali B, Serpell R. Design and validation of assessment tests for young children in Zambia. New Dir Child Adoles. 2014;2014(146):77–96.
Zuilkowski S, McCoy D, Serpell R, Matafwali B, Fink G. Dimensionality and the development of cognitive assessments for children in sub-Saharan Africa. J Cross Cult Psychol. 2016;47(3):341–54.
Hodes RJ, Insel TR, Landis SC. The NIH toolbox: setting a standard for biomedical research. Neurology. 2013;80(11 Suppl 3):1.
Acknowledgements
We gratefully acknowledge the children and their parents who participated in this research.
Funding
Funding for this research was provided by: National Institute of Neurological Disorders and Stroke/National Institutes of Health K23NS117310; University of Rochester Center for AIDS Research (CFAR) NIH/P30 AI 045008); University of Rochester School of Medicine and Dentistry; William G. McGowan Charitable Fund
Author information
Authors and Affiliations
Contributions
All authors whose names appear on the submission
1) made substantial contributions to the conception or design of the work; or the acquisition, analysis, or interpretation of data; or the creation of new software used in the work;
2) drafted the work or revised it critically for important intellectual content;
3) approved the version to be published; and
4) agree to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.
Corresponding author
Ethics declarations
Conflicts of interest/competing interests
There are no relevant conflicts of interest to disclose for any authors related to this work.
Ethics approval
This study was approved by the Institutional Review Boards of the University of Rochester (UR; protocol #00068985), the University of Zambia (UNZA; reference #004-08-17), and the National Health Research Authority of Zambia.
Consent to participate
In accordance with IRB requirements of UR and UNZA, parental permission, assent, and/or informed consent was obtained as appropriate according to the age of the participants. Participants received 100 Zambian Kwacha (equivalent to approximately 6 US dollars) per study visit as reimbursement for travel costs.
Consent for publication
Not Applicable
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
The original online version of this article was revised.
Rights and permissions
About this article
Cite this article
Kabundula, P.P., Mbewe, E.G., Mwanza-Kabaghe, S. et al. Validation of the National Institute of Health Toolbox Cognition Battery (NIHTB-CB) in Children and Adolescents with and without HIV Infection in Lusaka, Zambia. AIDS Behav 26, 3436–3449 (2022). https://doi.org/10.1007/s10461-022-03669-7
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10461-022-03669-7