Abstract
Cognitive reserve explains the differences in the susceptibility to cognitive impairment related to brain aging, pathology, or insult. Given that cognitive reserve has important implications for the cognitive health of typically and pathologically aging older adults, research needs to identify valid and reliable instruments for measuring cognitive reserve. However, the measurement properties of current cognitive reserve instruments used in older adults have not been evaluated according to the most up-to-date COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN). This systematic review aimed to critically appraise, compare, and summarize the quality of the measurement properties of all existing cognitive reserve instruments for older adults. A systematic literature search was performed to identify relevant studies published up to December 2021, which was conducted by three of four researchers using 13 electronic databases and snowballing method. The COSMIN was used to assess the methodological quality of the studies and the quality of measurement properties. Out of the 11,338 retrieved studies, only seven studies that concerned five instruments were eventually included. The methodological quality of one-fourth of the included studies was doubtful and three-seventh was very good, while only four measurement properties from two instruments were supported by high-quality evidence. Overall, current studies and evidence for selecting cognitive reserve instruments suitable for older adults were insufficient. All included instruments have the potential to be recommended, while none of the identified cognitive reserve instruments for older adults appears to be generally superior to the others. Therefore, further studies are recommended to validate the measurement properties of existing cognitive reserve instruments for older adults, especially the content validity as guided by COSMIN.
Systematic Review Registration numbers: CRD42022309399 (PROSPERO).
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data Availability
All data generated or analyzed during this study are included in this published article and its supplementary files.
References
Aguirre-Acevedo, D. C., Lopera, F., Henao, E., Tirado, V., Muñoz, C., Giraldo, M., et al. (2016). Cognitive decline in a Colombian kindred with autosomal dominant Alzheimer disease. JAMA Neurology, 73(4), 431. https://doi.org/10.1001/jamaneurol.2015.4851
Almeida-Meza, P., Steptoe, A., & Cadar, D. (2021). Markers of cognitive reserve and dementia incidence in the English Longitudinal Study of Ageing. British Journal of Psychiatry, 218(5), 243–251. https://doi.org/10.1192/bjp.2020.54
Altieri, M., Siciliano, M., Pappacena, S., Roldán-Tapia, M. D., Trojano, L., & Santangelo, G. (2018). Psychometric properties of the italian version of the Cognitive Reserve Scale (I-CRS). Neurological Sciences: Official Journal of the Italian Neurological Society and of the Italian Society of Clinical Neurophysiology, 39(8), 1383–1390. https://doi.org/10.1007/s10072-018-3432-0
Amoretti, S., Cabrera, B., Torrent, C., Bonnín, C. M., Mezquida, G., Garriga, M., et al. (2019). Cognitive Reserve Assessment Scale in Health (CRASH): Its validity and reliability. Journal of Clinical Medicine, 8(5), 586. https://doi.org/10.3390/jcm8050586
Apolinario, D., Brucki, S. M. D., Ferretti, R. E., de Farfel, L., Magaldi, J. M., Busse, R. M., & Jacob-Filho, W. (2013). Estimating premorbid cognitive abilities in low-educated populations. PLoS One, 8(3), e60084. https://doi.org/10.1371/journal.pone.0060084
Arenaza-Urquijo, E. M., & Vemuri, P. (2018). Resistance vs resilience to Alzheimer disease: Clarifying terminology for preclinical studies. Neurology, 90(15), 695–703. https://doi.org/10.1212/WNL.0000000000005303
Arenaza-Urquijo, E. M., & Vemuri, P. (2020, April 14). Improving the resistance and resilience framework for aging and dementia studies. Alzheimer’s Research and Therapy. BioMed Central Ltd. https://doi.org/10.1186/s13195-020-00609-2
Bennett, D. A., Schneider, J. A., Arvanitakis, Z., Kelly, J. F., Aggarwal, N. T., Shah, R. C., & Wilson, R. S. (2006). Neuropathology of older persons without cognitive impairment from two community-based studies. Neurology, 66(12), 1837–1844. https://doi.org/10.1212/01.wnl.0000219668.47116.e6
Bessi, V., Mazzeo, S., Padiglioni, S., Piccini, C., Nacmias, B., Sorbi, S., & Bracco, L. (2018). From subjective cognitive decline to Alzheimer’s disease: The predictive role of neuropsychological assessment, personality traits, and cognitive reserve. A 7-year follow-up study. Journal of Alzheimer’s Disease, 63(4), 1523–1535. https://doi.org/10.3233/JAD-171180
Bocancea, D. I., van Loenhoud, A. C., Groot, C., Barkhof, F., van der Flier, W. M., & Ossenkoppele, R. (2021). Measuring resilience and resistance in aging and Alzheimer Disease using residual methods: A systematic review and Meta-analysis. Neurology, 97(10), 474–488. https://doi.org/10.1212/WNL.0000000000012499
Boyle, R., Knight, S. P., De Looze, C., Carey, D., Scarlett, S., Stern, Y., et al. (2021). Verbal intelligence is a more robust cross-sectional measure of cognitive reserve than level of education in healthy older adults. Alzheimer’s Research & Therapy, 13(1), 128. https://doi.org/10.1186/s13195-021-00870-z
Çebi, M., & Kulce, S. N. (2021). The Turkish translation study of the Cognitive Reserve Index Questionnaire (CRIq). Applied Neuropsychology: Adult. https://doi.org/10.1080/23279095.2021.1896519
Choi, C. H., Park, S., Park, H. J., Cho, Y., Sohn, B. K., & Lee, J. Y. (2016). Study on Cognitive Reserve in Korea using Korean Version of Cognitive Reserve Index Questionnaire. Journal of Korean Neuropsychiatric Association, 55(3), 256. https://doi.org/10.4306/jknpa.2016.55.3.256
Coltman, T., Devinney, T. M., Midgley, D. F., & Venaik, S. (2008). Formative versus reflective measurement models: Two applications of formative measurement. Journal of Business Research, 61(12), 1250–1262. https://doi.org/10.1016/j.jbusres.2008.01.013
De Vet, H. C. W., Terwee, C. B., Mokkink, L. B., & Knol, D. L. (2011). Measurement in medicine: A practical guide. Cambridge University Press.
Foley, J. M., Ettenhofer, M. L., Kim, M. S., Behdin, N., Castellon, S. A., & Hinkin, C. H. (2012). Cognitive reserve as a protective factor in older HIV-positive patients at risk for cognitive decline. Applied Neuropsychology Adult, 19(1), 16–25. https://doi.org/10.1080/09084282.2011.595601
Garba, A. E., Grossberg, G. T., Enard, K. R., Jano, F. J., Roberts, E. N., Marx, C. A., & Buchanan, P. M. (2020). Testing the Cognitive Reserve Index questionnaire in an Alzheimer’s disease population. Journal of Alzheimer’s Disease Reports, 4(1), 513–524. https://doi.org/10.3233/adr-200244
Gonzales, C. (2012). The psychometric properties of the lifetime experience questionnaire (LEQ) in older American adults. ProQuest Dissertations and Theses. The University of North Carolina at Greensboro. Retrieved January 10, 2022, from https://www.proquest.com/dissertations-theses/psychometric-properties-lifetime-experience/docview/1022181255/se-2?accountid=205795
Griffiths, C., Armstrong-James, L., White, P., Rumsey, N., Pleat, J., & Harcourt, D. (2015). A systematic review of patient reported outcome measures (PROMs) used in child and adolescent burn research. Burns: Journal of the International Society for Burn Injuries, 41(2), 212–224. https://doi.org/10.1016/j.burns.2014.07.018
Han, S., Hu, Y., Pei, Y., Zhu, Z., Qi, X., & Wu, B. (2021). Sleep satisfaction and cognitive complaints in chinese middle-aged and older persons living with HIV: The mediating role of anxiety and fatigue. AIDS Care - Psychological and Socio-Medical Aspects of AIDS/HIV, 33(7), 929–937. https://doi.org/10.1080/09540121.2020.1844861
Jarvis, C. B., MacKenzie, S. B., & Podsakoff, P. M. (2003). A critical review of construct indicators and measurement model misspecification in marketing and consumer research. Journal of Consumer Research, 30(2), 199–218. https://doi.org/10.1086/376806
Jones, R. N., Manly, J., Glymour, M. M., Rentz, D. M., Jefferson, A. L., & Stern, Y. (2011). Conceptual and Measurement Challenges in Research on Cognitive Reserve. Journal of the International Neuropsychological Society, 17(4), 593–601. https://doi.org/10.1017/S1355617710001748
Kartschmit, N., Mikolajczyk, R., Schubert, T., & Lacruz, M. E. (2019). Measuring cognitive reserve (CR) – a systematic review of measurement properties of CR questionnaires for the adult population. PLoS One, 14(8), 1–23. https://doi.org/10.1371/journal.pone.0219851
Kaur, N., Fellows, L. K., Brouillette, M. J., & Mayo, N. (2021). Development and validation of a cognitive reserve index in HIV. Journal of the International Neuropsychological Society, (2021), 1–9. https://doi.org/10.1017/S1355617721000461
Landenberger, T., Cardoso, N. O., de Oliveira, C. R., & de Argimon, I. I. L (2019). Instruments for measuring cognitive reserve: A systematic review. Psicologia - Teoria e Prática, 21(2). https://doi.org/10.5935/1980-6906/psicologia.v21n2p58-74
Lee, J., Lee, E. H., Chae, D., & Kim, C. J. (2020). Patient-reported outcome measures for diabetes self-care: A systematic review of measurement properties. International Journal of Nursing Studies, 105, 103498. https://doi.org/10.1016/j.ijnurstu.2019.103498
Leoń, I., Garciá-García, J., & Roldań-Tapia, L. (2014). Estimating cognitive reserve in healthy adults using the cognitive reserve scale. PLoS One, 9(7), e102632. https://doi.org/10.1371/journal.pone.0102632
León, I., García, J., & Roldán-Tapia, L. (2011). Development of the scale of cognitive reserve in spanish population: A pilot study. Revista de Neurologia, 52(11), 653–660. https://doi.org/10.33588/rn.5211.2010704
Leon-Estrada, I., Garcia-Garcia, J., & Roldan-Tapia, L. (2017). [Cognitive Reserve Scale: Testing the theoretical model and norms]. Revista De Neurologia, 64(1), 7–16.
Li, X., Song, R., Qi, X., Xu, H., Yang, W., Kivipelto, M., et al. (2021). Influence of cognitive reserve on cognitive trajectories: Role of brain pathologies. Neurology, 97(17), e1695–e1706. https://doi.org/10.1212/WNL.0000000000012728
Maiovis, P., Ioannidis, P., Nucci, M., Gotzamani-Psarrakou, A., & Karacostas, D. (2016). Adaptation of the Cognitive Reserve Index Questionnaire (CRIq) for the greek population. Neurological Sciences, 37(4), 633–636. https://doi.org/10.1007/s10072-015-2457-x
Minogue, C., Delbaere, K., Radford, K., Broe, T., Forder, W. S., & Lah, S. (2018). Development and initial validation of the Retrospective Indigenous Childhood Enrichment scale (RICE). International Psychogeriatrics, 30(4), 519–526. https://doi.org/10.1017/S104161021700179X
Mokkink, L. B., Terwee, C. B., Knol, D. L., Stratford, P. W., Alonso, J., Patrick, D. L., et al. (2010). The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: A clarification of its content. BMC Medical Research Methodology, 10(1), 22. https://doi.org/10.1186/1471-2288-10-22
Mokkink, L. B., Terwee, C. B., Patrick, D. L., Alonso, J., Stratford, P. W., Knol, D. L., et al. (2010). The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. Journal of Clinical Epidemiology, 63(7), 737–745. https://doi.org/10.1016/j.jclinepi.2010.02.006
Mokkink, L. B., de Vet, H. C. W., Prinsen, C. A. C., Patrick, D. L., Alonso, J., Bouter, L. M., & Terwee, C. B. (2018). COSMIN Risk of Bias checklist for systematic reviews of patient-reported outcome measures. Quality of Life Research, 27(5), 1171–1179. https://doi.org/10.1007/s11136-017-1765-4
Mokkink, L. B., Prinsen, C. A. C., Patrick, D. L., Alonso, J., Bouter, L. M., de Vet, H. C. W., & Terwee, C. B. (2019). COSMIN study design checklist for patient-reported outcome measurement instruments. www.cosmin.nl. Accessed 17 Apr 2022
Morris, J. C., Storandt, M., McKeel, D. W., Rubin, E. H., Price, J. L., Grant, E. A., & Berg, L. (1996). Cerebral amyloid deposition and diffuse plaques in “normal” aging: Evidence for presymptomatic and very mild Alzheimer’s disease. Neurology, 46(3), 707–719. https://doi.org/10.1212/WNL.46.3.707
Negash, S., Wilson, R., Leurgans, S., Wolk, D., Schneider, J., Buchman, A., et al. (2013). Resilient brain aging: Characterization of discordance between Alzheimer’s disease pathology and cognition. Current Alzheimer Research, 10(8), 844–851. https://doi.org/10.2174/15672050113109990157
Nelson, M. E., Jester, D. J., Petkus, A. J., & Andel, R. (2021). Cognitive reserve, Alzheimer’s neuropathology, and risk of dementia: A systematic review and meta-analysis. Neuropsychology Review, 31(2), 233–250. https://doi.org/10.1007/s11065-021-09478-4
Nogueira, J., Gerardo, B., Santana, I., Simões, M. R., & Freitas, S. (2022). The assessment of cognitive reserve: a systematic review of the most used quantitative measurement methods of cognitive reserve for aging. Frontiers in Psychology, 13(March), 1–9. https://doi.org/10.3389/fpsyg.2022.847186
Nucci, M., Mapelli, D., & Mondini, S. (2012). Cognitive Reserve Index questionnaire (CRIq): A new instrument for measuring cognitive reserve. Aging Clinical and Experimental Research, 24(3), 218–226. https://doi.org/10.3275/7800
Opdebeeck, C., Martyr, A., & Clare, L. (2016). Cognitive reserve and cognitive function in healthy older people: A meta-analysis. Neuropsychology Development and Cognition Section B Aging Neuropsychology and Cognition, 23(1), 40–60. https://doi.org/10.1080/13825585.2015.1041450
Ourry, V., Marchant, N. L., Schild, A. K., Coll-Padros, N., Klimecki, O. M., Krolak-Salmon, P., et al. (2021). Harmonisation and between-country differences of the lifetime of Experiences Questionnaire in older adults. Frontiers in Aging Neuroscience, 13(October), 1–12. https://doi.org/10.3389/fnagi.2021.740005
Ozakbas, S., Yigit, P., Akyuz, Z., Sagici, O., Abasiyanik, Z., Ozdogar, A. T. (2021). Validity and reliability of “Cognitive Reserve Index Questionnaire” for the Turkish Population. Multiple Sclerosis and Related Disorders, 50(June 2020). https://doi.org/10.1016/j.msard.2021.102817
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., et al. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ, 372, n71. https://doi.org/10.1136/bmj.n71
Paplikar, A., Ballal, D., Varghese, F., Sireesha, J., Dwivedi, R., Rajan, A., et al. (2020). Assessment of lifestyle experiences across lifespan and cognitive ageing in the Indian context. Psychology and Developing Societies, 32(2), 308–330. https://doi.org/10.1177/0971333620937512
Patterson, C. (2018). World Alzheimer report 2018 - The state of the art of dementia research: New frontiers. Alzheimer’s Disease International.
Prinsen, C. A. C., Mokkink, L. B., Bouter, L. M., Alonso, J., Patrick, D. L., de Vet, H. C. W., & Terwee, C. B. (2018). COSMIN guideline for systematic reviews of patient-reported outcome measures. Quality of Life Research, 27(5), 1147–1157. https://doi.org/10.1007/s11136-018-1798-3
Rami, L., Valls-Pedret, C., Bartrés-Faz, D., Caprile, C., Solé-Padullés, C., Castellví, M., et al. (2011). Cognitive reserve questionnaire. Scores obtained in a healthy elderly population and in one with Alzheimer’s disease. Revista de Neurologia, 52(4), 195–201. https://doi.org/10.33588/rn.5204.2010478
Relander, K., Mäki, K., Soinne, L., García-García, J., & Hietanen, M. (2021). Active lifestyle as a reflection of cognitive reserve: The modified Cognitive Reserve Scale. Nordic Psychology, 73(3), 242–252. https://doi.org/10.1080/19012276.2021.1902846
Sajeev, G., Weuve, J., Jackson, J. W., VanderWeele, T. J., Bennett, D. A., Grodstein, F., & Blacker, D. (2016). Late-life cognitive activity and dementia: A systematic review and bias analysis. Epidemiology (Cambridge, Mass.), 27(5), 732–742. https://doi.org/10.1097/EDE.0000000000000513
Sardella, A., Quattropani, M. C., & Basile, G. (2021). Can cognitive reserve protect frail individuals from dementia? The Lancet Healthy Longevity, 2(2), e67. https://doi.org/10.1016/S2666-7568(20)30070-2
Schünemann, H., Brożek, J., Guyatt, G., & Oxman, A. (2013). GRADE Handbook - Introduction to GRADE Handbook: Handbook for grading the quality of evidence and the strength of recommendations using the GRADE approach. Updated October 2013. The GRADE Working Group. https://gdt.gradepro.org/app/handbook/handbook.html. Accessed 4 May 2022
Soldan, A., Pettigrew, C., Cai, Q., Wang, J., Wang, M., Moghekar, A., et al. (2017). Cognitive reserve and long-term change in cognition in aging and preclinical Alzheimer’s disease. Neurobiology of Aging, 60, 164–172. https://doi.org/10.1016/j.neurobiolaging.2017.09.002
Stern, Y., Arenaza-Urquijo, E. M., Bartrés-Faz, D., Belleville, S., Cantilon, M., Chetelat, G., et al. (2020). Whitepaper: Defining and investigating cognitive reserve, brain reserve, and brain maintenance. Alzheimer’s and Dementia. https://doi.org/10.1016/j.jalz.2018.07.219
Sumowski, J. F., Rocca, M. A., Leavitt, V. M., Dackovic, J., Mesaros, S., Drulovic, J., et al. (2014). Brain reserve and cognitive reserve protect against cognitive decline over 4.5 years in MS. Neurology, 82(20), 1776–1783. https://doi.org/10.1212/WNL.0000000000000433
Terwee, C. B., Jansma, E. P., Riphagen, I. I., & De Vet, H. C. W. (2009). Development of a methodological PubMed search filter for finding studies on measurement properties of measurement instruments. Quality of Life Research, 18(8), 1115–1123. https://doi.org/10.1007/s11136-009-9528-5
Terwee, C. B., Prinsen, C. A. C., Chiarotto, A., Westerman, M. J., Patrick, D. L., Alonso, J., et al. (2018). COSMIN methodology for evaluating the content validity of patient-reported outcome measures: A Delphi study. Quality of Life Research, 27(5), 1159–1170. https://doi.org/10.1007/s11136-018-1829-0
Valenzuela, M. J., & Sachdev, P. (2007). Assessment of complex mental activity across the lifespan: Development of the lifetime of Experiences Questionnaire (LEQ). Psychological Medicine, 37(7), 1015–1025. https://doi.org/10.1017/S003329170600938X
Valenzuela, M., Brayne, C., Sachdev, P., Wilcock, G., & Matthews, F. (2011). Cognitive lifestyle and long-term risk of dementia and survival after diagnosis in a multicenter population-based cohort. American Journal of Epidemiology, 173(9), 1004–1012. https://doi.org/10.1093/aje/kwq476
Vallet, F., Mella, N., Ihle, A., Beaudoin, M., Fagot, D., Ballhausen, N., et al. (2020). Motivation as a mediator of the relation between cognitive reserve and cognitive performance. The journals of gerontology Series B, 75(6), 1199–1205. https://doi.org/10.1093/geronb/gby144
Van Loenhoud, A. C., Van Der Flier, W. M., Wink, A. M., Dicks, E., Groot, C., Twisk, J., et al. (2019). Cognitive reserve and clinical progression in Alzheimer disease: A paradoxical relationship. Neurology, 93(4), E334–E346. https://doi.org/10.1212/WNL.0000000000007821
Wilson, R. S., Barnes, L. L., & Bennett, D. A. (2003). Assessment of lifetime participation in cognitively stimulating activities. Journal of Clinical and Experimental Neuropsychology, 25(5), 634–642. https://doi.org/10.1076/jcen.25.5.634.14572
Xu, H., Yang, R., Qi, X., Dintica, C., Song, R., Bennett, D. A., & Xu, W. (2019). Association of lifespan cognitive reserve indicator with dementia risk in the presence of brain pathologies. JAMA Neurology, 76(10), 1184–1191. https://doi.org/10.1001/jamaneurol.2019.2455
Xu, H., Yang, R., Dintica, C., Qi, X., Song, R., Bennett, D. A., & Xu, W. (2020). Association of lifespan cognitive reserve indicator with the risk of mild cognitive impairment and its progression to dementia. Alzheimer’s and Dementia, 16(6), 873–882. https://doi.org/10.1002/alz.12085
Funding
This work was supported by the School of Nursing of Peking Union Medical College [grant number: PUMCSON202101].
Author information
Authors and Affiliations
Contributions
Wanrui Wei: Conceptualization, Methodology, Validation, Formal analysis, Data Curation, Writing - Original Draft, Review & Editing, Project administration. Kairong Wang: Methodology, Validation, Formal analysis, Data Curation, Writing - Review & Editing. Jiyuan Shi: Methodology, Validation, Formal analysis, Data Curation, Writing - Review & Editing. Zheng Li: Supervision, Conceptualization, Methodology, Validation, Formal analysis, Data Curation, Writing - Review & Editing, Funding acquisition, Project administration.
Corresponding author
Ethics declarations
Ethical Approval
Not applicable.
Competing Interests
The authors declare no potential conflicts of interest.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Wei, W., Wang, K., Shi, J. et al. Instruments to Assess Cognitive Reserve Among Older Adults: a Systematic Review of Measurement Properties. Neuropsychol Rev (2023). https://doi.org/10.1007/s11065-023-09594-3
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s11065-023-09594-3