Abstract
Background
Healthcare providers use a life expectancy of at least 5 to 10 years in shared clinical decision-making with older adults about cancer screening, major surgeries, and disease prevention interventions. At present, few prognostic indexes predict long-term mortality beyond 10 years or are suited for use in primary care settings.
Objective
We developed and validated an 8-item multidimensional index predicting 11-year mortality for use in primary care.
Design, Setting, and Participants
Using data from the Singapore Longitudinal Ageing Studies (SLAS), we developed a Primary Care Prognostic (PCP) Index for predicting 11-year mortality risk in a development cohort (n = 1550) and validated it in a geographically different cohort (n = 928).
Main Measures
The PCP Index was derived from eight indicators (body mass loss, weakness, slow gait, comorbidity, polypharmacy, IADL/BADL dependency, low albumin, low total cholesterol, out of 25 candidate indicators) using stepwise Cox proportional hazard models.
Key Results
In the developmental cohort, the mortality hazard ratio increased by 53% per PCP point score increase, independent of age and sex. Across risk categories, absolute risks of mortality increased from 5% (score 0) to 67.9% (scores 7–9), with area under curve (AUC = 0.77 (95% CI 0.73–0.80)). The PCP Index also predicted mortality in the validation cohort, with AUC = 0.70 (95% CI 0.64–0.75).
Conclusions
The PCP Index using simple clinical assessments and point scoring is a potentially useful prognostic tool for predicting long-term mortality and is well suited for risk stratification and shared clinical decision-making with older adults in primary care.
Similar content being viewed by others
INTRODUCTION
In aging populations, escalating numbers of older adults in need of medical care present formidable healthcare challenges.1, 2 Individualized management of older adults requires clinicians to consider patients’ life expectancy in making shared clinical decisions regarding chronic disease management, major surgeries, and cancer screening.3 However, few prognostic indexes predict long-term mortality (beyond 10 years) in community-living older adults or can be easily used in primary care.
Current prognostic indexes face a number of issues that limit their application across a wide cross-section of patient groups and clinical settings.4,5,6,7,8 Tools developed from hospital-based administrative data sets require information that are not routinely available or relevant in the primary care setting. Indexes based on multiple demographic, lifestyle, and behavioral risk, and disease variables are less relevant in older populations because predictors such as smoking, obesity, and chronic diseases are less important in the oldest old.9, 10 While the Multidimensional Prognostic Index (MPI) has shown good predictive accuracy for mortality risk,11 it requires a standard Comprehensive Geriatric Assessment (CGA) which is time-consuming and not practical in primary care settings.
Multidimensional tools which use items such as age, gender, instrumental activities of daily living, comorbidities, mood, cognitive function, and nutritional status have shown good predictive validity for 3 to 5 years, but have not been tested over longer time periods.8, 12,13,14,15,16 Using data collected from community-dwelling older adults in the Singapore Longitudinal Ageing Studies (SLAS-1), we used a range of simple questionnaire, performance-based and blood indicators of health and functional status of older adults that are commonly used in primary care outpatient settings to develop a brief primary care prognostic index for predicting 11-year mortality risk in older adults. An 11-year mortality risk index was developed as few studies have evaluated long-term mortality risks of prognostic indices in population-based cohorts over periods longer than 5 or 10 years. This is important because current guidelines do not recommend some preventive interventions such as cancer screening when life expectancy is less than 10 years.17
METHODS
Study Cohort
Data was collected from an observational population-based cohort study of older adults, aged ≥ 55 years in Singapore, with mortality follow-up from 1 September 2003 to 31 December 2014. Full details are previously described.18 Briefly, between 1 September 2003 and 31 December 2005, a whole area population of 2804 older adult residents in a dozen adjoining precincts in the South-East Region of Singapore were invited to participate in the study. Informed consent was obtained, and the study was approved by an institutional review board. At recruitment, questionnaires were administered using face-to-face interviews conducted by research nurses at the participants’ homes. Clinical measurements and blood draws were performed at a local study site center.
Development and Validation of the PCP Index
The derivation of the PCP Index used a cohort of 1550 participants who were recruited from one defined geographical area during the period from 1 September to 31 December 2004. Our validation cohort19 was based on another cohort of 928 subjects who were recruited from a different residential area from 1 January 2005 to 31 December 2005.
A total of 25 performance-based and laboratory indicators of health and functional status of older adults were considered. (The full details for each measure are provided in Supplementary Table S1.) These indicators were selected for ease of collection in primary care settings and have been shown to predict mortality in older populations.20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45
All-Cause Mortality Follow-up
The follow-up vital status and date of death of the participants from baseline up to 31 December 2014 was determined by using the participants’ unique National Registration Identity Card (NRIC) number matched to the National Death Registry. Two-hundred and forty-three participants died from 15,340 person-years of observation during a follow-up period of 11 years.
Statistical analysis
Cox regression models of time to event data, censored at the date of death or on 31 December 2014, and Kaplan-Meier plots of survival, with testing for proportional hazard assumptions and estimates of hazard ratios (HR) and 95% confidence intervals (95% CI), were used to derive predictors of 11-year mortality. In the development cohort, we used a two-stage approach. We first identified variables that significantly predicted mortality in initial multivariable models in groups (NSI nutritional indicators, blood biomarkers, physical functional indicators, and other clinical and functional indicators) which also included age and sex. Variables significantly predicting mortality in each of the initial models were placed into a final stepwise multivariable model, along with age and sex. Forward stepwise elimination, backward stepwise elimination, and backward elimination were all tested, yielding the same results.
Using weights (rounded to the nearest integer) derived from regression coefficients, setting the lowest coefficient a score of 1, a weighted summed score was derived to create the PCP Index. The summed scores across indicators range potentially from 0 to 10. The performance of the PCP Index’s categorical levels: low (0–1), medium (2, 3), high (4, 5), and very high (6+) risk in predicting mortality risks were evaluated with HR estimates adjusted for age and sex. Discrimination of the model was assessed by receiver operating characteristic (ROC) curves and Harrel’s C-statistics for mortality. We validated the PCP Index by comparing the predicted mortality from the development cohort to the observed mortality in the validation cohort. All analyses were performed using SAS 9.2 (SAS Institute, Inc., Cary, NC).
RESULTS
Characteristics of Development Cohort Subjects
The mean age of participants in the development cohort (n = 1550) was 66.4 (SD 7.8). Sixty-two percent were women. Twenty-three percent had less than 6 years of formal education and were either single, divorced, or widowed. Forty percent had 3 or more comorbidities and 29% required assistance in either IADL or BADL (Table 1). During the 11 years of follow-up, 243 (15.7%) participants died, from a total of 15,340 person-years of observation.
Development Cohort
Table 2 shows the mortality HR of association with the 25 individual indicators in separate models for clinical and functional indicators, physical functioning indicators, and nutritional indicators, controlling for age and sex. Four of the 11 NSI questionnaire indicators (inability to prepare meals or feed oneself, poor dentition, or oral issues causing difficulty eating, low intake of fruits or vegetables, take 3 more different drugs a day), and all blood, physical, clinical, and functional indicators, except low physical activity and depression, significantly predicted mortality independently of other indicators in their respective classes.
Table 3 shows the results when these significant indicators were entered simultaneously as candidate variables in the final model using backward and forward stepwise selection procedures. The final reduced model includes eight independent predictors of mortality, with HR ranging from 1.5 to 2.5. Two indicators are laboratory findings (low albumin and low total cholesterol), 5 are physical indicators (height loss, weakness, slow gait, functional disability), and 2 clinical indicators (multiple comorbidities and polypharmacy). The prognostic index scores ranged from 0 to 9, mean (SD) of 2.1(2.0). There was a stepwise increase in mortality, from 5% for those with a score of 0 to 68% among those with a score of 7–9, with distinct survival trajectories; these differences persisted over the 11 years of follow-up (Fig. 1). The area under the ROC (AUC) was 0.77 (95% CI 0.73-0.80), compared with the corresponding area under the ROC for age, which was 0.73 (0.70–0.77). An index combining the PCP Index with age did not significantly increase the AUC (0.78, 95% CI 0.74–0.80).
Validation Cohort
The mean age of participants in the validation cohort (n = 928) was 65 years, 64% were women. Eleven percent had less than 6 years of formal education and 28.3% were either single, divorced, or widowed. Forty-six percent had 3 or more comorbidities and 16.7% required assistance in either IADLs or BADLs (Table 1). During 9 years of follow-up, 86 participants died, from a total of 8342 person-years of observation.
The PCP Index scores in the validation cohort were lower than in the development cohort; the highest PCP Index score category (6–10) had no participants with scores greater than 6. The mortality rates increased from 3.0 per 100 person-years among those with PCP Index score of 0 to 35.7 per 100 person-years among those with the highest PCP Index score of 6 (Table 4). The PCP Index showed good accuracy in discriminating between those who died and those who survived, with C-statistic of 0.70 (Table 5). There was reasonably close agreement between the observed mortality in the development and validation cohorts for various levels of risk.
In addition, we tested a 6-item version of the PCP Index which did not require blood measures (potential range of scores 0 to 8) which has an AUC of 0.75, with predicted probabilities of mortality ranging from 5.7% (score = 0) to 78.3% (score = 7–8). (See Supplementary Table S2.)
DISCUSSION
We developed and validated a prognostic index using a simple point scoring method that can be used by primary care providers to stratify older adults on their risk of 11-year mortality. The index predicted 11-year mortality independently of age and sex, spanned a wide range of absolute mortality from 5 to 68%, with uniformly wide separation across the different risk groups. The PCP Index predicted mortality in the validation cohort nearly as well as it did in the development cohort. The performance of the PCP Index compares favorably with that of other prognostic indexes that are also proposed for use by primary care providers for risk stratification of community-living older adults.13,14,15,16 Studies have reported that functional status adds modestly to mortality prediction in primary care beyond age, sex, and comorbidities.15, 16 Our study differs from previous studies by exploring a greater number of different and high-prevalence functional indicators for predicting mortality in the model development. Our index differs by using physical and functional indicators of frailty and malnutrition and provides estimates of mortality over 11 years, longer than other studies.
Older patients with high mortality risk over 5 to 10 years may benefit from closer monitoring and targeted interventions to improve life expectancy and quality of life. This is because the PCP Index is distinctively based on measures of physical frailty and malnutrition and identifies older adults who are pre-frail/frail and/or at-risk of malnutrition (or malnourished) with high mortality risks. These conditions have a high prevalence in older populations46, 47 and should be monitored and treated.48 The PCP Index may thus be used in older patients for holistic management of malnutrition and frailty which may improve quality of life and survival. Additionally, the PCP Index may also be a useful tool in healthcare policy and epidemiological studies for risk adjustment in the evaluation of quality of care, medical effectiveness, and patient care outcomes among healthcare organizations.
Our study has several limitations. First, the validation cohort was younger, was better educated, had higher income, and was better housed than the development cohort and few had the highest PCP scores. Among the strata present, the PCP Index performed nearly as well as the development index. Secondly, the AUC for our index was only slightly higher than using age alone as the predictor of mortality. Interestingly, our index was independent of age and can be used as an additional clinical marker for providers in clinical decision-making. Third, the study was performed using only elderly Chinese residents. Whether it would perform as well in other countries and other ethnicities needs to be studied. Finally, the index was developed from community-living older adults; it may not be generalizable to populations in hospitals or nursing homes. Further studies should also be conducted to determine how the PCP Index compares with other prognostic indices and to determine its validity in populations with longer or shorter life expectancies.
Study strengths include using physical, nutritional, and functional indicators that are standard clinical measures that can be easily performed in primary care settings. The PCP Index measures take no longer than 10 min to complete.
In addition, we developed and validated our measure in distinct patient populations. Third, our shorter prognostic indicator can be applied in the absence of having the serum markers available.
CONCLUSION
The Primary Care Prognostic Index using simple clinical assessments and point scoring is a prognostic tool for predicting long-term mortality risks that are well suited for risk stratification and shared clinical decision-making with older adults, as well as health policy formulation and research.
References
Collard RM, Boter H, Schoevers RA, Voshaar RCO. Prevalence of frailty in community-dwelling older persons: a systematic review. J Am Geriatr Soc 2012;60(8):1487-1492.
Fried LP, Ferrucci L, Darer J, Williamson JD, Anderson G. Untangling the concepts of disability, frailty, and comorbidity: implications for improved targeting and care. J Gerontol A Biol Sci Med Sci 2004;59(3):255-263.
Reilly BM, Magnussen CR, Ross J, Ash J, Papa L, Wagner M. Can we talk? Inpatient discussions about advance directives in a community hospital: attending physicians’ attitudes, their inpatients’ wishes, and reported experience. Arch Intern Med 1994;154(20):2299-2308.
Southern DA, Quan H, Ghali WA. Comparison of the Elixhauser and Charlson/Deyo methods of comorbidity measurement in administrative data. Med Care 2004;42(4):355-360.
Walter LC, Brand RJ, Counsell SR, et al. Development and validation of a prognostic index for 1-year mortality in older adults after hospitalization. Jama. 2001;285(23):2987-2994.
Inouye SK, Peduzzi PN, Robison JT, Hughes JS, Horwitz RI, Concato J. Importance of functional measures in predicting mortality among older hospitalized patients. Jama. 1998;279(15):1187-1193.
Carey EC, Walter LC, Lindquist K, Covinsky KE. Development and validation of a functional morbidity index to predict mortality in community-dwelling elders. J Gen Intern Med 2004;19(10):1027-1033.
Schonberg MA, Davis RB, McCarthy EP, Marcantonio ER. External validation of an index to predict up to 9-year mortality of community-dwelling adults aged 65 and older. J Am Geriatr Soc 2011;59(8):1444-1451.
Nybo H, Petersen HC, Gaist D, et al. Predictors of mortality in 2,249 nonagenarians--the Danish 1905-Cohort Survey. J Am Geriatr Soc 2003;51(10):1365-1373.
Marengoni A, von Strauss E, Rizzuto D, Winblad B, Fratiglioni L. The impact of chronic multimorbidity and disability on functional decline and survival in elderly persons. A community-based, longitudinal study. J Intern Med 2009;265(2):288-295.
Pilotto A, Ferrucci L, Franceschi M, et al. Development and validation of a multidimensional prognostic index for one-year mortality from comprehensive geriatric assessment in hospitalized older patients. Rejuvenation Res 2008;11(1):151-161.
Mazzaglia G, Roti L, Corsini G, et al. Screening of older community-dwelling people at risk for death and hospitalization: the Assistenza Socio-Sanitaria in Italia project. J Am Geriatr Soc 2007;55(12):1955-1960.
Jung HW, Kim JW, Han JW, et al. Multidimensional Geriatric Prognostic Index, Based on a Geriatric Assessment, for Long-Term Survival in Older Adults in Korea. PLoS One 2016;11(1):e0147032.
Angleman SB, Santoni G, Pilotto A, Fratiglioni L, Welmer AK. Multidimensional Prognostic Index in Association with Future Mortality and Number of Hospital Days in a Population-Based Sample of Older Adults: Results of the EU Funded MPI_AGE Project. PLoS One 2015;10(7):e0133789.
Carey IM, Shah SM, Harris T, DeWilde S, Cook DG. A new simple primary care morbidity score predicted mortality and better explains between practice variations than the Charlson index. J Clin Epidemiol 2013 Apr;66(4):436-44.
Sultana J, Fontana A, Giorgianni F, Basile G, Patorno E, Pilotto A, Molokhia M, Stewart R, Sturkenboom M, Trifirò G. Can information on functional and cognitive status improve short-term mortality risk prediction among community-dwelling older people? A cohort study using a UK primary care database. Clin Epidemiol 2017;10:31-39.
Bibbins-Domingo K, Grossman DC, Curry SJ, et al. Screening for colorectal cancer: US Preventive Services Task Force recommendation statement. Jama. 2016;315(23):2564-2575.
Wei K, Nyunt MS, Gao Q, Wee SL, Yap KB, Ng TP. Association of Frailty and Malnutrition With Long-term Functional and Mortality Outcomes Among Community-Dwelling Older Adults: Results From the Singapore Longitudinal Aging Study 1. JAMA Netw Open 2018;1(3):e180650.
Justice AC, Covinsky KE, Berlin JA. Assessing the generalizability of prognostic information. Ann Intern Med 1999;130(6):515-524.
Carey EC, Covinsky KE, Lui LY, Eng C, Sands LP, Walter LC. Prediction of mortality in community-living frail elderly people with long-term care needs. J Am Geriatr Soc 2008;56(1):68-75.
Fillenbaum GG, Pieper CF, Cohen HJ, Cornoni-Huntley JC, Guralnik JM. Comorbidity of five chronic health conditions in elderly community residents: determinants and impact on mortality. J Gerontol A Biol Sci Med Sci 2000;55(2):M84-89.
Ng TP, Niti M, Chiam PC, Kua EH. Prevalence and correlates of functional disability in multiethnic elderly Singaporeans. J Am Geriatr Soc 2006;54(1):21-29.
Ng TP, Niti M, Chiam PC, Kua EH. Physical and cognitive domains of the Instrumental Activities of Daily Living: validation in a multiethnic population of Asian older adults. J Gerontol A Biol Sci Med Sci 2006;61(7):726-735.
Jyrkka J, Enlund H, Korhonen MJ, Sulkava R, Hartikainen S. Polypharmacy status as an indicator of mortality in an elderly population. Drugs Aging 2009;26(12):1039-1048.
Sachs GA, Carter R, Holtz LR, et al. Cognitive impairment: an independent predictor of excess mortality: a cohort study. Ann Intern Med 2011;155(5):300-308.
Perna L, Wahl HW, Mons U, Saum KU, Holleczek B, Brenner H. Cognitive impairment, all-cause and cause-specific mortality among non-demented older adults. Age Ageing 2015;44(3):445-451.
An R, Liu GG. Cognitive impairment and mortality among the oldest-old Chinese. Int J Geriatr Psychiatry 2016;31(12):1345-1353.
Ng TP, Niti M, Chiam PC, Kua EH. Ethnic and educational differences in cognitive test performance on mini-mental state examination in Asians. Am J Geriatr Psychiatry 2007;15(2):130-139.
Cuijpers P, Schoevers RA. Increased mortality in depressive disorders: a review. Curr Psychiatry Rep 2004;6(6):430-437.
Nyunt MS, Fones C, Niti M, Ng TP. Criterion-based validity and reliability of the Geriatric Depression Screening Scale (GDS-15) in a large validation sample of community-living Asian older adults. Aging Ment Health 2009;13(3):376-382.
Tinetti ME. Performance-oriented assessment of mobility problems in elderly patients. J Am Geriatr Soc 1986;34(2):119-126.
Harris T, Cook EF, Garrison R, Higgins M, Kannel W, Goldman L. Body mass index and mortality among nonsmoking older persons. The Framingham Heart Study. Jama. 1988;259(10):1520-1524.
Dey DK, Rothenberg E, Sundh V, Bosaeus I, Steen B. Body mass index, weight change and mortality in the elderly. A 15 y longitudinal population study of 70 y olds. Eur J Clin Nutr 2001;55(6):482-492.
Fried LP, Tangen CM, Walston J, et al. Frailty in older adults: evidence for a phenotype. J Gerontol A Biol Sci Med Sci 2001;56(3):M146-M157.
Wang JY, Tsai AC. The short-form mini-nutritional assessment is as effective as the full-mini nutritional assessment in predicting follow-up 4-year mortality in elderly Taiwanese. J Nutr Health Aging 2013;17(7):594-598.
Bouillanne O, Morineau G, Dupont C, et al. Geriatric Nutritional Risk Index: a new index for evaluating at-risk elderly medical patients. Am J Clin Nutr 2005;82(4):777-783.
Barrocas A, Bistrian BR, Blackburn GL, et al. Appropriate and effective use of the NSI checklist and screens. An update on caring for the elderly by preventing malnutrition. J Am Diet Assoc 1995;95(6):647-648.
de Groot LC, Beck AM, Schroll M, van Staveren WA. Evaluating the DETERMINE Your Nutritional Health Checklist and the Mini Nutritional Assessment as tools to identify nutritional problems in elderly Europeans. Eur J Clin Nutr 1998;52(12):877-883.
Schalk BW, Visser M, Deeg DJ, Bouter LM. Lower levels of serum albumin and total cholesterol and future decline in functional performance in older persons: the Longitudinal Aging Study Amsterdam. Age Ageing 2004;33(3):266-272.
Okamura T, Hayakawa T, Hozawa A, et al. Lower levels of serum albumin and total cholesterol associated with decline in activities of daily living and excess mortality in a 12-year cohort study of elderly Japanese. J Am Geriatr Soc 2008;56(3):529-535.
Bae JM, Yang YJ, Li ZM, Ahn YO. Low cholesterol is associated with mortality from cardiovascular diseases: a dynamic cohort study in Korean adults. J Korean Med Sci 2012;27(1):58-63.
Dong X, Mendes de Leon C, Artz A, Tang Y, Shah R, Evans D. A population-based study of hemoglobin, race, and mortality in elderly persons. J Gerontol A Biol Sci Med Sci 2008;63(8):873-878.
Riva E, Tettamanti M, Mosconi P, et al. Association of mild anemia with hospitalization and mortality in the elderly: the Health and Anemia population-based study. Haematologica. 2009;94(1):22-28.
Chalmers KA, Knuiman MW, Divitini ML, Bruce DG, Olynyk JK, Milward EA. Long-term mortality risks associated with mild anaemia in older persons: the Busselton Health Study. Age Ageing 2012;41(6):759-764.
Rubio-Rivas M, Formiga F, Grillo S, Gili F, Cabrera C, Corbella X. Lymphopenia as prognostic factor for mortality and hospital length of stay for elderly hospitalized patients. Aging Clin Exp Res 2016;28(4):721-727.
Verlaan S, Ligthart-Melis GC, Wijers SLJ, Cederholm T, Maier AB, de van der Schueren MAE. High Prevalence of Physical Frailty Among Community-Dwelling Malnourished Older Adults-A Systematic Review and Meta-Analysis. J Am Med Dir Assoc 2017;18(5):374-382.
Wei K, Nyunt MSZ, Gao Q, Wee SL, Ng TP. Frailty and Malnutrition: Related and Distinct Syndrome Prevalence and Association among Community-Dwelling Older Adults: Singapore Longitudinal Ageing Studies. J Am Med Dir Assoc 2017;18(12):1019-1028.
Dent E, Lien C, Lim WS, et al. The Asia-Pacific Clinical Practice Guidelines for the Management of Frailty. J Am Med Dir Assoc 2017;18(7):564-575.
Acknowledgments
We thank the following voluntary welfare organizations for their support: Geylang East Home for the Aged, Presbyterian Community Services, St Luke’s Eldercare Services, Thye Hua Kwan Moral Society (Moral Neighbourhood Links), Yuhua Neighbourhood Link, Henderson Senior Citizens’ Home, NTUC Eldercare Co-op Ltd, Thong Kheng Seniors Activity Centre (Queenstown Centre), and Redhill Moral Seniors Activity Centre.
Funding
The study was supported by research grants from the Agency for Science Technology and Research (A*STAR) Biomedical Research Council (BMRC) [Grant: 08/1/21/19/567] and from the National Medical Research Council [Grant: NMRC/1108/2007].
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Informed consent was obtained, and the study was approved by an institutional review board.
Conflict of Interest
The authors declare that they do not have a conflict of interest.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic Supplementary Material
ESM 1
(DOC 215 kb)
Rights and permissions
About this article
Cite this article
Chiang, G.S.H., Nyunt, M.S.Z., Gao, Q. et al. Primary Care Prognostic (PCP) Index of 11-Year Mortality Risk: Development and Validation of a Brief Prognostic Tool. J GEN INTERN MED 36, 62–68 (2021). https://doi.org/10.1007/s11606-020-06132-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11606-020-06132-2