Abstract
Background
Chronic kidney disease progression to kidney failure is diverse, and progression may be different according to genetic aspects and settings of care. We aimed to describe kidney failure risk equation prognostic accuracy in an Australian population.
Methods
A retrospective cohort study was undertaken in a public hospital community-based chronic kidney disease service in Brisbane, Australia, which included a cohort of 406 adult patients with chronic kidney disease Stages 3–4 followed up over 5 years (1/1/13–1/1/18). Risk of progression to kidney failure at baseline using Kidney Failure Risk Equation models with three (eGFR/age/sex), four (add urinary-ACR) and eight variables (add serum-albumin/phosphate/bicarbonate/calcium) at 5 and 2 years were compared to actual patient outcomes.
Results
Of 406 patients followed up over 5 years, 71 (17.5%) developed kidney failure, while 112 died before reaching kidney failure. The overall mean difference between observed and predicted risk was 0.51% (p = 0.659), 0.93% (p = 0.602), and − 0.03% (p = 0.967) for the three-, four- and eight-variable models, respectively. There was small improvement in the receiver operating characteristic-area under the curve from three-variable to four-variable models: 0.888 (95%CI = 0.819–0.957) versus 0.916 (95%CI = 0.847–0.985). The eight-variable model showed marginal receiver operating characteristic-area under the curve improvement: 0.916 (95%CI = 0.847–0.985) versus 0.922 (95%CI = 0.853–0.991). The results were similar in predicting 2 year risk of kidney failure.
Conclusions
The kidney failure risk equation accurately predicted progression to kidney failure in an Australian chronic kidney disease population. Younger age, male sex, lower estimated glomerular filtration rate, higher albuminuria, diabetes mellitus, tobacco smoking and non-Caucasian ethnicity were associated with increased risk of kidney failure. Cause-specific cumulative incidence function for progression to kidney failure or death, stratified by chronic kidney disease stage, demonstrated differences within different chronic kidney disease stages, highlighting the interaction between comorbidity and outcome.
Avoid common mistakes on your manuscript.
Introduction
Chronic kidney disease (CKD) is a major public health issue [1, 2]. The rate of progression to kidney failure (KF) can vary widely [3, 4]. Some patients remain stable [4]; others progress rapidly requiring potential Kidney Replacement Therapy (KRT). Identifying those at risk of progression allows for early targeted interventions to slow kidney function loss and/or to prepare for KRT initiation [5, 6].
Tangri et al. published the Kidney Failure Risk Equation (KFRE) to predict risk of progression from CKD to KF, defined as the need to commence KRT, at 2 and 5 years [7]. Results are presented as a percentage risk and classified into three risk categories; low, intermediate and high. The group validated a three- (age, sex, eGFR[ml/min/1.73 m2]), four- (age, sex, eGFR, urine albumin-to-creatinine ratio (ACR)[mg/g]) and eight-variable KFRE (four-variables and serum bicarbonate, albumin, calcium and phosphate).
Initially developed and validated in two Canadian cohorts [7], the KFRE was subsequently validated in European [5], African-American [1], paediatric [8], and several multinational cohorts [1, 9]. Reporting of the application of KFRE in Australian cohorts, which we sought to do in our study, has been limited [10, 11].
Methods
We included patients who were under the care of the Chronic Kidney Team, a multidisciplinary CKD programme provided by Royal Brisbane and Women’s Hospital (RBWH) within the Metro North Hospital and Health Service (MNHHS) on 1st January, 2013 (referral time range August 2001 to December 2012) who met KFRE calibration parameters [7] i.e., ≥ 18 but ≤ than 90 years of age with an estimated glomerular filtration rate (eGFR) < 60 mL/min per 1.73 m2 and not on KRT.
In their original paper [7], Tangri et al. described a total of seven models with an increasing number of variables starting with two (age and sex) through to a maximum of thirteen variables which included the above mentioned eight variables as well as diabetes mellitus, hypertension, systolic and diastolic blood pressure per 10 mmHg and body weight. Three models were validated [7] which we mirrored in our study: three variables (eGFR, age and sex), four variables (eGFR, age, sex and urinary ACR) and eight variables (eGFR, age, sex, urinary ACR, serum albumin; phosphate; bicarbonate and calcium).
Unique to this analysis, we undertook cause-specific cumulative incidence function for progression to KF or death, stratified by CKD stage.
As experienced by Tangri et al., measured urinary ACR was not available in most patients, and only available in 14% (n = 57) of our cohort [1]. For the remainder, urinary protein-to-creatinine ratios were transformed to the ACR using a previously reported equation [7].
Model performance
The discrimination of the survival risk model developed using the Cox proportional hazards model was assessed using the concordance index (both Harrell’s C and Gӧnen and Heller’s K statistics). These concordance coefficients measure the discriminative power of prognostic models and they are equivalent to the receiver operating characteristic (ROC) curve for binary outcomes.
Data analysis
The predicted and observed event probability estimates represent the mean predicted probability from the Cox regression model and the mean observed probability from the Kaplan Meier estimate divided into quintiles of predicted probability.
Ethical approval
The RBWH Human Research Ethics Committee approved this retrospective cohort study as a low-risk quality assurance audit (HREC/18/QRBW/295) and waived individual patient consent.
Patient and public involvement
Patients and the public were not involved in the undertaking of this research.
Results
Four hundred seventeen patients were identified and followed up for 5 years. In 11 (2.6%) patients, at least one value required for the eight-variable KFRE was missing and so 406 patients remained for analysis (Table 1).
Of the remaining 406 patients, 71 (17.5%) developed KF, and 112 (27.6%) died during follow-up. Median follow up time was 41 months. Observed vs predicted probability of KF at 5 years was analysed (Fig. 1).
Observed vs predicted probability of kidney failure at 5 years. All three models consistently showed a lower mean observed probability compared to mean predicted probability for the risk quintiles 4 and 5 at 5 years, while the opposite was observed for the risk quintiles 2 and 3 (Fig. 3). The overall mean difference between the observed and predicted risk was 0.51% (p = 0.659) for the three-variable model, 0.93% (p = 0.602) for the four-variable model, − 0.03% (p = 0.967) for the eight-variable model
Receiver operating characteristic-area under the curve for the three models tested (three-variable, four-variable, eight-variable) appeared similar in predicting both 2 year and 5 year KF risk (Figs. 2a, b). There was some improvement in the ROC-AUCs at 5 years from three-variable to four-variable models (0.888 (95%CI 0.819–0.957) versus 0.916 (95%CI 0.847–0.985)). However, improvement beyond four-variable to eight-variable models showed little change in the ROC-AUC (0.916 (95%CI 0.847–0.985) versus 0.922 (95%CI 0.853–0.991)). These results were similar for ROC-AUCs at 2 years.
a ROC curves at 5 years. Evaluation of the four KFRE models in patients with CKD stages 3–5. ROC-AUCs were 0.888 (95% CI 0.819–0.957), 0.916 (95% CI 0.847–0.985), 0.922 (95% CI 0.853–0.991) for the three-, four-, and eight-variable models, respectively. b ROC curves at 2 years. Evaluation of the four KFRE models in patients with CKD stages 3–5. ROC-AUCs were 0.929 (95% CI 0.833–1.0), 0.953 (95% CI 0.857–1.0), 0.952 (95% CI 0.856–1.0) for the three-, four-, and eight-variable models, respectively
After restricting the analysis to patients with CKD stage 3 only and separately for patients with CKD stage 4 only, there was no difference in the ROC-AUCs between three-variable and eight-variable models for CKD stage 3 patients for predicting KF within 5 years. However, the three-variable model seemed to perform poorly for CKD stage 4 patients. There was no difference between the four-variable and eight-variable models (Table 2a). For predicting KF within 2 years, the eight-variable model performed better than both the three- and four-variable models (Table 2b).
The net reclassification index (NRI) further confirmed that there was only a marginal improvement in the performance of the four-variable or eight-variable model over the three-variable model in predicting 5 year and 2 year KF risk (Tables 3a, 3b). The NRI of the four-variable model was 19.5% compared with the three-variable model, while the NRI of the eight-variable model was only 0.5% compared with the four-variable model. Simply, the addition of urinary-ACR to the original three-variable model improved correct classifications considerably. However, the further addition of serum albumin, phosphate, bicarbonate and calcium resulted in only a small increase in net classification accuracy.
A sensitivity analysis of the competing risk analysis model showed that patients with CKD stage 5 progressed to KF faster than those with stage 3 or 4 (Fig. 3). Patients with CKD stage 5 progressed faster to KF than to death, whilst patients with stage 3 or 4 progressed slightly faster to death than to KF.
Discussion
We demonstrate that KFRE accurately predicted progression to KRT at 2 and 5 years in an Australian metropolitan CKD population. Tangri et al. analysed seven different KFRE models, demonstrating no improvement in model performance with the addition of risk variables obtained from history (diabetes mellitus, hypertension) or clinical examination (blood pressure, weight) [7], and our results concur with this. Of particular note is the rate and unexpected nature of progression related to ethnic diversity. Although 92% of the cohort were of Caucasian background, in those that progressed to KRT, this figure declined to 86%. Sub-group analyses noted that Pacific Islanders progressed more quickly and unexpectedly to KF, perhaps in part due to the burden of diabetes mellitus in this population coupled with documented barriers to accessing health care [12] with knowledge that CKD disproportionately affects Aboriginal, Maori and Pacifica people [13]. This is reported in the First Nations community in Canada, where the rate of progression of kidney disease is higher in this group due to younger age at kidney disease onset, with higher prevalence of diabetes and hypertension [14].
Of interest are those classified by the KFRE as being at low/intermediate risk who do indeed progress to KF, accounting for 13% of those who commenced KRT.
Two thirds of these patients had Autosomal Dominant Polycystic Kidney Disease (ADPKD), indicating a signal for accelerated progression. This variance in progression was also seen by the Canadian group when they compared performance of the equation by disease aetiology [15]. They identified the reason for higher observed than predicted risk to be that disease progression in ADPKD relates more strongly with cyst growth and kidney volume rather than the variables used with the KFRE.
The remaining one third were known to have experienced an incident Acute Kidney Injury (AKI) during the course of the study which changed the original trajectory of their disease.
Unique to this analysis, we were able to undertake cause-specific cumulative incidence function for progression to KF or death, stratified by CKD stage. This demonstrated dramatic differences within the different CKD stages highlighting the interaction of CKD stage, comorbidities and outcomes. We appreciate an amplification effect occurring as a result of CKD stage, and as our study was only over a 5 year period, we predict an ongoing phenomenon in a longer follow-up period.
A strength of our study is that exclusions were limited to those who had ≥one missing variable (n = 11) or whose age and/or eGFR fell outside the calibrated range (n = 14). Another strength is that we did not censor for mortality as we recognised that the risk of non-renal death was far higher than that of progression to KF. A potential limitation relates to the availability of urinary-ACR in only 14% (n = 57) of the cohort, requiring conversion of urine protein:creatinine to ACR [7].
More research is required to evaluate individuals from high-risk populations including Aboriginal, Torres Strait Islander, Maori and Pacific Islander populations as well as patients with ADPKD or AKI to determine specific KFRE accuracy. The KFRE is easy and quick to use with results portrayed in a way that are understandable. In the context of our own and other Australian evidence [10, 11], we aim to incorporate the KFRE into initial referral triage tools to objectively infer risk of the patient referred. With increasing prevalence of kidney disease, the referrals numbers are rising, and this tool will allow appropriate triage from primary care into the hospital outpatient service. This tool can also be used to ascertain which patients can be safely discharged back to their primary care physician, noting higher risks of progression associated with instances such as episodes of AKI. The KFRE can be firmly incorporated into the referral process for access creation and transplant work up, as these steps, if completed correctly, can be the defining moment in a patient’s journey with kidney disease.
Data availability
The authors will be happy to consider additional analyses of the anonymised dataset on request. The need for stringent measures to prevent reidentification of individuals within a discrete geographical location and limited time period, however, preclude sharing of patient level datasets in a GDPR compliant form.
References
Tangri N, Grams ME, Levey AS et al (2016) Multinational assessment of accuracy of equations for predicting risk of kidney failure: a meta-analysis. JAMA 315(2):164–174
Tangri N, Inker LA, Hiebert B et al (2017) A dynamic predictive model for progression of CKD. Am J Kidney Dis 69(4):514–520
Kadatz MJ, Lee ES, Levin A (2016) Predicting progression in CKD: perspectives and precautions. Am J Kidney Dis 67(5):779–786
Levin A, Rigatto C, Barrett B et al (2014) Biomarkers of inflammation, fibrosis, cardiac stretch and injury predict death but not renal replacement therapy at 1 year in a Canadian chronic kidney disease cohort. Nephrol Dial Transplant 29(5):1037–1047
Peeters MJ, van Zuilen AD, van den Brand JA et al (2013) Validation of the kidney failure risk equation in European CKD patients. Nephrol Dial Transplant 28(7):1773–1779
Ramspek CL, de Jong Y, Dekker FW, van Diepen M (2019) Towards the best kidney failure prediction tool: a systematic review and selection aid. Nephrol Dial Transplant 35:1527
Tangri N, Stevens LA, Griffith J et al (2011) A predictive model for progression of chronic kidney disease to kidney failure. JAMA 305(15):1553–1559
Winnicki E, McCulloch CE, Mitsnefes MM, Furth SL, Warady BA, Ku E (2018) Use of the kidney failure risk equation to determine the risk of progression to end-stage renal disease in children with chronic kidney disease. JAMA Pediatr 172(2):174–180
Grams ME, Brunskill NJ, Ballew SH et al (2023) The kidney failure risk equation: evaluation of novel input variables including eGFR estimated using the CKD-EPI 2021 EQUATION in 59 cohorts. J Am Soc Nephrol 34(3):482–494. https://doi.org/10.1681/ASN.0000000000000050
Irish GL, Cuthbertson L, Kitsos A, Saunder T, Clayton PA, Jose MD (2023) The kidney failure risk equation predicts kidney failure: validation in an Australian cohort. Nephrology (Carlton). https://doi.org/10.1111/nep.14160
Chuah A, Walters G, Christiadi D et al (2022) Machine learning improves upon clinicians’ prediction of end stage kidney disease. Front Med (Lausanne) 9:837232. https://doi.org/10.3389/fmed.2022.837232
Queensland Health. Queensland Health response to Pacific Islander and Māori health needs assessment. Division of the Chief Health Officer, Queensland Health. Brisbane 2011.
Walker RJ, Tafunai M, Krishnan A (2019) Chronic Kidney Disease in New Zealand Maori and Pacific People. Semin Nephrol 39(3):297–299
Ferguson TW, Tangri N, Tan Z, James MT, Lavallee BDA, Chartrand CD, McLeod LL, Dart AB, Rigatto C, Komenda PVJ (2017) Screening for chronic kidney disease in Canadian indigenous peoples is cost-effective. Kidney Int 92(1):192–200. https://doi.org/10.1016/j.kint.2017.02.022. (Epub 2017 Apr 20 PMID: 28433383)
Hundemer GL, Tangri N, Sood MM, Ramsay T, Bugeja A, Brown PA, Clark EG, Biyani M, White CA, Akbari A (2020) Performance of the kidney failure risk equation by disease etiology in advanced CKD. Clin J Am Soc Nephrol. 15(10):1424–1432. https://doi.org/10.2215/CJN.03940320. (Epub 2020 Sep 14. PMID: 32928746; PMCID: PMC7536763)
Funding
Open Access funding enabled and organized by CAUL and its Member Institutions. This research received no specific grant from any funding agency in the public, commercial or not-for-profit sectors.
Author information
Authors and Affiliations
Contributions
SJ, JH and AJM conceived the study. It was planned by SJ, JH, AK and AJM. SJ and JH undertook ethical approval and data extraction. EM and CH designed and undertook the analyses with input from AJ, JH, AK and AJM. AJM supervised the study. All authors contributed to writing, reviewing and editing the manuscript.
Corresponding author
Ethics declarations
Conflict of interest
None applicable to this work.
Ethical approval
The RBWH Human Research Ethics Committee reviewed and approved this study as a low-risk quality assurance audit study (Approval HREC/18/QRBW/295).
Patient consent
Not applicable. The RBWH Human Research Ethics Committee approved this retrospective cohort study and waived individual patient consent as a low risk quality assurance audit study.
Disclosures
AJM has been supported by a Queensland Health Advancing Clinical Research Fellowship. The authors do not have any disclosures.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Jahan, S., Hale, J., Malacova, E. et al. Real world evaluation of kidney failure risk equations in predicting progression from chronic kidney disease to kidney failure in an Australian cohort. J Nephrol 37, 231–237 (2024). https://doi.org/10.1007/s40620-023-01680-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40620-023-01680-2