Introduction

The coexistence of chronic kidney disease (CKD) and cancer is common due to the increased incidence of cancer in patients with CKD1 and the fact that CKD worsens the mortality rate of cancer patients2. A precise GFR assessment is fundamental to several aspects of cancer therapy, including chemotherapy dose adjustment, decisions regarding surgery eligibility with perioperative management, and preparation of long-term care. An underestimated GFR in a patient with cancer could lead to inappropriate care, such as in the case of a patient being deemed ineligible for both medical chemotherapy and surgical treatment because their GFR is too low. Conversely, overestimation of the GFR could put a patient at unnecessary risk of drug overdose and unfavorable complications. Because most cancer chemotherapeutic agents are excreted mainly through the kidneys, the accuracy of the estimated glomerular filtration rate (eGFR) in patients with cancer is crucial to balancing treatment efficacy and the risk of adverse events. Although the eGFR calculated from serum creatinine (SCr) is widely used in general practice, overestimation of the GFR due to a patient’s reduced muscle mass and food intake due to malignancy is very common. Despite the increased accuracy of eGFRs obtained by determining the measured GFR (mGFR) using the clearance of exogenous filtration markers, this method has not been widely used due to the necessity of a 24-hour urine collection. Indeed, a standard reference for the eGFR for chemotherapeutic agent dose-adjustments remains undecided. The International Society of Geriatric Oncology preferred eGFRs using the Modification of Diet in Renal Disease (MDRD) equation over the Cockcroft-Gault equation for patients over 65 years old. Nevertheless, the equation from the Chronic Kidney Disease Epidemiology Collaboration (CKD-EPI) in a recent large-scale, retrospective study appeared to be superior to the MDRD equation for the eGFR assessment in patients with cancer3.

In general, a consensus of the international guideline group of KDIGO (Kidney Disease: Improving Global Outcomes) recommends creatinine-based equations for initial testing, with other confirmatory tests for the estimation of kidney function in CKD patients4. Similarly, the Society of Geriatric Oncology guidelines prefer mGFR in anti-cancers that are mainly excreted through the kidney (or with apparent nephrotoxicity) or in cases of possibly inaccurate eGFRs5. It is important to recognize that both the MDRD and the CKD-EPI equations were developed using data from CKD patients, from which patients with malignancy are excluded6,7,8,9,10,11. Patients with malignancy, in contrast to those with CKD alone, mostly suffer from more severe sarcopenia, resulting in lower SCr (due to less creatinine production) and overestimated GFRs. As such, accurately estimated renal function is likely necessary for the proper adjustment of cancer chemotherapy. Although the MDRD and CKD-EPI equations are widely used to predict the GFR in the United States and Europe, some corrections are necessary for other ethnic groups, as is the case for the coefficient factor for the isotope-dilution mass-spectrometry (IDMS) tracer in the re-expressed MDRD equation proposed as 1.129 for the Thai population10. However, the validation of the eGFR derived from these equations in Thai patients with cancer has not yet been investigated.

Moreover, serum cystatin C (CysC) is considered a potential replacement for SCr as a filtration marker, but the correlation between the eGFRs derived from CysC and SCr are still uncertain12,13,14. In addition, increased serum CysC levels found in both solid and hematologic malignancies are likely related to the tumor’s nature as a cysteine protease inhibitor15,16,17. No studies have examined whether an equation based on serum CysC would improve GFR estimation in cancer patients compared to the estimates obtained by other equations. Therefore, the aim of the present study was to investigate the agreement and precision of the currently published eGFR formulae, including the CKD-EPI7, the body surface area (BSA)-unadjusted CKD-EPI, the re-expressed MDRD study equation with the Thai racial factor10,18, the Thai eGFR10, the 2012 CKD-EPI creatinine-cystatin C13, the Cockcroft-Gault19, and the most recent cancer patient-derived eGFR equation by Janowitz and Williams3, compared to the standard GFR measurement by 99mTc-DTPA.

Materials and Methods

Study design and patient selection

The study was performed in compliance with the Helsinki Declaration. All participants were informed and provided written informed consent to participate in this study, which was approved by the Human Research Ethics Committee of Chulabhorn Research Institute (No. 017/2559) and local institutional review boards. The inclusion criteria were adults aged 18–70 years old with the following conditions: (i) pathologically or cytologically proven solid or hematologic malignancy with a performance status according to the Eastern Cooperative Oncology Group (ECOG) of 0–1 and ii) CKD in stable condition at various stages (G1–G5) according to the KDIGO criteria4. The exclusion criteria were as follows: i) history of active medical or surgical treatment for related malignancy within the past 6 months; (ii) acute deterioration of malignancy or related complications, including gastrointestinal bleeding, infection, severe malnutrition with an edematous state, acute kidney injury superimposed on CKD, congestive heart failure, and arterial or venous thrombosis; (iii) dialysis dependence; (iv) amputation; (v) breastfeeding or pregnancy; (vi) end-of-life status; (vii) current hospitalization; and (viii) current use of medications with SCr interference, including ascorbic acid, corticosteroids, trimethoprim, cimetidine, flucytosine, methyldopa, and levodopa.

Reference GFR measurement

The reference GFR in the present study was determined by the 99mTc-diethylene triamine penta-acetic Acid (99mTc-DTPA) plasma clearance method with a radiopurity of >95% and the percentage bound to plasma protein <5%. The reference GFR by 99mTc-DTPA plasma clearance was read by a radiologist who was blinded to the clinical data. All participants were measured for plasma radioactivity of 99mTc-DTPA at 5, 30, 60, 120, 180, and 240 minutes after a single intravenous bolus of 99mTc-DTPA, following the institutional protocol. Then, plasma radioactive activities were plotted as a function of time to create a time–activity curve to calculate the GFR normalized by BSA20 as well as the measured GFR (mGFR) according to the following equation (D, dosage of drug injected; t, time of blood sampling):21

$${\rm{GFR}}=\frac{{\rm{D}}}{{\rm{area}}\,{\rm{under}}\,{\rm{time}}-{\rm{activity}}\,{\rm{curve}}}=\frac{{\rm{D}}}{{\int }_{0}^{\infty }c(t){\rm{d}}t}$$

Measurements of serum creatinine, serum cystatin C, and the 24-hour urine creatinine clearance

The serum creatinine (SCr) of individuals was evaluated by an enzymatic assay with the COBAS INTRGRA® 400 plus autoanalyzer (Roche Diagnostic, Indianapolis, IN, USA) adjusted with a traceable high-level IDMS reference. Serum cystatin C (CysC) was measured by an automated particle-enhanced turbidimetric immunoassay (PETIA) on an ARCHITECT AEROSET analyzer (Abbott Diagnostics, IL, USA). The coefficient of variation for the serum CysC assay was 2.1%. Both SCr and serum CysC were measured within 30 days of the 99mTc-DTPA–reference GFR measurement. No patient-identifiable data were used. Anonymized data included age, sex, height, weight, BSA, blood pressure, SCr, serum CysC, and serum albumin, all measured on the same day. Body composition was assessed by bioimpedance analysis using a Body Composition Analyzer (InBody 230, Biospace Corp., Seoul, Korea).

Evaluation of renal function by the eGFR

Seven different commonly used methods of GFR estimation were tested in this study, including the re-expressed MDRD study equation with the Thai racial factor, the CKD-EPI equation with and without the BSA adjustment, and the 2012 CKD-EPI creatinine-cystatin C, Cockcroft-Gault, Thai eGFR, and Janowitz and Williams equations, as shown in Table 1. It is interesting to note that the estimated GFR calculated from all of the selected equations, except the Janowitz and Williams equations and Cockcroft-Gault equation, are already adjusted for BSA by intrinsic design; therefore the unit is already expressed as “mL/min/1.73 m2” without the necessity for BSA adjustment in calculated eGFR values”. The units of the Janowitz and Williams equations and estimated creatinine clearance by Cockcroft-Gault equation express as “mL/min”3,19. In addition, a BSA-unadjusted GFR for those equations are calculated by the following formulae: BSA-unadjusted GFR (mL/min) = eGFR (mL/min/1.73 m2) x [BSA (m2)/1.73].

Table 1 Estimated glomerular filtration rate (eGFR) equations used in the present study.

Statistical analysis

The baseline characteristics of the patients are presented as the mean ± standard deviation (SD). Other data are presented as median ± interquartile ranges (IQR). Student’s t-test or the Mann–Whitney U test and the χ2 or Fischer’s exact test were conducted to compare continuous variables and categorical variables, respectively. Bland-Altman plots were used to assess the agreement between the reference GFR and eGFR22. The difference between the reference GFR and eGFR (reference GFR minus eGFR) was also calculated. The performances of the eGFR equations were evaluated for bias and precision. Bias measurements were expressed as the mean error (ME)23. Meanwhile, precision was defined as the standard deviation (SD) of the mean absolute difference24. Accuracy was defined as the root-mean square error (RMSE), which was calculated according to the following formula (n represents the sample size):25

$${\rm{RMSE}}=\sqrt{\frac{{\sum }_{i=1}^{{\rm{n}}}{({{\rm{P}}}_{i}-{{\rm{O}}}_{i})}^{2}}{{\rm{n}}}}$$

In addition to the RMSE, the accuracy of the equations was also calculated using the percentage of the eGFR falling within the range of 10%, 15%, and 30% of the reference GFR. Statistical analyses were performed using STATA version 13.1 (StataCorp., College Station, TX, USA). A p-value < 0.05 was considered a statistically significant difference.

Results

Participants’ baseline characteristics

The patient characteristics are summarized in Table 2. A total of 320 cancer patients were studied, of which 299 (93.4%) and 21 (6.6%) patients had solid malignancy and hematologic malignancy, respectively. The median 99mTc-DTPA clearance (the reference GFR) was 50.4 mL/min/1.73 m2 (interquartile range [IQR] from 32.6 to 86.6 mL/min/1.73 m2), with almost 80% of patients categorized with stages G1–G3b of chronic kidney disease (CKD) according to the KDIGO classification. Notably, there was no participant with an extreme GFR (i.e., greater than 150 mL/min/1.73 m2) during the observation period. The average body mass index (BMI) and body surface area (BSA) were 21.6 ± 3.1 kg/m2 and 1.68 ± 0.2 m2, respectively. The mean serum creatinine (SCr) was 2.5 ± 1.6 mg/dL (95% confidence interval [CI] of 1.48 to 3.29 mg/dL). In addition, the median muscle mass and soft lean mass were 22.5 ± 5.8 and 39.6 ± 8.7 kg, respectively, which was significantly lower than those in normal-weight and lean populations26 (p < 0.01).

Table 2 Baseline characteristics of participants.

Difference between the reference GFR and the GFR estimated from various equations

The performances of seven published models of estimated GFR (eGFR) (see Methods) in patients with cancer were compared with those of the reference GFR. Among them, the eGFR from the BSA-unadjusted CKD-EPI equation demonstrated the greatest accuracy according to the root-mean square error (RMSE) (6.15 mL/min; 95% CI, 5.82 to 7.61 mL/min) with the least bias (mean error [ME], 1.06 mL/min; 95% limits of agreement, −10.83 to 12.95 mL/min). The novel model of the Janowitz and Williams equation was the third most accurate and least biased model for the eGFR; the RMSE and ME were 8.96 mL/min (95% CI, 6.96 to 9.77 mL/min) and 2.03 mL/min (95% limits of agreement, −15.11 to 19.16 mL/min), respectively. For the re-expressed MDRD study equation with the Thai racial factor, the RMSE and ME were 15.97 mL/min (95% CI, 14.96 to 17.38 mL/min) and −7.70 mL/min (95% limits of agreement, −35.17 to 19.78 mL/min), respectively. For the Thai eGFR equation, the RMSE and ME were 14.16 mL/min (95% CI, 13.08 to 16.31 mL/min) and −8.73 mL/min (95% limits of agreement, −31.36 to 13.89 mL/min), respectively. Notably, the 2012 CKD-EPI creatinine-cystatin C equation demonstrated the most bias with the least accuracy compared with the other equations (Table 3). We also determined the effect of adjusting BSA on various estimated GFR accuracy (RMSE) as shown in Table 4.

Table 3 The means of the reference GFR and the eGFRs calculated by the different eGFR equations. The bias between the mean eGFR and the reference GFR and the range of the bias are shown.
Table 4 Comparisons between the accuracy (determined by the root-mean square error (RMSE)) of various estimated glomerular filtration rate (eGFR) model (BSA-adjusted vs. BSA-unadjusted) equations and the reference GFR.

Diagnostic performance of various estimated GFR equations compared to the reference GFR

The agreement between the measurements by Bland-Altman and residual plots indicated that the BSA-unadjusted CKD-EPI equation showed the most accurate, least biased, and least heteroscedastic results, i.e., the most constant variance in different subpopulations, compared to those from the other equations (Fig. 1). Regarding sex differences, the BSA-unadjusted CKD-EPI equation demonstrated the most homogeneity between male and female patients compared to the other eGFR equations. Notably, the Thai eGFR equation clearly demonstrated an overestimation of GFR in males in comparison to that in females (Fig. 1).

Figure 1
figure 1

Bland-Altman plots of estimated GFR (eGFR) versus the reference GFR for each model’s equation are shown. The mean of the reference GFR and eGFR was plotted against the difference between the two. Positive and negative differences indicate under- and overestimation, respectively. The plots are shown in ascending order of the precision of the eGFR from top left to bottom right, where the precision is calculated by the root-mean-squared error. The solid black line on each plot represents the mean of the difference, the solid gray line marks the line of identity, and the dashed line is drawn at the mean ± 1.96 times the standard deviation of the difference. Points are colored by sex (blue and orange represent female and male, respectively). BSA, body surface area; CKD-EPI, Chronic Kidney Disease Epidemiology Collaboration; MDRD, Modification of Diet in Renal Disease.

We also investigated the utility of these eGFR equations with the reference GFR in the CKD population grouped according to GFR range as following: i) GFR ≥60 mL/min, ii) GFR 30–59 mL/min, and iii) GFR <30 mL/min. As shown in Fig. 2, the BSA-unadjusted CKD-EPI equation was the least biased model for estimating the GFR, illustrated by the violin plot in all CKD categories. Although the Cockcroft-Gault equation was the second least biased model calculated by ME (Table 2), it underestimated the GFR, particularly in patients with GFR ≥60 mL/min (Fig. 2A). Similar to the BSA-unadjusted CKD-EPI equation, both the Janowitz and Williams equation and the CKD-EPI equation yielded estimates that were compatible with the reference GFR (i.e., less different from the reference GFR) in all GFR ranges. Meanwhile, both the Thai eGFR equation and the re-expressed MDRD study equation with the Thai racial factor demonstrated overestimation of the GFR in advanced CKD (Fig. 2B,C).

Figure 2
figure 2

Violin plot of the differences between the model equations’ outcomes and the reference GFR according to the GFR ranges: (A) GFR ≥60 mL/min, (B) GFR 30–59 mL/min, and (C) GFR <30 mL/min. The solid black lines in the left panels refer to the medians of the eGFR for each eGFR model, while the black circles on the right panels represent the medians of the difference for each eGFR model. Positive and negative differences indicate over- and underestimation, respectively. BSA, body surface area; CKD-EPI, Chronic Kidney Disease Epidemiology Collaboration; MDRD, Modification of Diet in Renal Disease.

Sensitivity and specificity of the eGFR equations for identifying various CKD stages

The performances of the published models were also analyzed according to the KDIGO classification (CKD stage G1–G5), as shown in Table 5. The re-expressed MDRD study equation with the Thai racial factor demonstrated the highest sensitivity (91.7%) and specificity (100%) in CKD stage G1. Meanwhile, the BSA-unadjusted CKD-EPI equation was the model with the best performance across CKD stages G2–G5. Interestingly, most of the published models showed less sensitivity and specificity in advanced CKD. It should be noted that only the CKD-EPI equation, regardless normalization by BSA, was suitable for determining CKD stage G5 based on the eGFR. In fact, the greatest sensitivity (89.7%) and specificity (100%) for CKD stage G5 were demonstrated by the BSA-unadjusted CKD-EPI equation.

Table 5 The performances of published estimated glomerular filtration rate (GFR) models for chronic kidney disease determination.

Discussion

Our study showed that the body surface area (BSA)-unadjusted CKD-EPI equation showed the best performance for GFR estimation in terms of both precision and accuracy, followed (in order) by the CKD-EPI equation as well as the Janowitz and Williams equation for patients with cancer, the Cockcroft-Gault equation, and the Thai eGFR equations. Meanwhile, the 2012 CKD-EPI creatinine-cystatin C equation was the least precise and the least accurate eGFR equation in cancer patients as determined by the standard deviation of the absolute difference and root-mean square error (RMSE), respectively.

GFR is currently the standard measurement for determining renal function27, and patients with cancer commonly present with impaired renal function28. At present, there are three most commonly used formulae in oncology worldwide—the Cockcroft-Gault, the MDRD study, and the CKD-EPI equations7,18,19—as well as the Thai eGFR equation, which is being adopted in practice nationwide10. While the CKD-EPI equation is recommended for use in routine clinical practice by the KDOQI and the National Kidney Foundation (NKF), most cancer centers use the MDRD study equation, following the International Society of Geriatric Oncology recommendation5. Nevertheless, the CKD-EPI equation is more accurate than the MDRD study equation in patients with reduced muscle mass, as eGFRs of 45–60 mL/min/1.73 m2 estimated by the MDRD study equation might be estimated as above 60 mL/min/1.73 m2 by the CKD-EPI equation11. Moreover, Asians have been shown to have a higher percentage of body fat for the same level of BMI than Caucasians, suggesting lower levels of muscle mass;29 this suggests ethnic interference and the necessity for robust validation of eGFRs in patients with cancer.

In our study, the BSA-unadjusted CKD-EPI equation was the least biased equation (Figs. 1 and 2); it was less biased than the Cockcroft-Gault equation and the re-expressed MDRD study equation with the Thai racial factor. Although the Cockcroft-Gault equation demonstrated the second least bias of the eGFR equations (mean error 1.43 mL/min), the precision and accuracy were less than the those of BSA-unadjusted CKD-EPI, CKD-EPI, and Janowitz and Williams equations (Table 3). The re-expressed MDRD study equation with the Thai racial factor, a preferable equation for CKD in the Thai population10, showed widest bias in eGFRs < 60 mL/min with a tendency of overestimation (Fig. 2), possibly due to sarcopenia in patients with cancer30. Indeed, the participants in the present study had an 8.5% lower mean muscle mass compared to those of patients with HIV infection (22.5 ± 5.8 vs. 24.6 ± 5.6 kg, p < 0.001), another chronic illness population31. Additionally, the BSA-unadjusted CKD-EPI equation would be more applicable than the re-expressed MDRD study equation for calculation of eGFR in cancer patients with higher sensitivity and specificity in CKD determination, particularly in patients with CKD stage G2–G5 (Table 5). However, the use of BSA in corporation with eGFR formulas should be interpreted with caution particularly in CKD stages of KDIGO because the unit of eGFR in KDIGO naturally presents as mL/min/m24. In other words, there must be no difference between BSA-adjusted equations and BSA-unadjusted equations in term of the KDIGO guideline.

Although the 2012 CKD-EPI creatinine-cystatin C equation was favorable in conditions of low SCr production, such as in the case of loss of muscle mass from limb amputations or neurological diseases32, the 2012 CKD-EPI creatinine-cystatin C eGFRs had low precision and accuracy in our results, possibly due to the lack of patients with cancer during the standardization of this equation13,33. Interestingly, the Thai eGFR equation demonstrated better performance than the 2012 CKD-EPI creatinine-cystatin C equation and the re-expressed MDRD study equation with the Thai racial factor, possibly due to the increased generalizability to the CKD population of the Thai eGFR equation and/or the different methods used for the reference GFR determination10. A further validation study in patients with cancer might be necessary to identify proper serum CysC-based and/or SCr-based eGFR equations for the Thai population. Moreover, the spread of bias among the BSA-unadjusted CKD-EPI, CKD-EPI, and Janowitz and Williams equations from the reference GFR was evenly distributed (Fig. 1) despite the increased deviation from the reference in patients with eGFR <60 mL/min with the Janowitz and Williams equation (Fig. 2B,C). This phenomenon might be explained by the low sensitivity for advanced CKD stage with the Janowitz and Williams equation. Although the Janowitz and Williams equation is a somewhat sophisticated mathematical formula and is weak in its assessment of advanced CKD, it was impressive in assessments of early-stage CKD and is available as an online calculation tool (http://tavarelab.cruk.cam.ac.uk/JanowitzWilliamsGFR/)34.

Given the validation of several common eGFR calculations, the CKD-EPI equation (regardless of BSA adjustment) is the most appropriate for determining the CKD stage in patients with malignancy (malnourishment or severe emaciation are common). Our findings support the 2016 cancer chemotherapy guidelines for treatment of renal injury, which states that i) eGFR (or creatinine clearance) without correcting BSA is used for drugs that the doses are fixed (BSA independent) and ii) eGFR (or creatinine clearance) corrected for BSA is used for drugs that the dose depends on BSA35. Although there is currently no guideline consensus which method of eGFR is preferred in cancer patients, our findings are consistent with the most recent study by Janowitz and colleagues3, which demonstrate better predictive performance of the BSA-unadjusted CKD-EPI over the CKD-EPI equation. While the CKD-EPI equation is recommended for use in routine clinical practice by the KDOQI and the National Kidney Foundation (NKF), the CKD-EPI equation showed less accuracy compared with the BSA-unadjusted CKD-EPI in the present study. This paradox could be explained by the fact that the CKD-EPI equations included populations with mean BSA of 1.93 ± 0.2 m2 and BMI of 28 ± 6 kg/m2, reflecting the large number of overweight participants in the CKD-EPI study7. Interestingly, Levey et al.7 also reported the mean measured GFR of their studied CKD patients of 68 mL/min/1.73 m2 and the mean BSA-unadjusted measured GFR of 75.9 mL/min. Accordingly, the difference of 7.9 mL/min was found after reversing the BSA indexing process among their studied population. In the present study, the CKD-EPI equation showed greater performance over the Janowitz and Williams equation, particularly in CKD with GFR < 30 mL/min, possibly due to (i) the ethnic difference10, (ii) the higher proportion of patients with low muscle mass (and BMI) in our study, iii) the difference in reference eGFR (99mTc-DTPA plasma clearance in the present study versus three different time points of chromium-51 EDTA (51Cr-EDTA) administration in the other study) and iv) the inclusion criteria including both solid and hematologic malignancy in the present study3.

There were several limitations in our study. First, the gold standard renal inulin clearance was not included in the present study. Although the 99mTc-DTPA method may overestimate GFR, particularly in patients with lower BMI36, the comparable inulin method for CKD patients has been mentioned in a large study37. Second, the performance status of most participants was good (ECOG 0–1) due to ethical restrictions. Patients with cachexia might have displayed more deviations in GFR. Third, a small number of patients with paraproteinemia—a disease with low SCr—were included in the present study. However, the exclusion criteria in this study ruled out most of the potential cofounding factors influencing the eGFR assessment. Fourth, the impacts of the different eGFR equations on clinical outcomes, complications, and other aspects of renal dysfunction (i.e., albuminuria and β2-microglobulin) and comparisons of the use of eGFR with the use of actual (reference) GFR were not explored. Further studies are warranted.

Taken together, we propose that the BSA-unadjusted CKD-EPI formula is the most favorable eGFR equation in patients with cancer, followed by the CKD-EPI and the Janowitz and Williams equations. Further validation studies with pharmacokinetic exploration are of interest.