Progression to microalbuminuria in type 1 diabetes: development and validation of a prediction rule
- 845 Downloads
Microalbuminuria is common in type 1 diabetes and is associated with an increased risk of renal and cardiovascular disease. We aimed to develop and validate a clinical prediction rule that estimates the absolute risk of microalbuminuria.
Data from the European Diabetes Prospective Complications Study (n = 1115) were used to develop the prediction rule (development set). Multivariable logistic regression analysis was used to assess the association between potential predictors and progression to microalbuminuria within 7 years. The performance of the prediction rule was assessed with calibration and discrimination (concordance statistic [c-statistic]) measures. The rule was validated in three other diabetes studies (Pittsburgh Epidemiology of Diabetes Complications [EDC] study, Finnish Diabetic Nephropathy [FinnDiane] study and Coronary Artery Calcification in Type 1 Diabetes [CACTI] study).
Of patients in the development set, 13% were microalbuminuric after 7 years. Glycosylated haemoglobin, AER, WHR, BMI and ever smoking were found to be the most important predictors. A high-risk group (n = 87 [8%]) was identified with a risk of progression to microalbuminuria of 32%. Predictions showed reasonable discriminative ability, with c-statistic of 0.71. The rule showed good calibration and discrimination in EDC, FinnDiane and CACTI (c-statistic 0.71, 0.79 and 0.79, respectively).
We developed and validated a clinical prediction rule that uses relatively easily obtainable patient characteristics to predict microalbuminuria in patients with type 1 diabetes. This rule can help clinicians to decide on more frequent check-ups for patients at high risk of microalbuminuria in order to prevent long-term chronic complications.
KeywordsMicroalbuminuria risk Prediction model Progression Type 1 diabetes
Coronary Artery Calcification in Type 1 Diabetes
Epidemiology of Diabetes Complications
- EURODIAB PCS
European Diabetes Prospective Complications Study
Finnish Diabetic Nephropathy study
Microalbuminuria is common in type 1 diabetes. Of patients with type 1 diabetes, 30 to 60% progress to microalbuminuria within 10 to 20 years [1, 2]. Various risk factors have been found for the progression to microalbuminuria including: hyperglycaemia, hyperlipidaemia, (central) obesity, hypertension and smoking [2, 3, 4, 5].
Patients with microalbuminuria have elevated risks of diabetic renal disease [6, 7] and cardiovascular disease . Timely prediction of progression to microalbuminuria in patients with type 1 diabetes is therefore of major importance. Accurate identification of patients at high risk of microalbuminuria at an early stage can guide disease management in order to prevent further complications. Intervention in high-risk patients may be beneficial, although data to support this are inconclusive.
Prediction of microalbuminuria progression is rarely studied [2, 5]. Only one prediction rule has been proposed before . This rule uses arbitrary dichotomisation of various continuous predictor values (HbA1c and AER). Further, selection of the predictors was based on a p value of 0.05, which is considered conservative in prediction modelling. Both strategies potentially lead to an optimistic or overfitted prediction rule [9, 10]. Moreover, the prediction rule was not validated in an independent sample.
Using state of the art methods in prediction modelling, we therefore developed and externally validated a clinical prediction rule for estimating risk of progression to microalbuminuria in patients with type 1 diabetes. We used data from large prospective cohort studies of type 1 diabetes. The rule was developed with data from the European Diabetes Prospective Complications Study (EURODIAB PCS)  and validated in US patients treated in a similar time period (Pittsburgh Epidemiology of Diabetes Complications [EDC]) study . Since treatment policies have changed over the years, we also studied the validity of the rule in two more contemporary studies, i.e. the Finnish Diabetic Nephropathy study (FinnDiane)  and the Coronary Artery Calcification in Type 1 Diabetes study (CACTI) .
We used data from the EURODIAB PCS to develop the prediction rule (development set). Full details of the design, methods and recruitment have been published elsewhere . In brief, the study was designed to investigate risks and determinants of microvascular complications in type 1 diabetes patients. The EURODIAB PCS cohort included patients from 31 centres in 16 European countries.
Type 1 diabetes was defined as a diagnosis made before the age of 36 with continuous insulin treatment within 1 year of diagnosis. Patient measurements were taken at baseline (1990–1991) and at 7 years follow-up (1997–1999). Patients were included in the present analysis if they had a normal AER, i.e. below 20 μg/min, at baseline and a normal AER or microalbuminuria (AER between 20 and 200 μg/min) at follow-up.
We used data from three studies to externally validate the prediction rule (validation sets): the EDC study, FinnDiane and CACTI. The EDC study is a hospital-based incidence cohort from the Children’s Hospital of Pittsburgh, USA, set up to investigate risk factors for complications of these patients . After the baseline examination (1986–1988), patients were re-examined biennially. The FinnDiane study is a nationwide, multicentre study with the aim to identify genetic and clinical risk factors for diabetic nephropathy in type 1 diabetes . Patients have been followed since the baseline examination (1998). The CACTI study is a prospective cohort study designed to assess risk factors associated with the development and progression of subclinical coronary artery disease . Baseline examination was performed between 2000 and 2002. All three studies are ongoing. For the present analysis, follow-up measurements 7 years after inclusion were taken to assess the development of microalbuminuria. The same inclusion criteria were used as for the development set.
Microalbuminuria (yes/no) was determined 7 years after inclusion and defined as an AER between 20 and 200 μg/min. In EURODIAB PCS, the average of two 24 h urine samples was used for classification. Albumin concentrations were assessed with an immunoturbidimetric  method that included goat anti-human albumin antisera (Sanofi Diagnostics Pasteur, Chaska, MN, USA) and human serum albumin standards (ORHA 20/21 grade HAS; Behring Diagnostics, Hoechst UK, Hounslow, UK). Proteinuria due to urinary tract infection was excluded.
In the EDC study, an immuno-nephelometric method was used  and the median AER was calculated on the basis of three urine samples (24 h, overnight and 4 h post-clinic) or the average AER if only two samples were available. In the FinnDiane study, AER was calculated from a single 24 h urine collection, which was measured by immunoturbidimetry. The actual classification of patients was based on two out of three consecutive urine samples. In the CACTI study, AER was calculated from urinary albumin measured using RIA in two timed overnight urine samples with the results from the two nights being averaged.
The patient characteristics available in the EURODIAB PCS dataset were critically reviewed using the literature and clinical expertise. The following characteristics were considered to be possibly predictive for microalbuminuria: age, sex, duration of diabetes, HbA1c, AER, fasting triacylglycerol, non-HDL- and LDL-cholesterol, WHR, BMI, pulse pressure, hypertension and smoking. HbA1c was measured with an enzyme immunoassay using a monoclonal antibody. The HbA1c values obtained were converted to DCCT values . One 24 h urine sample was analysed to determine the AER. Serum lipids were measured with standard enzymatic methods. Non-HDL-cholesterol was calculated as the total cholesterol level minus the HDL level. Height, weight, and waist and hip circumference were measured in a standardised way to calculate BMI and WHR. Blood pressure was measured by a random zero sphygmomanometer and the mean of two measurements taken. Pulse pressure was calculated as systolic minus diastolic pressure. Hypertension was defined as a systolic pressure of 140 mmHg or more, a diastolic pressure of 90 mmHg or more, or the current use of blood-pressure-lowering medication. Smoking status was dichotomised into ever vs never smokers.
In the EURODIAB PCS, 355 patients had values missing for one or more predictors. The average percentage of missing values per predictor was 3%. We imputed missing data using the linear-regression method with addition of a random-error term (single imputation) available in SPSS software (version 12.0; SPSS, Chicago, IL, USA).
Logistic regression was used to estimate univariable and multivariable regression coefficients, and odds ratios with 95% CIs for each predictor. The nature of the association between continuous predictors and risk of microalbuminuria was studied with restricted cubic splines with three knots (two df). The restricted cubic splines were plotted and approximated with simple transformations. The simplest transformation is a linear term. Other possible transformations included the natural logarithm, square and square root.
A full multivariable model was fitted that included all candidate predictors with chosen transformations. The number of predictors was reduced with backward stepwise selection. We applied Akaike’s information criterion  for predictor selection, which corresponds to a p value of 0.157 for a predictor with one regression coefficient. Interaction terms between predictors were assessed, but not included because their predictive effects were very limited. The regression coefficients in the final model were multiplied with a shrinkage factor, which was estimated with bootstrapping [9, 18]. Shrinkage is applied to obtain accurate predictions for new patients; without shrinkage, predictions are in general too extreme, resulting in low predictions being too low and high predictions too high.
The described analytical strategy to develop the prediction rule is in accordance with the current state of the art . The strategy aims to develop a prediction rule that can provide accurate predictions for future patients rather than predictions that are correct for patients of the development dataset. Therefore, the selection of predictors in the model is based on multivariable modelling only with a backward selection procedure and liberal p value (0.157 in this study). Use of higher p values results in inclusion of relatively weaker predictors in the model at the cost of possible selection of a nuisance variable. Such a model performs well in new patients . Further, the backward selection procedure starts with a limited number of candidate predictors with continuous variables studied in their original form (i.e. continuously). Dichotomising or categorising continuous variables may be seen as introducing an extreme form of rounding, with an inevitable loss of information .
The final model with the shrunken regression coefficients was presented as a score chart to facilitate clinical application. Scores were calculated by dividing the products of regression coefficients and predictor values by the smallest product. A constant was subtracted or added to rescale the scores in positive integers. The sum scores were then related to predicted risks.
The performance of the prediction rule was studied in terms of calibration (i.e. agreement between predicted risks and observed proportions of microalbuminuria) and discrimination. Discrimination was expressed with a concordance statistic (c-statistic), which is similar to the area under the receiver-operating characteristic curve when dichotomous outcomes are considered . The performance was studied in 100 bootstrap samples (internal validation) and in the independent validation sets of the EDC, FinnDiane and CACTI studies (external validation). Internal validation gives an impression of how much the performance of the prediction rule may deteriorate when applied to a new patient sample from the same population. External validation indicates how generalisable the prediction rule is to similar patients from other populations.
Development of prediction rule
Characteristics of patients in the development and validation sets
EURODIAB PCS (1990–1991)
Male sex, n (%)
Diabetes duration (years)
Fasting triacylglycerol (mmol/l)a
BMI, men (kg/m2)
BMI, women (kg/m2)
Diastolic pressure (mmHg)
Systolic pressure (mmHg)
Pulse pressure (mmHg)
Hypertension, n (%)
Ever smoked, n (%)
Outcome at follow-up
Microalbuminuria, n (%)
Univariable associations of patient characteristics assessed at baseline with progression to microalbuminuria
Multivariable associations of selected predictors for progression to microalbuminuria
HbA1c (%), transformedb
Observed proportions and predicted risks of microalbuminuria among four risk groups in the development set (EURODIAB PCS) and validation sets (EDC, FinnDiane and CACTI)
Mean predicted risk
Mean predicted risk
Mean predicted risk
Mean predicted risk
External validation of the prediction rule
The EDC patients were slightly younger than patients of the development set (mean age 26 years compared with 33 years). The FinnDiane and CACTI patients were slightly older (36 and 37). Occurrence of hypertension varied between 1% (EDC) and 32% for the validation sets, with 13% in the development set. Progression to microalbuminuria occurred in 18% (EDC), 8% (FinnDiane) and 6% (CACTI) of patients (Table 1).
Most of the microalbuminuric patients were categorised in one of the two groups with the highest risk: 27/34 (79%) for EDC, 81/96 (84%) for FinnDiane and 16/20 (80%) for CACTI (Table 4), which is similar to the results found in the development set. The discriminative ability of the prediction rule was similar to that in the development set for the EDC patients with c-statistic = 0.72. The discriminative ability was even better in the FinnDiane and CACTI patients (c-statistic = 0.79 in both).
The mean predicted risks in the two datasets with recently treated patients (FinnDiane and CACTI) were higher than the observed proportions of microalbuminuria (13% predicted risk and 8% observed in FinnDiane, 11% and 6% in CACTI). We adjusted the intercept of the prediction rule in such a way that the mean predicted risk agrees with the observed proportion of microalbuminuria (intercept changes from −9.88 to −10.14).
We developed and validated a clinical prediction rule that can be used to predict progression from normal AER to microalbuminuria in type 1 diabetes patients. First, we identified a series of predictors for the risk of progression to microalbuminuria within a period of 7 years. The following five characteristics predominantly contributed to prediction in a multivariable logistic regression model: HbA1c, AER, WHR, BMI and ever smoking. These predictors can be relatively easily obtained by physical examination and laboratory tests. External validation of the prediction rule in three independent patient samples showed good performance.
HbA1c and baseline AER have consistently been shown to be important predictors of microalbuminuria [2, 3, 4, 5, 22] and were also included in a previous model developed by Rossing and co-workers . Smoking was also included in both models. In contrast, BMI and WHR were included in the present model, but were not considered in the development of the Rossing model, which did, however, include retinopathy. We found with the EURODIAB data that the present model discriminated patients with microalbuminuria from those with normal AER better than the Rossing model, which included retinopathy (c-statistics 0.69 and 0.65 respectively). A model that included the four predictors of the Rossing model (HbA1c, AER, current smoking and any retinopathy) fitted with the EURODIAB PCS data showed a c-statistic of 0.66. The additive predictive value for WHR in a model that already includes BMI indicates that central obesity contains different information than general obesity. This is confirmed by the relatively low correlation between WHR and BMI (Pearson correlation r = 0.21). The differences in effect of central and general obesity have also been described for the risk of cardiovascular events .
The predictors hyperglycaemia and central obesity are part of the insulin resistance syndrome . Insulin resistance is also a risk factor for the development of diabetic complications. We further studied the added value of insulin sensitivity with the amount of fasting insulin (per kg body weight). However, this factor did not have added value in our model (p = 0.53).
Continuous predictors are best included in a model as such and not categorised . In this way, all information is used for the prediction. Continuous variables do not necessarily have to be included as linear terms. We found that logarithmic transformation of HbA1c predicts the risk of microalbuminuria better than the frequently used linear values. The nature of the relation between AER and risk of microalbuminuria was linear, although a logarithmic transformation of AER is frequently used [3, 5]. Apparently, a logarithmic transformation of AER is only necessary to estimate correct values of the mean and standard deviation, given the skewed distribution of AER.
We studied the generalisability of our prediction rule with respect to place (EDC), time (FinnDiane) and time and place (CACTI). The US cohort (EDC) with patients treated in the same time period as the patients from the development set (the 1990s) showed similar discriminative ability of the prediction rule (c-statistic = 0.71 compared with 0.69 in the development set). C-statistic values around 0.7 indicate reasonable discriminative ability for prognostic models. Prediction of an event later in time (here 7 years) is more difficult than prediction of an event shortly after the baseline measurement. Furthermore, the predicted risks were reasonably in agreement with the observed proportions of microalbuminuria (Table 4).
It was particularly important to study the generalisability of the prediction rule in time, since treatment of type 1 diabetes patients with normal AER has changed. Nowadays, ACE inhibitors and statins are prescribed more frequently to lower blood pressure and lipid plasma concentrations respectively. The use of these medications has been shown to affect the transition from normo- to microalbuminuria in type 1 diabetes patients [25, 26], as was also apparent from our data. The incidence of microalbuminuria was only 7.7% in FinnDiane and 6.0% in CACTI compared with 13% in the earlier development sample. Indeed, predicted risks were too high for the patients from the FinnDiane and CACTI studies. However, the model was well able to discriminate between patients with and without microalbuminuria. Therefore, a simple recalibration step was sufficient to make the rule valid for recently treated patients.
The clinical implications of our study are that risk of microalbuminuria can be established at an early stage and patient management tailored to risk levels. We categorised the patients into four risk groups with scores 2 to 10, 11 to 15, 16 to 20, and 21 and higher. The highest two risk groups together contained 77% (110/143) of all microalbuminuric patients of the development set and 79%, 80% and 84% of all microalbuminuric patients of the validation sets. We would advocate offering these high-risk patients more frequent check-ups than once a year, perhaps together with the quarterly routine visit and with an overnight or 24 h urine collection to measure the albumin:creatinine ratio. Current surveillance protocols recommend follow-up of patients more frequently than once a year only after an abnormal surveillance result. Under this protocol, a considerable proportion of new microalbuminuria cases will be recognised later than necessary. The identification, by our prediction rule, of a group of patients with normal AER and at high risk of progressing to microalbuminuria might facilitate the early introduction of ACE inhibitor or angiotensin receptor blocker therapy, if trials currently under way suggest benefit. Glycaemic control could also be intensified and other risk factors for microalbuminuria, e.g. smoking, BMI and WHR could be more strictly controlled than is usual. It is currently unknown whether such intervention strategies based on our prediction rule would be of benefit; this should be the focus of future research.
Unfortunately, the model predicts for one occasion only, i.e. after 7 years of follow-up. The assessment of the outcome only after 7 years has two implications. First, we do not have information on time of onset of microalbuminuria. Time-to-event analysis, e.g. with Cox proportional hazards regression analysis, was therefore not possible. Second, we do not know how many patients remain microalbuminuric and how many regress. Several studies have shown regression of microalbuminuria in type 1 diabetes patients [2, 27, 28]. Cumulative incidences of regression vary between 13% and 56% and are mainly induced by intensive therapy. Only few patients with microalbuminuria undergo spontaneous regression that is permanent (around 15%) . Consequently, our rule may only slightly overestimate a patient’s risk of progression to microalbuminuria.
In conclusion, we developed a prediction rule to estimate the risk of progressing to microalbuminuria in individual type 1 diabetes patients. The rule was developed in a European cohort and externally validated in two US cohorts and another European cohort. We believe that this prediction rule could be used to divide patients into different risk categories. Such risk categories could guide surveillance recommendations and ultimately improve the prevention of long-term chronic complications.
We would like to thank all study participants who volunteered their time, all the staff involved in the EURODIAB PCS, EDC, FinnDiane and CACTI studies, and all investigators and consultants. EURODIAB PCS was financially supported by the Wellcome Trust, the European Community and Diabetes UK. The EDC study was supported by National Institutes of Health Grant R01 DK34818. The FinnDiane Study was supported by the Folkhälsan Research Foundation, Wilhelm and Else Stockmann Foundation, Liv och Hälsa Foundation, Signe and Ane Gyllenberg Foundation, Sigrid Juselius Foundation and the European Commission (QLG2-CT-2001-01669; LSHB-CT-2003-503364 and LSHB-CT-2006-037681). Support for the CACTI study was provided by the National Institutes of Health grants R01 HL61753 and R01 HL079611, American Diabetes Association grant 7-09-CVD-06 and Diabetes Endocrinology Research Center Clinical Investigation Core P30 DK57516. The study was performed at the Adult General Clinical Research Center at the University of Colorado Denver Anschutz Medical Center (supported by NIH grant M01 RR000051) and at the Barbara Davis Center for Childhood Diabetes. Y. Vergouwe and K. G. M. Moons were supported by the Netherlands Organization for Scientific Research Grant ZON-MW 917.46.360.
Duality of interest
The authors declare that there is no duality of interest associated with this manuscript.
This article is distributed under the terms of the Creative Commons Attribution Noncommercial License which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.
- 18.Efron B, Tibshirani RJ (1993) An introduction to the bootstrap. Chapman and Hall, LondonGoogle Scholar