Abstract
Recently, prediction models for type 2 diabetes mellitus (T2DM) in older adults (aged ≥55 year) were developed in the KORA S4/F4 study, Augsburg, Germany. We aimed to externally validate the KORA models in a Dutch population. We used data on both older adults (n = 2,050; aged ≥55 year) and total non-diabetic population (n = 6,317; aged 28–75 year) for this validation. We assessed performance of base model (model 1: age, sex, BMI, smoking, parental diabetes and hypertension) and two clinical models: model 1 plus fasting glucose (model 2); and model 2 plus uric acid (model 3). For 7-year risk of T2DM, we calculated C-statistic, Hosmer–Lemeshow χ2-statistic, and integrated discrimination improvement (IDI) as measures of discrimination, calibration and reclassification, respectively. After a median follow-up of 7.7 years, 199 (9.7%) and 374 (5.9%) incident cases of T2DM were ascertained in the older and total population, respectively. In the older adults, C-statistic was 0.66 for model 1. This was improved for model 2 and model 3 (C-statistic = 0.81) with significant IDI. In the total population, these respective C-statistics were 0.77, 0.85 and 0.85. All models showed poor calibration (P < 0.001). After adjustment for the intercept and slope of each model, we observed good calibration for most models in both older and total populations. We validated the KORA clinical models for prediction of T2DM in an older Dutch population, with discrimination similar to the development cohort. However, the models need to be corrected for intercept and slope to acquire good calibration for application in a different setting.
Similar content being viewed by others
Abbreviations
- ARICA:
-
Atherosclerosis risk in communities
- BMI:
-
Body mass index
- DESIR:
-
Data from the epidemiological study on the insulin resistance syndrome
- FINDRISC:
-
Finnish diabetes risk score
- HbA1c:
-
Glycosylated hemoglobin
- IDI:
-
Integrated discrimination improvement
- KORA:
-
Cooperative health research in the region of Augsburg
- PREVEND:
-
Prevention of renal and vascular end stage disease
References
Wild S, Roglic G, Green A, Sicree R, King H. Global prevalence of diabetes: estimates for the year 2000 and projections for 2030. Diabetes Care. 2004;27:1047–53.
Diabetes Prevention Program Research Group. 10-year follow-up of diabetes incidence and weight loss in the diabetes prevention program outcomes study. Lancet. 2009;374:1677–86.
Schmidt MI, Duncan BB, Bang H, et al. Identifying individuals at high risk for diabetes: the atherosclerosis risk in communities study. Diabetes Care. 2005;28:2013–8.
Buijsse B, Simmons RK, Griffin SJ, Schulze MB. Risk assessment tools for identifying individuals at risk of developing type 2 diabetes. Epidemiol Rev. 2011;33:46–62.
Stolk RP, Hutter I, Wittek RP. Population ageing research: a family of disciplines. Eur J Epidemiol. 2009;24:715–8.
Lindström J, Tuomilehto J. The diabetes risk score: a practical tool to predict type 2 diabetes risk. Diabetes Care. 2003;26:725–31.
Kahn HS, Cheng YJ, Thompson TJ, Imperatore G, Gregg EW. Two risk-scoring systems for predicting incident diabetes mellitus in U.S. adults age 45–64 years. Ann Intern Med. 2009;150:741–51.
Wilson PW, Meigs JB, Sullivan L, Fox CS, Nathan DM, D’Agostino RB Sr. Prediction of incident diabetes mellitus in middle-aged adults: the framingham offspring study. Arch Intern Med. 2007;167:1068–74.
Balkau B, Lange C, Fezeu L, et al. Predicting diabetes: clinical, biological, and genetic approaches: data from the epidemiological study on the insulin resistance syndrome (DESIR). Diabetes Care. 2008;31:2056–61.
Griffin SJ, Little PS, Hales CN, Kinmonth AL, Wareham NJ. Diabetes risk score: towards earlier detection of type 2 diabetes in general practice. Diabetes Metab Res Rev. 2000;16:164–71.
Noble D, Mathur R, Dent T, Meads C, Greenhalgh T. Risk models and scores for type 2 diabetes: systematic review. BMJ. 2011;343:d7163.
Vischer UM, Safar ME, Safar H, et al. Cardiometabolic determinants of mortality in a geriatric population: is there a ‘reverse metabolic syndrome’? Diabetes Metab. 2009;35:108–14.
Weiss A, Boaz M, Beloosesky Y, Kornowski R, Grossman E. Body mass index and risk of all-cause and cardiovascular mortality in hospitalized elderly patients with diabetes mellitus. Diabet Med. 2009;26:253–9.
de Ruijter W, Westendorp RG, Assendelft WJ, et al. Use of framingham risk score and new biomarkers to predict cardiovascular mortality in older people: population based observational cohort study. BMJ. 2010;338:a3083.
Rathmann W, Kowall B, Heier M, et al. Prediction models for incident type 2 diabetes mellitus in the older population: KORA S4/F4 cohort study. Diabet Med. 2010;27:1116–1123.
Rathmann W, Martin S, Haastert B, et al. KORA study group. performance of screening questionnaires and risk scores for undiagnosed diabetes: the KORA survey 2000. Arch Intern Med. 2005;165:436–41.
Rathmann W, Haastert B, Icks A, et al. High prevalence of undiagnosed diabetes mellitus in Southern Germany: target populations for efficient screening. The KORA survey 2000. Diabetologia. 2003;46:182–9.
Lambers Heerspink HJ, Brantsma AH, de Zeeuw D, et al. Albuminuria assessed from first-morning-void urine samples versus 24-h urine collections as a predictor of cardiovascular morbidity and mortality. Am J Epidemiol. 2008;168:897–905.
Abbasi A, Corpeleijn E, Postmus D, et al. Plasma procalcitonin and risk of type 2 diabetes in the general population. Diabetologia. 2011;54:2463–5.
Steyerberg EW, Vickers AJ, Cook NR, et al. Assessing the performance of prediction models: a framework for traditional and novel measures. Epidemiology. 2010;21:128–38.
Janssen KJ, Moons KG, Kalkman CJ, Grobbee DE, Vergouwe Y. Updating methods improved the performance of a clinical prediction model in new patients. J Clin Epidemiol. 2008;61:76–86.
Altman DG, Vergouwe Y, Royston P, Moons KG. Prognosis and prognostic research: validating a prognostic model. BMJ. 2009;338:b605.
Vergouwe Y, Moons KG, Steyerberg EW. External validity of risk models: use of benchmark values to disentangle a case-mix effect from incorrect coefficients. Am J Epidemiol. 2010;172:971–80.
Acknowledgments
This work was supported by the Netherlands Heart Foundation, Dutch Diabetes Research Foundation and Dutch Kidney Foundation. This research was performed within the framework of CTMM, the Center for Translational Molecular Medicine (www.ctmm.nl); project PREDICCt (grant 01C-104-07). We thank Prof. Dr. L.T.W. de Jong-van den Berg and Dr. S.T. Visser from the Department of Social Pharmacy, Pharmacoepidemiology and Pharmacotherapy, Groningen University Institute for Drug Exploration, University Medical Center Groningen and University of Groningen, The Netherlands for providing the data on use of glucose-lowering agents according to central pharmacy registration. The Diabetes Cohort Study was funded by a German Research Foundation project grant to W. Rathmann (DFG;RA 459/2–1). The KORA research platform and the KORA Augsburg studies are financed by the Helmholtz Zentrum München, German Research Center for Environmental Health, which is funded by the German Federal Ministry of Education, Science, Research and Technology and by the State of Bavaria. We thank the field staff in Augsburg who were involved in the conduct of the studies. The German Diabetes Center is funded by the German Federal Ministry of Health and the Ministry of Innovation, Science, Research and Technology of the State of North Rhine Westphalia. None of the study sponsors had a role in study design; in data collection, analysis, or interpretation; in writing the report; or in the decision to submit for publication.
Conflict of interest
No duality of interest relevant to this manuscript is declared.
Author information
Authors and Affiliations
Corresponding author
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Abbasi, A., Corpeleijn, E., Peelen, L.M. et al. External validation of the KORA S4/F4 prediction models for the risk of developing type 2 diabetes in older adults: the PREVEND study. Eur J Epidemiol 27, 47–52 (2012). https://doi.org/10.1007/s10654-011-9648-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10654-011-9648-4