Introduction

Whether or not screening for undiagnosed type 2 diabetes in asymptomatic individuals is cost-effective is unknown, and policy statements on this topic are controversial. To some it is self-evident that screening should be commenced, given the rapidly increasing prevalence of type 2 diabetes [1], the fact that around 50% of individuals with type 2 diabetes are undiagnosed [1], that 20–30% have complications at clinical diagnosis, and that individuals with type 2 diabetes have a two- to four-fold increased risk of dying from cardiovascular disease (CVD) [2]. To others the evidence that screening is an appropriate public policy is less clear cut, and recommendations focus on screening high-risk groups rather than the whole population [3, 4].

In the absence of definitive trial evidence of the net benefits of a programme of screening and subsequent treatment, modelling is an appropriate alternative approach to inform public health strategy. This has previously been undertaken for the effects of screening on the microvascular complications of diabetes [5], but there are few models focusing on macrovascular disease [6], which is, by far, the greater public health problem associated with diabetes. Furthermore, no studies have modelled the combined effect of treatment of hyperglycaemia, hypertension and dyslipidaemia in people with screen-detected diabetes. In this paper we report initial results from a model of screening, with an emphasis on identifying the parameters within the model that have the greatest impact on the estimates of cost-effectiveness. This use of modelling can inform decisions about priorities for research as it can identify important but poorly estimated parameters that can be more accurately quantified in future studies.

Subjects and methods

The model

Figure 1 outlines the components of the model to estimate the costs and benefits of screening and treatment for type 2 diabetes, with benefit expressed in terms of CHD events prevented over 5 years. Two classes of inputs have been specified: those that concern underlying parameters that predict screening compliance, baseline risk, treatment risk reduction and cost, and choices concerning screening and treatment strategies. For a range of parameter assumptions and strategy choices, the model calculates predicted outcomes for each individual, and these are then weighted to estimate the expected costs and benefits for the chosen strategy in the proposed screening target population. This method of sampling using individual level information from a population-based study avoids the need to build statistical models for population characteristics from which theoretical individuals are simulated.

Fig. 1
figure 1

Cost and effectiveness model of screening and treatment strategies for type 2 diabetes

Parameter assumptions

Table 1 shows the assumptions used in the model. For uncertain quantities, we distinguish between those for which an evidence-based probability distribution can be derived from the literature (probabilistic sensitivity analysis), and those that are taken as ‘unknown’; in principle, a judgemental distribution could be used for the latter, but instead we have considered a range of informed possible values (deterministic sensitivity analysis) [7]. The overall compliance with a screening programme for type 2 diabetes is unknown. In this paper, sensitivity analyses with levels of compliance ranging from 30–75% were performed [8, 9].The untreated risk model uses the risk prediction engine derived from the UK Prospective Diabetes Study (UKPDS), calculating the 5-year cumulative risk of CHD events (fatal or non-fatal myocardial infarction or sudden death) in people with diabetes (Table 1) [10]. The relative risk reduction for treatment of individual cardiovascular risk factors used in the risk reduction model are taken from a meta-analysis of single agent clinical trials in people with diabetes [11]. By using these clinical trial risk reduction estimates, we are implicitly assuming that the adherence to medication among patients in a real-life screening programme would be identical to that seen in the ideal situation of a randomised controlled trial. None of these trials was specifically undertaken among individuals with screen-detected diabetes, and therefore we assume that risk reductions observed in the populations recruited to these clinical trials can be generalised to people whose diabetes is detected through screening. Most trials including people with diabetes have focused on the management of individual cardiovascular risk factors. Consequently, there is uncertainty concerning the CHD event rate reduction consequent upon intensive treatment for several cardiovascular risk factors at once. Given that in the real world of current diabetes care most patients with screen-detected diabetes have more than one cardiovascular risk factor, polypharmacy is the norm rather than the exception. Thus, modelling the effects on the results of screening of different assumptions about how single cardiovascular risk factor reductions combine when more than one factor is treated is an important component of this study. We have included two extreme scenarios in our model: the conservative situation, where combined therapy is only as effective as the most effective single agent, and the optimistic scenario, where risk reductions combine in a multiplicative manner (Table 1). The cost model contains information on the cost of the screening procedure estimated from our experience with the ongoing Anglo–Danish–Dutch Study of Intensive Treatment in People with Screen Detected Diabetes in Primary Care (ADDITION) [12]. We took the costs of pharmaceutical treatment of hyperglycaemia, hypertension and dyslipidaemia from the British National Formulary [13]. The costs of GP and practice nurse visits were estimated using standard BMA or Whitley Council rates and the frequency of consultations from the UKPDS [14]. The cost of specific pharmaceutical treatments is not fixed and may vary significantly, especially when patents on certain agents cease. Thus, in our sensitivity analyses we estimated the costs and benefits of an alternative situation in which there was a 25% reduction in cost of treatment with antihypertensive drugs and statins (Table 1).

Table 1 Assumptions in the cost-effectiveness model

Screening and treatment strategy choices

In the model, it is possible to examine different screening strategies according to information on age, BMI, sex and ethnicity. In this paper, a range of high-risk strategies are evaluated. It is also possible to specify alternative treatment strategies. In the current model, the individual’s BMI is used to decide whether they are prescribed a sulfonylurea or metformin; those with a BMI >25 kg/m2 being prescribed metformin. The decision to treat with antihypertensive drugs is conditional on the blood pressure, with therapy being commenced if the systolic blood pressure is ≥140 mmHg or the diastolic blood pressure is ≥85 mmHg. Finally, we have assumed that treatment with statins will be commenced for primary prevention of CHD on the basis of an estimated 30% 10-year Framingham CHD risk [15].

Outcomes

For each set of parameter assumptions and strategy choices, the model estimates the proportion of the total population offered screening, the ratio of those screened who subsequently require treatment, the total cost of the screening programme for a population of 1,000,000 individuals aged 35–60 years, the numbers needed to screen and treat over 5 years to prevent one CHD event, the total number of CHD events prevented, and the cost-effectiveness ratio (defined as the total cost divided by the number of events prevented). Compared with a baseline strategy of no screening, at no cost and saving no events, these cost-effectiveness ratios can be interpreted as incremental cost-effectiveness ratios (ICERs) [7].

Study population and survey procedures

In this paper we have used a population-based study from Denmark as an example. The model can be readily tested on data from other population-based studies. The Danish Inter99 study is a primary prevention study of CVD, impaired glucose tolerance and type 2 diabetes in the western part of the Copenhagen County of Denmark [16, 17]. A random sample of 13,016 people aged 30–60 years, stratified by age and sex, were invited for a health examination including a standard 75-g OGTT. The participation rate was 52.5% (n=6,784). All individuals with known diabetes (n=139), and 374 people who could not be categorised according to the World Health Organization (WHO) criteria owing to lack of plasma glucose measurements were excluded. Only people with complete information on ethnicity, smoking, sex, age, blood pressure, BMI and blood tests were included in the analyses (n=6,216; 93.5%). The mean of two measurements of blood pressure, taken with the participant lying, using a standard mercury sphygmomanometer with an appropriate cuff size after at least 5 min rest, was used in the analysis. Weight and height were measured with the participants wearing indoor clothes without shoes. BMI was defined as weight in kilograms divided by height in metres squared. In Denmark, 51% of the adult population aged 35–80 years are men and 97% of this population are Europids (Statistics Denmark. Available at http://www.dst.dk./, last accessed 10th August 2005).Plasma glucose was analysed using the hexokinase/G6P-DH method (Boehringer Mannheim, Mannheim, Germany). HbA1c samples in capillary tubes were analysed by ion exchange HPLC (Bio-Rad Variant, Richmond, CA, USA). Serum cholesterol was determined using enzymatic techniques (Boehringer Mannheim). Diabetes was defined according to the WHO criteria set out in 1999 [18]. All participants gave written consent before taking part in the study. The protocol was conducted in accordance with the Declaration of Helsinki and approved by the local research ethics committee.

Statistical analysis

Sensitivity analysis

Deterministic sensitivity analysis resulted from multiple runs of the model under different strategy choices and using the extremes of the ranges for the parameters shown in Table 1. Probabilistic sensitivity analysis provided confidence intervals around the outputs from the model using the following method: uncertain parameter values were independently simulated from the distributions in Table 1, the results for each simulated set were recorded, and the subsequent distribution of outcomes were summarised by a mean and 95% intervals [7]. Sufficient simulations were carried out to estimate the intervals with under 5% error. All modelling was carried out in Excel 2000 (Microsoft, Redmond, WA, USA), with the addition of Crystal Ball http://www.decisioneering.com/crystal_ball, last accessed in February 2006) for the probabilistic sensitivity analysis.

Other statistical analyses were carried out using SAS, version 8.2 (SAS institute, Cary, NC, USA). Groups were compared using the Student’s t-test for continuous variables, the χ 2 test for dichotomous variables. A p value of <0.05 was considered statistically significant.

Results

In the Inter99 study, the prevalence of screen-detected diabetes was 4.3% (95% CI 3.9–4.9%). The characteristics of the Inter99 population are shown in Table 2. Individuals with diabetes had significantly higher HbA1c, blood pressure, and cholesterol:HDL cholesterol ratios, and were more likely to be men compared with individuals without diabetes. Hypertension was present in 75.6% of individuals with diabetes compared with 35.4% of individuals without diabetes. These findings demonstrate the higher prevalence of cardiovascular risk factors in individuals with screen-detected diabetes compared with those without diabetes. There were no differences between the two groups in terms of smoking status or ethnicity.

Table 2 Characteristics of the Inter99 population

Table 3 shows the results for different theoretical high-risk screening strategies in a population of 1,000,000 individuals aged 30–60 years. It assumes a response rate for screening of 75%, a multiplicative risk from multiple therapy, and a cost model using current costs. The total cost of the evaluated screening strategies varied between £13.3 and £27.4 million. In addition, the number needed to screen (NNS) varied between 240 and 362, and the number needed to treat (NNT) varied between 32 and 34. The NNS, NNT, and cost-effectiveness ratio did not change within the different strategies, but the total cost of the entire programme varied markedly according to strategy. The high-risk strategies were cheaper than the broader strategies. However, the number of events prevented was lowest in the high-risk strategies, and highest in the mass strategies.

Table 3 Cost and effectiveness of alternative definitions of target high-risk population within a total population of 1,000,000 people aged 35–60 years, assuming a screening attendance rate of 75%, multiplicative risk reduction from multiple therapy and current cost model

Sensitivity analyses are given in Table 4 for the fixed strategy of screening all those aged ≥50 years with a BMI >30 kg/m2. The models refer to the different deterministic sensitivity analyses, with stepwise changes in the parameter assumptions as in Table 1. In the models assuming a multiplicative effect on risk reduction according to treatment, the number of coronary heart disease events prevented was higher than in the models assuming no additional effect. Consequently, the NNS, NNT and ICER were all lower in the multiplicative models. Decreasing the compliance reduced the number of events prevented but did not affect the NNT, NNS or ICER. Changing the cost by 25% for the treatment of hypertension and dyslipidaemia affected the ICER but not the NNS or NNT.

Table 4 Monte Carlo simulations and sensitivity analysis for results of screening varying compliance, assumption of treatment risk reduction and cost model in a screening strategy aimed at individuals aged ≥50 years with a BMI >30 kg/m2

The uncertainties of the estimates simulated by probabilistic sensitivity analysis are given as 95% prediction limits. For all outcome estimates there was a five-fold increase from the lowest to the highest limit. The impact on the variance from the probabilistic sensitivity analysis of the model is shown in Fig. 2. The uncertainty of the risk reduction associated with antihypertensive treatment contributed most to the variance of the model (48%), followed by the intercept (corresponding to the baseline hazard for a 55-year-old, non-smoking Europid or Asian-Indian man with a HbA1c of 6.72%, a systolic BP of 135.7 and a lipid ratio of 4.9) in the UKPDS risk engine (23%), and then treatment with hypoglycaemic medication (20%).

Fig. 2
figure 2

The contribution to the variance of the sensitivity analysis

Discussion

In an ideal world, policy decisions about whether or not to screen for conditions like type 2 diabetes would be made on the basis of perfect information with a strong evidence base supported by randomised controlled trials, not only of the specific treatments but of the whole process of screening. However, this is far from reality, as such public health policy considerations are often driven by timetables that do not allow for long-term trials, and there may be objections to trials of the process of screening. In the absence of these definitive data, modelling becomes a critical public policy tool. A key aspect of modelling that is often overlooked is uncertainty, since for many of the parameters that are included in these models there is either no published evidence at all, or else only estimations available. In this paper we have described the development of a simple simulation model for estimating the cost-effectiveness of screening for type 2 diabetes. More importantly, we have shown how choosing different high-risk screening approaches with various permutations of target groups based on age, degree of obesity, and ethnicity made no significant difference to the number of individuals needed to be screened or treated to prevent one CHD event, or to the cost-effectiveness ratio. However, the major impact of these different policy decisions was on the total cost of the screening programme and the total number of CHD cases prevented, with both increasing as strategies were broadened to include a greater proportion of the population.

A major advantage of this model is that it incorporates the risk of developing CHD and models the effect of simultaneous treatment of hyperglycaemia, hypertension and dyslipidaemia. Previous modelling studies have tended to focus on the efficiency of case detection or have restricted benefits to the effect of treatment of hyperglycaemia [5, 1921] or the effect of combined treatment of hyperglycaemia and hypertension [6]. A final key feature of this analysis was the focus on uncertainty. All screening models contain uncertain factors, some of which can be estimated from the literature, and others that can only be taken as ‘unknown’ and a range of plausible values assessed. No previous models have explored the impact of this uncertainty on the results. Our results suggest that decisions about whether or not to screen for diabetes using such models now would be based on data that has considerable uncertainty. The overall cost-effectiveness ratio does not appear to be sensitive to decisions about which groups to screen, or particularly to the costs of screening or treatment. It is, however, affected to a large degree by the assumptions about how treatments combine to reduce risk. It is not currently known whether the risk reduction associated with treating hypertension, dyslipidaemia and hyperglycaemia in people with screen-detected diabetes are multiplicative, additive or sub-additive. Data from studies such as the Steno 2 trial, in which multifactorial therapy was compared with standard care, can provide some evidence of how risk is reduced by combined treatment, but this is limited since the trial was conducted in high-risk individuals, i.e. people with established diabetes and microalbuminuria [22]. The impact of this type of uncertainty on the estimates of cost-effectiveness provides justification for trials such as ADDITION, which aims to measure the effect of intensified multifactorial therapy on CHD events in people with screen-detected diabetes [12].

In addition to the impact of unknown parameters, such as the combined treatment risk reduction, we also investigated the uncertainty in the estimates of cost-effectiveness attributable to the evidence-based uncertainties in critical parameters. In our least conservative model, where costs were low and the impact of combined treatments was multiplicative, the 95% confidence interval of the ICER varied from £23,300–82,000. The major contributors to this uncertainty were the parameters in the treatment risk reduction model—particularly the risk reduction from treatment of hypertension in people with diabetes—and the intercept of the UKPDS risk model. Models like this can help to direct research efforts to narrow confidence intervals in key but uncertain parameters.

In our model we have only focused on CHD events. Others have modelled the effects of screening on microvascular disease. The Centers for Disease Control and Prevention (CDC) group found that universal screening for type 2 diabetes was not cost-effective in the age range in which it is most prevalent—those people aged 55–64 years—in whom the cost per quality-adjusted life-year (QALY) was US$70,759 and the cost per life-year gained was US$480,600. In the >65 years age group the cost per QALY was US$575,000 [19]. The ICER was lower in younger individuals. In light of the already established uncertainty about the benefits of screening for diabetes on microvascular outcomes, and the much greater public health burden of undiagnosed diabetes attributable to CHD risk, our model focused on this outcome. It is likely however, that reductions in CHD mortality attributable to early, more intensive multifactorial therapy would also have effects on microvascular outcomes, which might, in turn, alter the balance between the costs and benefits of screening over the longer term. Thus, future iterations of this model will need to consider multiple health endpoints. The time horizon for this analysis was 5 years, a time-course over which the issues of discounting are not brought to the fore. However, if a longer time perspective were taken, then the model would also need to be complicated by consideration of discounting. Finally, we consider screening strategies based on selection of population groups based on easily identifiable characteristics, such as age, ethnicity and degree of obesity. Future developments of our model could include consideration of other strategies, although the contribution to the outcome of cost-effectiveness would be unlikely to be major, since we have already shown that the screening strategy has a limited impact on the ICER, although it does have an impact on the total cost of the programme.

This kind of model does have other limitations. We focused our attention on treatments for hyperglycaemia, hypertension and dyslipidaemia. Other treatments, such as antiplatelet therapy including acetylsalicylic acid (ASA) could have been included, since some, but not all, expert guidelines recommend cardioprotective treatment with ASA [23, 24]. However, there is no clear evidence that ASA treatment is effective in primary prevention in individuals with diabetes [25, 26], as a meta-analysis from 2002 that included 5,955 individuals with diabetes reported that treatment with ASA was associated with a non-significant 7% reduction in the risk of having any vascular event [26]. Using the UKPDS risk engine may overestimate the risk of CHD since it was developed in trial participants, the majority of whom had clinically diagnosed diabetes and are therefore likely to have had disease for longer than screen-detected cases, with greater possibility for accumulation of time-dependent vessel damage. In the treatment model, metformin was initiated without reference to HbA1c. This is an assumption that increases potential benefit but has little effect on cost because the drug is cheap. In reality, many of the screen-detected patients would actually not receive any specific hypoglycaemic medication at the point of detection by screening, as 57% have a HbA1c<6.5%. Over time, many of these patients would have therapy added as HbA1c rises with duration of disease, but our model has assumed treatment from diagnosis. It is unknown whether early hypoglycaemic therapy alters the disease trajectory. The cost model used in this analysis is naïve as we have used average costs. We have not estimated the effects of uncertainty in cost, and the effect of adding in this additional level of uncertainty would only add to the overall uncertainty in the ICER. We have not included strategies for differential targeting of specific ethnic groups, principally because the study population chosen as an example is overwhelmingly Europid. Future work should consider inclusion of other populations in which data from other ethnic groups are available.

In conclusion, we have developed a cost-effectiveness model estimating the benefits of screening for type 2 diabetes. The impact of uncertainty in key parameters demonstrates the importance of including sensitivity analyses in future models and highlights areas where research efforts may narrow uncertainty. The demonstration of the impact of factors that are unknown helps to inform research strategy. Our analysis suggests that measuring the risk reduction from multifactorial therapy in people with screen-detected diabetes is a priority.