Abstract
Background
Decision analytical models (DAMs) are used to develop an evidence base for impact and health economic evaluations, including evaluating interventions to improve diabetes care and health services—an increasingly important area in low- and middle-income countries (LMICs), where the disease burden is high, health systems are weak, and resources are constrained. This study examines how DAMs–in particular, Markov, system dynamic, agent-based, discrete event simulation, and hybrid models–have been applied to investigate non-pharmacological population-based (NP) interventions and how to advance their adoption in diabetes research in LMICs.
Methods
We systematically searched peer-reviewed articles published in English from inception to 8th August 2022 in PubMed, Cochrane, and the reference list of reviewed articles. Articles were summarised and appraised based on publication details, model design and processes, modelled interventions, and model limitations using the Health Economic Evaluation Reporting Standards (CHEERs) checklist.
Results
Twenty-three articles were fully screened, and 17 met the inclusion criteria of this qualitative review. The majority of the included studies were Markov cohort (7, 41%) and microsimulation models (7, 41%) simulating non-pharmacological population-based diabetes interventions among Asian sub-populations (9, 53%). Eleven (65%) of the reviewed studies evaluated the cost-effectiveness of interventions, reporting the evaluation perspective and the time horizon used to track cost and effect. Few studies (6,35%) reported how they validated models against local data.
Conclusions
Although DAMs have been increasingly applied in LMICs to evaluate interventions to control diabetes, there is a need to advance the use of DAMs to evaluate NP diabetes policy interventions in LMICs, particularly DAMs that use local research data. Moreover, the reporting of input data, calibration and validation that underlies DAMs of diabetes in LMICs needs to be more transparent and credible.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.Background
The prevalence of diabetes, particularly type 2 diabetes, is rapidly increasing worldwide, particularly in low- and middle-income countries (LMICs). Around 537 million adults globally lived with diabetes in 2021, an increase of 70 million since 2019 [1]. The International Diabetes Federation (IDF) estimated that the number will increase by 46%, i.e., 783 million adults, by 2045 [1]. However, this projection may be underestimated considering the unintended effect of control strategies associated with multiple waves of Coronavirus Disease 2019 (COVID-19) on diabetes risk distribution, for example, increased stress and low physical activity levels due to lockdown [2]. Although 79% of persons with diabetes live in LMICs, total health expenditure on diabetes remains lower in LMICs than in high-income countries (HICs) because of resource constraints and lower priority given to chronic diseases [1, 3].
Additionally, diabetes accounts for a large proportion of morbidity and mortality in LMICs. IDF indicates that the Western Pacific and South-East countries experienced the highest diabetes fatalities between 2010 and 2019 [1]. Diabetes is one of the leading causes of death in LMICs among people aged 20–99 years, with the majority of deaths occurring in people under 60 years of age [1]. According to the IDF Atlas, Africa recorded more than a 10% increase in diabetes deaths between 2010 and 2019. Compared with deaths from other territories, most people who died in Africa were below 60 years old. South Africa and the Democratic Republic of Congo were the most affected by diabetes mortalities [1].
Studies have reported the potential of non-pharmacological (NP) population-based strategies to reduce the diabetes burden [4], but most of these studies are large-scale randomized control trials (RCTs) and cohort studies conducted in high-income countries, and transferability issues may limit the application of the evidence in LMICs. NP diabetes interventions are public health community-based strategies targeted at persons with or without diabetes to control or prevent the disease. They include fiscal policies, legislation in – but not limited to – trade and agriculture, health promotion activities or changes to physical environments that can influence modifiable risk factors, e.g., physical activity and dietary patterns. RCTs and cohort studies can generate evidence of the economic and health effects of NP diabetes interventions for policy decision-making [5], but their application can be challenging from an ethical, implementation time and cost perspective. Ethical issues, including – but not limited to – delaying life-saving intervention in human subjects, could constitute a breach of duty of care; consequently, ethics committees may deny such studies approval. In LMICs, large-scale RCTs and cohort studies may be challenging to fund.
Decision analytical models (DAMs) overcome these challenges by using mathematical and logical relationships to abstract real-world phenomena for investigation and simulation. DAMs are most useful where the lack of data due to a rare event, legal circumstances, time, technical, ethics and funds prevent real-live studies. LMICs can benefit from their use to prioritise interventions and policies as they enable comparatively cheap, convenient, and risk-free experiments that are impossible in reality [5]. DAMs can offer an opportunity to perform “what-if” scenarios to predict and explore NP diabetes interventions in LMICs before these interventions are implemented, saving policymakers the cost and time that would have been invested in trial and error.
Despite the benefits of DAMs, their application to diabetes in LMICs is limited. Most DAMs for type 2 diabetes are built among high-income populations and then generalized to LMICs, which could be misleading considering that the difference in culture, ethnicity and health system capacities influence diabetes control. For instance, diabetes develops 10 years earlier and at lower body weight in Africans and Asians than in Europeans [6]. There is a need to consolidate the literature on DAMs application, particularly their methodology, to diabetes in LMICs to identify gaps in their adoption and advance their use.
Whereas studies have appraised the application of DAMs to study diabetes interventions [7,8,9,10,11], few have focused on NP diabetes interventions in LMICs. Our study adds to this research. Mukonda, Cleary and Lesosky’s review on computer simulation models for type 2 diabetes in LMICs, like our present study, reports on model-based economic evaluations to support decisions in type 2 diabetes care, to assess their quality and validity [11]. However, unlike Mukonda and colleagues, we focus on DAMs for NP interventions and consider both type 1 and 2 diabetes. NP interventions are important for reducing diabetes risk and improving its outcomes [3], providing benefits to both diabetic and non-diabetic populations. Our review focuses on NP interventions as they are understudied in the literature compared to pharmacological interventions [11]. Moreover, the methods (and outcomes reported) used to investigate NP interventions can be very different from those used to examine pharmacological interventions as the latter concentrates on biology, physiology, and medicines compared to NP intervention, for which local context, including culture, health system and infrastructure is so important [3, 11]. As a result, it is often more reasonable to transfer efficacy estimates of pharmaceutical interventions than NP ones from RCTs in one setting to another. Thus, the methods for conceptualizing and developing models and the types of models that are fit for purpose differ for NP interventions. DAMs are also employed for scaling up pharmacological interventions’ use to understand the effectiveness of distributing these interventions in a population. The modelling focus and assumptions differ compared to NP ones. By focusing on NP interventions, we maintain a more homogenous set of studies and gain insight into this understudied area.
Specifically, our review investigates the methodological application of DAMs investigating NP diabetes interventions in LMICs with three objectives:
-
1.
To investigate how DAMs have been applied to investigate NP policy interventions in LMICs,
-
2.
To assess what gaps exist in the modelling procedures according to the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) checklist.
-
3.
and how to advance their adoption to diabetes research in LMICs.
We focus on four types of DAMs: systems dynamic, agent-based models, microsimulations, discrete event simulations and Markov models and a hybrid of any of them, hereafter referred to as DAMs, in NP diabetes intervention. Multiple factors determine the choice of DAMs in a study, e.g., study problem and goal, system processes, data availability and aggregation level, and analysis unit. Each approach has specific assumptions and structure, detailed in Additional file 1.
Methods
We qualitatively review peer-reviewed articles that examine DAMs of the natural progressions of type 1 and 2 diabetes and assess the effect of NP interventions on these populations. The qualitative review was designed and presented using Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines [12].
Information sources and search strategies
A combination of search terms for diabetes and the four modelling approaches (indicated below) was used to search titles and abstracts of papers in PubMed and Cochrane databases from inception to 8th August 2022. We limited the results to peer-reviewed articles published in English. Two people were involved independently in the search strategy phase, and disagreements were resolved through discussions and third-party judgement.
(((diabetes) OR (type 1) OR (type 2) OR (NIDDM) OR (IDDM) OR (DM)) AND ((Diabetes Mellitus [MeSH Terms]))) AND (“agent-based” OR “system dynamic” OR “discrete event” OR “microsimulation” OR “Markov model”)
Eligibility criteria
Table 1 summarises the inclusion criteria applied. We included studies that meet the following criteria: 1) use any of the four DAMs or a hybrid of them, 2) examine NP interventions among persons living with type 1 or 2 diabetes or at risk of type 2 diabetes (as defined in the papers), 3) conducted the study in LMICs population per World Bank 2020 classification or initialized the modelled population with data from LMICs.
Exclusion criteria
Studies were excluded where 1) diabetes control is secondary to a primary disease/medical condition, e.g., preventing diabetes in people with schizophrenia, because in such studies, the model is designed with a particular focus on the primary disease and 2) they focus on pharmaceutical interventions and the pathological disposition of diabetes. Studies were excluded where the data, i.e., diabetes prevalence, obesity, and blood glucose distribution—used to initialize the modelled population were from developed countries. Diabetes prevalence and risk are higher in most developed countries; therefore, using data from such countries would likely misrepresent the disease burden in LMICs. All qualitative studies, literature reviews, abstracts only, non-English written papers and methodological papers were excluded. For instance, we excluded Kazemian et al.’s study [13] titled “development and validation of PREDICT-DM: a new microsimulation model to project and evaluate complications and treatment of type 2 diabetes mellitus” because the paper focused on the modelling process, i.e., the design, development, and validation of the model for the United States population.
Data collection process
We used a data extraction tool containing relevant information from the methods section of the CHEERS checklist [14] needed to answer the research question to collect data from selected articles. The checklist is recommended to standardise and improve the reporting of economic evaluation of health interventions; it provides guidelines for model-based economic evaluation. We then summarised data under categories using Nvivo 12.0 and presented the summary in an excel format. The summarised data from selected articles are in Additional file 2.
Data items
Pieces of information were extracted from the selected articles and organized under themes to answer the study questions. We collected and organized data under five themes: “study details”, which included data items such as author(s), title, publication date and place; “diabetes details”, consisting of the following data items: the type and diabetes state modelled, interventions and outcomes reported. “Model design” included model choice, parameterization and calibration, uncertainty analysis and validation. “Limitations” gathered information on study limitations reported in reviewed publications, and “economic evaluation” gathered details on the type of evaluation conducted, perspective adopted, interventions assessed, and outcomes reported.
Results
Study selection
Figure 1 highlights the process of article identification, screening, and selection. Our initial search resulted in 811 articles, and no relevant article was retrieved from searching the reference list of selected articles. Overall, we screened the full text of 23 studies and then included 17 studies in the qualitative review. Table 2 summarises findings from reviewed studies. Details of included studies are in Additional file 2. Studies excluded in the full-text screen and the justification are in Additional file 3, as well as the PRISMA checklist in Additional file 4.
Country and year of research
The majority of the modelled population was from China (5 studies) and India (4 studies). Two studies each described sub-populations in LMICs and Palestine, whereas one study each modelled sub-populations in Iran, Cambodia, South Africa, and Brazil. Studies were published between 2013 and 2021, with the highest number of publications (eleven) occurring between 2016 and 2020.
The type and diabetes progression state modelled
Nine studies (69%) [15,16,17,18,19,20,21,22,23] modelled adults at risk of diabetes and undiagnosed diabetes; one of the nine studies specifically looked at persons with impaired glucose tolerance [21]. The remaining eight studies [24,25,26,27,28,29,30,31] modelled persons with diagnosed diabetes (type 1 or 2 or both) under treatment.
Interventions modelled/strategies studied
Screening programs were the most common intervention examined, as they were reported in five studies [18, 19, 23, 27, 29]. Screening interventions targeted at-risk populations except for two studies [27, 29] that investigated diabetes retinopathy screening strategies among diabetes patients aged 40 years and above under clinical treatment. Three studies each investigated interventions related to fiscal policies [16, 22, 28] and patient education [21, 24, 25]. Specific interventions under the formal include taxes on sugar-sweetened beverages [16], food aid [22] and financial coverage for clinical diabetes care [28]. Specific patient education-related interventions reported include lifestyle-focused planned diabetes programs [24, 25] and the delivery of short message services on diabetes care [21]. An additional two studies (46%) investigated interventions related to health systems’ operations: one on clinicians’ choice of treatment approaches [26] and the other on national/international treatment guidelines [31]. As shown in Table 2, four studies do not describe the specific interventions but broadly describe the interventions as obesity reduction [15], dairy food consumption [17], healthy lifestyle behaviours [20] and increasing diagnosis, treatment, and control [30], but these studies do not describe the activities/program that would reduce obesity, increase dairy food consumption promotes a healthy lifestyle and improve treatment/control. For instance, Abu-Rmeileh et al. [15] assume a 5, 10, 15 and 35% reduction in obesity prevalence and model the outcome of such reductions on diabetes prevalence in Palestine but do not describe measures to be taken to achieve the reduction.
Decision model type
Markov models and microsimulation models (seven studies each) were the most used modelling approaches, as indicated in Table 2. Only one study [20] used an agent-based model (ABM) to examine lifestyle intervention for diabetes prevention in China. No study was found that used discrete event simulation (DES) and system dynamics (SD) models. The review found no study that combined a Markov model, SD, DES, microsimulation, or ABM, except for two studies that combined a Markov model with a decision tree—a series of nodes and branches representing a logical structure of possible decisions and resulting [5].
Benefits of decision modelling
Only two studies (15%) indicated the benefits of using DAMs [21, 24]. Both studies indicated time, cost, ethical considerations, and non-practicality of conducting long-term clinical trials as justification. Another explanation provided is the complexity of diabetes. The disease progresses gradually over a long time, and it is associated with several complications and other diseases that could be difficult to represent in a real-world experiment [24].
Seven studies discussed the benefits of using the specific modelling approach used. Three studies mentioned that the benefit of microsimulation over Markov models was mainly to represent complex relationships, individual-level dynamics, and histories [18, 26, 31]. One study [20] that investigated how individual-level factors influence public health outcomes found ABM beneficial in capturing interactions and feedback between individual-level behaviour and population-level parameters.
Software
All but three studies, each using ABM [20], microsimulation [30] and hybrid Markov and decision tree [23], indicated the software used to implement models. Six studies used TreeAge software, out of which four were used to implement Markov models and one each for microsimulation and hybrid Markov and decision tree. An additional five studies used R software (four microsimulations and one Markov model). MATLAB was used to implement microsimulation [16] and Markov models [24]. One study used Microsoft Excel to implement a Markov model [15]. Three studies did not report on the software package used for modelling.
Uncertainty analysis
Uncertainty analysis examines the accuracy of model outcomes and how model outcome changes due to variations in model parameters, structure, or assumptions [5]. Modellers may perform first-order, second-order, or structural uncertainty analysis to investigate uncertainty. The former investigates uncertainty surrounding outcomes for individuals with the same characteristics and cannot be conducted in deterministic models. Second-order examines uncertainty around model parameters, and structural uncertainty investigates other uncertainties that do not fit directly into parameters, methodological or heterogeneity [5].
Techniques for investigating second-order uncertainty are one-way, multiway/threshold and probabilistic sensitivity analysis (PSA) [5]. In a one-way sensitivity analysis, a single parameter or assumption is varied at a time, whereas in multiway, parameters or assumptions are varied simultaneously to the highest or lowest values to generate a best- or worst-case scenario; both methods are deterministic. In PSA, a model’s parameters are sampled from pre-specified distributions. The outcome of PSA is an interval within which model outcomes could fall. Table 2 shows the distribution of techniques studies used in parameter uncertainty analysis. All reviewed studies except one [24] indicated the methods used to estimate parameter uncertainty. Seven studies (41%) used several methods: five combined one-way and PSA [16, 18, 26, 27, 29], one combined one-way and multiway analysis [21] and one combined one-way, multiway and PSA [23]. Nine studies (54%) used a single method: four each used one-way only [19, 20, 25, 30] and PSA only [17, 22, 28, 31] and one used multiway analysis only [15].
Validation/confidence building
Validation is the process of comparing model components, e.g., structure, input, outcome, and assumptions, with reality to increase confidence in the model outcomes. Validation techniques include face (expert assess model behaviour and processes), internal/verification (check coding accuracy), cross (compare model outputs with outputs of similar models), external (compare model output with actual data) and predictive validity (compare model output with prospectively observed data). Multiple techniques can be used to increase confidence in models.
More than half of the reviewed studies (11 studies, 45%) do not report model validation procedures. Model users and consumers of model results/outputs may have less confidence in unvalidated models and are less likely to use such models or their outcomes [32]. Among the six studies (46%) that reported validating their models, four conducted external validity using historical data from national surveys and literature review [15, 16, 18, 27]. The remaining two studies [17, 20] combined all four validation techniques: 1) face validity through expert consultation, 2) internal validity through sensitivity analysis and manually checking codes for error, 3) cross validity via comparing model outputs to outputs of similar published models, and 4) external validity using actual data from national/international surveys registers.
Data source, parameter estimation and calibration
Data may be unavailable or scattered in different sources and forms that are not readily usable in a model, requiring modellers to combine or transform available data through mathematical methods to estimate and calibrate model parameters. Reviewed studies obtained data to parameterized models from plausible assumptions, previous simulation studies, published cohort studies and data recorded in clinical trials, national surveys, and registers. Except for one study [24], which used primary data from a diabetes preventions program, all studies reported data limitation as a challenge to model building. Researchers reported that local epidemiological and clinical data (e.g., diabetes state transition probabilities and risk equations) and cost data were mostly unavailable, unreliable, or insufficient for modelling purpose, consequently leading them to use data from international studies. Studies used mixed-effects meta-regression, inverse-variance methods, validated hazard calculation method and validated equations from the United Kingdom Prospective Diabetes Study, Risk Equations for Complications of Type 2 Diabetes, World Health Organisation (WHO) and International Society of Hypertension equations, and Monte Carlo Markov Chain to parameterized and calibrate models.
Type of evaluation (health and economic)
Economic evaluation can produce evidence of the cost and the effect of alternative interventions to support decisions on resource allocation. Among the reviewed studies, four reported on health effects only [15, 16, 20, 24], and two reported on cost/economic outcomes only [17, 18] from a health system perspective. Eleven studies (54%), whose details are presented in Table 2, included evidence of both cost and health outcomes. For instance, Liu et al. [19] examined the cost of screening and lifestyle interventions from a societal perspective and the resulting health effects, including life-years remaining, quality-adjusted life years (QALYs) and incremental QALYs.
Discussion
The chronic nature of type 1 and 2 diabetes, high cost and implementation challenges of large-scale cohort studies necessitate the use of decision analytical modelling to extrapolate evidence of short-term empirical studies to predict costs and health benefits over a long-term period. This study reviewed the application of DAMs, specifically Markov cohort models, system dynamics, discrete event, microsimulation, and agent-based models, to study NP diabetes intervention in LMICs. We applied the CHEERS checklist to appraise seventeen studies identified through a systematic search.
Overall, there were more studies conducted in Asian sub-populations, particularly China, and most studies reported data as a limitation. The dearth of studies exclusively from LMICs is somewhat indicative of the scarcity of the use of DAMs in research in the region. Healthcare data sources exist in LMICs, e.g., national demographic and health surveys and WHO’s studies on Global Aging and Adult Health. However, the levels of detail and quality are often insufficient. Consequently, confidence in the validity of outcomes/results from models using such data sources could be questioned. This is daunting given the expected escalation of the diabetes burden, and it highlights the need for more structures for data collection/generation in LMICs.
In the absence of sufficient and quality data in LMICs, calibration techniques are used to adjust parameters or even existing models with different population characteristics, e.g., models from HICs. The objective of (re)calibration is to enhance the representativeness or predictability of a model which otherwise might under- or over-estimate model outputs. Calibration approaches reported in the reviewed studies include Markov Chain Monte Carlo —a standard Bayesian posterior computation approach [33] and adjusting the Risk Equations for Complications of Type 2 Diabetes (RECODe) with local data. RECODe was designed for Americans in particular; however, the equation can be adjusted with local data to represent context-specific epidemiology.
The International Society for Pharmacoeconomics and Outcomes Research have also produced protocols for the adaption of an existing validated model to a specific context/ population [34]. During such an adaption process, it is essential that baseline characteristics of the modelled cohort are adjusted to reflect local epidemiological data and possibly the transition probabilities between states. Also crucial for the adaption are context-specific cost, health state preferences, and utility data. The requirement of context-specific data brings us back to the challenge of reliable/robust diabetes data in LIMCs and how the situation limits the application of DAMs for diabetes in the region. Modellers could obtain model data from various sources: ongoing clinical trials or existing data through systematic review and meta-analysis, routine data collection, expert opinion, and observational studies. Among these data sources, researchers have suggested using observational research data on type 2 diabetes in LMICs despite concerns about selection bias as compared to RCTs, highlighting how such metrics, including health-related quality of life, are seldom altered by selection bias [35]. As a result, observational studies, which are easier to conduct in LMICs, can fill in the data gaps required for the implementation of DAMs.
Model validation is another procedure to improve models’ fitness for purpose, especially when adapting parameters or existing models developed from other populations. Nearly half of the reviewed publications do not report how models were validated, and few discussed how applicable their model is in other LMICs. Some of the reviewed studies mentioned using data from the United Kingdom Prospective Diabetes Study (UKPDS) Outcomes Model and RECODe to estimate transition probabilities and risk equations for predicting diabetes complications. It is worth noting that both were developed for the United Kingdom and United States populations, respectively. Even though these models had undergone external validation, it is unclear if the models had also been validated for the LMIC populations of interest.
Tarride and colleagues [36] have identified some drawbacks to using UKPDS data: 1) the majority of UKPDS participants were of European descent and considering that diabetes progresses differently in different ethnic groups, there is a challenge with generalizing data to varied ethnic groups. 2) Technology and treatment regimens have advanced since the study was conducted (1977–1997). Such developments, e.g., new medicines and disease incidence, could affect the transition between diabetes states, affecting the applicability of the model. 3) Differences in culture, lifestyle, demographics, health systems and available health technology means that the rate of diabetes progression in a United Kingdom population is different from LMIC populations, affecting the application of the model to LMICs. These issues highlight the need for extensive model validation and reporting on the validation process to increase model representativeness, transparency and confidence in model processes and outcomes, consequently increasing model adoption. Researchers could adopt different tools, e.g., CHEERs checklist, International Decision Support Initiative (iDSI) Reference Case for Economic Evaluation [37], Diabetes Modelling Input Checklist [38] and the Overview, Design concept and Details protocol [39] (in ABMs) to improve model reporting and transparency.
Although most of the reviewed studies used a Markov cohort model or microsimulation (Table 2), it is unclear what modelling approach is appropriate as their appropriateness depends on multiple factors, including the study question/objective. The assumption of “memoryless” property, meaning that transition to another state is independent of the previous states, is a fundamental characteristic of Markov modelling but also a drawback [5] as this would be a simplification for diabetes where progression to another diabetes state is dependent on the previous state. Given the substantial patient variability and interconnected risk in diabetes, complexity is almost unavoidable [9]. Another challenge with using Markov cohort models in a cost-effectiveness analysis is the likelihood of skewed estimates of the incremental cost-effectiveness ratio resulting from “uncaptured” patient heterogeneity [40].
Unlike Markov cohort models, microsimulation models individual characteristics through time, thereby representing patient variability and overcoming the Markov assumption. Individual level characteristics can affect how they move through the model and can also be utilized to modify the likelihood of future occurrences. Details of DAM approaches are available in Additional file 1. Microsimulation allows for modellers to assign risk of events or complications, taking into consideration a patient’s unique demographic characteristics, risk factors, and event history and is not constrained to “mutually exclusive” health states as is the case in Markov-based models. However, the challenge with microsimulation compared with a Markov cohort model is the heavy computation and data required [9]. In addition to data challenges, LMICs currently lack the technical capacity for building heavy computational models. Collaborations between international and local academic and research institutions could help increase modelling expertise in LMICs. Knowledge exchange initiatives, such as the Mount Hood Diabetes Challenge Network [38], which facilitates the sharing of ideas and skills among diabetes simulation modellers through workshops, hackathons, and conferences, can build capacity in LMICs for advancing DAMs.
Additionally, incorporating evidence of intervention cost and effect in DAMs can increase the use of such models as decision support in LMICs. Economic evaluation methods that use DAM estimate the potential lifetime impact of investments, which means policymakers can account for or justify their choices. Having such evidence can contribute to policymakers prioritizing diabetes interventions. The CHEERS protocol recommends reporting perspectives of economic evaluations and a lifetime horizon for tracking cost and effect. It is encouraging to note that all reviewed studies reported on the perspectives of their economic analysis, giving readers a context within which cost is tracked.
Study limitations and directions for future research
The study’s main limitation is that research that would have added to the discussion may have been left out due to exclusion criteria, such as eliminating published material that is not presented in English or studies on pharmacological interventions. We eliminated the latter due to their difference in modelling methodologies, assumptions and focus compared to NP intervention studies. By collecting data relevant to modelling, important insights into the effectiveness and cost-effectiveness of the interventions being simulated are not reported. Further research should thoroughly analyze DAMs in connection to the decision issue at hand and the selection of cost-effective NP interventions. Second, although we judge the CHEERS checklist appropriate for this review, the Diabetes Modelling Input Checklist designed for improving transparency in reporting input data of model-based economic evaluation and the IDSI Reference case are equally suitable and should be explored by future studies. Nevertheless, given the large overlap with both checklists, we believe nothing significant has been overlooked that may have altered the findings of this analysis.
Conclusion and implications
DAMs have been increasingly applied in LMICs to evaluate interventions to control diabetes, which may contribute to better decision-making about the best use of limited resources and the improvement of patient outcomes. However, there is a need to advance the use of DAMs to evaluate NP diabetes policy interventions in LMICs, particularly DAMs that use local research data, because 1) such models are a good representation of diabetes burden in LMICs, 2) and could be effective at estimating intervention effect on local population. Additionally, given that data limitation is a major concern in model-based assessments, especially in non-Asian LMICs, clinical and observational research on diabetes is undoubtedly necessary. Finally, the reporting of input data, calibration and validation that underlies DAMs of diabetes in LMICs needs to be more transparent and credible. Modellers are encouraged to use the CHEERS checklist and Diabetes Modelling Input checklist to improve the modelling process and documentation.
Availability of data and materials
All data generated or analysed during this study are included in this published article [see Additional files].
Abbreviations
- LMICs:
-
Low- and middle-income countries
- DAMs:
-
Decision analytical modelling approaches
- NP:
-
Non-pharmacological
- ABM:
-
Agent-based models
- DES:
-
Discrete event simulation
- SD:
-
System dynamics
- NCD:
-
Non-communicable diseases
- QALY:
-
Quality-adjusted life years
- RCT:
-
Randomised control trials
- PSA:
-
Probabilistic sensitivity analysis
- HICs:
-
High-income countries
- RECODe:
-
Risk Equations for Complications of Type 2 Diabetes
- UKPDS:
-
United Kingdom Prospective Diabetes Study (UKPDS)
- CHEERS:
-
Consolidated Health Economic Evaluation Reporting Standards
- IDSI:
-
International Decision Support Initiative
- WHO:
-
World Health Organisation
References
International Diabetes Federation. IDF Diabetes Atlas. Brussel: International Diabetes Federation; 2021.
Verma A, Rajput R, Verma S, Balania VKB, Jangra B. Impact of lockdown in COVID 19 on glycemic control in patients with type 1 diabetes mellitus. Diabetes Metab Syndr: Clin Res Rev. 2020;14(5):1213–6.
World Health Organisation. Global report on diabetes. Geneva: World Health Organisation; 2016.
Merlotti C, Morabito A, Pontiroli AE. Prevention of type 2 diabetes; a systematic review and meta-analysis of different intervention strategies. Diabetes Obes Metab. 2014;16(8):719–27.
Briggs A, Sculpher M, Claxton K. Decision modelling for health economic evaluation. Oxford: Oxford University Press; 2006.
Spanakis EK, Golden SH. Race/ethnic difference in diabetes and diabetic complications. Curr Diab Rep. 2013;13(6):814–23.
Gillett M, Royle P, Snaith A, Scotland G, Poobalan A, Imamura M, et al. Non-pharmacological interventions to reduce the risk of diabetes in people with impaired glucose regulation: a systematic review and economic evaluation. Health Technol Assess. 2012;16(33):1–236, iii-iv.
Watson P, Preston L, Squires H, Chilcott J, Brennan A. Modelling the economics of type 2 diabetes mellitus prevention: a literature review of methods. Appl Health Econ Health Policy. 2014;12(3):239–53.
Yi Y, Philips Z, Bergman G, Burslem K. Economic models in type 2 diabetes. Curr Med Res Opin. 2010;26(9):2105–18.
Dadwani RS, Laiteerapong N. Economic simulation modeling in type 2 diabetes. Curr Diab Rep. 2020;20:1–11.
Mukonda E, Cleary S, Lesosky M. A review of simulation models for the long-term management of type 2 diabetes in low-and-middle income countries. BMC Health Serv Res. 2021;21(1):1313.
Moher D, Liberati A, Tetzlaff J, Altman DG, Prisma G. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7):e1000097.
Kazemian P, Wexler DJ, Fields NF, Parker RA, Zheng A, Walensky RP. Development and validation of PREDICT-DM: a new microsimulation model to project and evaluate complications and treatments of type 2 diabetes mellitus. Diabetes Technol Ther. 2019;21(6):344–55.
Husereau D, Drummond M, Petrou S, Carswell C, Moher D, Greenberg D, et al. Consolidated health economic evaluation reporting standards (CHEERS)—explanation and elaboration: a report of the ISPOR health economic evaluation publication guidelines good reporting practices task force. Value Health. 2013;16(2):231–50.
Abu-Rmeileh NM, Husseini A, Capewell S, O'Flaherty M. Preventing type 2 diabetes among Palestinians: comparing five future policy scenarios. BMJ Open. 2013;3(12):e003558.
Basu S, Vellakkal S, Agrawal S, Stuckler D, Popkin B, Ebrahim S. Averting obesity and type 2 diabetes in India through sugar-sweetened beverage taxation: an economic-epidemiologic modeling study. PLoS Med. 2014;11(1):e1001582.
Javanbakht M, Jamshidi AR, Baradaran HR, Mohammadi Z, Mashayekhi A, Shokraneh F, et al. Estimation and prediction of avoidable health care costs of cardiovascular diseases and type 2 diabetes through adequate dairy food consumption: a systematic review and Micro simulation modeling study. Arch Iran Med. 2018;21(5):213–22.
Basu S, Millett C, Vijan S, Hayward RA, Kinra S, Ahuja R, et al. The health system and population health implications of large-scale diabetes screening in India: a microsimulation model of alternative approaches. PLoS Med. 2015;12(5):e1001827 discussion e.
Liu X, Li C, Gong H, Cui Z, Fan L, Yu W, et al. An economic evaluation for prevention of diabetes mellitus in a developing country: a modelling study. BMC Public Health. 2013;13:729.
Luo L, Pang B, Chen J, Li Y, Xie X. Assessing the impact of lifestyle interventions on diabetes prevention in China: a modeling approach. Int J Environ Res Public Health. 2019;16(10):1677.
Wong CK, Jiao FF, Siu SC, Fung CS, Fong DY, Wong KW, et al. Cost-effectiveness of a short message service intervention to prevent type 2 diabetes from impaired glucose tolerance. J Diabetes Res. 2016;2016:1219581.
Basu S, Yudkin JS, Berkowitz SA, Jawad M, Millett C. Reducing chronic disease through changes in food aid: a microsimulation of nutrition and cardiometabolic disease among Palestinian refugees in the Middle East. PLoS Med. 2018;15(11):e1002700.
Kaur G, Chauhan AS, Prinja S, Teerawattananon Y, Muniyandi M, Rastogi A, et al. Cost-effectiveness of population-based screening for diabetes and hypertension in India: an economic modelling study. Lancet Public Health. 2022;7(1):e65–73.
Chao J, Zong M, Xu H, Yu Q, Jiang L, Li Y, et al. The long-term effect of community-based health management on the elderly with type 2 diabetes by the Markov modeling. Arch Gerontol Geriatr. 2014;59(2):353–9.
Wang H, Wang M, Wang J, Liu H, Lu R, Duan T, et al. Cost-effectiveness analysis of comprehensive intervention programs to control blood glucose in overweight and obese type 2 diabetes mellitus patients based on a real-world setting: Markov modeling. Ann Transl Med. 2019;7(22):676.
Basu S, Shankar V, Yudkin JS. Comparative effectiveness and cost-effectiveness of treat-to-target versus benefit-based tailored treatment of type 2 diabetes in low-income and middle-income countries: a modelling analysis. Lancet Diabetes Endocrinol. 2016;4(11):922–32.
Ben ÂJ, Neyeloff JL, de Souza CF, Rosses APO, de Araujo AL, Szortika A, et al. Cost-utility analysis of opportunistic and systematic diabetic retinopathy screening strategies from the perspective of the Brazilian public healthcare system. Appl Health Econ Health Policy. 2020;18(1):57–68.
Feldhaus I, Nagpal S, Verguet S. Alleviating the burden of diabetes with health equity funds: economic evaluation of the health and financial risk protection benefits in Cambodia. PLoS One. 2021;16(11):e0259628.
Rachapelle S, Legood R, Alavi Y, Lindfield R, Sharma T, Kuper H, et al. The cost-utility of telemedicine to screen for diabetic retinopathy in India. Ophthalmology. 2013;120(3):566–73.
Basu S, Flood D, Geldsetzer P, Theilmann M, Marcus ME, Ebert C, et al. Estimated effect of increased diagnosis, treatment, and control of diabetes and its associated cardiovascular risk factors among low-income and middle-income countries: a microsimulation model. Lancet Glob Health. 2021;9(11):e1539–e52.
Basu S, Wagner RG, Sewpaul R, Reddy P, Davies J. Implications of scaling up cardiovascular disease treatment in South Africa: a microsimulation and cost-effectiveness analysis. Lancet Glob Health. 2019;7(2):e270–e80.
Tropsha A, Gramatica P, Gombar VK. The importance of being earnest: validation is the absolute essential for successful application and interpretation of QSPR models. QSAR Comb Sci. 2003;22(1):69–77.
Robert CP, Elvira V, Tawn N, Wu C. Accelerating MCMC algorithms. Wiley Interdiscip Rev: Comput Stat. 2018;10(5):e1435.
Daniel Mullins C, Onwudiwe NC, Branco De Araújo GT, Chen W, Xuan J, Tichopád A, et al. Guidance document: global Pharmacoeconomic model adaption strategies. Value Health Reg Issues. 2014;5:7–13.
Baik S, Chacra AR, Yuxiu L, White J, Güler S, Latif ZA. Conducting cost-effectiveness analyses of type 2 diabetes in low- and middle-income countries: can locally generated observational study data overcome methodological limitations? Diabetes Res Clin Pract. 2010;88:S17–22.
Tarride J-E, Hopkins R, Blackhouse G, Bowen JM, Bischof M, Von Keyserlingk C, et al. A review of methods used in long-term cost-effectiveness models of diabetes mellitus treatment. PharmacoEconomics. 2010;28(4):255–77.
Wilkinson T, Sculpher MJ, Claxton K, Revill P, Briggs A, Cairns JA, et al. The international decision support initiative reference case for economic evaluation: an aid to thought. Value Health. 2016;19(8):921–8.
Palmer AJ, Si L, Tew M, Hua X, Willis MS, Asseburg C, et al. Computer modeling of diabetes and its transparency: a report on the eighth Mount Hood challenge. Value Health. 2018;21(6):724–31.
Grimm V, Railsback SF, Vincenot CE, Berger U, Gallagher C, DeAngelis DL, et al. The ODD protocol for describing agent-based and other simulation models: a second update to improve clarity, replication, and structural realism. Journal of artificial societies and social. Simulation. 2020;23(2):7.
Willis M, Asseburg C, He J. Validation of economic and health outcomes simulation model of type 2 diabetes mellitus (ECHO-T2DM). J Med Econ. 2013;16(8):1007–21.
Acknowledgements
Not applicable.
Funding
This study is funded by the University of Strathclyde as part of ETT doctoral research.
Author information
Authors and Affiliations
Contributions
All authors contributed to conceptualising the study and provided critical feedback to direct analysis and manuscript writing. ETT selected and reviewed literature, analysed data and wrote the manuscript draft. The author(s) read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
All authors declare no competing interest.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Additional file 1.
Description of Decision Analysis models.
Additional file 2.
Details of reviewed studies.
Additional file 3.
Characteristics of studies excluded during full text review.
Additional file 4.
PRISMA checklist of the study.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Twumwaa, T.E., Justice, N., Robert, v.D.M. et al. Application of decision analytical models to diabetes in low- and middle-income countries: a systematic review. BMC Health Serv Res 22, 1397 (2022). https://doi.org/10.1186/s12913-022-08820-7
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12913-022-08820-7