, Volume 34, Issue 11, pp 1071–1074 | Cite as

From Good to Better: New Dutch Guidelines for Economic Evaluations in Healthcare

  • Matthijs Versteegh
  • Saskia Knies
  • Werner Brouwer

1 Introduction

Many countries have national guidelines for performing economic evaluations in healthcare.1 These guidelines should ensure the comparability and quality of such evaluations, which should facilitate making well informed policy decisions regarding reimbursement of interventions. Given the developments in both the methodology and policy context of economic evaluation of healthcare interventions, these guidelines require periodical revision. Recently, the Dutch National Health Care Institute issued new guidance for economic evaluations in healthcare [1]. The new guidelines update and replace three separately published previous guidelines: those for pharmacoeconomic evaluation (latest version 2006), outcomes research (latest version 2008) as well as the Dutch costing manual (latest version 2010). In this editorial, we highlight the distinguishing features of the new Dutch guidelines. Moreover, we highlight which developments, in our opinion, are desirable in coming updates, but are still in development or controversial.

2 Unchanged Features

2.1 Societal Perspective

A key feature of guidelines is which perspective they prescribe researchers to take in an evaluation. In line with the welfare economic roots of economic evaluation, influential textbooks as well as all previous Dutch guidelines, the new guidelines prescribe taking a societal perspective. This implies that all significant societal costs and benefits need to be included in the analysis, regardless of where these fall. Thus, evaluations should also include costs and benefits that fall outside the healthcare sector, such as time costs for patients (e.g. time lost from paid work, unpaid work or leisure time), travel costs, costs related to informal care (e.g. time of caregivers), costs of special education or those related to criminal activity.

2.2 Productivity Costs

Productivity costs are an important example of costs falling outside the healthcare sector. When productive people, either paid or unpaid, become less productive (due to illness, disability, death or treatment), this causes real societal costs. The guidelines indicate how to value these components, including the often ignored unpaid work [2, 3]. For absenteeism from paid work, the friction cost method is prescribed as the most accurate estimation of societal costs [4, 5]. This method limits productivity to the period it takes to replace an absent worker [6]. The measurement and valuation of production losses due to presenteeism are acknowledged as relevant. The costing manual (as part of the guidelines) indicates that productivity losses, including presenteeism, can be measured using, for example, the iMTA Productivity Cost Questionnaire (iPCQ) instrument [7].2 Unpaid work is valued at €14 per hour.

2.3 Informal Care

Another important cost (and effect) category is informal care, which commonly is a large part of total care provided to patients. Several methods for measuring, valuing and including these costs exist [8], but the current guidelines suggest they should be included on the cost side of the economic evaluation. This facilitates their inclusion in the most common type of economic evaluation: cost–utility analysis.

2.4 Cost–Utility Analysis

Cost–utility analysis, using quality-adjusted life-years (QALYs) as outcome, continues to be the reference case in the current guidelines. Effects in terms of health-related quality of life have to be captured with EQ-5D-5L valued with Dutch population preferences [9]. Remarkably, EQ-5D-5L scores have to be presented in the reference case, even when they might be considered inappropriate. Then, alternative measures can be presented alongside EQ-5D-5L outcomes.

2.5 Differential Discounting

Discounting costs and effects in economic evaluations is much debated (e.g. [10]). The previous guidelines (from 2006) already prescribed differential discounting (4 % for costs and 1.5 % for effects) rather than an equal discount rate of 4 %, to account for the growing value of health benefits in the future [11]. The current guideline also prescribes differential discounting; using the same rates (4 and 1.5 %).

3 New Features

The new guidelines also include new elements, reflecting the methodological developments in performing economic evaluations in healthcare. We highlight three of them.

3.1 Value of Information Analysis

Previous guidelines requested information on the uncertainty of the outcome of economic evaluations through univariate sensitivity analyses, probabilistic sensitivity analyses (PSA) and scenario analyses. The new guidelines require quantifying uncertainty through value of information analysis for all uncertain policy decisions, which can help in decision making, using conditional reimbursement schemes and priority setting of further research [12, 13]. In all instances where there is decision uncertainty, i.e. PSA indicates that the probability of an intervention being cost effective (given a relevant cost-effectiveness threshold) is <100 %, a value of information analysis is required.

3.2 Inclusion of Indirect Medical Costs in Life-Years Gained

Another major and quite unique change is the requirement to include so-called unrelated indirect medical costs in life-years gained. For example, when assessing the cost effectiveness of heart surgery, the costs related to treating hip fractures in gained life-years after successful heart surgery are also to be included. These costs were explicitly excluded from consideration in the previous guidelines, and this is still the case in most other guidelines, including those of NICE [14]. The inclusion of these latter costs has been much debated [15], but the case for their inclusion is strong [16]. Especially given that the health gains due to these unrelated costs typically are (implicitly) included in economic evaluations, making their exclusion inconsistent from both a societal and a healthcare perspective [17]. These unrelated healthcare costs can be estimated, correcting for the characteristics of the patients involved, using a simple tool that was recently developed [18].3 Clearly, including these costs can increase incremental cost-effectiveness ratios (i.e. decrease cost effectiveness of life-prolonging interventions), which may result in different reimbursement decisions that collectively increase health gained per euro, but which may also raise important ethical and policy questions. Given the new Dutch guidelines, these questions cannot and should not be circumvented by ignoring these real costs.

3.3 Beyond Medicines and Curative Care

A final important development is the explicit attention in the guidelines for methodological issues that arise in sectors other than the conventional areas of curative care and pharmaceuticals. While for these other sectors the now-included reference case requires QALY measurement with EQ-5D-5L-based quality-of-life corrections, it is acknowledged that this outcome measure may have limitations in particular contexts. Issues may specifically arise in economic evaluations in the contexts of prevention (e.g. uncertainty and modelling based on intermediate outcomes), diagnostics (e.g. consequences of false positives and negatives as well as value assessment in patients), medical devices (e.g. value of user friendliness), long-term care (e.g. wellbeing rather than health improvement as the goal) and forensic (e.g. reduction of criminal activity as the goal of an intervention). Many of these issues pertain to accurately capturing the value of interventions when this exceeds or deviates from health gains (in terms of length of life and quality of life as measured with the EQ-5D). The guidelines suggest other possibilities, ranging from measuring patients’ preferences for medical devices, use of effectiveness measures such as ‘criminal-activity-free years’ in forensic interventions, to the use of new instruments such as the ICECAP (Icepop Capability) measure [19] in case of long-term and social care [20]. For the purpose of standardization, the ICECAP is recommended in the guideline for outcome assessment in this field, be it alongside EQ-5D. This marks the broadening of the scope of the guidelines and use of economic evaluations in healthcare. The guideline also highlights the need for Multi-Criteria Decision Analysis in this context.

4 What is Expected and Desired in Future Updates?

The new Dutch guidelines present a long awaited update incorporating important improvements in theory and methodology of economic evaluations. A committee with broad representation of health technology assessment (HTA) experts was involved in creating these new guidelines. Cyclic updates are foreseen to guarantee that the guidelines keep up with methodological advances and are useful in the policy context. Below, we suggest four topics that could be included in future versions of the Dutch guidelines.

4.1 Expanding the Scope of Economic Evaluations

The current guidelines began the first step in broadening the scope of economic evaluations by looking at the specific issues related to, for instance, long-term care. It is important and expected that future guidelines will develop stronger and clearer guidance as to how to perform economic evaluations in these contexts. This will probably include a further standardization of non-QALY outcomes, such as wellbeing measures like the ICECAP [19]. It may also involve guidance on how to obtain preferences from patients through methods such as discrete choice experiments. Wellbeing measures may well become the preferred outcome measures in economic evaluations in non-curative settings, rather than being presented next to QALY estimates. However, it has to be acknowledged that experience with these instruments is currently limited. Moreover, there may be other pressing challenges related to obtaining good quality economic evaluations in the non-curative setting, most notably those related to adequate study designs for assessing comparative effectiveness of interventions. Indeed, appropriate wellbeing measures should be used in the context of well designed studies capable of detecting the wellbeing changes due to interventions.

4.2 Inclusion of Non-Medical Consumption

Given that Dutch guidelines prescribe taking a societal perspective and that, where relevant, productivity costs and indirect medical costs in gained life-years are now included, it is likely that the inclusion of non-medical consumption in life-years gained (housing, food, etc.) will gain more attention. Similar to indirect medical costs, prolonged survival of individuals increases such non-medical consumption. Moving towards a more complete and consistent trade-off of costs and effects will require inclusion of these costs in evaluations, as well as more discussion on whether the QALY adequately captures the related benefits [21, 22]. We do foresee, however, that inclusion of these costs will require both methodological work as well as further discussion to increase the acceptance of their inclusion.

4.3 Inclusion of QALY Variation

The current guideline prescribes the use of EQ-5D with Dutch tariffs obtained in the general public in all evaluations. This guidance enhances the uniform assessment of QALY gains, but also ignores important heterogeneity in QALY instruments. One important missed issue is the valuation of health states by patients themselves. Using both patient and general population values can inform the decision makers about the likelihood of adaptation to a condition, and use this information in the decision-making context. In a context of limited resources, decision makers might, for instance, use this information to, ceteris paribus, prioritize treatments of conditions for which adaptation is less likely and, therefore, treatment effects from a patient perspective are relatively large [23].

4.4 Two Perspectives and Costs of Displacement

Economic evaluations ultimately aim to inform resource allocation decisions in healthcare. The current framework for decision making in The Netherlands adopts a societal perspective, informally using an (equity weighted) threshold value for QALY gains that represents the social willingness to pay for QALY gains—the trade-off between health and other consumption. However, a full assessment, in the context of limited healthcare budgets, also requires knowledge about the opportunity costs within the healthcare sector [11, 17]. An intermediate step is to present the results from two perspectives: the societal and the healthcare perspective [24]. This allows relevant stakeholders to understand the tension between the two perspectives (if any).

Meaningfully interpreting the results from both perspectives still requires appropriate threshold values from both perspectives. While some experience with using equity-weighted, societal values of QALYs is present in the Dutch context, more knowledge on the opportunity costs of spending within the Dutch healthcare sector is required. In the coming period, more research can be devoted to this issue, along with gaining experience in the decision-making process using two perspectives.

5 Conclusion

The new Dutch guidelines are an important step forward in improving the requirements for economic evaluations in healthcare in the context of reimbursement decisions. We feel that the changes have moved the guidelines from good to better. We also feel that the foreseen periodical updates of the guidelines will allow further improvement in the future.


  1. 1.

    For an overview of guidelines around the world visit

  2. 2.

    Questionnaires for measuring and valuing productivity costs and informal care can be found here:

  3. 3.

    The tool can also be found here:



The guidelines were based on work and inputs from many national and international colleagues and formulated by an independent committee of experts, installed by the Dutch National Health Care Institute. Both Werner Brouwer (independent expert) and Saskia Knies (Project Leader, revision at the National Health Care Institute and Secretary, independent committee) were involved in the work of this committee. All expressed views here are our own.


  1. 1.
    Nederland Zorginstituut. Richtlijn voor het uitvoeren van economische evaluaties in de gezondheidszorg. Diemen: Zorginstituut Nederland; 2015.Google Scholar
  2. 2.
    Krol M, Brouwer W. How to estimate productivity costs in economic evaluations. Pharmacoeconomics. 2014;32(4):335–44.CrossRefPubMedGoogle Scholar
  3. 3.
    Krol M, Brouwer W. Unpaid work in health economic evaluations. Soc Sci Med. 2015;144:127–37.CrossRefPubMedGoogle Scholar
  4. 4.
    Koopmanschap MA, van Ineveld BM. Towards a new approach for estimating indirect costs of disease. Soc Sci Med. 1992;34(9):1005–10.CrossRefPubMedGoogle Scholar
  5. 5.
    Koopmanschap MA, Rutten FF. Indirect costs in economic studies. Pharmacoeconomics. 1993;4(6):446–54.CrossRefPubMedGoogle Scholar
  6. 6.
    Koopmanschap MA, Rutten FFH, van Ineveld BM, van Roijen L. The friction cost method for measuring indirect costs of disease. J Health Econ. 1995;14(2):171–89.CrossRefPubMedGoogle Scholar
  7. 7.
    Bouwmans C, Krol M, Severens H, Koopmanschap M, Brouwer W, Hakkaart-van Roijen L. The iMTA productivity cost questionnaire: a standardized instrument for measuring and valuing health-related productivity losses. Value in Health. 2015;18(6):753–8.CrossRefPubMedGoogle Scholar
  8. 8.
    Hoefman RJ, van Exel J, Brouwer W. How to include informal care in economic evaluations. Pharmacoeconomics. 2013;31(12):1105–19.CrossRefPubMedGoogle Scholar
  9. 9.
    Versteegh MM, Vermeulen KM, Evers SM, de Wit GA, Prenger R, Stolk EA. Dutch tariff for the five-level version of EQ-5D. Value Health. 2016;19(4):343–52.CrossRefGoogle Scholar
  10. 10.
    Claxton K, Paulden M, Gravelle H, Brouwer W, Culyer AJ. Discounting and decision making in the economic evaluation of health-care technologies. Health Econ. 2011;20(1):2–15.CrossRefPubMedGoogle Scholar
  11. 11.
    Brouwer WB, Niessen LW, Postma MJ, Rutten FF. Need for differential discounting of costs and health effects in cost effectiveness analyses. BMJ. 2005;331(7514):446–8.CrossRefPubMedPubMedCentralGoogle Scholar
  12. 12.
    Ramos IC, Rutten-van Mölken MP, Al MJ. The role of value-of-information analysis in a health care research priority setting a theoretical case study. Med Decis Making. 2012;33(4):472–89.CrossRefGoogle Scholar
  13. 13.
    Al M, Bindels J, Corro Ramos I, Feenstra T, Grutters J, Joore M, et al. Onzekerheid en Value of Information (VOI). Report. Diemen: Zorginstituut Nederland; 2015.Google Scholar
  14. 14.
    Morton A, Adler A, Briggs A, Brouwer WBF, Claxton K, Fischer A, et al. Unrelated future costs and unrelated future benefits: reflections on NICE guide to the methods of technology appraisal. Health Econ. 2016;25(8):933–8.CrossRefPubMedGoogle Scholar
  15. 15.
    Rappange DR, van Baal PH, van Exel N, Job A, Feenstra TL, Rutten FF, Brouwer WB. Unrelated medical costs in Life-Years gained. Pharmacoeconomics. 2008;26(10):815–30.CrossRefPubMedGoogle Scholar
  16. 16.
    Meltzer D. Accounting for future costs in medical cost-effectiveness analysis. J Health Econ. 1997;16(1):33–64.CrossRefPubMedGoogle Scholar
  17. 17.
    van Baal P, Meltzer D, Brouwer W. Future costs, fixed healthcare budgets, and the decision rules of cost-effectiveness analysis. Health Econ. 2016;25(2):237–48.CrossRefPubMedGoogle Scholar
  18. 18.
    van Baal PH, Wong A, Slobbe LC, Polder JJ, Brouwer WB, de Wit GA. Standardizing the inclusion of indirect medical costs in economic evaluations. Pharmacoeconomics. 2011;29(3):175–87.CrossRefPubMedGoogle Scholar
  19. 19.
    Coast J, Flynn TN, Natarajan L, Sproston K, Lewis J, Louviere JJ, et al. Valuing the ICECAP capability index for older people. Soc Sci Med. 2008;67(5):874–82.CrossRefPubMedGoogle Scholar
  20. 20.
    Lorgelly PK. Choice of outcome measure in an economic evaluation: a potential role for the capability approach. Pharmacoeconomics. 2015;33(8):849–55.CrossRefPubMedGoogle Scholar
  21. 21.
    Nyman JA. Should the consumption of survivors be included as a cost in cost–utility analysis? Health Econ. 2004;13(5):417–27.CrossRefPubMedGoogle Scholar
  22. 22.
    Gandjour A. Consumption costs and earnings during added years of life-a reply to Nyman. Health Econ. 2006;15(3):315–7.CrossRefPubMedGoogle Scholar
  23. 23.
    Versteegh MM, Brouwer WBF. Patient and general public preferences for health states: a call to reconsider current guidelines. Soc Sci Med. 2016;165:66–74.CrossRefPubMedGoogle Scholar
  24. 24.
    Brouwer WB, Van Exel N, Baltussen RM, Rutten FF. A dollar is a dollar is a dollar—or is it? Value Health. 2006;9(5):341–7.CrossRefPubMedGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Matthijs Versteegh
    • 1
  • Saskia Knies
    • 2
    • 3
  • Werner Brouwer
    • 1
    • 3
  1. 1.Institute for Medical Technology AssessmentErasmus University RotterdamRotterdamThe Netherlands
  2. 2.Dutch National Health Care InstituteDiemenThe Netherlands
  3. 3.Institute of Health Policy and ManagementErasmus University RotterdamRotterdamThe Netherlands

Personalised recommendations