Avoid common mistakes on your manuscript.
We would like to thank Ramaekers et al. [1] for their interest in our publication, which highlights some of the challenges faced when validating complex, multi-disease models.
We welcome the discussion of feedback from the evidence review group appraisal. Based on the experience of submitting to the National Institute for Health and Care Excellence, updates have been made to the Core Obesity Model (COM) and the revised version is currently being used in other countries around the world. While there is uncertainty associated with certain aspects of the model predictions, the internal and external validation aimed to provide a degree of reassurance that those model predictions are generally consistent with external data.
Another important point is the definition of acceptable concordance between predicted and observed values, and we agree that this is a challenging aspect of model validation. Indeed, the International Society for Pharmacoeconomics and Outcomes Research/Society for Medical Decision Making guidelines emphasize that it is not feasible to quantify the desired level of accuracy for the predictions made by models, stating that “it is not possible to specify criteria that a model must meet to be declared ‘valid’, as if validity were a property of the model that applies to all of its applications and uses for all time” [2]. Additional statistical methods, like those described by Corro Ramos et al., may be of use; however, as stated by those authors, any approach would still require decision makers to establish a necessary accuracy level, which may rely on more factors than prediction accuracy versus empirical data per se [3].
Finally, we agree that uncertainty may arise from extrapolating short-term outcomes based on selected, published risk estimates, and that alternative options are limited. When risk equations are used to predict outcomes, it is assumed that the effect of a weight management intervention will result in a risk of an outcome, irrespective of baseline levels. However, a prerequisite to modelling legacy effects accounting for previous weight profiles is that such risk equations must be available. These aspects are particularly important when considering a multi-application model like the COM, which can evolve over time as new clinical evidence becomes available.
We hope that these additional discussions are a constructive adjunct to our manuscript and help to contextualize its role as a starting point from which future iterations can incorporate newer risk estimates, when available, and as the basis for cost-effectiveness analyses in specific clinical settings.
References
Ramaekers B, Wijnen B, Armstrong N, et al. Comment on “External validation of the core obesity model to assess the cost-effectiveness of weight management interventions”. Pharmacoeconomics. 2020. https://doi.org/10.1007/s40273-020-00985-5.
Eddy DM, Hollingworth W, Caro JJ, Tsevat J, McDonald KM, Wong JB, et al. Model transparency and validation: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force-7. Med Decis Mak. 2012;32(5):733–43. https://doi.org/10.1177/0272989X12454579.
Corro Ramos I, van Voorn GAK, Vemer P, Feenstra TL, Al MJ. A new statistical method to determine the degree of validity of health economic model outcomes against empirical data. Value Health. 2017;20(8):1041–7. https://doi.org/10.1016/j.jval.2017.04.016.
Acknowledgements
The authors acknowledge the medical writing assistance of PharmaGenesis Oxford Central, Oxford, UK, which was funded by Novo Nordisk A/S.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
Sandra Lopes and Pierre Johansen are employees of and shareholders in Novo Nordisk A/S. IQVIA, the employer of Mark Lamotte and Anamaria-Vera Olivieri, received consulting fees from Novo Nordisk A/S for this study. Health Economics and Outcomes Research Ltd, the employer of Phil McEwan and Volker Foos, received consulting fees from Novo Nordisk A/S for this study.
Additional information
This reply refers to the article available online at https://link.springer.com/article/10.1007/s40273-020-00941-3.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License, which permits any non-commercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc/4.0/.
About this article
Cite this article
Lopes, S., Johansen, P., Lamotte, M. et al. Authors’ reply to Comment on “External Validation of the Core Obesity Model to Assess the Cost-Effectiveness of Weight Management Interventions”. PharmacoEconomics 39, 137–138 (2021). https://doi.org/10.1007/s40273-020-00982-8
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40273-020-00982-8