Skip to main content
Log in

A Case Study Examining the Usefulness of Cure Modelling for the Prediction of Survival Based on Data Maturity

  • Original Research Article
  • Published:
PharmacoEconomics Aims and scope Submit manuscript

Abstract

Introduction

Mixture modelling is increasingly being considered where a potential cure leads to a long life. Traditional methods use relative survival models for frail populations or cure models that have improper survival functions with theoretical infinite lifespans. Additionally, much of the work uses population data with long follow-up or theoretical data for method development.

Objective

This case study uses life table data to create a proper survival function in a real-world clinical trial context. In particular, we discuss the impact of the length of trial follow-up on the accuracy of model estimation and the impact of extrapolation to capture long-term survival.

Methods

A review of recent National Institute for Health and Clinical Excellence (NICE) immuno-oncological and chimeric antigen receptor (CAR) T-cell therapy submissions was performed to assess industry uptake and NICE acceptance of survival analysis methods incorporating the potential for long-term survivorship. The case study analysed a simulated trial-based dataset investigating a curative treatment with long-term mortality based on population life tables. The analysis examined three timepoints corresponding to early trial, end-of-trial follow-up and complete follow-up. Mixture modelling approaches were considered, including both cure modelling and relative survival approaches. The curves were evaluated based on the ability to estimate cure fractions and mean life in years within the time span the models are based on and when extrapolating to capture long-term behaviour. The survival curves were fitted with Weibull distributions using non-mixture and mixture cure models.

Results

The performance of the cure modelling methods depended on the relative maturity of the data, indicating that care is needed when deciding when the methods should be applied. For progression-free survival, the cure fraction simulated was 15%. The cure fractions estimated using the traditional mixture cure model were 43% (95% confidence interval [CI] 30–57) at the first analysis time point (40 months), 15% (95% CI 12–20) at the end-of-study follow-up (153 months) and 0% (95% CI 0–100) at the end of follow-up. Other standard cure modelling methods produced similar results. For overall survival, we observed a similar pattern of goodness of fit, with a good fit for the end-of-study follow-up and poor fit for the other two data cuts. However, in this case, the estimate of the cure fraction was below the true value in the first analysis data.

Conclusions

This case study suggests cure modelling works well with data in which the disease-specific events have had time to occur. Care is needed when extrapolating from immature data, and further information should support the estimation rather than relying on statistical estimates based on the trial alone.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Data Availability

The simulated data generated for this study is included in the supplementary information supplied with this article.

References

  1. Allemani C, Matsuda T, Di Carlo V, Harewood R, Matz M, Niksic M, et al. Global surveillance of trends in cancer survival 2000-14 (CONCORD-3): analysis of individual records for 37 513 025 patients diagnosed with one of 18 cancers from 322 population-based registries in 71 countries. Lancet (Lond Engl). 2018;391(10125):1023–75. https://doi.org/10.1016/s0140-6736(17)33326-3.

    Article  Google Scholar 

  2. Bullement A, Meng Y, Cooper M, Lee D, Harding TL, O’Regan C et al. A review and validation of overall survival extrapolation in health technology assessments of cancer immunotherapy by the National Institute for Health and Care Excellence: how did the initial best estimate compare to trial data subsequently made available? J Med Econ. 2018;2018:1–10. https://doi.org/10.1080/13696998.2018.1547303.

    Article  Google Scholar 

  3. Dine J, Gordon R, Shames Y, Kasler MK, Barton-Burke M. Immune checkpoint inhibitors: an innovation in immunotherapy for the treatment and management of patients with cancer. Asia-Pac J Oncol Nurs. 2017;4(2):127–35. https://doi.org/10.4103/apjon.apjon_4_17.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Latimer N. Estimating survival benefit for health technology assessment: new challenges presented by immuno-oncology treatments? BBS/PSI 1-Day Scientific Meeting: Empower the immune system to fight cancer. Basel: Switzerl. 2017.

  5. Kaplan EL, Meier P. Nonparametric estimation from incomplete observations. J Am Stat Assoc. 1958;53(282):457–81. https://doi.org/10.2307/2281868.

    Article  Google Scholar 

  6. Schadendorf D, Hodi FS, Robert C, Weber JS, Margolin K, Hamid O, et al. Pooled Analysis of long-term survival data from phase II and phase III trials of ipilimumab in unresectable or metastatic melanoma. J Clin Oncol. 2015;33(17):1889–94. https://doi.org/10.1200/jco.2014.56.2736.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  7. Neelapu SS, Locke FL, Bartlett NL, Lekakis LJ, Miklos DB, Jacobson CA, et al. Axicabtagene ciloleucel CAR T-cell therapy in refractory large B-cell lymphoma. New Engl J Med. 2017;377(26):2531–44. https://doi.org/10.1056/NEJMoa1707447.

    Article  PubMed  CAS  Google Scholar 

  8. Othus M, Barlogie B, LeBlanc ML, Crowley JJ. Cure models as a useful statistical tool for analyzing survival. Clin Cancer Res. 2012;18(14):3731–6. https://doi.org/10.1158/1078-0432.ccr-11-2859.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Canadian Agency for Drugs and Technologies in Health. Guidelines for the Economic Evaluation of Health Technologies: Canada—4th Edition. 2017. https://www.cadth.ca/about-cadth/how-we-do-it/methods-and-guidelines/guidelines-for-the-economic-evaluation-of-health-technologies-canada. Accessed 31 Jan 2019.

  10. Haute Autorité de Santé. Choices in Methods for Economic Evaluation. 2012. https://www.has-sante.fr/portail/upload/docs/application/pdf/2012-10/choices_in_methods_for_economic_evaluation.pdf. Accessed 31 Jan 2019.

  11. Jackson C. flexsurv: a platform for parametric survival modeling in R. J Stat Softw. 2016;70(8):33. https://doi.org/10.18637/jss.v070.i08.

    Article  Google Scholar 

  12. Latimer N. NICE DSU Technical Support Document 14: survival analysis for economic evaluations alongside clinical trials—extrapolation with patient-level data. 2011. http://nicedsu.org.uk/wp-content/uploads/2016/03/NICE-DSU-TSD-Survival-analysis.updated-March-2013.v2.pdf. Accessed 31 Jan 2019.

  13. Berkson J, Gage RP. Survival curve for cancer patients following treatment. J Am Stat Assoc. 1952;47(259):501–15. https://doi.org/10.2307/2281318.

    Article  Google Scholar 

  14. Lambert PC, Thompson JR, Weston CL, Dickman PW. Estimating and modeling the cure fraction in population-based cancer survival analysis. Biostat (Oxf, Engl). 2007;8(3):576–94. https://doi.org/10.1093/biostatistics/kxl030.

    Article  Google Scholar 

  15. De Angelis R, Capocaccia R, Hakulinen T, Soderman B, Verdecchia A. Mixture models for cancer survival analysis: application to population-based data with covariates. Stat Med. 1999;18(4):441–54. https://doi.org/10.1002/(sici)1097-0258(19990228)18:4%3c441:aid-sim23%3e3.0.co;2-m.

    Article  PubMed  Google Scholar 

  16. McLachlan Geoffrey J, Peel D. Finite mixture models. New York: Wiley; 2000.

    Book  Google Scholar 

  17. Mariotto AB, Etzioni R, Hurlbert M, Penberthy L, Mayer M. Estimation of the number of women living with metastatic breast cancer in the United States. Cancer Epidemiol Biomark Prev. 2017. https://doi.org/10.1158/1055-9965.epi-16-0889.

    Article  Google Scholar 

  18. Yu B, Tiwari RC, Cronin KA, Feuer EJ. Cure fraction estimation from the mixture cure models for grouped survival data. Stat Med. 2004;23(11):1733–47. https://doi.org/10.1002/sim.1774.

    Article  PubMed  Google Scholar 

  19. Bolard P, Quantin C, Abrahamowicz M, Esteve J, Giorgi R, Chadha-Boreham H, et al. Assessing time-by-covariate interactions in relative survival models using restrictive cubic spline functions. J Cancer Epidemiol Prev. 2002;7(3):113–22.

    PubMed  CAS  Google Scholar 

  20. Giorgi R, Abrahamowicz M, Quantin C, Bolard P, Esteve J, Gouvernet J, et al. A relative survival regression model using B-spline functions to model non-proportional hazards. Stat Med. 2003;22(17):2767–84. https://doi.org/10.1002/sim.1484.

    Article  PubMed  Google Scholar 

  21. Royston P, Parmar MK. Flexible parametric proportional-hazards and proportional-odds models for censored survival data, with application to prognostic modelling and estimation of treatment effects. Stat Med. 2002;21(15):2175–97. https://doi.org/10.1002/sim.1203.

    Article  PubMed  Google Scholar 

  22. Gibson E, Koblbauer I, Begum N, Dranitsaris G, Liew D, McEwan P, et al. Modelling the survival outcomes of immuno-oncology drugs in economic evaluations: a systematic approach to data analysis and extrapolation. PharmacoEconomics. 2017;35(12):1257–70. https://doi.org/10.1007/s40273-017-0558-5.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Ouwens MJNM, Mukhopadhyay P, Zhang Y, Huang M, Latimer N, Briggs A. Estimating lifetime benefits associated with immuno-oncology therapies: challenges and approaches for overall survival extrapolations. PharmacoEconomics. 2019;37(9):1129–38. https://doi.org/10.1007/s40273-019-00806-4.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Andersson TM, Dickman PW, Eloranta S, Lambert PC. Estimating and modelling cure in population-based cancer studies within the framework of flexible parametric survival models. BMC Med Res Methodol. 2011;11:96. https://doi.org/10.1186/1471-2288-11-96.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Lambert PC. Modeling of the cure fraction in survival studies. Stata J. 2007;7(3):351–75.

    Article  Google Scholar 

  26. Weller M, Felsberg J, Hartmann C, Berger H, Steinbach JP, Schramm J, et al. Molecular predictors of progression-free and overall survival in patients with newly diagnosed glioblastoma: a prospective translational study of the German Glioma Network. J Clin Oncol. 2009;27(34):5743–50. https://doi.org/10.1200/jco.2009.23.0805.

    Article  PubMed  CAS  Google Scholar 

  27. National Institute for Health and Care Excellence. Brentuximab vedotin for treating relapsed or refractory systemic anaplastic large cell lymphoma [TA478]. 2017. https://www.nice.org.uk/guidance/ta478. Accessed 31 Jan 2019.

  28. National Institute for Health and Care Excellence. Atezolizumab for untreated PD-L1-positive locally advanced or metastatic urothelial cancer when cisplatin is unsuitable [TA492]. 2017. https://www.nice.org.uk/guidance/ta492. Accessed 31 Jan 2019.

  29. National Institute for Health and Care Excellence. Atezolizumab for treating locally advanced or metastatic non-small-cell lung cancer after chemotherapy [TA520]. 2018. https://www.nice.org.uk/guidance/ta520. Accessed 31 January 2019.

  30. National Institute for Health and Care Excellence. Atezolizumab for treating locally advanced or metastatic urothelial carcinoma after platinum-containing chemotherapy [TA525]. 2018. https://www.nice.org.uk/guidance/ta525. Accessed 31 Jan 2019.

  31. Othus M, Bansal A, Koepl L, Wagner S, Ramsey S. Accounting for cured patients in cost-effectiveness analysis. Value Health. 2017;20(4):705–9. https://doi.org/10.1016/j.jval.2016.04.011.

    Article  PubMed  Google Scholar 

  32. Amico M, Van Keilegom I. Cure models in survival analysis. Annu Rev Stat Appl. 2018;5(1):311–42. https://doi.org/10.1146/annurev-statistics-031017-100101.

    Article  Google Scholar 

  33. Maller RA, Zhou X. Survival analysis with long-term survivors. New York: Wiley; 1996.

    Google Scholar 

Download references

Acknowledgements

Tim Grant performed analyses and wrote sections of the article. Darren Burns conducted the literature review and wrote sections of the article. Dawn Lee validated the analyses and wrote sections of the article. Christopher Kiff provided the data for the analyses and contributed to the writing and editing of the article. Tim Grant will act as the overall guarantor.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Tim S. Grant.

Ethics declarations

Funding

Financial support for this study was provided by a contract with Bristol-Myers Squibb Pharmaceuticals Ltd. The funding agreement ensured the authors’ independence in designing the study, interpreting the data and writing and publishing the report.

Conflict of interest

TG, DB and DL are employees of BresMed Health Solutions Ltd. CK is an employee and stockholder of Bristol-Myers Squibb Pharmaceuticals Ltd, which provided funding for this work. BresMed has received consulting fees from Bristol-Myers Squibb Pharmaceuticals Ltd for producing this manuscript.

Electronic supplementary material

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Grant, T.S., Burns, D., Kiff, C. et al. A Case Study Examining the Usefulness of Cure Modelling for the Prediction of Survival Based on Data Maturity. PharmacoEconomics 38, 385–395 (2020). https://doi.org/10.1007/s40273-019-00867-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40273-019-00867-5

Navigation