Abstract
Background
The National Cancer Database (NCDB) is a valuable resource for studying national cancer treatment patterns. However, data abstraction rules from 2004 to 2007 resulted in missing clinical stage for a high percentage of cases. We investigated how this missingness can bias results in breast cancer studies including patients treated with neoadjuvant chemotherapy (NAC).
Methods
The impact of missing clinical stage on the estimated percentage of breast cancers treated with NAC versus adjuvant chemotherapy (AC) was examined from 2004 to 2013. Trends in NAC use were presented, excluding those cases with missing clinical stage, and compared with trends after multiple imputation, performed using the chained equations approach with predictive mean matching.
Results
Clinical stage was missing for 56% of cases in 2004–2007, versus 12% in 2008–2013, and was missing more than twice as often for AC patients versus NAC patients (31% vs. 12% overall), with the largest difference occurring in 2004–2007 (60% vs. 27% missing). Because stage was more frequently missing in AC patients, excluding those missing clinical stage introduced bias when considering NAC versus AC trends. With multiple imputation, significant increases in NAC use were identified between 2004 and 2013 for each stage: use for stage I was 2% in 2004 and 5% in 2013, use for stage II was 11% in 2004 and 24% in 2013, use for stage III was 34% in 2004 and 46% in 2013, in contrast to an analysis excluding those missing stage, which suggested little or no increase within any stage.
Conclusion
NCDB data abstraction rules from 2004 to 2007 resulted in missing clinical stage for > 50% of breast cancers, which may introduce substantial bias. Multiple imputation or exclusion of the years 2004–2007 should be considered to mitigate the problem of missing clinical stage in NCDB.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Raval MV, Bilimoria KY, Stewart AK, Bentrem DJ, Ko CY. Using the NCDB for cancer care improvement: an introduction to available quality assessment tools. J Surg Oncol. 2009;99(8):488–90.
Bilimoria KY, Stewart AK, Winchester DP, Ko CY. The National Cancer Data Base: a powerful initiative to improve cancer care in the United States. Ann Surg Oncol. 2008;15(3):683–90.
Boffa DJ, Rosen JE, Mallin K, et al. Using the National Cancer Database for outcomes research: a review. JAMA Oncol. 2017;3(12):1722–8.
National Cancer Database. Participant Use Data File (PUF) data dictionary. https://www.facs.org/~/media/files/quality%20programs/cancer/ncdb/puf_data_dictionary_puf_2015.ashx. Accessed 13 Aug 2018.
National Cancer Database. Participant Use Data File (PUF) supplemental documents. https://www.facs.org/~/media/files/quality%20programs/cancer/ncdb/puf_supplemental_documentation.ashx. Accessed 13 Aug 2018.
Merkow RP, Rademaker AW, Bilimoria KY. Practical guide to surgical data sets: National Cancer Database (NCDB). JAMA Surg. 2018;153(9):850–1.
Haider AH, Bilimoria KY, Kibbe MR. A checklist to elevate the science of surgical database research. JAMA Surg. 2018;153(6):505–7.
Kaji AH, Rademaker AW, Hyslop T. Tips for analyzing large data sets from the JAMA surgery statistical editors. JAMA Surg. 2018;153(6):508–9.
Little RJ, Rubin DB. Statistical analysis with missing data. Wiley, London; 2014.
Sterne JA, White IR, Carlin JB, et al. Multiple imputation for missing data in epidemiological and clinical research: potential and pitfalls. BMJ. 2009;338:b2393.
Horton NJ, Kleinman KP. Much ado about nothing: A comparison of missing data methods and software to fit incomplete data regression models. Am Stat. 2007;61(1):79-90.
Moons KG, Donders RA, Stijnen T, Harrell FE. Using the outcome for imputation of missing predictor values was preferred. J Clin Epidemiol. 2006;59(10):1092–101.
Eisemann N, Waldmann A, Katalinic A. Imputation of missing values of tumour stage in population-based cancer registration. BMC Med Res Methodol. 2011;11(1):129.
White IR, Royston P, Wood AM. Multiple imputation using chained equations: issues and guidance for practice. Stat Med. 2011;30(4):377–99.
Van Buuren S, Groothuis-Oudshoorn K. mice: multivariate imputation by chained equations in R. J Stat Softw. 2011;45(3):1–67.
Knol MJ, Janssen KJ, Donders ART, et al. Unpredictable bias when using the missing indicator method or complete case analysis for missing confounder values: an empirical example. J Clin Epidemiol. 2010;63(7):728–36.
Mougalian SS, Soulos PR, Killelea BK, et al. Use of neoadjuvant chemotherapy for patients with stage I to III breast cancer in the United States. Cancer. 2015;121(15):2544–52.
Mackinnon A. The use and reporting of multiple imputation in medical research: a review. J Intern Med. 2010;268(6):586–93.
Acknowledgment
The NCDB is a joint project of the CoC of the American College of Surgeons and the American Cancer Society. The CoC’s NCDB, and the hospitals participating in the CoC NCDB, are the source of the de-identified data used herein; they have not verified and are not responsible for the statistical validity of the data analysis or the conclusions derived by the authors.
Funding
The Mayo Clinic Robert D. and Patricia E. Kern Center for the Science of Health Care Delivery provides salary support for Dr. Habermann, Ms. Hoskin, and Ms. Day. No external funding was used.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Hoskin, T.L., Boughey, J.C., Day, C.N. et al. Lessons Learned Regarding Missing Clinical Stage in the National Cancer Database. Ann Surg Oncol 26, 739–745 (2019). https://doi.org/10.1245/s10434-018-07128-3
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1245/s10434-018-07128-3