Most studies addressing the volume–outcome relationship in complex surgical procedures use hospital mortality as the sole outcome measure and are rarely based on detailed clinical data. The lack of reliable information about comorbidities and tumor stages makes the conclusions of these studies debatable.
The purpose of this study was to compare outcomes for esophageal resections for cancer in low- versus high-volume hospitals, using an extensive set of variables concerning case-mix and outcome measures, including long-term survival.
Clinical data, from 903 esophageal resections performed between January 1990 and December 1999, were retrieved from the original patients’ files. Three hundred and forty-two patients were operated on in 11 low-volume hospitals (<7 resections/year) and 561 in a single high-volume center.
Mortality and morbidity rates were significantly lower in the high-volume center, which had an in-hospital mortality of 5 vs 13% (P < .001). On multivariate analysis, hospital volume, but also the presence of comorbidity proved to be strong prognostic factors predicting in-hospital mortality (ORs 3.05 and 2.34). For stage I and II disease, there was a significantly better 5-year survival in the high-volume center. (P = .04).
Hospital volume and comorbidity patterns are important determinants of outcome in esophageal cancer surgery. Strong clinical endpoints such as in-hospital mortality and survival can be used as performance indicators, only if they are joined by reliable case-mix information.
Similar content being viewed by others
Since Luft published his study about the inverse relationship between surgical volume and hospital mortality in 1979, a plethora of studies has demonstrated an improvement of clinical outcome with increased hospital volume.1 Most of these studies use hospital mortality as the sole outcome measure. Often, data are obtained from insurance company’s databases, and few studies use clinical data for risk-adjustment.2
The surgical treatment of esophageal cancer is often mentioned as one of the procedures for which concentration in high-volume centers might improve outcome.3,4 Nevertheless, a clear volume cut-off point at which a cancer center is justified to perform esophageal resections can hardly be defined.5,6 Also, the volume–outcome literature for esophageal resections is limited to postoperative mortality as the sole determinant of outcome.
Considering the growing evidence for this volume–outcome relationship for esophageal cancer surgery, we decided to investigate the outcome of these procedures in our region from 1990 until 1999. During this study period none of the 11 hospitals affiliated with the Comprehensive Cancer Center Leiden (CCCL) in the Netherlands performed more than seven esophageal resections a year; all are considered low-volume hospitals (LVH).
In contrast to most volume–outcome studies, we decided to use clinical data obtained from the original patients’ files. We retrieved information about comorbid diseases, tumor characteristics, treatment, and outcome. Next to hospital mortality, several determinants of outcome were examined, such as the number of tumor-free margins and complication rates. Assuming that survival is an essential indicator for quality in cancer surgery, we included a 5-year follow-up. To put our data in the right perspective, we compared these outcomes to the results of the topographically nearest high-volume referral center (HVH).
PATIENTS AND METHODS
All surgically treated esophageal carcinomas in the period 1990–1999 were retrospectively identified through the Leiden Cancer Registry (LCR) of the Comprehensive Cancer Center Leiden (CCCL), in which all cancer patients treated in the midwestern part of the Netherlands are registered (1.7 million inhabitants). All 11 hospitals gave consent to participate in this audit and were visited by two investigators to retrieve the original patient files. Patient demographics, pathological notes, data on the surgical and (neo)adjuvant treatments, comorbidity as well as postoperative morbidity, mortality, length of stay, radicality of the resection, and long-term survival could all be retrieved from the patient’s files.
All tumors were staged according to the UICC TNM classification of 1997. This was done by two independent researchers. The obtained pTNM stages were checked with the pTNM stages registered in the LCR. Any discrepancies were discussed between the researchers and a trained data manager from the CCCL. If consensus could not be reached, the pTNM stage was registered as “unknown.”
To make a comparison with the outcomes of the nearest high-volume center, data were categorized according to the database of this center. In this hospital, data of patients operated on for an esophageal carcinoma are prospectively collected by a trained data manager.
Differences in patient, tumor, and treatment characteristics as well as outcome measurements were assessed using the Kruskal–Wallis test for continuous variables and the chi-square test for categorical variables. Logistic regression was used to determine prognostic factors of in-hospital mortality. Variables were entered in the multivariate model as a prognostic factor when P values <.10.
Survival was calculated as the difference between date of surgery and either the date of death or the date of last patient follow-up. For both groups, follow-up of the patients was completed until December 31,, 2005. Observed survival rates were estimated by using the Kaplan–Meier method. The log-rank test was used to assess differences in survival between patients who were operated in LVHs and the HVH. All analyses were conducted using SPSS software (version 12.0; SPSS Inc., Chicago. IL).
In 1990–1999 the evaluation and treatment of patients with an esophageal carcinoma were performed in 11 hospitals in the region of the CCCL (one university hospital, five teaching hospitals, and five general hospitals). In 342 patients the tumor was resected with curative intent. Figures 1 A and B illustrate the distribution of surgical procedures within the studied time period and between the different hospitals. None of the CCCL hospitals performed more than seven esophageal resections a year, which makes them low-volume hospitals (LVHs).7 In the same period, 561 esophageal resections were performed in the nearest high-volume referral center (HVH); a mean volume of 56 resections a year.
Patient, Tumor, and Treatment Characteristics
Table 1 shows the patient, tumor, and treatment characteristics of both groups. More patients from the HVH had a squamous cell carcinoma and an advanced stage of the disease. Operative strategy as well as adjuvant or neoadjuvant treatment varied widely between the groups. The vast majority of resections in the HVH was performed according to the transhiatal technique, with a gastric tube reconstruction and anastomosis to the cervical remnant esophagus. In the LVH group a substantial number of anastomoses were located in the thoracic cavity, after a (partial) gastroesophagectomy with either a gastric tube reconstruction or esophagojejunostomy. In the pathology, clear surgical margins (R0) were reported in 72 % and 67 %, respectively for the LVHs and the HVH group.
Morbidity and Mortality
A significantly higher postoperative morbidity rate was found in the LVH group, which probably is also reflected by the longer hospital stay (Table 2). The clinical anastomotic leakage rate differed between both groups: LVHs 17% versus HVH 5%. The mortality rate was almost three times higher for patients treated in the LVHs than those who had their operation in the HVH: 13% vs 5%, respectively (P < .001). None of the LVHs had a mortality rate lower than the 5% of the HVH (Table 3). Univariate analysis showed that hospital volume, age, and comorbidity are prognostic factors for mortality (Table 4). The mortality risk increased with higher age and the number of organ systems affected. Especially cardiac (OR 3.22, CI 1.91–5.44), vascular (OR 2.49, CI 1.45–4.27), and respiratory (OR 1.90 CI 1.09–3.33) comorbidity were risk factors for postoperative mortality.
Multivariate analysis showed that both hospital volume and comorbidity were independent prognostic factors for hospital mortality (Table 5).
Figure 2 shows the crude 10-year overall survival rate of all patients, in which an esophageal resection for cancer was performed. Survival rates for patients treated in the HVH are significantly better (P = .01). This survival benefit loses its statistical significance, after exclusion of patients who died postoperatively of complications of the surgical procedure (Fig. 3). Only, when we select patients with stage I and II disease do we see a better survival in the HVH (Fig. 4), meaning that its overall results are worsened by the poor survival in the higher stages of the disease, stage III and IV. This can be explained by the unfavorable tumor mix, with significantly more stage IV disease treated in the HVH, than in the LVHs (16.7 vs 6.1%).
Currently, there is extensive interest in comparing outcome of complex surgical procedures between high- and low-volume providers. Most of the studies are registry-based or relatively small. Our series offers additional proof to the volume–outcome relationship, because it is based on clinical data, retrieved from the original patient files. This allows us to make reliable comparisons for comorbidities and tumor stage, which proved to be important prognostic factors for in-hospital mortality and survival.
A review of the evidence for a volume–outcome relationship was published by Dudley in 20008 and Halm in 2002.2 In the latter publication 135 studies were reviewed, of which only five were not from the United States or Canada. The majority of reports were based on state or national hospital discharge databases, where only a few studies used clinical data for risk adjustment. The outcome measure was “death” in 79% of the studies, without analyzing other dimensions of “outcome,” such as morbidity, length of hospital stay, reoperations, et cetera. For cancer-related procedures, long-term survival was not mentioned. Higher-level methodological issues were rarely addressed. Only five studies concerning cancer treatment adjusted for (neo)-adjuvant therapies or the type of surgical resection, but without any adjustment for tumor stage.
Since 2002, more extensive studies on hospital or surgeon volume appeared in the international literature. Birkmeyer reported a total number of 2.5 million operations concerning 14 different surgical procedures derived from the MEDICARE database.9 Mortality was the only outcome measure. Even after risk adjustment, which decreased the outcome differences between high- and low-volume hospitals, the differences in results for esophageal and pancreatic resections were highly significant, favoring surgery in a high-volume center. Two more recently published reviews of the volume–outcome relationship for esophagectomies came up with 12 papers addressing this subject.4,5 Only two of these studies were based on clinical data. Although both showed a decrease in mortality, they failed to show a statistically significant relationship of operative mortality with hospital volume.10,11 In our own review of the literature we identified another study from the United Kingdom using clinical data, in which hospital case volume independently predicted operative mortality2 (Table 6).
In the present study, independent data managers collected data retrospectively from the patient files. Not only the (in-hospital) mortality rate was obtained, but also a range of other outcome data, such as complication rates, resection margins, length of stay, and long-term survival. In our opinion the latter is an important performance indicator in surgical oncology, surprisingly sporadically mentioned in the volume–outcome literature.
The results of patients treated in 11 low-volume hospitals were compared with the results of patients treated in the nearest high-volume referral center. Significant differences in outcome could be revealed. In-hospital mortality was significantly higher in the low-volume hospitals. The retrieved information about comorbidity and stage of the disease made an extensive preoperative risk and tumor load comparison possible. Risk adjustment is an important issue in outcome research, because patients with severe comorbidity may be unequally distributed between (groups of) hospitals. Especially, when only administrative data are used to assess hospital performances, a selection-bias could lead to inadvertently penalizing those surgeons who provide excellent care to patients with more severe comorbid disease.7,13 Administrative data sets were never designed to predict risk and should probably not be used as such.14 Therefore, the validity of studies that fail to make case-mix adjustments based on clinical data, has to be questioned.
Nevertheless, a multivariate analysis of our data shows hospital volume to be an independent prognostic factor for in-hospital mortality. Although differences in surgical technique could be detected, with more transthoracic esophagectomies and intrathoracic anastomoses in the low-volume group, these factors are not significantly related to mortality. These findings are confirmed by earlier reports.15–18 Also, there is little evidence for a beneficial role of neoadjuvant therapies.19–22 However, above all, choices made concerning diagnostic strategy, neoadjuvant treatments, and surgical technique are related to the knowledge, experience, and judgment of the (team of) specialists.
After exclusion of in-hospital mortality, the survival of patients in the HVH was equal to those treated in the LVHs. However, the results of the HVH were negatively influenced by its case-mix. More patients with stage IV disease were treated in the HVH, corresponding with its status as a tertiary referral center. The very poor survival in this group of patients influences the overall results significantly. Only when we are informed about differences in tumor stage, we are able to detect real differences in survival between patients treated in different hospitals. Although in this study, all pathology reports were reviewed, and the number of lymph nodes resected was equal for both groups, we still have to be cautious suggesting a survival benefit for high-volume surgery. Only when a uniform pathologic evaluation is guaranteed, can we be sure that observed differences in tumor stages are truly characteristic for patient groups. This could be the reason that few studies have attempted to examine the influence of hospital volume on long-term survival in cancer surgery, only one of them concerning esophagectomies.23–27 A recent study from the Netherlands failed to show a survival benefit in high-volume hospitals (>20 resections a year), but did show an improved survival for esophagectomies performed in university compared to non-university hospitals.28 On the other hand, for pancreatectomies and hepatectomies registered in the MEDICARE-database, Fong showed a significantly better survival for procedures performed in high-volume centers.25 In his study, administrative data about age, gender, comorbidity, and extent of the resection were included in a univariate and multivariate analysis, but stages of the disease, radicality, and intent of the resection (palliative or curative) were not reported.
In conclusion, our study shows that hospital volume is an important determinant of perioperative morbidity and mortality in esophageal cancer surgery. Nevertheless, volume in itself is no guarantee for high quality of surgical care in a specific institution. Selecting (only) favorable patients can be the basis of superior results. Therefore, case-mix adjustments are essential in the assessment of surgical performance of different institutions.
Luft HS, Bunker JP, Enthoven AC. Should operations be regionalized? The empirical relation between surgical volume and mortality. N Engl J Med 1979;301:1364–9
Halm EA, Lee C, Chassin MR. Is volume related to outcome in health care? A systematic review and methodologic critique of the literature. Ann Intern Med 2002;137:511–20
Birkmeyer JD, Siewers AE, Finlayson EV, et al. Hospital volume and surgical mortality in the United States. N Engl J Med 2002;346:1128–37
Killeen SD, O’Sullivan MJ, Coffey JC, Kirwan WO, Redmond HP. Provider volume and outcomes for oncological procedures. Br J Surg 2005;92:389–402
Metzger R, Bollschweiler E, Vallbohmer D, Maish M, DeMeester TR, Holscher AH. High volume centers for esophagectomy: what is the number needed to achieve low postoperative mortality? Dis Esophagus 2004;17:310–4
Holscher AH, Metzger R, Brabender J, Vallbohmer D, Bollschweiler E. High-volume centers—effect of case load on outcome in cancer surgery. Onkologie 2004;27:412–6
van Lanschot JJ, Hulscher JB, Buskens CJ, Tilanus HW, ten Kate FJ, Obertop H. Hospital volume and hospital mortality for esophagectomy. Cancer 2001;91:1574–8
Dudley RA, Johansen KL, Brand R, Rennie DJ, Milstein A. Selective referral to high-volume hospitals: estimating potentially avoidable deaths. JAMA 2000;283:1159–66
Birkmeyer JD, Siewers AE, Finlayson EV, et al. Hospital volume and surgical mortality in the United States. N Engl J Med 2002;346:1128–37
Bachmann MO, Alderson D, Edwards D, Wotton S, Bedford C, Peters TJ, Harvey IM. Cohort study in South and West England of the influence of specialization on the management and outcome of patients with oesophageal and gastric cancers. Br J Surg 2002;89:914–22
Gillison EW, Powell J, McConkey CC, Spychal RT. Surgical workload and outcome after resection for carcinoma of the oesophagus and cardia. Br J Surg 2002;89:344–8
McCulloch P, Ward J, Tekkis PP. Mortality and morbidity in gastro-oesophageal cancer surgery: initial results of ASCOT multicentre prospective cohort study. BMJ 2003;327:1192–7
Urbach DR, Bell CM. The effect of patient selection on comorbidity-adjusted operative mortality risk. Implications for outcomes studies of surgical procedures. J Clin Epidemiol 2002;55:381–5
Iezzoni LI. Assessing quality using administrative data. Ann Intern Med 1997;127:666–74
Chasseray VM, Kiroff GK, Buard JL, Launois B. Cervical or thoracic anastomosis for esophagectomy for carcinoma. Surg Gynecol Obstet 1989;169:55–62
Goldminc M, Maddern G, Le Prise E, Meunier B, Campion JP, Launois B. Oesophagectomy by a transhiatal approach or thoracotomy: a prospective randomized trial. Br J Surg 1993;80:367–70
Hulscher JB, van Sandick JW, de Boer AG, et al. Extended transthoracic resection compared with limited transhiatal resection for adenocarcinoma of the esophagus. N Engl J Med 2002;347:1662–9
Ribet M, Debrueres B, Lecomte-Houcke M. Resection for advanced cancer of the thoracic esophagus: cervical or thoracic anastomosis? Late results of a prospective randomized study. J Thorac Cardiovasc Surg 1992;103:784–9
Arnott SJ, Duncan W, Kerr GR, et al. Low dose preoperative radiotherapy for carcinoma of the oesophagus: results of a randomized clinical trial. Radiother Oncol 1992;24:108–13
Malthaner RA, Wong RK, Rumble RB, Zuraw L. Neoadjuvant or adjuvant therapy for resectable esophageal cancer: a systematic review and meta-analysis. BMC Med 2004;2:35
Urba SG, Orringer MB, Turrisi A, Iannettoni M, Forastiere A, Strawderman M. Randomized trial of preoperative chemoradiation versus surgery alone in patients with locoregional esophageal carcinoma. J Clin Oncol 2001;19:305–3
Walsh TN, Noonan N, Hollywood D, Kelly A, Keeling N, Hennessy TP. A comparison of multimodal therapy and surgery for esophageal adenocarcinoma. N Engl J Med 1996;335:462–7
Bach PB, Cramer LD, Schrag D, Downey RJ, Gelfand SE, Begg CB. The influence of hospital volume on survival after resection for lung cancer. N Engl J Med 2001;345:181–8
Birkmeyer JD, Warshaw AL, Finlayson SR, Grove MR, Tosteson AN. Relationship between hospital volume and late survival after pancreaticoduodenectomy. Surgery 1999;126:178–83
Fong Y, Gonen M, Rubin D, Radzyner M, Brennan MF. Long-term survival is superior after resection for cancer in high-volume centers. Ann Surg 2005;242:540–4
Roohan PJ, Bickell NA, Baptiste MS, Therriault GD, Ferrara EP, Siu AL. Hospital volume differences and five-year survival from breast cancer. Am J Public Health 1998;88:454–7
Schrag D, Cramer LD, Bach PB, Cohen AM, Warren JL, Begg CB. Influence of hospital procedure volume on outcomes following surgery for colon cancer. JAMA 2000;284:3028–35
Verhoef C, van de WR, Schaapveld M, Bastiaannet E, Plukker JT. Better Survival in Patients with Esophageal Cancer After Surgical Treatment in University Hospitals: A Plea for Performance by Surgical Oncologists. Ann Surg Oncol 2007;14:1678–87
Birkmeyer JD, Dimick JB, Birkmeyer NJ. Measuring the quality of surgical care: structure, process, or outcomes? J Am Coll Surg 2004;198:626–32
van Heek NT, Kuhlmann KF, Scholten RJ, et al. Hospital volume and mortality after pancreatic resection: a systematic review and an evaluation of intervention in the Netherlands. Ann Surg 2005;242:781–8, discussion
O’Connor GT, Plume SK, Olmstead EM, et al. A regional intervention to improve the hospital mortality associated with coronary artery bypass graft surgery. The Northern New England Cardiovascular Disease Study Group. JAMA 1996;275:841–6
Dimick JB, Wainess RM, Upchurch GR Jr., Iannettoni MD, Orringer MB. National trends in outcomes for esophageal resection. Ann Thorac Surg 2005;79:212–6
Urbach DR, Baxter NN. Does it matter what a hospital is “high volume” for? Specificity of hospital volume–outcome associations for surgical procedures: analysis of administrative data. BMJ 2004;328:737–40
Christian CK, Gustafson ML, Betensky RA, Daley J, Zinner MJ. The Leapfrog volume criteria may fall short in identifying high-quality surgical centers. Ann Surg 2003;238:447–55
Finlayson EV, Goodney PP, Birkmeyer JD. Hospital volume and operative mortality in cancer surgery: a national study. Arch Surg 2003;138:721–5
Urbach DR, Bell CM, Austin PC. Differences in operative mortality between high- and low-volume hospitals in Ontario for 5 major surgical procedures: estimating the number of lives potentially saved through regionalization. CMAJ 2003;168:1409–14
Dimick JB, Pronovost PJ, Cowan JA Jr., Lipsett PA, Stanley JC, Upchurch GR, Jr. Variation in postoperative complication rates after high-risk surgery in the United States. Surgery 2003;134:534–40
Dimick JB, Cattaneo SM, Lipsett PA, Pronovost PJ, Heitmiller RF. Hospital volume is related to clinical and economic outcomes of esophageal resection in Maryland. Ann Thorac Surg 2001;72:334–9
Kuo EY, Chang Y, Wright CD. Impact of hospital volume on clinical and economic outcomes for esophagectomy. Ann Thorac Surg 2001;72:1118–24
Swisher SG, Deford L, Merriman KW, et al. Effect of operative volume on morbidity, mortality, and hospital use after esophagectomy for cancer. J Thorac Cardiovasc Surg 2000;119:1126–32
Gordon TA, Bowman HM, Bass EB, et al. Complex gastrointestinal surgery: impact of provider experience on clinical and economic outcomes. J Am Coll Surg 1999;189:46–56
Begg CB, Cramer LD, Hoskins WJ, Brennan MF. Impact of hospital volume on operative mortality for major cancer surgery. JAMA 1998;280:1747–51
Patti MG, Corvera CU, Glasgow RE, Way LW. A hospital’s annual rate of esophagectomy influences the operative mortality rate. J Gastrointest Surg 1998;2:186–92
This article is distributed under the terms of the Creative Commons Attribution Noncommercial License which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.
About this article
Cite this article
Wouters, M.W., Wijnhoven, B.P., Karim-Kos, H.E. et al. High-Volume versus Low-Volume for Esophageal Resections for Cancer: The Essential Role of Case-Mix Adjustments based on Clinical Data. Ann Surg Oncol 15, 80–87 (2008). https://doi.org/10.1245/s10434-007-9673-4