High-Volume versus Low-Volume for Esophageal Resections for Cancer: The Essential Role of Case-Mix Adjustments based on Clinical Data

Abstract

Background

Most studies addressing the volume–outcome relationship in complex surgical procedures use hospital mortality as the sole outcome measure and are rarely based on detailed clinical data. The lack of reliable information about comorbidities and tumor stages makes the conclusions of these studies debatable.

The purpose of this study was to compare outcomes for esophageal resections for cancer in low- versus high-volume hospitals, using an extensive set of variables concerning case-mix and outcome measures, including long-term survival.

Methods

Clinical data, from 903 esophageal resections performed between January 1990 and December 1999, were retrieved from the original patients’ files. Three hundred and forty-two patients were operated on in 11 low-volume hospitals (<7 resections/year) and 561 in a single high-volume center.

Results

Mortality and morbidity rates were significantly lower in the high-volume center, which had an in-hospital mortality of 5 vs 13% (P < .001). On multivariate analysis, hospital volume, but also the presence of comorbidity proved to be strong prognostic factors predicting in-hospital mortality (ORs 3.05 and 2.34). For stage I and II disease, there was a significantly better 5-year survival in the high-volume center. (P = .04).

Conclusions

Hospital volume and comorbidity patterns are important determinants of outcome in esophageal cancer surgery. Strong clinical endpoints such as in-hospital mortality and survival can be used as performance indicators, only if they are joined by reliable case-mix information.

Since Luft published his study about the inverse relationship between surgical volume and hospital mortality in 1979, a plethora of studies has demonstrated an improvement of clinical outcome with increased hospital volume.1 Most of these studies use hospital mortality as the sole outcome measure. Often, data are obtained from insurance company’s databases, and few studies use clinical data for risk-adjustment.2

The surgical treatment of esophageal cancer is often mentioned as one of the procedures for which concentration in high-volume centers might improve outcome.3,4 Nevertheless, a clear volume cut-off point at which a cancer center is justified to perform esophageal resections can hardly be defined.5,6 Also, the volume–outcome literature for esophageal resections is limited to postoperative mortality as the sole determinant of outcome.

Considering the growing evidence for this volume–outcome relationship for esophageal cancer surgery, we decided to investigate the outcome of these procedures in our region from 1990 until 1999. During this study period none of the 11 hospitals affiliated with the Comprehensive Cancer Center Leiden (CCCL) in the Netherlands performed more than seven esophageal resections a year; all are considered low-volume hospitals (LVH).

In contrast to most volume–outcome studies, we decided to use clinical data obtained from the original patients’ files. We retrieved information about comorbid diseases, tumor characteristics, treatment, and outcome. Next to hospital mortality, several determinants of outcome were examined, such as the number of tumor-free margins and complication rates. Assuming that survival is an essential indicator for quality in cancer surgery, we included a 5-year follow-up. To put our data in the right perspective, we compared these outcomes to the results of the topographically nearest high-volume referral center (HVH).

PATIENTS AND METHODS

All surgically treated esophageal carcinomas in the period 1990–1999 were retrospectively identified through the Leiden Cancer Registry (LCR) of the Comprehensive Cancer Center Leiden (CCCL), in which all cancer patients treated in the midwestern part of the Netherlands are registered (1.7 million inhabitants). All 11 hospitals gave consent to participate in this audit and were visited by two investigators to retrieve the original patient files. Patient demographics, pathological notes, data on the surgical and (neo)adjuvant treatments, comorbidity as well as postoperative morbidity, mortality, length of stay, radicality of the resection, and long-term survival could all be retrieved from the patient’s files.

All tumors were staged according to the UICC TNM classification of 1997. This was done by two independent researchers. The obtained pTNM stages were checked with the pTNM stages registered in the LCR. Any discrepancies were discussed between the researchers and a trained data manager from the CCCL. If consensus could not be reached, the pTNM stage was registered as “unknown.”

To make a comparison with the outcomes of the nearest high-volume center, data were categorized according to the database of this center. In this hospital, data of patients operated on for an esophageal carcinoma are prospectively collected by a trained data manager.

Differences in patient, tumor, and treatment characteristics as well as outcome measurements were assessed using the Kruskal–Wallis test for continuous variables and the chi-square test for categorical variables. Logistic regression was used to determine prognostic factors of in-hospital mortality. Variables were entered in the multivariate model as a prognostic factor when P values <.10.

Survival was calculated as the difference between date of surgery and either the date of death or the date of last patient follow-up. For both groups, follow-up of the patients was completed until December 31,, 2005. Observed survival rates were estimated by using the Kaplan–Meier method. The log-rank test was used to assess differences in survival between patients who were operated in LVHs and the HVH. All analyses were conducted using SPSS software (version 12.0; SPSS Inc., Chicago. IL).

RESULTS

Hospital Volume

In 1990–1999 the evaluation and treatment of patients with an esophageal carcinoma were performed in 11 hospitals in the region of the CCCL (one university hospital, five teaching hospitals, and five general hospitals). In 342 patients the tumor was resected with curative intent. Figures 1 A and B illustrate the distribution of surgical procedures within the studied time period and between the different hospitals. None of the CCCL hospitals performed more than seven esophageal resections a year, which makes them low-volume hospitals (LVHs).7 In the same period, 561 esophageal resections were performed in the nearest high-volume referral center (HVH); a mean volume of 56 resections a year.

FIG. 1.

(A) Number of esophageal resections per year in HVH versus LVH group (1990–1999). (B) Total number of esophageal resections per hospital for HVH and LVHs (1990–1999).

Patient, Tumor, and Treatment Characteristics

Table 1 shows the patient, tumor, and treatment characteristics of both groups. More patients from the HVH had a squamous cell carcinoma and an advanced stage of the disease. Operative strategy as well as adjuvant or neoadjuvant treatment varied widely between the groups. The vast majority of resections in the HVH was performed according to the transhiatal technique, with a gastric tube reconstruction and anastomosis to the cervical remnant esophagus. In the LVH group a substantial number of anastomoses were located in the thoracic cavity, after a (partial) gastroesophagectomy with either a gastric tube reconstruction or esophagojejunostomy. In the pathology, clear surgical margins (R0) were reported in 72 % and 67 %, respectively for the LVHs and the HVH group.

TABLE 1. Patient, tumor, and treatment characteristics of esophageal resections in LVH^a and HVH^b

Morbidity and Mortality

A significantly higher postoperative morbidity rate was found in the LVH group, which probably is also reflected by the longer hospital stay (Table 2). The clinical anastomotic leakage rate differed between both groups: LVHs 17% versus HVH 5%. The mortality rate was almost three times higher for patients treated in the LVHs than those who had their operation in the HVH: 13% vs 5%, respectively (P < .001). None of the LVHs had a mortality rate lower than the 5% of the HVH (Table 3). Univariate analysis showed that hospital volume, age, and comorbidity are prognostic factors for mortality (Table 4). The mortality risk increased with higher age and the number of organ systems affected. Especially cardiac (OR 3.22, CI 1.91–5.44), vascular (OR 2.49, CI 1.45–4.27), and respiratory (OR 1.90 CI 1.09–3.33) comorbidity were risk factors for postoperative mortality.

TABLE 2. Outcome after resection of esophagus for cancer in LVH^a and HVH^b

TABLE 3. Mortality after resection of esophagus for cancer in LVH^a and HVH^b

TABLE 4. Univariate analysis of in-hospital mortality

Multivariate analysis showed that both hospital volume and comorbidity were independent prognostic factors for hospital mortality (Table 5).

TABLE 5. Multivariate analysis of in-hospital mortality

Survival

Figure 2 shows the crude 10-year overall survival rate of all patients, in which an esophageal resection for cancer was performed. Survival rates for patients treated in the HVH are significantly better (P = .01). This survival benefit loses its statistical significance, after exclusion of patients who died postoperatively of complications of the surgical procedure (Fig. 3). Only, when we select patients with stage I and II disease do we see a better survival in the HVH (Fig. 4), meaning that its overall results are worsened by the poor survival in the higher stages of the disease, stage III and IV. This can be explained by the unfavorable tumor mix, with significantly more stage IV disease treated in the HVH, than in the LVHs (16.7 vs 6.1%).

FIG. 2.

Overall survival after esophagus resection for cancer: LVHs vs HVH (in-hospital mortality included ).

FIG. 3.

Overall survival after esophagus resection for cancer: LVHs vs HVH (in-hospital mortality excluded ).

FIG. 4.

Overall survival after esophagus resection for stage I and II carcinoma: LVHs vs HVH (in-hospital mortality excluded ).

DISCUSSION

Currently, there is extensive interest in comparing outcome of complex surgical procedures between high- and low-volume providers. Most of the studies are registry-based or relatively small. Our series offers additional proof to the volume–outcome relationship, because it is based on clinical data, retrieved from the original patient files. This allows us to make reliable comparisons for comorbidities and tumor stage, which proved to be important prognostic factors for in-hospital mortality and survival.

A review of the evidence for a volume–outcome relationship was published by Dudley in 20008 and Halm in 2002.2 In the latter publication 135 studies were reviewed, of which only five were not from the United States or Canada. The majority of reports were based on state or national hospital discharge databases, where only a few studies used clinical data for risk adjustment. The outcome measure was “death” in 79% of the studies, without analyzing other dimensions of “outcome,” such as morbidity, length of hospital stay, reoperations, et cetera. For cancer-related procedures, long-term survival was not mentioned. Higher-level methodological issues were rarely addressed. Only five studies concerning cancer treatment adjusted for (neo)-adjuvant therapies or the type of surgical resection, but without any adjustment for tumor stage.

Since 2002, more extensive studies on hospital or surgeon volume appeared in the international literature. Birkmeyer reported a total number of 2.5 million operations concerning 14 different surgical procedures derived from the MEDICARE database.9 Mortality was the only outcome measure. Even after risk adjustment, which decreased the outcome differences between high- and low-volume hospitals, the differences in results for esophageal and pancreatic resections were highly significant, favoring surgery in a high-volume center. Two more recently published reviews of the volume–outcome relationship for esophagectomies came up with 12 papers addressing this subject.4,5 Only two of these studies were based on clinical data. Although both showed a decrease in mortality, they failed to show a statistically significant relationship of operative mortality with hospital volume.10,11 In our own review of the literature we identified another study from the United Kingdom using clinical data, in which hospital case volume independently predicted operative mortality2 (Table 6).

TABLE 6. Volume–outcome articles for in-hospital mortality after esophagectomy 1998–2006

In the present study, independent data managers collected data retrospectively from the patient files. Not only the (in-hospital) mortality rate was obtained, but also a range of other outcome data, such as complication rates, resection margins, length of stay, and long-term survival. In our opinion the latter is an important performance indicator in surgical oncology, surprisingly sporadically mentioned in the volume–outcome literature.

The results of patients treated in 11 low-volume hospitals were compared with the results of patients treated in the nearest high-volume referral center. Significant differences in outcome could be revealed. In-hospital mortality was significantly higher in the low-volume hospitals. The retrieved information about comorbidity and stage of the disease made an extensive preoperative risk and tumor load comparison possible. Risk adjustment is an important issue in outcome research, because patients with severe comorbidity may be unequally distributed between (groups of) hospitals. Especially, when only administrative data are used to assess hospital performances, a selection-bias could lead to inadvertently penalizing those surgeons who provide excellent care to patients with more severe comorbid disease.7,13 Administrative data sets were never designed to predict risk and should probably not be used as such.14 Therefore, the validity of studies that fail to make case-mix adjustments based on clinical data, has to be questioned.

Nevertheless, a multivariate analysis of our data shows hospital volume to be an independent prognostic factor for in-hospital mortality. Although differences in surgical technique could be detected, with more transthoracic esophagectomies and intrathoracic anastomoses in the low-volume group, these factors are not significantly related to mortality. These findings are confirmed by earlier reports.15–18 Also, there is little evidence for a beneficial role of neoadjuvant therapies.19–22 However, above all, choices made concerning diagnostic strategy, neoadjuvant treatments, and surgical technique are related to the knowledge, experience, and judgment of the (team of) specialists.

After exclusion of in-hospital mortality, the survival of patients in the HVH was equal to those treated in the LVHs. However, the results of the HVH were negatively influenced by its case-mix. More patients with stage IV disease were treated in the HVH, corresponding with its status as a tertiary referral center. The very poor survival in this group of patients influences the overall results significantly. Only when we are informed about differences in tumor stage, we are able to detect real differences in survival between patients treated in different hospitals. Although in this study, all pathology reports were reviewed, and the number of lymph nodes resected was equal for both groups, we still have to be cautious suggesting a survival benefit for high-volume surgery. Only when a uniform pathologic evaluation is guaranteed, can we be sure that observed differences in tumor stages are truly characteristic for patient groups. This could be the reason that few studies have attempted to examine the influence of hospital volume on long-term survival in cancer surgery, only one of them concerning esophagectomies.23–27 A recent study from the Netherlands failed to show a survival benefit in high-volume hospitals (>20 resections a year), but did show an improved survival for esophagectomies performed in university compared to non-university hospitals.28 On the other hand, for pancreatectomies and hepatectomies registered in the MEDICARE-database, Fong showed a significantly better survival for procedures performed in high-volume centers.25 In his study, administrative data about age, gender, comorbidity, and extent of the resection were included in a univariate and multivariate analysis, but stages of the disease, radicality, and intent of the resection (palliative or curative) were not reported.

In conclusion, our study shows that hospital volume is an important determinant of perioperative morbidity and mortality in esophageal cancer surgery. Nevertheless, volume in itself is no guarantee for high quality of surgical care in a specific institution. Selecting (only) favorable patients can be the basis of superior results. Therefore, case-mix adjustments are essential in the assessment of surgical performance of different institutions.