Does Practice Make Perfect?
Extensive literature supports the correlation between surgical volume and improved clinical outcome in the management of various cancers. It is this evidence that has catalysed the creation of centres of excellence. However, on closer inspection, many of these studies are poor quality, low weight and use vastly heterogenous end points in assessment of both volume and outcome. We critically appraise the English language literature published over the last ten years pertaining to the volume outcome relationship in the context of cancer care. Future balanced unbiased studies may enable equipoise in planning international cancer management strategies.
KeywordsCancer Volume Outcome
No longer is there room for eminence-based complacency or misguided arrogance in healthcare delivery. The day of the autonomous clinician is gone with a vogue towards standardised, evidence-based clinical excellence. Cynics would erroneously attribute this to a parallel increase in litigation but increasing patient knowledge and expectations with a move toward subspecialisation are the main catalysts driving change. When offered operative intervention, the question frequently asked by the patient is “How many of these have you done before?” This article aims to critically analyse recent literature and explore the correlation between volume and clinical outcome in the context of cancer care.
Mortality rates are reported to be influenced by the number of particular operations performed in a given hospital or by a specific surgeon (i.e. outcomes are better in high-volume centres). In 1999, the US National Cancer Policy Board recommended that patients requiring complex procedures be transferred from low- to high-volume hospitals in its report entitled “Ensuring Quality Cancer Care”.1 The following year, the Institute of Medicine held a workshop to discuss cancer care, publishing a document (“Interpreting the Volume-Outcome Relationship in the Context of Cancer Care”2) which concluded that existing evidence was strong enough to recommend the regionalisation of high-risk operations. Hence, the impact of volume on outcome has been assessed in several tumour types but the majority of data relates to gastrointestinal, hepatobiliary, urological, and breast cancers.
Colorectal cancer outcome: high- and low-volume units
APR versus LAR
Meyerhardt et al. 19
Purves et al.20
30-day postoperative mortality
Schrag et al.21
Survival (overall and cancer specific)
Schrag et al.21
Permanent stoma formation
McGrath et al.22
Colonic pouch formation
McGrath et al.22
Comprehensive albeit retrospective studies unequivocally state that patients who undergo radical prostatectomy at lower-volume institutions are at significant risk of requiring adjuvant therapy due to adverse surgical factors, prolonged hospital admission, increased hospital charges and postoperative complications.8 The hospital structure of high-volume units, including easy availability of consultative, diagnostic and ancillary services, were cited as likely contributors to the association between procedure volume and short-term cystectomy outcomes.9 A minimum case load of only 11 radical cystectomies per year was cited to be associated with the lowest mortality rate.10
Less certainty exists in relation to breast cancer but a variety of end points have been examined, including number of visits required to obtain a nonoperative diagnosis, mastectomy rates for <15 mm tumours and rate of referral for adjuvant radiotherapy.11 Skinner et al. were adamant that volume alone could not be used as a surrogate for expertise but, like most studies, conceded that patients with breast cancer operated on in high-volume units compared to very low-volume units had better survival. However there is ambiguity surrounding the exact causal relationship: volume effect alone versus surgical skill versus appropriate use of adjuvant therapy.12
The majority of studies are poor quality, heterogenous and potentially flawed. Even the best literature stems from retrospective review of large databases which are up to 40% inaccurate13 and pertain to selected patient groups. Most papers are published from a few very high-volume US centres, thus introducing immediate potential for bias. No consistent end point is used and, incredibly, few studies explore cancer-specific outcomes. Mortality rates, when not corrected for comorbidities or stage at diagnosis, are poor surrogates for more robust comparators of volume–outcome analysis such as cancer-specific survival, patient satisfaction and quality of life.
American data cannot be used as a basis for the formation of European cancer strategies because so many inherent differences exist. These include earlier disease stage at time of operation (a function of screening),14 wide variance in population15 and socioeconomic status16 as well as insured versus noninsured outcomes.17 Comparison of very high-volume centres and very low-volume centres is as redundant as measuring revenue from a supermarket versus a corner store. Is it not intuitive that analysis of such extremes will yield vastly different results? Looking at the structure–process–outcome model, structure is relatively fixed (health service, institution) but process is entirely variable and volume is but one component of it. Therefore, in the absence of multivariable data, subgroup analysis is entirely inappropriate, rendering the aforementioned studies at best biased, at worst invalid.
To identify procedure volume in a single institution is easy but not so for quantifying specific operations done by a single surgeon, many of whom practise in several centres. Without asking individuals to record caseload prospectively, obtaining accurate figures may be very difficult. Surely significant bias could occur in that those willing to share details of operations may be confident of their own justification in performing such procedures. Furthermore, who counts as more experienced: a mature surgeon who has performed two colonic resections a week for 20 years but now does only two a month or a younger, specialist trained surgeon who performs three a week? How do you weight lifetime experience against current volume? Should a centralised database of surgeons’ logbooks exist, and should permission to operate be granted or denied based on this? What governing body should be afforded such a task? Should operating surgeons be ranked in their ability or would this border on defamation for the less fortunate ones? Regarding referral pattern, does volume attract quantity or do excellent clinicians attract patients? Many studies have compared the significance of surgeon experience to unit volume with varied conclusions as to which has more impact. Do excellent surgeons naturally aggregate in excellent high-volume units, thus giving a self-propagating explanation for improved outcome?
Many papers allude to the importance of the multidisciplinary approach in cancer care. Higher-volume units are far more likely to have subspecialised radiologists, radiation and medical oncologists, high dependency and intensive care units, cancer specialist nurses, dedicated psychologists and palliative care support. Anecdotally, the involvement of such services translates into better patient outcome regardless of unit volume, thus confounding results. The resounding evidence in favour of the volume–outcome relationship pertains to those cancers requiring adjuvant therapy: oesophagus, pancreas and advanced colorectal. It seems, therefore, that good surgical technique or individual surgeon experience do not exclusively guarantee positive outcomes and that much depends on availability of radiation and medical oncology.
Quality of life and patient satisfaction, apart from in colorectal and prostate cancers, are largely ignored when assessing impact of volume on clinical outcome. Is it preferential for elderly patients to travel long distances for management of a low-grade tumour or would they be better served by treatment in a lower-volume local centre where follow-up will be on their doorstep? Decisions like this are made on a daily basis in the context of primary care and so this begs the question of higher-volume specialist centres receiving selected patient cohorts, thus falsely improving outcome. This is confirmed by Morris et al. who showed that patients treated in the Australian private sector were likely to be younger, male and to have an earlier disease stage.17
The literature supports a correlation between surgical volume and improved clinical outcome in cancer care. However, a rather simplistic approach is evident in many studies and much potential remains for unbiased, prospective, statistically sound investigations with the aim of numerically stratifying appropriate volume and its impact on disease specific cancer outcomes.
While traditionally graph 1 in Fig. 1 has been used to represent the volume–outcome relationship, it seems probable that it is more accurately represented by graph 2 in Fig. 1, and can be interpreted as an area under a curve rather than a strictly linear relationship.
- 12.Skinner KA, Helsper JT, Deapen D. Breast cancer. Do specialists make a difference? Ann Surg Oncol 2003; 10(6):606–15Google Scholar
- 14.Colorectal Cancer Screening: Clinical guidelines and rationale. Winawer S. Gastroenterology 2003; 112(2):594–642Google Scholar
- 16.Krieger N, Williams D, Moss N. Genetic structure of human populations. Measuring social class in US public health research; concepts, methodologies and guidelines. Annu Rev Pub Health 1997; 18:341–78Google Scholar
- 18.The Royal College of Radiologists’ Clinical Oncology Information Network. Guidelines on the non-surgical management of breast cancer. Version 1: June 1999Google Scholar