In oncology, RCTs are often beset by slow recruitment, limited generalizability, and strong preferences for interventions by patients and physicians. The cohort multiple randomized controlled trial (cmRCT) is an innovative design with the potential to overcome those challenges. In cmRCT, a prospective cohort serves as an infrastructure for multiple RCTs. We implemented cmRCT in a clinical breast cancer setting by creating UMBRELLA—a large prospective cohort of breast cancer and DCIS patients/survivors.
For all participants, clinical data and patient-reported outcomes (PROs, i.e., quality of life, fatigue, anxiety and depression, physical activity, work ability, and cosmetic satisfaction) are being collected at regular time-intervals for a period of 10 years. These data are being used both for observational and randomized studies. For each intervention to be tested against standard care, a subcohort of eligible patients is identified within UMBRELLA. From this subcohort, a random sample of patients is offered the intervention. Their outcomes are compared to the outcomes of patients receiving standard care.
So far, between October 2013 and July 2016, we have recruited 1308 participants. In this period, 1308/1486 (88%) patients who were invited for participation in UMBRELLA consented to cohort participation. Of these patients, 1138 (87%) gave broad consent for randomization to future interventions. Return rate for PROs at baseline were 80%, and varied from 67 to 74% during follow-up. Several observational studies—and the first randomized intervention study—are currently ongoing.
Results from UMBRELLA show that this novel study design is feasible and acceptable to patients in a clinical breast cancer setting. We invite researchers who are interested in conducting randomized or observational studies within the UMBRELLA cohort to contact the UMBRELLA scientific advisory board.
With a lifetime risk of one in seven, breast cancer is an important public health concern among women in the Western world [1, 2]. Due to earlier detection and better treatment, breast cancer survival has improved substantially [1–3]. However, current treatment is associated with substantial morbidity, including lymphedema, breast deformities, (chronic) pain, and fatigue. Therefore, new breast cancer treatments should not only focus on further improving (progression-free) survival, but should also aim for good quality of life (QoL), functional outcomes, and satisfying cosmetic results .
Interventions aiming to achieve these purposes include minimally invasive treatment of the primary tumor (e.g., axillary irradiation instead of surgery, radiofrequency ablation), as well as lifestyle interventions (e.g., dietary interventions, exercise programs, supportive health apps) [5–7]. Before implementation in routine care, these interventions would ideally be evaluated in randomized controlled trials (RCTs) to confirm whether theoretical benefits translate into actual benefits for patients.
RCTs are the gold standard in comparative research, but often face many challenges. RCTs often are beset by slow recruitment, leading to 40% of cancer trials ending prematurely , which is unethical with regards to patients unnecessarily being exposed to potentially harmful or inferior interventions, as well as a waste of time and resources. In the field of breast cancer, the large amount of new interventions entering the market makes it virtually impossible to adequately evaluate each intervention in a separate RCT. It is also complicated to directly compare different interventions tested in separate trials, due to differences in inclusion criteria, outcome measures, and follow-up schemes . RCTs often suffer from limited generalizability due to strict inclusion criteria and selective participation . When highly desired interventions are being evaluated, patients are often disappointed when allocated to the control arm, which may result in drop-out, cross-over, and/or disappointment bias . And lastly, for physicians, the informed consent procedure is cumbersome, as they have to explain (at least) two treatment options that they cannot both with certainty offer to their patients.
In order to deal with these challenges, the cohort multiple randomized controlled trial (cmRCT) design was proposed . In this design, a prospective cohort serves as an infrastructure for multiple RCTs. Advantages of the cmRCT design have been described previously, and include efficient use of control patients, improved comparison between different trialed interventions, enhanced generalizability, and reduced disappointment bias [12, 13].
Clinical and methodological experts in the field of breast cancer combined their knowledge to create a cohort of breast cancer patients according to the cmRCT design—‘Utrecht cohort for Multiple BREast cancer intervention studies and Long-term evaLuAtion’ (UMBRELLA). With UMBRELLA, we aim to
Generate short- and long-term data on clinical and patient-reported outcomes during and after breast cancer treatment.
Provide an infrastructure for multiple randomized evaluations of interventions for breast cancer patients and survivors.
In this paper, we describe UMBRELLA’s study design and clinical experiences after 30 months of active recruitment. This paper will serve as the basis for all future observational studies and RCTs using the UMBRELLA cohort.
Materials and methods
Patients are recruited at the University Medical Center Utrecht (UMC Utrecht), the Netherlands. All patients with invasive breast cancer and ductal carcinoma in situ (DCIS), who are referred to the department of Radiation Oncology, are eligible for participation in UMBRELLA. Patients with limited understanding of the Dutch language and patients under the age of 18 years are ineligible. Since the UMC Utrecht is the regional center for radiation treatment, UMBRELLA includes patients from secondary and tertiary hospitals. Each year, approximately 575 eligible patients visit the UMC Utrecht for adjuvant radiation treatment of the breast (and axilla).
Before their first visit to the department of radiation oncology, all patients with breast cancer or DCIS receive detailed written information about UMBRELLA. They are scheduled to visit a researcher/research assistant 30 minutes prior to their first appointment with the radiation oncologist. During this research consultation, the researcher/research assistant explains the study in detail, and written informed consent is obtained from those who agree to participate.
The study protocol for UMBRELLA was approved by the Institutional Review and Ethics Board of the University Medical Center Utrecht, the Netherlands.
UMBRELLA serves as a facility for multiple trials and follows the cmRCT design. In this context, informed consent is obtained through a staged procedure . Before entering the cohort, all patients give written informed consent for collection and use of clinical data. Patient-reported outcomes (PROs) are collected at baseline and at fixed intervals during follow-up.
In addition, patients may give broad consent to be randomly allocated to experimental interventions in the (near) future. Only those randomly allocated to the intervention arm are offered the experimental intervention (which they can accept or refuse). If they accept, additional written informed consent to undergo the experimental intervention will be obtained. Patients who refuse the intervention receive standard care. Patients who are randomly allocated to the control arm also receive standard care, and are not informed about being in the control arm.
Data from all patients may be used for observational studies in UMBRELLA, but only those who provide broad consent for randomization are eligible for participation in RCTs within UMBRELLA. After completion of an RCT within UMBRELLA, all patients—irrespective of participation in the specific study—receive aggregated results.
Within UMBRELLA, various clinical data are prospectively collected including demographics, tumor characteristics, treatment and toxicity, and imaging data (e.g., mammography, radiotherapy planning computed tomography (CT) scans). Clinical data are captured from electronic medical records, referral letters, and annual reports from the national cancer registry .
Sociodemographic data include gender, date of birth, age at diagnosis, highest level of education, postal code (to estimate socioeconomic status), body mass index (BMI) and WHO performance status.
Disease characteristics include method of detection (symptomatic, screening), date of diagnosis, laterality, localization within the breast, classification according to Breast Imaging-Reporting and Data System (BI-RADS) [15, 16], tumor size, nodal status, clinical and pathological stages (classified as American Joint Committee on Cancer c/pTNM classification), multifocality and multicentricity, histologic type, invasiveness, Bloom-Richardson grade, hormone receptor status, and HER-2 status.
Treatment characteristics comprise type of surgery of primary tumor (breast-conserving surgery or mastectomy) and regional lymph nodes (sentinel node biopsy, axillary lymph node dissection, and/or regional radiotherapy), type and timing of reconstructive surgery, surgical margin status (radical, focally irradical, irradical), (neo)adjuvant systemic therapy, radiotherapy parameters (e.g., irradiated volumes, prescribed dose), (surgical) complications, re-admission, and center of surgical treatment.
Toxicity is captured according to the National Cancer Institute’s (NCI) Common Toxicity Criteria for Adverse Events (CTCAE).
Information on recurrence and survival is collected annually by means of (self-reported) questionnaires, the national pathology database (PALGA) and the Central Bureau of Statistics (CBS).
The principal investigators and delegates are responsible for daily cohort management. Data quality is checked periodically. All data are stored and handled according to Dutch privacy law regulations.
We collect PROs by means of validated questionnaires designed to quantify health-related QoL from the patient’s perspective. These questionnaires are sent to patients upon entry into the cohort (baseline), at 3 and 6 months and every 6 months thereafter with a total follow-up of at least 10 years. It takes approximately 20 min to fill out the set of questionnaires at each time point.
Patient-reported information is collected on QoL, fatigue, anxiety and depression, physical activity, work ability, and cosmetic satisfaction through the following questionnaires:
Quality of Life: European Organization for Research and Treatment of Cancer (EORTC) QLQ-C30, including breast cancer specific module BR23 
Fatigue: Multidimensional Fatigue Inventory-20 
Anxiety and Depression: Hospital Anxiety and Depression Scale (HADS) 
Physical activity: QUestionnaire to ASses Health enhancing physical activity (SQUASH) 
Work ability: Work Ability Index (WAI) 
Cosmetic outcome: Cosmetic Evaluation .
So far, between October 2013 and July 2016, we have recruited 1308 participants. In this period, 1308 out of 1486 (88%) patients who were invited for participation in UMBRELLA consented to cohort participation (Table 1). Of those, 1138 (87%) gave broad consent for randomization to future interventions.
The mean age of cohort participants was 59 years (27–95), 86% were treated with breast-conserving surgery (BCS) and 14% underwent mastectomy. Those who did not provide broad consent for random allocation were slightly older (60 vs. 57 years). Moreover, other differences between patients who provided broad consent for random allocation and those who did not were also marginal (Table 2).
Return rates for questionnaires at baseline were 80%, and varied from 67 to 74% during follow-up (Table 1). Sixty percent of patients chose to fill out PROs online, while 40% opted for paper questionnaires.
Descriptive baseline results already provide some insight into patients’ perspectives during and after treatment. Baseline scores for health-related QoL domains are shown in Table 2. Compared to patients who returned the baseline questionnaires, nonresponders were slightly younger (54 vs. 58 years), and a higher proportion of nonresponders were treated with mastectomy (23 vs. 15%) and loco-regional radiotherapy (19 vs. 13%).
Within the cohort, several longitudinal observational studies are investigating PROs in relation to patient, tumor, and treatment characteristics. Studies in progress include, for example, a study on lymphedema of the breast after breast-conserving treatment (incidence, determinants, and the effect of edema on health-related QoL). In another study the association between cardiovascular events and presence of coronary artery calcium on radiotherapy planning CT scans was investigated . This study showed that one in four breast cancer patients planned for radiotherapy have coronary artery calcium, which is known to be a strong risk factor for cardiovascular disease. Within UMBRELLA, Knuttel et al. assessed preferences of breast cancer patients and healthy women regarding new non- and minimally invasive breast cancer treatment options, compared to conventional surgical treatments. These results may be helpful to guide the development of innovative breast cancer therapies and randomized studies to evaluate these novel techniques .
Also, the first randomized comparison within UMBRELLA is currently ongoing (FIT trial). The FIT trial evaluates the effect of an exercise program on QoL in breast cancer survivors with low levels of physical activity 12–18 months after diagnosis .
Strengths of UMBRELLA
The major strengths of UMBRELLA are that we systematically invite all eligible patients to participate in UMBRELLA, the high participation rate, the longitudinal capturing of PROs, and the ability to foster multiple trials within a longitudinal cohort. By systematically inviting all eligible patients, and by keeping the physician out of the informed consent procedure, selection is minimized. Due to the high participation rate, UMBRELLA provides a representative study sample.
In UMBRELLA, a wide range of PROs are systematically collected. PROs are becoming increasingly important endpoints to better understand patients’ symptoms, experiences, health-related QoL, and side effects of treatment . Such outcomes will be important when determining which new treatments will be implemented in routine care and will provide valuable input for the process of shared decision-making.
UMBRELLA follows the cmRCT design, which is associated with several advantages. It has the unique ability to facilitate multiple randomized evaluations of (experimental) interventions. Patients may participate in several cmRCTs simultaneously (which may sometimes require stratified randomization if interactions between interventions is to be expected). Direct comparison between interventions is possible, because all trials are conducted within the same study population, making use of the same follow-up scheme and available outcomes . Patients who are not selected for an intervention (the controls) are not informed about interventions under study, which reduces the risk of disappointment bias and contamination compared to classic RCTs. Furthermore, physicians and researchers only explain an intervention that they can actually offer to the patient. This reduces the workload of physicians participating in trials, as they only have to explain experimental interventions to patients in the intervention arm.
By adopting a staged-informed consent procedure, we separated consent for cohort participation from consent for accepting interventions after being randomly selected. Instead of receiving a large amount of study information at once, UMBRELLA participants only receive the essential information they need, at the time they need it to make a well-informed decision. This resembles the way information is shared in routine care, thus potentially increasing generalizability to a clinical setting and potentially increasing patients’ ability to process and understand the informed consent procedure.
Limitations of UMBRELLA
One of the limitations of UMBRELLA is that we only include patients referred for radiotherapy. As a result, around 60% of all invasive breast cancer and DCIS patients are eligible . We have recently obtained ethical approval to expand our cohort to patients without an indication for radiotherapy.
Clinical data collected in this cohort are generated in routine care, and are therefore rather pragmatic. Endpoints for trials within UMBRELLA need to be part of the predefined outcomes being measured for all patients. However, it is possible to collect additional data for specific studies if required.
Since cmRCT is a rather new design, several aspects still need further exploration. For instance, an in-depth evaluation of statistical approaches when running multiple trials with potential for interaction between treatments has not yet been performed.
Finally, the questionnaire return rates slowly decrease over time. This is a problem that many other prospective cohort studies encounter. In our cohort we are actively informing patients about results of studies conducted with cohort data in the hopes of keeping participants actively involved and motivated to return the questionnaires.
National Institutes of Health Consensus Development Conference Statement (1990) Development Program. http://consensus.nih.gov/1990/1990earlystagebreastcancer081html.htm
Netherlands Comprehensive Cancer Organization (IKNL) (2016) https://www.iknl.nl/over-iknl/about-iknl or www.cijfersoverkanker.nl
EBCTCG (2014) Effect of radiotherapy after mastectomy and axillary surgery on 10-year recurrence and 20-year breast cancer mortality: meta-analysis of individual patient data for 8135 women in 22 randomized trials. Lancet. doi:10.1016/S0140-6736(14)60488-8
Fallowfield L, Jenkins V (2015) Psychosocial/survivorship issues in breast cancer: are we doing better? JNCI J Natl Cancer Inst. doi:10.1093/jnci/dju335
Knuttel FM, Waaijer L, Merckel LG et al (2016) Histopathology of breast cancer after magnetic resonance-guided high-intensity focused ultrasound and radiofrequency ablation. Histopathology. doi:10.1111/his.12926
Jones LW, Habel LA, Weltzien E et al (2016) Exercise and risk of cardiovascular events in women with nonmetastatic breast cancer. J Clin Oncol. doi:10.1200/JCO.2015.65.6603
Burki TK (2013) Cancer apps. Lancet Oncol. doi:10.1016/S1470-2045(13)70259-6
Young RC (2010) Cancer clinical trials—A chronic but curable crisis. N Engl J Med. doi:10.1056/NEJMp1005843
Song F, Altman DG, Glenny AM, Deeks JJ (2003) Validity of indirect comparison for estimating efficacy of competing interventions: empirical evidence from published meta-analyses. BMJ 326(7387):472
Kennedy-Martin T, Curtis S, Faries D, Robinson S, Johnston J (2015) A literature review on the representativeness of randomized controlled trial samples and implications for the external validity of trial results. Trials. doi:10.1186/s13063-015-1023-4
Sedgwick P (2015) Controlled trials: allocation concealment, random allocation, and blinding. BMJ. doi:10.1136/bmj.h2633
Relton C et al (2010) Rethinking pragmatic randomized controlled trials: introducing the “cohort multiple randomized controlled trial” design. BMJ 340:c1066
Van der Velden JM, Verkooijen HM, Young-Afat DA, et al (2016) The cohort multiple randomized controlled trial design: a valid and efficient alternative to pragmatic trials? Int J Epidemiol: dyw050
Young-Afat DA, Verkooijen HM, van Gils CH et al (2016) Staged-informed consent in the cohort multiple randomized controlled trial design. Epidemiology. doi:10.1097/EDE.0000000000000435
American College of Radiology (ACR) (2003) Breast imaging reporting and data system atlas (BI-RADS atlas). American College of Radiology, Reston, VA
D’Orsi CJ, Sickles EA, Mendelson EB et al (2013) Breast imaging reporting and data system: ACR BI-RADS atlas. American College of Radiology, Reston, VA
Aaronson NK, Ahmedzai S, Bergman B et al (1993) The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology. J Natl Cancer Inst 85:365–376
Smets EM, Garssen B, Cull A, de Haes JC (1996) Application of the multidimensional fatigue inventory (MFI-20) in cancer patients receiving radiotherapy. Br J Cancer 73(2):241–245
Zigmond AS, Snaith RP (1983) The hospital anxiety and depression scale. Acta Psychiatr Scand 67:361–370. doi:10.1111/j.1600-0447.1983.tb09716.x
Wendel-Vos GC, Schuit AJ, Saris WH et al (2003) Reproducibility and relative validity of the short questionnaire to assess health-enhancing physical activity. J Clin Epidemiol 56:1163–1169
Ilmarinen J (2007) The work ability index (WAI). Occup Med 57(2):160. doi:10.1093/occmed/kqm008
Sneeuw KC, Aaronson NK, Yarnold JR et al (1992) Cosmetic and functional outcomes of breast conserving treatment for early stage breast cancer. 1. Comparison of patients’ ratings, observers’ ratings, and objective assessments. Radiother Oncol 25(3):153–159
Gernaat SA, Išgum I, de Vos BD et al (2016) Automatic coronary artery calcium scoring on radiotherapy planning CT scans of breast cancer patients: reproducibility and association with traditional cardiovascular risk factors. PLoS ONE 11(12):e0167925. doi:10.1371/journal.pone.0167925
Knuttel FM, van den Bosch MA, Young-Afat DA et al (2017) Patient preferences for minimally invasive and conventional locoregional treatment for early-stage breast cancer; a utility assessment. Value Health 20(3):474–480. doi:10.1016/j.jval.2016.10.013
UMBRELLA-FIT trial registration. http://www.trialregister.nl/trialreg/admin/rctview.asp?TC=5482
This work is supported by an intramural Grant from the Department of Radiation Oncology and the Julius Center for Health Sciences and Primary Care of the University Medical Center Utrecht, the Netherlands. The authors would like to thank our trial office, data managers, participating centers, and all those involved in UMBRELLA.
International collaborations are essential to improve the breast oncology field. We invite researchers who are interested in conducting randomized or observational studies within the UMBRELLA cohort to contact the UMBRELLA scientific advisory board, led by Dr. H.M. Verkooijen (email@example.com).
Collaborators (as part of the UMBRELLA study group)
Gernaat SA, Gregorowitsch ML, May AM, Peeters PH, van der Pol CC, Witkamp AJ, Pijnappel RM, Bijlsma RM, Maarse W, Ausems MG, van Diest PJ, van der Wall E, van Dalen T, Burgmans IP, de Roos MA, van Doorn RC, Baas IO, van Ooijen B, Koelemij R.
Conflict of interest
The authors declare that they have no competing interests.
Collaborators of the UMBRELLA Study Group are listed in “Acknowledgment”.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Young-Afat, D.A., van Gils, C.H., van den Bongard, H.J.G.D. et al. The Utrecht cohort for Multiple BREast cancer intervention studies and Long-term evaLuAtion (UMBRELLA): objectives, design, and baseline results. Breast Cancer Res Treat 164, 445–450 (2017). https://doi.org/10.1007/s10549-017-4242-4
- Breast cancer
- Prospective cohort
- Patient-reported outcomes