Abstract
Background
This study aimed for a collaborative evaluation of variability in the target volumes for glioblastoma, determined and contoured by different radiotherapy (RT) facilities in Korea.
Methods
Fifteen panels of radiation oncologists from independent institutions contoured the gross target volumes (GTVs) and clinical target volumes (CTVs) for 3-dimensional conformal RT or intensity-modulated RT on each simulation CT images, after scrutinizing the enhanced T1-weighted and T2-weighted-fluid-attenuated inversion recovery MR images of 9 different cases of glioblastoma. Degrees of contouring agreement were analyzed by the kappa statistics. Using the algorithm of simultaneous truth and performance level estimation (STAPLE), GTVSTAPLE and CTVSTAPLE contours were derived.
Results
Contour agreement was moderate (mean kappa 0.58) among the GTVs and was substantial (mean kappa 0.65) among the CTVs. However, each panels’ GTVs and modification of CTVs regarding anatomical structures varied. Three-fourth of contoured panels’ CTVs encompassed the peritumoral areas of T2-high signal intensity (T2-HSI). Nine of nine GTVSTAPLE encompased the surgical cavity and the T1-enhanced lesions. Eight of nine CTVSTAPLE encompassed the peritumoral T2-HSI area. The median MARGIN90 and the median MARGIN95 were 1.4 cm and 1.5 cm, respectively.
Conclusions
Moderate to substantial agreement existed in target volumes for 3-dimensional or intensity-modulated RT determined by radiation oncologists in Korea. According to the estimated consensus contours, the initial CTV encompassed the GTV with margin less than 2.0 cm and the whole peritumoral areas of T2-HSI. The findings of our study propose the need for further studies and modified guidelines.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.Background
The prognosis of glioblastoma multiforme (GBM) has not changed for the past 10 years since the European Organization for Research and Treatment of Cancer (EORTC) and National Cancer Institute of Canada (NCIC) demonstrated a survival benefit with local radiotherapy (RT) plus concomitant and adjuvant temozolomide (TMZ) chemotherapy [1]. In the 1970s and 1980s, whole brain RT was considered optimal. However, multiple series over 20 years including the Brain Tumor Cooperative Group 80–01 randomized trial [2] have established local RT as the current standard. Local RT, with smaller irradiated normal brain volumes, produces less RT-induced neurotoxicity [3, 4]. However, defining the optimal local RT treatment volume in GBM remains controversial.
Local treatment volumes used for GBM have varied among cooperative group trials and large-scale single institution studies, especially differing in margin from the gross target volume (GTV) and inclusion of peritumoral edema. The Radiation Therapy Oncology group (RTOG) recommends that the initial clinical target volume (CTV) encompass the entire T2-high signal intensity (T2-HSI; a mixture of peritumoral edema and infiltrative tumor cells) defined on post-operative magnetic resonance imaging (MRI) plus 2 cm, followed by a boost field defined as the residual T1-enhancement and the surgical cavity plus 2.5 cm (per the RTOG 0525 [5] and RTOG 0825 [6] trials). The rationale for peritumoral edema inclusion is that histologically identified microscopic tumor cells have been found in these areas [7, 8]. In contrast, EORTC recommends that the CTV should encompass the T1-enhancement and surgical cavity plus 2–3 cm without intentional inclusion of the T2-HSI [1]. Reports that the majority of recurrences occur within 2 cm of the primary tumor [9–12] support the EORTC protocols. Furthermore, retrospective studies suggest that the use of a margin less than 2 cm around the GTV or the omission of intentional peritumoral edema inclusion does not alter the failure patterns of GBM [13–15]. Thus, no definite consensus for the RT treatment volume in GBM has been established so far.
For this reason, The Brain Tumor Committee of the Korean Radiation Oncology Group (KROG) initiated the KROG 13–18 study to evaluate current practice and variability of target volume delineation in GBM.
Methods and materials
Ethics
This study was performed with the approval of the Health Institutional Review Board of Seoul National University College of Medicine, Seoul, Korea.
Panels and contouring
Fifteen brain tumor expert radiation oncologists from 15 different institutions in Korea participated in the study. They represented the 37 brain tumor expert radiation oncologists of the brain tumor committee of KROG. Six of the 15 were from large scale institutions treating more than 25 newly diagnosed GBM patients with RT per year. Nine cases representing variable clinical scenarios of GBM were chosen for the study. Clinical information about tumor location, age/sex, extent of surgery, performance status, and pre-RT neurological symptoms was provided (Table 1). Patient history and image sets in ‘Digital Imaging and Communications in Medicine’ formats were provided to the panels. Axial pre- and post-operative MRI, including T1-gadolinium enhanced (T1-GdE) and T2-weighted-fluid-attenuated inversion recovery (T2-FLAIR) images, as well as noncontrast-enhanced axial planning computed tomography (CT) images taken in 3-mm slices composed the image sets. Panels were encouraged to contour the GTV and the initial CTV for all cases within each institution’s planning system with a prerequisite of delivering 3-dimensional conformal RT or intensity-modulated RT (IMRT), since all panels were surveyed to use one of the two modalities in GBM RT. Image fusion of pre-/post-operative MRI and planning CT images were recommended for target contouring. The final contours were returned for central analysis, and for statistical evaluation, they were transferred into the Computational Environment for Radiotherapy Research, version 4.6 (Mathworks, Natick, USA).
Panels’ contour agreement
The individual contours were all merged into a single scan. The apparent agreement and kappa-corrected agreement were used to measure consistency between panels [16].
-
1.
Apparent agreement represents the overlap contour obtained by average agreement probability of a voxel selection by the radiation oncologists. The apparent agreement probability of the i th voxel is calculated as:
$$ {p}_i=\frac{{\displaystyle {\sum}_{j=1}^m}{r}_j}{m},\ i=1,\dots,\ n $$r j = Rate by which the j th panel selects the current voxel; in this case of inter-observer analysis, it is 0 or 1.
m = Number of panels.
n = Number of voxels selected by any of the panels
-
2.
Generalized kappa statistics are an inter-observer metric that corrects for agreement that could be obtained by chance, and the kappa value is calculated as follows [17, 18]:
$$ Kappa = \frac{\left( Apparent\ Agreement - Chance\ Agreement\right)}{\left(1- Chance\ Agreement\right)} $$Chance Agreement = the expected agreement by chance alone and is based on marginal totals: \( {\displaystyle \prod_{j=1}^m}p\left({r}_j=1\right) + {\displaystyle \prod_{j=1}^m}p\left({r}_j=0\right) \)
The kappa values range between −1 and 1, with a value of −1 representing complete disagreement, 0 representing no agreement above chance, and 1 representing perfect agreement. According to Landis and Koch’s interpretation of strength of agreement, kappa <0.00 is poor, 0.00 − 0.20 is slight, 0.21 − 0.40 is fair, 0.41 − 0.60 is moderate, 0.61 − 0.80 is substantial, and 0.81 − 1.00 is near perfect agreement [19].
Estimated consensus contours; GTV/CTVSTAPLE
Consensus generation was done by maximum likelihood estimation using the simultaneous truth and performance level estimation (STAPLE) algorithm. Using the collection of manually drawn contours provided by panels, the STAPLE algorithm computes a probabilistic estimate of the ‘true contour’ that represents the desired tumor and measures the performance of each segmentation [20]. The probabilistic estimated consensus contours of GTV and CTV of each case were generated in the form of GTVSTAPLE and CTVSTAPLE, respectively, at a 95 % confidence level.
-
(1)
Margin
To assess margin the from GTVSTAPLE to CTVSTAPLE, MARGIN90 and MARGIN95 were used. MARGIN90 and MARGIN95 were the minimal margins needed to cover at least 90 % and 95 % of the CTVSTAPLE volume, respectively. The reason 100 % coverage margin was not used was to allow for the effects of variations in each physician’s policy of contouring regarding clinical scenarios, irregularity of the contour, anatomical modification of the CTVs considering bony or ventricular structures, or inclusion of peritumoral edema within the CTVs.
-
(2)
Comparison with RTOG and EORTC
For comparison of the CTVSTAPLE and the CTV based on RTOG/EORTC guidelines, CTVRTOG and CTVEORTC were manually contoured in each case by a single observer. Regarding the CTVEORTC delineation, a 2.5-cm margin was utilized. The dice similarity coefficient (DSC) index was used for comparison of CTVRTOG and CTVEORTC overlap with the CTVSTAPLE volume. DSC is calculated as follows:
$$ \frac{2\ *\ \left[\mathrm{Volume}\ \mathrm{of}\kern0.5em \left({\mathrm{CTV}}_{\mathrm{STAPLE}}\ {\displaystyle \cap}\kern0.5em {\mathrm{CTV}}_{\frac{\mathrm{RTOG}}{\mathrm{EORTC}}}\right)\right]}{\left(\mathrm{Volume}\ \mathrm{of}\kern0.5em {\mathrm{CTV}}_{\mathrm{STAPLE}} + \mathrm{Volume}\ \mathrm{of}\ {\mathrm{CTV}}_{\frac{\mathrm{RTOG}}{\mathrm{EORTC}}}\right)\ } $$A DSC of 1 represents perfect overlap and thus perfect agreement whereas the DSC is 0 if no overlap exists [16].
Results
Panels’ contour evaluation
All 15 participating panels contoured the GTV and CTV in 9 cases, resulting in a total of 135 GTVs and CTVs each. GTV and CTV delineation reached moderate agreement with mean kappa value of 0.58 and substantial agreement with mean kappa value of 0.65, respectively. The quantitative variability of the panels’ contours and the kappa values of GTV and CTV in each case are shown in Table 2. Of the 135 GTVs, 100 % included the T1-enhancement in the post-operative/biopsy MRI. If surgical resection was performed, the resection margin was included in 100 % of the contours whereas the whole surgical cavity, which indicates the space of post-operative tissue defect with fluid collection created by surgical resection plus the surgical margin, was included in only 81.1 % of the contours. Only 1 radiation oncologist strictly confined the GTV to the resection margin throughout all 9 cases whereas most of the panels included the whole surgical cavity in most cases (Fig. 1). GTV included the T2-HSI in only 34.8 % of the panels’ contours. In contrast, CTV included the whole T2-HSI in 74.8 % (Additional file 1: Table S1).
a Case 1. RO #4 only included the resection margin for GTV (green line) whereas RO #9 included both the resection margin and the resected tumor bed (red line). b Case 4. RO #2 included both the resection margin and the resected tumor bed (red line), in contrast to RO #4 (green line). Abbreviation; GTV, gross target volume; RO, radiation oncologist
Evaluation of individual radiation oncologist’s modification of CTVs after a simple margin expansion from the GTVs, regarding potential anatomical barriers such as the bony structure, falx, tentorium, and ventricular system was also performed. Constraint regarding the ventricular system means that no portion of the CTV violates into the CSF space of the lateral ventricles, which might occur if the CTV is not modified after simple margin expansion. All radiation oncologists were found to constantly constrain the CTVs in proximity of the bony structures. However, rates of constraining the CTV in regards of the falx, tentorium, ventricular system varied. The falx (80 %) and the tentorium (71 %) were more strictly concerned compared to the ventricular system (34 %). Only 1 radiation oncologist strictly concerned all 3 anatomical barriers throughout all 9 cases. In contrast, 1 radiation oncologist only concerned those 3 barriers in only 22 % of the cases. The details of results are shown elsewhere (Additional file 2: Table S2).
GTVSTAPLE and CTVSTAPLE
GTVSTAPLE included T1-enhancement in the post-operative/biopsy MRI in all cases. In 6 surgically resected cases GTVSTAPLE always encompassed not only the resection margin but also the whole surgical cavity. GTVSTAPLE and CTVSTAPLE included the whole T2-HSI in 2 and 8 cases, respectively. The median MARGIN90 and MARGIN95 were 1.4 cm (range, 1.0 − 2.5) and 1.5 cm (range, 1.2 − 2.8), respectively. T2-HSI inclusion rates and margin statuses are shown in Table 3.
In the comparison between CTVSTAPLE and the guideline-based CTVs, the mean volume of the contour was the smallest in CTVSTAPLE (329.76 cm3) followed by CTVEORTC (349.44 cm3 and CTV R TOG(458.65cm 3), although the differences were not statistically significant. The mean DSC was 0.77 (range, 0.52 − 0.85) between CTVSTAPLE and CTVRTOG, and 0.78 (range, 0.69 − 0.86) between CTVSTAPLE and CTVEORTC (Table 4). In contrast to CTVRTOG, which covers the T2-HSI plus an additional 2 cm, CTVEORTC and CTVSTAPLE missed some areas of T2-HSI in 4 and 1 of the 9 cases, respectively.
Discussion
RT with or without surgical resection is the standard of GBM treatment. Therefore, a clear definition of the GTV and CTV is necessary. Furthermore, the introduction of TMZ has significantly prolonged the survival in these patients, and reports that specific molecular subgroups survive even longer [1, 21] has made the need for minimizing unnecessary irradiation to the normal brain tissue more urgent. Definite consensus guidelines for target delineation in GBM patients that address this need do not exist.
In this study, moderate and substantial agreements among Korean radiation oncologists were observed for GTV and CTV delineation, respectively. The levels of agreement were comparable to the results of studies involving different diseases that have utilized the same methodology [22–25]. Small heterogeneity might not result in significant differences in actually irradiated volumes of the brain, but because more conformal radiation techniques are available in current practice, accurate target delineation is essential. First of all, accurate delineation of the GTV after surgical resection is important. According to our study, most of the Korean radiation oncologists tended to encompass the whole surgical cavity, which includes both the space of post-operative tissue defect with fluid collection and the resection margin, in the GTVs whereas only 1 radiation oncologist strictly confined the GTVs to the resection margin only in all cases. Fig. 1 shows the difference in 2 cases. Surrounding the brain tissue, there are several dose limiting organs such as the brain stem, spinal cord, optic apparatus, acoustic apparatus, hippocampus, etc. In case 4, in contrast to case 1, the 2 displayed GTVs differ largely in their volumes and the difference is likely to increase when the CTVs are created by a margin expansion. Eventually, at the time of actual planning, the optic apparatus are likely to limit the PTV coverage by dose of 60 Gy or 61.2 Gy at the caudal aspect. Even in case 1, although the volumes of the panels’ GTVs seem not to differ largely, the final CTV or the PTV of the GTV including the whole surgical cavity, if they are created by margin expansion and not constrained to the brain tissue, is likely to end up with a higher dose to the patient’s scalp, resulting in either temporary or permanent hair loss. Constraining the CTV strictly in proximity of the potential anatomical barriers, such as the falx, tentorium, and the ventricular space, is in a similar vein with accurate GTV contouring. Since the space of post-operative tissue defect with fluid collection do not harbor GBM tumor cells, future guidelines should propose a more detailed definition of GTV in GBM. Furthermore, a strict quality assurance for CTV modification regarding the anatomical barriers is necessary, especially in a clinical trial setting.
Numerous data support proximity to the gross tumor as the most important factor in predicting GBM recurrence [9–12]. However, there are caveats to applying these results of older studies to the modern era. Several modern MRI-based studies [15] based on this principle utilized margins less than 2 cm, such as 0.5 cm, 1.0 cm, or 1.5 cm. These studies showed that the centrally failing pattern of GBM does not change even with reduced margins. In our study, the median MARGIN90 and MARGIN95 were 1.4 cm and 1.5 cm, respectively, which are less than 2 cm or 2.5 cm, as utilized by the RTOG or EORTC. These findings appear to reflect the disregarding of older RTOG/EORTC guidelines by Korean radiation oncologists. The MARGIN90 and MARGIN95 were 2.5 cm or more only in the case of multicentric GBM (case 3). Multiplicity at initial presentation reflects a tumor of a more infiltrative and aggressive nature compared to tumors presenting as solitary lesions. Demand for highly aggressive therapy with larger RT treatment volumes rather than relying on a single unified guideline may be warranted for these patients. In cases where GTVSTAPLE was defined as the T2-HSI (cases 6 and 8) as in the RTOG trials, margins less than 1.5 cm were utilized, reflecting the use of smaller margins than the RTOG guideline in contemporary practice even when T2-HSI is considered the gross tumor. Reduction of treatment volumes based on the evidence of failure patterns would yield smaller RT fields and thus result in lesser neurologic morbidity in longer-surviving patients. However, modern studies [13–15] have not demonstrated the non-inferiority in local control rates. Therefore, to justify the reduced margin below 2 cm, further studies demonstrating equivalent local control with conventional margins are necessary.
Another issue of controversy is whether it is necessary to intentionally include peritumoral edema, which is often simplified as T2-HSI on MRI, within the target volume. Burger et al. [7] reported that the hypodense areas surrounding the enhancing lesion on CT images contained infiltrative tumor cells and infiltration of tumor cells may extend even beyond the hypodense areas. Halperin et al. [8] also reported that adding 3 cm to the hypodense area is optimal for covering all infiltrative tumor cells. The RTOG protocols mirror these findings. However, modern series utilizing MRI [13–15] indicate that the omission of intentional inclusion of peritumoral edema with reduced margins does not change the failure pattern in GBM. In our study, most panels’ GTVs and GTVSTAPLES did not encompass the whole T2-HSI, suggesting that they tend to overlook the RTOG recommendations. The two cases (cases 6 and 8) in which the GTVSTAPLE encompassed the whole T2-HSI, images showed mass-like T2-HSI lesions indicating tumor mass rather than edema, whereas areas of enhancement were not definite (Fig. 2). As some portion of GBM patients, up to 10–15 %, present with non-enhancing tumors on MRI, future guidelines should individualize the recommendation based on the initial image findings of the tumor rather than unifying the definition of GTV as the T1-enhancement or T2-HSI. In contrast to the GTV, most of the panels’ CTVs and CTVSTAPLES included the whole T2-HSI, indicating that most Korean radiation oncologists do not ignore the possibility of malignant tumor cell existence in the T2-HSI. On the other hand, additional margins around the T2-HSI were not commonly observed in CTVSTAPLES. Eradicating every malignant tumor cells is impossible, but at the same time, totally neglecting the T2-HSI risks the possibility of marginal recurrence. It would be difficult for the radiation oncologist to ignore an obviously discemible T2-HSI. Moreover, the volumes of CTVSTAPLE s encompassing the whole T2-HSI actually did not differ significantly with those of CTVEORTCS. One case (case 5) in which the CTVSTAPLE missed areas of T2-HSI was a poorly performing patient who underwent stereotactic biopsy without tumor resection. The extensive infiltrative T2-hyperintense and contrast-enhanced lesion involved bilateral frontal lobes, both anterior horns of lateral ventricles, the corpus callosum and bilateral basal ganglias combined with leptomeningeal seeding at the pontomedullary junction (Additional file 3: Figure S1). The volume of CTVRTOG was almost 3 times higher than that of CTVSTAPLE. The low T2-HSI inclusion rate of 26.7 % in the panels’ CTVs for this case was probably a result of the poor expected overall survival/disease control [26] and the high probability of radiation-related morbidity [3, 4] in case of whole T2-HSI inclusion. Panels may have been reluctant to administer aggressive radical RT in such a case. As for target volumes for other tumors, target volumes of GBM may be modified based on individual clinical settings. In summary, a majority of Korean radiation oncologists include the T2-HSI in the CTV whereas T2-HSI is not routinely included in the GTV unless the T2-HSI lesion forms a mass like appearance with no definitely enhancing lesion.
Several limitations exist in our study. One is that the dose prescription scheme was not acquired. The RTOG recommends 46 Gy in 23 fractions for the initial CTV followed by a boost of 14 Gy in 7 fractions [5, 6], whereas the EORTC recommends 60 Gy in 30 fractions for a single field [1]. Individual institutions may adopt more variable dose fractionation schemes in non-trial based practices [19–21]. Whether the dose is prescribed to the GTV, CTV, or the planning target volume with extra safety-margins may also vary between panels. Lack of information of the RT technique may also weaken our study as the use of IMRT for brain tumors is increasing. The increasing use and importance of functional MRI techniques like spectroscopy and diffuser tensor imaging, or 11C-methionine positron emission tomography [27, 28] were also not reflected in the current study. Nevertheless, the key strengths of this study are that the evaluated number of GTVs and CTVs, all contoured by brain tumor expert radiation oncologists, is relatively high [22–25], and that ours is the first report evaluating inter-observer variability in GBM target delineation.
Conclusions
Although moderate and substantial agreement were observed between Korean radiation oncologists for GTV and CTV delineation, respectively, several variations were present in delineating the GTV and constraining the CTV in regards of anatomical barriers. Therefore, more detailed guidelines for consistency of target volumes between radiation oncologists are warranted. We found that most of the practicing radiation oncologists tend to define the initial CTV by adding a < 2-cm margin around the GTV and further encompass the remnant T2-HSI uncovered by the margin (Fig. 3), based on modern evidence of failure patterns. In conclusion, these findings of Korean pattern of target volume delineation for GBM propose the need for further studies and modified guidelines of target volume delineation for future clinical trials. Further studies for consensus formation evaluating disease control are ahead from the brain tumor committee of the KROG.
References
Stupp R, Mason WP, van den Bent MJ, Weller M, Fisher B, Taphoorn MJ, et al. Radiotherapy plus concomitant and adjuvant temozolomide for glioblastoma. N Engl J Med. 2005;352:987–96.
Shapiro WR, Green SB, Burger PC, Mahaley Jr MS, Selker RG, VanGilder JC, et al. Randomized trial of three chemotherapy regimens and two radiotherapy regimens in postoperative treatment of malignant glioma. Brain Tumor Cooperative Group Trial 8001. J Neurosurg. 1989;71:1–9.
Marks JE, Baglan RJ, Prassad SC, Blank WF. Cerebral radionecrosis: incidence and risk in relation to dose, time, fractionation and volume. Int J Radiat Oncol Biol Phys. 1981;7:243–52.
Constine LS, Konski A, Ekholm S, McDonald S, Rubin P. Adverse effects of brain irradiation correlated with MR and CT imaging. Int J Radiat Oncol Biol Phys. 1988;15:319–30.
Gilbert MR, Wang M, Aldape KD, Stupp R, Hegi ME, Jaeckle KA, et al. Dose-dense temozolomide for newly diagnosed glioblastoma: a randomized phase III clinical trial. J Clin Oncol. 2013;31:4085–91.
Gilbert MR, Dignam JJ, Armstrong TS, Wefel JS, Blumenthal DT, Vogelbaum MA, et al. A randomized trial of bevacizumab for newly diagnosed glioblastoma. N Engl J Med. 2014;370:699–708.
Burger PC, Dubois PJ, Schold Jr SC, Smith Jr KR, Odom GL, Crafts DC, et al. Computerized tomographic and pathologic studies of the untreated, quiescent, and recurrent glioblastoma multiforme. J Neurosurg. 1983;58:159–69.
Halperin EC, Bentel G, Heinz ER, Burger PC. Radiation therapy treatment planning in supratentorial glioblastoma multiforme: an analysis based on postmortem topographic anatomy with CT correlations. Int J Radiat Oncol Biol Phys. 1989;17:1347–50.
Hochberg FH, Pruitt A. Assumptions in the radiotherapy of glioblastoma. Neurology. 1980;30:907–11.
Wallner KE, Galicich JH, Krol G, Arbit E, Malkin MG. Patterns of failure following treatment for glioblastoma multiforme and anaplastic astrocytoma. Int J Radiat Oncol Biol Phys. 1989;16:1405–9.
Liang BC, Thornton Jr AF, Sandler HM, Greenberg HS. Malignant astrocytomas: focal tumor recurrence after focal external beam radiation therapy. J Neurosurg. 1991;75:559–63.
Lee SW, Fraass BA, Marsh LH, Herbort K, Gebarski SS, Martel MK, et al. Patterns of failure following high-dose 3-D conformal radiotherapy for high-grade astrocytomas: a quantitative dosimetric study. Int J Radiat Oncol Biol Phys. 1999;43:79–88.
Chang EL, Akyurek S, Avalos T, Rebueno N, Spicer C, Garcia J, et al. Evaluation of peritumoral edema in the delineation of radiotherapy clinical target volumes for glioblastoma. Int J Radiat Oncol Biol Phys. 2007;68:144–50.
Minniti G, Amelio D, Amichetti M, Salvati M, Muni R, Bozzao A, et al. Patterns of failure and comparison of different target volume delineations in patients with glioblastoma treated with conformal radiotherapy plus concomitant and adjuvant temozolomide. Radiother Oncol. 2010;97:377–81.
McDonald MW, Shu HK, Curran Jr WJ, Crocker IR. Pattern of failure after limited margin radiotherapy and temozolomide for glioblastoma. Int J Radiat Oncol Biol Phys. 2011;79:130–6.
Allozi R, Li XA, White J, Apte A, Tai A, Michalski JM, et al. Tools for consensus analysis of experts’ contours for radiotherapy structure definitions. Radiother Oncol. 2010;97:572–8.
Fleiss JL, Levin BA, Paik MC. Statistical Methods for Rates and Proportions, Wiley Series in Probability and Statistics. 3rd ed. Hoboken, NJ: John Wiley & Sons; 2003.
Crewson PE, Applegate KE. Data collection in radiology research. Am J Roentgenol. 2001;177:755–61.
Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.
Warfield SK, Zou KH, Wells WM. Simultaneous truth and performance level estimation (STAPLE): an algorithm for the validation of image segmentation. IEEE Trans Med Imaging. 2004;23:903–21.
Hegi ME, Diserens AC, Gorlia T, Hamou MF, de Tribolet N, Weller M, et al. MGMT gene silencing and benefit from temozolomide in glioblastoma. N Engl J Med. 2005;352:997–1003.
Michalski JM, Lawton C, El Naqa I, Ritter M, O’Meara E, Seider MJ, et al. Development of RTOG consensus guidelines for the definition of the clinical target volume for postoperative conformal radiation therapy for prostate cancer. Int J Radiat Oncol Biol Phys. 2010;76:361–8.
Cox BW, Spratt DE, Lovelock M, Bilsky MH, Lis E, Ryu S, et al. International spine radiosurgery consortium consensus guidelines for target volume definition in spinal stereotactic radiosurgery. Int J Radiat Oncol Biol Phys. 2011;83:e597–605.
Bahig H, Roberge D, Bosch W, Levin W, Petersen I, Haddock M, et al. Agreement among RTOG sarcoma radiation oncologists in contouring suspicious peritumoral edema for preoperative radiation therapy of soft tissue sarcoma of the extremity. Int J Radiat Oncol Biol Phys. 2013;86:298–303.
Hong TS, Bosch WR, Krishnan S, Kim TK, Mamon HJ, Shyn P, et al. Interobserver variability in target delineation for hepatocellular carcinoma with and without portal vein thrombosis: Radiation Therapy Oncology Group consensus guidelines. Int J Radiat Oncol Biol Phys. 2014;89:804–13.
Lim DA, Cha S, Mayo MC, Chen MH, Keles E, VandenBerg S, et al. Relationship of glioblastoma multiforme to neural stem cell regions predicts invasive and multifocal tumor phenotype. Neuro Oncol. 2007;9:424–9.
Pirzkall A, McGue C, Saraswathy S, Cha S, Liu R, Vandenberg S, et al. Tumor regrowth between surgery and initiation of adjuvant therapy in patients with newly diagnosed glioblastoma. Neuro Oncol. 2009;11:842–52.
Lee IH, Piert M, Gomez-Hassan D, Junck L, Rogers L, Hayman J, et al. Association of 11C-methionine PET uptake with site of failure after concurrent temozolomide and radiation for primary glioblastoma multiforme. Int J Radiat Oncol Biol Phys. 2009;73:479–85.
Acknowledgments
This work is a collaborative effort from The Brain Tumor Committee of the Korean Radiation Oncology Group. This work was supported by the National R&D Program for Cancer Control by National Cancer Center Korea (grant No. 1320220 to Il Han Kim) and the National Research Foundation of Korea (NRF) grant funded by the Korean government (MSIP) (No. 2013M2A2A7043683 to Il Han Kim).
Author information
Authors and Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
CWW, IHK, HCK, and SMY conceived the study, and participated in its design and coordination. All authors participated in the acquisition/analysis of the data. CWW drafted the manuscript. CWW and IHK critically reviewed/revised the manuscript. All authors read and approved the final manuscript.
Additional files
Additional file 1: Table S1.
Individual factors included in the GTV and CTV of each case.
Additional file 2: Table S2.
Modification of CTVs in regards of potential anatomical barriers.
Additional file 3: Figure S1.
Case 5. a Post-biopsy gadolinium enhanced T1-weighted (T1-GdE) images. b GTVSTAPLE (red line) and CTVSTAPLE (yellow line) on T2-FLAIR images (areas of T2-high signal intensity uncovered by the CTVSTAPLE shown in blue lines).
Rights and permissions
This article is published under an open access license. Please check the 'Copyright Information' section either on this page or in the PDF for details of this license and what re-use is permitted. If your intended use exceeds what is permitted by the license or if you are unable to locate the licence and re-use information, please contact the Rights and Permissions team.
About this article
Cite this article
Wee, C.W., Sung, W., Kang, HC. et al. Evaluation of variability in target volume delineation for newly diagnosed glioblastoma: a multi-institutional study from the Korean Radiation Oncology Group. Radiat Oncol 10, 137 (2016). https://doi.org/10.1186/s13014-015-0439-z
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s13014-015-0439-z