Effect of imaging and catheter characteristics on clinical outcome for patients in the PRECISE study
- First Online:
- Cite this article as:
- Mueller, S., Polley, MY., Lee, B. et al. J Neurooncol (2011) 101: 267. doi:10.1007/s11060-010-0255-0
The PRECISE study used convection enhanced delivery (CED) to infuse IL13-PE38QQR in patients with recurrent glioblastoma multiforme (GBM) and compared survival to Gliadel Wafers (GW). The objectives of this retrospective evaluation were to assess: (1) catheter positioning in relation to imaging features and (2) to examine the potential impact of catheter positioning, overall catheter placement and imaging features on long term clinical outcome in the PRECISE study. Catheter positioning and overall catheter placement were scored and used as a surrogate of adequate placement. Imaging studies obtained on day 43 and day 71 after resection were each retrospectively reviewed. Catheter positioning scores, catheter overall placement scores, local tumor control and imaging change scores were reviewed and correlated using Generalized Linear Mixed Models. Cox PH regression analysis was used to examine whether these imaging based variables predicted overall survival (OS) and progression free survival (PFS) after adjusting for age and KPS. Of 180 patients in the CED group, 20 patients did not undergo gross total resection. Of the remaining 160 patients only 53% of patients had fully conforming catheters in respect to overall placement and 51% had adequate catheter positioning scores. Better catheter positioning scores were not correlated with local tumor control (P = 0.61) or imaging change score (P = 0.86). OS and PFS were not correlated with catheter positioning score (OS: P = 0.53; PFS: P = 0.72 respectively), overall placement score (OS: P = 0.55; PFS: P = 0.35) or imaging changes on day 43 MRI (P = 0.88). Catheter positioning scores and overall catheter placement scores were not associated with clinical outcome in this large prospective trial.
KeywordsConvection enhanced deliveryPRECISE studyImagingCatheter scoresRecurrent glioblastoma
Recurrent glioblastoma multiforme (GBM) has a dismal prognosis with a median survival of 6 months despite multi-modality treatment strategies. The introduction of temozolamide led to prolonged survival of newly diagnosed patients with GBM after radiation and surgical resection to 15 months  but therapeutic options for recurrent GBM are limited. Gliadel wafers (GW) are currently the only Food and Drug Administration (FDA) approved local treatment for recurrent GBM. The restrictive blood brain barrier (BBB) remains a tremendous challenge for the development of systemically delivered therapeutics. Ongoing studies are currently investigating the role of regional delivery systems for these patients including convection enhanced delivery (CED) combined with targeted therapy such as cintredekin-besudotox (CB) and TP-38, a recombinant protein targeting the epidermal growth factor receptor [2, 3]. CB, also referred to as IL13-PE38QQR, has been tested in prior phase I studies using CED as delivery methodology. CB, a recombinant cytotoxin composed of the human interleukin -13 (IL-13) and a truncated form of the Pseudomonas aeruginosa Exotoxin A, has been shown to be highly toxic to cells expressing the IL-13 receptor [4, 5]. Pseudomonas Exotoxin A kills mammalian cells by catalyzing irreversible ADP-ribosylation and inactivation of the elongation factor 2 necessary for protein synthesis. Human GBMs express high levels of the IL-13 receptor in comparison to normal brain and therefore this genetically engineered drug should be highly specific to tumor cells [6, 7]. Investigations to assess if CED can successfully distribute IL13-PE38QQR demonstrated that co-infusion of IL13-PE38QQR with 123I-labeled human serum albumin (HAS) in patients with GBM led under ideal circumstances to adequate tissue distribution of the drug . The authors also identified that proximity to subarachnoid space and placement close to an ependymal surface has a significant detrimental influence on the drug delivery. Specific catheter positioning placement guidelines were therefore proposed based on these findings with an emphasis on adequate depth from brain surface, sulcus or resection cavity as well as distance from ependymal and pial surfaces. Timing of catheter placement is also important for the accuracy of the positioning. Edema, fluid shifts and re-expansion after surgical resection of the tumor limits the use of pre-surgical MRIs for catheter placement planning. Therefore most neurosurgeons using CED as delivery method will plan a second procedure for catheter implantation based on post resection images. Prior phase I studies found that accurate catheter positioning based on these guidelines seem to be a critical factor to improve OS assuming that accurately positioned catheters result in better drug distribution. These studies also proved that CB could be infused safely via CED in patients after tumor resection . The imaging changes seen on MRIs of patients treated with CB via CED are summarized by Parney et al.  and a specific scoring system has been established. It is thought that higher grades of imaging changes are due to a necrotic and inflammatory processes involving also normal brain. The underlying mechanism is not well understood but higher concentration of the drug could potentially lead to non-targeted uptake of CB and therefore also harm normal tissue. However, others have shown that the development of new T2/FLAIR signal abnormalities after delivery of CB via CED is an indication of successful drug delivery using concurrent infusion of CB and 123I-labeled HSA in combination with SPECT analysis . The encouraging results from prior phase I studies led to the design of the multicenter phase III trial. The PRECISE study is the largest surgically based randomized clinical trial to date using CED in comparison to other local therapy in recurrent GBM. No survival advantage in patients treated with IL13-PE38QQR compared to GW was identified with a median survival of 36.4 weeks for CB and 35.3 weeks for GW (P = 0.476) with hazard ratio of 0.89 (95% CI: 0.67–1.18). Although progression free survival (PFS) was not an endpoint centrally reviewed in this trial, the study reported an improved PFS of 17.7 weeks for CB over a PFS of 11.4 weeks for GW (P = 0.008). To further elucidate which factors are essential to respond to this type of therapy, we assessed MRIs of all patients receiving IL13-PE38QQR in respect to catheter positioning scores, overall catheter placement scores, local recurrence of disease, imaging changes associated with the therapy as well as the effect of these variables on clinical outcome.
Materials and methods
Cintredekin besudotox (CB)
The sequence encoding IL13-PE38QQR was created by Dr. Debinski and further developed by Dr. Raj K. Puri, M.D., Ph.D. in the department of Tumor Vaccines and Biotechnology Branch, Center for Biologics Evaluation and Research, FDA. The sequence was incorporated into a plasmid at Advanced BioScience Laboratories (Kensington, MD) and later at Diosynth (Morrisville, MC). Escherichia coli bacteria were transformed with a plasmid containing the CB sequence, protein synthesis was induced and expanded. CB was purified as described prior under current good manufacturing practices . CB was infused at a concentration of 0.5 μg/ml at a total rate of 0.750 ml/h for 96 h after catheter placement was confirmed.
Clinical trial design
The PRECISE study is an international, multicenter study across the U.S, Canada, Europe and Israel. Adult patients with recurrent supratentorial GBM, histologically confirmed at initial presentation, were eligible for the trial. The patients had to be surgical candidates with an intent of gross total resection (GTR), defined as more than 95% of the total volume of the enhancing lesion. Other inclusion criteria consisted of Karnofsky performance score ≥70 as well as prior radiation therapy completed ≥4 weeks prior to study entry. Patients who had multifocal disease, subependymal or leptomeningeal spread, evidence of tumor crossing the midline, or who showed signs of significant increased intracranial pressure, had uncontrolled seizures, or required emergent palliative treatment were excluded. Survival was defined as the number of days from the date of randomization to the date of death or last known alive date. PFS was defined as the number of days from the date of randomization to the date of tumor progression as determined by the investigator. For detail see Kunwar et al. .
All patients underwent pre-resection contrast MRI imaging (with and without gadolinium) within 7 days prior to surgery. Within 72 h after resection all patients underwent an MRI scan (slices <3 mm without spacing) to assess the extent of resection. These images were also used to plan for guidelines-compliant catheter trajectories. Based upon this planning MRI scan, on the day of catheter placement, two to four catheters were stereotactically placed by the treating neurosurgeon. To confirm proper catheter positioning, a non-contrast CT scan using slices ≤3 mm without spacing was performed prior to start the IL13-PE38QQR infusion. Follow-up contrast MR images were obtained at day 43 and day 71 post infusion and consistently collected for central review for all patients.
Catheter planning and placement
The surgical planning procedure for the infusion catheters was performed using the MRI scan obtained within 72 h of resection. The images were reviewed on the planning computer station or the surgical navigation station. Virtual trajectories were generated based upon the guidelines outlined in Table 1. Each trajectory was reviewed in Probe’s Eye View in order to ensure adherence to the placement guidelines. Barium impregnated infusion catheters (Vygon, Norristown, PA, USA), not specifically designed for CED, were inserted in the operating room under local or general anesthesia. Using a sterile frameless or frame based stereotactic placement technique, two to four catheters were inserted into the brain parenchyma based on the surgical plan. For frameless insertion, the guideline was to use rigidly mounted holding devices rather than free-hand approaches in order to minimize deviations of actual versus planned catheter trajectories. The stylets from the catheters were slowly removed under constant irrigation so that the vacuum in the catheter would draw fluid down into the catheter and reduce the amount of air in the infusion system. Catheters were then tunneled beneath the scalp to reduce the risk of infection. Each catheter was connected to a separate micro infusion pump (MEDEX 3500 or equivalent). Placement was confirmed on CT imaging within 24 h of placement. The technique for placement was however not centrally mandated and was left to the discretion of each investigator. Infusion was started within 24 h after catheter placement. All members of the clinical team involved in the study received on-site and off-site training to gain basic proficiency and comfort level in using CED for the PRECISE Trial (BrainLAB AG, Feldkirchen, Germany). Investigators were not permitted to enroll a second patient until their first patient’s plan and catheter placements were reviewed and deemed acceptable. In all cases, near real-time, but post-treatment, analysis of catheter planning and placement was performed and feedback was provided to the surgeon. Major deviations from the guidelines or from the catheter plan resulted in a requirement for retraining prior to enrollment of another patient.
A separate post-resection procedure for placement of catheters was chosen to improve the accuracy of catheter positioning by avoiding the effects of postoperative edema as well as brain shift and re-expansion on catheter positioning that can occur with placement at the time of resection.
Central case review of catheter placement
A central case review procedure to assess catheter placement was established in order to optimize clinical trial management and to improve interpretability of patient outcome. For this review BrainLAB collected anonymous data for each patient (post-resection/catheter planning MRI, post-catheter placement CT scan) in DICOM format at every site after treatment was completed. BrainLAB imported all available data to the iPlan® Flow planning and simulation software (BrainLAB AG, Feldkirchen, Germany). The planning functionality was used to add a virtual trajectory for every catheter depicted on the CT scan. To visualize these trajectories on all available images, CT and MRI data were overlaid using the image fusion functionality in the iPlan® Flow planning and simulation software, which is described in more detail elsewhere [8, 13, 14].
Criteria for catheter positioning
Depth ≥25 mm from brain surface or any deep sulcus, or from resection cavity wall if placed through the resection cavity
Catheter tip ≥5 mm from any pial surfaces
Catheter tip ≥10 mm from the resection cavity walls or any ependymal surfaces
Scoring system for assessment of catheter positioning
Poor: criterion A not fulfilled (regardless of other criteria)
Fair: criteria A and either B or C fulfilled
Good: all three criteria fulfilled
Criteria for overall catheter placement
Target includes areas of T2/FLAIR abnormalities and largest adjacent area of white matter
Catheter tips are ≥20 mm apart from each other
If any residual, solid contrast-enhancing disease is present the catheter tip is positioned adjacent but not into it
Scoring system for overall catheter placement
F = fully conforming
Criteria I, II and III (if applicable) fulfilled
P = partially conforming
Only one criteria fulfilled or criteria I and II fulfilled with criteria III failed (if applicable)
N = non-conforming
No criteria fulfilled
Retrospective imaging analysis
Imaging change score
Imaging change score
Hyperintense signal abnormality on FLAIR related to catheter tract or tip only. No new contrast-enhancement
Mild contrast-enhancement (<1.0 cm or linear) related to catheter tract or tip
Moderate contrast-enhancement (1.0–3.0 cm) related to catheter tract or tip
Extensive contrast-enhancement (>3.0 cm) related to catheter tract or tip, with or without central hypointensity
Patients with extent of resection less than 95% were excluded from the analysis to ensure that the statistical analyses were based on the intended population. To explore whether the catheter positioning score predicted local tumor control or imaging change scores on day 43 and day 71 MRIs, we employed the extended versions of logistic regression model and proportional odds model. These types of statistical models belong to the class of Generalized Linear Mixed Models (GLMM), which takes into proper consideration the correlation arising from multiple catheters (two to four) in each of the patients. Similarly, a generalized logistic regression model was used to examine if imaging change score was associated with local tumor control. Both catheter positioning score and imaging change score were treated as categorical variables when included as covariates in the model. These analyses were performed using STATA version 10.0 . The Survival package in R version 2.7.1 was utilized to evaluate whether any imaging-based variable predicted long term survival . For these analyses, two or more catheters optimally positioned (i.e. catheter positioning score 2; see Tables 1 and 2) were used as the categorical cut-off. For overall catheter placement score, patients assessed as “non-conforming” were collapsed with the “partially conforming” category due to limited number in the former category. Similarly, two or more catheters with imaging change score graded II or above (see Table 5) were used as the criterion for the purpose of dichotomization. For the local tumor control variable, patients were categorized into either achieving local tumor control in all catheters or having at least one local catheter failure. To assess whether catheter positioning score or overall catheter placement predicted long term clinical outcome, the Cox proportional hazards (Cox PH) model was used to allow for the adjustment of the known prognostic markers of age and KPS. Further, to examine the impact of day 43 and day 71 imaging variables (i.e. local tumor control and imaging change score) on clinical outcomes, we used a landmark analysis approach based on Cox PH model. For example, to evaluate whether local tumor control on day 43 MRIs predicted OS or PFS, all patients alive with known local tumor control status on day 43 were included in the analysis. Survival was counted as number of days from the date that day 43 MRI was performed until date of death due to any cause and Cox PH model was then used to adjust for factors including age and KPS. Adjustments for multiple comparisons was made by choosing P values of <0.01 to indicate statistical significance.
Distribution of catheter scores and imaging grading scores in the CB treated population
Among 183 patients in the CED ITT population, the extent of resection could not be evaluated in three patients. Twenty patients had significant residual disease and were excluded from this analysis. This differs from the analysis by Sampson et al. , who included all patients treated in the PRECISE trial with CB. The analysis was based on 160 patients. Of note, only 50 patients had no evidence of any residual disease defined as contrast enhancing lesion after surgery per USCF review. Seventy-five patients (47%) treated with IL13-PE38QQR via CED had three catheters placed, 63 (39%) had four catheters, and only 16 patients had two catheters. With respect to the overall catheter placement score, 83 patients (54%) were judged to fulfill all of the criteria as outlined in Tables 3 and 4 (i.e. fully conforming), while 65 patients (40%) only partially fulfilled the criteria and 5 patients (3%) did not fulfill any.
Distribution of catheter positioning score, local tumor control and imaging change score
Number of catheters (%)
Catheter positioning score (# pts = 154)
Local tumor control
Day 43 (# pts = 119)
Day 71 (# pts = 102)
Image change score
Day 43 (# pts = 15)
Day 71 (# pts = 99)
Correlative analysis of catheter scores, local tumor control and imaging changes
Correlative analysis of relationship among catheter positioning score, local tumor control and imaging change score on day 43 and day 71 MRI evaluation
OR (95% C.I.)
OR (05% C.I.)
2 vs. 0/1
Imaging change score
1 vs. 0
2 vs. 0
3/4 vs. 0
Imaging change scorec
2 vs. 0/1
Effect of catheter positioning score, overall catheter placement score and imaging change score on clinical outcome
Cox proportional hazard model for PFS and OS
HR (95% CI)
HR (95% CI)
Overall catheter placementa
Catheter Positioning scoreb
Image change scorec
Local tumor controld
The PRECISE trial is the largest study to date using CED for the delivery of a genetically engineered therapeutic agent for the treatment of patients with recurrent GBM. The study did not meet its primary endpoint by not showing a significant OS difference between CB via CED and GW. PFS was not a primary endpoint if this trial and not centrally reviewed . To further examine the underlying reasons for this outcome, despite the very promising phase I study results, we investigated imaging characteristics on MRI scans obtained during this study. We assessed catheter positioning scores, overall catheter placement as well as imaging change scores for each MRI scan obtained during the study and correlated the collected variables with clinical outcome.
We found that 11% of patients did not fulfill the study inclusion criteria of GTR defined as greater than 95% resection of the contrast-enhancing mass and only a small percentage of patients (27%) had a complete (100%) resection of their enhancing tumor based on our review of the images. We excluded patients who did not fulfill the inclusion criteria of GTR. Further, the definition of extent of resection did not incorporate changes in T2/FLAIR signal abnormality, which potentially characterize significant metabolic and/or tumor burden. As such, the degree of variations in extent of resection may have influenced the study outcome negatively .
A detailed catheter scoring system was developed prior to study initiation based on studies using SPECT and 123I-HAS (Plasbumin). These studies showed that using CED could provide clinically relevant intracerebral distributions of high molecular weight compounds if catheters are accurately placed . The overall placement score was created to determine placement in respect to resection cavity, T2/FLAIR signal abnormality and other catheters, whereas the catheter positioning score itself reflects the distance of each catheter in relation to different brain surfaces. The treating neurosurgeons underwent training for this complex treatment plan and also received feedback after catheter placement. Despite these specifications only 54% of the catheters were fully conformed regarding their overall placement and only 51% of all catheters were accurately positioned. These numbers indicate that the use of CED as a delivery technique is a highly specialized procedure and implementation of strict procedures is required to ensure accurate placement. An ad hoc analysis of the PRECISE trial showed centers that enrolled more than six patients had a higher median survival than centers that enrolled fewer patients. More experience with catheter placement by the treating neurosurgeon has been linked to improved survival . This indicates that the training provided for CED in this study may have been insufficient and should be taken into consideration when planning future trials. It might also be beneficial to restrict this kind of complex delivery technique to centers of excellence to ensure the best possible outcome. Further to bear in mind is that patients treated on the PRECISE trial only received one infusion of the CB. If repeated administration of the agent via CED would be surgically feasible the benefit on clinical outcome might be more substantial than given the drug only once.
In this analysis, we found that local tumor control status based on day 43 MRI was significantly predictive of OS and as expected of PFS. We were unable to establish this relationship based on day 71 data potentially due to the smaller sample size. Nevertheless, this finding is consistent with the general belief of clinicians that delay in tumor progression indicates the likelihood of prolonged survival. In fact, a recent study based on the experience of the North American Brain Tumor Consortium (NABTC) demonstrates a strong correlation between progression status at 6 months and OS among adult patients with recurrent high grade glioma .
Real time monitoring of drug distribution was not provided during the PRECISE study and we therefore used the catheter positioning score and imaging change score as surrogates. We were unable to find any correlation between catheter positioning score, local tumor control, and clinical outcome. In a subset of patients treated on the PRECISE trial, the distribution of the drug was estimated by using the iPlan Flow software (BrainLab AG, Germany) . The authors found that there was a significant correlation between coverage volumes and overall catheter placement score. However, no correlation was found between coverage volumes and PFS or OS . Additionally, these results are in contradiction to the analysis of prior phase I studies, which showed that OS was linked to adequate catheter placement. The median survival in the PRECISE study for patients treated with CB was reported to be 45.3 weeks, which is in concordance with prior studies . Conversely, the median survival for patients with good catheter scores in the PRECISE trial was significantly lower (39.9 weeks with 95% CI, 32.6–52.4) compared to prior phase I trials (55.6 weeks with 95% CI, 21.0–45.9). In this analysis we used the same parameters to define good catheter scores as that used in the phase I analysis (two or more catheters with an optimal catheter positioning score of 2). We further investigated if the overall placement score affected these results. However, even patients with good overall placement score and good catheter scores had only a median survival of 38.1 weeks (95% CI, 30.9–49.4 weeks). These results indicate that the catheter positioning score and overall placement score were not sufficient to predict response to therapy in the PRECISE trial. Other techniques are needed to predict accurately the drug distribution in vivo. Recently, gadoteridol-loaded liposomes were shown to be successfully delivered in a canine model via CED and this technology also allows for monitoring of the distribution of these particles by real time imaging . Using this technique, a recent study from Varenika et al.  showed that leakage occurred in 20% of infusions in monkeys. The clinical development of such a technique would identify patients in whom leakage occurred during the infusion or who showed poor drug distribution. Further trials using CED as a delivery method should incorporate detailed analysis of drug distribution to determine if delivery of the drug is adequate and covers the expected area. Monitoring drug distribution will also help to further identify additional factors needed to provide adequate drug delivery, which is not currently captured in the catheter positioning score or overall placement score.
Besides drug distribution, drug specificity and expression of the target molecule on tumor cells influence the response to therapy. With respect to target expression, several studies have shown that the target of CB, the IL-13R, is over-expressed in a large number of high grade glioma explants [6, 22]. A recent study using a commercially available tissue array and IL-13R antibody showed that up to 75% of patients with GBM over-express the IL-13R. This will allow upfront testing for future trials and should be included in the eligibility criteria . The percentage of IL13R positive samples within the PRECISE cohort is currently not known and might have influenced the outcome. Heterogeneous expression of the IL-13R has been demonstrated in tumor samples as well as variation in the expression from various sites of tumor, however the use of different antibodies used in these studies makes it difficult to assess the real impact of these findings [6, 22–25]. Given that most patients will undergo surgery at recurrence, the expression of the target gene at the tumor margins is much more crucial than the expression in the core of the tumor. Further analysis of the expression of the IL-13R in samples obtained during this trial will help to answer some of these questions. In summary, more rigorous upfront biological based inclusion criteria might be needed when using a targeted therapy like CB.
CB related imaging changes seen during the PRECISE trial were similar to what has been reported from phase I studies. We used the imaging change score as a marker for drug distribution based on a study that showed that new FLAIR/T2 signal changes are correlated with drug distribution . We were unable to identify any correlation between the imaging change score, local tumor control or clinical outcome. The numbers of catheters associated with more extensive imaging changes were relatively low and therefore we might have lacked the statistical power to see any differences.
The PRECISE study did not demonstrate a survival benefit of patients treated with CB versus GW in resectable recurrent GBM. Despite intensive on site training a majority of catheters were not positioned correctly highlighting the complexity of this technique. Detailed analysis of catheter positioning score, overall placement score and imaging change score did not reveal any correlation of these parameters with clinical outcome and better methods for determining drug distribution by CED need to be included in future study designs. Further analysis of the target expression will be important to further identify areas of improvement.
This work was supported by the PO grant PO1CA118816-02, Campini Foundation (SM) as well by BrainLab AG, Germany. The PRECISE trial was sponsored by NeoPharm, Inc.
This article is distributed under the terms of the Creative Commons Attribution Noncommercial License which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.