An algorithm for longitudinal registration of PET/CT images acquired during neoadjuvant chemotherapy in breast cancer: preliminary results
- First Online:
- Cite this article as:
- Li, X., Abramson, R.G., Arlinghaus, L.R. et al. EJNMMI Res (2012) 2: 62. doi:10.1186/2191-219X-2-62
By providing estimates of tumor glucose metabolism, 18F-fluorodeoxyglucose positron emission tomography (FDG-PET) can potentially characterize the response of breast tumors to treatment. To assess therapy response, serial measurements of FDG-PET parameters (derived from static and/or dynamic images) can be obtained at different time points during the course of treatment. However, most studies track the changes in average parameter values obtained from the whole tumor, thereby discarding all spatial information manifested in tumor heterogeneity. Here, we propose a method whereby serially acquired FDG-PET breast data sets can be spatially co-registered to enable the spatial comparison of parameter maps at the voxel level.
The goal is to optimally register normal tissues while simultaneously preventing tumor distortion. In order to accomplish this, we constructed a PET support device to enable PET/CT imaging of the breasts of ten patients in the prone position and applied a mutual information-based rigid body registration followed by a non-rigid registration. The non-rigid registration algorithm extended the adaptive bases algorithm (ABA) by incorporating a tumor volume-preserving constraint, which computed the Jacobian determinant over the tumor regions as outlined on the PET/CT images, into the cost function. We tested this approach on ten breast cancer patients undergoing neoadjuvant chemotherapy.
By both qualitative and quantitative evaluation, our constrained algorithm yielded significantly less tumor distortion than the unconstrained algorithm: considering the tumor volume determined from standard uptake value maps, the post-registration median tumor volume changes, and the 25th and 75th quantiles were 3.42% (0%, 13.39%) and 16.93% (9.21%, 49.93%) for the constrained and unconstrained algorithms, respectively (p = 0.002), while the bending energy (a measure of the smoothness of the deformation) was 0.0015 (0.0005, 0.012) and 0.017 (0.005, 0.044), respectively (p = 0.005).
The results indicate that the constrained ABA algorithm can accurately align prone breast FDG-PET images acquired at different time points while keeping the tumor from being substantially compressed or distorted.
Keywordsbreast cancer longitudinal registration FDG-PET/CT treatment response metabolic monitoring
18F-fluorodeoxyglucose positron emission tomography (FDG-PET) can provide estimates of parameters related to the delivery, retention, and metabolism of glucose, and therefore has been proposed as a method of characterizing the response of tumors to treatment [1, 2, 3, 4]. To assess treatment response, semi-quantitative parameters, such as the standard uptake value (SUV) which is derived from static images [5, 6], or quantitative parameters which are derived from dynamic images, [7, 8, 9], are measured at different time points during the course of treatment. Changes in these values on a region of interest (ROI) basis are then used to assess or predict the response of tumors to therapy [10, 11]. In recent years, there has been increasing interest in assessing imaging data at the voxel level, rather than at the ROI level, with the hypothesis that important information on tumor heterogeneity is discarded when an ROI average is performed [12, 13]. In order to optimally perform such an analysis during therapy, the data sets acquired at different time points must be accurately co-registered so that similar sections of tissues can be compared. Towards this end, we have introduced a technique that allows for co-registering breast MRI data acquired at different imaging sessions during therapy [14, 15]. In this effort, we seek to amend this method to perform longitudinal registration of PET/CT data of the breast in order to enable voxel level analysis of changes observed in FDG-PET images acquired during therapy.
The motivation for developing a method for characterizing changes in FDG-PET scans at the voxel level comes from the fact that probing tumor heterogeneity, as well as changes in that heterogeneity over time, is gaining prominence as a research topic . As MRI studies have shown changes in heterogeneity are predictive of response , it is natural to apply a similar approach in studying FDG-PET data. Indeed, as FDG-PET is becoming more accepted in assessing changes in tumor metabolism over time (see, e.g., the most recent version of the Response Evaluation Criteria in Solid Tumors, RECIST [17, 18]), the ability to compare the same section of tissue will become increasingly important. While the limited spatial resolution of PET (compared to, e.g., MRI and CT) is a potential barrier for performing such a comparison, it certainly must be addressed to determine if such a promising approach is viable. As has been noted recently , volumes of interest established just prior to the initiation of therapy (i.e., baseline images) are not easily transformed to images acquired at later time points, thereby making attempts to study changes in heterogeneity challenging. In this effort, we present one approach to potentially mitigate such difficulties.
There are three main challenges in performing longitudinal registration of breast FDG-PET images: (1) differences in patient positioning between consecutive imaging sessions, (2) changes in tumor shape and volume between imaging sessions, and (3) the relatively low spatial resolution of PET images. To minimize the error introduced by differences in patient positioning, we have designed a support device that allows for PET imaging in the prone position. This allows for the breasts to lay pendant during the scanning session, rather than flat against the chest as in the supine position. It is important to note that we are not the first to introduce this technique; Moy et al.  have used prone PET imaging of the breast to facilitate registration of PET data to MRI data, where it has been applied to assist in diagnosis [21, 22]. The second problem, addressing the changes in tumor shape and volume that occur due to therapy, requires a registration technique that can maximally align the breast volumes while minimally distorting the tumor, the volume of which must be kept true to what is measured at each time point [14, 15]. That is, if V(t1) is the tumor volume at time t1 (e.g., pre-treatment), and VR(t1) is the tumor volume after registration to the post-treatment image, then the registration scheme should minimize the differences between V(t1) and VR(t1). Similar comments apply for time t2. To achieve this, we developed and applied a spatially constrained, non-rigid registration method previously used for longitudinal registration of MR images, which incorporates a tumor volume-preserving constraint. The third problem is addressed by applying the algorithm on the computed tomography (CT) images that are acquired during the PET/CT acquisition and applying the resulting transformation to the PET data. We tested our approach on ten patients receiving neoadjuvant chemotherapy for breast cancer, who were scanned at three different time points: pre-therapy, after one cycle of therapy, and at the conclusion of therapy. The PET/CT data at the first two time points were co-registered to the data at the third time point by applying constrained and unconstrained registration algorithms. Both qualitative visual comparisons, as well as a quantitative analysis of the change in the median tumor volume determined from the SUV maps and bending energy obtained from the deformation fields (DF), were employed to evaluate the performance of the registration algorithms.
Data were acquired from ten patients with locally advanced breast cancer, who were enrolled in an ongoing phase II clinical trial that is investigating whether the addition of an mTOR inhibitor (RAD001) would have synergistic effects with cisplatin in triple negative breast cancer. The patients provided informed consent, and the study was approved by our Institutional Review Board. Patients with measurable clinical stage II/III triple negative breast cancer are assigned (2:1) to cisplatin 25 mg/m2 with and without RAD001 30 mg weekly for 3 weeks, followed by cisplatin + paclitaxel 80 mg/m2 with and without RAD001 weekly for 9 weeks until the time of definitive surgery. FDG-PET/CT images of the patients were obtained before (t1), after one cycle (t2), and at the completion of neoadjuvant chemotherapy (t3), yielding a total of 30 data sets (ten patients × three time points). For each patient, we registered the data from t1 to t3 and the data from t2 to t3, thereby yielding 20 data sets in which to test the registration algorithms.
PET/CT data were acquired with a GE Discovery STE scanner (GE Healthcare, Waukesha, WI, USA). A low-mAs CT scan was acquired for attenuation correction of the emission data. The acquisition parameters for the transmission CT scan were the following: the tube current was 80 mAs for a 70-kg patient and scaled accordingly for all patients, the tube voltage was 120 KVp, and the pitch was 1.675/1. The activity of FDG administered was approximately 370 MBq (10 mCi) for a 70-kg patient and scaled according to weight. FDG was administered intravenously via an antecubital vein contra-lateral to the affected breast. After 60 min, emission data was collected in 3D mode for 2 min per bed position. The emission scan was first collected in the prone position over the breast only, and then in the supine position from the skull to mid-femurs. Standard-of-care supine images and research prone images were acquired at times t1 and t3, while only the prone images were acquired at t2.
Image registration methods
where H(A) and H(B) are the marginal entropy of images A and B, and H(A,B) is the joint entropy. A non-rigid registration method  is then applied to the longitudinal breast CT images between the first two time points and the third. This method relies on the adaptive bases algorithm (ABA) . The ABA algorithm employs NMI as the similarity measure, and the deformation field is modeled by a linear combination of radial basis functions . Through searching the optimal coefficients of radial basis functions, the NMI can be maximized, and the deformation field that registers the two images can be obtained. The ABA algorithm is applied using a hierarchical multi-resolution strategy, in which the original PET/CT images are down-sampled into a number of low-resolution images, and the registration starts at a low resolution level, with few basis functions, and ends at the highest resolution level.
where JT(x) is the Jacobian determinant on the tumor area, and α is the parameter to control the weight of this constraint term. The value of α can be adjusted from 0 to 1 based on individual datasets; the smaller the weight, the less the tumor volume is constrained (please see the ‘Discussion’ section for more comments on this technical point). For the patient data sets in this study, a weight of 0.1 was unable to constrain the tumor volume for some patients, while a weight of 0.5 was too strong to allow the reorientation of the tumor in other patients; thus, a weight of 0.3 was (empirically) selected for all 20 pairs of image sets. Through minimizing the cost function, the algorithm optimally registers the normal tissues while simultaneously minimizing tumor distortion.
To perform the constrained registration, the tumor volume must first be segmented. We note that determination of the tumor volume in PET images by thresholding is still an area of active discussion. For example, Drever et al.  have shown that the optimal threshold depends mainly on lesion size and contrast, and that a threshold of 40% can be reasonable for larger lesions. However, Biehl et al.  showed that the PET and CT gross tumor volumes were approximately equal using a threshold of 40% for tumors less than 3 cm. As an in-depth analysis of the determination of the threshold was outside the scope of the study, we simply segmented the tumor volume using a threshold of 40% of the maximum SUV uptake, a common method to delineate tumor volumes on SUV maps of FDG [28, 29, 30]. More specifically, the SUV maps were calculated for each patient and loaded into in-house software (based on MATLAB, Natick, MA, USA). An experienced radiologist drew tumor ROIs large enough to ensure that all possible tumor voxels were included. These manually drawn ROIs may also include some healthy tissue voxels. The ROIs for each slice were then combined to generate 3D masks. The final tumor volume is detected by finding all voxels with SUV larger than 40% of the maximum SUV uptake in the 3D masks. These are the tumor voxels, the Jacobian determinant of which is minimized during the application of the constrained algorithm in order to maximally preserve the tumor volume during the registration process. It is also important to note that our previous studies  have shown that the selection of the tumor volume (i.e., the volume of tissue that is to be constrained during the registration process) does not significantly affect the performance of the method.
where T is the transformation, and V is the tumor volume.
The percentage change of tumor volumes is used to measure the degree the constrained algorithm preserves tumor volume or the extent the unconstrained algorithm distorts the tumor. When looking at the longitudinal data during therapy response, one of the primary goals is to predict which patient will achieve a positive response. Any change in tumor size should be due to changes in biology and not to changes in patient positioning or errors in the registration scheme. Thus, we want to make sure that changes in the tumor volume are absolutely minimized during registration. Given our earlier result on applying this technique to MRI data, we hypothesized that the tumor volume will be similar before and after applying the constrained ABA registration algorithm (i.e., Equation 2), while the tumor volume will be changed substantially using the unconstrained ABA registration algorithm (i.e., Equation 2 without the second term on the right hand side) because the unconstrained algorithm tends to compress or stretch the tumor at early stages of treatment (i.e., t1 and t2) to match the post-treatment (i.e., t3) tumor size and shape. We also hypothesized that compared with the unconstrained ABA approach, the constrained ABA algorithm will lead to a smoother transformation, and therefore a smaller bending energy.
We used the Lilliefors test to determine if the change of the tumor volumes and the bending energy came from a normal distribution. The test showed that the data did not come from a normal family (p < 0.05 for the bending energy obtained by both the constrained and unconstrained algorithms and the tumor volume change obtained by the unconstrained algorithm). Hence, instead of using the mean and standard deviation, the median and the lower and upper quantiles (the 25th and 75th quantiles) were reported for the change of the tumor volumes and the bending energy. The non-parametric Wilcoxon signed rank test was then applied to determine if the results obtained by the constrained and unconstrained ABA algorithms were significantly different.
Qualitative assessment of registration algorithms
Quantitative assessment of registration algorithms
The bending energy and change of tumor volumes are calculated using the constrained (ABA_CON) and unconstrained ABA algorithms (ABA), respectively
Change of tumor volumes
t1 → t3
t2 → t3
t1 → t3
t2 → t3
t1 → t3
t2 → t3
t1 → t3
t2 → t3
t1 → t3
t2 → t3
t1 → t3
t2 → t3
t1 → t3
t2 → t3
t1 → t3
t2 → t3
t1 → t3
t2 → t3
t1 → t3
t2 → t3
In previous studies [14, 15], we presented a tumor volume-preserving registration algorithm for breast MR images acquired at different time points during therapy, validating this algorithm quantitatively on both simulated and experimental breast MR data. The tumor volume changes obtained for MR images were 4.8% and 46.9% for the constrained and unconstrained algorithms, respectively, and the bending energies were 0.0058 and 0.15, respectively . The accurate performance of this algorithm on MR data makes it a promising technique to apply on longitudinally acquired breast data available from other modalities. In this effort, we have applied the constrained, non-rigid registration algorithm to sequential breast PET/CT images acquired during neoadjuvant chemotherapy. Visual assessment (Figures 3, 4, and 5) demonstrates that the algorithm leads to accurate registration results. Quantitative assessment (Table 1) also shows that the algorithm yields smoother deformation fields and significantly less tumor volume change compared with the unconstrained, non-rigid registration algorithm.
One limitation of this study is that the registration algorithm may not correct the change in the whole breast volume over time, e.g., due to hormonal fluctuations over the menstrual cycle . In the current technique, the constrained term is applied to the tumor ROI to preserve the tumor volumes, and NMI is used to perform the alignment. Therefore, this technique may not be able to handle changes in overall breast volume.
We note that there are some negative volume changes in Table 1. This may have occurred since the difference of patient positioning in particular cases could be large, resulting in large deformation during registration between two time points. Under some circumstances, the registration algorithm must stretch the healthy tissue in the source image to match with the target image. When the mutual information term in the cost function is substantially greater than the constraint term, both the healthy tissue and the tumor area will be stretched during registration, and this could result in tumor expansion. We also note that for some patients (e.g., patients #5 and 7 in Table 1), the results obtained by both the constrained and unconstrained algorithms were very similar. One possible reason is that for all 20 data sets, we use similar registration parameter settings (e.g., the number of radial basis functions and the total resolution levels); in particular, we fixed the weight of the constraint term, α, to a value of 0.3. However, as the tumor shape, volume, and normal tissue structures are substantially different between patients, it is highly likely that empirical adjustment of those parameters for different patients would improve the performance of the constrained. One of the future goals is to automate the optimal selection of these parameters. Another future direction is to use MR images to further verify the performance of the constrained algorithm on PET/CT images. As mentioned above, MR images have a higher spatial resolution (than PET) and could be used to examine if larger voxel size or partial volume effect causes the registration inaccuracy in PET/CT data, though applying the transformation obtained from PET/CT data to MR images.
Although currently, most studies still focus on the assessment of physiological parameters at the ROI level, investigators have realized the importance of tumor heterogeneity contained in parametric maps. Maday et al.  employed a deformable registration and texture analysis on breast magnetic resonance images to assess the response of breast cancer to therapy and concluded that their approach improved the ability to predict response. Padhani et al.  also reported that the change in the range of tumor perfusion and permeability estimated by MRI was able to predict breast cancer response to treatment, indicating that intra-tumoral heterogeneity is important. O'Connor et al.  also showed that DCE-MRI biomarkers of tumor heterogeneity may predict the shrinkage of colorectal cancer liver metastasis. Li et al.  applied longitudinal registration to DCE-MRI data and performed a voxel-by-voxel analysis. Their preliminary results indicated that the voxel-based analysis may improve the ability of DCE-MRI parameters to separate complete responders from non-responders after one cycle of chemotherapy. Hence, longitudinal registration keeps the information of tumor heterogeneity and spatial distribution of the physiological parameters, thereby enabling spatial comparison at the voxel level. It is a reasonable hypothesis that registration of PET/CT breast images obtained during therapy may allow for an improvement in assessing and/or predicting treatment response. Hence, future efforts will apply the algorithm to parametric maps (e.g., the standard uptake value) to investigate if assessing the changes at the voxel level can improve, over region-of-interest-based measurements, the ability of FDG-PET to predict the response of breast tumors to neoadjuvant chemotherapy. In particular, it will be important to determine if the constrained algorithm can limit registration errors to such a level that they would be acceptable for clinical evaluation based on voxel (or, at least, local) uptake analysis. As our data set grows, this will be a primary goal to address. Such an analysis has been applied in MRI longitudinal studies of treatment response in cancer [33, 34, 35], and the methods presented in this contribution enable such an approach for PET data.
This study indicates that the constrained registration method can accurately align prone breast FDG-PET images acquired at different time points while keeping the tumor from being substantially compressed or distorted. Future studies, in a larger cohort of patients, will test whether the approach can enhance the ability to predict eventual response, thereby by providing an important (clinical) validation.
XL and LRA are imaging research scientists. RGA is an assistant professor. ABC is an associate professor and a radiation oncologist. VA is an assistant professor of medicine and a medical oncologist. IM is also an assistant professor of medicine and a medical oncologist. She is the clinical director of the Breast Cancer Program. JF is a licensed practical nurse. DD is a professor of the Radiology and Radiological Sciences Department and the director of the Nuclear Medicine and Positron Emission Tomography. TEY is an associate professor of the Radiology and Radiological Sciences Department, Biomedical Engineering, Physics and Astronomy, and Cancer Biology, and the director of Cancer Imaging Research.
We offer our sincerest gratitude to the patients who volunteered to participate in this study. We thank the National Institutes of Health for funding through NCI 1U01CA142565, NCI 1P50 098131, and the Vanderbilt-Ingram Cancer Center Support Grant (NIH P30 CA68485). We thank the Nuclear Medicine/PET technologists, particularly Ms. M. Dawn Shone and Ms. Janine Belote, for their expert technical assistance, Mr. Ken Wilkens for fabricating the PET support system for prone imaging, and Benoit Dawant, Ph.D., for the important and insightful discussions. We also thank the Kleberg Foundation for the generous support of the molecular imaging program at our institution.
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License ( http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.