A preliminary PET radiomics study of brain metastases using a fully automatic segmentation method



Positron Emission Tomography (PET) is increasingly utilized in radiomics studies for treatment evaluation purposes. Nevertheless, lesion volume identification in PET images is a critical and still challenging step in the process of radiomics, due to the low spatial resolution and high noise level of PET images. Currently, the biological target volume (BTV) is manually contoured by nuclear physicians, with a time expensive and operator-dependent procedure.

This study aims to obtain BTVs from cerebral metastases in patients who underwent L-[11C]methionine (11C-MET) PET, using a fully automatic procedure and to use these BTVs to extract radiomics features to stratify between patients who respond to treatment or not. For these purposes, 31 brain metastases, for predictive evaluation, and 25 ones, for follow-up evaluation after treatment, were delineated using the proposed method. Successively, 11C-MET PET studies and related volumetric segmentations were used to extract 108 features to investigate the potential application of radiomics analysis in patients with brain metastases. A novel statistical system has been implemented for feature reduction and selection, while discriminant analysis was used as a method for feature classification.


For predictive evaluation, 3 features (asphericity, low-intensity run emphasis, and complexity) were able to discriminate between responder and non-responder patients, after feature reduction and selection. Best performance in patient discrimination was obtained using the combination of the three selected features (sensitivity 81.23%, specificity 73.97%, and accuracy 78.27%) compared to the use of all features. Secondly, for follow-up evaluation, 8 features (SUVmean, SULpeak, SUVmin, SULpeak prod-surface-area, SUVmean prod-sphericity, surface mean SUV 3, SULpeak prod-sphericity, and second angular moment) were selected with optimal performance in discriminant analysis classification (sensitivity 86.28%, specificity 87.75%, and accuracy 86.57%) outperforming the use of all features.


The proposed system is able i) to extract 108 features for each automatically segmented lesion and ii) to select a sub-panel of 11C-MET PET features (3 and 8 in the case of predictive and follow-up evaluation), with valuable association with patient outcome. We believe that our model can be useful to improve treatment response and prognosis evaluation, potentially allowing the personalization of cancer treatment plans.


Radiomics has the potential to personalize patient management extracting relevant features from medical images for use in statistical models [1, 2]. Radiomics features can reflect the tumour pathophysiology and potentially, the evolution of the disease [3], for example through the evaluation of lesion heterogeneity [4, 5] known to cause treatment failure [6], improving the prediction of patient overall survival and/or outcome.

Radiomics aim is to construct a clinically relevant predictive or prognostic model, through the extracted features [7]. Precisely, when extracted from positron emission tomography (PET) images, these features, quantify biological characteristics with a potentially key role in the prediction of treatment response [8]. Moreover, physiological changes may occur before detectable anatomical changes, which makes the PET a valuable tool for an early treatment assessment. In addition, PET may be an excellent alternative to magnetic resonance imaging (MRI) or computed tomography (CT) in detecting unknown primary tumour thanks to high sensitivity for the detection of lesions [9]. Nevertheless, studies have demonstrated that there are numerous challenges in the extraction of quantitative parameters, such as the standardized uptake value (SUV) or the SUV normalized to lean body mass (SUL), from PET images [10]. In turn, the identification of the biological tumour volume (BTV), from which to extract appropriate and significant features, is of primary importance for the development of prognostic models. Radiomics only makes sense if the data extraction process is reproducible and repeatable. In addition, a precise tumour delineation, the process of defining the extent of the lesion in the image separating high uptake regions from background avoiding false-positives, is needed to avoid distortions in data extraction. This is a critical and still challenging issue due to the low spatial resolution and high noise level of PET images where boundaries between tissues are not always clearly defined [11]. Currently, the BTV is manually contoured by nuclear physicians. Although manual contouring seems like the most intuitive and easily implemented way of obtaining regions of interest (ROIs), it has many drawbacks. It is operator-dependent, time-consuming and labour-intensive. The high intra- and inter-operator variability associated with manual delineations gives less precise and mainly irreproducible results. For example, in the study proposed by Vorwerk et al. [12], the analysis of manual contouring data obtained by 18 physicians from 4 different departments highlighted a large inter-observer variability in tumour delineation, despite detailed instructions given to all for delineation process. A partial explanation for this high variability may be related to the partial volume effect [13]; lesion boundaries become blurred and unclear, making manual segmentation more challenging. This is an important limitation of several radiomics studies, i.e. [14], where ROIs were manually delineated. For this reason, many PET-based automatic segmentation methods have been proposed [15,16,17,18] but no consensus has been reached on the optimal delineation method recommending that no one single method can be used for general BTV delineation [19]. The large variability in the shape and texture of lesions makes difficult to generalize PET segmentation methods. In addition, in follow-up examinations (i.e. after radiotherapy or neoadjuvant chemotherapy), segmentation is challenging due to reduced metabolic uptake, lesion to background ratio and reduced tumour volume.

This study aimed to obtain BTVs from cerebral metastases in patients who underwent L-[11C]methionine (11C-MET) PET and to use these BTVs to extract radiomics features to stratify between patients who respond to radio-treatment [20] or not.

Methionine is a natural amino acid that shows a greater uptake by brain cancer cells, whereas it is low in normal cells. Precisely, 11C-MET uptake is mainly driven by the activation of the L-mediated and A-mediated amino acid transport across the blood-brain barrier. Although MRI remains the gold standard for diagnosis and follow-up after radiation therapy [21], 11C-MET PET can discriminate between cancer and healthy tissues, with great power of sensitivity and specificity. It has been reported that the extension of tumour cell invasion can be detected more clearly by 11C-MET PET rather than by CT or MRI approaches [22] providing complementary information to morphological imaging. As reported in [23], PET can be combined with MRI to provide specific information for defining the target volume for the radio-surgical treatment in patients with recurrent brain tumours, such as glioma, metastasis, and pituitary adenoma, to optimize target identification for infiltrating or ill-defined brain lesions. Other studies have shown that the 11C-MET PET specificity related to the extraction of the tumour volume is higher compared with MRI; for example, in the study reported by Grosu et al. [24], PET imaging was used for biological target delineation in 36 patients that showed a significantly longer median survival compared with the group of patients in which target volume was merely defined by MRI. Moreover, recent studies, conducted on primary brain tumours, propose an emerging PET approach to differentiate recurrent brain tumour from radiation necrosis using a radiomics-based model [25, 26].

For these reasons, in the management of brain disease, the integration of 11C-MET PET imaging in radiotherapy planning or follow-up evaluations represents a desirable step forward.

Starting from our previous study [27] where we proposed a semi-automatic method to segment lesions in whole-body [18F]fluoro-2-deoxy-d-glucose (18F-FDG) PET studies, we have implemented a fully automatic and operator-independent system for brain 11C-MET PET studies [28, 29]. The proposed system performs all segmentation steps automatically by individuating an optimal, operator-independent, initial ROI located around the metastasis on an automatically selected PET slice. So, once the ROI has been identified, it is fed to an enhanced local active contour (LAC) segmentation algorithm [27]. In the previous study [27], the proposed method outperformed another state of the art BTV segmentation method tested for comparison. In this study, the great sensitivity and specificity of 11C-MET in differentiating between healthy and malignant tissues is used to automatically identify an initial seed to start the BTV segmentation process, without any user intervention [28]. In other words, we show how this approach may be integrated into a fully automatic protocol for the segmentation of brain metastases in 11C-MET PET images. Based on these BTVs, 108 radiomics features were extracted using the open-source toolbox “Chang-Gung Image Texture Analysis” (CGITA) [30]. Since not all features carry important information, a novel statistical system based on correlation matrix and point-biserial correlation coefficient, was used to identify the most relevant features able to discriminate between responder and non-responder patients. Afterwards, Discriminant Analysis (DA) was used for patient classification.

In particular, 31 brain metastases for predictive evaluation, and 25 brain metastases for follow-up evaluation, have been considered to assess the suitability of the proposed system as a medical decision tool. PET studies and related structures containing BTV segmentations were imported in the CGITA toolbox to extract imaging features to investigate the predictive role of 11C-MET PET in the discrimination between patients who respond to treatment or not.

Summarizing, we aimed i) to propose a fully automatic segmentation system of BTVs with the consequent extraction of radiomics features, and ii) to implement a novel radiomics model to investigate the potential role of extracted features in the prediction of patient outcome in patients underwent 11C-MET PET examinations.


For basal evaluation, 15 men and 16 women with brain metastases (without other organ or/and bone metastases) were considered (men 62 ± 9y, women 53 ± 10y). Primary tumours were breast (22%), brain (32%) and lung cancer (46%). For follow-up evaluation, a subset of 10 men and 15 women with PET scan after gamma-knife or radio treatment was considered (men’s age 56 ± 8, woman’s age 53 ± 10). Gamma-knife was used to safeguard the surrounding healthy brain tissue in the case of brain disorders inaccessible for a conventional surgery allowing accurate external irradiation (with a single, high dose and steep dose gradient) and minimizing doses given to adjacent critical brain structures. In the other cases (i.e. for big tumours), stereotaxic radiotherapy using a conventional linac-based system was performed.

The median time between PET scans was 6 months. A clinical evaluation was carried out by our medical staff to differentiate between responder and non-responder patients using MRI studies after the treatment for the 6 patients without follow-up PET study, and MRI and PET studies after the treatment for the remaining 25 patients. In particular, patients with progression or stable disease were considered as non-responders, patients with partial or complete response were considered responders.

CGITA toolbox [30], using 11C-MET PET images and automatic extracted BTVs, allowed the extraction of 108 radiomics features for each selected metastasis. BTV segmentation examples are shown in Fig. 1. For predictive evaluation, 3 features (asphericity, low-intensity run emphasis, and complexity) were able to discriminate between responder and non-responder patients after feature reduction and selection. Precisely, asphericity is a measure of the deviation from a spherical shape, while the low-intensity run emphasis is a textural feature based on a grey level run (a set of consecutive, collinear voxels having the same grey level value). The length of the run is the number of voxels in one direction and reflects the size of texture elements [31]. The complexity refers to the visual information content of a texture. So, a texture is considered complex if the information content is high: this occurs when there are many patches in the texture with different average intensities [32]. Best performance in DA classification was obtained using the combination of the 3 selected features with sensitivity 81.23%, specificity 73.97%, precision (or positive predictive value) 82.94%, negative predictive value 71.95%, error 21.73% and accuracy 78.27%, compared to the use of all features. All results are shown in Table 1. Corresponding receiver operating characteristic (ROC) curves are shown in Fig. 2.

Fig. 1

Two examples of three-dimensional volume reconstructions

Table 1 Comparison of performance in DA classification for predictive evaluation
Fig. 2

ROC curves for predictive evaluation. The black bold line represents the combined predicted probability by using the 3 selected features (AUC = 0.73; 95% C.I. 0.52–0.93)

For follow-up evaluation, 8 features (SUVmean, SULpeak, SUVmin, SULpeak prod surface area, SUVmean prod sphericity, surface mean SUV 3, SULpeak prod sphericity, and second angular moment) were selected with optimal performance in DA classification (sensitivity 86.28%, specificity 87.75%, precision 92.10%, negative predictive value 80.22%, error 13.43%, and accuracy 86.57%) outperforming the use of all features in the DA classification. The various SUV and SUL related features are intensity-based metrics coupled with the surface area or the asphericity. The second angular moment is a measure of texture homogeneity or uniformity [33]. Corresponding results and ROC curves are shown in Fig. 3 and Table 2, respectively.

Fig. 3

ROC curves for follow-up evaluation. The black bold line represents the combined predicted probability by using the 8 selected features (AUC = 0.79; 95% C.I. 0.59–1.00)

Table 2 Comparison of performance in DA classification for follow-up evaluation


To date, prognosis and treatment response evaluation in the oncological field is still challenging. There is a crucial need to identify biomarkers predictive of patient outcomes to improve personalized treatment. Radiomics has emerged as a potential solution to this issue, providing a multitude of features from biomedical images, i.e. PET images. One advantage of radiomics is that it uses diagnostic images that are available already without requiring additional exams. Despite some encouraging results, several challenges still need to be addressed. Reproducibility and robustness of radiomics studies involving PET images are influenced, among other things, by the choice of the delineation method used to identify the BTV [34]. The lesion segmentation process must be reliable and repeatable. This can only be achieved by using computer-assisted methods. For this reason, we propose a fully automatic segmentation system that eliminates any user intervention, thus increasing result repeatability [29]. The proposed system determines an initial ROI around the lesion, differently than in the original semi-automatic system [27]. Besides, we incorporate in the system the results of the DA classifications to discriminate between patients with brain metastases able to respond to treatment or not. Our ultimate goal is to aid in creating personalized therapy.

After automatic BTV delineation and radiomics feature extraction, the applied DA classification yields promising results. In particular, firstly we implemented a novel statistical system based on correlation matrix and point-biserial correlation coefficient to recursively eliminate features, to select the most relevant ones. Secondly, we used the DA classification to stratify patients. Best performance in classification was obtained using the combination of the selected features (3 and 8 features for predictive and follow-up evaluation, respectively) compared to the use of all 108 features, improving the specificity for more accurate risk stratification in the brain metastases.

Our results showed that 11C-MET PET radiomics has a great predictive value (sensitivity = 81.23%, specificity = 73.97%), comparable with other 11C-MET PET studies [35, 36]. In addition, 11C-MET PET showed great potential in follow-up evaluation after radiotherapy (sensitivity and specificity were 86.28 and 87.75%, respectively), thus potentially helping the clinicians to assess treatment outcomes. In the latter case, we would like to underline that the 8 selected features include PET parameters (i.e. SUV and SUL) that are usually taken into consideration in PET studies that do not perform radiomics analysis to assess treatment follow-up, i.e. [37,38,39]. However, our radiomics analysis did not use the 8 selected features individually as in the above-mentioned studies, but they were combined to classify patients (see Fig. 3).

A major limitation of the proposed study is the relatively small dataset used for the training and validation step. So, a future study with more data is expected to yield even better results improving the prediction of patient outcome. Finally, considering that the proposed system and the CGITA toolbox have been implemented in the Matlab environment running on a standard PC, the whole system (from the BTV segmentation to DA classification, see Fig. 4) could be easily integrated into the clinical setting as a built-in tool in PET workstations. This allows clinicians to use the BTV information both for radiotherapy treatment planning, prognosis and treatment response evaluation to improve personalized medicine.

Fig. 4

The proposed workflow from the fully automatic BTV segmentation process to DA classification to discriminate between patients who respond to treatment or not


In our study, the proposed system was able i) to extract 108 features for each automatically segmented lesion and ii) to select a sub-panel of 11C-MET PET features (three in the case of basal evaluation and eight in the case of follow-up evaluation) with valuable association with patient outcome. We believe that our model can be useful to improve treatment response and prognosis evaluation, potentially allowing the personalization of cancer treatment plans.


Patients with brain metastases underwent 11C-MET PET/CT scan and radiotherapy treatment, including the Leksell Gamma Knife (Elekta, Stockholm, Sweden), were considered in this retrospective analysis. Leksell Gamma Knife is a stereotactic radio surgical device able to treat brain metastases that are inaccessible for a conventional surgery allowing accurate irradiation to target through a metal helmet.

Functional and anatomical imaging modalities provide complementary data that can be integrated to provide a better diagnosis and to improve the effectiveness evaluation of oncological treatments. For this reason, the PET is always combined with CT or MRI to provide co-registered functional and anatomical images. Anatomical imaging also provides crucial data for attenuation correction of PET images. Metastasis segmentation in PET images was performed off-line without actually influencing the treatment protocol or patient management. No sensitive patient data were accessed. As such, after all patients were properly informed and released their written consent, the institutional hospital medical ethics review board approved the present study protocol.

Image acquisition

Although the 18F-FDG is the most commonly used radiotracer in PET studies, its specificity and sensitivity are notably reduced in the brain region. As a matter of fact, 18F-FDG is a glucose metabolism tracer whose distribution involves cells according to the glucose transport mechanism and, consequently, it is not limited to malignant tissue, i.e. 18F-FDG PET can be limited by unspecific uptake in inflammatory benign lesions [40]. In [41], 18F-FDG shows limited clinical value when comparing brain tumour volume defined by metabolic imaging with the corresponding volume defined by PET/MRI images due to low contrast between tumour and healthy tissue in 18F-FDG PET images. Vice versa, 18F-FDG PET may be useful in distinguishing common enhancing malignant brain tumours, particularly high grade and low-grade gliomas and lymphoma [42,43,44]. Nevertheless, a high 18F-FDG uptake in surrounding healthy tissue limits its use for the imaging of a large fraction of primary and recurrent tumours [45]. For example, glioblastoma shows glucose uptake higher than in anaplastic astrocytoma that, vice versa, shows hypo-metabolism. This difference could be explained by the presence of necrosis [46]. In conclusion, 18F-FDG PET often poses a challenge in the identification of treatment-induced necrosis, edema, inflammation, and pseudo-progression. For this reason, other PET radiotracers have been developed, i.e. 11C-MET that shows excellent sensitivity and specificity in the detection of brain metastases [21, 22, 35]. Thanks to the injected 11C-MET radiotracer, metastasis appears as a hyperintense region. Unfortunately, 11C-MET PET is not widespread in clinical practice due to very short half-life of 11C (around 20 min) requiring a short interval between synthesis, injection, and acquisition. Consequently, only the medical centres which have an onsite cyclotron can utilize 11C-MET radiotracer. Alternatively, [18F]fluoro-ethyl-l-tyrosine (18F-FET) significantly correlates with brain tumour cell density and proliferation [40] and it can be distributed to PET centres without a cyclotron unit on site (18F half-life = 110 min).

In our study, 11C-MET PET/CT imaging scans were performed at Cannizzaro Hospital in Catania (Italy) in compliance with the standard brain oncological protocol in use in this institution. Patients fasted for at least 4 h before the examination performed on Discovery 690 scanner (General Electric Medical Systems, Milwaukee, WI, USA), and successively were intravenously injected with MET. The PET/CT oncological protocol started 10 min after the injection. The PET protocol included a SCOUT scan at 40 mA, a CT scan at 140 keV and 150 mA (10 s), and 3D PET scans (6 min per bed position). ‘Ordered Subset Expectation Maximization’ with two-iterative process was used as a 3D reconstruction algorithm. Images were reconstructed to a 256 × 256 matrix with a grid spacing of 1.17 mm3 and a thickness of 3.27 mm3. The CT scan performed contextually to the PET imaging was used for attenuation correction.

The fully automatic segmentation method

In the proposed method, PET images were pre-processed as previously described by our group [47]. Precisely, the body-weight SUV, the most widely used PET parameter, was used to convert PET images into SUV unit (g/ml) images. Successively, to obtain a fully automatic BTV segmentation system starting from the one proposed [27], our algorithm performs all segmentation steps automatically by individuating an optimal, operator-independent, initial ROI located around the tumour on an automatically selected PET slice. By taking advantage of the great sensitivity and specificity of 11C-MET radio-tracers in discriminating between healthy and tumour tissues, the system identifies the PET slice containing the maximum SUV (SUVmax) in the whole PET dataset avoiding any user intervention. Consequently, the SUVmax voxel is used as a target seed for a region growing segmentation [18] to automatically identify a ROI containing the lesion. It is worth noting that the region growing algorithm is used only to obtain a rough estimate of the lesion boundary. This initial operator-independent ROI is input to the next component of the system, an enhanced LAC segmentation algorithm [48], as extensively explained [27]. Despite the LAC method is able of locally widening or tightening around the lesion boundary, a stopping criterion has been implemented to prevent wrong segmentations when a free disease slice is reached. This because the LAC algorithm is driven by the image properties rather than by an inherent knowledge of whether the tumour is present. In other words, the LAC is automatically stopped when a free disease PET slice is reached [27]. In this way, the proposed system becomes fully automatic for the segmentation of brain metastases in 11C-MET PET images [29]. In the case of multiple brain metastases, each lesion is independently processed. A different local maximum (SUVmax-j, with j = 1:n) is identified for each lesion. By design, the first BTV contains global SUVmax. The delineation iterative procedure ends when the SUVmax of the currently processed lesion is less than 2 g/ml. However, the user will receive a warning message in case of multiple lesions and will be able to stop the process to avoid false-positive occurrences (healthy tissues with SUVmax > 2 g/ml).

Radiomics features extraction

After automatic BTV delineations, 11C-MET PET studies and related structures containing volumetric segmentation were imported in the open-source CGITA toolbox [30] to extract radiomics features from each lesion and to investigate the potential application of radiomics analysis in patients with brain metastases. The extracted radiomics features were grouped into first-order, second-order, and higher-order features. First-order features derive from the histogram of PET voxel intensities such as SUVmax and SUVmean, SUV normalized to lean body mass (SUL), total lesion proliferation (TLP), median, skewness, kurtosis, variance, entropy, etc. Second-order textural features provide information about the regional spatial arrangement of the voxels such as their homogeneity, and contrast simulating the human perception of tumours in PET images. Higher-order features provide information on local collinear voxels with the same grey level. Specifically, grey levels inside each volume were re-sampled in 64 quantization levels and 9 texture matrices in 3D with 26-voxel connectivity. Texture features were computed on grey level co-occurrence matrix (7 indices), voxel alignment matrix (11 indices), neighbourhood grey level difference matrix (5 indices), grey level size zone matrix (11 indices), normalized grey level co-occurrence matrix (6 indices), texture spectrum matrix (2 index), texture feature coding matrix (4 indices), texture feature coding co-occurrence matrix (8 indices), and neighbourhood grey level dependence matrix (5 indices) [30, 49]. A total of 108 imaging features were calculated for each metastasis, considering additional 49 SUV indices (see Table 3). For follow-up evaluation, we considered the feature variations (Δ) in sequential PET scans normalized to baseline examinations:

$$ \Delta \left(\%\right)=100\ \mathrm{x}\ \left(\mathrm{post}\hbox{-} \mathrm{treatment}\ \mathrm{feature}\ \mathrm{value}-\mathrm{baseline}\ \mathrm{feature}\ \mathrm{value}\right)/\mathrm{baseline}\ \mathrm{feature}\ \mathrm{value} $$
Table 3 Radiomics features extracted from each brain metastasis

Due to the redundancy, heterogeneity and uncertainty of the information represented by radiomics features, the use of these data efficiently and reliably is challenging [50]. For this reason, we used the correlation matrix and point-biserial correlation coefficient for feature reduction and selection, while DA [51] was used as a machine learning method for feature classification.

Briefly, the correlation matrix was used to identify the most relevant features able to discriminate between responder and non-responder patients. Matrix columns correspond to extracted features, rows correspond to observations. The first step was to identify, for each feature, the highly correlated features (correlation coefficient greater than 0.9). For each highly correlated feature, the point-biserial correlation coefficient was calculated between the feature and gold standard (responder vs non-responder patient). The point-biserial correlation coefficient is used in the case of dichotomous variables (in our case, the gold standard). Then, we selected the feature with a higher point-biserial correlation coefficient among the highly correlated features. The remaining features were deleted. This step was repeated for each feature of our dataset. The second step was to recalculate the point-biserial correlation coefficient for each feature identified in the first step and the gold standard. The features with a higher coefficient were selected (point-biserial correlation coefficient > 0.25) and area under the curve (AUC) and confidence interval of selected features were calculated. The above-mentioned correlation coefficient thresholds (0.9 and 0.25, respectively) were empirically determined to provide the best performance on the present dataset with the classifier results.

After the feature selection process, DA was used to identify the linear combination of selected features that characterize or separate two or more classes of objects. We trained DA using a random partition method to split data into training and validating sets. The grouping was made so that both the training and validation sets maintained the same responder and non-responder patient status percentage of the original dataset. In particular, k-fold cross-validation was used to partition the whole dataset in k parts of equal numerosity to validate the classification method. For each fold, k-1 of the data was used as a training set and the remaining of the data as a validation set. In other words, the whole dataset is splitting into k equal subsets, and the holdout method is repeated k times. Each time, one of the k subsets was used as the validation set, and the other k-1 subsets were used as a training set. Training vectors were labelled as responder or non-responder patients. Then the average error across all experiments was computed. In this way, overfitting and asymmetric sampling were avoided increasing the precision of final results. In this study, k = 5 has been empirically determined through the trial-and-error method (k range: 5–15, step size of 5).

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.



Area under the curve


Biological target volume


Chang-Gung image texture analysis


Computed tomography


Discriminant analysis






local active contour




Magnetic resonance imaging


Positron emission tomography


Receiver operating characteristic


regions of interest


Standardized uptake value normalized to lean body mass


Standardized uptake value


Total lesion proliferation


  1. 1.

    Zhang Z, Sejdić E. Radiological images and machine learning: trends, perspectives, and prospects. Comput Biol Med. 2019;108:354–70.

    PubMed  PubMed Central  Google Scholar 

  2. 2.

    Cuocolo R, Cipullo MB, Stanzione A, Ugga L, Romeo V, Radice L, et al. Machine learning applications in prostate cancer magnetic resonance imaging. Eur Radiol Exp. 2019;3:35.

    PubMed  PubMed Central  Google Scholar 

  3. 3.

    Gillies RJ, Kinahan PE, Hricak H. Radiomics: images are more than pictures, they are data. Radiology. 2016;278:563–77.

    PubMed  Google Scholar 

  4. 4.

    Sala E, Mema E, Himoto Y, Veeraraghavan H, Brenton JD, Snyder A, et al. Unravelling tumour heterogeneity using next-generation imaging: radiomics, radiogenomics, and habitat imaging. Clin Radiol. 2017;72:3–10.

    CAS  PubMed  Google Scholar 

  5. 5.

    Negrini S, Gorgoulis VG, Halazonetis TD. Genomic instability - an evolving hallmark of cancer. Nat Rev Mol Cell Biol. 2010;11:220–8.

    CAS  PubMed  Google Scholar 

  6. 6.

    Gerlinger M, Swanton C. How Darwinian models inform therapeutic failure initiated by clonal heterogeneity in cancer medicine. Br J Cancer. 2010;103:1139–43.

    CAS  PubMed  PubMed Central  Google Scholar 

  7. 7.

    Hatt M, Tixier F, Visvikis D, Cheze Le Rest C. Radiomics in PET/CT: more than meets the eye? J Nucl Med. 2017;58:365–6.

    PubMed  Google Scholar 

  8. 8.

    Chowdhury R, Ganeshan B, Irshad S, Lawler K, Eisenblätter M, Milewicz H, et al. The use of molecular imaging combined with genomic techniques to understand the heterogeneity in cancer metastasis. Br J Radiol. 2014;87:20140065.

    CAS  PubMed  PubMed Central  Google Scholar 

  9. 9.

    Kwee TC, Basu S, Cheng G, Alavi A. FDG PET/CT in carcinoma of unknown primary. Eur J Nucl Med Mol Imaging. 2010;37:635–44.

    PubMed  Google Scholar 

  10. 10.

    Cook GJR, Azad G, Owczarczyk K, Siddique M, Goh V. Challenges and promises of PET Radiomics. Int J Radiat Oncol Biol Phys. 2018;102:1083–9.

    PubMed  PubMed Central  Google Scholar 

  11. 11.

    Comelli A, Stefano A, Benfante V, Russo G. Normal and abnormal tissue classification in positron emission tomography oncological studies. Pattern Recognit Image Anal. 2018;28:106–13.

    Google Scholar 

  12. 12.

    Vorwerk H, Beckmann G, Bremer M, Degen M, Dietl B, Fietkau R, et al. The delineation of target volumes for radiotherapy of lung cancer patients. Radiother Oncol. 2009;91:455–60.

    PubMed  Google Scholar 

  13. 13.

    Soret M, Bacharach SL, Buvat II. Partial-volume effect in PET tumor imaging. J Nucl Med. 2007;48:932–45.

    PubMed  Google Scholar 

  14. 14.

    Sun C, Tian X, Liu Z, Li W, Li P, Chen J, et al. Radiomic analysis for pretreatment prediction of response to neoadjuvant chemotherapy in locally advanced cervical cancer: a multicentre study. EBioMedicine. 2019;46:160–9.

    PubMed  PubMed Central  Google Scholar 

  15. 15.

    Foster B, Bagci U, Mansoor A, Xu Z, Mollura DJ. A review on segmentation of positron emission tomography images. Comput Biol Med. 2014;50:76–96.

    PubMed  Google Scholar 

  16. 16.

    Comelli A, Stefano A, Russo G, Bignardi S, Sabini MG, Petrucci G, et al. K-nearest neighbor driving active contours to delineate biological tumor volumes. Eng Appl Artif Intell. 2019;81:133–44.

    Google Scholar 

  17. 17.

    Berthon B, Spezi E, Galavis P, Shepherd T, Apte A, Hatt M, et al. Toward a standard for the evaluation of PET-auto-segmentation methods following the recommendations of AAPM task group no. 211: requirements and implementation. Med Phys. 2017;44:4098–111.

    CAS  PubMed  PubMed Central  Google Scholar 

  18. 18.

    Tan S, Li L, Choi W, Kang MK, D’Souza WD, Lu W. Adaptive region-growing with maximum curvature strategy for tumor segmentation in 18F-FDG PET. Phys Med Biol. 2017;62:5383–402.

    PubMed  PubMed Central  Google Scholar 

  19. 19.

    Hatt M, Laurent B, Ouahabi A, Fayad H, Tan S, Li L, et al. The first MICCAI challenge on PET tumor segmentation. Med Image Anal. 2018;44:177–95.

    PubMed  Google Scholar 

  20. 20.

    Stefano A, Vitabile S, Russo G, Ippolito M, Marletta F, D’Arrigo C, et al. An automatic method for metabolic evaluation of gamma knife treatments. In: Murino V, Puppo E, editors. Image Analysis and Processing — ICIAP 2015. Lecture Notes in Computer Science. 2015. Vol. 9279. p. 579–589. https://doi.org/10.1007/978-3-319-23231-7_52.

  21. 21.

    Grosu AL, Weber WA, Riedel E, Jeremic B, Nieder C, Franz M, et al. L-(methyl-11C) methionine positron emission tomography for target delineation in resected high-grade gliomas before radiotherapy. Int J Radiat Oncol Biol Phys. 2005;63:64–74.

    CAS  PubMed  Google Scholar 

  22. 22.

    Nariai T, Tanaka Y, Wakimoto H, Aoyagi M, Tamaki M, Ishiwata K, et al. Usefulness of l -[methyl- 11 C] methionine—positron emission tomography as a biological monitoring tool in the treatment of glioma. J Neurosurg. 2005;103:498–507.

    PubMed  Google Scholar 

  23. 23.

    Levivier M, Wikler D, Massager N, David P, Devriendt D, Lorenzoni J, et al. The integration of metabolic imaging in stereotactic procedures including radiosurgery: a review. J Neurosurg. 2002;97(5 Suppl):542–50.

    PubMed  Google Scholar 

  24. 24.

    Grosu AL, Weber WA, Franz M, Stärk S, Piert M, Thamm R, et al. Reirradiation of recurrent high-grade gliomas using amino acid PET (SPECT)/CT/MRI image fusion to determine gross tumor volume for stereotactic fractionated radiotherapy. Int J Radiat Oncol Biol Phys. 2005;63:511–9.

    CAS  PubMed  Google Scholar 

  25. 25.

    Hotta M, Minamimoto R, Miwa K. 11C-methionine-PET for differentiating recurrent brain tumor from radiation necrosis: radiomics approach with random forest classifier. Sci Rep. 2019;9:1–7.

    Google Scholar 

  26. 26.

    Wang K, Qiao Z, Zhao X, Li X, Wang X, Wu T, et al. Individualized discrimination of tumor recurrence from radiation necrosis in glioma patients using an integrated radiomics-based model. Eur J Nucl Med Mol Imaging. 2019;18. https://doi.org/10.1007/s00259-019-04604-0.

  27. 27.

    Comelli A, Stefano A, Russo G, Sabini MG, Ippolito M, Bignardi S, et al. A smart and operator independent system to delineate tumours in positron emission tomography scans. Comput Biol Med. 2018;102:1–15.

    PubMed  Google Scholar 

  28. 28.

    Comelli A, Stefano A, Bignardi S, Coronnello C, Russo G, Sabini MG, et al. Tissue classification to support local active delineation of brain tumors. Med Image Underst Anal. 2020;4:3–14. https://doi.org/10.1007/978-3-030-39343-4.

    Article  Google Scholar 

  29. 29.

    Comelli A, Stefano A. A fully automated segmentation system of positron emission tomography studies. Med Image Underst Anal. 2020:353–63. https://doi.org/10.1007/978-3-030-39343-4_30.

  30. 30.

    Fang YHD, Lin CY, Shih MJ, Wang HM, Ho TY, Liao CT, et al. Development and evaluation of an open-source software package “cGITA” for quantifying tumor heterogeneity with molecular images. Biomed Res Int. 2014;2014:248505.

    PubMed  PubMed Central  Google Scholar 

  31. 31.

    Loh HH, Leu JG, Luo RC. The analysis of natural textures using run length features. IEEE Trans Ind Electron. 1988;35:323–8.

    Google Scholar 

  32. 32.

    Tamura H, Mori S, Yamawaki T. Textural features corresponding to visual perception. IEEE Trans Syst Man Cybern. 1978;8:460–73.

    Google Scholar 

  33. 33.

    Haralick RM, Dinstein I, Shanmugam K. Textural features for image classification. IEEE Trans Syst Man Cybern. 1973;SMC-3:610–21.

    Google Scholar 

  34. 34.

    Blackledge MD, Collins DJ, Koh DM, Leach MO. Rapid development of image analysis research tools: bridging the gap between researcher and clinician with pyOsiriX. Comput Biol Med. 2016;69:203–12.

    PubMed  PubMed Central  Google Scholar 

  35. 35.

    Palanichamy K, Chakravarti A. Diagnostic and prognostic significance of methionine uptake and methionine positron emission tomography imaging in gliomas. Front Oncol. 2017;7:257.

    PubMed  PubMed Central  Google Scholar 

  36. 36.

    Cao MD, Giskeødegård GF, Bathen TF, Sitter B, Bofin A, Lønning PE, et al. Prognostic value of metabolic response in breast cancer patients receiving neoadjuvant chemotherapy. BMC Cancer. 2012;12:39.

    CAS  PubMed  PubMed Central  Google Scholar 

  37. 37.

    Wahl RL, Jacene H, Kasamon Y, Lodge MA. From RECIST to PERCIST: evolving considerations for PET response criteria in solid tumors. J Nucl Med. 2009;50(Suppl 1):122S–50S.

    CAS  PubMed  PubMed Central  Google Scholar 

  38. 38.

    Cegla P, Kazmierska J, Gwozdz S, Czepczynski R, Malicki J, Cholewinski W. Assessment of biological parameters in head and neck cancer based on in vivo distribution of 18F-FDG-FLT-FMISO-PET/CT images. Tumori. 2019;106:33–8.

    PubMed  Google Scholar 

  39. 39.

    Banna GL, Anile G, Russo G, Vigneri P, Castaing M, Nicolosi M, et al. Predictive and prognostic value of early disease progression by PET evaluation in advanced non-small cell lung Cancer. Oncology. 2016;92:39–47.

    PubMed  Google Scholar 

  40. 40.

    Dunet V, Pomoni A, Hottinger A, Nicod-Lalonde M, Prior JO. Performance of 18F-FET versus 18F-FDG-PET for the diagnosis and grading of brain tumors: systematic review and meta-analysis. Neuro-Oncology. 2016;18:426–34.

    CAS  PubMed  Google Scholar 

  41. 41.

    Gross MW, Weber WA, Feldmann HJ, Bartenstein P, Schwaiger M, Molls M. The value of F-18-fluorodeoxyglucose pet for the 3-D radiation treatment planning of malignant gliomas. Int J Radiat Oncol Biol Phys. 1998;41:989–95.

    CAS  PubMed  Google Scholar 

  42. 42.

    Spence AM, Muzi M, Graham MM, O’Sullivan F, Link JM, Lewellen TK, et al. 2-[18F]fluoro-2-deoxyglucose and glucose uptake in malignant gliomas before and after radiotherapy: correlation with outcome. Clin Cancer Res. 2002;8:971–9.

    PubMed  Google Scholar 

  43. 43.

    De Witte O, Lefranc F, Levivier M, Salmon I, Brotchi J, Goldman S. FDG-PET as a prognostic factor in high-grade astrocytoma. J Neuro-Oncol. 2000;49:157–63.

    Google Scholar 

  44. 44.

    Das K, Mittal BR, Vasistha RK, Singh P, Mathuriya SN. Role of 18 F-fluorodeoxyglucose positron emission tomography scan in differentiating enhancing brain tumors. Indian J Nucl Med. 2011;26:171–6.

    PubMed  PubMed Central  Google Scholar 

  45. 45.

    Demetriades AK, Almeida AC, Bhangoo RS, Barrington SF, et al. Surgeon. 2014;12:148–57.

    PubMed  Google Scholar 

  46. 46.

    Barker FG, Chang SM, Valk PE, Pounds TR, Prados MD. 18-Fluorodeoxyglucose uptake and survival of patients with suspected recurrent malignant glioma. Cancer. 1997;79:115–26.

    CAS  PubMed  Google Scholar 

  47. 47.

    Comelli A, Bignardi S, Stefano A, Russo G, Sabini MG, Ippolito M, et al. Development of a new fully three-dimensional methodology for tumours delineation in functional images. Comput Biol Med. 2020;120:103701. https://doi.org/10.1016/j.compbiomed.2020.103701.

    CAS  Article  PubMed  Google Scholar 

  48. 48.

    Lankton S, Nain D, Yezzi A, Tannenbaum A. Hybrid geodesic region-based curve evolutions for image segmentation. In: Hsieh J, Flynn MJ, Editors. Med. Imaging 2007 Phys. Med. Imaging, International Society for Optics and Photonics. 2007. 65104U. https://doi.org/10.1117/12.709700.

  49. 49.

    De Bernardi E, Buda A, Guerra L, Vicini D, Elisei F, Landoni C, et al. Radiomics of the primary tumour as a tool to improve 18F-FDG-PET sensitivity in detecting nodal metastases in endometrial cancer. EJNMMI Res. 2018;8:86.

    PubMed  PubMed Central  Google Scholar 

  50. 50.

    Karaca Y, Moonis M, Zhang YD. Multifractal Analysis with L2 Norm Denoising Technique: Modelling of MS Subgroups Classification. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 2019;257–69.

  51. 51.

    Comelli A, Stefano A, Bignardi S, Russo G, Sabini MG, Ippolito M, et al. Active contour algorithm with discriminant analysis for delineating tumors in positron emission tomography. Artif Intell Med. 2019;94:67–78.

    PubMed  Google Scholar 

Download references


Authors would like to thank Prof. Antonio Leal Plaza for their crucial support in the management of the proposed study.

About this supplement

This article has been published as part of Volume 21, Supplement 82,020: Italian Society of Bioinformatics (BITS): Annual Meeting 2019. The full contents of the supplement are available at https://bmcbioinformatics.biomedcentral.com/articles/supplements/volume-21-supplement-8.


The entire study and publication costs are funded by Italian Ministry of Economic Development Grant No. F/090012/01–02/X36.

Author information




Conceptualization: AS, GR. Data curation: AS, AC, GS, MGS, MI. Formal analysis: AS, AC, ID. Investigation: AS, AC. Methodology: AS, AC, SB. Software: AS, AC. Supervision: VB, GR. Writing ± original draft: AS, AC. Writing ± review & editing: AS, AC, VB, GR. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Valentina Bravatà.

Ethics declarations

Ethics approval and consent to participate

Patients were properly informed and released their written consent. The institutional Cannizzaro Hospital (Catania, Italy) medical ethics review board approved the present study protocol.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Stefano, A., Comelli, A., Bravatà, V. et al. A preliminary PET radiomics study of brain metastases using a fully automatic segmentation method. BMC Bioinformatics 21, 325 (2020). https://doi.org/10.1186/s12859-020-03647-7

Download citation


  • Cancer
  • Active contour
  • Positron emission tomography
  • Biological target volume
  • Radiomics