Abstract
Purpose
Developed and validated a deep learning radiomics nomogram using multi-phase contrast-enhanced computed tomography (CECT) images to predict neoadjuvant chemotherapy (NAC) response in locally advanced gastric cancer (LAGC) patients.
Methods
This multi-center study retrospectively included 322 patients diagnosed with gastric cancer from January 2013 to June 2023 at two hospitals. Handcrafted radiomics technique and the EfficientNet V2 neural network were applied to arterial, portal venous, and delayed phase CT images to extract two-dimensional handcrafted and deep learning features. A nomogram model was built by integrating the handcrafted signature, the deep learning signature, with clinical features. Discriminative ability was assessed using the receiver operating characteristics (ROC) curve and the precision-recall (P-R) curve. Model fitting was evaluated using calibration curves, and clinical utility was assessed through decision curve analysis (DCA).
Results
The nomogram exhibited excellent performance. The area under the ROC curve (AUC) was 0.848 [95% confidence interval (CI), 0.793–0.893)], 0.802 (95% CI 0.688–0.889), and 0.751 (95% CI 0.652–0.833) for the training, internal validation, and external validation sets, respectively. The AUCs of the P-R curves were 0.838 (95% CI 0.756–0.895), 0.541 (95% CI 0.329–0.740), and 0.556 (95% CI 0.376–0.722) for the corresponding sets. The nomogram outperformed the clinical model and handcrafted signature across all sets (all P < 0.05). The nomogram model demonstrated good calibration and provided greater net benefit within the relevant threshold range compared to other models.
Conclusion
This study created a deep learning nomogram using CECT images and clinical data to predict NAC response in LAGC patients undergoing surgical resection, offering personalized treatment insights.
Graphical abstract
![](http://media.springernature.com/lw685/springer-static/image/art%3A10.1007%2Fs00261-024-04331-7/MediaObjects/261_2024_4331_Figa_HTML.png)
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.Avoid common mistakes on your manuscript.
Introduction
Gastric cancer ranks as the fifth most prevalent malignant neoplasm globally and stands as the third most common cause of cancer-related mortality worldwide [1]. Approximately 50% of all gastric cancer cases occur in China [2]. Although surgery serves as the cornerstone of treatment for locally advanced gastric cancer (LAGC), the 5-year survival rate persists at a modest 20–30% [3, 4]. Neoadjuvant chemotherapy (NAC) has become a crucial additional treatment modality for LAGC, aiming to increase the R0 resection rate and improve prognosis by shrinking tumors. Patients with LAGC, stage T2 or above, are recommended to have NAC [5]. However, studies indicate significant individual variability in the response of LAGC patients to NAC, with some developing resistance [6]. For such patients, NAC not only fails to provide additional survival benefits but also introduces unnecessary toxicity and may increase the risk of disease progression [7]. The efficacy of NAC in patients with LAGC can be assessed through methods such as tumor regression grade (TRG) or the Mandard scoring system, which evaluate postoperative tissue [8]. The aforementioned methods evaluate patients’ response to NAC based on the extent of residual tumor in postoperative tissue specimens, providing clinicians with crucial information regarding patients’ treatment response and guiding further treatment strategies. Previous studies have found that for TRG 0 or 1 patients without adverse prognostic factors, the option of no postoperative chemotherapy may be considered, whereas for patients with TRG 2 or 3, postoperative chemotherapy may be necessary [9, 10]. However, these methods rely on pathologic results obtained after tumor surgical resection, making them challenging to apply for predictions before NAC. Currently, tumor staging (Tumor Node Metastasis, TNM) and histological subtype are commonly used for risk stratification and treatment decisions [11]. However, even in patients with similar staging and receiving similar NAC, significant differences in prognosis persist, suggesting that the clinical and pathological risk factors currently employed may not accurately predict the individual patient prognosis after NAC [12]. Therefore, there is an urgent need in clinical practice for biomarkers capable of predicting the response to NAC, providing better guidance for treatment decisions.
Computed Tomography (CT) is presently the predominant imaging modality utilized in clinical settings for the diagnosis, staging, and post-treatment surveillance of gastric cancer. However, conventional CT examinations, based on visual observation, have limited predictive value for NAC prognosis [13]. Radiomics is a data computation and analysis method, based on medical imaging, aiming to uncover features not visible to the naked eye by extracting numerous quantitative features, providing a comprehensive description of tumor heterogeneity [14]. A previous study has shown that image analysis techniques, based on CT radiomics, can offer morphological features, texture, and other characteristics of tumors in CT images, thereby assisting clinicians in predicting the response of gastric cancer patients to NAC [15].
However, radiomics requires manual extraction and selection of features, which may be subject to subjective influences leading to perceived biases. In contrast, deep learning technology, which has been widely utilized across various disciplines, has demonstrated significant advantages [16]. Deep learning models can automatically identify features and representations from raw data through an end-to-end learning process, reducing the need for manual feature extraction. Previous researchers have successfully applied this technology to predict lymph node metastasis, peritoneal metastasis, molecular subtypes, and prognosis of gastric cancer, achieving satisfactory results with good generalization in validation sets [17,18,19]. Deep learning models exhibit excellent generalization, with features and patterns learned from one dataset potentially adapting well to other datasets. A previous study has shown that the integration of deep learning and handcrafted radiomics features into a nomogram can accurately predict the response of locally advanced cervical cancer patients to NAC, whose performance is significantly superior to that of the clinical model and handcrafted radiomics features [20]. Additionally, some researchers have combined deep learning and handcrafted radiomics for predicting the response of breast cancer to NAC, with its efficacy surpassing that of the clinical model [21]. This study aimed to utilize multi-phase enhanced CT images and leverage both traditional radiomics and deep learning techniques to develop a radiomics clinical features model for prediction of NAC effectiveness. Moreover, this study endeavored to investigate the supplementary value of the model in predicting patients’ progression-free survival (PFS).
Materials and methods
Patient and inclusion criteria
The subjects of this study were 414 patients diagnosed with LAGC at two Chinese hospitals. Both institutions had identical inclusion and exclusion criteria. Inclusion criteria included: (a) gastric adenocarcinoma confirmed through histopathological examination; (b) LAGC diagnosis based on preoperative CT scans or laparoscopic examination according to the American Joint Committee on Cancer (AJCC) TNM staging manual (8th edition), defined as cT2 ~ 4/N0 ~ N3/M0; (c) undergoing gastrectomy and lymph node dissection after NAC, with confirmation of TRG on postoperative pathological examination; (d) having undergone multi-phase contrast-enhanced CT scans before treatment. Exclusion criteria included: (a) inability to identify the primary tumor on CT or bad CT image quality (e.g., severe artifacts) preventing accurate measurements; (b) concurrent presence of other malignancies; (c) receiving anticancer treatment before baseline CT scanning; (d) incomplete clinical or pathologic data. Ethical approval was secured from the Ethics Review Committees of both participating medical centers. Given the retrospective nature of the study, informed consent was waived.
This study divided patients into three sets: (1) Training set and internal validation set: A total of 284 LAGC patients who sought medical attention at the Fourth Hospital of Hebei Medical University from January 2013 to June 2023 were initially considered. Following the inclusion/exclusion criteria mentioned above, 225 patients were ultimately included. They were randomly assigned in a 7:3 ratio, resulting in a training cohort (n = 157) and an internal validation cohort (n = 68). (2) External validation set: A group of 130 patients with LAGC treated at the First Hospital of Qinhuangdao from December 2014 to June 2023 was identified. After applying the same inclusion/exclusion criteria, 97 patients with advanced gastric cancer were ultimately included. For details of patient inclusion and exclusion, refer to Fig. 1.
Baseline characteristics
Baseline clinical features, including age, gender, body mass index (BMI), tumor differentiation, carcinoembryonic antigen (CEA), carbohydrate antigen 19–9 (CA 19–9), as well as clinical T (cT) and clinical N (cN) staging according to the 8th edition of the AJCC TNM staging system, were extracted from medical records.
NAC strategy
All enrolled patients underwent 2–4 cycles of neoadjuvant chemotherapy (specifically the SOX regimen: oxaliplatin 130 mg/m2 of body surface area administered intravenously on day 1; S-1 administered orally on days 1–14: for individuals with a body surface area less than 1.25m2, 40 mg twice daily; for those with a body surface area between 1.25 and 1.5m2, 50 mg twice daily; for those with a body surface area greater than 1.5m2, 60 mg twice daily) with treatment cycles repeated every 3 weeks. NAC was administered to all patients before surgery, and dose or cycle adjustments were made based on treatment efficacy and patient tolerance. Preoperative treatment efficacy is assessed based on improvement in patient symptoms, normalization or continuous decrease in tumor markers, and reduction in the size of the primary tumor and suspected metastatic lymph nodes observed in CT or magnetic resonance imaging (MRI). All patients received at least two cycles of the SOX regimen, and there were no cases of premature termination of the intended NAC regimen or alterations in the treatment agents. Gastric resection surgery was performed within 2 weeks of completion of NAC.
NAC response assessment
The assessment of NAC response was conducted collaboratively by two pathology experts with more than 10 years of experience in diagnosing gastrointestinal tumors. Both were blinded to the imaging and clinical data of the patients. The TRG was categorized into four levels based on the most recent National Comprehensive Cancer Network (NCCN) guidelines (2021, version 4, guideline 26), evaluating the extent of tumor regression after preoperative neoadjuvant treatment for gastric cancer: TRG 0: No viable cancer cells (complete response); TRG 1: Residual cancer cells in single or small clusters (moderate response); TRG 2: Residual cancer with fibrosis in the stroma (mild response); TRG 3: Minimal or no tumor regression, with a significant amount of residual cancer cells (poor response). TRG 0 and TRG 1 were combined into the good response (GR) group, while TRG 2 and TRG 3 were categorized as the poor response (PR) group.
CT examination
After an overnight fast, patients ingested a small amount of warm water and swallowed a gas-producing powder before the examination, followed by immediate CT scanning. The CT scans covered the entire gastric region and axial images were acquired during breath-holding. Contrast-enhanced CT scans in the arterial phase, portal venous phase, and delayed phase were obtained 30, 60, and 180 s, respectively, after injection of contrast agent. The CT image acquisition parameters for Centers A and B are detailed in Supplementary Table S1.
Image standardization and segmentation
Image standardization in this study involved two steps to reduce data variability between centers. Firstly, all CT images were resampled using cubic spline interpolation to a pixel size of 1 × 1 mm. Secondly, pixel intensities were normalized, transforming the intensity range to − 1024 HU to 1024 HU, and applying a consistent abdominal window with a window level of 50 and a window width of 350.
A radiologist (Radiologist A) with 5 years of experience in diagnosing digestive system tumors manually delineated regions of interest (ROIs) on the three-phase contrast-enhanced images. The segmentation encompassed tumor parenchyma, necrosis, hemorrhage, and cystic areas, resulting in multiple ROIs containing tumor regions for each patient. For each patient, segmentation was performed on arterial, portal venous, and delayed phase images, encompassing all slices standardized to 1 mm thickness containing CT findings of interest. To assess inter-observer consistency, 30 randomly selected patients underwent a re-segmentation process one month after the initial ROI delineation. This time, both Radiologist A and another radiologist (Radiologist B) with 10 years of experience in diagnosing digestive system tumor diagnosis performed the segmentation using the same method. Inter-group correlation coefficients and intra-group correlation coefficients were calculated for feature extraction. The process of image segmentation is illustrated in Supplementary Fig. S1.
Manual feature extraction
Manual feature extraction was conducted using the PyRadiomics software package, a Python-based tool. The extracted features comprised 8 first-order statistical features, 18 shape features, 75 s-order statistical features, and 1488 transformation features. Detailed definitions of these features are available at http://PyRadiomics.readthedocs.io/en/latest/. Transformations were applied, including wavelet, Laplacian of Gaussian (LoG) filter, square, square root, logarithm, exponential, gradient, and 2D local binary pattern (LBP2D). Image features were extracted at various spatial scales by adjusting the parameter sigma values of the LoG filter to 3.0 and 5.0. In total, 1589 manual features were extracted from each 2D image. The process of feature extraction is depicted in Supplementary Fig. S1.
Deep learning feature extraction
For all patients, we included all 2D images containing tumor tissue and their corresponding regions of interest (ROIs) as inputs. Subsequently, the image sizes were uniformly transformed to 224 × 224 pixels to match the input size of the model. This operation, allows for a more comprehensive utilization of medical images, contributing to the improvement of the model’s performance as opposed to selecting only the maximum tumor layer as input. Additionally, since effective training of deep learning models involves millions of learnable parameters for estimation, requiring a large amount of image data, and medical image datasets are often limited in size, this study employed transfer learning techniques to address the issue of insufficient image quantity. Specifically, this study employed the EfficientNet V2 architecture of a pre-trained deep learning model trained on the ImageNet dataset. The final fully connected layer was removed to create a feature extractor, and the resulting output values from the feature extractor were utilized as deep learning features. The images underwent three transformations based on the normalization parameters (z-score) of the red/green/blue channels to adapt them to the format suitable for the ImageNet dataset. Implementation of the EfficientNet V2 model was carried out using the Python timm package (https://github.com/huggingface/pytorch-image-models) in conjunction with the PyTorch library (https://www.pytorch.org/). A total of 1280 features were extracted for each 2D image.
During model training, a cross-entropy loss function was used, and optimization was performed using the Adam algorithm. A batch size of 64, an initial learning rate of 0.1, and a learning rate scheduler (ReduceLROnPlateau) dynamically adjusting the learning rate were employed for training over 100 epochs. The training process was implemented using PyTorch in an environment with an NVIDIA GTX 3090 GPU, Intel(R) Core(TM) CPU i7-12700F @ 2.10, and 64 GB of memory. The feature extraction process is illustrated in Supplementary Fig. S1.
Feature selection and signature building
To deal with the imbalance between PR and GR samples, we use the borderline synthetic minority over-sampling technique (Borderline-SMOTE) to oversample the training set, ensuring an equal number of GR and PR samples. Then, the handcrafted and deep learning features from the arterial, portal venous, and delayed phases were combined for feature selection and signature building. Firstly, the z-score method was applied to normalize the handcrafted and deep learning features.
The feature selection in this study comprised five steps. Firstly, the ICC value was calculated for both intra-observer and inter-observer reliability. Features with ICC values > 0.75 were considered to have good repeatability and were selected for further filtering. Subsequently, the Spearman correlation coefficient method was used to select features, randomly removing one of two features if their correlation coefficient exceeded 0.9. Next, the variance threshold method was employed to further filter the remaining features. The basic idea was to eliminate features with low variance, as these features exhibit minimal changes in the data and may contribute less information to modeling or classification tasks. In this study, a variance threshold of 0.8 was set; as commonly employed in previous studies [22]. Following that, the ReliefF algorithm, which calculates importance scores by considering the distribution of instance weights based on nearest neighbors, was applied for feature selection. With n_neighbors set to 10 in this study, the ReliefF algorithm selected 10 nearest neighbors of the same class and 10 nearest neighbors of a different class for each sample to estimate the importance scores of features. Finally, the Least Absolute Shrinkage and Selection Operator (LASSO) algorithm was employed. Through ten-fold cross-validation, the penalty parameter was optimized to select the most useful predictive features with non-zero coefficients. The feature selection process is illustrated in Supplementary Fig. S1.
For each gastric cancer patient, as there could be multiple layers of CT images and different layers might yield different predictive results, a voting method was used to determine the final classification. By combining the finally selected features and multiplying them by their normalized coefficients, a multivariate logistic regression model was used to calculate the feature identifiers predicting GR. The final outcome comprised two feature signature; handcrafted feature and deep learning feature signature.
Establishment of the deep learning radiomics nomogram
In the training set, univariate analysis was conducted to select clinical-pathologic variables with statistical significance (P < 0.05). Subsequently, multivariate logistic regression was performed to integrate the three-phase handcrafted, the deep learning signatures, and significant clinical-pathologic factors, constructing a fused nomogram model. This model was compared with clinical models, handcrafted, and deep learning signatures.
Receiver operating characteristic (ROC) curve analysis was applied to measure the discriminative performance of each model. The Delong test was used to compare the discriminative abilities of different models. Calibration curve analysis and the Hosmer–Lemeshow test were employed to evaluate the goodness-of-fit of the models. Net Reclassification Improvement (NRI) and Integrated Discrimination Improvement (IDI) were calculated to compare the performance differences between the fused model and the clinical model. Decision Curve Analysis (DCA) assessed the clinical utility of the models. Kaplan–Meier curves were used to evaluate the association between the radiomics nomogram score and PFS.
PFS
Patients in the follow-up set (n = 147) underwent follow-up every 3–6 months in the first 2 years’ post-surgery, followed by annual follow-ups. The follow-up duration extended from the time of surgery until March 2023, collecting information on PFS up to the last follow-up. PFS was defined as the duration from the commencement of tumor NAC to the onset of any type of tumor progression or mortality from any cause. All occurrences of disease progression, encompassing both local recurrence and distant metastasis, were evaluated through clinical examination and imaging modalities such as CT, magnetic resonance imaging, or positron emission tomography-computed tomography scans.
Statistical analysis
Differences in clinical characteristics among various groups or cohorts were compared using independent t-tests or Mann–Whitney U tests for continuous variables. For categorical variables, Fisher’s exact test or the chi-square test was employed as appropriate. The Akaike Information Criterion (AIC) was served as the stopping criterion for the backward stepwise process aimed at determining the optimal feature combination. Kaplan–Meier survival analysis and log-rank tests were employed to assess the probability of PFS. The optimal cutoff values were determined using X-tile software, and patients were stratified into high-risk and low-risk groups. Univariate and multivariate analyses utilizing Cox proportional hazards regression, with backward stepwise elimination and AIC, were conducted to construct the PFS prediction model. All statistical analyses were carried out using R software (version 3.6.3, http://www.R-project.org). Two-sided P value less than 0.05 were considered statistically significant.
Results
Patient characteristics
The baseline characteristics of 322 patients with LAGC are presented in Table 1. The efficacy of NAC demonstrated a balanced performance across the three sets, with pathologic GR rates of 29.9, 29.4, and 29.9% in the training, internal validation, and external validation sets, respectively. Clinical and pathologic features, including age, gender, pre-NAC CEA, tumor location, and cN stage, showed no significant differences (P > 0.05). Significant differences were observed in BMI, tumor differentiation, pre-NAC carbohydrate CA19-9, and cT stage. Additionally, there was no significant difference in the time from CT examination to the initiation of NAC among the three sets (P = 0.051).
Handcrafted and deep learning signature construction
The mean and standard deviation of the number of ROIs obtained per individual patient were approximately 30.4 ± 14.9. The feature selection process in this study involved a total of 5 steps. Due to the extraction of 1589 handcrafted features and 1280 deep learning features from each of the arterial phase, venous phase, and delayed phase 2D images, a total of 4767 (1589 × 3) handcrafted features and 3840 (1280 × 3) deep learning features were extracted for the same layer. Of these, 2781 and 2196 features were found to have high reproducibility and stability (ICC > 0.75), respectively. After excluding features with strong correlations using the Spearman method, 2268 and 1755 features with weaker correlations were identified. Following the variance threshold method to remove features with low variance, 1370 and 1081 features were retained. The ReliefF method was then employed to include the 100 features most strongly correlated with the intercept variable for each set. Finally, LASSO regression analysis was applied, resulting in 9 and 3 features remaining to construct the handcrafted and deep learning signatures, respectively. The selected features for constructing the handcrafted and deep learning signatures are listed in Supplementary Table S2.
Performance of handcrafted and deep learning signature models
As shown in Supplementary Table S3, the AUCs of the handcrafted signature in the training, internal validation, and external validation sets were 0.715 (95% CI 0.650–0.773), 0.559 (95% CI 0.434–0.680), and 0.536 (95% CI 0.432–0.638), respectively. The AUCs of the deep learning signature in the training, internal validation, and external validation sets were 0.809 (95% CI 0.751–0.859), 0.786 (95% CI 0.670–0.877), and 0.731 (95% CI 0.632–0.816), respectively. The deep learning signature demonstrated significantly better performance than the handcrafted signature in the training and internal validation sets (with P values of 0.028 and 0.010, respectively) but showed no significant difference in the external validation set (P = 0.051, Fig. 2 and Supplementary Figure S2).
Performance of the four predictive models. A–C Receiver operating characteristic curves of three predictive models in A the training set, B the internal validation set and C the external validation set. D–F Precision-recall curves of the predictive models in D the training set, E the internal validation set and F the external validation set. AUC area under the curve, DL deep learning, PPV positive predictive value
Furthermore, due to the significant imbalance in the sample sizes between the good response and poor response groups, we also plotted P-R curves to assess the models’ discriminative performance. Compared to the handcrafted feature signature, the deep learning feature signature exhibited a larger area under the P-R curve, and the difference was statistically significant (Supplementary Table S4). The F1max values of the deep learning signature in the training, internal validation, and external validation sets were 0.755, 0.667, and 0.582, respectively (Supplementary Table S3 and Fig. 2).
Construction of the nomogram
In the training set, a stepwise backward multivariate analysis using the AIC criterion was performed, and both handcrafted features and cT stage independently emerged as predictors of PR, as detailed in Table S5 and Figure S3. These factors were integrated into the nomogram (Fig. 3A). The AIC of the nomogram model was 213.1, which was lower than the clinical model, handcrafted signature, and deep learning signature (with AICs of 303.7, 270.3, and 235.1, respectively).
Construction and performance of a combined nomogram model. A Nomogram composed of deep learning signature, handcrafted signature, and clinical T stage. For clinical T stage, a score of “0” in the nomogram represents clinical stage T2 or T3, while a score of “1” represents clinical stage T4a or T4b. B Waterfall plot illustrating the distribution of nomogram scores for individual cases based on neoadjuvant chemotherapy (NAC) efficacy. C–E Violin plots depicting the relationship between nomogram scores and NAC response in the training set (C), internal validation set (D) and external validation set (E). GR good response; PR: poor response
As depicted in Figs. 3C–E, the nomogram scores exhibited significant differences between the GR and PR groups in all datasets (all P < 0.001). Risk scores for all patients in the training, internal validation, and external validation sets were computed to visually demonstrate the predictive ability of the model (Fig. 3B). The nomogram model exhibited good performance in the training set and demonstrated robust generalization in the validation sets, with ROC AUCs approximately 0.848 (0.793–0.893), 0.802 (0.688–0.889), and 0.751 (0.652–0.833), and P-R AUCs approximately 0.838 (0.756–0.895), 0.541 (0.329–0.740), and 0.556 (0.376–0.722), respectively. Additionally, the AUCs of the nomogram were significantly higher than that of the clinical model and handcrafted signature in all sets (P < 0.05) (Table S3, Fig. 2 and Supplementary Fig. S2). The NRI and IDI analyses indicated that integrating image signatures into the combined nomogram model improved the predictive accuracy of the clinical model across all sets (Table S6). The nomogram demonstrated significantly better performance than the handcrafted signature in the training set (P < 0.001), but showed no significant difference in the internal and external validation sets (with P values of 0.440 and 0.490, respectively). Examples of using the nomogram to predict the NAC response were presented in Fig. 4.
Examples of predicting individual risk for neoadjuvant chemotherapy (NAC) using the nomogram proposed in this study involves three steps. Firstly, vertical lines are drawn for each patient’s variables, where the red, yellow, and blue lines represent handcrafted score, deep learning score, and clinical T stage, respectively. For clinical T stage, a score of “0” in the nomogram represents clinical stage T2 or T3, while a score of “1” represents clinical stage T4a or T4b. Next, the values intersecting each line with the “Points” scale are summed to obtain the total score, referred to as “Total Points”. Finally, a vertical green line is drawn on the “Total points” scale to read the “Risk” of NAC response. A The nomogram of a 74-year-old female patient with locally advanced gastric cancer (LAGC) in the gastric antrum. B–D The portal venous phase CT images at different slices of the female patient. The female patient’s clinical T stage is 2, with a handcrafted score of 0.812 and a deep learning score of 0.391. By summing the values intersecting the lines with the “Points” scale, the total score is calculated as 0 + 22 + 48 = 70. Drawing a vertical line on the “Total points” scale reveals an approximately 22% risk of poor NAC response for this patient. The patient’s pathological tumor regression grade (TGR) grading after NAC is grade 1. E The nomogram of an 52-year-old male patient with LAGC in the LAGC in the gastric body. F–H The portal venous phase CT images at different slices of the male patient. The patient’s clinical T stage is 4a, with a handcrafted score of 1.735 and a deep learning score of 1.651. By summing the values intersecting the lines with the “Points” scale, the total score is calculated as 12 + 30 + 69 = 111. Drawing a vertical line on the “Total points” scale reveals an approximately 89% risk of poor NAC response for this patient. The patient’s pathological tumor regression grade (TGR) after NAC is 3
The calibration curves of the nomogram demonstrated good fitting accuracy between the predicted and observed PR across all cohorts (P values for the training, internal validation, and external validation sets were 0.054, 0.430, and 0.441, respectively) (Fig. 5A). Additionally, DCA revealed that the nomogram provided greater net benefit across almost the entire threshold range from 0 to 1 compared to other models across the entire cohort (Fig. 5B). Our radiomics model exhibited higher net benefit almost throughout the entire threshold probability compared to the clinical and other models, enhancing the clinical utility of radiomics in providing recommendations for NAC to patients.
Predictive factors for PFS in LAGC
We further assessed the prognostic value of the nomogram for patients with LAGC. The median follow-up time and average follow-up durations were 27 and 27.6 months, respectively, with a range of 1 to 65 months. Schoenfeld’s individual test indicated that the Cox model met the proportional hazards assumption (P > 0.05). We determined the optimal nomogram score for predicting PFS as 0.1 and subsequently stratified patients into high-risk and low-risk groups using this threshold. The Kaplan–Meier curves demonstrated a significant association between higher nomogram scores and worse PFS (HR = 1.130; 95% CI = 1.016–1.257, P = 0.0017) (Fig. 6A). Table 2 presents the findings of univariate and multivariable Cox regression analyses for PFS prediction factors in the follow-up cohort, demonstrating that the nomogram score is an independent prognostic factor for PFS (HR = 1.235; 95% CI = 1.099–1.387, P < 0.001), along with pre-NAC full stomach tumor, T stage, and N stage (Fig. 6B). The Cox regression model demonstrated a C-index of 0.673 (95% CI = 0.545–0.802).
Discussion
This study developed and validated an innovative machine learning nomogram model that integrates traditional handcrafted radiomics and deep learning features to predict the response to NAC in patients with LAGC undergoing surgical resection. In comparison to clinical and traditional radiomics models, this model exhibited more accurate discriminative ability in the training, internal validation, and external validation sets. Therefore, it processes potential clinical utility in quantifying the risk of adverse individual responses to NAC.
Previous studies have indicated that NAC helps reduce tumor volume, enhances the success rate of surgery [23, 24]. However, a considerable proportion of patients may not derive significant benefits from NAC [25]. Accurately identifying patients who are expected to derive benefit from NAC may contribute to improving its effectiveness. Additionally, a previous study has shown that approximately one-third of LAGC patients may fail to undergo surgical resection after NAC due to poor treatment response or disease progression [26]. For such patients, early identification using a non-invasive approach prior to treatment may aid in selecting more appropriate treatment modalities, thereby improving their prognosis. However, the predictive capability of conventional contrast-enhanced CT examinations for NAC response is limited, making it challenging for clinicians to determine potential responses in patients with LAGC. Radiomics methods can extract a plethora of hidden features from medical images, providing information about tumor microenvironments such as cell density, hypoxia, and microvessel density, significantly expanding the scope of research in medical imaging [27]. Previous researchers have found that traditional handcrafted radiomics signatures can predict the prognosis and NAC response in LAGC patients [28]. A model built with radiomics using multiple machine learning algorithms have shown good discriminative ability in predicting the effectiveness of NAC in gastric cancer, with AUCs of 0.784 and 0.803 in two validation sets [29]. In the study of Zhou et al., handcrafted features were extracted from CT images of 323 gastric cancer patients, demonstrated the discriminative ability of radiomics signatures for NAC response in an external cohort, with an AUC of only 0.679 [15]. Furthermore, the standardization of radiomics features is likely one of the key challenges influencing its widespread application, as there is a lack of reproducibility of radiomics features across different imaging devices and radiomics software. Researchers are continuously striving to address this issue, with initiatives like the Image Biomarker Standardization Initiative (IBSI) proposed by Zwanenburg et al. and undergoing ongoing updates [30]. However, some researchers still argue that IBSI compliance does not guarantee consistency in feature values [31]. In the present study, the performance of the handcrafted signature was poorer, with ROC AUCs of 0.559 and 0.536 for the two validation sets. The reason for this may be that manual feature design and extraction are typically based on prior knowledge and experience. This approach may sometimes fail to adequately capture complex patterns and information in the data, resulting in poor model performance.
To enhance the effectiveness of the handcrafted signature and address its inadequate generalization capability, the emphasis of this study was on examining the contribution of deep learning features. In our research, the deep learning signature showed promising performance, with an ROC AUC exceeding 0.73. This performance is comparable to deep learning features previously employed to predict treatment response in esophageal squamous cell carcinoma [32]. In comparison with conventional radiomics and clinical models, the deep learning signature demonstrated greater predictive efficacy and better generalization. The ROC and PR curve AUCs were significantly higher. Currently, deep learning has transformed the landscape of medical imaging applications. Previous researchers have successfully utilized deep learning techniques to predict lymph node metastasis, depth of infiltration, and survival outcomes in gastric cancer patients, achieving notable results [18, 33]. In the context of predicting response to NAC, researchers previously employed deep learning features extracted from a ResNet-50 network and observed AUC values ranging from 0.752 to 0.808 in the validation sets [34], which aligns closely with the findings of this study. However, that study only extracted features from portal venous phase images, potentially overlooking crucial information present in arterial and delayed phase images. Some researchers have noted a close association between DL features extracted from arterial phase images and the heterogeneity of gastric cancer [19]. Another study utilizing features extracted from a Densenet-121 network accurately predicted NAC response in gastric cancer, achieving AUC values ranging between 0.720 and 0.806 [35]. However, this study only included the maximum tumor layer for each patient, potentially limiting the number of included images. In contrast, our study included all images containing tumors and their corresponding ROCs, greatly enriching the sample size and potentially yielding more accurate predictions. All these findings indicate that deep learning provides rich information reflecting tumor spatial heterogeneity and the relationship between the tumor microenvironment and chemotherapy sensitivity.
In our study, we employed the recently introduced, lightweight deep learning network known as EfficientNet V2 [36]. EfficientNet V2 represents an upgraded version of the deep neural network model developed by Google, with the primary goal of further enhancing model efficiency and performance. In comparison to the original EfficientNet, EfficientNet V2 incorporates more efficient architectural designs and optimization strategies, achieving improved performance while maintaining a relatively smaller model size. It combines optimizations in model depth, width, and resolution to provide enhanced accuracy, particularly in scenarios with limited computational resources [37].
Previous studies have indicated that clinical-pathologic features, including age, tumor stage, and tumor differentiation, are associated with the response to NAC [38, 39]. However, these studies were often single-center, had relatively small sample sizes, and lacked external validation. Some researchers found that tumor T stage was a crucial predictive factor for NAC efficacy [34], similar to what was observed in our study. The rationale behind this may be that T staging reflected tumor burden and invasiveness, with larger or more invasive tumors achieving higher staging before treatment, implying greater resistance or difficulty in treatment. Additionally, higher T stage may indicate greater intratumoral heterogeneity, leading to inconsistent response to chemotherapy drugs [40, 41]. Intratumoral heterogeneity may be reflected, to some extent, by unique textures and spatial grayscale patterns extracted from pre-treatment CT images. However, these theoretical hypotheses have not been fully elucidated through radiogenomic and multiomic studies. Another multicenter study found no significant correlation between clinical-pathologic features and treatment response in LAGC patients [15]. Therefore, the relationship between treatment response in LAGC still requires large-scale studies for validation. Nonetheless, the AUCs of the clinical model exhibited significantly lower values compared to those of the nomogram model (P < 0.05). This finding indicates that deep learning models can reveal intricate imaging features and, when combined with clinical features, can more comprehensively quantify intratumoral heterogeneity. Furthermore, enhanced NRI and IDI further corroborated the effectiveness of combining image signatures with clinical features in predicting NAC response.
The proposed nomogram model based on traditional handcrafted, deep learning signatures, and clinical features, in this study can provide a quantitative assessment of patients’ NAC response. The incorporation of radiological signatures related to CT significantly bolstered the predictive capability when added to independent clinical predictive factors. Moreover, it outperformed a single deep learning signature. One possible explanation is that the nomogram model explores high-dimensional imaging features and subsequently quantifies intratumoral heterogeneity comprehensively. In this study, the nomogram incorporated imaging features that are not redundant but complementary. A previous study found that model based on traditional radiomics features could predict the response of LAGC to NAC, but their AUC was 0.77 in the validation set, slightly lower than the nomogram proposed in this study [42]. This might be due to the fact that the previous study did not incorporate a comprehensive analysis of deep learning and clinical features. However, the advantage of that research is that it validated the model’s efficacy in a prospective cohort, achieving favorable results (AUC: 0.72). Another novel study used radiomics nomograms based on MRI to predict the response of LAGC to NAC, with an AUC of about 0.820 in the internal validation set, which is close to this study, but it was a single-center study without external validation [43]. A recent study discovered that extracting deep learning features from the ResNet50 neural network and combining them with clinicopathological features could more accurately predict the response of LAGC to NAC, with AUCs of 0.755 and 0.752 in the internal and external validation sets, respectively. Its efficacy was slightly lower than the nomogram proposed in this study in the internal validation set, possibly because this model did not include manual features [34]. The user-friendly nomogram in this study can be utilized by both clinicians and patients which aligns with the trend of personalized medicine. Additionally, the lowest AIC, along with the enhanced NRI and IDI, also indicate that the improved discriminative capability of the nomogram is attributed to integration rather than overfitting. To evaluate the clinical utility of the nomogram, DCA was conducted. Within a certain threshold range, predicting NAC status using the nomogram provided a net benefit for patients with higher scores. For these patients, alternative treatment strategies with lower toxicity or better tolerance, or close monitoring, can be considered. It is anticipated that the nomogram may ultimately be combined with established clinical-pathologic standards and molecular biomarkers to refine risk stratification and guide personalized management of gastric cancer.
In addition, we investigated the efficacy of the nomogram model for predicting the PFS of patients with LAGC. Our analysis revealed that the nomogram model score independently served as a risk factor for PFS in patients with LAGC following NAC. Patients with lower scores demonstrated better PFS, specifically, those achieving pathologic GR after NAC experienced a significant extension in survival. For gastric cancer, factors influencing the risk of recurrence include a combination of various aspects such as the pre-treatment clinical and pathological characteristics of the tumor, molecular biological features of the tumor, and even the patient’s lifestyle habits [44, 45]. A comprehensive assessment by clinicians is required in clinical practice. For example, patients with larger tumors or higher TNM staging may have a higher risk of recurrence. For patients with lower scores, even those with a high risk of recurrence after surgery, adjuvant chemotherapy may be a suitable option. On the other hand, for patients with higher scores and a lower risk of recurrence, prompt consideration of alternative curative-intent treatment options is warranted to mitigate unnecessary toxicity and enhance survival outcomes. There is still controversy over whether curative resection should be performed after NAC treatment for T2-stage LAGC, or if it should be performed directly without NAC. Some researchers believe that NAC does not prolong recurrence-free and overall survival time after curative resection in T2-stage patients, thus they do not recommend NAC for these patients [46]. The present study may provide guidance on treatment options for such patients through nomogram scoring. In summary, the proposed nomogram in this study may provide a viable approach to facilitate treatment planning. Furthermore, our study identified several independent risk factors for the survival of patients with LAGC, including tumor location, cT staging, and cN staging which are consistent with previous studies [47, 48].
The present study possesses several limitations. Firstly, despite the extensive sample size drawn from multiple centers, inherent biases are unavoidable given the retrospective nature of the study. Patients from different hospitals with varying CT equipment may introduce biases. Therefore, well-designed large-scale studies are imperative to validate the generalizability and clinical applicability of our nomogram model, as prospective validation could further ascertain its predictive accuracy and utility in real-time clinical decision-making. Secondly, different regions or countries may employ NAC protocols and drugs different from those used in this study, which could impact the consistency and generalizability of the study results. Thirdly, tumor delineation was performed on 2D slices rather than the entire tumor in three dimensions, which may not fully represent the entire tumor, and some radiomics features might be influenced by the choice between 2 and 3D analysis. Further research is needed to analyze the entire tumor in three dimensions. In addition, manual segmentation of ROI and manual feature extraction may introduce subjectivity and operational differences, which could affect the accuracy and reproducibility of the results. The application of automated segmentation methods and end-to-end models may help address the aforementioned issues. Fourth, due to the lower pathological complete response rate after NAC in the Chinese population, there is a significant imbalance in the samples. Although oversampling was conducted to compensate for the shortage of positive samples, it led to changes in the data distribution. Fifth, the clear precise biologic significance of the tumor internal features from the deep learning remains unknown and requires comprehensive elucidation. Finally, both this study and several previous studies have only included LAGC patients with postoperative pathological results for evaluating the effectiveness of NAC. However, in clinical practice, some LAGC patients do not undergo surgical resection after NAC, and thus cannot be included in these studies. This may affect the generalizability of the model in the population, particularly for the aforementioned unresectable patients.
This study constructed a personalized prediction model for NAC response in patients with LAGC undergoing surgical resection, integrating deep learning techniques with multi-phase CT images and clinical features. This provided valuable information for clinical practice and processes significant potential for individualized treatment strategies.
References
BRAY F, FERLAY J, SOERJOMATARAM I, et al. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA: A Cancer Journal for Clinicians, 2018, 68(6): 394-424.
KOERNER A S, MOY R H, RYEOM S W, et al. The present and future of neoadjuvant and adjuvant therapy for locally advanced gastric cancer. Cancers, 2023, 15(16): 4114.
ZURLO I V, BASSO M, STRIPPOLI A, et al. Treatment of Locally Advanced Gastric Cancer (LAGC): Back to Lauren’s classification in pan-cancer analysis era? Cancers, 2020, 12(7): 1749.
TSAGKALIDIS V, BLASZCZYK M B, IN H. Interpretation of tumor response grade following preoperative therapy for gastric cancer: An overview. Cancers, 2023, 15(14): 3662.
WANG X Z, ZENG Z Y, YE X, et al. Interpretation of the development of neoadjuvant therapy for gastric cancer based on the vicissitudes of the NCCN guidelines. World Journal of Gastrointestinal Oncology, 2020, 12(1): 37-53.
LORENZEN S, BLANK S, LORDICK F, et al. Prediction of response and prognosis by a score including only pretherapeutic parameters in 410 neoadjuvant treated gastric cancer patients. Annals of Surgical Oncology, 2012, 19(7): 2119-27.
JIANG Y, LI T, LIANG X, et al. Association of adjuvant chemotherapy with survival in patients with stage II or III gastric cancer. JAMA Surgery, 2017, 152(7): e171087.
TONG Y, ZHU Y, ZHAO Y, et al. Evaluation and comparison of predictive value of tumor regression grades according to Mandard and Becker in locally advanced gastric adenocarcinoma. Cancer Research and Treatment, 2021, 53(1): 112-22.
MA F, ZHANG Y, PENG L, et al. Which is the optimal management for locally advanced gastric cancer patients with TRG 0 and 1 after R0 resection? Annals of Translational Medicine, 2020, 8(15): 948.
WANG Y, XU H, HU C, et al. Prognostic value and clinicopathological correlation of the tumor regression grade in neoadjuvant chemotherapy for gastric adenocarcinoma: A retrospective cohort study. Journal of Gastrointestinal Oncology, 2022, 13(3): 1046-57.
CHENG X, WU D, XU N, et al. Adjuvant albumin-bound paclitaxel combined with S-1 vs. oxaliplatin combined with capecitabine after D2 gastrectomy in patients with stage III gastric adenocarcinoma: a phase III multicenter, open-label, randomized controlled clinical trial protocol. BMC cancer, 2021, 21(1): 56.
KAKEJI Y, YOSHIDA K, KODERA Y, et al. Three-year outcomes of a randomized phase III trial comparing adjuvant chemotherapy with S-1 plus docetaxel versus S-1 alone in stage III gastric cancer: JACCRO GC-07. Gastric Cancer, 2022, 25(1): 188-96.
SUN J, WANG X, ZHANG Z, et al. The sensitivity prediction of neoadjuvant chemotherapy for gastric cancer. Frontiers in Oncology, 2021, 11: 641304.
CHEN Q, ZHANG L, LIU S, et al. Radiomics in precision medicine for gastric cancer: Opportunities and challenges. European Radiology, 2022, 32(9): 5852-68.
WANG W, PENG Y, FENG X, et al. Development and validation of a computed tomography-based radiomics signature to predict response to neoadjuvant chemotherapy for locally advanced gastric cancer. JAMA Network Open, 2021, 4(8): e2121143.
ROGERS W, THULASI SEETHA S, REFAEE T A G, et al. Radiomics: From qualitative to quantitative imaging. The British Journal of Radiology, 2020, 93(1108): 20190948.
JIANG Y, ZHANG Z, YUAN Q, et al. Predicting peritoneal recurrence and disease-free survival from CT images in gastric cancer with multitask deep learning: A retrospective study. The Lancet Digital Health, 2022, 4(5): e340-50.
JIN C, JIANG Y, YU H, et al. Deep learning analysis of the primary tumour and the prediction of lymph node metastases in gastric cancer. The British Journal of Surgery, 2021, 108(5): 542-9.
GUAN X, LU N, ZHANG J. Evaluation of epidermal growth factor receptor 2 status in gastric cancer by CT-based deep learning radiomics nomogram. Frontiers in Oncology, 2022, 12: 905203.
ZHANG Y, WU C, XIAO Z, et al. A deep learning radiomics nomogram to predict response to neoadjuvant chemotherapy for locally advanced cervical cancer: A two-center study. Diagnostics, 2023, 13(6): 1073.
JIANG M, LI C L, LUO X M, et al. Ultrasound-based deep learning radiomics in the assessment of pathological complete response to neoadjuvant chemotherapy in locally advanced breast cancer. European Journal of Cancer, 2021, 147: 95-105.
WANG W, CAO K, JIN S, et al. Differentiation of renal cell carcinoma subtypes through MRI-based radiomics analysis. European Radiology, 2020, 30(10): 5738-47.
SU P F, YU J C. Progress in neoadjuvant therapy for gastric cancer. Oncology Letters, 2022, 23(6): 172.
HOSHI H. Management of gastric adenocarcinoma for general surgeons. The Surgical Clinics of North America, 2020, 100(3): 523-34.
CHEONG J H, YANG H K, KIM H, et al. Predictive test for chemotherapy response in resectable gastric cancer: A multi-cohort, retrospective analysis. The Lancet Oncology, 2018, 19(5): 629-38.
BIONDI A, LIROSI M C, D’UGO D, et al. Neo-adjuvant chemo(radio)therapy in gastric cancer: Current status and future perspectives. World Journal of Gastrointestinal Oncology, 2015, 7(12): 389-400.
GANESHAN B, MILES K A. Quantifying tumour heterogeneity with CT. Cancer Imaging, 2013, 13(1): 140-9.
LI Z, ZHANG D, DAI Y, et al. Computed tomography-based radiomics for prediction of neoadjuvant chemotherapy outcomes in locally advanced gastric cancer: A pilot study. Chinese Journal of Cancer Research, 2018, 30(4): 406-14.
SONG R, CUI Y, REN J, et al. CT-based radiomics analysis in the prediction of response to neoadjuvant chemotherapy in locally advanced gastric cancer: A dual-center study. Radiotherapy and Oncology, 2022, 171: 155-63.
ZWANENBURG A, VALLIèRES M, ABDALAH M A, et al. The image biomarker standardization initiative: Standardized quantitative radiomics for high-throughput image-based phenotyping. Radiology, 2020, 295(2): 328-38.
PAQUIER Z, CHAO S L, ACQUISTO A, et al. Radiomics software comparison using digital phantom and patient data: IBSI-compliance does not guarantee concordance of feature values. Biomedical Physics & Engineering Express, 2022, 8(6): 065008.
HU Y, XIE C, YANG H, et al. Computed tomography-based deep-learning prediction of neoadjuvant chemoradiotherapy treatment response in esophageal squamous cell carcinoma. Radiotherapy and Oncology, 2021, 154: 6-13.
SUN R J, FANG M J, TANG L, et al. CT-based deep learning radiomics analysis for evaluation of serosa invasion in advanced gastric cancer. European Journal of Radiology, 2020, 132: 109277.
ZHANG J, CUI Y, WEI K, et al. Deep learning predicts resistance to neoadjuvant chemotherapy for locally advanced gastric cancer: A multicenter study. Gastric Cancer, 2022, 25(6): 1050-9.
CUI Y, ZHANG J, LI Z, et al. A CT-based deep learning radiomics nomogram for predicting the response to neoadjuvant chemotherapy in patients with locally advanced gastric cancer: A multicenter cohort study. EClinicalMedicine, 2022, 46: 101348.
Tan M X, Le Q V. EfficientNetV2: Smaller models and faster training. Proceedings of the international conference on machine learning (ICML). Electric Network, Jul 18–24, 2021.
ZHOU W, JI J, JIANG Y, et al. EARDS: EfficientNet and attention-based residual depth-wise separable convolution for joint OD and OC segmentation. Frontiers in Neuroscience, 2023, 17: 1139181.
JIANG L, MA Z, YE X, et al. Clinicopathological factors affecting the effect of neoadjuvant chemotherapy in patients with gastric cancer. World Journal of Surgical Oncology, 2021, 19(1): 44.
RAJABNEJAD A, VAIDA F, VALASEK M, et al. Predictors and significance of histologic response to neoadjuvant therapy for gastric cancer. Journal of Surgical Oncology, 2021, 123(8): 1716-23.
LI Z, GAO X, PENG X, et al. Multi-omics characterization of molecular features of gastric cancer correlated with response to neoadjuvant chemotherapy. Science Advances, 2020, 6(9): eaay4211.
YEH Y S, CHEN Y T, TSAI H L, et al. Predictive value of ERCC1, ERCC2, and XRCC expression for patients with locally advanced or metastatic gastric cancer treated with neoadjuvant mFOLFOX-4 chemotherapy. Pathology Oncology Research, 2020, 26(2): 1105-16.
CHEN Y, XU W, LI Y L, et al. CT-based radiomics showing generalization to predict tumor regression grade for advanced gastric cancer treated with neoadjuvant chemotherapy. Frontiers in Oncology, 2022, 12: 758863.
LI J, YIN H, WANG Y, et al. Multiparametric MRI-based radiomics nomogram for early prediction of pathological response to neoadjuvant chemotherapy in locally advanced gastric cancer. European Radiology, 2023, 33(4): 2746-56.
AMIN M B, GREENE F L, EDGE S B, et al. The eighth edition AJCC cancer staging manual: Continuing to build a bridge from a population-based to a more “personalized” approach to cancer staging. CA: A Cancer Journal for Clinicians, 2017, 67(2): 93-9.
WANG W, YANG J, YU Y, et al. Expression of JWA and XRCC1 as prognostic markers for gastric cancer recurrence. International Journal of Clinical and Experimental Pathology, 2020, 13(12): 3120-7.
WANG F H, ZHANG X T, TANG L, et al. The Chinese Society of Clinical Oncology (CSCO): Clinical guidelines for the diagnosis and treatment of gastric cancer, 2023. Cancer Communications, 2024, 44(1): 127-72.
AOYAMA T, NISHIKAWA K, FUJITANI K, et al. Early results of a randomized two-by-two factorial phase II trial comparing neoadjuvant chemotherapy with two and four courses of cisplatin/S-1 and docetaxel/cisplatin/S-1 as neoadjuvant chemotherapy for locally advanced gastric cancer. Annals of Oncology, 2017, 28(8): 1876-81.
NI C, ZHANG Z, ZHU X, et al. Prognostic value of CD166 expression in cancers of the digestive system: A systematic review and meta-analysis. PloS One, 2013, 8(8): e70958.
Author information
Authors and Affiliations
Contributions
J Zhang and Q Zhang designed and coordinated the study; B Zhao and G Shi carried out experiment and data process, and drafted the manuscript. All authors gave final approval for publication.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Ethical approval
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest. This retrospective study involved human participants. This retrospective study that incorporates anonymous data was approved by the Ethics Committee of two hospitals and the need for informed consent was waived.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Zhang, J., Zhang, Q., Zhao, B. et al. Deep learning nomogram for predicting neoadjuvant chemotherapy response in locally advanced gastric cancer patients. Abdom Radiol (2024). https://doi.org/10.1007/s00261-024-04331-7
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s00261-024-04331-7