Introduction

Colorectal cancer (CRC) is one of the most common malignant tumors in the world, with high morbidity and mortality. It is estimated that there were over 1.8 million new cases in 2018, and at the same time, more than 881,000 deaths were estimated to have occurred [1]. Lymph node (LN) metastasis in patients with CRC is considered a reliable predictor of prognosis and a determinant for therapeutic decision-making [2, 3]. Currently, the most authorized tool for CRC staging assessment is the American Joint Committee on Cancer/International Union Against Cancer Classification (AJCC/UICC) tumor node metastasis (TNM) system, which classifies the pathological N (pN) stages according to the number of metastatic lymph nodes [4]. For optimal staging of CRC, the analysis of 12 or more lymph nodes is necessary for CRC patients, which was proposed by the AJCC/UICC. Due to inaccurate surgical dissection and pathological evaluation, an inadequate number of nodes examined may result in under-staging and improper treatment, known as “stage migration” [5,6,7]. Thus, new parameters have been proposed during the last decade, such as the number of involved lymph nodes [8], the number of negative lymph nodes [9], and the lymph node ratio (LNR) [10, 11]. LNR was defined as the ratio of the number of positive lymph nodes to the total number of lymph nodes examined. Several studies have proven that the LNR may serve as a better predictor of survival in patients with CRC because it is less affected by the total number of retrieved nodes [10, 12,13,14]. Therefore, as an alternative or complementary method, LNR have been suggested for AJCC staging [15]. It aims to improve the prognosis for CRC by reducing the effect of heterogeneity of procedures on staging lymph nodes. In addition, LNR can be a strong predictor of survival in patients with CRC, which confers additional information regarding the total number of lymph nodes examined. However, clinical node negative (cN0) patients, similar to pN0 patients, fail to benefit from the LNR system. The log odds of positive lymph nodes (LODDS) defined as the log of the ratio between the number of positive nodes and the number of negative nodes, was first proposed by Vinh-Hung V and colleagues to predict prognosis of breast cancer. In this study, it was noted that the LODDS performed equally well as a prognostic indicator in pathological lymph node status (negative [pN0] or positive [pN+]) [16]. This initial finding was subsequently extended to several kinds of cancers including CRC [17,18,19,20,21,22]. The LODDS classification was an excellent independent prognostic factor for patients with CRC, particularly those who had < 12 harvested or no lymph node metastasis [23,24,25]. However, some studies reported that LODDS were not related to the survival of CRC patients [26].

Considering the current controversies regarding the significance of LODDS in the prognosis of CRC patients, we systematically analyzed data obtained in published literature and summed the prognostic significance of LODDS in CRC patients.

Materials and methods

Study selection

We systematically searched PubMed, Medline, Embase, Web of Science and the Cochrane Library for relevant studies from inception to December 3, 2021. The following keywords were used: “log odds of positive lymph nodes”, “Colonic Neoplasms” [Mesh], and “Rectal Neoplasms” [Mesh], “Colorectal Neoplasms” [Mesh]. We used the following strategy: ((log odds of positive lymph nodes) OR (LODDS)) AND ((((((((((((“Colonic Neoplasms”[Mesh]) OR (“Rectal Neoplasms”[Mesh])) OR (“Colorectal Neoplasms”[Mesh])) OR (Rectal Neoplasms)) OR (Rectal Cancer)) OR (Rectal Tumor)) OR (Colonic Neoplasms)) OR (Colon Cancer)) OR (Colon Tumor)) OR (Colorectal Neoplasms)) OR (Colorectal Cancer)) OR (Colorectal Tumor)). For the meta-analysis, we followed PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-analyses) guidelines [27].

Inclusion and exclusion criteria

Studies fulfilling the following criteria were included: (i) the article reported at least one of the outcomes of interest or the outcome could be calculated according to data extracted from the published data; (ii) only articles published in English, focused on human, and reporting at least one outcome of interest were evaluated, or the outcome could be calculated according to data extracted from the published data; (iii) all CRC patients were diagnosed with the gold standard test; (iv) we included the studies which classified LODDS into three hierarchical levels because currently classification of LODDS has no uniform standard and we found that most of the studies classified LODDS into three categories during the study selection process.

Articles were excluded based on the following criteria: (i) missed crucial information needed for detailed stratification; (ii) number of participants less than 20; (iii) the article was a review, case report, comment, letter, or meeting record; (iv) the article shared a study population with another article.

Data extraction and definitions

Two reviewers independently used a standardized form to extract the data from the included articles: reference, published year, country, type of cancer, number of patients (male/female), age, gender, treatment and prognostic indicators (overall survival (OS) and disease-free survival (DFS)). Any disputes or differences were settled by a third independent investigator. For articles with multiple arms, each arm was considered an independent data set.

Outcomes and quality assessment

Prognostic values (OS and DFS) were used to compare the different LODDS groups.

Two investigators independently assessed the quality of the included articles according to the Newcastle-Ottawa scale (NOS) [28], on the basis of three categories: (i) study group selection; (ii) comparability of groups; and (iii) outcome of interest. The full score was 9, and 1–4 points indicated low-quality, while 5–9 points were considered high-quality.

Data analysis and statistical methods

We used Stata statistical software Version 16.0 (Stata Corporation, College Station, TX) to analyze the data in our meta-analysis. To statistically assess the prognostic effects of LODDS, we extracted the hazard ratio (HR) and 95% confidence interval (CI) of OS and DFS from the included studies. If HRs, 95% CIs, or P values were not directly provided in the original literature, the estimated HR was used to assess prognostic effects based on the method described by Tierney et al. [29], and HR > 1 indicated more disease progression or deaths in the patients. Data were pooled using a random-effects model (REM). All statistical values were combined with 95% CIs and two-sided P values, the threshold of which was set to 0.05. Heterogeneity between articles was calculated using the Q test and I2 statistic [30]. For the I2 statistic, heterogeneity was defined as low (25–50%), moderate (50–75%) or high (> 75%) [31]. For the Q statistic, P ≤ 0.1 was considered to indicate significant heterogeneity. In addition, based on the differences in the data retrieved, subgroup analyses were performed. Then, we also conducted a sensitivity analysis in which each study was removed in turn to evaluate the undue influence of the study on the overall summary estimates including Duval and Tweedie’s trim-and-fill method [32], and Galbraith plots [33]. Publication bias was investigated with qualitative and quantitative methods, including funnel plots and Egger’s test [34]. P values for pooled results were two-sided, and the inspection level was 0.05.

Results

Study characteristics

The original search yielded 204 records in PubMed, Web of Science, Medline, the Cochrane Library and Embase. Of these, 128 duplicate articles were excluded. We excluded 46 records after reading the titles and abstracts. After reviewing the full texts, 10 articles [10,11,12, 14, 23, 24, 35,36,37,38] were finally included in this study. The flowchart of the search and selection process is demonstrated as a PRISMA flowchart in Fig. 1. All articles were published between 2012 and 2021. Overall, the 10 articles included 3523 patients, ranging from 117 to 856 patients. Among these articles, the NOS quality scores ranged from 6 to 7. The characteristics of the selected articles are detailed in Table 1.

Fig. 1
figure 1

Flow diagram of study selection

Table 1 Characteristics of included studies for the meta-analyses

Study analysis

We analyzed OS and DFS in different LODDS categories according to the data from the included articles [10,11,12, 14, 23, 24, 35,36,37,38]. The results of the pooled analysis are summarized in Table 2.

Table 2 Results of prognostic effects of CRC patients

OS based on LODDS comparing LODDS0 versus LODDS1 and LODDS2 group

Compared with LOODS0 CRC patients, LODDS1 CRC patients had a worse OS (HR = 1.77, 95% CI (1.38, 2.28)) where the heterogeneity was insignificant (I2 statistic = 18.3%, P heterogeneity = 0.280). The pooled results indicated that LODDS2 CRC patients had a worse OS (HR = 3.49, 95% CI (2.88, 4.23)) than LOODS0 CRC patients. Regarding the heterogeneity, there was no statistical significance (I2 statistic = 0.0%, P heterogeneity = 0.600), as shown in Fig. 2.

Fig. 2
figure 2

Estimated HR summary for OS. Data were pooled using a random-effects model (REM). All statistical values were combined with 95% CIs and two-sided P-values, the threshold of which was set to 0.05. HR, hazard ratio; OS, overall survival; LODDS, log odds of positive lymph nodes

DFS based on LODDS comparing LODDS0 versus LODDS1 and LODDS2 group

Compared with LOODS0 CRC patients, LODDS1 CRC patients had a worse DFS (HR = 1.82, 95% CI (1.23, 2.68)). The heterogeneity was moderate insignificant (I2 statistic = 35.0%, P heterogeneity = 0.203). The result of pooled analysis using the random-effects model showed that LODDS2 CRC patients was also associated with poor DFS (HR =3.30, 95% CI (1.74, 6.27)) than LODDS0 CRC patients, and between-study heterogeneity was obvious (I2 statistic = 74.4%, P heterogeneity = 0.002), as shown in Fig. 3.

Fig. 3
figure 3

Estimated HR summary for DFS. Data were pooled using a random-effects model (REM). All statistical values were combined with 95% CIs and two-sided P-values, the threshold of which was set to 0.05. HR, hazard ratio; DFS, disease-free survival; LODDS, log odds of positive lymph nodes

The source of heterogeneity

To explore the potential sources of heterogeneity, we used Galbraith plot and Duval and Tweedie’s trim-and-fill method to further explore the source of heterogeneity in DFS, and the result showed that the training set of the study by Ogawa T et al. [38] might have mainly contributed substantial heterogeneity to DFS (Fig. 4A). After omitting this study, the pooled HR was not affected obviously (HR =4.53, 95% CI (3.14, 6.55); Fig. 4B), but the heterogeneity for DFS dropped to an insignificant level (from I2 statistic = 74.4%, P heterogeneity = 0.002 to I2 statistic = 0.0%, P heterogeneity = 0.948; Fig. 4C).

Fig. 4
figure 4

Process of exploring the potential sources of heterogeneity on DFS. a galbraith plot for DFS. b Forest plot for DFS after Ogawa S et al. (2015) is omitted. c change of heterogeneity before and after Ogawa S et al. (2015) is omitted. Weights are from random-effects analysis. P value for heterogeneity. HR, hazard ratio; DFS, disease-free survival; SE, standard error

Subgroup analysis and publication bias

We performed subgroup analysis according to differences in the variables, including the publication year, country, and type of cancer. Consistent with above results, LODDS1 and LODDS2 CRC patients had a worse OS and DFS compared with LODDS0 CRC patients in most subsets. Although it is found that OS and DFS of non-Asian CRC patients were better than patients from Asian, high LODDS is a marker for poor prognosis both in non-Asian and Asian CRC patients. Meanwhile, although OS and DFS of rectal cancer patients were better than colon cancer patients, high LODDS is a marker for poor prognosis both in colon and rectal cancer patients, as shown in Table 3.

Table 3 Results of subgroup analyses on prognostic effects of CRC patients

Publication bias was assessed by funnel plots and Egger’ s test, as shown in Fig. S1. Formal evaluation using Egger’ s test also failed to identify significant publication bias in the analysis of LODDS1 versus LODDS0 (p = 0.729), LODDS2 versus LODDS0 (p = 0.265) in OS. Similarly, there was no evidence for significant publication bias in LODDS1 versus LODDS0 (p = 0.860), LODDS2 versus LODDS0 (p = 0.949) in DFS. The results with heterogeneity adjusted are listed in Table 2. In addition, we used funnel plots to detect publication bias, as shown in Fig. 5. All of the funnel plots of the included articles showed a symmetrical distribution. Thus, no significant publication bias was found in the meta-analyses of OS or DFS.

Fig. 5
figure 5

Assessment of publication bias using Funnel plot analysis. a-b Funnel plot analysis of studies on OS ((a) LODDS1 vs. LODDS0, b LODDS2 vs. LODDS0). c-d Funnel plot analysis of studies on DFS ((c) LODDS1 vs. LODDS0, d LODDS2 vs. LODDS0). Publication bias was not found in the meta-analyses of OS and DFS. All of the funnel plots of the included articles showed a symmetrical distribution. Thus, no significant publication bias was found in the meta-analyses of OS or DFS. HR, hazard ratio; OS, overall survival; DFS, disease-free survival; LODDS, log odds of positive lymph nodes

Discussion

To our knowledge, this is the first meta-analysis that focused on the significance of LODDS in the prognosis of CRC patients. Arslan NC [23] suggested that the LODDS classification was an excellent independent prognostic factor for patients with CRC, particularly those who had < 12 harvested or no lymph node metastasis. However, Jung W [26] indicated that LODDS were not related to the survival of CRC patients. Our meta-analysis of 10 articles including 3523 patients with CRC indicating that LODDS1 and LODDS2 patients had a worse OS and DFS compared with LODDS0 patients, which showed that LODDS is associated with the prognosis of CRC patients and accurately predicts survival of CRC patients. Compared with LOODS0 CRC patients, LODDS1 (HR = 1.77, 95% CI (1.38, 2.28)) and LODDS2 (HR = 3.49, 95% CI (2.88, 4.23)) CRC patients had a worse OS with insignificant heterogeneity. Additionally, the pooled results demonstrated that LODDS1 CRC patients had a worse DFS (HR = 1.82, 95% CI (1.23, 2.68)) than LOODS0 CRC patients where the heterogeneity was insignificant. Our pooled analysis also showed that LODDS2 CRC patients was also associated with poor DFS (HR =3.30, 95% CI (1.74, 6.27)) than LODDS0 CRC patients, and between-study heterogeneity was obvious (I2 statistic = 74.4%, P heterogeneity = 0.002). To explore the potential sources of heterogeneity, we used Galbraith plot and Duval and Tweedie’s trim-and-fill method to further explore the source of heterogeneity in DFS, and the result showed that the training set of the study by Ogawa T et al. [38] might have mainly contributed substantial heterogeneity to DFS. After omitting this study, the heterogeneity for DFS dropped to an insignificant level (from I2 statistic = 74.4%, P heterogeneity = 0.002 to I2 statistic = 0.0%, P heterogeneity = 0.948; Fig. 4C), and the pooled HR was not affected obviously (HR =4.53, 95% CI (3.14, 6.55); Fig. 4B). Most results of the subgroup analysis in our study were in agreement with the survival results described above.

Despite recent advances in novel antitumor therapeutics, the overall survival is far from satisfactory, especially in patients with advanced CRC. To improve the quality of life of oncological patients, it is necessary to accurately estimate prognosis and adopt personalized therapeutics. Although the number-based UICC/AJCC pN classification in patients with radically resected CRC is currently considered as the most reliable predictor of poor prognosis [2, 3], the primary flaw of the pN classification is that the accuracy of the predicting prognosis was significantly influenced by the total number of nodes retrieved [5,6,7]. Neither the LNR nor pN classification system provided additional prognostic information for patients with N0 status or harvested total lymph nodes (TLNs) < 12. Recently, an increasing number of studies have confirmed the crucial roles of LODDS in the management of several types of cancer, including CRC [39,40,41,42,43,44]. LODDS, first proposed in breast cancer in which it performed equally well as a prognostic indicator in node-positive and node-negative patients [16], was later generalized to several cancers, including CRC [17,18,19,20,21,22]. The LODDS classification was a novel prognostic LN-related index that considers the effects of both the numbers of positive LNs and negative LNs and gives a new chance to improve the accuracy of pN classification for prognostic assessment, particularly in patients with N0 status or harvested < 12 TLNs [45]. By searching the most recent articles considering the prognostic value of LODDS, we found that LODDS is superior to other lymph node–based staging algorithms in predicting prognosis in several cancers. For instance, LODDS demonstrated the highest discriminative capacity and prognostic accuracy for esophageal squamous cell carcinoma (ESCC) patients [46]. Another recent study showed that LODDS was also an independent and superior predictor for OS in head and neck cancer (HNC) in a population-based setting with representative real-life data [47]. However, some studies reported that LODDS were not related to the survival of CRC patients [26]. However, several reasons may be partly explained the inconsistent conclusions of different studies, such as methodological reasons and confounder variables. In view of this, synthesizing all related findings to draw more reliable conclusions would be of interest. To our knowledge, no meta-analysis has examined the significance of LODDS in the prognosis of CRC patients. Therefore, our meta-analysis was the first and most full-scale systematic review and meta-analysis to evaluate the prognostic value of the LODDS in patients with CRC.

However, several limitations of the current meta-analysis should be emphasized. First, because several studies did not report HRs that were estimated based on the method described by Tierney et al. [29]. Second, the optimal cutoff point of LODDS need to be confirmed in a large-scale, international, multicenter prospective study before its promotion for clinical practice. Third, there were an insufficient number of studies to assess the 5-year survival rates of patients with different pN and ratio-based lymph node system (rN) classifications stratified by LODDS. That is, we were not able to access differences in survival among patients in different LODDS classification for patients in each of the pN or rN classifications. Despite these limitations, this is the first meta-analysis of focusing on the crucial roles of LODDS in predicting prognosis of patients with CRC. It is clear that LODDS accurately predicts survival of CRC patients. Moreover, it may be novel prognostic predictor, as a more accurate and sensitive stratification tool for use in clinical studies and in evaluating the appropriateness of chemotherapy treatment in homogenous patient groups.

Conclusions

In conclusion, our systematic review demonstrated that LODDS is associated with the prognosis of CRC patients and accurately predicts survival of CRC patients. Our meta-analysis indicated that LODDS1 and LODDS2 patients have a poorer OS and DFS compared with LODDS0 patients. Moreover, the results of summary analysis demonstrated the significance of LODDS as a remarkable prognostic indicator of OS and DFS in most subgroups. Further high-quality, large-scale, international, well-designed multicenter prospective studies are required to obtain the optimal cutoff point of LODDS until the utilization of LODSS in the clinical practice.