Skip to main content

External validation of the Briganti 2019 nomogram to identify candidates for extended pelvic lymph node dissection among patients with high-risk clinically localized prostate cancer



We aimed to establish an external validation of the Briganti 2019 nomogram in a Japanese cohort to preoperatively evaluate the probability of lymph node invasion in patients with high-risk, clinically localized prostate cancer.


The cohort consisted of 278 patients with prostate cancer diagnosed using magnetic resonance imaging-targeted biopsy who underwent radical prostatectomy and extended pelvic lymph node dissection from 2012 to 2020. Patients were rated using the Briganti 2019 nomogram, which evaluates the probability of lymph node invasion. We used the area under curve of the receiver operating characteristic analysis to quantify the accuracy of the nomogram.


Nineteen (6.8%) patients had lymph node invasion. The median number of lymph nodes removed was 18. The area under the curve for the Briganti 2019 was 0.71. When the cutoff was set at 7%, 84 (30.2%) patients with extended pelvic lymph node dissection could be omitted, and only 1 (1.2%) patient with lymph node invasion would be missed. Sensitivity, specificity, and negative predictive values at the 7% cutoff were 94.7, 32.0, and 98.8%, respectively.


This external validation showed that the Briganti 2019 nomogram was accurate, although there may still be scope for individual adjustments.


Pelvic lymph node dissection (PLND) represents the gold standard for detecting occult lymph node invasion (LNI) and confirming accurate staging of high-risk prostate cancer [1]. However, its therapeutic role, indication, and the extent of PLND required remain controversial [2, 3]. Moreover, there are complications, such as lymphocele, lymphedema, neurovascular injury, and thromboembolic events associated with PLND [4, 5]. Furthermore, PLND has additional attendant costs and requires extended operative time [4]. In the current era of widespread prostate-specific antigen (PSA)-based population screening, the actual number of cases with LNI is small, compared to the number of PLNDs performed. It is, therefore, of great importance to focus on the indications for PLNDs to avoid unnecessary invasion and the associated complications.

To achieve an ideal strategy that minimizes unnecessary invasion without missing progression, various nomograms have been developed and updated to preoperatively evaluate the risk of LNI and to determine the indications for PLND. The European Association of Urology (EAU) guidelines introduced Briganti, Partin, and Memorial Sloan Kettering Cancer Center (MSKCC) nomograms to estimate the risk of nodal metastases [1], whereas Japanese guidelines include Partin as well as the Japan Prostate Cancer (PC) table designed for Japanese patients [6]. All these nomograms are based on preoperative serum PSA, clinical tumor stage, and histopathological biopsy results, with some modification of each.

An updated version of the Briganti nomogram (Briganti 2019), which includes multiparametric-magnetic resonance imaging (MRI) findings and MRI-targeted biopsy results as parameters, was published in 2019 [7] and is considered to possibly be the "clinically most effective tool to date," noting that a full external validation is still outstanding in the EAU 2020 updated guidelines [8].

There are several techniques of MRI-targeted biopsy: cognitive fusion biopsy, fusion MRI-ultrasound-guided biopsy, and MRI-guided in-bore biopsy [9,10,11,12]. The superiority of the detection of clinically significant prostate cancer (csPC) by using a combined method of MRI-targeted and systematic biopsy compared with each single method has been reported [13]. As the diagnostic imaging technique improves, MRI-targeted biopsy has been more popular worldwide to achieve more accurate diagnoses.

We introduced MRI-targeted prostate biopsy in 2012. The indication for PLND had traditionally been dependent on the surgeon's decision, but since the publication of the Briganti 2019 nomogram, we have used this nomogram to identify candidates for PLND.

We aimed to externally validate the Briganti 2019 nomogram in a Japanese cohort of patients with prostate cancer to assess its accuracy in real-world clinical practice.

Materials and methods

Study cohort

Clinical and pathological data were retrospectively collected for patients diagnosed with prostate cancer using MRI-targeted biopsy and treated with radical prostatectomy (RP) with ePLND at the Cancer Institute Hospital, Japanese Foundation for Cancer Research, Tokyo, Japan from 2012 to 2020. During the period, RP was performed in 1155 patients. Patients were excluded from the study if their malignancies were only confirmed by systematic biopsy (i.e., they did not undergo targeted biopsy or obtained a negative targeted biopsy result), if they underwent biopsy at another institution, received neoadjuvant hormone or radiation therapy, or underwent RP without ePLND. Hence, the remaining 278 patients were included in the current study. The determination of serum PSA level and pelvic multi-parametric MRI were performed prior to the biopsy. MRI scans were read by trained radiologists without the use of the Prostate Imaging Reporting & Data System (PI-RADS). Transrectal ultrasound-guided transperineal biopsy was combined with MRI-targeted (1–4 cores per lesion via cognitive registration) and systematic (8–14 cores; median 8 cores) methods, and the number of cores taken was decided by the treating surgeon. Imaging studies preoperatively confirmed that all patients had no metastases. Skilled surgeons performed RP and ePLND (including external, internal iliac, and obturator lymph nodes) using either an open or minimum incision endoscopic or robot-assisted approach [14, 15]. The probability of LNI was evaluated using the Briganti 2019 nomogram [7], Briganti 2017 nomogram [16], Briganti 2012 nomogram [17], MSKCC nomogram [18], Partin 2017 nomogram [19], and Japan PC table [20], based on clinical data and biopsy results (Table 1). This study was approved by the Institutional Review Board at the Cancer Institute Hospital, Japanese Foundation for Cancer Research (IRB No. 2020-1198).

Table 1 Variables included in nomograms predicting lymph node invasion at radical prostatectomy in patients with prostate cancer

Statistical analyses

Data were summarized, including all of the parameters of each of the six nomograms. Frequencies and percentages were determined for categorical variables, and medians and ranges for continuous variables. Comparisons between the groups with and without histologically confirmed LNI were performed using Fisher’s exact test for qualitative variables and the Mann–Whitney U test for quantitative variables. The area under the curve (AUC) of the receiver operating characteristic (ROC) analysis was obtained to quantify the accuracy of each nomogram. The calibration plot representing the relationship between the predictive probabilities calculated with the Briganti 2019 coefficients on the x-axis and the observed frequencies on the y-axis was also studied. All statistical tests were two-sided with the significance level set at P < 0.05. Analyses were conducted using R version 3.6.3 (The R Foundation for Statistical Computing, Vienna, Austria).


Baseline characteristics

Descriptive patient characteristics are shown in Table 2. Overall, 19 (6.8%) patients exhibited LNI at final pathology. The median number of lymph nodes removed was 18 (5–55). Among patients with and without LNI, there were statistically significant differences in preoperative PSA, Gleason grade group in overall/MRI-targeted/systematic biopsy, primary and secondary Gleason grade overall, percentage positive cores on overall/systematic biopsy, percentage of positive cores with lower-grade taken overall, as well as the number of positive and negative cores taken overall (P < 0.05). Pathological characteristics are also shown in Table 2, which achieved statistical significance in the Gleason grade group regarding surgical specimens and pathological T stage.

Table 2 Descriptive statistics for patients with clinically localized prostate cancer diagnosed via MRI-targeted biopsy and treated with RP and ePLND

External validation of the Briganti 2019 nomogram

As shown in Table 3, the AUC for the Briganti 2019 nomogram in our overall cohort was 0.71. On the calibration plot, the 45° line indicates perfect congruity between the predictive probability and observed value, and overestimation was noted throughout the ranges of the predicted risk of LNI (Fig. 1). Table 4 shows nomogram-derived LNI probabilities. With a cutoff set at 7%, ePLND could be omitted for 84 (30.2%) patients, and only 1 (1.2%) patient who actually had LNI would be missed. Sensitivity, specificity, and negative predictive value at a 7% cutoff were 94.7, 32.0, and 98.8%, respectively.

Table 3 AUCs of the nomograms in the original and external validation cohorts
Fig. 1
figure 1

Nomogram calibration plot. The dashed line indicates the location of the ideal nomogram, in which predicted and observed probabilities are identical

Table 4 Systematic analyses of nomogram-derived cutoffs of the externally validated nomograms

External validation of the Briganti 2019 Nomogram compared to the other currently available nomograms.

The AUCs for the other nomograms are shown in Table 3. The AUC of Briganti 2019 in our overall cohort was confirmed to be the lowest, compared with 0.72, 0.74, and 0.73 for the Briganti 2017, Briganti 2012, and MSKCC nomograms, respectively. However, the differences were not statistically significant. For nomograms that can evaluate cases below cT3, the AUC was 0.73 for Partin 2017 and 0.79 for the Japan PC table, compared with the AUC of 0.75 for the Briganti 2019 nomogram under the same condition. As shown in Table 4, when compared using a cutoff of 7% for the Briganti 2019, Briganti 2017, Briganti 2012, and MSKCC nomograms that can evaluate the cases that include cT3, the Briganti 2019 nomogram could omit the highest number of patients (30.2% vs 14.4% vs 11.9% vs 12.2%) while limiting the number of cases of LNI that could be missed (1.2% vs 2.5% vs 0% vs 0%).


In our external validation, the AUC of the Briganti 2019 nomogram was the lowest compared with that of the other nomograms calculated under the same conditions. There are currently three reports of external validations of the Briganti 2019 nomogram [21,22,23], all of which are from Europe and include a common author. Table 3 shows the AUCs of the nomograms calculated with their cohorts. Notably, Oderda et al. highlighted a similar trend in their study, where the lowest AUC was obtained from the Briganti 2019 nomogram when compared to the other validated nomograms [23]. In addition, the AUCs of all nomograms calculated in our cohort were relatively low compared to the original and the other external validation cohorts. The calibration plot of the Briganti 2019 is below the ideal line, which indicates that the predicted probability of LNI as determined by the nomogram is overestimated compared to the actual probability. Meanwhile, sensitivity and specificity were not significantly improved if the cutoff point was changed. Therefore, changing the cutoff could not compensate for the overestimation. However, for nomograms aimed at reducing unnecessary lymph node dissection while minimizing missed lymph node metastases, the Briganti 2019 nomogram performed relatively better than other nomograms capable of assessing cases of cT3 when the cutoff was set at 7%.

The differences in the patient characteristics between the original cohort, other external validation cohort, and our cohort need to be considered. In comparison with the original cohort and our cohort, our cohort had a higher PSA and smaller prostate volume, while the maximum diameter of the index lesion on MRI was similar. Also, regarding the diagnostic accuracy of MRI to determine cT3 or higher, clinical stage tended to be underestimated compared to pathological stage in all of the studies, but the degree was the smallest in our cohort. As for the pathology results, our cohort was in a higher Gleason grade group for biopsies compared to the original cohort and other external validations. Meanwhile, when comparing the biopsy results with the final results of the surgical specimen, the other reports all tended to be upgraded while our cohort was likely to downgraded, and these tendencies in diagnostic technique may have been assumed to influence the results. In fact, between our cohort and the original cohort, the percentages of patients below the cutoff set at 7% were 30.2% and 57%, respectively, which reflect a relatively higher score in our validation cohort. Meanwhile, the results above also suggested that preoperative evaluation in our cohort tended to be overestimated, which seemed to result in low AUCs of the nomograms and a gentle gradient in the calibration plot of the Briganti 2019 nomogram. It should be noted that, in terms of the detection ability of LNI, although there were differences in surgical techniques of prostatectomy between the cohorts, the median number of lymph nodes removed was comparable, suggesting that the quality of lymph node dissection in our study was well established.

When multiple parameters were used to measure AUC, the highest AUCs for biopsy pathology were obtained using the total biopsy results rather than the targeted ones. The Gleason grade of the target lesion did not necessarily reflect cancer progression. Rather, a higher Gleason grade obtained from a systematic biopsy may reflect the extension of high-grade cancer beyond the target lesion, which could be considered as a more significant risk factor of lymph node metastasis. This may explain the lower AUC of the Briganti 2019 nomogram compared to the other nomograms, and is supported by the fact that 28 (10.1%) of the 278 cases in our cohort exhibited negative systematic biopsies, none of which were positive for LNI. Although MRI-targeted biopsy is quite useful as a diagnostic tool to increase the accuracy of cancer detection, combined MRI-targeted and systematic biopsy was considered more appropriate to determine the required therapeutic strategy.

Meanwhile, a positive systematic biopsy around the target lesion, the larger diameter of the index lesion, and higher clinical stage on MRI should have similar implications in terms of the presence of extensive malignant findings, depending on the accuracy of the imaging diagnosis of the target lesion. The diameter of the index lesion and clinical stage on MRI, both used as parameters in Briganti 2019 for positive and negative LNI, were not statistically significant. This could be due to the fact that systematic biopsies may reflect malignancies further from the target lesion, whereas our study measured the maximum diameter of the index lesion only at coronal sections, which may not accurately reflect the total tumor volume (the Briganti 2019 nomogram did not specify how the measurement was performed in the original cohort). In addition, the rate of positive LNI in cases in which pT3b was diagnosed in surgical specimens was 29.2% (7/24 cases), which was significantly higher than the 9.8% (25/254 cases) of cases with pT3a or lower. There was only one case in which the imaging and pathological diagnoses of seminal vesicle invasion were in agreement. Notably, the modified AUC of the Briganti 2019 nomogram, calculated by replacing clinical stage with pathological stage in our cohort, was increased to 0.76. An accurate assessment of the clinical stage on MRI may be key to predicting LNI.

Our study only included cases diagnosed by MRI-targeted biopsy. Cases in which the target lesion could not be identified by MRI or those in which the cancer could not be identified from the target lesion were excluded. Future studies including such cases are required.

Other parameters also remain to be studied in the future. Sato et al. reported that prostate cancer located in the anterior are less aggressive than those located in the posterior [24]. A study at our institution also suggested that cases with negative digital rectal examinations (DRE), i.e., ventral lesions, were relatively slow to progress compared to cases with positive DRE, i.e., dorsal lesions (Yoshitomi 2020, unpublished data), and further investigation regarding the relationship between the location of the tumor and its aggressiveness would be required.

Limitations of our study should be noted. First, this was a single-institute study with relatively small sample size and number of events, limiting its generalizability. Gandaglia et al. highlighted the need to generalize their nomogram to other races, stating that their cohort including mainly Caucasian males was one of the limitations of their study [7]. The majority of our cohort was Japanese, which may similarly be considered as a limitation. However, since this is the first study to include an Asian cohort when compared to all of the external validations to date, it helps to address the limitation of the original study. Also, we did not evaluate the quality of the surgical technique and the outcomes of the disease, which was not the main purpose of this study; we only evaluated the number of lymph node removed. Finally, the retrospective nature of our study is another limitation.

In conclusion, we externally validated the 2019 Briganti nomogram for the selection of patients with high-risk prostate cancer in a different cohort. Further research is warranted to identify more accurate decision-making tools, aimed at reducing unnecessary invasion while accurately identifying relevant patients and minimizing the number of LNI missed.



Area under curve


Clinically significant prostate cancer


Digital rectal examination


European Association of Urology


Extended pelvic lymph node dissection


Histologically confirmed lymph node invasion


Interquartile range


Lymph node invasion


Multi-parametric magnetic resonance imaging


Magnetic resonance imaging


Memorial Sloan Kettering Cancer Center


Not applicable


Negative predictive value


Prostate cancer


Pelvic lymph node dissection


Prostate specific antigen


Receiver operating characteristic


Radical prostatectomy


  1. Mottet N, Bellmunt J, Bolla M et al (2017) EAU-ESTRO-SIOG guidelines on prostate cancer. Part 1: screening, diagnosis, and local treatment with curative intent. Eur Urol 71(4):618–29

    Article  Google Scholar 

  2. Fossati N, Willemse PM, Van den Broeck T et al (2017) The benefits and harms of different extents of lymph node dissection during radical prostatectomy for prostate cancer: a systematic review. Eur Urol 72(1):84–109

    Article  Google Scholar 

  3. Chen J, Wang Z, Zhao J et al (2019) Pelvic lymph node dissection and its extent on survival benefit in prostate cancer patients with a risk of lymph node invasion >5%: a propensity score matching analysis from SEER database. Sci Rep 9(1):17985

    Article  Google Scholar 

  4. Francesco P, Stefano DL, Riccardo B et al (2015) Robot-assisted extended pelvic lymph nodes dissection for prostate cancer: personal surgical technique and outcomes. Int Braz J Urol 41(6):1209–1219

    Article  Google Scholar 

  5. Munbauhal G, Seisen T, Gomez FD et al (2016) Current perspectives of sentinel lymph node dissection at the time of radical surgery for prostate cancer. Cancer Treat Rev 50(2016):228–239

    Article  Google Scholar 

  6. Kakehi Y, Sugimoto M, Taoka R (2017) Evidenced-based clinical practice guideline for prostate cancer (summary: Japanese Urological Association, 2016 edition). Int J Urol 24(9):648–66

    Article  Google Scholar 

  7. Gandaglia G, Ploussard G, Valerio M et al (2019) A novel nomogram to identify candidates for extended pelvic lymph node dissection among patients with clinically localized prostate cancer diagnosed with magnetic resonance imaging-targeted and systematic biopsies. Eur Urol 75(3):506–514

    Article  Google Scholar 

  8. Mottet N, van den Bergh RCN, Briers E et al (2020) EAU-EANM-ESTRO-ESUR-SIOG guidelines on prostate cancer—2020 update. Part 1: screening, diagnosis, and local treatment with curative intent. Eur Urol 79:243

    Article  Google Scholar 

  9. Thomson A, Li M, Grummet J et al (2020) Transperineal prostate biopsy: a review of technique. Transl Androl Urol 9(6):3009–3017

    Article  Google Scholar 

  10. Puech P, Ouzzane A, Gaillard V et al (2014) (2014) Multiparametric MRI-targeted TRUS prostate biopsies using visual registration. Biomed Res Int 2014:1–11

    Article  Google Scholar 

  11. Hakozaki Y, Matsushima H, Kumagai J et al (2017) A prospective study of magnetic resonance imaging and ultrasonography (MRI/US)-fusion targeted biopsy and concurrent systematic transperineal biopsy with the average of 18-cores to detect clinically significant prostate cancer. BMC Urol 17(1):117

    Article  Google Scholar 

  12. Schimmöller L, Blondin D, Arsov C et al (2016) MRI-guided in-bore biopsy: differences between prostate cancer detection and localization in primary and secondary biopsy settings. Am J Roentgenol 206(1):92–99

    Article  Google Scholar 

  13. Ahdoot M, Wilbur AR, Reese SE et al (2020) MRI-targeted, systematic, and combined biopsy for prostate cancer diagnosis. N Engl J Med 382(10):917–928

    Article  Google Scholar 

  14. Yamamoto S, Kawakami S, Yonese J et al (2008) Lymphovascular invasion is an independent predictor of prostate-specific antigen failure after radical prostatectomy in patients with pT3aN0 prostate cancer. Int J Urol 15(10):895–899

    Article  Google Scholar 

  15. Yamamoto S, Kawakami S, Yonese J et al (2010) Feasibility of antegrade radical prostatectomy for clinically locally advanced prostate cancer: a comparative study with clinically localized disease. Int J Urol 17(8):720–725

    Article  Google Scholar 

  16. Gandaglia G, Fossati N, Zaffuto E et al (2017) Development and internal validation of a novel model to identify the candidates for extended pelvic lymph node dissection in prostate cancer. Eur Urol 72(4):632–640

    Article  Google Scholar 

  17. Briganti A, Larcher A, Abdollah F et al (2012) Updated nomogram predicting lymph node invasion in patients with prostate cancer undergoing extended pelvic lymph node dissection: the essential importance of percentage of positive cores. Eur Urol 61(3):480–487

    Article  Google Scholar 

  18. Memorial Sloan Kettering Cancer Center. Dynamic prostate cancer nomogram: coefficients. Accessed Mar 2021

  19. Tosoian JJ, Chappidi M, Feng Z et al (2017) Prediction of pathological stage based on clinical stage, serum prostate-specific antigen, and biopsy Gleason score: Partin Tables in the contemporary era. BJU Int 119(5):676–683

    CAS  Article  Google Scholar 

  20. Naito S, Kuroiwa K, Kinukawa N et al (2008) Validation of partin tables and development of a preoperative nomogram for Japanese patients with clinically localized prostate cancer Using 2005 International Society of Urological Pathology Consensus on Gleason Grading: data from the clinicopathological. J Urol 180(3):904–910

    CAS  Article  Google Scholar 

  21. Gandaglia G, Martini A, Ploussard G et al (2020) External validation of the 2019 briganti nomogram for the identification of prostate cancer patients who should be considered for an extended pelvic lymph node dissection. Eur Urol 78(2):138–142

    Article  Google Scholar 

  22. Diamand R, Oderda M, Albisinni S et al (2020) External validation of the Briganti nomogram predicting lymph node invasion in patients with intermediate and high-risk prostate cancer diagnosed with magnetic resonance imaging-targeted and systematic biopsies: a European multicenter study. Urol Oncol Semin Orig Investig 38(11):847.e9-847.e16

    Google Scholar 

  23. Oderda M, Diamand R, Albisinni S et al (2021) Indications for and complications of pelvic lymph node dissection in prostate cancer: accuracy of available nomograms for the prediction of lymph node invasion. BJU Int 127(3):318–325

    Article  Google Scholar 

  24. Sato S, Takahashi H, Kimura T et al (2017) Clinicopathological importance of anterior prostate cancer in Japanese Men. Pathol Int 67(3):156–162

    CAS  Article  Google Scholar 

Download references


The authors would like to thank Editage ( for English language editing.

Author information

Authors and Affiliations


Corresponding author

Correspondence to Shinya Yamamoto.

Ethics declarations

Conflict of interest

No author has any conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

This article is published under an open access license. Please check the 'Copyright Information' section either on this page or in the PDF for details of this license and what re-use is permitted. If your intended use exceeds what is permitted by the license or if you are unable to locate the licence and re-use information, please contact the Rights and Permissions team.

About this article

Verify currency and authenticity via CrossMark

Cite this article

Fukagawa, E., Yamamoto, S., Ohde, S. et al. External validation of the Briganti 2019 nomogram to identify candidates for extended pelvic lymph node dissection among patients with high-risk clinically localized prostate cancer. Int J Clin Oncol 26, 1736–1744 (2021).

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI:


  • External validation
  • Lymph node invasion
  • Nomogram
  • Prostate cancer
  • Radical prostatectomy