Skip to main content

Advertisement

SpringerLink
Log in

Inter-reader reliability of the vesical imaging-reporting and data system (VI-RADS) for muscle-invasive bladder cancer: a systematic review and meta-analysis

  • Review
  • Published:
Abdominal Radiology Aims and scope Submit manuscript

Abstract

To evaluate the diagnostic agreement between readers in VI-RADS interpretation to detect muscle-invasive bladder cancer (MIBC) preoperatively, we conducted a systematic review and meta-analysis of the available data. Scopus, PubMed, Web of Science, and Embase databases were systematically searched up to November 13, 2021. Case reports, review articles, editorials, and studies with insufficient data were eliminated. The Quality Appraisal of the Diagnostic Reliability Checklist was used to assess the risk of bias. The degree of agreement was determined by Cohen’s kappa coefficient (κ) for comparison of data. The heterogeneity of these studies was explored using subgroup analysis and meta-regression analysis. The level of confidence was set at 0.05. All analyses were conducted in STATA 16.0. Overall, 19 eligible studies, consisting of 2439 participants, were included in this meta-analysis. The inter-reader agreement for VI-RADS in MIBC detection ranged from κ of 0.45 to 0.96 among included studies. The pooled inter-reader reliability was calculated as 0.76 [95% CI 0.73–0.80; I2 = 92.13%, Q(50) = 635.08, p < 0.01]. Sources of heterogeneity included magnetic strength, T2WI slice thickness, number of readers, sample size, study design, number of centers, year of publication, proportion of male patients, and mean age. There is substantial reliability in VI-RADS interpretation for MIBC among radiologists with various levels of expertise. The high degree of inter-reader agreement for MIBC detection supports the implementation of VI-RADS in routine clinical practice for the staging paradigm of bladder cancer.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  1. Siegel RL, Miller KD, Fuchs HE, Jemal A. Cancer statistics, 2021. CA: A Cancer Journal for Clinicians. 2021;71:7–33.

    Google Scholar 

  2. Soukup V, Čapoun O, Cohen D, Hernandez V, Babjuk M, Burger M, et al. Prognostic performance and reproducibility of the 1973 and 2004/2016 World Health Organization Grading classification systems in non-muscle-invasive bladder cancer: a European Association of Urology non-muscle invasive bladder cancer guidelines panel systematic review. European Urology. 2017;72:801–13.

    Article  PubMed  Google Scholar 

  3. Babjuk M, Burger M, Compérat EM, Gontero P, Mostafid AH, Palou J, et al. European association of urology guidelines on non-muscle-invasive bladder cancer (TaT1 and carcinoma in situ)-2019 update. European Urology. 2019;76:639–57.

    Article  CAS  PubMed  Google Scholar 

  4. Cumberbatch MG, Foerster B, Catto JW, Kamat AM, Kassouf W, Jubber I, et al. Repeat transurethral resection in non-muscle-invasive bladder cancer: a systematic review. European Urology. 2018;73:925–33.

    Article  PubMed  Google Scholar 

  5. Kim LH, Patel MI. Transurethral resection of bladder tumour (TURBT). Translational Andrology and Urology. 2020;9:3056.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Panebianco V, Narumi Y, Altun E, Bochner BH, Efstathiou JA, Hafeez S, et al. Multiparametric magnetic resonance imaging for bladder cancer: development of VI-RADS (Vesical Imaging-Reporting And Data System). European Urology. 2018;74:294–306.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JP, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. Journal of Clinical Epidemiology. 2009;62:e1–e34.

    Article  PubMed  Google Scholar 

  8. Lucas NP, Macaskill P, Irwig L, Bogduk N. The development of a quality appraisal tool for studies of diagnostic reliability (QAREL). Journal of Clinical Epidemiology. 2010;63:854–61.

    Article  PubMed  Google Scholar 

  9. Kundel HL, Polansky M. Measurement of observer agreement. Radiology. 2003;228:303–8.

    Article  PubMed  Google Scholar 

  10. Akcay A, Yagci AB, Celen S, Ozlulerden Y, Turk NS, Furkan U. VI-RADS score and tumor contact length in MRI: A potential method for the detection of muscle invasion in bladder cancer. Clinical Imaging. 2021;77:25–36.

    Article  PubMed  Google Scholar 

  11. Ahn H, Hwang SI, Lee HJ, Choe G, Oh JJ, Jeong SJ, et al. Quantitation of bladder cancer for the prediction of muscle layer invasion as a complement to the vesical imaging-reporting and data system. European Radiology. 2021;31:1656–66.

    Article  PubMed  Google Scholar 

  12. Barchetti G, Simone G, Ceravolo I, Salvo V, Campa R, Del Giudice F, et al. Multiparametric MRI of the bladder: inter-observer agreement and accuracy with the Vesical Imaging-Reporting and Data System (VI-RADS) at a single reference center. European Radiology. 2019;29:5498–506.

    Article  PubMed  Google Scholar 

  13. Cao B, Li Q, Xu P, Chen W, Hu X, Dai C, et al. Preliminary Exploration of the Application of Vesical Imaging‐Reporting and Data System (VI‐RADS) in Post‐treatment Patients with Bladder Cancer: A Prospective Single‐Center Study. Journal of Magnetic Resonance Imaging. 2022;55:275–86.

    Article  PubMed  Google Scholar 

  14. Del Giudice F, Barchetti G, De Berardinis E, Pecoraro M, Salvo V, Simone G, et al. Prospective assessment of vesical imaging reporting and data system (VI-RADS) and its clinical impact on the management of high-risk non-muscle-invasive bladder cancer patients candidate for repeated transurethral resection. European Urology. 2020;77:101–9.

    Article  PubMed  Google Scholar 

  15. Erkoc M, Otunctemur A, Bozkurt M, Can O, Atalay HA, Besiroglu H, et al. The efficacy and reliability of VI‐RADS in determining candidates for repeated transurethral resection in patients with high‐risk non‐muscle invasive bladder cancer. International Journal of Clinical Practice. 2021;75:e14584.

    Article  PubMed  Google Scholar 

  16. Gmeiner J, Garstka N, Helbich TH, Shariat SF, Baltzer PA. Vesical Imaging Reporting and Data System (VI-RADS): Are the individual MRI sequences equivalent in diagnostic performance of high grade NMIBC and MIBC? European Journal of Radiology. 2021;142:109829.

    Article  PubMed  Google Scholar 

  17. Huang S, Bain J, Yiu TW, Gilbourd D, Jain T, Jyoti R. Accuracy of the Vesical Imaging-Reporting and Data System (VIRADS) for pre‐treatment staging of bladder cancer in an Australian cohort. Journal of Medical Imaging and Radiation Oncology. 2021.

  18. Li S, Liang P, Wang Y, Feng C, Shen Y, Hu X, et al. Combining volumetric apparent diffusion coefficient histogram analysis with vesical imaging reporting and data system to predict the muscle invasion of bladder cancer. Abdominal Radiology. 2021:1–10.

  19. Makboul M, Farghaly S, Abdelkawi IF. Multiparametric MRI in differentiation between muscle invasive and non-muscle invasive urinary bladder cancer with vesical imaging reporting and data system (VI-RADS) application. The British Journal of Radiology. 2019;92:20190401.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Marchioni M, Primiceri G, Pizzi AD, Basilico R, Berardinelli F, Mincuzzi E, et al. Could bladder multiparametric MRI be introduced in routine clinical practice? Role of the new VI-RADS score: results from a prospective study. Clinical Genitourinary Cancer. 2020;18:409–15.e1.

    Article  PubMed  Google Scholar 

  21. Metwally MI, Zeed NA, Hamed EM, Elfwakhry RM, Eldin AMA, Sakr A, et al. The validity, reliability, and reviewer acceptance of VI-RADS in assessing muscle invasion by bladder cancer: a multicenter prospective study. European Radiology. 2021:1–13.

  22. Nikulainen I, Salminen AP, Jambor I, Merisaari H, Tammilehto V, Taimen P, et al. Visual MRI T-category versus VI-RADS evaluation from multiparametric MRI in the detection of muscle-invasion in patients with suspected bladder cancer: single centre registered clinical trial (MIB-trial). Scandinavian Journal of Urology. 2021;55:354–60.

    Article  CAS  PubMed  Google Scholar 

  23. Pecoraro M, Del Giudice F, Magliocca F, Simone G, Flammia S, Leonardo C, et al. Vesical Imaging-Reporting and Data System (VI-RADS) for assessment of response to systemic therapy for bladder cancer: preliminary report. Abdominal Radiology. 2021:1–8.

  24. Ueno Y, Takeuchi M, Tamada T, Sofue K, Takahashi S, Kamishima Y, et al. Diagnostic accuracy and interobserver agreement for the vesical imaging-reporting and data system for muscle-invasive bladder cancer: a multireader validation study. European Urology. 2019;76:54–6.

    Article  PubMed  Google Scholar 

  25. Ueno Y, Tamada T, Takeuchi M, Sofue K, Takahashi S, Kamishima Y, et al. VI-RADS: Multiinstitutional Multireader Diagnostic Accuracy and Interobserver Agreement Study. American Journal of Roentgenology. 2021;216:1257–66.

    Article  PubMed  Google Scholar 

  26. Wang H, Luo C, Zhang F, Guan J, Li S, Yao H, et al. Multiparametric MRI for bladder cancer: validation of VI-RADS for the detection of detrusor muscle invasion. Radiology. 2019;291:668–74.

    Article  PubMed  Google Scholar 

  27. Wang X, Tu N, Sun F, Wen Z, Lan X, Lei Y, et al. Detecting Muscle Invasion of Bladder Cancer Using a Proposed Magnetic Resonance Imaging Strategy. Journal of Magnetic Resonance Imaging. 2021.

  28. Woo S, Ghafoor S, Becker AS, Hricak H, Goh AC, Vargas HA. Prognostic Utility of MRI Features in Intradiverticular Bladder Tumor. Academic Radiology. 2020.

  29. Del Giudice F, Pecoraro M, Vargas HA, Cipollari S, De Berardinis E, Bicchetti M, et al. Systematic review and meta-analysis of vesical imaging-reporting and data system (VI-RADS) inter-observer reliability: An added value for muscle invasive bladder cancer detection. Cancers. 2020;12:2994.

    Article  PubMed Central  Google Scholar 

  30. Jazayeri SB, Dehghanbanadaki H, Hosseini M, Taghipour P, Alam MU, Balaji K, et al. Diagnostic accuracy of vesical imaging-reporting and data system (VI-RADS) in suspected muscle invasive bladder cancer: A systematic review and diagnostic meta-analysis. Urologic Oncology: Seminars and Original Investigations: Elsevier; 2021.

  31. Park KJ, Choi SH, Lee JS, Kim JK, Kim M-H. Interreader agreement with Prostate Imaging Reporting and Data System Version 2 for prostate cancer detection: a systematic review and meta-analysis. The Journal of Urology. 2020;204:661–70.

    Article  PubMed  Google Scholar 

  32. Giganti F, Allen C, Emberton M, Moore CM, Kasivisvanathan V. Prostate Imaging Quality (PI-QUAL): A New Quality Control Scoring System for Multiparametric Magnetic Resonance Imaging of the Prostate from the PRECISION trial. Eur Urol Oncol. 2020;3:615–9.

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Urology, Jacksonville College of Medicine, University of Florida, Jacksonville, FL, 32209, USA

    Seyed Behzad Jazayeri, Hojat Dehghanbanadaki, Mahdie Hosseini, Pourya Taghipour, Soroush Bazargani, Devon Thomas, Allison Feibus, Elnaz Sarabchian, Mark Bandyk & K. C. Balaji

  2. Department of Urology, University of Florida College of Medicine, Gainesville, FL, USA

    Michael W. Bacchus & Elizabeth A. Di Valerio

Authors
  1. Seyed Behzad Jazayeri
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hojat Dehghanbanadaki
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mahdie Hosseini
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Pourya Taghipour
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Soroush Bazargani
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Devon Thomas
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Allison Feibus
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Elnaz Sarabchian
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Michael W. Bacchus
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Elizabeth A. Di Valerio
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Mark Bandyk
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. K. C. Balaji
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Seyed Behzad Jazayeri.

Ethics declarations

Conflict of interest

The authors confirm that there is no conflict of interest to declare.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Below is the link to the electronic supplementary material.

261_2022_3669_MOESM1_ESM.pdf

Supplementary file1 (PDF 198 kb) Supplementary Fig. 1 Forest plot of meta-analysis of the inter-reader agreement of VI-RADS based on sample size subgroups

261_2022_3669_MOESM2_ESM.pdf

Supplementary file2 (PDF 186 kb) Supplementary Fig. 2 Forest plot of meta-analysis of the inter-reader agreement of VI-RADS based on study type

261_2022_3669_MOESM3_ESM.pdf

Supplementary file3 (PDF 210 kb) Supplementary Fig. 3 Forest plot of meta-analysis of the inter-reader agreement of VI-RADS based on the number of participating centers

261_2022_3669_MOESM4_ESM.pdf

Supplementary file4 (PDF 223 kb) Supplementary Fig. 4 Forest plot of meta-analysis of the inter-reader agreement of VI-RADS based on publication year

261_2022_3669_MOESM5_ESM.pdf

Supplementary file5 (PDF 221 kb) Supplementary Fig. 5 Forest plot of meta-analysis of the inter-reader agreement of VI-RADS based on the proportion of male patients

261_2022_3669_MOESM6_ESM.pdf

Supplementary file6 (PDF 282 kb) Supplementary Fig. 6 Forest plot of meta-analysis of the inter-reader agreement of VI-RADS based on age groups of patients

261_2022_3669_MOESM7_ESM.pdf

Supplementary file7 (PDF 247 kb) Supplementary Fig. 7 Forest plot of meta-analysis of the inter-reader agreement of VI-RADS based on the gold standard of history diagnosis

261_2022_3669_MOESM8_ESM.pdf

Supplementary file8 (PDF 263 kb) Supplementary Fig. 8 Forest plot of meta-analysis of the inter-reader agreement of VI-RADS based on the number of readers in the study

261_2022_3669_MOESM9_ESM.pdf

Supplementary file9 (PDF 281 kb) Supplementary Fig. 9 Forest plot of meta-analysis of the inter-reader agreement of VI-RADS based on total years of experience of the radiologists

261_2022_3669_MOESM10_ESM.pdf

Supplementary file10 (PDF 259 kb) Supplementary Fig. 10 Forest plot of meta-analysis of the inter-reader agreement of VI-RADS based on the proportion of muscle-invasive bladder cancer in the study

261_2022_3669_MOESM11_ESM.pdf

Supplementary file11 (PDF 276 kb) Supplementary Fig. 11 Forest plot of meta-analysis of the inter-reader agreement of VI-RADS based on the timing of MRI interval to surgery

261_2022_3669_MOESM12_ESM.pdf

Supplementary file12 (PDF 217 kb) Supplementary Fig. 12 Forest plot of meta-analysis of the inter-reader agreement of VI-RADS based on strength of MRI

261_2022_3669_MOESM13_ESM.pdf

Supplementary file13 (PDF 212 kb) Supplementary Fig. 13 Forest plot of meta-analysis of the inter-reader agreement of VI-RADS based on the thickness of MRI slices

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jazayeri, S.B., Dehghanbanadaki, H., Hosseini, M. et al. Inter-reader reliability of the vesical imaging-reporting and data system (VI-RADS) for muscle-invasive bladder cancer: a systematic review and meta-analysis. Abdom Radiol 47, 4173–4185 (2022). https://doi.org/10.1007/s00261-022-03669-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00261-022-03669-0

Keywords

Search

Navigation