SpringerLink
Log in

Performance of VI-RADS in predicting muscle-invasive bladder cancer after transurethral resection: a single center retrospective analysis

  • Kidneys, Ureters, Bladder, Retroperitoneum
  • Published:
Abdominal Radiology Aims and scope Submit manuscript

Abstract

Purpose

To assess VIRADS performance and inter-reader agreement for detecting muscle-invasive bladder cancer (MIBC) following transurethral resection of bladder tumor (TURBT).

Methods

An IRB-approved, HIPAA-compliant, retrospective study from 2016 to 2020 included patients with bladder urothelial carcinoma who underwent MRI after TURBT, and cystectomy within 3 months without post-MRI treatments. Three radiologists blinded to pathology results independently reviewed MR images and assigned a VI-RADS score. Sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV) and accuracy of VI-RADS were assessed for diagnosing MIBC using VI-RADS scores ≥ 3 and ≥ 4. Inter-reader agreement was assessed using Gwet’s agreement coefficient (AC) and percent agreement.

Results

The cohort consisted of 70 patients (mean age, 68 years ± 11 [SD]; range 39–85; 58 men) and included 32/70 (46%) with MIBC at cystectomy. ROC analysis revealed an AUC ranging from 0.67 to 0.77 and no pairwise statistical difference between readers (p-values, 0.06, 0.08, 0.97). Percent sensitivity, specificity, PPV, NPV and accuracy for diagnosing MIBC for the three readers ranged from 81.3–93.8, 36.8–55.3, 55.6–60.5, 77.3–87.5, and 62.9–67.1 respectively for VI-RADS score ≥ 3, and 78.1–81.3, 47.4–68.4, 55.6–67.6, 72.0–78.8 and 61.4–72.9 respectively for VI-RADS score ≥ 4. Gwet’s AC was 0.63 [95% confidence interval (CI): 0.49,0.78] for VI-RADS score ≥ 3 with 79% agreement [95% CI 72,87] and 0.54 [95%CI 0.38,0.70] for VI-RADS score ≥ 4 with 76% agreement [95% CI 69,84]. VIRADS performance was not statistically different among 31/70 (44%) patients who received treatments prior to MRI (p ≥ 0.16).

Conclusion

VI-RADS had moderate sensitivity and accuracy but low specificity for detection of MIBC following TURBT, with moderate inter-reader agreement.

Graphical abstract

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. World Health Organization International Agency for Research on Cancer (2020) Cancer today, https://gco.iarc.fr/today/online-analysis-multi-bars, accessed December 2022

  2. Siegel RL, Miller KD, Jemal A. Cancer Statistics (2018) CA Cancer J Clin 68:7-30

    Article  PubMed  Google Scholar 

  3. Netto GJ, Amin MB, Berney DM, Compe EVM, Gill AJ, Hartmann A, Menon S, Raspollini MR, Rubin MA, Srigley JR, Tan PH, Tickoo SK, Tsuzuki T, Turajlic S, Cree I, Moch H (2022) The 2022 World Health Organization classification of tumors of the urinary system and male genital organs—Part B: prostate and urinary tract tumors. J Eur Urol 82(5):469–482. https://doi.org/10.1016/j.eururo.2022.07.002

  4. Schrier BP, Hollander MP, van Rhijn BW, Kiemeney LA, Witjes JA. Prognosis of muscle-invasive bladder cancer: difference between primary and progressive tumours and implications for therapy (2004) Eur Urol 45(3): 292–296. https://doi.org/10.1016/j.eururo.2003.10.006

  5. Antoni S, Ferlay J, Soerjomataram I, Znaor A, Jemal A, Bray F (2017) Bladder Cancer Incidence and Mortality: A Global Overview and Recent Trends. Eur Urol 71(1): 96–108. https://doi.org/10.1016/j.eururo.2016.06.010

  6. Chang SS, Boorjian SA, Chou R, Clark PE, Daneshmand S, Konety BR, Pruthi R, Quale DZ, Ritch CR, Siegne JD, Skinner EC, Smith ND, Mckiernan JM (2016) Diagnosis and treatment of non-muscle invasive bladder cancer: AUA/SUO guideline. J Urol 196(4):1021–1029. org/https://doi.org/10.1016/j.juro.2016.06.049

    Article  PubMed  Google Scholar 

  7. Ark JT, Keegan KA, Barocas DA, Morgan TM, Resnick MJ, You C, Cookson MS, Penson DF, Davis R, Clark PE, Smith JA Jr, Chang SS (2014) Incidence and predictors of understaging in patients with clinical T1 urothelial carcinoma undergoing radical cystectomy. BJU Int 113(6):894–899. https://doi.org/10.1111/bju.12245

  8. Fritsche H-M, Burger M, Svatek RS, Jeldres C, Karakiewicz PI, Novara G, Skinner E, Denzinger S, Fradet Y, Isbarn H, Bastian PJ, Volkmer BG, Montorsi F, Kassouf W, Tilki D, Otto W, Capitanio U, Izawa JI, Ficarra V, Lerner S, Sagalowsky AI, Schoenberg M, Kamat A, Dinney CP, Lotan Y, Shariat SF (2010) Characteristics and outcomes of patients with clinical T1 grade 3 urothelial carcinoma treated with radical cystectomy: results from an international cohort. Eur Urol 57(2):300–9. https://doi.org/10.1016/j.eururo.2009.09.024

  9. Panebianco V, Narumi Y, Altun E, Bochner BH, Efstathiou JA, Hafeez S, Huddart R, Kennish S, Lerner S, Montironi R, Muglia VF, Salomon G, Thomas S, Vargas HA, Witjes JA, Takeuchi M, Barentsz J, Catto JWF (2018) Multiparametric magnetic resonance imaging for bladder cancer: development of VI-RADS (vesical imaging-reporting and data system). Eur Urol 74(3):294–306. https://doi.org/10.1016/j.eururo.2018.04.029

  10. Wang H, Luo C, Zhang F, Guan J, Li S, Yao H, Chen J, Luo J, Chen L, Guo Y (2019) Multiparametric MRI for bladder cancer: validation of VI-RADS for the detection of detrusor muscle invasion. Radiology 291(3):668-674. org/https://doi.org/10.1148/radiol.2019182506

    Article  PubMed  Google Scholar 

  11. Metwally MI, Zeed NA, Hamed EM, Elshetry ASF, Elfwakhry RM, Eldin AMA, Sakr A, Aly SA, Mosallam W, Ziada YMA, Balata R, Harb OA, Basha MAA (2021) The validity, reliability, and reviewer acceptance of VI-RADS in assessing muscle invasion by bladder cancer: a multicenter prospective study. Eur Radiol 31(9);694906961. https://doi.org/10.1007/s00330-021-07765-5

  12. Ueno Y, Tamada T, Takeuchi M, Sofu K, Takahashi S, Kamishima Y, Urase Y, Kido A, Hinata N, Harada K, Fujisawa M, Miyaji Y, Murakami T (2021) VI-RADS: multiinstitutional multireader diagnostic accuracy and interobserver agreement study. AJR 216(5):1257–1266. https://doi.org/10.2214/AJR.20.23604

  13. Ueno Y, Takeuchi M, Tamada T, Sofue K, Takahashi S, Kamishima Y, Hinata N, Harada K, Fujisawa M, Murakami T (2019) Diagnostic accuracy and interobserver agreement for the vesical imaging-reporting and data system for muscle-invasive bladder cancer: a multireader validation study. Eur Urol 76:54-56. org/https://doi.org/10.1016/j.eururo.2019.03.012

    Article  PubMed  Google Scholar 

  14. Wang Z, Shang Y, Luan T, Duan Y, Wang J, Wang H, Hao J (2020) Evaluation of the value of the VI-RADS scoring system in assessing muscle infiltration by bladder cancer. Cancer Imaging 20(26). https://doi.org/10.1186/s40644-020-00304-3

  15. del Giudice F, Barchetti G, de Berardinis E, Pecoraro M, Salvo V, Simone G, Sciarra A, Leonardo C, Gallucci M, Catalano C, Catto JWF, Panebianco V (2020) Prospective assessment of vesical imaging reporting and data system (VI-RADS) and its clinical impact on the management of high-risk non-muscle-invasive bladder cancer patients candidate for repeated transurethral resection. Eur Urol 77(1):101–209. https://doi.org/10.1016/j.eururo.2019.09.029

  16. Barchetti G, Simone G, Ceravolo I, Salvo V, Campa R, del Giudice F, de Berardinis E, Buccilli D, Catalano C, Gallucci M, Catto JWF, Panebianco V (2019) Multiparametric MRI of the bladder: inter-observer agreement and accuracy with the vesical imaging-reporting and data system (VI-RADS) at a single reference center. Eur Radiol 29(10):5498–5506. https://doi.org/10.1007/s00330-019-06117-8

  17. Pecararo M, Takeuchi M, Vargas HA, Muglia VF, Cipollari S, Catalano C, Panebianco V (2020) Overview of VI-RADS in bladder cancer. AJR 214:1259–1268. https://doi.org/10.2214/AJR.20.22763

  18. Kim SH (2019) Validation of vesical imaging reports and data system for assessing muscle invasion in bladder tumor. Abdom Radiol 45(2):491–498. https://doi.org/10.1007/s00261-019-02190-1

  19. Makboul M, Farghaly S, Abdelkawi IF (2019) Multiparametric MRI in differentiation between muscle invasive and non-muscle invasive urinary bladder cancer with vesical imaging reporting and data system (VI-RADS) application. Br J Radiol 92(1104):20190401. https://doi.org/10.1259/bjr.20190401

  20. Luo C, Huang B, Wu Y, Chen J, Chen L (2020) Use of Vesical Imaging-Reporting and Data System (VI-RADS) for detecting the muscle invasion of bladder cancer: a diagnostic meta-analysis. Eur Radiol 30(8):4606–4614. https://doi.org/10.1007/s00330-020-06802-z

  21. van der Pol CB, Shinagare AB, Trumani SH, Preston MA, Vangel MG, Silverman SG (2018) Bladder cancer local staging: multiparametric MRI performance following transurethral resection. Abdom Radiol 43:2412:2423. https://doi.org/10.1007/s00261-017-1449-0

  22. Panebianco V, Narumi Y, Barchetti G, Montironi R, Catto JWF (2019) Should we perform multiparametric magnetic resonance imaging of the bladder before transurethral resection of bladder? time to reconsider the rules. Eur Urol 76(1):57–58. https://doi.org/10.1016/j.eururo.2019.03.046

  23. Gwet KL (2008) Computing inter-rater reliability and its variance in the presence of high agreement. Br J Math Stat Psychol 61:29–48. https://doi.org/10.1348/000711006X126600

  24. Gwet KL (2012) Handbook of inter-rater reliability: the definitive guide to measuring the extent of agreement among multiple raters. 3rd edition. Advanced Analytics Press, Gaithersburg, MD

    Google Scholar 

  25. Tran D, Dolgun NA, Demirhan H (2020). Weighted inter-rater agreement measures for ordinal outcomes. Comm Stat Simul Comput 49(4):989-1003. org/https://doi.org/10.1080/03610918.2018.1490428

    Article  Google Scholar 

  26. Yuan B, Cai L, Cao Q, Wu Q, Zhuang J, Sun X, Zhang Y, Li P, Yang X, Lu Q (2022) Role of vesical imaging-reporting and data system in predicting muscle-invasive bladder cancer: a diagnostic meta-analysis. Int J Urol 29:186–195. https://doi.org/10.1111/iju.14748

  27. Barentsz JO, Jager GJ, van Vierzen PBJ, Witjes, JA, Strijk SP, Peters H, Karssemeijer N, Ruijs SHJ (1996) Staging urinary bladder cancer after transurethral biopsy: value of fast dynamic contrast-enhanced MR imaging. Radiology 201:185–193. https://doi.org/10.1148/radiology.201.1.8816542

  28. Johnson RJ, Carrington BM, Jenkins JPR, Barnard RJ, Read G, Isherwood I (1990) Accuracy in staging carcinoma of the bladder by magnetic resonance imaging. Clin Radiol 41(4):258–263. https://doi.org/10.1016/s0009-9260(05)81661-7

  29. Yoshida S, Koga F, Kawakami S, Ishii C, Tanaka H, Numao N, Sakai Y, Saito K, Masuda H, Fujii Y, Kihara K (2010) Initial experience of diffusion-weighted magnetic resonance imaging to assess therapeutic response to induction chemoradiotherapy against muscle-invasive bladder cancer. J Urol 75(2);387–391. https://doi.org/10.1016/j.urology.2009.06.111

  30. Wang H, Pui M, Guo Y, Yang D, Pan B, Zhou X (2014) Diffusion-weighted MRI in bladder carcinoma: the differentiation between tumor recurrence and benign changes after resection. Abdom Imag 39(1):135–141. https://doi.org/10.1007/s002061-013-0038-0

  31. Jazayeri SB, Dehghanbanadaki H, Hosseini M, Taghipour P, Bazargani S, Thomas D, Feibus A, Sarabchian E, Bacchus MW, Di Valerio EA, Mark Bandyk M, Balaji KC (2022) Inter-reader reliability of the vesical imaging-reporting and data system (VI-RADS) for muscle-invasive bladder cancer: a systematic review and meta-analysis. Abdom Radiol 47:4173–4185. https://doi.org/10.1007/s00261-022-03669-0

  32. Cao B, Li Q, Xu P, Chen W, Hu X, Dai C, Shan Y, Ding Y, Mao W, Liu K, Wu PY, Sun W, Rao S, Zeng M, Jiang S, Zhou J (2022) Preliminary exploration of the application of vesical imaging-reporting and data system (VI-RADS) in post-treatment patients with bladder cancer: a prospective single-center study. JMRI 55(1):257–286. https://doi.org/10.1002/jmri.27807

  33. Meng X, Hu H, Wang Y, Feng C, Hu D, Liu Z, Kamel IR, Li Z (2022) Accuracy and challenges in the vesical imaging-reporting and data system for staging bladder cancer. JMRI 56(2):391–398. https://doi.org/10.1002/jmri.28064

Download references

Acknowledgements

The authors would like to thank Camden P. Bay, PhD for his help with statistical analysis.

Author information

Authors and Affiliations

  1. Division of Abdominal Imaging and Intervention, Department of Radiology, Brigham and Women’s Hospital, 75 Francis Street, Boston, MA, 02115, USA

    Jessie L. Chai, Lauren A. Roller, Stuart G. Silverman & Atul B. Shinagare

  2. Joint Department of Medical Imaging, University Medical Imaging Toronto, University Health Network, University of Toronto, 200 Elizabeth Street, Toronto, ON, M5G 2C4, Canada

    **aoyang Liu

  3. Department of Radiology, Brigham and Women’s Hospital, 75 Francis Street, Boston, MA, 02115, USA

    Zhou Lan

  4. Department of Urology, Brigham and Women’s Hospital, 75 Francis Street, Boston, MA, 02115, USA

    Matthew Mossanen

Authors
  1. Jessie L. Chai
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lauren A. Roller
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. **aoyang Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhou Lan
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Matthew Mossanen
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Stuart G. Silverman
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Atul B. Shinagare
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jessie L. Chai.

Ethics declarations

Conflict of interest

The authors did not receive support from any organization for the submitted work. Jessie L. Chai, MD, Lauren A. Roller, MD, **aoyang Liu, MD, PhD, Zhou Lan, PhD, Matthew Mossanen, MD, MPH, Stuart G. Silverman, MD: None. Atul B. Shinagare, MD: Consultant, Virtualscopics and Imaging Endpoints.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chai, J.L., Roller, L.A., Liu, X. et al. Performance of VI-RADS in predicting muscle-invasive bladder cancer after transurethral resection: a single center retrospective analysis. Abdom Radiol 49, 1593–1602 (2024). https://doi.org/10.1007/s00261-024-04245-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00261-024-04245-4

Keywords

Search

Navigation