Skip to main content
SpringerLink
Log in

Diagnostic performance and interreader agreement of CEUS LI-RADS in ≤ 30 mm liver nodules with different experienced radiologists

  • Hepatobiliary
  • Published:
Abdominal Radiology Aims and scope Submit manuscript

Abstract

Purpose

To explore the diagnostic performance and interreader agreement of CEUS LI-RADS in diagnosing ≤ 30 mm liver nodules with different experienced radiologists.

Methods

Between January 2018 and October 2020, 244 patients at high-risk for HCC who underwent CEUS were enrolled. Two novice radiologists and two expert radiologists independently evaluated LI-RADS categories and main features. Kappa (κ) and Kendall’s tests were employed to evaluate the interreader agreement of CEUS LI-RADS. The diagnostic performance was determined based on sensitivity, specificity, accuracy, PPV and NPV.

Results

The interreader agreement for arterial phase hyperenhancement, late and mild washout, early washout, and rim hyperenhancement was moderate to almost perfect (κ, 0.44–0.93) among the different levels of radiologists. The interreader agreement for the LI-RADS categories was substantial to almost perfect (κ, 0.78–0.88). However, the interreader agreement for marked washout was fair to moderate (κ, 0.28–0.50). When CEUS LR-5 was used as a diagnostic criterion for HCC, there were no statistical differences in sensitivity, specificity, accuracy, PPV and NPV among the radiologists (p > 0.05), except for the differences between Reader 4 and the remaining three radiologists in terms of accuracy and sensitivity (p < 0.05).

Conclusion

CEUS LI-RADS has good diagnostic agreement for ≤ 30 mm liver nodules among experienced radiologists.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Sung H, Ferlay J, Siegel RL, Laversanne M, Soerjomataram I, Jemal A, Bray F (2021) Global Cancer Statistics 2020: GLOBOCAN Estimates of Incidence and Mortality Worldwide for 36 Cancers in 185 Countries. CA: a cancer journal for clinicians 71 (3):209-249. https://doi.org/10.3322/caac.21660

  2. European Association for Study of L, European Organisation for R, Treatment of C (2012) EASL-EORTC clinical practice guidelines: management of hepatocellular carcinoma. European journal of cancer 48 (5):599-641. https://doi.org/10.1016/j.ejca.2011.12.021

  3. Marrero JA, Kulik LM, Sirlin CB, Zhu AX, Finn RS, Abecassis MM, Roberts LR, Heimbach JK (2018) Diagnosis, Staging, and Management of Hepatocellular Carcinoma: 2018 Practice Guidance by the American Association for the Study of Liver Diseases. Hepatology 68 (2):723-750. https://doi.org/10.1002/hep.29913

  4. European Association for the Study of the Liver. Electronic address eee, European Association for the Study of the L (2018) EASL Clinical Practice Guidelines: Management of hepatocellular carcinoma. Journal of hepatology 69 (1):182-236. https://doi.org/10.1016/j.jhep.2018.03.019

  5. Leoni S, Piscaglia F, Granito A, Borghi A, Galassi M, Marinelli S, Terzi E, Bolondi L (2013) Characterization of primary and recurrent nodules in liver cirrhosis using contrast-enhanced ultrasound: which vascular criteria should be adopted? Ultraschall in der Medizin 34 (3):280-287. https://doi.org/10.1055/s-0033-1335024

  6. Omata M, Lesmana LA, Tateishi R, Chen PJ, Lin SM, Yoshida H, Kudo M, Lee JM, Choi BI, Poon RT, Shiina S, Cheng AL, Jia JD, Obi S, Han KH, Jafri W, Chow P, Lim SG, Chawla YK, Budihusodo U, Gani RA, Lesmana CR, Putranto TA, Liaw YF, Sarin SK (2010) Asian Pacific Association for the Study of the Liver consensus recommendations on hepatocellular carcinoma. Hepatology international 4 (2):439-474. https://doi.org/10.1007/s12072-010-9165-7

  7. Italian Association for the Study of the L, Panel AE, Committee AC, Bolondi L, Cillo U, Colombo M, Craxi A, Farinati F, Giannini EG, Golfieri R, Levrero M, Pinna AD, Piscaglia F, Raimondo G, Trevisani F, Bruno R, Caraceni P, Ciancio A, Coco B, Fraquelli M, Rendina M, Squadrito G, Toniutto P (2013) Position paper of the Italian Association for the Study of the Liver (AISF): the multidisciplinary clinical approach to hepatocellular carcinoma. Digestive and liver disease : official journal of the Italian Society of Gastroenterology and the Italian Association for the Study of the Liver 45 (9):712-723. https://doi.org/10.1016/j.dld.2013.01.012

  8. Kudo M, Matsui O, Izumi N, Iijima H, Kadoya M, Imai Y, Okusaka T, Miyayama S, Tsuchiya K, Ueshima K, Hiraoka A, Ikeda M, Ogasawara S, Yamashita T, Minami T, Yamakado K, Liver Cancer Study Group of J (2014) JSH Consensus-Based Clinical Practice Guidelines for the Management of Hepatocellular Carcinoma: 2014 Update by the Liver Cancer Study Group of Japan. Liver cancer 3 (3-4):458-468. https://doi.org/10.1159/000343875

  9. Zheng W, Li Q, Zou XB, Wang JW, Han F, Li F, Huang LS, Li AH, Zhou JH (2020) Evaluation of Contrast-enhanced US LI-RADS version 2017: Application on 2020 Liver Nodules in Patients with Hepatitis B Infection. Radiology 294 (2):299-307. https://doi.org/10.1148/radiol.2019190878

  10. Claudon M, Dietrich CF, Choi BI, Cosgrove DO, Kudo M, Nolsoe CP, Piscaglia F, Wilson SR, Barr RG, Chammas MC, Chaubal NG, Chen MH, Clevert DA, Correas JM, Ding H, Forsberg F, Fowlkes JB, Gibson RN, Goldberg BB, Lassau N, Leen EL, Mattrey RF, Moriyasu F, Solbiati L, Weskott HP, Xu HX (2013) Guidelines and good clinical practice recommendations for contrast enhanced ultrasound (CEUS) in the liver--update 2012: a WFUMB-EFSUMB initiative in cooperation with representatives of AFSUMB, AIUM, ASUM, FLAUS and ICUS. Ultraschall in der Medizin 34 (1):11-29. https://doi.org/10.1055/s-0032-1325499

  11. Shin J, Lee S, Bae H, Chung YE, Choi JY, Huh YM, Park MS (2020) Contrast-enhanced ultrasound liver imaging reporting and data system for diagnosing hepatocellular carcinoma: A meta-analysis. Liver international : official journal of the International Association for the Study of the Liver 40 (10):2345-2352. https://doi.org/10.1111/liv.14617

  12. Huang JY, Li JW, Lu Q, Luo Y, Lin L, Shi YJ, Li T, Liu JB, Lyshchik A (2020) Diagnostic Accuracy of CEUS LI-RADS for the Characterization of Liver Nodules 20 mm or Smaller in Patients at Risk for Hepatocellular Carcinoma. Radiology 294 (2):329-339. https://doi.org/10.1148/radiol.2019191086

  13. Byun J, Choi SH, Byun JH, Lee SJ, Kim SY, Won HJ, Shin YM, Kim PN (2020) Comparison of the diagnostic performance of imaging criteria for HCCs </= 3.0 cm on gadoxetate disodium-enhanced MRI. Hepatology international 14 (4):534-543. https://doi.org/10.1007/s12072-020-10040-2

  14. Ling W, Wang M, Ma X, Qiu T, Li J, Lu Q, Luo Y (2018) The preliminary application of liver imaging reporting and data system (LI-RADS) with contrast-enhanced ultrasound (CEUS) on small hepatic nodules (</= 2cm). Journal of Cancer 9 (16):2946-2952. https://doi.org/10.7150/jca.25539

  15. Li W, Li L, Zhuang BW, Ruan SM, Hu HT, Huang Y, Lin MX, Xie XY, Kuang M, Lu MD, Chen LD, Wang W (2021) Inter-reader agreement of CEUS LI-RADS among radiologists with different levels of experience. European radiology 31 (9):6758-6767. https://doi.org/10.1007/s00330-021-07777-1

  16. Wang JY, Feng SY, Xu JW, Li J, Chu L, Cui XW, Dietrich CF (2020) Usefulness of the Contrast-Enhanced Ultrasound Liver Imaging Reporting and Data System in Diagnosing Focal Liver Lesions by Inexperienced Radiologists. Journal of ultrasound in medicine: official journal of the American Institute of Ultrasound in Medicine 39 (8):1537-1546. https://doi.org/10.1002/jum.15242

  17. Li J, Ling W, Chen S, Ma L, Yang L, Lu Q, Luo Y (2019) The interreader agreement and validation of contrast-enhanced ultrasound liver imaging reporting and data system. European journal of radiology 120:108685. https://doi.org/10.1016/j.ejrad.2019.108685

  18. Zhou H, Zhang C, Du L, Jiang J, Zhao Q, Sun J, Li Q, Wan M, Wang X, Hou X, Wen Q, Liu Y, Zhou X, Huang P (2020) Contrast-Enhanced Ultrasound Liver Imaging Reporting and Data System in Diagnosing Hepatocellular Carcinoma: Diagnostic Performance and Interobserver Agreement. Ultraschall in der Medizin. https://doi.org/10.1055/a-1168-6321

  19. Yang J, Zhang YH, Li JW, Shi YY, Huang JY, Luo Y, Liu JB, Lu Q (2020) Contrast-enhanced ultrasound in association with serum biomarkers for differentiating combined hepatocellular-cholangiocarcinoma from hepatocellular carcinoma and intrahepatic cholangiocarcinoma. World journal of gastroenterology 26 (46):7325-7337. https://doi.org/10.3748/wjg.v26.i46.7325

Download references

Funding

This study was funded by the National Natural Science Foundation of China (No. 82160336) and Natural Science Foundation of Guangxi, China (No. 2020GXNSFDA238005).

Author information

Author notes

  1. Rong Wen and Peng Lin have contributed equally as first-authors.

Authors and Affiliations

  1. Department of Medical Ultrasound, The First Affiliated Hospital of Guangxi Medical University, No.6 Shuangyong Road, Nanning, 530021, Guangxi Zhuang Autonomous Region, China

    Rong Wen, Peng Lin, Ruizhi Gao, Yuquan Wu, Jinbo Peng, Dongyue Wen, Haihui Yin, Zhiping Tang, Yun He & Hong Yang

  2. Department of Medical Ultrasound, The Second Affiliated Hospital of Guangxi Medical University, Nanning, Guangxi Zhuang Autonomous Region, China

    Yuting Peng

  3. Department of Medical Ultrasound, Guangxi International Zhuang Medical Hospital, Nanning, Guangxi Zhuang Autonomous Region, China

    Zhen Ma

Authors
  1. Rong Wen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Peng Lin
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ruizhi Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yuquan Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jinbo Peng
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Yuting Peng
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Dongyue Wen
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Haihui Yin
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Zhen Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Zhiping Tang
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Yun He
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Hong Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Study concepts and design: HY and YH. Literature research: HHY, ZM and ZPT. Methodology: RW and PL. Data analysis: RW, YTP, YQW and JBP. Statistical analysis: RZG, DYW and RW. Manuscript preparation: RW. Manuscript editing: RW and PL. Study supervision: HY and YH.

Corresponding author

Correspondence to Hong Yang.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical approval

This is an observational study. The Research Ethics Committee has confirmed that no ethical approval is required.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Below is the link to the electronic supplementary material.

Supplementary file1 (DOCX 23 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wen, R., Lin, P., Gao, R. et al. Diagnostic performance and interreader agreement of CEUS LI-RADS in ≤ 30 mm liver nodules with different experienced radiologists. Abdom Radiol 47, 1798–1805 (2022). https://doi.org/10.1007/s00261-022-03468-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00261-022-03468-7

Keywords

Search

Navigation