Liver Lesion Detection from Weakly-Labeled Multi-phase CT Volumes with a Grouped Single Shot MultiBox Detector

  • Sang-gil Lee
  • Jae Seok Bae
  • Hyunjae Kim
  • Jung Hoon Kim
  • Sungroh Yoon
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11071)


We present a focal liver lesion detection model leveraged by custom-designed multi-phase computed tomography (CT) volumes, which reflects real-world clinical lesion detection practice using a Single Shot MultiBox Detector (SSD). We show that grouped convolutions effectively harness richer information of the multi-phase data for the object detection model, while a naive application of SSD suffers from a generalization gap. We trained and evaluated the modified SSD model and recently proposed variants with our CT dataset of 64 subjects by five-fold cross validation. Our model achieved a 53.3% average precision score and ran in under three seconds per volume, outperforming the original model and state-of-the-art variants. Results show that the one-stage object detection model is a practical solution, which runs in near real-time and can learn an unbiased feature representation from a large-volume real-world detection dataset, which requires less tedious and time consuming construction of the weak phase-level bounding box labels.


Deep learning Liver lesions Detection Multi-phase CT 



This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (Ministry of Science and ICT) [2018R1A2B3001628], the Interdisciplinary Research Initiatives Program from College of Engineering and College of Medicine, Seoul National University (800-20170166), Samsung Research Funding Center of Samsung Electronics under Project Number SRFC-IT1601-05, the Creative Industrial Technology Development Program [No. 10053249] funded by the Ministry of Trade, Industry & Energy (MOTIE, Korea), and the Brain Korea 21 Plus Project in 2018.


  1. 1.
    Stewart, B.W., Wild, C.P.: World cancer report 2014. Health (2017)Google Scholar
  2. 2.
    McGlynn, K.A., London, W.T.: Epidemiology and natural history of hepatocellular carcinoma. Best Pract. Res. Clin. Gastroenterol. 19(1), 3–23 (2005)CrossRefGoogle Scholar
  3. 3.
    Bruix, J., Reig, M., Sherman, M.: Evidence-based diagnosis, staging, and treatment of patients with hepatocellular carcinoma. Gastroenterology 150(4), 835–853 (2016)CrossRefGoogle Scholar
  4. 4.
    Kim, B.R., et al.: Diagnostic performance of gadoxetic acid-enhanced liver MR imaging versus multidetector CT in the detection of dysplastic nodules and early hepatocellular carcinoma. Radiology 285(1), 134–146 (2017)CrossRefGoogle Scholar
  5. 5.
    Heimbach, J.K., et al.: AASLD guidelines for the treatment of hepatocellular carcinoma. Hepatology 67(1), 358–380 (2018)CrossRefGoogle Scholar
  6. 6.
    Christ, P.F.: Automatic liver and lesion segmentation in CT using cascaded fully convolutional neural networks and 3D conditional random fields. In: Ourselin, S., Joskowicz, L., Sabuncu, M.R., Unal, G., Wells, W. (eds.) MICCAI 2016. LNCS, vol. 9901, pp. 415–423. Springer, Cham (2016). Scholar
  7. 7.
    Vorontsov, E., Chartrand, G., Tang, A., Pal, C., Kadoury, S.: Liver lesion segmentation informed by joint liver segmentation. arXiv preprint arXiv:1707.07734
  8. 8.
    Bi, L., Kim, J., Kumar, A., Feng, D.: Automatic liver lesion detection using cascaded deep residual networks. arXiv preprint arXiv:1704.02703
  9. 9.
    Huang, J., et al.: Speed/accuracy trade-offs for modern convolutional object detectors. In: CVPR (2017)Google Scholar
  10. 10.
    Liu, W., et al.: SSD: single shot multibox detector. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9905, pp. 21–37. Springer, Cham (2016). Scholar
  11. 11.
    Simonyan, K., Andrew, Z.: Very deep convolutional networks for large-scale image recognition. In: ICLR (2015)Google Scholar
  12. 12.
    Alex, K., et al.: ImageNet classification with deep convolutional neural networks. In: NIPS (2012)Google Scholar
  13. 13.
    Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. In: NIPS (2015)Google Scholar
  14. 14.
    Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You only look once: unified, real-time object detection. In: CVPR (2016)Google Scholar
  15. 15.
    He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: CVPR (2016)Google Scholar
  16. 16.
    Huang, G., Liu, Z., Weinberger, K. Q., van der Maaten, L.: Densely connected convolutional networks. In: CVPR (2017)Google Scholar
  17. 17.
    Cao, G., et al.: Feature-fused SSD: fast detection for small objects. arXiv preprint arXiv:1709.05054
  18. 18.
    Li, Z., Zhou, F.: FSSD: feature fusion single shot multibox detector. arXiv preprint arXiv:1712.00960
  19. 19.
    Soler, L., et al.: 3D image reconstruction for comparison of algorithm database: a patient-specific anatomical and medical image database (2012)Google Scholar
  20. 20.
    Christ, P.F.: LiTS: liver tumor segmentation challenge. In: ISBI and MICCAI (2017)Google Scholar
  21. 21.
    Diamant, I., Goldberger, J., Klang, E., Amitai, M., Greenspan, H.: Multi-phase liver lesions classification using relevant visual words based on mutual information. In: ISBI (2015)Google Scholar
  22. 22.
    Szegedy, C., et al.: Going deeper with convolutions. In: CVPR (2015)Google Scholar
  23. 23.
    Lin, M., Chen, Q., Yan, S.: Network in network. arXiv preprint arXiv:1312.4400

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  • Sang-gil Lee
    • 1
  • Jae Seok Bae
    • 2
    • 3
  • Hyunjae Kim
    • 1
  • Jung Hoon Kim
    • 2
    • 3
    • 4
  • Sungroh Yoon
    • 1
  1. 1.Electrical and Computer EngineeringSeoul National UniversitySeoulKorea
  2. 2.RadiologySeoul National University HospitalSeoulKorea
  3. 3.RadiologySeoul National University College of MedicineSeoulKorea
  4. 4.Institute of Radiation MedicineSeoul National University Medical Research CenterSeoulKorea

Personalised recommendations