Skip to main content

Lung Nodule Segmentation Based on Convolutional Neural Networks Using Multi-orientation and Patchwise Mechanisms

  • Conference paper
  • First Online:
VipIMAGE 2019 (VipIMAGE 2019)

Abstract

Image segmentation is used in several knowledge domains, such as medicine, biology, remote sensing, industrial automation, surveillance and security. More specifically, image segmentation plays a crucial role in various medical imaging applications, as an important part of clinical diagnosis. Deep learning techniques have recently benefited medical image segmentation and classification tasks. In this work, we have explored the use of Convolutional Neural Networks (CNN) for lung nodule segmentation using multi-orientation and patchwise mechanisms. Experiments conducted on the public LIDC-IRI dataset demonstrate that our results were able to reduce the number of false negatives, which is important in this task. High segmentation rates were achieved when compared to medical specialists.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Adams, R., Bischof, L.: Seeded region growing. IEEE Transact. Pattern Anal. Mach. Intell. 16(6), 641–647 (1994)

    Article  Google Scholar 

  2. Alilou, M., Beig, N., Orooji, M., Rajiah, P., Velcheti, V., Rakshit, S., Reddy, N., Yang, M., Jacono, F., Gilkeson, R.C.: An integrated segmentation and shape-based classification scheme for distinguishing adenocarcinomas from granulomas on lung CT. Med. Phys. 44(7), 3556–3569 (2017)

    Article  CAS  Google Scholar 

  3. Amorim, P., Moraes, T., Silva, J., Pedrini, H.: InVesalius: an interactive rendering framework for health care support. In: International Symposium on Visual Computing, pp. 45–54. Springer, Heidelberg (2015)

    Chapter  Google Scholar 

  4. Arik, S.Ö., Chrzanowski, M., Coates, A., Diamos, G., Gibiansky, A., Kang, Y., Li, X., Miller, J., Ng, A., Raiman, J.: Deep voice: real-time neural text-to-speech. In: 34th International Conference on Machine Learning, vol. 70, pp. 195–204. JMLR.org (2017)

    Google Scholar 

  5. Armato, S.G., McLennan, G., Bidaut, L., McNitt-Gray, M.F., Meyer, C.R., Reeves, A.P., Zhao, B., Aberle, D.R., Henschke, C.I., Hoffman, E.A.: The lUng Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): a completed reference database of lung nodules on CT scans. Med. Phys. 38(2), 915–931 (2011)

    Article  Google Scholar 

  6. Bankier, A.A., MacMahon, H., Goo, J.M., Rubin, G.D., Schaefer-Prokop, C.M., Naidich, D.P.: Recommendations for measuring pulmonary nodules at CT: a statement from the fleischner society. Radiology 285(2), 584–600 (2017)

    Article  Google Scholar 

  7. Bobadilla, J.C.M., Pedrini, H.: Lung nodule classification based on deep convolutional neural networks. In: 21st Iberoamerican Congress on Pattern Recognition, pp. 117–124. Springer, Lima (2016)

    Chapter  Google Scholar 

  8. Brebisson, A., Montana, G.: Deep neural networks for anatomical brain segmentation. In: IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 20–28 (2015)

    Google Scholar 

  9. De Boor, C., De Boor, C., Mathématicien, E.U., De Boor, C., De Boor, C.: A Practical Guide to Splines, vol. 27. Springer, New York (1978)

    Book  Google Scholar 

  10. Dennie, C., Thornhill, R., Sethi-Virmani, V., Souza, C.A., Bayanati, H., Gupta, A., Maziak, D.: Role of quantitative computed tomography texture analysis in the differentiation of primary lung cancer and granulomatous nodules. Quant. Imaging Med. Surg. 6(1), 6 (2016)

    PubMed  PubMed Central  Google Scholar 

  11. Farag, A.A., El Munim, H.E.A., Graham, J.H., Farag, A.A.: A novel approach for lung nodules segmentation in chest CT using level sets. IEEE Transact. Image Process. 22(12), 5202–5213 (2013)

    Article  Google Scholar 

  12. Gonzalez, R., Woods, R.: Digital Image Processing. Pearson Education, London (2011)

    Google Scholar 

  13. Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., Bengio, Y.: Generative adversarial nets. In: Advances in Neural Information Processing Systems, pp. 2672–2680 (2014)

    Google Scholar 

  14. Heidinger, B.H., Anderson, K.R., Nemec, U., Costa, D.B., Gangadharan, S.P., VanderLaan, P.A., Bankier, A.A.: Lung adenocarcinoma manifesting as pure ground-glass nodules: correlating CT size, volume, density, and roundness with histopathologic invasion and size. J. Thorac. Oncol. 12(8), 1288–1298 (2017)

    Article  Google Scholar 

  15. Hinton, G.E.: Deep belief networks. Scholarpedia 4(5), 5947 (2009)

    Article  Google Scholar 

  16. Junqueira Amorim, P.H., de Moraes, T.F., Rezende, R.A., Silva, J.V.L., Pedrini, H.: Medical imaging for three-dimensional computer-aided models. In: 3D Printing and Biofabrication, pp. 185–207 (2017)

    Google Scholar 

  17. Kamal, U., Rafi, A.M., Hoque, R., Hasan, M.: Lung Cancer Tumor Region Segmentation Using Recurrent 3D-DenseUNet. arXiv preprint arXiv:1812.01951 (2018)

  18. Khosravan, N., Bagci, U.: Semi-supervised multi-task learning for lung cancer diagnosis. In: 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 710–713. IEEE (2018)

    Google Scholar 

  19. Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)

    Google Scholar 

  20. LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521(7553), 436 (2015)

    Article  CAS  Google Scholar 

  21. Li, W., Jia, F., Hu, Q.: Automatic segmentation of liver tumor in CT images with deep convolutional neural networks. J. Comput. Commun. 3(11), 146 (2015)

    Article  Google Scholar 

  22. Margerie-Mellon, C., Heidinger, B.H., Bankier, A.A.: 2D or 3D measurements of pulmonary nodules: preliminary answers and more open questions. J. Thorac. Dis. 10(2), 547 (2018)

    Article  Google Scholar 

  23. Moeskops, P., Wolterink, J.M., van der Velden, B.H., Gilhuijs, K.G., Leiner, T., Viergever, M.A., Išgum, I.: Deep learning for multi-task medical image segmentation in multiple modalities. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 478–486. Springer, Heidelberg (2016)

    Chapter  Google Scholar 

  24. Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 234–241. Springer, Heidelberg (2015)

    Google Scholar 

  25. Schwartz, W.R., Pedrini, H.: Color textured image segmentation based on spatial dependence using 3D co-occurrence matrices and markov random fields. In: 15th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision, pp. 81–87. Plzen, Czech Republic (2007)

    Google Scholar 

  26. Siegel, R.L., Miller, K.D., Jemal, A.: Cancer statistics. CA Cancer J. Clin. 66(1), 7–30 (2017)

    Article  Google Scholar 

  27. Silva, R.D., Minetto, R., Schwartz, W.R., Pedrini, H.: Satellite image segmentation using wavelet transforms based on color and texture features. In: International Symposium on Visual Computing, pp. 113–122. Springer, Heidelberg (2008)

    Google Scholar 

  28. Sünderhauf, N., Brock, O., Scheirer, W., Hadsell, R., Fox, D., Leitner, J., Upcroft, B., Abbeel, P., Burgard, W., Milford, M.: The limits and potentials of deep learning for robotics. Int. J. Robot. Res. 37(4–5), 405–420 (2018)

    Article  Google Scholar 

  29. Wang, S., Zhou, M., Gevaert, O., Tang, Z., Dong, D., Liu, Z., Tian, J.: A multi-view deep convolutional neural networks for lung nodule segmentation. In: 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 1752–1755. IEEE (2017)

    Google Scholar 

  30. Wang, S., Zhou, M., Liu, Z., Liu, Z., Gu, D., Zang, Y., Dong, D., Gevaert, O., Tian, J.: Central focused convolutional neural networks: developing a data-driven model for lung nodule segmentation. Med. Image Anal. 40, 172–183 (2017)

    Article  Google Scholar 

  31. Ye, X., Beddoe, G., Slabaugh, G.: Automatic graph cut segmentation of lesions in CT using mean shift superpixels. J. Biomed. Imaging 2010, 19 (2010)

    Google Scholar 

  32. Ye, X., Lin, X., Dehmeshki, J., Slabaugh, G., Beddoe, G.: Shape-based computer-aided detection of lung nodules in thoracic CT images. IEEE Transact. Biomed. Eng. 56(7), 1810–1820 (2009)

    Article  Google Scholar 

  33. Zhang, X.L., Wu, J.: Deep belief networks based voice activity detection. IEEE Transact. Audio Speech Lang. Process. 21(4), 697–710 (2013)

    Article  Google Scholar 

Download references

Acknowledgements

The authors are thankful to CNPq (grants #300047/2019-3 and #305169/2015-7) and São Paulo Research Foundation (grant FAPESP #2014/12236-1) for their financial support, as well for the NVidia GPU Grant Program for a Titan Xp donation.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Helio Pedrini .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Amorim, P.H.J., de Moraes, T.F., da Silva, J.V.L., Pedrini, H. (2019). Lung Nodule Segmentation Based on Convolutional Neural Networks Using Multi-orientation and Patchwise Mechanisms. In: Tavares, J., Natal Jorge, R. (eds) VipIMAGE 2019. VipIMAGE 2019. Lecture Notes in Computational Vision and Biomechanics, vol 34. Springer, Cham. https://doi.org/10.1007/978-3-030-32040-9_30

Download citation

Publish with us

Policies and ethics