LNDetector: A Flexible Gaze Characterisation Collaborative Platform for Pulmonary Nodule Screening

  • João PedrosaEmail author
  • Guilherme Aresta
  • João Rebelo
  • Eduardo Negrão
  • Isabel Ramos
  • António Cunha
  • Aurélio Campilho
Conference paper
Part of the IFMBE Proceedings book series (IFMBE, volume 76)


Lung cancer is the deadliest type of cancer worldwide and late detection is one of the major factors for the low survival rate of patients. Low dose computed tomography has been suggested as a potential early screening tool but manual screening is costly, time-consuming and prone to interobserver variability. This has fueled the development of automatic methods for the detection, segmentation and characterisation of pulmonary nodules but its application to the clinical routine is challenging. In this study, a platform for the development, deployment and testing of pulmonary nodule computer-aided strategies is presented: LNDetector. LNDetector integrates image exploration and nodule annotation tools as well as advanced nodule detection, segmentation and classification methods and gaze characterisation. Different processing modules can easily be implemented or replaced to test their efficiency in clinical environments and the use of gaze analysis allows for the development of collaborative strategies. The potential use of this platform is shown through a combination of visual search, gaze characterisation and automatic nodule detection tools for an efficient and collaborative computer-aided strategy for pulmonary nodule screening.


Lung cancer Low dose computed tomography Pulmonary nodules Computer-aided diagnosis 



This work was financed by the European Regional Development Fund (ERDF) through the Operational Programme for Competitiveness - COMPETE 2020 Programme and by National Funds through the Portuguese Funding agency, FCT - Fundação para a Ciência e Tecnologia within project: PTDC/EEI-SII/6599 /2014 (POCI-01-0145-FEDER-016673).

Conflict of Interest

The authors declare that there is no conflict of interest.


  1. 1.
  2. 2.
    Aresta, G., Araújo, T., Jacobs, C., van Ginneken, B., Cunha, A., Ramos, I., Campilho, A.: Towards an automatic lung cancer screening system in low dose computed tomography. In: Image Analysis for Moving Organ, Breast, and Thoracic Images, pp. 310–318. Springer (2018)Google Scholar
  3. 3.
    Armato, S.G., McLennan, G., Bidaut, L., McNitt-Gray, M.F., Meyer, C.R., Reeves, A.P., Zhao, B., Aberle, D.R., Henschke, C.I., Hoffman, E.A., et al.: The lung image database consortium (LIDC) and image database resource initiative (IDRI): a completed reference database of lung nodules on CT scans. Med. Phys. 38(2), 915–931 (2011)CrossRefGoogle Scholar
  4. 4.
    Gonçalves, L., Novo, J., Campilho, A.: Hessian based approaches for 3D lung nodule segmentation. Expert Syst. Appl. 61, 1–15 (2016)CrossRefGoogle Scholar
  5. 5.
    Goncalves, L., Novo, J., Cunha, A., Campilho, A.: Learning lung nodule malignancy likelihood from radiologist annotations or diagnosis data. J. Med. Biolog. Eng. 38(3), 424–442 (2018)CrossRefGoogle Scholar
  6. 6.
    Gruden, J.F., Ouanounou, S., Tigges, S., Norris, S.D., Klausner, T.S.: Incremental benefit of maximum-intensity-projection images on observer detection of small pulmonary nodules revealed by multidetector CT. Am. J. Roentgenol. 179(1), 149–157 (2002)CrossRefGoogle Scholar
  7. 7.
    Khosravan, N., Celik, H., Turkbey, B., Jones, E.C., Wood, B., Bagci, U.: A collaborative computer aided diagnosis (C-CAD) system with eye-tracking, sparse attentional model, and deep learning. Med. Image Anal. 51, 101–115 (2019)CrossRefGoogle Scholar
  8. 8.
    Kundel, H.L.: Reader error, object recognition, and visual search. In: Medical Imaging 2004: Image Perception, Observer Performance, and Technology Assessment, vol. 5372, pp. 1–12. International Society for Optics and Photonics (2004)Google Scholar
  9. 9.
    Machado, M., Aresta, G., Leitão, P., Carvalho, A.S., Rodrigues, M., Ramos, I., Cunha, A., Campilho, A.: Radiologists’ gaze characterization during lung nodule search in thoracic CT. In: 2018 International Conference on Graphics and Interaction (ICGI), pp. 1–7. IEEE (2018)Google Scholar
  10. 10.
    Millodot, M.: Dictionary of Optometry and Visual Science E-Book. Elsevier Health Sciences, London (2014)Google Scholar
  11. 11.
    Redmon, J., Farhadi, A.: YOLOV3: an incremental improvement. arXiv preprint arXiv:1804.02767 (2018)
  12. 12.
    Setio, A.A.A., Traverso, A., De Bel, T., Berens, M.S., van den Bogaard, C., Cerello, P., Chen, H., Dou, Q., Fantacci, M.E., Geurts, B., et al.: Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: the LUNA16 challenge. Med. Image Anal. 42, 1–13 (2017)CrossRefGoogle Scholar
  13. 13.
    Siegel, R.L., Miller, K.D., Jemal, A.: Cancer statistics. CA. Cancer J. Clin. 69(1), 7–34 (2019) CrossRefGoogle Scholar
  14. 14.
    The National Lung Screening Trial Research Team: Reduced lung-cancer mortality with low-dose computed tomographic screening. N. Engl. J. Med. 365(5), 395–409 (2011)Google Scholar
  15. 15.
    Wang, S., Zhou, M., Liu, Z., Liu, Z., Gu, D., Zang, Y., Dong, D., Gevaert, O., Tian, J.: Central focused convolutional neural networks: developing a data-driven model for lung nodule segmentation. Med. Image Anal. 40, 172–183 (2017)CrossRefGoogle Scholar
  16. 16.
    Wu, B., Zhou, Z., Wang, J., Wang, Y.: Joint learning for pulmonary nodule segmentation, attributes and malignancy prediction. In: 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), pp. 1109–1113. IEEE (2018)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  • João Pedrosa
    • 1
    • 2
    Email author
  • Guilherme Aresta
    • 1
    • 2
  • João Rebelo
    • 3
    • 4
  • Eduardo Negrão
    • 3
    • 4
  • Isabel Ramos
    • 3
    • 4
  • António Cunha
    • 1
    • 5
  • Aurélio Campilho
    • 1
    • 2
  1. 1.Institute for Systems and Computer Engineering, Technology and Science (INESC TEC)PortoPortugal
  2. 2.Faculty of Engineering (FEUP)University of PortoPortoPortugal
  3. 3.Department of RadiologyS. João Hospital CenterPortoPortugal
  4. 4.Faculty of Medicine (FMUP)University of PortoPortoPortugal
  5. 5.University of Trás-os-Montes e Alto Douro (UTAD)Vila RealPortugal

Personalised recommendations