Towards Multiple Instance Learning and Hermann Weyl’s Discrepancy for Robust Image-Guided Bronchoscopic Intervention

  • Xiongbiao LuoEmail author
  • Hui-Qing Zeng
  • Yan-Ping Du
  • Xiao Cheng
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11768)


This paper proposes an advantageous approach that introduces multiple instance learning (MIL) and Hermann Weyl’s discrepancy (HWD) to improve image-guided bronchoscopic intervention. Numerous 2D-3D registration methods used for bronchoscopic navigation suffer from problematic bronchoscopic video images (e.g., bubbles and collision) that easily collapse the registration optimization since these images remain challenging to precisely calculate the similarity between bronchoscopic real images and virtual renderings generated from CT slices, resulting in inaccurate bronchoscopic navigation. To address this limitation, we develop a new navigation framework that employs a MIL-driven image classification strategy to remove problematic frames and then performs a HWD-enhanced 2D-3D registration procedure. We validate our framework on patient data. The experimental results demonstrate that our effective and accurate navigation method outperforms others approaches. In particular, the average navigation accuracy of position and orientation was improved from (6.8, 18.0) to 3.5 mm, 9.4\(^{\circ }\)).



This work was partly supported by the Fundamental Research Funds for the Central Universities (No. 20720180062) and National Natural Science Foundation of China (No. 61971367).


  1. 1.
    Deguchi, D., et al.: Selective image similarity measure for bronchoscope tracking based on image registration. MedIA 13(4), 621–633 (2009)Google Scholar
  2. 2.
    Soper, T.D., Haynor, D.R., Glenny, R.W., Seibel, E.J.: In vivo validation of a hybrid tracking system for navigation of an ultrathin bronchoscope within peripheral airways. IEEE TBME 57(3), 736–745 (2010)Google Scholar
  3. 3.
    Luo, X., Feuerstein, M., Deguchi, D., Kitasaka, T., Takabatake, H., Mori, K.: Development and comparison of new hybrid motion tracking for bronchoscopic navigation. MedIA 16(3), 577–596 (2012)Google Scholar
  4. 4.
    Luo, X., Wan, Y., He, X., Mori, K.: Observation-driven adaptive differential evolution and its application to accurate and smooth bronchoscope three-dimensional motion tracking. MedIA 24(1), 282–296 (2015)Google Scholar
  5. 5.
    Hofstad, E.F., et al.: Intraoperative localized constrained registration in navigated bronchoscopy. Med. Phys. 44(8), 4204–4212 (2017)CrossRefGoogle Scholar
  6. 6.
    Shen, M., Giannarou, S., Shah, P.L., Yang, G.-Z.: BRANCH: bifurcation recognition for airway navigation based on structural characteristics. In: Descoteaux, M., Maier-Hein, L., Franz, A., Jannin, P., Collins, D.L., Duchesne, S. (eds.) MICCAI 2017. LNCS, vol. 10434, pp. 182–189. Springer, Cham (2017). Scholar
  7. 7.
    Byrnes, P.D., Higgins, W.E.: Efficient bronchoscopic video summarization. IEEE TBME 66(3), 848–863 (2018)Google Scholar
  8. 8.
    Babenko, B., Yang, M.-H., Belongie, S.: Robust object tracking with online multiple instance learning. IEEE TPAMI 33(8), 1619–1632 (2011)CrossRefGoogle Scholar
  9. 9.
    Moser, B.A.: A similarity measure for image and volumetric data based on Hermann Weyl’s discrepancy. IEEE TPAMI 33(11), 2321–2329 (2011)CrossRefGoogle Scholar
  10. 10.
    Maron, O., Ratan, A.L.: Multiple-instance learning for natural scene classification. Proc. ICML 1998, 341–349 (1998)Google Scholar
  11. 11.
    Viola, P., Platt, J.C., Zhang, C.: Multiple instance boosting for object detection. Proc. NIPS 2005, 1417–1426 (2005)Google Scholar
  12. 12.
    Gavin H.: The Levenberg-Marquardt method for nonlinear least squares curve-fitting problems. Technical report, Duke University, USA (2011)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Xiongbiao Luo
    • 1
    Email author
  • Hui-Qing Zeng
    • 2
  • Yan-Ping Du
    • 2
  • Xiao Cheng
    • 2
  1. 1.Department of Computer ScienceXiamen UniversityXiamenChina
  2. 2.Zhongshan Hospital, Xiamen UniversityXiamenChina

Personalised recommendations