Stereo Matching for Wireless Capsule Endoscopy Using Direct Attenuation Model

  • Min-Gyu ParkEmail author
  • Ju Hong Yoon
  • Youngbae Hwang
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11075)


We propose a robust approach to estimate depth maps designed for stereo camera-based wireless capsule endoscopy. Since there is no external light source except ones attached to the capsule, we employ the direct attenuation model to estimate a depth map up to a scale factor. Afterward, we estimate the scale factor by using sparse feature correspondences. Finally, the estimated depth map is used to guide stereo matching to recover the detailed structure of the captured scene. We experimentally verify the proposed method with various images captured by stereo-type endoscopic capsules in the gastrointestinal tract.



This work was supported by ‘The Cross-Ministry Giga KOREA Project’ grant funded by the Korea government(MSIT) (No. K18P0200, Development of 4D reconstruction and dynamic deformable action model based hyper-realistic service technology) and a gift from Intromedic.


  1. 1.
    Ciuti, G., Menciassi, A., Dario, P.: Capsule endoscopy: from current achievements to open challenges. IEEE Rev. Biomed. Eng. 4, 59–72 (2011)CrossRefGoogle Scholar
  2. 2.
    Ciuti, G., Visentini-Scarzanella, M., Dore, A., Menciassi, A., Dario, P., Yang, G.Z.: Intra-operative monocular 3d reconstruction for image-guided navigation in active locomotion capsule endoscopy. In: 2012 4th IEEE RAS EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob), pp. 768–774, June 2012Google Scholar
  3. 3.
    Fan, Y., Meng, M.Q.H., Li, B.: 3d reconstruction of wireless capsule endoscopy images. In: 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology, pp. 5149–5152, August 2010Google Scholar
  4. 4.
    Furukawa, R., Sanomura, Y., Tanaka, S., Yoshida, S., Sagawa, R., Visentini-Scarzanella, M., Kawasaki, H.: 3d endoscope system using doe projector. In: 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 2091–2094, August 2016Google Scholar
  5. 5.
    He, K., Sun, J., Tang, X.: Single image haze removal using dark channel prior. IEEE Trans. Pattern Anal. Mach. Intell. 33(12), 2341–2353 (2011). Scholar
  6. 6.
    Hirschmüller, H.: Stereo processing by semiglobal matching and mutual information. IEEE Trans. Pattern Anal. Mach. Intell. 30(2), 328–341 (2008)CrossRefGoogle Scholar
  7. 7.
    Ma, Z., He, K., Wei, Y., Sun, J., Wu, E.: Constant time weighted median filtering for stereo matching and beyond. In: IEEE International Conference on Computer Vision (ICCV) (2013)Google Scholar
  8. 8.
    Narasimhan, S.G., Nayar, S.K.: Vision and the atmosphere. Int. J. Comput. Vis. 48(3), 233–254 (2002). Scholar
  9. 9.
    Scharstein, D., Szeliski, R.: A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int. J. Comput. Vis. 47, 7–42 (2002)CrossRefGoogle Scholar
  10. 10.
    Scharstein, D., Szeliski, R.: High-accuracy stereo depth maps using structured light. In: Proceedings of the 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2003, pp. 195–202. IEEE Computer Society, Washington, DC, USA (2003).
  11. 11.
    Takeshita, T., Kim, M., Nakajima, Y.: 3-d shape measurement endoscope using a single-lens system. Int. J. Comput. Assist. Radiol. Surg. 8(3), 451–459 (2013). Scholar
  12. 12.
    Tomasi, C., Manduchi, R.: Bilateral filtering for gray and color images. In: IEEE International Conference on Computer Vision (ICCV) (1998)Google Scholar
  13. 13.
    Visentini-Scarzanella, M., Stoyanov, D.: Stereo and shape-from-shading cue fusion for dense 3d reconstruction in endoscopic surgery. In: 3rd Joint Workshop on New Technologies for Computer/Robot Assisted Surgery (CRAS) (2013).

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  1. 1.Intelligent Image Processing Research CenterKorea Electronics Technology Institute (KETI)GwangjuSouth Korea

Personalised recommendations