3D Shape Recovery from Endoscope Image Based on Both Photometric and Geometric Constraints

  • Yuji Iwahori
  • Keita Tatematsu
  • Tsuyoshi Nakamura
  • Shinji Fukui
  • Robert J. Woodham
  • Kunio Kasugai

Abstract

An endoscope is a medical instrument that acquires images inside the human body. Sometimes, diagnosis requires assessment of the 3-D shape of observed tissue. For example, the pathology of a polyp often is related its geometrical shape. This chapter proposes a new approach for the 3-D shape recovery under the conditions of both point light illumination and perspective projection. The purpose of the proposed approach is to recover the direct shape of an object from an endoscope image using shape-from-shading approach. Observation model is assumed under the condition that both of a camera view point and a point light source are located at the origin and the goal is to recover the (X,Y,Z) coordinates at each point on the object. The previous approaches recover the shape based on Fast Marching Method (FMM) under the condition of parallel light source and orthographic projection, while proposed approach uses optimization technique based on the constraints of image irradiance equation and geometrical constraint. Photometric constraints are derived from the relation of observed image intensity and the surface gradient parameters and the depth parameter at each point, while the geometrical constraints use the geometrical relation between the depth at a point and the surface gradient parameters at the neighboring points. Optimization is used to determine the unique depth parameter at any point using both constraints from an initial point at the local brightest point. Proposed approach is evaluated via simulation and demonstrated through experiment. It is confirmed that the recovered shape improves the better performance than that by the previous approaches.

Keywords

Shape from Shading Endoscope Fast Marching Method Point Light Source Perspective Projection 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Nakatani, H., Abe, K., Miyakawa, A., Terakawa, S.: Three-dimensional measurement endoscope system with virtual rulers. Journal of Biomedical Optics 12(5), 051803-05–051803-06 (2007)Google Scholar
  2. 2.
    Mourgues, F.: Devernay, F.: 3d reconstruction of the operating field for image overlay in 3d-endoscopic surgery. In: Proceedings of the IEEE and ACM International Symposium on Augmented Reality (ISAR), pp. 191–192. IEEE and ACM (2001)Google Scholar
  3. 3.
    Thormaehlen, T., Broszio, H.: Threedimensional endoscopy. In: Falk Symposium, Falk, pp. 199–212 (2001)Google Scholar
  4. 4.
    Horn, B.K.: Obtaining shape from shading information. In: Psychology of Computer Vision, Winston, pp. 115–155. McGraw-Hill (1975)Google Scholar
  5. 5.
    Woodham, R.J.: Photometric method for determining surface orientation from multiple images. Optical Engineering 19(1), 139–144 (1980)CrossRefGoogle Scholar
  6. 6.
    Kimmel, R., Sethian, J.A.: Optimal algorithm for shape from shading and path planning. Journal of Mathematical Imaging and Vision (JMIV) 14(3), 237–244 (2001)CrossRefMATHMathSciNetGoogle Scholar
  7. 7.
    Sethian, J.A.: A fast marching level set method for monotonically advancing fronts. Proceedings of the National Academy of Sciences of the United States of America (PNAS U.S.) 93(4), 1591–1593 (1996)CrossRefMATHMathSciNetGoogle Scholar
  8. 8.
    Yuen, S.Y., Tsui, Y.Y., Chow, C.K.: A fast marching formulation of perspective shape from shading under frontal illumination. Pattern Recognition Letters 28(7), 806–824 (2007)CrossRefGoogle Scholar
  9. 9.
    Iwahori, Y., Sugie, H.: Extending fast marching method under point light source illumination and perspective projection. In: Proceedings of ICPR 2010, IAPR, pp. 1650–1653 (2010)Google Scholar
  10. 10.
    Coleman, T., Li, Y.: An interior, trust region approach for nonlinear minimization subject to bounds. SIAM Journal on Optimization 6, 418–455 (1996)CrossRefMATHMathSciNetGoogle Scholar
  11. 11.
    Iwahori, Y.: Hidezumi, S.: Reconstructing shape from shading images under point light source illumination. In: Proceedings of IEEE 10th International Conference on Pattern Recognition (ICPR 1990), pp. 83–87. IEEE (1990)Google Scholar
  12. 12.
    Shimasaki, Y., Iwahori, Y., Neog, D.R., Woodham, R.J., Bhuyan, M.K.: Generating lambertian image with uniform reflectance for endoscope image. In: International Workshop on Advanced Image Technology(IWAIT2013), 1C-2 (Computer Vision 1), pp. 1–6 (2013)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Yuji Iwahori
    • 1
  • Keita Tatematsu
    • 2
  • Tsuyoshi Nakamura
    • 2
  • Shinji Fukui
    • 3
  • Robert J. Woodham
    • 4
  • Kunio Kasugai
    • 5
  1. 1.Dept. of Computer ScienceChubu UniversityKasugaiJapan
  2. 2.Dept. of Computer ScienceNagoya Institute of TechnologyShowa-kuJapan
  3. 3.Faculty of EducationAichi University of EducationIgaya-choJapan
  4. 4.Dept. of Computer ScienceUniversity of British ColumbiaVancouverCanada
  5. 5.Aichi Medical UniversityNagakuteJapan

Personalised recommendations