3D Shape Recovery from Endoscope Image Based on Both Photometric and Geometric Constraints
An endoscope is a medical instrument that acquires images inside the human body. Sometimes, diagnosis requires assessment of the 3-D shape of observed tissue. For example, the pathology of a polyp often is related its geometrical shape. This chapter proposes a new approach for the 3-D shape recovery under the conditions of both point light illumination and perspective projection. The purpose of the proposed approach is to recover the direct shape of an object from an endoscope image using shape-from-shading approach. Observation model is assumed under the condition that both of a camera view point and a point light source are located at the origin and the goal is to recover the (X,Y,Z) coordinates at each point on the object. The previous approaches recover the shape based on Fast Marching Method (FMM) under the condition of parallel light source and orthographic projection, while proposed approach uses optimization technique based on the constraints of image irradiance equation and geometrical constraint. Photometric constraints are derived from the relation of observed image intensity and the surface gradient parameters and the depth parameter at each point, while the geometrical constraints use the geometrical relation between the depth at a point and the surface gradient parameters at the neighboring points. Optimization is used to determine the unique depth parameter at any point using both constraints from an initial point at the local brightest point. Proposed approach is evaluated via simulation and demonstrated through experiment. It is confirmed that the recovered shape improves the better performance than that by the previous approaches.
KeywordsShape from Shading Endoscope Fast Marching Method Point Light Source Perspective Projection
Unable to display preview. Download preview PDF.
- 1.Nakatani, H., Abe, K., Miyakawa, A., Terakawa, S.: Three-dimensional measurement endoscope system with virtual rulers. Journal of Biomedical Optics 12(5), 051803-05–051803-06 (2007)Google Scholar
- 2.Mourgues, F.: Devernay, F.: 3d reconstruction of the operating field for image overlay in 3d-endoscopic surgery. In: Proceedings of the IEEE and ACM International Symposium on Augmented Reality (ISAR), pp. 191–192. IEEE and ACM (2001)Google Scholar
- 3.Thormaehlen, T., Broszio, H.: Threedimensional endoscopy. In: Falk Symposium, Falk, pp. 199–212 (2001)Google Scholar
- 4.Horn, B.K.: Obtaining shape from shading information. In: Psychology of Computer Vision, Winston, pp. 115–155. McGraw-Hill (1975)Google Scholar
- 9.Iwahori, Y., Sugie, H.: Extending fast marching method under point light source illumination and perspective projection. In: Proceedings of ICPR 2010, IAPR, pp. 1650–1653 (2010)Google Scholar
- 11.Iwahori, Y.: Hidezumi, S.: Reconstructing shape from shading images under point light source illumination. In: Proceedings of IEEE 10th International Conference on Pattern Recognition (ICPR 1990), pp. 83–87. IEEE (1990)Google Scholar
- 12.Shimasaki, Y., Iwahori, Y., Neog, D.R., Woodham, R.J., Bhuyan, M.K.: Generating lambertian image with uniform reflectance for endoscope image. In: International Workshop on Advanced Image Technology(IWAIT2013), 1C-2 (Computer Vision 1), pp. 1–6 (2013)Google Scholar