Three Dimensional Image Inpainting

  • Satoru Morita
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4222)


Recently the method restoring an old picture using the local differential equation on the basis of the geometric measure is proposed. It is necessary to restore an old film and a medical image with noise as well as an old picture. So we extend the method applying for the two dimentional image such as a picture to the three dimensional image such as a time sequence image and a medical image. It is necessary to obtain an object boundary from the original image in order to generate a composite image of good quality, which is difficult to distinguish from the original image. If an object boundary can not be detected, it is difficult to remove the object. In this study, we propose a method for detecting an object boundary and removing it and inpainting its image in a manner that makes it difficult to distinguish from the original image. We extend the image partition method based on the level set method to the method applying for the movie and the medical image to detect an object boundary. We demonstrate its effectiveness by removing a terop from a movie and a tumor from a three dimensional medical image.


Brain Tumor Object Boundary Geometric Measure Dimensional Image Active Contour Model 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Kokaram, A.C., Morris, R.D., Fitzgerald, W.J., Rayner, P.J.W.: Detection of missing data in image sequences. IEEE Transactions on Image Processing 11, 1508–1946 (1995)Google Scholar
  2. 2.
    Bertalmio, M., Sapiro, G., Caselles, V., Ballester, C.: Image inpainting. In: SIGGRAPH 2000, pp. 417–424 (2000)Google Scholar
  3. 3.
    Bertalmio, M., Bertozzi, A.L., Saphiro, G.: Navier-stokes, fluid dynamics and image and video inpainting. In: CVPR 2001, pp. 353–363 (2001)Google Scholar
  4. 4.
    Dori, I., Cohen-Or, I., Yeshurun, H.: Fragment-based image completion. In: SIGGRAPH 2003, pp. 303–312 (2003)Google Scholar
  5. 5.
    Kass, M., Witkin, A., Terzopoulos, D.: Snakes: Active contours models. International Journal of Computer Vision 1, 321–322 (1988)CrossRefGoogle Scholar
  6. 6.
    Cohoen, L.D.: On active contour models and balloons. CVGIP: Image Understanding 53, 211–218 (1991)CrossRefGoogle Scholar
  7. 7.
    Sethian, J.: Curvature and the evalution of fronts. Comm. Math. Physics 101, 487–499 (1985)MATHCrossRefMathSciNetGoogle Scholar
  8. 8.
    Vese, L.A., Chan, T.F.: A multiphase level set framework for image segmentation using the mumford and stah model. International Journal of Computer Vision 50, 271–293 (2002)MATHCrossRefGoogle Scholar
  9. 9.
    Mumford, D., Stah, J.: Optimal approximation by piecewise smooth function adn associated variational problems. Comm. Pure Appl. Math. 42, 577–685 (1989)MATHCrossRefMathSciNetGoogle Scholar
  10. 10.
    Efros, A., Leung, K.: Texture synthesis by non-parametric sampling. In: Proc. of International Conference on Computer Vision, vol. 2, pp. 1033–1038 (1999)Google Scholar
  11. 11.
    Criminisi, A., Perez, P., Toyama, K.: Object removal by exemplar-based inpainting. Proc. of IEEE Computer Vision and Pattern Recognition 2, 721–728 (2003)Google Scholar
  12. 12.
    Wang, J., Adelson, E.: Ieee transactions on image processing special issue: Image sequence compression. CVGIP: Image Understanding 3, 625–638 (1994)Google Scholar
  13. 13.
    Irani, M., Rousso, B., Peleg, S.: Computing occluding and transparent motions. International Journal of Computer Vision 12, 5–16 (1994)CrossRefGoogle Scholar
  14. 14.
    Malladi, R., Sethian, J.A., Vemuri, B.C.: Shape modeling with front propagation: A level set approach. IEEE Trans. of Pattern Analysis and Machine Intelligence 17, 158–175 (1995)CrossRefGoogle Scholar
  15. 15.
    Han, X., Prince, J.L.: A topology preserving level set method for geometric deformable models. CVGIP: Image Understanding 25, 755–768 (2003)Google Scholar
  16. 16.
    Bro-Nielsen, M.: Finite element modeling in surgery simulation. Proc. IEEE 86, 490–503 (1993)CrossRefGoogle Scholar
  17. 17.
    Delingette, H.: Toward realistic soft-tissue odeling in medical simulation. Proc. IEEE 86, 512–523 (1998)CrossRefGoogle Scholar
  18. 18.
    Gross, M.H.: Computing occluding and transparent motions. Computer graphics in medicine: From visualization to surgery simulation 32, 53–56 (1998)Google Scholar
  19. 19.
    Kokaram, A., Godsill, S.J.: Mcmc for joint noise reduction and missing data treatment in degraded video. IEEE Trans. on Signal Processing, Special Issue on MCMC 50, 189–205 (2002)Google Scholar
  20. 20.
    Wexler, Y., Shechtman, E., Irani, M.: Space-time video completion. In: Proc. of CVPR 2004, vol. 1, pp. 120–127 (2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Satoru Morita
    • 1
  1. 1.Faculty of EngineeringYamaguchi UniversityUbeJapan

Personalised recommendations