Automatic Restoration of Old Motion Picture Films Using Spatiotemporal Exemplar-Based Inpainting

  • Ali Gangal
  • Bekir Dizdaroglu
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4179)


This paper presents a method for automatic removal of local defects such as blotches and impulse noise in old motion picture films. The method is fully automatic and includes the following steps: fuzzy prefiltering, motion-compensated blotch detection, and spatiotemporal inpainting. The fuzzy prefilter removes small defective areas such as impulse noise. Modified bidirectional motion estimation with a predictive diamond search is utilized to estimate the motion vectors. The blotches are detected by the rank-ordered-difference method. Detected missing regions are interpolated by a new exemplar-based inpainting approach that operates on three successive frames. The performance of the proposed method is demonstrated on an artificially corrupted image sequence and on a real motion picture film. The results of the experiments show that the proposed method efficiently removes flashing and still blotches and impulse noise from image sequences.


Motion Vector Motion Estimation Motion Trajectory Current Frame Impulse Noise 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Thoma, R., Bierling, M.: Motion compensating interpolation considering covered and uncovered background. Signal Processing: Image Commun. 1(2), 191–212 (1989)CrossRefGoogle Scholar
  2. 2.
    Kim, M.K., Kim, J.K.: Efficient motion estimation algorithm for bidirectional prediction scheme. IEE Electron. Lett. 30(8), 632–633 (1994)CrossRefGoogle Scholar
  3. 3.
    Goh, W.B., Chong, M.N., Kalra, S., Krishnan, D.: Bi-directional 3D auto-regressive model approach to motion picture restoration. In: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, Atlanta, USA, pp. 2275–2278 (1996)Google Scholar
  4. 4.
    Kokaram, A.C., Morris, R.D., Fitzgerald, W.J., Rayner, J.W.: Detection of missing data in image sequences. IEEE Trans. Image Processing 4(11), 1496–1508 (1995)CrossRefGoogle Scholar
  5. 5.
    Nadenau, M.J., Mitra, S.K.: Blotch and scratch detection in image sequences based on rank ordered differences. In: Proceedings of the 5th International Workshop on Time-Varying Image Processing and Moving Object Recognition, Florence, Italy, pp. 1–7 (1996)Google Scholar
  6. 6.
    Armstrong, S., Kokaram, A.C., Rayner, P.J.W.: Restoring video images taken from scratched 2-inch tape. In: Marshall, S., Harvey, N., Shah, D. (eds.) Workshop on Non-Linear Model Based Image Analysis (NMBIA 1998), pp. 83–88. Springer, Heidelberg (1998)Google Scholar
  7. 7.
    Gangal, A., Kayıkcioglu, T., Dizdaroglu, B.: An improved motion-compensated restoration method for damaged color motion picture films. Signal Processing: Image Commun. 19, 353–368 (2004)CrossRefGoogle Scholar
  8. 8.
    Criminisi, A., Perez, P., Toyama, K.: Region filling and object removal by exemplar-based inpainting. IEEE Trans. Image Processing 13(9), 1200–1212 (2004)CrossRefGoogle Scholar
  9. 9.
    Bertalmio, M., Vese, L., Sapiro, G.: Simultaneous structure and texture image inpainting. IEEE Trans. Image Processing 12(8), 882–889 (2003)CrossRefGoogle Scholar
  10. 10.
    Kwan, H.K.: Fuzzy filters for noisy image filtering. In: Proceedings of the 2003 International Symposium on Circuits and Systems (ISCAS 2003), vol. 4, pp. 161–164 (2003)Google Scholar
  11. 11.
    Tourapis, A.M., Shen, G., Liou, M.L., Au, O.C., Ahmad, I.: A new predictive diamond search algorithm for block based motion estimation. In: Ngan, K.N., Sikora, T., Sun, M.T. (eds.) Proceedings of Visual Communication and Image Processing, Perth, Australia, pp. 1365–1373 (2000)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Ali Gangal
    • 1
  • Bekir Dizdaroglu
    • 2
  1. 1.Department of Electrical and Electronics EngineeringKaradeniz Technical UniversityTrabzonTurkey
  2. 2.Program of Computer Technology and Programming, Besikduzu Vocational SchoolKaradeniz Technical UniversityTrabzonTurkey

Personalised recommendations