Journal of Mathematical Imaging and Vision

, Volume 20, Issue 1–2, pp 163–177 | Cite as

Practical, Unified, Motion and Missing Data Treatment in Degraded Video

  • Anil Kokaram


Recently, the problem of automated restoration of archived sequences has caught the attention of the Video Broadcast industry. One of the main problems is deadling with Blotches caused by film abrasion or dirt adhesion. This paper presents a new framework for the simultaneous treatment of missing data and motion in degraded video sequences. Using simple, translational models of motion, a joint solution for the detection, and reconstruction of missing data is proposed. The framework also incorporates the unique notion of dealing with occlusion and uncovering as it pertains to picture building. The idea is to use MCMC to solve the resulting problem articulated under a Bayesian framework, but to deploy purely deterministic mechanisms for dealing with the solution. This results in a relatively fast implementation that unifies many of the pixel-by-pixel schemes previously described in the literature.

video reconstruction statistical interpolation image reconstruction image restoration motion estimation Gibbs sampling Bayesian inference 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    E. Abreu, M. Lightstone, S.K. Mitra, and K. Arakawa, "A new efficient approach for the removal of impulsive noise from highly corrupted images," IEEE Image Processing, pp. 1012–1025, 1996.Google Scholar
  2. 2.
    J. Besag, "On the statistical analysis of dirty pictures," Journal of the Royal Statistical Society B,Vol. 48, pp. 259–302, 1986.Google Scholar
  3. 3.
    E. Dubois and S. Sabri, "Noise reduction in image sequences using motion compensated temporal filtering," IEEE Transactions on Communications,Vol. 32, pp. 826–831, 1984.Google Scholar
  4. 4.
    A. Katsagellos, J. Driessen, S. Efstratiadis, and R. Lagendijk, "Spatio-temporal motion compensated noise filtering of image sequences," in SPIE VCIP, 1989, pp. 61–70.Google Scholar
  5. 5.
    R. Kleihorst, G. de Haan, R. Lagendijk, and J. Biemond, "Motion compensated noise filtering of image sequences," in Signal Processing VI, Elsevier Science, 1992, pp. 1385–1388.Google Scholar
  6. 6.
    A.C. Kokaram, Motion Picture Restoration: Digital Algo-rithms for Artefact Suppression in Degraded Motion Pic-ture Film and Video, Springer Verlag, 1998, ISBN 3-540-76040-7.Google Scholar
  7. 7.
    A. Kokaram and S. Godsill, "A system for reconstruction of missing data in image sequences using sampled 3D AR models and MRF motion priors," in European Conference on Computer Vision 1996, Springer-Verlag, 1996, pp. 613–624.Google Scholar
  8. 8.
    A. Kokaram and S. Godsill, "Joint detection, interpolation, motion and parameter estimation for image sequences with missing data," in IEEE International Conference on Image Processing, IEEE, 1997, pp. 191–194.Google Scholar
  9. 9.
    A. Kokaram, R. Morris, W. Fitzgerald, and P. Rayner, "Detection of missing data in image sequences," IEEE Image Processing, pp. 1496–1508, 1995.Google Scholar
  10. 10.
    A. Kokaram, R. Morris, W. Fitzgerald, and P. Rayner, "Interpolation of missing data in image sequences," IEEE Image Processing, pp. 1509–1519, 1995.Google Scholar
  11. 11.
    A. Kokaram and P. Rayner, "A system for the removal of impulsive noise in image sequences," in SPIE Visual Communications and Image Processing, 1992, pp. 322–331.Google Scholar
  12. 12.
    J. Konrad and E. Dubois, "Bayesian estimation of motion vector fields," IEEE Transactions on Pattern Analysis and Machine Intelligence,Vol. 14, No. 9, 1992.Google Scholar
  13. 13.
    R.D. Morris and W.J. Fitzgerald, "Detection and correction of speckle degradation in image sequences using a 3D markov random field," in Proceedings International Conference on Image Processing: Theory and Applications (IPTA '93), Elsevier, 1993.Google Scholar
  14. 14.
    M.J. Nadenau and S.K. Mitra, "Blotch and scratch detection in image sequences based on rank ordered differences," in 5th International Workshop on Time-Varying Image Processing and Moving Object Recognition, 1996.Google Scholar
  15. 15.
    P.V.M. Roosmalen, R.L. Lagendijk, and J. Biemond, "Noise reduction for image sequences using an oriented pyramid thresh-olding technique," in IEEE International Conference on Image Processing,Vol. 1, pp. 275–378, 1996.Google Scholar
  16. 16.
    J.J.O Ruanaidh and W.J. Fitzgerald, Numerical Bayesian Methods Applied to Signal Processing, Springer-Verlag, Springer Series in Statistics and Computing, 1996.Google Scholar
  17. 17.
    R. Storey, "Electronic detection and concealment of film dirt," SMPTE Journal, pp. 642–647, 1985.Google Scholar

Copyright information

© Kluwer Academic Publishers 2004

Authors and Affiliations

  • Anil Kokaram
    • 1
  1. 1.Electronic and Electrical Engineering Department, Trinity CollegeUniversity of DublinIreland

Personalised recommendations