Abstract
We propose a novel restoration method for defects and missing regions in video sequences, particularly in application to archive film restoration. Our statistical framework is based on random walks to examine the spatiotemporal path of a degraded pixel, and uses texture features in addition to intensity and motion information traditionally used in previous restoration works. The degraded pixels within a frame are restored in a multiscale framework by updating their features (intensity, motion and texture) at each level with reference to the attributes of normal pixels and other defective pixels in the previous scale as long as they fall within the defective pixel’s random walk-based spatiotemporal neighbourhood. The proposed algorithm is compared against two state-of-the-art methods to demonstrate improved accuracy in restoring synthetic and real degraded image sequences.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Bertalmio, M., Sapiro, G., Caselles, V., Ballester, C.: Image inpainting. In: Proc. SIGGRAPH, pp. 417–424 (2000)
Bornard, R., Lecan, E., Laborelli, L., Chenot, J.H.: Missing data correction in still images and image sequences. In: Proc. MULTIMEDIA, pp. 355–361 (2002)
Chan, T.F., Kang, S.H., Shen, J.: Euler’s elastica and curvature driven diffusions. SIAM J. App. Math. 2, 564–592 (2002)
Chan, T.F., Shen, J.: Image Processing and Analysis. SIAM, Philadelphia (2005)
Criminisi, A., Pérez, P., Toyama, K.: Region filling and object removal by exemplar-based image inpainting. IEEE Trans. IP 13(9), 1–13 (2004)
Efros, A., Freeman, W.T.: Image quilting for texture synthesis and transfer. In: Proc. SIGGRAPH, pp. 341–346 (2001)
Efros, A., Leung, T.: Texture synthesis by non-parametric sampling. In: Proc. ICCV, vol. 2, pp. 1033–1038 (1999)
Esedoglu, S., Shen, J.: Digital inpainting based on the mumford-shah-euler image model. Euro. J. App. Math. 13(4), 353–370 (2002)
Estrada, F., Fleet, D., Jepson, A.: Stochastic image denoising. In: Proc. BMVC (2009)
Gangal, A., Dizdaroglu, B.: Automatic restoration of old motion picture films using spatiotemporal exemplar-based inpainting. In: Blanc-Talon, J., Philips, W., Popescu, D., Scheunders, P. (eds.) ACIVS 2006. LNCS, vol. 4179, pp. 55–66. Springer, Heidelberg (2006)
Grady, L.: Random walk for image segmentation. IEEE Trans. PAMI 28(11), 1768–1783 (2006)
Hamid, M.S., Harvey, N., Marshall, S.: Genetic algorithm optimization of multidimensional grayscale soft morphological filters with applications in film archive restoration. IEEE Trans. CSVT 13(5), 406–416 (2003)
Hardie, R., Boncelet, C.: Lum filters: a class of rank-order-based filters for smoothing and sharpening. IEEE Trans. SP 41(3), 1061–1076 (1993)
Heeger, D.J., Bergen, J.R.: Pyramid-based texture analysis/synthesis. In: Proc. SIGGRAPH, pp. 229–238 (1995)
Kokaram, A.: On missing data treatment for degraded video and film archives: a survey and a new bayesian approach. IEEE Trans. IP 13(3), 397–415 (2004)
Kokaram, A., Godsill, S.: Mcmc for joint noise reduction and missing data treatment in degraded video. IEEE Trans. SP 50(2), 189–205 (2002)
Kokaram, A., Morris, R., Fitzgerald, W., Rayner, P.: Interpolation of missing data in image sequences. IEEE Trans. IP 4(11), 1509–1519 (1995)
Masnou, S., Morel, J.M.: Level lines based disocclusion. In: Proc. ICIP, vol. 3, pp. 259–263 (1998)
Morris, R.: Image Sequence Restoration using Gibbs Distributions. Ph.D. thesis, Cambridge University (1995)
Ojala, T., Pietikainen, M., Maenpaa, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE trans. PAMI 24(7), 971–987 (2002)
Patwardhan, K., Sapiro, G., Bertalmio, M.: Video inpainting of occluding and occluded objects. In: Proc. ICIP, vol. 2, pp. II: 69–72 (2005)
Ren, J., Vlachos, T.: Efficient detection of temporally impulsive dirt impairments in archived films. Signal Processing 87(3), 541–551 (2007)
Roosmalen, P.M.B.V.: Restoration of Archived Film and Video. Ph.D. thesis, Delft University of Technology (1999)
Wang, X., Mirmehdi, M.: HMM based archive film defect detection with spatial and temporal constraints. In: Proc. BMVC (2009)
Wexler, Y., Shechtman, E., Irani, M.: Space-time video completion. In: Proc. CVPR, vol. 1, pp. 120–127 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wang, X., Mirmehdi, M. (2010). Archive Film Restoration Based on Spatiotemporal Random Walks. In: Daniilidis, K., Maragos, P., Paragios, N. (eds) Computer Vision – ECCV 2010. ECCV 2010. Lecture Notes in Computer Science, vol 6315. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15555-0_35
Download citation
DOI: https://doi.org/10.1007/978-3-642-15555-0_35
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15554-3
Online ISBN: 978-3-642-15555-0
eBook Packages: Computer ScienceComputer Science (R0)