Abstract
Super-resolution of the alpha matte and the foreground object from a video are jointly attempted in this paper. Instead of super-resolving them independently, we treat super-resolution of the matte and foreground in a combined framework, incorporating the matting equation in the image degradation model. We take multiple adjacent frames from a low-resolution video with non-global motion for increasing the spatial resolution. This ill-posed problem is regularized by employing a Bayesian restoration approach, wherein the high-resolution image is modeled as a Markov Random Field. In matte super-resolution, it is particularly important to preserve fine details at the boundary pixels between the foreground and background. For this purpose, we use a discontinuity-adaptive smoothness prior to include observed data in the solution. This framework is useful in video editing applications for compositing low-resolution objects into high-resolution videos.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Levin, A., Lischinski, D., Weiss, Y.: A closed-form solution to natural image matting. IEEE Trans. Pattern Anal. and Mach. Intell. 30(2), 228–242 (2008)
Chuang, Y.Y., Agarwala, A., Curless, B., Salesin, D.H., Szeliski, R.: Video matting of complex scenes. ACM Transactions on Graphics, 243–248 (2002)
Park, S.C., Park, M.K., Kang, M.G.: Super-resolution image reconstruction: a technical overview. IEEE Signal Processing Magazine 20(3), 21–36 (2003)
Farsiu, S., Robinson, D., Elad, M., Milanfar, P.: Advances and challenges in super-resolution. International Journal of Imaging Systems and Technology 14(2), 47–57 (2004)
Besag, J.: On the statistical analysis of dirty pictures. Journal of Royal Statistics Society 48, 259–302 (1986)
Suresh, K., Rajagopalan, A.: Robust space-variant super-resolution. In: IET International Conference on Visual Information Engineering (2006)
Schultz, R.R., Stevenson, R.: Extraction of high-resolution frames from video sequences. IEEE Transactions on Image Processing 5(6), 996–1011 (1996)
Shen, H., Zhang, L., Huang, B., Li, P.: A map approach for joint motion estimation, segmentation, and super resolution. IEEE Transactions on Image Processing 16(2), 479–490 (2007)
Bhavsar, A.V., Rajagopalan, A.N.: Resolution enhancement for binocular stereo. In: Proc. International Conference on Pattern Recognition, pp. 1–4 (2008)
Rajagopalan, A.N., Bhavsar, A.V., Wallhoff, F., Rigoll, G.: Resolution enhancement of pmd range maps. In: Rigoll, G. (ed.) DAGM 2008. LNCS, vol. 5096, pp. 304–313. Springer, Heidelberg (2008)
Fransens, R., Strecha, C., Van Gool, L.: Optical flow based super-resolution: A probabilistic approach. Computer vision and image understanding 106(1), 106–115 (2007)
Tai, Y.W., Tong, W.S., Tang, C.K.: Perceptually-inspired and edge-directed color image super-resolution (2006)
Dai, S., Han, M., Xu, W., Wu, Y., Gong, Y., Katsaggelos, A.K.: Softcuts: a soft edge smoothness prior for color image super-resolution. IEEE Transactions on Image Processing 18(5), 969–980 (2009)
Joshi, N., Matusik, W., Avidan, S., Pfister, H., Freeman, W.T.: Exploring defocus matting: Nonparametric acceleration, super-resolution, and off-center matting. In: IEEE Computer Graphics and Applications, pp. 43–52 (2007)
Brox, T., Bruhn, A., Papenberg, N., Weickert, J.: High accuracy optical flow estimation based on a theory for warping. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004, Part IV. LNCS, vol. 3024, pp. 25–36. Springer, Heidelberg (2004)
Chari, V.: http://perception.inrialpes.fr/people/chari/myweb/software/
Li, S.: Markov random field modeling in computer vision. Springer, Tokyo (1995)
Chuang, Y.Y.: http://grail.cs.washington.edu/projects/digital-matting/video-matting/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Prabhu, S.M., Rajagopalan, A.N. (2010). Matte Super-Resolution for Compositing. In: Goesele, M., Roth, S., Kuijper, A., Schiele, B., Schindler, K. (eds) Pattern Recognition. DAGM 2010. Lecture Notes in Computer Science, vol 6376. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15986-2_43
Download citation
DOI: https://doi.org/10.1007/978-3-642-15986-2_43
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15985-5
Online ISBN: 978-3-642-15986-2
eBook Packages: Computer ScienceComputer Science (R0)