Extracting the Foreground from Video Based on a New Sampling Method

  • Qiaoming Pan
  • Yang ShenEmail author
  • Yanxiao Bao
  • Xiao Lin
  • Jiang Liu
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8971)


In this paper, we propose a new video matting method based on sampling. By detecting the movement of foreground and background objects from video, we define the local transformation which transfer the small areas between different frames in the video. By the local transformation, foreground and the occluded background object can be sampled from neighbor frames. Benefited from temporal consistency, we can get high quality alpha matte. Experiment results show that our method achieves ideal results in the scenes where old method get poor results.


Alpha matting Computer vision Background reconstruction Video matting Image processing 



This work is supported by the Zhejiang Provincial Natural Science Foundation of China, under grant LY13F020019, The Natural Science Foundation of China (No.u1304616).


  1. 1.
    Bai, X., Wang, J., Simons, D., Sapiro, G.: Video snapcut: robust video object cutout using localized classifiers, vol. 28, pp. 70:1–70:11. ACM, New York (July 2009)Google Scholar
  2. 2.
    Brox, T., Bregler, C., Malik, J.: Large displacement optical flow. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 41–48 (2009)Google Scholar
  3. 3.
    Chen, Q., Li, D., Tang, C.-K.: Knn matting. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recogn. (CVPR) 2012, 869–876 (2012)Google Scholar
  4. 4.
    Chen, T., Cheng, M.-M., Tan, P., Shamir, A., Hu, S.-M.: Sketch2photo: internet image montage. ACM Trans. Graph. 28, 124:1–124:10 (2009)Google Scholar
  5. 5.
    Chen, X., Zhou, D., Zhou, S.Z., Zhao, Q., Tan, P.: Image matting with local and nonlocal smooth priors. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (June 2013)Google Scholar
  6. 6.
    Gastal, E.S.L., Oliveira, M.M.: Shared sampling for real-time alpha matting. In: Proceedings of Eurographics Computer Graphics Forum, vol. 29, no. 2, pp. 575–584 (May 2010)Google Scholar
  7. 7.
    Hou, Z.: A background reconstruction algorithm based on pixel intensity classification in remote video surveillance systemGoogle Scholar
  8. 8.
    Lee, P., Wu, Y.: Nonlocal matting. In: The 24th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2011, pp. 2193–2200. IEEE, Colorado Springs (20–25 June 2011)Google Scholar
  9. 9.
    Levin, A., Lischinski, D., Weiss, Y.: A closed form solution to natural image matting. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 61–68. IEEE Computer Society, Washington, DC, USA (2006)Google Scholar
  10. 10.
    Li, Y., Sun, J., Shum, H.-Y.: Video object cut and paste. ACM Trans. Graph. 24, 595–600 (2005)CrossRefGoogle Scholar
  11. 11.
    Rajan, D.: Weighted color and texture sample selection for image matting. In: Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), CVPR 2012, pp. 718–725. IEEE Computer Society, Washington (2012)Google Scholar
  12. 12.
    Shen, Y., Lin, X., Gao, Y., Sheng, B., Liu, Q.: Video composition by optimized 3d mean-value coordinates. Comput. Animat. Virtual Worlds 23(3–4), 179–190 (2012)CrossRefGoogle Scholar
  13. 13.
    Shen, Y., Ma, L., Liu, H., Bao, Y., Chen, Z.: Detecting and extracting natural snow from videos. Inf. Process. Lett. 110(24), 1124–1130 (2010)MathSciNetCrossRefGoogle Scholar
  14. 14.
    Shi, Y., Au, O.C., Pang, J., Tang, K., Sun, W., Zhang, H., Zhu, W., Jia, L.: Color clustering matting. In: ICME, pp. 1–6. IEEE (2013)Google Scholar
  15. 15.
    Varadarajan, S., Karam, L.J., Florencio, D.: Background recovery from video sequences using motion parameters. In: ICASSP 2009: Proceedings of the 2009 IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 989–992. IEEE Computer Society, Washington (2009)Google Scholar
  16. 16.
    Wang, J., Bhat, P., Colburn, R.A., Agrawala, M., Cohen, M.F.: Interactive video cutout. ACM Trans. Graph. 24, 585–594 (2005)CrossRefGoogle Scholar
  17. 17.
    Sorkine, O., Wang, Y.S., Tai, C.-L. Lee, T.-Y.: Optimized scale-and-stretch for image resizing. In: ACM Trans. Graph. Proceedings of ACM SIGGRAPH ASIA, vol. 27, no. 5 (2008)Google Scholar
  18. 18.
    Zheng, Y., Kambhamettu, C.: Learning based digital matting. In: IEEE 12th International Conference on Computer Vision, ICCV 2009, pp. 889–896. IEEE, Kyoto (27 September–4 October 2009)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2015

Authors and Affiliations

  • Qiaoming Pan
    • 1
  • Yang Shen
    • 1
    Email author
  • Yanxiao Bao
    • 1
  • Xiao Lin
    • 2
  • Jiang Liu
    • 1
  1. 1.Lishui UniversityLishuiChina
  2. 2.Luoyang Normal UniversityLuoyangChina

Personalised recommendations