Abstract
Image matting is an essential technique in many image and video editing applications. Although many matting methods have been proposed, it is still a challenge for most to obtain satisfactory matting results in the transparent foreground region of an image. To solve this problem, this paper proposes a novel matting algorithm, i.e. adaptive transparency-based propagation matting (ATPM) algorithm. ATPM algorithm considers image matting from a new slant. We pay attention to the transparencies of the input images and creatively assign them into three categories (highly transparent, strongly transparent and little transparent) according to the transparencies of the foreground objects in the images. Our matting model can make relevant adjustment in terms of the transparency types of the input images. Moreover, many current matting methods do not perform well when the foreground and background regions have similar color distributions. Our method adds texture as an additional feature to effectively discriminate the foreground and background regions. Experimental results on the benchmark dataset show that our method gets high-quality matting results for images of three transparency types, especially provides more accurate results for highly transparent images comparing with the state-of-the-art methods.
Similar content being viewed by others
References
Aksoy Y, Aydin TO, Pollefeys M (2017) Designing effective inter-pixel information flow for natural image matting. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 29–37
Buades A, Coll B, Morel JM (2008) Nonlocal image and movie denoising. Int J Comput Vis 76(2):123–139
Cao G, Li J, He Z, Chen X (2017) Divide and conquer: a self-adaptive approach for high-resolution image matting. In: International conference on virtual reality and visualization, pp 24–30
Chen X, Zou D, Zhao Q, Tan P (2012) Manifold preserving edit propagation. ACM Trans Graph (TOG) 31(6):1–7
Chen Q, Li D, Tang CK (2013) Knn matting. IEEE Trans Pattern Anal Mach Intell 35(9):2175–2188
Chen X, Zou D, Zhiying Zhou S, Zhao Q, Tan P (2013) Image matting with local and nonlocal smooth priors. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 1902–1907
Cho D, Tai YW, Kweon I (2016) Natural image matting using deep convolutional neural networks. In: European conference on computer vision. Springer, pp 626–643
Chuang YY, Curless B, Salesin DH, Szeliski R (2001) A bayesian approach to digital matting. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), vol 2. IEEE, pp 264–271
Feng X, Liang X, Zhang Z (2016) A cluster sampling method for image matting via sparse coding. In: European conference on computer vision. Springer, pp 204–219
Gastal ES, Oliveira MM (2010) Shared sampling for real-time alpha matting. Computer Graphics Forum 29(2):575–584
Grady L, Schiwietz T, Aharon S, Westermann R (2005) Random walks for interactive alpha-matting. In: Proceedings of the IASTED international conference on visualization, imaging and image processing (VIIP), pp 423–429
He K, Rhemann C, Rother C, Tang X, Sun J (2011) A global sampling method for alpha matting. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 2049–2056
He B, Wang G, Ruan Z, Yin X, Pei X, Lin X (2012) Local matting based on sample-pair propagation and iterative refinement. In: Proceedings of the IEEE international conference on image processing (ICIP). IEEE, pp 285–288
Hu WC, Chen WH, Huang DY, Yang CY (2016) Effective image forgery detection of tampered foreground or background image based on image watermarking and alpha mattes. Multimedia Tools and Applications 75(6):3495–3516
Jin M, Kim BK, Song WJ (2014) Adaptive propagation-based color-sampling for alpha matting. IEEE Transactions on Circuits and Systems for Video Technology 24(7):1101–1110
Johnson J, Varnousfaderani ES, Cholakkal H, Rajan D (2016) Sparse coding for alpha matting. IEEE Trans Image Process 25(7):3032–3043
Karacan L, Erdem A, Erdem E (2015) Image matting with kl-divergence based sparse sampling. In: Proceedings of the IEEE international conference on computer vision (ICCV), pp 424–432
Lee P, Wu Y (2011) Nonlocal matting. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 2193–2200
Levin A, Lischinski D, Weiss Y (2008) A closed-form solution to natural image matting. IEEE Trans Pattern Anal Mach Intell 30(2):228–242
Levin A, Rav-Acha A, Lischinski D (2008) Spectral matting. IEEE Trans Pattern Anal Mach Intell 30(10):1699–1712
Li C, Wang P, Zhu X, Pi H (2017) Three-layer graph framework with the sumd feature for alpha matting. Comput Vis Image Underst. https://doi.org/10.1016/j.cviu.2017.06.011
Lin YC, Wang HA, Hsieh YF (2012) Image matting through a web browser. Multimedia Tools and Applications 61(3):551–570
Ojala T, Pietikäinen M, Harwood D (1996) A comparative study of texture measures with classification based on featured distributions. Pattern Recogn 29(1):51–59
Omer I, Werman M (2004) Color lines: image specific color representation. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), vol 2. IEEE, pp 946–953
Porter T, Duff T (1984) Compositing digital images. In: Proceedings of the 11th annual conference on computer graphics and interactive techniques, pp 253–259
Rhemann C, Rother C, Gelautz M (2008) Improving color modeling for alpha matting. In: British machine vision conference 2008, Leeds, September, pp 1155–1164
Rhemann C, Rother C, Wang J, Gelautz M, Kohli P, Rott P (2009) A perceptually motivated online benchmark for image matting. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 1826–1833
Rother C, Kolmogorov V, Blake A (2004) Grabcut: interactive foreground extraction using iterated graph cuts. ACM Trans Graph (TOG) 23(3):309–314
Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326
Ruzon MA, Tomasi C (2000) Alpha estimation in natural images. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), vol 1. IEEE, pp 18–25
Shahrian E, Rajan D (2012) Weighted color and texture sample selection for image matting. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 718–725
Shahrian E, Rajan D, Price B, Cohen S (2013) Improving image matting using comprehensive sampling sets. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 636–643
Sun J, Jia J, Tang CK, Shum HY (2004) Poisson matting. ACM Trans Graph (TOG) 23(3):315–321
Tan G, Chen H, Qi J (2016) A novel image matting method using sparse manual clicks. Multimedia Tools and Applications 75(17):10,213–10,225
Varnousfaderani ES, Rajan D (2013) Weighted color and texture sample selection for image matting. IEEE Trans Image Process 22(11):4260–4270
Wang J, Cohen MF (2005) An iterative optimization approach for unified image segmentation and matting. In: Proceedings of the IEEE international conference on computer vision (ICCV), vol 2. IEEE, pp 936–943
Wang J, Cohen MF (2007) Optimized color sampling for robust matting. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 1–8
Wang J, Agrawala M, Cohen MF (2007) Soft scissors: an interactive tool for realtime high quality matting. ACM Trans Graph (TOG) 26(3):1–9
Wright S (2006) Digital compositing for film and video. Elsevier/Focal Press
Xu N, Price B, Cohen S, Huang T (2017) Deep image matting. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 2970–2979
Xue B, Sapiro G (2007) A geodesic framework for fast interactive image and video segmentation and matting. In: Proceedings of the IEEE international conference on computer vision (ICCV), pp 1–8
Yang CK, Kuo CN (2016) Automatic hair extraction from 2d images. Multimedia Tools and Applications 75(8):4441–4465
Zhang Z, Zhu Q, Xie Y (2012) Learning based alpha matting using support vector regression. In: Proceedings of the IEEE international conference on image processing (ICIP). IEEE, pp 2109–2112
Zheng Y, Kambhamettu C (2009) Learning based digital matting. In: Proceedings of the IEEE international conference on computer vision (ICCV). IEEE, pp 889–896
Zheng Y, Kambhamettu C, Yu J, Bauer T, Steiner K (2008) Fuzzymatte: a computationally efficient scheme for interactive matting. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 1–8
Acknowledgements
This work was partially supported by the National Natural Science Foundation of China (Grant No. 11431002).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interests
The authors declare that they have no conflict of interest.
Informed Consent
Informed consent was obtained from all individual participants included in the study.
Ethical approval
This article does not contain any studies with human participants or animals performed by any of the authors.
Rights and permissions
About this article
Cite this article
Zhu, X., Wang, P. & Huang, Z. Adaptive propagation matting based on transparency of image. Multimed Tools Appl 77, 19089–19112 (2018). https://doi.org/10.1007/s11042-017-5357-7
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-017-5357-7