Abstract
Separating a foreground layer from stereo video in real-time is used in many applications such as live background substitution. Conventional separating models using stereo, contrast or color alone are usually not accurate enough to be satisfactory. Furthermore, the powerful tool of graph cut which is well suited for segmentation is known to be not efficient enough especially for high resolution images. In this paper, we conquer these difficulties by fusing stereo with color and contrast to model the segmentation problem as an minimum cut problem of a planar graph and solving it by a specialized algorithm, parametric shortest paths [8] with a dynamic tree structure, in O(nlogn) time. Experimental results demonstrate the high accuracy and efficiency of the algorithm.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Acar, U.A., Blelloch, G.E., Harper, R., Vittes, J.L., Woo, S.L.M.: Dynamizing static algorithms, with applications to dynamic trees and history independence. In: Proc. 15th Ann. ACM-SIAM Symp. Discrete Algorithms, pp. 531–540 (2004)
Alstrup, S., Holm, J., De Lichtenberg, K., Thorup, M.: Maintaining information in fully dynamic trees with top trees. ACM Trans. Algorithms 1(2), 243–264 (2005)
Baker, S., Szeliski, R., Anandan, P.: A layered approach to stereo reconstruction. In: Proc. CVPR, Santa Barbara, pp. 434–441 (1998)
Boykov, Y., Jolly, M.-P.: Interactive graph cuts for optimal boundary and region segmentation of objects in N-D images. In: Proc. Int. Conf. on Computer Vision (2001)
Boykov, Y., Kolmogorov, V.: An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. IEEE PAMI 26(9), 1124–1137 (2004)
Boykov, Y., Veksler, O., Zabih, R.: Fast approximate energy minimization via graph cuts. IEEE Trans. on PAMI 23(11) (2001)
Criminisi, A., Shotton, J., Blake, A., Torr, P.H.S.: Gaze manipulation for one to one teleconferencing. In: Proc. ICCV (2003)
Erickson, J.: Maximum flows and parametric shortest paths in planar graphs. In: Proceedings of the 21st Annual ACM-SIAM Symposium on Discrete Algorithms (2010)
Geiger, D., Ladendorf, B., Yuille, A.: Occlusions and binocular stereo. Int. J. Computer Vision 14, 211–226 (1995)
Jojic, N., Frey, B.: Learning flexible sprites in video layers. In: Proc. CVPR, Hawaii (2001)
Kolmogorov, V., Criminisi, A., Blake, A., Cross, G., Rother, C.: Probabilistic fusion of stereo with color and contrast for bilayer segmentation. PAMI 28(8) (2006)
Kolmogorov, V., Zabih, R.: Multi-camera scene reconstruction via graph cuts. In: Proc. ECCV, Copenhagen, Denmark (2002)
Mortensen, E.N., Barrett, W.A.: Intelligent Scissors for Image Composition. In: Computer Graphics (SIGGRAPH 1995), Los Angeles, California, pp. 191–198 (1995)
Rother, C., Kolmogorov, V., Blake, A.: GrabCut–Interactive foreground extraction using iterated graph cuts. In: Proc. ACM Siggraph (2004)
Rowe, S.M., Blake, A.: Statistical mosaics for tracking. J. Image and Vision Computing 14, 549–564 (1996)
Sleator, D.D., Tarjan, R.E.: A data structure for dynamic trees. In: JCSS, pp. 362–391 (1981)
Stauffer, C., Grimson, W.E.L.: Adaptive background mixture models for real-time tracking. In: Proc. CVPR, pp. 246–252 (1999)
Tarjan, R.E., Werneck, R.F.: Self-adjusting top trees. In: Proc. 16th Ann. ACM-SIAM Symp. Discrete Algorithms, pp. 813–822 (2005)
Torr, P.H.S., Szeliski, R., Anandan, P.: An integrated Baysesian approach to layer extraction from image sequences. PAMI (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Huang, X., Gong, L. (2011). Shortest Path Based Planar Graph Cuts for Bi-layer Segmentation of Binocular Stereo Video. In: Koch, R., Huang, F. (eds) Computer Vision – ACCV 2010 Workshops. ACCV 2010. Lecture Notes in Computer Science, vol 6469. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-22819-3_9
Download citation
DOI: https://doi.org/10.1007/978-3-642-22819-3_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-22818-6
Online ISBN: 978-3-642-22819-3
eBook Packages: Computer ScienceComputer Science (R0)