Abstract
We describe a novel method for propagating disparity values using hierarchical segmentation by waterfall and robust regression models. High confidence disparity values obtained by state of the art stereo matching algorithms are interpolated using a coarse to fine approach. We start from a coarse segmentation of the image and try to fit each region’s disparities using robust regression models. If the fit is not satisfying, the process is repeated on a finer region’s segmentation. Erroneous values in the initial sparse disparity maps are generally excluded, as we use robust regressions algorithms and left-right consistency checks. Final disparity maps are therefore not only denser but can also be more accurate. The proposed method is general and independent from the sparse disparity map generation: it can therefore be used as a post-processing step for any stereo-matching algorithm.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Alvarez, L., Deriche, R., Sánchez, J., Weickert, J.: Dense disparity map estimation respecting image discontinuities: a PDE and scale-space based approach. JVCIR 13(1–2), 3–21 (2002)
Ayache, N., Hansen, C.: Rectification of images for binocular and trinocular stereovision. In: ICPR 1988 (1988)
Barron, J.T., Poole, B.: The fast bilateral solver. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9907, pp. 617–632. Springer, Cham (2016). doi:10.1007/978-3-319-46487-9_38
Beucher, S.: Image segmentation and mathematical morphology. Theses, École Nationale Supérieure des Mines de Paris, June 1990
Beucher, S.: Towards a unification of waterfalls, standard and P algorithms, working paper or preprint, January 2013
Bricola, J.-C., Bilodeau, M., Beucher, S.: A top-down methodology to depth map estimation controlled by morphological segmentation. Technical report (2014)
Bricola, J.-C., Bilodeau, M., Beucher, S.: A multi-scale and morphological gradient preserving contrast. In: 14th International Congress for Stereology and Image Analysis, Liège, Belgium, Eric Pirard, July 2015
Bricola, J.-C., Bilodeau, M., Beucher, S.: Morphological processing of stereoscopic image superimpositions for disparity map estimation, working paper or preprint, March 2016
Facciolo, G., de Franchis, C., Meinhardt, E.: MGM: a significantly more global matching for stereovision. In: BMVC (2015)
Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)
Fua, P.: A parallel stereo algorithm that produces dense depth maps and preserves image features. Mach. Vis. Appl. 6(1), 35–49 (1993)
Hirschmüller, H.: Stereo processing by semiglobal matching and mutual information. IEEE Trans. Pattern Anal. Mach. Intell. 30(2), 328–341 (2008)
Itseez. Open source computer vision library. https://github.com/itseez/opencv (2015)
Kanade, T., Okutomi, M.: A stereo matching algorithm with an adaptive window: theory and experiment. In: Proceedings of IEEE ICRA (1991)
Kolmogorov, V.: Graph based algorithms for scene reconstruction from two or more views. Ph.D. thesis, Ithaca, NY, USA (2004). AAI3114475
Konolige, K.: Small vision systems: hardware and implementation. In: Shirai, Y., Hirose, S. (eds.) Robotics Research, pp. 203–212. Springer Nature, London (1998)
Min, D., Choi, S., Lu, J., Ham, B., Sohn, K., Do, M.N.: Fast global image smoothing based on weighted least squares. IEEE Trans. Image Process. 23(12), 5638–5653 (2014)
Moravec, K., Harvey, R., Bangham, J.A.: Improving stereo performance in regions of low texture. In: BMVC (1998)
Ralli, J., Díaz, J., Ros, E.: A method for sparse disparity densification using voting mask propagation. J. Vis. Commun. Image Represent. 21(1), 67–74 (2010)
Ralli, J., Pelayo, F., Diaz, J.: Increasing efficiency in disparity calculation. In: Mele, F., Ramella, G., Santillo, S., Ventriglia, F. (eds.) BVAI 2007. LNCS, vol. 4729, pp. 298–307. Springer Nature, Heidelberg (2007). doi:10.1007/978-3-540-75555-5_28
Salembier, P., Garrido, L.: Binary partition tree as an efficient representation for filtering, segmentation and information retrieval. In: ICIP 1998 (1998)
Scharstein, D., Hirschmüller, H., Kitajima, Y., Krathwohl, G., Nešić, N., Wang, X., Westling, P.: High-resolution stereo datasets with subpixel-accurate ground truth. In: Jiang, X., Hornegger, J., Koch, R. (eds.) GCPR 2014. LNCS, vol. 8753, pp. 31–42. Springer, Cham (2014). doi:10.1007/978-3-319-11752-2_3
Scharstein, D., Szeliski, D.: Stereo matching with non-linear diffusion. In: CVPR (1996)
Vachier, C., Meyer, F.: The viscous watershed transform. J. Math. Imaging Vis. 22(2–3), 251–267 (2005)
Weickert, J.: Anisotropic diffusion in image processing. Ph.D. thesis (1998)
Yang, Q., Wang, L., Yang, R., Stewenius, H., Nister, D.: Stereo matching with color-weighted correlation, hierarchical belief propagation and occlusion handling. In: CVPR (2006)
Zbontar, J., LeCun, Y.: Stereo matching by training a convolutional neural network to compare image patches. CoRR, abs/1510.05970 (2015)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Drouyer, S., Beucher, S., Bilodeau, M., Moreaud, M., Sorbier, L. (2017). Sparse Stereo Disparity Map Densification Using Hierarchical Image Segmentation. In: Angulo, J., Velasco-Forero, S., Meyer, F. (eds) Mathematical Morphology and Its Applications to Signal and Image Processing. ISMM 2017. Lecture Notes in Computer Science(), vol 10225. Springer, Cham. https://doi.org/10.1007/978-3-319-57240-6_14
Download citation
DOI: https://doi.org/10.1007/978-3-319-57240-6_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-57239-0
Online ISBN: 978-3-319-57240-6
eBook Packages: Computer ScienceComputer Science (R0)