Occlusions and binocular stereo
Binocular stereo is the process of obtaining depth information from a pair of left and right cameras. In the past occlusions have been regions where stereo algorithms have failed. We show that, on the contrary, they can help stereo computation by providing cues for depth discontinuities.
We describe a theory for stereo based on the Bayesian approach. We suggest that a disparity discontinuity in one eye's coordinate system always corresponds to an occluded region in the other eye thus leading to an occlusion constraint or monotonicity constraint. The constraint restricts the space of possible disparity values, simplifying the computations, and gives a possible explanation for a variety of optical illusions. Using dynamic programming we have been able to find the optimal solution to our system and the experimental results support the model.
KeywordsIllusory Contour Stereo Match Epipolar Line Occlude Region Monotonicity Constraint
Unable to display preview. Download preview PDF.
- [BelMum91]P. Belhumeur and D. Mumford, A Bayesian treatment of the stereo correspondence using half-occluded region, Harvard Robotics Lab, Tech. Repport: December, 1991.Google Scholar
- [BlaZis87]A. Blake and A. Zisserman, Visual Reconstruction, Cambridge, Mass: MIT Press, 1987.Google Scholar
- [ChaGeiMal91]A. Champolle, D. Geiger, and S. Mallat, “Un algorithme multi-échelle de mise encorrespondance stéréo basé sur les champs markoviens,” in 13th GRETSI Conference on Signal and Image Processing, Juan-les-Pins, France, Sept. 1991.Google Scholar
- [GeiGir91]D. Geiger and F. Girosi, “Parallel and deterministic algorithms for mrfs: surface reconstruction,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. PAMI-13, no. 5, pp. 401–412, May 1991.Google Scholar
- [Grimson81]W. E. L. Grimson, From Images to Surfaces, Cambridge, Mass.: MIT Press, 1981.Google Scholar
- [Julesz71]B. Julesz, Foundations of Cyclopean Perception, Chicago: The University of Chicago Press, 1971.Google Scholar
- [KanOku90]T. Kanade and M. Okutomi, “A stereo matching algorithm with an adaptive window: theory and experiments,” in Proc. Image Understanding Workshop DARPA, PA, September 1990.Google Scholar
- [MarPog79]D. Marr and T. Poggio, “A computational theory of human stereo vision,” Proceedings of the Royal Society of London B, vol. 204, pp. 301–328, 1979.Google Scholar
- [OhtKan85]Y. Ohta and T. Kanade, “Stereo by intra-and inter-scanline search using dynamic programming,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. PAMI-7, no. 2, pp. 139–154, 1985.Google Scholar
- [PolMayFri87]S. B. Pollard, J. E. W. Mayhew, and J. P. Frisby, “Disparity gradients and stereo correspondences,” Perception, 1987.Google Scholar
- [Sperling 70]G. Sperling, “Binocular vision: a physical and a neural theory.,” American Journal of Psychology, vol. 83, pp. 461–534, 1967.Google Scholar
- [YuiGeiBul90]A. Yuille, D. Geiger, and H. Bulthoff, “Stereo, mean field theory and psychophysics,” in 1st. ECCV, pp. 73–82, Springer-Verlag, Antibes, France, April 1990.Google Scholar