Abstract
We present a computational framework for stereopsis based on the outputs of linear spatial filters tuned to a range of orientations and scales. This approach goes beyond edge-based and area-based approaches by using a richer image description and incorporating several stereo cues that have previously been neglected in the computer vision literature.
A technique based on using the pseudo-inverse is presented for characterizing the information present in a vector of filter responses. We show how in our framework viewing geometry can be recovered to determine the locations of epipolar lines. An assumption that visible surfaces in the scene are piecewise smooth leads to differential treatment of image regions corresponding to binocularly visible surfaces, surface boundaries, and occluded regions that are only monocularly visible. The constraints imposed by viewing geometry and piecewise smoothness are incorporated into an iterative algorithm that gives good results on random-dot stereograms, artificially generated scenes, and natural grey-level images.
This work has been supported by a grant to DJ from the Natural Sciences and Engineering Research Council of Canada (OGP0105912) and by a National Science Foundation PYI award (IRI-8957274) to JM.
Chapter PDF
References
Arnold RD, Binford TO (1980) Geometric constraints on stereo vision. Proc SPIE 238:281–292
Ayache N, Faverjon B (1987) Efficient registration of stereo images by matching graph descriptions of edge segments. Int J Computer Vision 1(2):107–131
Baker HH, Binford TO (1981) Depth from edge-and intensity-based stereo. Proc 7th IJCAI 631–636
Barnard ST, Thompson WB (1980) Disparity analysis of images. IEEE Trans PAMI 2(4):333–340
Burt P, Julesz B (1980) A disparity gradient limit for binocular function. Science 208:651–657
DeValois R, DeValois K (1988) Spatial vision. Oxford Univ Press
Faugeras O, Maybank S (1990) Motion from point matches: multiplicity of solutions. Int J Computer Vision 4:225–246
Freeman WT, Adelson EH (1991) The design and use of steerable filters. IEEE Trans PAMI 13(9):891–906
Gennery DB (1977) A stereo vision system for autonomous vehicles. Proc 5th IJCAI 576–582
Gillam B, Lawergren B (1983) The induced effect, vertical disparity, and stereoscopic theory. Perception and Psychophysics 36:559–64
Golub GH, Van Loan CF (1983) Matrix computations. The Johns Hopkins Univ Press, Baltimore, MD
Grimson WEL (1981) From images to surfaces. M.I.T Press, Cambridge, Mass
Hannah MJ (1974) Computer matching of areas in images. Stanford AI Memo #239
Hoff W, Ahuja N (1989) Surfaces from stereo: integrating stereo matching, disparity estimation and contour detection. IEEE Trans PAMI 11(2):121–136
Jones, DG (1991) Computational models of binocular vision. PhD Thesis, Stanford Univ
Jones DG, Malik J (1991) A computational framework for determining stereo correspondence from a set of linear spatial filters. U.C. Berkeley Technical Report UCB-CSD 91-655
Jones DG, Malik J (1992) Determining three-dimensional shape from orientation and spatial frequency disparities. Proc ECCV, Genova
Kass M (1983) Computing visual correspondence. DARPA IU Workshop 54–60
Kemp M (Ed) (1989) Leonardo on painting. Yale Univ. Press: New Haven 65–66
Koenderink JJ, van Doom AJ (1987) Representation of local geometry in the visual system. Biol Cybern 55:367–375
Koenderink JJ (1988) Operational significance of receptive field assemblies. Biol Cybern 58:163–171
Marr D, Poggio T (1979) A theory for human stereo vision. Proc Royal Society London B 204:301–328
Mayhew JEW (1982) The interpretation of stereo disparity information: the computation of surface orientation and depth. Perception 11:387–403
Mayhew JEW (1983) Stereopsis. in Physiological and Biological Processing of Images. Braddick OJ, Sleigh AC (Eds) Springer-Verlag, Berlin.
Medioni G, Nevatia R (1985) Segment-based stereo matching. CVGIP 31:2–18
Moravec HP (1977) Towards automatic visual obstacle avoidance. Proc 5th IJCAI
Nakayama K, Shimojo S (1990) DaVinci Stereopsis: Depth and subjective occluding contours from unpaired image points Vision Research 30(11):1811–1825
Perona P (1991) Deformable kernels for early vision. IEEE Proc CVPR 222–227
Pollard SB, Mayhew JEW, Frisby JP (1985) PMF: a stereo correspondence algorithm using a disparity gradient limit. Perception 14:449–470
Young R (1985) The Gaussian derivative theory of spatial vision: analysis of cortical cell receptive field line-weighting profiles. General Motors Research TR #GMR-4920
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1992 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jones, D.G., Malik, J. (1992). A computational framework for determining stereo correspondence from a set of linear spatial filters. In: Sandini, G. (eds) Computer Vision — ECCV'92. ECCV 1992. Lecture Notes in Computer Science, vol 588. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-55426-2_45
Download citation
DOI: https://doi.org/10.1007/3-540-55426-2_45
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-55426-4
Online ISBN: 978-3-540-47069-4
eBook Packages: Springer Book Archive