Benchmarking Stereo Data (Not the Matching Algorithms)
Current research in stereo image analysis focuses on improving matching algorithms in terms of accuracy, computational costs, and robustness towards real-time applicability for complex image data and 3D scenes. Interestingly, performance testing takes place for a huge number of algorithms, but, typically, on very small sets of image data only. Even worse, there is little reasoning whether data as commonly applied is actually suitable to prove robustness or even correctness of a particular algorithm. We argue for the need of testing stereo algorithms on a much broader variety of image data then done so far by proposing a simple measure for putting image stereo data of different quality into relation to each other. Potential applications include purpose-directed decisions for the selection of image stereo data for testing the applicability of matching techniques under particular situations, or for realtime estimation of stereo performance (without any need for providing ground truth) in cases where techniques should be selected depending on the given situation.
KeywordsGround Truth Stereo Image Stereo Match Stereo Pair Normalize Cross Correlation
Unable to display preview. Download preview PDF.
- 2.EISATS: enpeda.. image sequence analysis test site, http://www.mi.auckland.ac.nz/EISATS
- 5.Foo, J.J., Sinha, R.: Pruning SIFT for scalable near-duplicate image matching. In: Proc. Australasian Database Conf., pp. 63–71 (2007)Google Scholar
- 9.Kolmogorov, V., Zabih, R.: Computing visual correspondence with occlusions via graph cuts. In: Proc. Int. Conf. Computer Vision, pp. 508–515 (2001)Google Scholar
- 10.Leclerc, Y.G., Luong, Q.-T., Fua, P.V.: Self-consistency, Stereo, MDL, and Change detection. In: Proc. IJCV (2002)Google Scholar
- 14.Nistér, D., Stewénius, H.: Scalable recognition with a vocabulary tree. In: Proc. IEEE Conf. Computer Vision Pattern Recognition, vol. 2, pp. 2161–2168 (2006)Google Scholar
- 15.Ohta, Y., Kanade, T.: Stereo by two-level dynamic programming. In: Proc. Int. Joint Conf. Artificial Intelligence, pp. 1120–1126 (1985)Google Scholar
- 16.Pharr, M., Humphreys, G.: Physically Based Rendering: From Theory to Implementation. Morgan Kaufmann, San Francisco (2004)Google Scholar
- 19.Vedaldi, A., Fulkerson, B.: VLFeat: An open and portable library of computer vision algorithms (2008), http://www.vlfeat.org