International Journal of Computer Vision

, Volume 47, Issue 1, pp 229-246

First online:

Real-Time Correlation-Based Stereo Vision with Reduced Border Errors

  • Heiko HirschmüllerAffiliated withCentre for Computational Intelligence, De Montfort University
  • , Peter R. InnocentAffiliated withCentre for Computational Intelligence, De Montfort University
  • , Jon GaribaldiAffiliated withCentre for Computational Intelligence, De Montfort University

Rent the article at a discount

Rent now

* Final gross prices may vary according to local VAT.

Get Access


This paper describes a real-time stereo vision system that is required to support high-level object based tasks in a tele-operated environment. Stereo vision is computationally expensive, due to having to find corresponding pixels. Correlation is a fast, standard way to solve the correspondence problem. This paper analyses the behaviour of correlation based stereo to find ways to improve its quality while maintaining its real-time suitability. Three methods are suggested. Two of them aim to improve the disparity image especially at depth discontinuities, while one targets the identification of possible errors in general. Results are given on real stereo images with ground truth. A comparison with five standard correlation methods is provided. All proposed algorithms are described in detail and performance issues and optimisation are discussed. Finally, performance results of individual parts of the stereo algorithm are shown, including rectification, filtering andcorrelation using all proposed methods. The implemented system shows that errors of simple stereo correlation, especially in object border regions, can be reduced in real-time using non-specialised computer hardware.

stereo vision real-time correlation problems multiple correlation windows object border correction