Pacific-Rim Symposium on Image and Video Technology

PSIVT 2011: Advances in Image and Video Technology pp 165-177

Temporally Consistent Disparity and Optical Flow via Efficient Spatio-temporal Filtering

  • Asmaa Hosni
  • Christoph Rhemann
  • Michael Bleyer
  • Margrit Gelautz
Conference paper

DOI: 10.1007/978-3-642-25367-6_15

Volume 7087 of the book series Lecture Notes in Computer Science (LNCS)
Cite this paper as:
Hosni A., Rhemann C., Bleyer M., Gelautz M. (2011) Temporally Consistent Disparity and Optical Flow via Efficient Spatio-temporal Filtering. In: Ho YS. (eds) Advances in Image and Video Technology. PSIVT 2011. Lecture Notes in Computer Science, vol 7087. Springer, Berlin, Heidelberg

Abstract

This paper presents a new efficient algorithm for computing temporally consistent disparity maps from video footage. Our method is motivated by recent work [1] that achieves high quality stereo results by smoothing disparity costs with a fast edge-preserving filter. This previous approach was designed to work with single static image pairs and does not maintain temporal coherency of disparity maps when applied to video streams.

The main contribution of our work is to transfer this concept to the spatio-temporal domain in order to efficiently achieve temporally consistent disparity maps, where disparity changes are aligned with spatio-temporal edges of the video sequence. We further show that our method can be used as spatio-temporal regularizer for optical flow estimation. Our approach can be implemented efficiently, achieving real-time results for stereo matching. Quantitative and qualitative results demonstrate that our approach (i) considerably improves over frame-by-frame methods for both stereo and optical flow; and (ii) outperforms the state-of-the-art for local space-time stereo approaches.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Asmaa Hosni
    • 1
  • Christoph Rhemann
    • 1
  • Michael Bleyer
    • 1
  • Margrit Gelautz
    • 1
  1. 1.Institute for Software Technology and Interactive SystemsVienna University of TechnologyViennaAustria