International Journal of Computer Vision

, Volume 50, Issue 2, pp 185–201

Rendering by Manifold Hopping

  • Heung-Yeung Shum
  • Lifeng Wang
  • Jin-Xiang Chai
  • Xin Tong
Article

DOI: 10.1023/A:1020398016678

Cite this article as:
Shum, HY., Wang, L., Chai, JX. et al. International Journal of Computer Vision (2002) 50: 185. doi:10.1023/A:1020398016678

Abstract

In this paper, we present a novel image-based rendering technique, which we call manifold hopping. Our technique provides users with perceptually continuous navigation by using only a small number of strategically sampled manifold mosaics or multiperspective panoramas. Manifold hopping has two modes of navigation: moving continuously along any manifold, and discretely between manifolds. An important feature of manifold hopping is that significant data reduction can be achieved without sacrificing output visual fidelity, by carefully adjusting the hopping intervals. A novel view along the manifold is rendered by locally warping a single manifold mosaic using a constant depth assumption, without the need for accurate depth or feature correspondence. The rendering errors caused by manifold hopping can be analyzed in the signed Hough ray space. Experiments with real data demonstrate that we can navigate smoothly in a virtual environment with as little as 88k data compressed from 11 concentric mosaics.

manifold mosaic concentric mosaic perceptually smooth navigation warping plenoptic functions image-based rendering video computing 

Copyright information

© Kluwer Academic Publishers 2002

Authors and Affiliations

  • Heung-Yeung Shum
    • 1
  • Lifeng Wang
    • 1
  • Jin-Xiang Chai
    • 1
  • Xin Tong
    • 1
  1. 1.Microsoft Research, AsiaBeijingP.R. China