Real-Time Spherical Mosaicing Using Whole Image Alignment

  • Steven Lovegrove
  • Andrew J. Davison
Conference paper

DOI: 10.1007/978-3-642-15558-1_6

Part of the Lecture Notes in Computer Science book series (LNCS, volume 6313)
Cite this paper as:
Lovegrove S., Davison A.J. (2010) Real-Time Spherical Mosaicing Using Whole Image Alignment. In: Daniilidis K., Maragos P., Paragios N. (eds) Computer Vision – ECCV 2010. ECCV 2010. Lecture Notes in Computer Science, vol 6313. Springer, Berlin, Heidelberg

Abstract

When a purely rotating camera observes a general scene, overlapping views are related by a parallax-free warp which can be estimated by direct image alignment methods that iterate to optimise photo-consistency. However, building globally consistent mosaics from video has usually been tackled as an off-line task, while sequential methods suitable for real-time implementation have often suffered from long-term drift. In this paper we present a high performance real-time video mosaicing algorithm based on parallel image alignment via ESM (Efficient Second-order Minimisation) and global optimisation of a map of keyframes over the whole viewsphere. We present real-time results for drift-free camera rotation tracking and globally consistent spherical mosaicing from a variety of cameras in real scenes, demonstrating high global accuracy and the ability to track very rapid rotation while maintaining solid 30Hz operation. We also show that automatic camera calibration refinement can be straightforwardly built into our framework.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Steven Lovegrove
    • 1
  • Andrew J. Davison
    • 1
  1. 1.Imperial College LondonLondonUK

Personalised recommendations