Synchronization of Video Sequences from Free-Moving Cameras
We present a new method for the synchronization of a pair of video sequences and the spatial registration of all the temporally corresponding frames. This is a mandatory step to perform a pixel wise comparison of a pair of videos. Several proposals for video matching can be found in the literature, with a variety of applications like object detection, visual sensor fusion, high dynamic range and action recognition. The main contribution of our method is that it is free from three common restrictions assumed in previous works. First, it does not impose any condition on the relative position of the two cameras, since they can move freely. Second, it does not assume a parametric temporal mapping relating the time stamps of the two videos, like a constant or linear time shift. Third, it does not rely on the complete trajectories of image features (points or lines) along time, something difficult to obtain automatically in general. We present our results in the context of the comparison of videos captured from a camera mounted on moving vehicles.
KeywordsVideo Sequence Action Recognition High Dynamic Range Fundamental Matrix Ideal Tracker
Unable to display preview. Download preview PDF.
- 1.Stein, G.P.: Tracking from multiple view points: self calibration of space and time. In: Proc. DARPA Image Understanding Workshop, pp. 521–527 (1998)Google Scholar
- 2.Carceroni, R., Pádua, F., Santos, G., Kutulakos, K.: Linear sequence–to–sequence alignment. In: Proc. IEEE Conf. on Computer Vision and Pattern Recognition, Washington DC, pp. 746–753 (2004)Google Scholar
- 3.Tresadern, P., Reid, I.: Synchronizing image sequences of non–rigid objects. In: British Machine Vision Conf., Norwich, UK, pp. 629–638 (2003)Google Scholar
- 6.Tuytelaars, T., VanGool, L.: Synchronizing video sequences. In: Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition, Washington DC, vol. 1, pp. 762–768 (2004)Google Scholar
- 9.Sand, P., Teller, S.: Video matching. ACM Transactions on Graphics (Proc. SIGGRAPH) 22(3), 592–599 (2004)Google Scholar
- 10.Rao, C., Gritai, A., Sha, M., et al.: View–invariant alignment and matching of video sequences. In: Proc. IEEE Int. Conf. Computer Vision, Nice, France, pp. 939–945 (2003)Google Scholar
- 12.Szeliski, R.: Image alignment and stitching: A tutorial. Technical Report MSR-TR-2004-92, Microsoft Research (2006)Google Scholar