Video Synchronization Using Temporal Signals from Epipolar Lines

  • Dmitry Pundik
  • Yael Moses
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6313)


Time synchronization of video sequences in a multi-camera system is necessary for successfully analyzing the acquired visual information. Even if synchronization is established, its quality may deteriorate over time due to a variety of reasons, most notably frame dropping. Consequently, synchronization must be actively maintained. This paper presents a method for online synchronization that relies only on the video sequences. We introduce a novel definition of low level temporal signals computed from epipolar lines. The spatial matching of two such temporal signals is given by the fundamental matrix. Thus, no pixel correspondence is required, bypassing the problem of correspondence changes in the presence of motion. The synchronization is determined from registration of the temporal signals. We consider general video data with substantial movement in the scene, for which high level information may be hard to extract from each individual camera (e.g., computing trajectories in crowded scenes). Furthermore, a trivial correspondence between the sequences is not assumed to exist. The method is online and can be used to resynchronize video sequences every few seconds, with only a small delay. Experiments on indoor and outdoor sequences demonstrate the effectiveness of the method.


Video Sequence Time Shift Temporal Signal Time Synchronization Fundamental Matrix 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Carceroni, R., Padua, F., Santos, G., Kutulakos, K.: Linear sequence-to-sequence alignment. In: Proc. IEEE Conf. Comp. Vision Patt. Recog., vol. 1 (2004)Google Scholar
  2. 2.
    Caspi, Y., Irani, M.: Spatio-temporal alignment of sequences. IEEE Trans. Patt. Anal. Mach. Intell., 1409–1424 (2002)Google Scholar
  3. 3.
    Caspi, Y., Simakov, D., Irani, M.: Feature-based sequence-to-sequence matching. Int. J. of Comp. Vision 68(1), 53–64 (2006)CrossRefGoogle Scholar
  4. 4.
    Dexter, E., Pe’rez, P., Laptev, I.: Multi-view synchronization of human actions and dynamic scenes. In: Proc. British Machine Vision Conference (2009)Google Scholar
  5. 5.
    Hartley, R., Zisserman, A.: Multiple view geometry. Cambridge university press, Cambridge (2000)zbMATHGoogle Scholar
  6. 6.
    Lei, C., Yang, Y.: Tri-focal tensor-based multiple video synchronization with subframe optimization. IEEE Transactions on Image Processing 15(9) (2006)Google Scholar
  7. 7.
    Mandel, Z., Shimshoni, I., Keren, D.: Multi-camera topology recovery from coherent motion. In: ACM/IEEE International Conference on Distributed Smart Cameras, pp. 243–250 (2007)Google Scholar
  8. 8.
    Serrat, J., Diego, F., Lumbreras, F., Álvarez, J.M.: Synchronization of Video Sequences from Free-Moving Cameras. In: Martí, J., Benedí, J.M., Mendonça, A.M., Serrat, J. (eds.) IbPRIA 2007. LNCS, vol. 4478, p. 627. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  9. 9.
    Singh, M., Basu, A., Mandal, M.: Event dynamics based temporal registration. IEEE Transactions on Multimedia 9(5) (2007)Google Scholar
  10. 10.
    Spencer, L., Shah, M.: Temporal synchronization from camera motion. In: Proc. Asian Conf. Comp. Vision (2004)Google Scholar
  11. 11.
    Tresadern, P., Reid, I.: Synchronizing image sequences of non-rigid objects. In: Proc. British Machine Vision Conference, vol. 2, pp. 629–638 (2003)Google Scholar
  12. 12.
    Tuytelaars, T., Van Gool, L.: Synchronizing video sequences. In: Proc. IEEE Conf. Comp. Vision Patt. Recog., vol. 1 (2004)Google Scholar
  13. 13.
    Whitehead, A., Laganiere, R., Bose, P.: Temporal synchronization of video sequences in theory and in practice. In: IEEE Workshop on Motion and Video Computing (2005)Google Scholar
  14. 14.
    Wolf, L., Zomet, A.: Correspondence-free synchronization and reconstruction in a non-rigid scene. In: Proc. Workshop Vision and Modeling of Dynamic Scenes (2002)Google Scholar
  15. 15.
    Yan, J., Pollefeys, M.: Video synchronization via space-time interest point distribution. In: Proc. Advanced Concepts for Intelligent Vision Systems (2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Dmitry Pundik
    • 1
  • Yael Moses
    • 1
  1. 1.The Interdisciplinary Center HerzliyaIsrael

Personalised recommendations