Motion Guided Video Sequence Synchronization

  • Daniel Wedge
  • Du Huynh
  • Peter Kovesi
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3852)


We present an algorithm that synchronizes two short video sequences where an object undergoes ballistic motion against stationary scene points. The object’s motion and epipolar geometry are exploited to guide the algorithm to the correct synchronization in an iterative manner. Our algorithm accurately synchronizes videos recorded at different frame rates, and takes few iterations to converge to sub-frame accuracy. We use synthetic data to analyze our algorithm’s accuracy under the influence of noise. We demonstrate that it accurately synchronizes real video sequences, and evaluate its performance against manual synchronization.


Video Sequence Fundamental Matrix Epipolar Line Epipolar Geometry Reprojection Error 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Rao, C., Gritai, A., Shah, M., Syeda-Mahmood, T.: View-invariant alignment and matching of video sequences. In: Proceedings of International Conference on Computer Vision (2003)Google Scholar
  2. 2.
    Kitahara, I., Saito, H., Akimichi, S., Onno, T., Ohta, Y., Kanade, T.: Large-scale virtualized reality. In: Computer Vision and Pattern Recognition Technical Sketches (2001)Google Scholar
  3. 3.
    Tresadern, P.A., Reid, I.: Synchronizing image sequences of non-rigid objects. In: Proceedings of British Machine Vision Conference (2003)Google Scholar
  4. 4.
    Caspi, Y., Irani, M.: Spatio-temporal alignment of sequences. IEEE Transactions on Pattern Analysis and Machine Intelligence 24, 1409–1424 (2002)CrossRefGoogle Scholar
  5. 5.
    Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press, Cambridge (2004)zbMATHGoogle Scholar
  6. 6.
    Reid, I.D., Zisserman, A.: Goal-directed video metrology. In: Buxton, B.F., Cipolla, R. (eds.) ECCV 1996. LNCS, vol. 1065, pp. 647–658. Springer, Heidelberg (1996)Google Scholar
  7. 7.
    Stein, G.P.: Tracking from multiple view points: Self-calibration of space and time. In: Proceedings of Computer Vision and Pattern Recognition, pp. 521–527 (1999)Google Scholar
  8. 8.
    Lee, L., Romano, R., Stein, G.: Monitoring activities from multiple video streams: Establishing a common coordinate frame. IEEE Transactions on Pattern Analysis and Machine Intelligence 22, 758–767 (2000)CrossRefGoogle Scholar
  9. 9.
    Pooley, D.W., Brooks, M.J., van den Hengel, A.J., Chojnacki, W.: A voting scheme for estimating the synchrony of moving-camera videos. In: Proceedings of ICIP (2003)Google Scholar
  10. 10.
    Carceroni, R.L., Pádua, F.L.C., Santos, G.A.M.R., Kutulakos, K.N.: Linear sequence-to-sequence alignment. In: Proceedings of CVPR, vol. 1, pp. 746–753 (2004)Google Scholar
  11. 11.
    Fischler, M.A., Bolles, R.C.: Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM 24, 381–395 (1981)CrossRefMathSciNetGoogle Scholar
  12. 12.
    Tuytelaars, T., Van Gool, L.: Synchronizing video sequences. Computer Vision and Pattern Recognition, 762–768 (2004)Google Scholar
  13. 13.
    Wolf, L., Zomet, A.: Correspondence-free synchronization and reconstruction in a non-rigid scene. In: ECCV Workshop on Vision and Modelling of Dynamic Scenes (2002)Google Scholar
  14. 14.
    Giese, M.A., Poggio, T.: Synthesis and recognition of biological motion patterns based on linear superposition of prototypical motion sequences. In: Proceedings of the IEEE Workshop on Multi-View Modeling and Analysis of Visual Scene, pp. 73–80 (1999)Google Scholar
  15. 15.
    Yan, J., Pollefeys, M.: Video synchronization via space-time interest point distribution. In: Proceedings of Advanced Concepts for Intelligent Vision Systems (2004)Google Scholar
  16. 16.
    Laptev, I., Lindeberg, T.: Space-time interest points. In: Proceedings of International Conference on Computer Vision, vol. 1, pp. 432–439 (2003)Google Scholar
  17. 17.
    Sinha, S.N., Pollefeys, M.: Synchronization and calibration of camera networks from silhouettes. In: International Conference on Pattern Recognition (2004)Google Scholar
  18. 18.
    Wedge, D., Huynh, D., Kovesi, P.: Tracking footballs through clutter in broadcast digital videos. In: Image and Vision Computing, New Zealand, pp. 155–160 (2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Daniel Wedge
    • 1
  • Du Huynh
    • 1
  • Peter Kovesi
    • 1
  1. 1.School of Computer Science & Software EngineeringThe University of Western AustraliaCrawleyAustralia

Personalised recommendations