Synchronization of Two Independently Moving Cameras without Feature Correspondences

  • Tiago Gaspar
  • Paulo Oliveira
  • Paolo Favaro
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8689)

Abstract

In this work, a method that synchronizes two video sequences is proposed. Unlike previous methods, which require the existence of correspondences between features tracked in the two sequences, and/or that the cameras are static or jointly moving, the proposed approach does not impose any of these constraints. It works when the cameras move independently, even if different features are tracked in the two sequences. The assumptions underlying the proposed strategy are that the intrinsic parameters of the cameras are known and that two rigid objects, with independent motions on the scene, are visible in both sequences. The relative motion between these objects is used as clue for the synchronization. The extrinsic parameters of the cameras are assumed to be unknown. A new synchronization algorithm for static or jointly moving cameras that see (possibly) different parts of a common rigidly moving object is also proposed. Proof-of-concept experiments that illustrate the performance of these methods are presented, as well as a comparison with a state-of-the-art approach.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Bouguet, J.: Camera Calibration Toolbox for Matlab, http://www.vision.caltech.edu/bouguetj/calib_doc/
  2. 2.
    Caspi, Y., Irani, M.: Spatio-temporal alignment of sequences. IEEE Transactions on Pattern Analysis and Machine Intelligence 24(11), 1409–1424 (2002)CrossRefGoogle Scholar
  3. 3.
    Crassidis, J., Markley, F., Cheng, Y.: Survey of nonlinear attitude estimation methods. Journal of Guidance, Control, and Dynamics 30(1), 12–28 (2007)CrossRefGoogle Scholar
  4. 4.
    Elhamifar, E., Vidal, R.: Sparse subspace clustering. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2790–2797 (2009)Google Scholar
  5. 5.
    Golub, G.H., Loan, C.F.V.: Matrix Computations, 3rd edn., vol. 1. JHU Press (1996)Google Scholar
  6. 6.
    Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press (2004)Google Scholar
  7. 7.
    Horaud, R., Dornaika, F.: Hand-eye calibration. The International Journal of Robotics Research 14(3), 195–210 (1995)CrossRefGoogle Scholar
  8. 8.
    Kanade, T., Morris, D.: Factorization methods for structure from motion. Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences 356, 1153–1173 (1998)CrossRefMATHMathSciNetGoogle Scholar
  9. 9.
    Liu, G., Lin, Z., Yan, S., Sun, J., Yu, Y., Ma, Y.: Robust recovery of subspace structures by low-rank representation. IEEE Transactions on Pattern Analysis and Machine Intelligence 35(1), 171–184 (2013)CrossRefGoogle Scholar
  10. 10.
    Marquardt, D.: An algorithm for least-squares estimation of nonlinear parameters. Journal of the Society for Industrial & Applied Mathematics 11(2), 431–441 (1963)CrossRefMATHMathSciNetGoogle Scholar
  11. 11.
    Meyer, B., Stich, T., Magnor, M., Pollefeys, M.: Subframe temporal alignment of non-stationary cameras. In: British Machine Vision Conference (2008)Google Scholar
  12. 12.
    Murray, R., Li, Z., Sastry, S.: A Mathematical Introduction to Robotic Manipulation, 1st edn. CRC Press, Inc. (1994)Google Scholar
  13. 13.
    Ozden, K.E., Schindler, K., Van Gool, L.: Multibody structure-from-motion in practice. IEEE Transactions on Pattern Analysis and Machine Intelligence 32(6), 1134–1141 (2010)CrossRefGoogle Scholar
  14. 14.
    Schönemann, P.: A generalized solution of the orthogonal procrustes problem. Psychometrika 31(1), 1–10 (1966)CrossRefMATHMathSciNetGoogle Scholar
  15. 15.
    Shi, J., Tomasi, C.: Good features to track. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 593–600 (June 1994)Google Scholar
  16. 16.
    Sinha, S.N., Pollefeys, M.: Synchronization and calibration of camera networks from silhouettes. In: International Conference on Pattern Recognition, vol. 1, pp. 116–119 (August 2004)Google Scholar
  17. 17.
    Stewénius, H., Engels, C., Nistér, D.: Recent developments on direct relative orientation. Journal of Photogrammetry and Remote Sensing 60(4), 284–294 (2006)CrossRefGoogle Scholar
  18. 18.
    Sturm, P., Triggs, B.: A factorization based algorithm for multi-image projective structure and motion. In: Buxton, B., Cipolla, R. (eds.) ECCV 1996. LNCS, vol. 1065, pp. 709–720. Springer, Heidelberg (1996)CrossRefGoogle Scholar
  19. 19.
    Tomasi, C.: Shape and motion from image streams under orthography: a factorization method. International Journal of Computer Vision 9, 137–154 (1992)CrossRefGoogle Scholar
  20. 20.
    Tresadern, P., Reid, I.: Synchronizing image sequences of non-rigid objects. In: British Machine Vision Conference, pp. 629–638 (2003)Google Scholar
  21. 21.
    Tuytelaars, T., Van Gool, L.: Synchronizing video sequences. In: IEEE Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 762–768 (June 2004)Google Scholar
  22. 22.
    Wolf, L., Zomet, A.: Correspondence-free synchronization and reconstruction in a non-rigid scene. In: Workshop on Vision and Modelling of Dynamic Scenes (2002)Google Scholar
  23. 23.
    Yan, J., Pollefeys, M.: Video synchronization via space-time interest point distribution. Advanced Concepts for Intelligent Vision Systems (2004)Google Scholar
  24. 24.
    Yilma, A., Shah, M.: Recognizing human actions in videos acquired by uncalibrated moving cameras. In: IEEE International Conference on Computer Vision, vol. 1, pp. 150–157 (October 2005)Google Scholar
  25. 25.
    Zhang, Z.: A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(11), 1330–1334 (2000)CrossRefGoogle Scholar
  26. 26.
    Zhou, C., Tao, H.: Dynamic depth recovery from unsynchronized video streams. In: IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 351–358 (June 2003)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Tiago Gaspar
    • 1
  • Paulo Oliveira
    • 1
  • Paolo Favaro
    • 2
  1. 1.Instituto Superior TécnicoUniversidade de LisboaLisbonPortugal
  2. 2.University of BernBernSwitzerland

Personalised recommendations