Geometrical Scene Analysis Using Co-motion Statistics

  • Zoltán Szlávik
  • László Havasi
  • Tamás Szirányi
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4678)

Abstract

Deriving the geometrical features of an observed scene is pivotal for better understanding and detection of events in recorded videos. In the paper methods are presented for the estimation of various geometrical scene characteristics. The estimated characteristics are: point correspondences in stereo views, mirror pole, light source and horizon line. The estimation is based on the analysis of dynamical scene properties by using co-motion statistics. Various experiments prove the feasibility of our approach.

Keywords

Gaussian Mixture Model Point Correspondence Shadow Detection Horizon Line Outlier Rejection 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Abdel-Aziz, Y.I., Karara, H.M.: Direct Linear Transformation from Comparator Coordinates into Object Space Coordinates in Close-range Photogrammetry. In: Proc. ASP/UI Symp. Close-Range Photogrammetry, pp. 1–18 (1971)Google Scholar
  2. 2.
    Barnard, S.T., Thompson, W.B.: Disparity analysis of images. EEE Trans. PAMI 2, 333–340 (1980)Google Scholar
  3. 3.
    Benedek, C., Havasi, L., Szirányi, T., Szlávik, Z.: Motion-based Flexible Camera Registration. In: Proc. IEEE AVSS 2005, pp. 439–444. IEEE, Los Alamitos (2005)Google Scholar
  4. 4.
    Caspi, Y., Simakov, D., Irani, M.: Feature-based sequence-to-sequence matching. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2350, Springer, Heidelberg (2002)Google Scholar
  5. 5.
    Cucchiara, R., Grana, C., Neri, G., Piccardi, M., Prati, A.: The Sakbot System for Moving Object Detection and Tracking, Video-Based Surveillance Systems-Computer Vision and Distributed Processing, 145–157 (2001)Google Scholar
  6. 6.
    Fischler, M.A., Bolles, R.C.: Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. CACM 24(6), 381–395 (1981)Google Scholar
  7. 7.
    Havasi, L., Szirányi, T.: Estimation of Vanishing Point in Camera-Mirror Scenes Using Video, Optics Letters 1367–1566 (2006)Google Scholar
  8. 8.
    Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge (2003)Google Scholar
  9. 9.
    Khan, S., Shah, M.: Consistent Labeling of Tracked Objects in Multiple Cameras with Overlapping Fields of View. IEEE Trans. PAMI 25(10), 1355–1360 (2003)Google Scholar
  10. 10.
    Lee, L., Romano, R., Stein, G.: Monitoring activities from multiple video streams: establishing a common coordinate frame. IEEE Trans. PAMI, 22 (2000)Google Scholar
  11. 11.
    Nunziati, W., Alon, J., Sclaroff, S., Bimbo, A.D.: View registration using interesting segments on planar trajectories. In: Proc. of IEEE AVSS 2005, pp. 75–80. IEEE, Los Alamitos (2005)Google Scholar
  12. 12.
    Stauffer, C., Eric, W., Grimson, L.: Learning patterns of activity using real-time tracking. IEEE Trans. PAMI 22(8), 747–757 (2000)Google Scholar
  13. 13.
    Weng, J., Ahuja, N., Huang, T.S.: Matching two perspective views. IEEE Trans. PAMI 14, 806–825 (1992)Google Scholar
  14. 14.
    Zhang, Z., Deriche, R., Faugeras, O., Luong, Q.-T.: A robust technique for matching two uncalibrated images through the recovery of the unknown epipolar geometry. Artificial Intelligence Journal 78, 87–119 (1995)CrossRefGoogle Scholar
  15. 15.
    Hu, B., Brown, C., Nelson, R.: Multiple-view 3-D reconstruction using a mirror, Technical Report (2005)Google Scholar
  16. 16.
    Zabrodsky, H., Weinshall, D.: Utilizing symmetry in the reconstruction of 3-dimensional shape from noisy images. In: Eklundh, J.-O. (ed.) ECCV 1994. LNCS, vol. 801, pp. 403–419. Springer, Heidelberg (1994)Google Scholar
  17. 17.
    Lu, F., Zhao, T., Nevatia, R.: Self-Calibration of a camera from video of a walking human. In: Proc. of ICPR, pp. 1513–1518 (2000)Google Scholar
  18. 18.
    Criminisi, A., Reid, I., Zisserman, A.: Single view metrology. In: Proc. of ICCV, 434–442 (1999)Google Scholar
  19. 19.
    Cao, X., Foroosh, H.: Camera calibration and light source orientation from solar shadows. Computer Vision and Image Understanding 105(1), 60–72 (2007)CrossRefGoogle Scholar
  20. 20.
    Mitsumoto, H., Tamura, S.: 3-D reconstruction using mirror images based on a plane symmetry recovering method. IEEE Trans. PAMI, 941-946 (1992)Google Scholar
  21. 21.
    Penne, R.: Mirror Symmetry in Perspective. In: Blanc-Talon, J., Philips, W., Popescu, D.C., Scheunders, P. (eds.) ACIVS 2005. LNCS, vol. 3708, pp. 634–642. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  22. 22.
    Francois, A.R.J., Medioni, G.G., Waupotitsch, R.: Reconstructing mirror symmetric scenes from a single view using 2-view stereo geometry. In: Proc. of ICPR, pp. 12–16 (2002)Google Scholar
  23. 23.
    Szlávik, Z., Szirányi, T., Havasi, L.: Video camera registration using accumulated co-motion maps. ISPRS Journal of Photogrammetry and Remote Sensing 61(1), 298–306 (2007)CrossRefGoogle Scholar
  24. 24.
    Johnson, R.A., Wichern, D.W.: Applied Multivariate Statistical Analysis. Prentice Hall, Englewood Cliffs (2002)Google Scholar
  25. 25.
    Nguyen, V., Martinelli, A., Tomatis, N., Siegwart, R.: A Comparison of Line Extraction Algorithms using 2D Laser Rangefinder for Indoor Mobile Robotics. In: Proc. of IROS, pp. 1929–1934 (2005)Google Scholar
  26. 26.
    Ji, Q., Xie, Y.: Randomised hough transform with error propagation for line and circle detection. Pattern Analysis and Applications 6, 55–64 (2003)CrossRefGoogle Scholar
  27. 27.
    Shafer, S.A.: Shadows and Silhouettes in Computer Vision. Kluwer Academic Publisher, Dordrecht (1985)Google Scholar
  28. 28.
    Szlávik, Z., Szirányi, T.: Stochastic view registration of overlapping cameras based on arbitrary motion. IEEE Transactions on Image Processing 16(3), 710–720 (2007)CrossRefGoogle Scholar
  29. 29.
    Havasi, L., Sziranyi, T., Rudzsky, M.: Adding geometrical terms to shadow detection process. In: EUSIPCO (14th European Signal Processing Conference), Florence (2006)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Zoltán Szlávik
    • 1
  • László Havasi
    • 1
  • Tamás Szirányi
    • 1
  1. 1.Computer and Automation Research Institute, Hungarian Academy of Sciences, H-1111 Budapest, Kende u. 13-17Hungary

Personalised recommendations