A Framework for Inter-camera Association of Multi-target Trajectories by Invariant Target Models

  • Shahar Daliyot
  • Nathan S. Netanyahu
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7729)

Abstract

We propose a novel framework for associating multi-target trajectories across multiple non-overlapping views (cameras) by constructing an invariant model per each observed target. Ideally, these models represent the targets in a unique manner. The models are constructed by generating synthetic images that simulate how targets would be seen from different viewpoints. Our framework does not require any training or other supervised phases. Also, we do not make use of spatiotemporal coordinates of trajectories, i.e., our framework seamlessly works with both overlapping and non-overlapping field-of-views (FOVs) as well as widely separated ones. Also, contrary to many other related works, we do not try to estimate the relationship between cameras that tends to be error prone in environments like airports or supermarkets where targets wander about different areas, stop at times, or turn back to their starting location. We show the results obtained by our framework on a rather challenging dataset. Also, we propose a black-box approach based on Support Vector Machine (SVM) for fusing multiple pertinent algorithms and demonstrate the added value of our framework with respect to some basic techniques.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Avidan, S.: Ensemble tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence, 261–271 (2007)Google Scholar
  2. 2.
    Bay, H., Tuytelaars, T., Van Gool, L.: SURF: Speeded Up Robust Features. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3951, pp. 404–417. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  3. 3.
    Changjiang, Y., Duraiswami, R., Davis, L.: Fast Multiple Object Tracking via a Hierarchical Particle Filter. In: Proceedings of the Tenth IEEE International Conference on Computer Vision, pp. 212–219 (2005)Google Scholar
  4. 4.
    Chilgunde, A., Kumar, P., Ranganath, S., Weimin, H.: Multi-Camera Target Tracking in Blind Regions of Cameras with Non-Overlapping Fields of View. In: Proceedings of the British Machine Vision Conference, pp. 397–406 (2004)Google Scholar
  5. 5.
    Cortes, C., Vapnik, V.: Support-Vector Networks. Machine Learning, 273–297 (1995)Google Scholar
  6. 6.
    D’Angelo, A., Dugelay, J.: People Re-idnetification in Camera Networks Based on Probabilistic Color Histograms. In: Proceedings of the SPIE Conference on Visual Information Processing and Communication, vol. 7882 (2011)Google Scholar
  7. 7.
    Dalal, N., Triggs, B.: Histograms of Oriented Gradients for Human Detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 886–893 (2005)Google Scholar
  8. 8.
    Gilbert, A., Bowden, R.: Tracking Objects Across Cameras by Incrementally Learning Inter-camera Colour Calibration and Patterns of Activity. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3952, pp. 125–136. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  9. 9.
    Javed, O., Rasheed, Z., Shafique, K., Shah, M.: Tracking across Multiple Cameras with Disjoint Views. In: Proceedings of the Ninth IEEE International Conference on Computer Vision, pp. 952–957 (2003)Google Scholar
  10. 10.
    Javed, O., Shafique, K., Rasheed, Z., Shah, M.: Modeling Inter-camera Space-time and Appearance Relationships for Tracking across Non-overlapping Views. Computer Vision and Image Understanding, 146–162 (2008)Google Scholar
  11. 11.
    Kang, J., Cohen, I., Medioni, G.: Continuous Tracking within and across Camera Streams. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 267–272 (2003)Google Scholar
  12. 12.
    Kuo, C.-H., Huang, C., Nevatia, R.: Inter-camera Association of Multi-target Tracks by On-Line Learned Appearance Affinity Models. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part I. LNCS, vol. 6311, pp. 383–396. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  13. 13.
    Lowe, D.: Distinctive Image Features from Scale-Invariant Keypoints. International Journal of Computer Vision, 91–110 (2004)Google Scholar
  14. 14.
    Makris, D., Ellis, T.J., Black, J.: Bridging the Gaps Between Cameras. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 205–210 (2004)Google Scholar
  15. 15.
    Mazzeo, P.L., Spagnolo, P., D’Orazio, T.: Object Tracking by Non-overlapping Distributed Camera Network. In: Blanc-Talon, J., Philips, W., Popescu, D., Scheunders, P. (eds.) ACIVS 2009. LNCS, vol. 5807, pp. 516–527. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  16. 16.
    Mikolajczyk, K., Schmid, C.: An Affine Invariant Interest Point Detector. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002, Part I. LNCS, vol. 2350, pp. 128–142. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  17. 17.
    Montcalm, T., Boufama, B.: Object Inter-camera Tracking with Non-overlapping Views: A New Dynamic Approach. In: Proceedings of the Canadian Conference on Computer and Robot Vision, pp. 354–361 (2010)Google Scholar
  18. 18.
    Porikli, F., Tuzel, O., Meer, P.: Covariance Tracking Using Model Update Based on Means on Riemannian Manifolds. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 728–735 (2006)Google Scholar
  19. 19.
    Zheng, W., Gong, S., Xiang, T.: Person Re-identification by Probabilistic Relative Distance Comparison. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 649–656 (2011)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Shahar Daliyot
    • 1
    • 2
  • Nathan S. Netanyahu
    • 1
    • 3
  1. 1.Department of Computer ScienceBar-Ilan UniversityRamat-GanIsrael
  2. 2.Verint Systems Ltd.HerzliyaIsrael
  3. 3.Center for Automation ResearchUniversity of MarylandCollege ParkUSA

Personalised recommendations