Skip to main content
SpringerLink
Log in

Multicamera Human Re-Identification based on Covariance Descriptor

  • Applied Problems
  • Published:
Pattern Recognition and Image Analysis Aims and scope Submit manuscript

Abstract

Human re-identification is a crucial component of security and surveillance systems, smart environments and robots. In this paper a novel selective covariance-based method for human re-identification in video streams from multiple cameras is proposed. Our method, which includes human localization and human classification stages, is called selective covariance-based because before classifying the object using covariance descriptors (in this case the classes are the different people being re-identified) we extract (selection) specific regions, which are definitive for the class of objects we deal with (people). In our case, the region being extracted is the human head and shoulders. In the paper new feature functions for covariance region descriptors are developed and compared to basic feature functions, and a mask, filtering out the most of the background information from the region of interest, is proposed and evaluated. The use of the proposed feature functions and mask significantly improved the human classification performance (from 75% when using basic feature functions to 94.6% accuracy with the proposed method), while keeping computational complexity moderate.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. J. Watada and Z.B. Musaand, “Tracking human motions for security system,” in Proc. 2008 SICE Annual Conference (IEEE, 2008), pp. 3344–3349.

    Chapter  Google Scholar 

  2. A. A. Morozov, A. Vaish, A. F. Polupanov, V. E. Antciperov, I. I. Lychkov, A. N. Alfimtsev, and V. V. Deviatkov, “Development of concurrent object-oriented logic programming platform for the intelligent monitoring of anomalous human activities,” in Biomedical Engineering Systems and Technologies, BIOSTEC 2014, Ed. by G. Plantier, T. Schultz, A. Fred, and H. Gamboa, Communications in Computer and Information Science (Springer, Cham, 2015), vol. 511, pp. 82–97.

    Article  Google Scholar 

  3. V. Devyatkov, A. Alfimtsev, and S. Sakulin, “Web personalization based on fuzzy aggregation and recognition of user activity,” Int. J. Web Portals (IJWP) 4 (1), 33–41 (2012).

    Article  Google Scholar 

  4. N. Bellotto and H. Hu, “Multisensor-based human detection and tracking for mobile service robots,” IEEE Trans. Syst., Man, Cybernet. Part B: Cybernet. 39 (1), 167–181 (2009).

    Article  Google Scholar 

  5. D. G. Lowe, “Distinctive image features from scaleinvariant keypoints,” Int. J. Comput. Vision 60 (2), 91–110 (2004).

    Article  Google Scholar 

  6. K.-E. Aziz, D. Merad, and B. Fertil, “People re-identification across multiple non-overlapping cameras system by appearance classification and silhouette part segmentation,” in Proc. 2011 8th IEEE Int. Conf. on Advanced Video and Signal-Based Surveillance (AVSS) (IEEE, 2011), pp. 303–308.

    Chapter  Google Scholar 

  7. S. Fazli, H. M. Pour, and H. Bouzari, “Particle filter based object tracking with Sift and color feature,” in Proc. 2009 Second Int. Conf. on Machine Vision (IEEE Computer Society, 2009), pp. 89–93.

    Chapter  Google Scholar 

  8. S. Belongie, J. Malik, and J. Puzicha, “Shape matching and object recognition using shape contexts,” IEEE Trans. Pattern Anal. Mach. Intellig. 24 (4), 509–522 (2002).

    Article  Google Scholar 

  9. S. Ioffe and D. A. Forsyth, “Probabilistic methods for finding people,” Int. J. Comput. Vision 43 (1), 45–68 (2001).

    Article  MATH  Google Scholar 

  10. A. Li, L. Liu, K. Wang, et al. “Clothing attributes assisted person reidentification,” IEEE Trans. Circuits Syst. Video Technol. 25 (5), 869–878 (2015).

    Article  Google Scholar 

  11. H. Elzein, S. Lakshmanan, and P. Watta, “A motion and shape-based pedestrian detection algorithm,” in Proc. 2003 IEEE Intelligent Vehicles Symposium (IEEE, 2003), pp. 500–504.

    Google Scholar 

  12. M. Hasan and N. Babaguchi, “Long-term people reidentification using anthropometric signature,” in Proc. 2016 IEEE 8th Int. Conf. on Biometrics Theory, Applications and Systems (BTAS) (IEEE, 2016). pp. 1–6.

    Google Scholar 

  13. H. Liu, L. Wang, and F. Sun, “Mean-shift tracking using fuzzy coding histogram,” Int. J. Fuzzy Syst. 16 (4), 457–467 (2014).

    Google Scholar 

  14. D. Comaniciu, V. Ramesh, and P. Meer, “Kernelbased object tracking,” IEEE Trans. Pattern Anal. Mach. Intellig. 25 (5), 564–577 (2003).

    Article  Google Scholar 

  15. P. Pérez, C. Hue, J. Vermaak, and M. Gangnet, “Color-based probabilistic tracking,” in European Conf. on Computer Vision — ECCV 2002, Ed. by A. Heyden, G. Sparr, M. Nielsen, and P. Johansen, Lecture Notes in Computer Science (Springer, Berlin, 2002), Vol. 2350, pp. 661–675.

    Article  MATH  Google Scholar 

  16. O. Tuzel, F. Porikli, and P. Meer, “Region covariance: A fast descriptor for detection and classification,” in European Conf. on Computer Vision — ECCV 2006, Ed. by A. Leonardis, H. Bischof, and A. Pinz, Lecture Notes in Computer Science (Springer, Berlin, 2006), vol. 3952, pp. 589–600.

    Article  Google Scholar 

  17. F. Porikli, O. Tuzel, and P. Meer, “Covariance tracking using model update based on Lie algebra,” in Proc. 2006 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition (CVPR'06) (IEEE Computer Society, 2006), vol. 1, pp. 728–735.

    Article  Google Scholar 

  18. Y. Wu, J. Cheng, J. Wang, and H. Lu, “Real-time visual tracking via incremental covariance tensor learning,” in Proc. 2009 IEEE 12th Int. Conf. on Computer Vision (IEEE, 2009), pp. 1631–1638.

    Chapter  Google Scholar 

  19. Y. Wu, J. Wang, and H. Lu, “Robust Bayesian tracking on Riemannian manifolds via fragments-based representation,” in Proc. 2009 IEEE Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP) (IEEE, 2009), pp. 765–768.

    Chapter  Google Scholar 

  20. Y. H. Hassen, T. Ouni, W. Ayedi, and M. Jallouli, “Mono-camera person tracking based on template matching and covariance descriptor,” in Proc. 2015 Int. Conf. on Computer Vision and Image Analysis Applications (ICCVIA) (IEEE, 2015), pp. 225–229.

    Google Scholar 

  21. Y. Wu, J. Cheng, J. Wang, et al. “Real-time probabilistic covariance tracking with efficient model update,” IEEE Trans. Image Process. 21 (5), 2824–2837 (2012).

    Article  MathSciNet  MATH  Google Scholar 

  22. S. Bąk, E. Corvee, F. Bremond, and M. Thonnat, “Person re-identification using spatial covariance regions of human body parts,” in Proc. 2010 7th IEEE Int. Conf. on Advanced Video and Signal Based Surveillance (AVSS) (IEEE, 2010), pp. 435–440.

    Google Scholar 

  23. H. Ergezer and K. Leblebicioğlu, “Anomaly detection and activity perception using covariance descriptor for trajectories,” in European Conf. on Computer Vision–ECCV 2016 Workshops, Ed. by G. Hua and H. Jégou, Lecture Notes in Computer Science (Springer, Cham, 2016), Vol. 9914, pp. 728–742.

    Article  Google Scholar 

  24. A. Sanin, C. Sanderson, M. T. Harandi, and B. C. Lovell, “Spatio-temporal covariance descriptors for action and gesture recognition,” in Proc. 2013 IEEE Workshop on Applications of Computer Vision (WACV) (IEEE, 2013). pp. 103–110.

    Chapter  Google Scholar 

  25. Z. Zivkovic, “Improved adaptive Gaussian mixture model for background subtraction,” in Proc. 17th International Conference on Pattern Recognition (ICPR 2004) (IEEE, 2004), pp. 28–31.

    Google Scholar 

  26. P. Viola and M. J. Jones, “Robust real-time face detection,” Int. J. Comput. Vision 57 (2), 137–154 (2004).

    Article  Google Scholar 

  27. Human tracking dataset (2016 November 29). Retrieved from https://github.com/Taranyan/Human-Tracking-DataSet

  28. 3DPeS dataset (2016 October 17). Retrieved from http://www.openvisor.org/3dpes.asp

  29. SARC3D dataset (2016 October 17). Retrieved from http://www.openvisor.org/sarc3d.asp

  30. Town Centre dataset (2016 October 17). Retrieved from http://www.robots.ox.ac.uk/ActiveVision/Research/Projects/2009bbenfold_headpose/project.html#datasets

Download references

Author information

Authors and Affiliations

  1. Bauman Moscow State Technical University, Moscow, Russia

    V. V. Devyatkov, A. N. Alfimtsev & A. R. Taranyan

Authors
  1. V. V. Devyatkov
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. A. N. Alfimtsev
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. A. R. Taranyan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to V. V. Devyatkov.

Additional information

The article is published in the original.

V.V. Devyatkov–D.Sc. (Eng.), Professor of Engineering, Head of the Department of Information Systems and Telecommunications, Bauman Moscow State Technical University. He has over 120 publications (including three monographs) in the fields of logical control, computer systems and complexes of technical cybernetics.

A.N. Alfimtsev–Ph.D. (Eng.), Associate Professor of Engineering, Department of Information Systems and Telecommunications, Bauman Moscow State Technical University. He has over seventy scientific papers, including five patents for inventions. Scientific interests lie in the fields of artificial intelligence methods, multimodal interfaces and pattern recognition.

A.R. Taranyan–Ph.D. student, Department of Information Systems and Telecommunications, Bauman Moscow State Technical University, software developer at “Anti-Plagiat” CJSC. He has two scientific papers. Scientific interests lie in the fields of computer vision, pattern recognition and intelligent systems.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Devyatkov, V.V., Alfimtsev, A.N. & Taranyan, A.R. Multicamera Human Re-Identification based on Covariance Descriptor. Pattern Recognit. Image Anal. 28, 232–242 (2018). https://doi.org/10.1134/S1054661818020025

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S1054661818020025

Keywords

Search

Navigation