Skip to main content
SpringerLink
Log in

Multi-view recognition system for human activity based on multiple features for video surveillance system

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Recognition of the activities of human, image sequences is most active area of research in computer vision and most of the previous projects, the focus of the activity is to acknowledge the recognition, from a single view and ignored issues of multiple view invariance. In this paper, the proposed framework for the recognition of a view-invariant human activity, solves the above problem. The components of the proposed framework are three consecutive modules: (i) the detection and positioning of the person’s background subtraction, (ii) the function extraction (iii) and the final activity is referenced by using a set of hidden Markov models (HMMs). During features extraction phase in the proposed method for activity representation a combination of contour-based distance signal feature, optical flow-based motion feature and uniform rotation local binary patterns has been used. Due to its rotation invariant nature the uniform LBP provides view-invariant recognition of multi-view human activities. A successful testing of the proposed approach was done on our own viewpoint dataset, KTH action recognition dataset, i3DPost multi-view dataset, and MSR view-point action dataset. From the experimental results and analysis over the chosen datasets, it is observed that the proposed framework is robust, flexible and efficient with respect to multiple views activity recognition, scale and phase variations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Ahmadand M, Lee S-W (2008) Human action recognition using shape and CLG-motion flow frommulti-view image sequences. J Pattern Recognit 41:2237–2252

    Article  MATH  Google Scholar 

  2. Ahonen T, Matas J, He C, Pietikäinen M (2009) Rotation invariant image description with local binary pattern histogram Fourier features, image analysis, vol 5575. Springer, Berlin, LNCS, pp 61–70

    Google Scholar 

  3. Althloothi S, Mahoor MH, Zhang X, Voyles RM (2014) Human activity recognition using multi-features and multiplekernel learning. J Pattern Recognit 47:1800–1812

    Article  Google Scholar 

  4. Ben-Arie J, Wang Z, Pandit P, Rajaram S (2002) Human activity recognition using multidimensional indexing. IEEE Transactions on Pattern Analysis and Machine Intelligence Archive 24(8):1091–1104

    Article  Google Scholar 

  5. Bobick AF, Davis JW (2001) The recognition of human movement using temporal templates. IEEE Trans Pattern Anal Mach Intell 23(3):257–267

    Article  Google Scholar 

  6. Bregler C (1997) Learning and recognizing human dynamics in video sequences. Proc. IEEE Int’l conf. on computer vision and pattern recognition, pp 568–574

  7. Bruhn A, Weickert J, Schnörr C (2005) Lucas/Kanade meets horn/Schunck:combining local and global optic flow methods. Int J Comput Vis 61(3):211–231

    Article  Google Scholar 

  8. Carlsson S, Sullivan J (2002) Action recognition by shape matching to key frames. IEEE computer society workshop on models versus exemplars in computer vision, pp 263–270

  9. Cohen I, Li H (2003) Inference of human postures by classification of 3D human body shape. IEEE international workshop on analysis and modeling of faces and gestures, pp 74–81

  10. Fernández A, Ghita O, González E, Bianconi F, Whelan PF (2011) Evaluation of robustness against rotation of LBP, CCR ILBP features in granite texture classification. Mach Vis Appl 22(6):913–926

    Article  Google Scholar 

  11. Hamid R, Huang Y, Essa I (n.d.) ARGMode –activity recognition using graphical models. Conference on computer vision and pattern recognition workshop, volume 4, pp. 38–45, Madison, Wisconsin, June 16-22, 2003

  12. Hannuksela J (2008) Camera based motion estimation recognition for human-computer interaction. Dissertation University of Oulu

  13. Holte MB, Tran C, Trivedi MM, Moeslund TB (2012) "Human pose estimation and activity recognition from multi-view videos: comparative explorations of recent developments". IEEE Journal of Selected Topics in Signal Processing (J-STSP). Volume 6(5):538–552

  14. Ikizler-Cinbis N, Sclaroff S (2010) Object, scene and actions: combining multiple features for human action recognition, Proceedings of 11th European Conference Computer Vision–ECCV(2010). Springer, Berlin, pp 494–507

  15. Ji X, Liu H (2010) Advances in view-invariant human motion analysis: a review. IEEE Trans Syst Man Cybern Part C Appl Rev 40(1):13–24

    Google Scholar 

  16. Kellokumpu V, Zhao G, Pietikäinen M (2010) Dynamic textures for human movement recognition. Proceedings of ACM international conference on image and video retrieval, pp 470–476

  17. Kellokumpu V, Zhao G, Pietikäinen M (2011) Recognition of human actions using texture descriptors. Mach Vis Appl 22(5):767–780

    Article  Google Scholar 

  18. Kulathumani V (n.d.) WVU multi-view action recognition dataset. Available on: http://csee.wvu.edu/~vkkulathumani/wvu-action.html#download2

  19. Laptev I, Caputo B (n.d.) Recognition of human actions, November 2011 http://www.nada.kth.se/cvap/actions/

  20. Liu Y, Nie L, Liu L, Rosenblum DS (2016) Fromactiontoactivity:sensor-basedactivityrecognition. Neurocomputing 181:108–115

    Article  Google Scholar 

  21. Liu L, Cheng L, Liu Y, Jia Y, Rosenblum DS (n.d.) Recognizing complex activities by a probabilistic interval-based model. Proceedings of the thirtieth AAAI conference on artificial intelligence (AAAI-16)

  22. Liuy Y, Niey L, Hanx L, Zhangy L, Rosenblum DS (2015) Action2Activity: recognizing complex activities from sensor data. Proceedings of the twenty-fourth international joint conference on artificial intelligence (IJCAI 2015)

  23. Dedeoğlu Y, Töreyin B, Güdükbay U, Çetin A (2006) “Silhouette-based method forobject classification and human action recognition in video”, ComputerVision in human-computer interaction, lecture notes in computer science, 3979. Springer, Berlin, pp 64–77

    Google Scholar 

  24. Nam Y, Wohn K (1996) Recognition of space-time hand-gestures using hidden Markov model. ACM symposium on virtual reality software and technology, Hong Kong, pp 51–58

  25. Ojala T, Pietikainen M, Maenpaa T (2002) Multiresolution gray-scale rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell 24(7):971–987

    Article  MATH  Google Scholar 

  26. Pietikäinen M (2011) Computer vision using local binary patterns, vol 40. Springer, Berlin

    Book  Google Scholar 

  27. Qian H, Mao Y, Xiang W, Wang Z (2010) Recognition of human activities using SVM multi-class classifier. Pattern Recogn Lett 31(2):100–111

    Article  Google Scholar 

  28. Sadek S, Al-Hamadi A, Krell G, Michaelis B (2013) Affine-invariant feature extraction for activity recognition. International Scholarly Research Notices- ISRN Machine Vision 2013:215195, 7 pages. https://doi.org/10.1155/2013/215195

  29. Sharma CM, Kushwaha AKS, Nigam S, Khare A (2011) Automatic human activity recognition in video using background modeling and spatio-temporal template matching based technique. In Proc. of international conference on advances in computing and artificial intelligence (ACAI – 2011), pp 97–101

  30. Suzuki S, Be K (1985) Topological structural analysis of digitized binary images by border following. Computer Vision, Graphics and Image Processing. volume 30(1):32–46

  31. University of Surrey and CERTH-ITI (n.d.) i3dpost multi-view human action datasets, January 2012. http://kahlan.eps.surrey.ac.uk/i3dpostaction/

  32. Veeraraghavan A, Chellappa R, Roy-Chowdhury AK (2006) The function space of an activity. Proc. of IEEE computer society Conf. On computer vision and pattern recognition

  33. Vili K, Guoying Z, Matti P (2008) Texture based description of movements for activity analysis. Proceedings of international conference on computer vision theory and applications (VISAPP 2008), 1(2008), pp 206–213

  34. Weinland D, Ronfard R (2011) A survey of vision based methods for action representation, segmentation, and recognition. Comput Vis Image Underst 115(2):529–551

    Article  Google Scholar 

  35. Yang J, Xu Y, Chen CS (2002) Human action learning via hidden Markov model. IEEE Trans Syst Man Cybern Syst Hum 27(1):34–44

    Article  Google Scholar 

  36. Yuan J, Liu Z, Wu Y (n.d.) Discriminative video pattern search for efficient action detection, January 2012.http://www.ece.northwestern.edu/~jyu410/index_files/actiondetection.html

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science & Engineering, IIT (BHU), Varanasi, Varanasi, India

    Roshan Singh & Rajeev Srivastava

  2. Department of Computer Sc. & Engineering, IK Gujral Punjab Technical University, Main Campus, Kapurthala, Punjab, India

    Alok Kumar Singh Kushwaha

Authors
  1. Roshan Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Alok Kumar Singh Kushwaha
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Rajeev Srivastava
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Roshan Singh.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Singh, R., Kushwaha, A.K.S. & Srivastava, R. Multi-view recognition system for human activity based on multiple features for video surveillance system. Multimed Tools Appl 78, 17165–17196 (2019). https://doi.org/10.1007/s11042-018-7108-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-018-7108-9

Keywords

Search

Navigation