A Novel Action Descriptor to Recognize Actions from Surveillance Videos

  • T. Pradeepa
  • S. Abirami
  • M. Sivarathinabala
  • S. Murugappan
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 379)


Due to the increased application in the area of human action detection, automatic capture and action analysis becomes a great research area. This paper provides a novel method to detect human action by considering features from the positive space and negative space region. Usually, in the literatures features have been considered from the positive space of the subject. Positive space features alone cannot provide solutions to the challenges such as occlusion and boundary variations. Therefore, in this method we have also considered the surrounding regions of the subject along with the positive space features. Initially, the input video has been segmented using background subtraction. Then the features are extracted from both positive and negative space of the subjects. Later, action descriptor has been defined for each pose of an action and proposed a new way for detecting number of cycles required to describe an action. Later, nearest neighbor classifier has been applied to classify the actions. The proposed system is evaluated using Weizmann dataset, KTH dataset and the results seem to be promising.


Positive space features Negative space features Action descriptor Activity recognition 


  1. 1.
    Aggarwal, J.K., Ryoo, M.S.: Human activity analysis: a review. ACM Comput. Surv. 43, 1–43 (2011)CrossRefGoogle Scholar
  2. 2.
    Sadek, S., Al-Hamadi, A., Michaelis, B., Sayed, U.: An efficient method for real-time activity recognition. In: Proceedings of the International Conference on Soft Computing and Pattern Recognition, Paris, pp. 7–10 (2010)Google Scholar
  3. 3.
    Poppe, R.: A survey on vision-based human action recognition. Image Vis. Comput. 28, 976–990 (2010)CrossRefGoogle Scholar
  4. 4.
    Gowsikhaa, D., Manjunath, Abirami, S.: Suspicious Human activity detection from Surveillance videos. Int. J. Internet Distrib. Comput. Syst. 2(2), 141–149 (2012)Google Scholar
  5. 5.
    Gowshikaa, D., Abirami, S., Baskaran, R.: Automated human behaviour analysis from surveillance videos: a survey artificial intelligence review. doi: 10.1007/s10462-012-9341-3 (2012)
  6. 6.
    Gowsikhaa, D., Abirami, S., Baskaran, R.: Construction of image ontology using low level features for image retrieval. In: Proceedings of the International Conference on Computer Communication and Informatics, pp. 129–134 (2012)Google Scholar
  7. 7.
    Bobick, A.F, Davis, J.W.: The recognition of human movement using temporal templates. Proc. IEEE Trans. Pattern Anal. Mach. Intell. 23(3), 257–267 (2001)Google Scholar
  8. 8.
    Chaaraoui, A.A., Climent-Pérez, P., Flórez-Revuelta, F.: Silhouette-based human action recognition using sequences of key poses. Pattern Recogn. Lett. 34(15), 1799–1807 (2013)CrossRefGoogle Scholar
  9. 9.
    Sivarathinabala, M., Abirami, S.: Motion Tracking of Humans under Occlusion using Blobs. In: Advanced Computing, Networking and Informatics, vol. 1. Smart Innovation, Systems and Technologies, vol. 27, pp. 251–258 (2014)Google Scholar
  10. 10.
    Rahman, S.A., Leung, M., Cho, S.-Y.: Human action recognition by extracting features from negative space. In: Maino, G., Foresti, G. (eds.) International Conference on Image Analysis and Processing, pp. 29–39 (2011)Google Scholar
  11. 11.
    Ikizler, N., Duygulu, P.: Histogram of oriented rectangles: a new pose descriptor for human action recognition. Proc. Int. Conf. Image Vis. Comput. 27(10), 1515–1526 (2009)Google Scholar
  12. 12.
    Kushwaha, A.K.S., Prakash, O., Khare, A., Kolekar,M.H.: Rule based human activity recognition for surveillance system. In: Proceedings of International Conference on Intelligent Human Computer Interaction, pp. 1–6 (2012)Google Scholar
  13. 13.
    Blank, M., Gorelick, L., Shechtman, E., Irani, M., Basri, Ronen: Actions as space-time shapes. IEEE Trans. Pattern Anal. Mach. Intell. 27(12), 2247–2253 (2007)Google Scholar
  14. 14.
    Rahman, S.A., Song, I., Leung, M.K.H.: Negative space template: a novel feature to describe activities in video. In: IEEE International Joint Conference on Neural Network (IJCNN), pp. 197–213 (2012)Google Scholar
  15. 15.
    Rakibe, R.S., Patil, B.D.: Human motion detection using background subtraction algorithm. Int. J. Adv. Res. Comput. Sci. Soft. Eng. 4(2) (2014)Google Scholar
  16. 16.
    Sun, D., Roth, S., Black, M.J.: Secrets of optical flow estimation and their principles. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2010)Google Scholar
  17. 17.
    Rahman, S.A., Cho, S.-Y., Leung, M.K.H.: Recognizing human actions by analyzing negative spaces. IET Comput. Vis. 6, 197–213 (2012)MathSciNetCrossRefGoogle Scholar
  18. 18.
    Chua, T.W., Leman, K., Pham, N.T.: Human action recognition via sum-rule fusion of fuzzy K-Nearest Neighbor classifiers. In: International Conference on Fuzzy Systems (FUZZ), pp. 484–489 (2011)Google Scholar
  19. 19.
    Gorelick, L., Blank, M., Shechtman, E., Irani, M., Basri, R.: Actions as space-time shapes. In: Tenth IEEE International Conference on Computer Vision (ICCV) (2005)Google Scholar
  20. 20.
    Schuldt, C., Laptev, I., Caputo, B.: Recognizing human actions: a local SVM approach. In: International Conference on Pattern Recognition, pp. 32–36 (2004)Google Scholar
  21. 21.
    Fathi, A.., Mori, G.: Action recognition by learning mid-level motion features. Computer Vision and Pattern Recognition. 1–8 (2008)Google Scholar
  22. 22.
    Bregonzio, M., Xiang, T., Gong, S.: Fusing appearance and distribution information of interest points for action recognition. Pattern Recognition. 45,1220–1234 (2012)Google Scholar
  23. 23.
    Liu, C., Yuen, P.C.: Human action recognition using boosted eigen actions. Image and Vision Computing. 28, 825–835 (2010)Google Scholar

Copyright information

© Springer India 2016

Authors and Affiliations

  • T. Pradeepa
    • 1
  • S. Abirami
    • 1
  • M. Sivarathinabala
    • 1
  • S. Murugappan
    • 2
  1. 1.Department of Information Science and TechnologyCollege of Engineering, Anna UniversityChennaiIndia
  2. 2.School of Computer ScienceTamil Nadu Open UniversityChennaiIndia

Personalised recommendations