Abstract
This paper presents human action recognition method based on silhouette sequences and simple shape descriptors. The proposed solution uses single scalar shape measures to represent each silhouette from an action sequence. Scalars are then combined into a vector that represents the entire sequence. In the following step, vectors are transformed into sequence representations and matched with the use of leave-one-out cross-validation technique and selected similarity or dissimilarity measure. Additionally, action sequences are pre-classified using the information about centroid trajectory into two subgroups—actions that are performed in place and actions during which a person moves in the frame. The average percentage accuracy is 80%—the result is very satisfactory taking into consideration the very small amount of data used. The paper provides information on the approach, some key definitions as well as experimental results.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Moeslund, T.B., Hilton, A., Krüger, V.: A survey of advances in vision-based human motion capture and analysis. Comput. Vis. Image Underst. 104(2), 90–126 (2006)
Poppe, R.: A survey on vision-based human action recognition. Image Vis. Comput. 28(6), 976–990 (2010)
Weinland, D., Ronfard, R., Boyer, E.: A survey of vision-based methods for action representation, segmentation and recognition. Comput. Vis. Image Underst. 115(2), 224–241 (2011)
Borges, P.V.K., Conci, N., Cavallaro, A.: Video-based human behavior understanding: a survey. IEEE Trans. Circ. Syst. Video Technol. 23(11), 1993–2008 (2013)
Cheng, G., Wan, Y., Saudagar, A.N., Namuduri, K., Buckles, B.P.: Advances in human action recognition: a survey. CoRR (2015)
Herath, S., Harandi, M., Porikli, F.: Going deeper into action recognition: a survey. Image Vis. Comput. 60, 4–21 (2017)
Vishwakarma, S., Agrawal, A.: A survey on activity recognition and behavior understanding in video surveillance. Vis. Comput. 29(10), 983–1009 (2013)
Chaquet, J.M., Carmona, E.J., Fernández-Caballero, A.: A survey of video datasets for human action and activity recognition. Comput. Vis. Image Underst. 117(6), 633–659 (2013)
Schuldt, C., Laptev, I., Caputo, B.: Recognizing human actions: a local SVM approach. In: Proceedings of the 17th International Conference on Pattern Recognition, vol. 3, pp. 32–36 (2004)
Gorelick, L., Blank, M., Shechtman, E., Irani, M., Basri, R.: Actions as space-time shapes. IEEE Trans. Pattern Anal. Mach. Intell. 29(12), 2247–2253 (2007)
Bobick, A.F., Davis, J.W.: The recognition of human movement using temporal templates. IEEE Trans. Pattern Anal. Mach. Intell. 23(3), 257–267 (2001)
Alp, E.C., Keles, H.Y.: Action recognition using MHI based Hu moments with HMMs. In: IEEE EUROCON 2017–17th International Conference on Smart Technologies, pp. 212–216 (2017)
Chen, D.Y., Shih, S.W., Liao, H.Y.M.: Human action recognition using 2-D spatio-temporal templates. In: 2007 IEEE International Conference on Multimedia and Expo, pp. 667–670 (2007)
Baysal, S., Kurt, M.C., Duygulu, P.: Recognizing human actions using key poses. In: 2010 20th International Conference on Pattern Recognition, pp. 1727–1730 (2010)
Chaaraoui, A.A., Climent-Pérez, P., Flórez-Revuelta, F.: Silhouette-based human action recognition using sequences of key poses. Pattern Recogn. Lett. 34(15), 1799–1807 (2013)
Islam, S., Qasim, T., Yasir, M., Bhatti, N., Mahmood, H., Zia, M.: Single- and two-person action recognition based on Silhouette shape and optical point descriptors. Sig. Image Video Process. 12(5), 853–860 (2018)
Goudelis, G., Karpouzis, K., Kollias, S.: Exploring trace transform for robust human action recognition. Pattern Recogn. 46(12), 3238–3248 (2013)
Al-Ali, S., Milanova, M., Al-Rizzo, H., Fox, V.L.: Human action recognition: contour-based and Silhouette-based approaches. In: Favorskaya, M.N., Jain, L.C. (eds.) Computer Vision in Control Systems-2. ISRL, vol. 75, pp. 11–47. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-11430-9_2
Jahagirdar, A.S., Nagmode, M.S.: Silhouette-based human action recognition by embedding HOG and PCA features. In: Bhalla, S., Bhateja, V., Chandavale, A.A., Hiwale, A.S., Satapathy, S.C. (eds.) Intelligent Computing and Information and Communication. AISC, vol. 673, pp. 363–371. Springer, Singapore (2018). https://doi.org/10.1007/978-981-10-7245-1_36
Vishwakarma, D.K., Gautam, J., Singh, K.: A robust framework for the recognition of human action and activity using spatial distribution gradients and Gabor wavelet. In: Reddy, M.S., Viswanath, K., K.M., S.P. (eds.) International Proceedings on Advances in Soft Computing, Intelligent Systems and Applications. AISC, vol. 628, pp. 103–113. Springer, Singapore (2018). https://doi.org/10.1007/978-981-10-5272-9_10
Gościewska, K., Frejlichowski, D.: Action recognition using silhouette sequences and shape descriptors. In: Choraś, R.S. (ed.) Image Processing and Communications Challenges 8, pp. 179–186. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-47274-4_21
Gościewska, K., Frejlichowski, D.: Moment shape descriptors applied for action recognition in video sequences. In: Nguyen, N.T., Tojo, S., Nguyen, L.M., Trawiński, B. (eds.) Intelligent Information and Database Systems, pp. 197–206. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-54430-4_19
Brunelli, R., Messelodi, S.: Robust estimation of correlation with applications to computer vision. Pattern Recogn. 28(6), 833–841 (1995)
Yang, L., Albregtsen, F., Lønnestad, T., Grøttum, P.: Methods to estimate areas and perimeters of blob-like objects: a comparison. In: Proceedings of IAPR Workshop on Machine Vision Applications, pp. 272–276 (1994)
Yang, M., Kpalma, K., Ronsin, J.: A survey of shape feature extraction techniques. In: Yin, P.-Y. (ed.) Pattern Recognition, pp. 43–90. INTECH Open Access Publisher (2008)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Gościewska, K., Frejlichowski, D. (2018). Silhouette-Based Action Recognition Using Simple Shape Descriptors. In: Chmielewski, L., Kozera, R., Orłowski, A., Wojciechowski, K., Bruckstein, A., Petkov, N. (eds) Computer Vision and Graphics. ICCVG 2018. Lecture Notes in Computer Science(), vol 11114. Springer, Cham. https://doi.org/10.1007/978-3-030-00692-1_36
Download citation
DOI: https://doi.org/10.1007/978-3-030-00692-1_36
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-00691-4
Online ISBN: 978-3-030-00692-1
eBook Packages: Computer ScienceComputer Science (R0)