Online Action Recognition from Trajectory Occurrence Binary Patterns (ToBPs)
Online action recognition is nowadays a major challenge on computer vision due to uncontrolled scenarios, variability on dynamic action representations, unrestricted capture protocols among many other variations. This work introduces a very compact binary occurrence motion descriptor that allows to recognize actions on partial video-sequences. The proposed approach starts by computing a set of motion trajectories that represent the developed activity. On that regard, a local counting process is performed over bounded regions, and centered at each trajectory, to search for a minimal number of neighboring trajectories. This process is then codified in a vector of binary values (ToBPs) that will create a regional description, at any time of the video sequence, to represent actions. This regional description is obtained by determining the most recurrent binary descriptors in a particular video interval. The final regional descriptor is mapped to a machine learning algorithm to obtain a recognition. The proposed strategy was evaluated on three public datasets, achieving an average accuracy of 70% in tasks of action recognition by using a local descriptor of only 51 values and a regional descriptor of 400 values. This compact description constitute an ideal condition for real-time video applications. The proposed approach achieves a partial recognition above 70% on average accuracy using only the 40% of videos.
KeywordsAction recognition Binary motion patterns Occurrence patterns Motion trajectories
This work was partially funded by the Universidad Industrial de Santander. The authors acknowledge the Decanato de la Facultad de Ingenierías Fisicomecánicas and the Vicerrectoría de Investigación y Extensión (VIE) of the Universidad Industrial de Santander for supporting this research registered by the project: Reconocimiento continuo de expresiones cortas del lenguaje de señas, with SIVIE code 2430.
- 1.Al-Akam, R., Al-Darraji, S., Paulus, D.: Human action recognition from RGBD videos based on retina model and local binary pattern features. In: 26 Conference on Computer Graphics, Visualization and Computer Vision (WSCG), pp. 1–7 (2018)Google Scholar
- 2.Al-Ali, S., Milanova, M., Al-Rizzo, H., Fox, V.L.: Human action recognition: contour-based and silhouette-based approaches. In: Computer Vision in Control Systems-2, pp. 11–47. Springer, Heidelberg (2015)Google Scholar
- 4.Chang, C.C., Lin, C.J.: Libsvm: a library for support vector machines. ACM Trans. Intell. Syst. Technol. (TIST) 2(3), 27 (2011)Google Scholar
- 13.Ryoo, M.S., Aggarwal, J.K.: Spatio-temporal relationship match: video structure comparison for recognition of complex human activities. In: 2009 IEEE 12th international conference on Computer vision, pp. 1593–1600. IEEE (2009)Google Scholar
- 14.Schuldt, C., Laptev, I., Caputo, B.: Recognizing human actions: a local SVM approach. In: Proceedings of the 17th International Conference on Pattern Recognition 2004, ICPR 2004, vol. 3, pp. 32–36. IEEE (2004)Google Scholar
- 16.Yang, Y., Zhang, B., Yang, L., Chen, C., Yang, W.: Action recognition using completed local binary patterns and multiple-class boosting classifier. In: 2015 3rd IAPR Asian Conference on Pattern Recognition (ACPR), pp. 336–340. IEEE (2015)Google Scholar
- 17.Yeffet, L., Wolf, L.: Local trinary patterns for human action recognition. In: 2009 IEEE 12th International Conference on Computer Vision, pp. 492–497. IEEE (2009)Google Scholar