Inferring Stochastic Regular Grammar with Nearness Information for Human Action Recognition
In this paper, we present an extended scheme of human action recognition with nearness information between hands and other body parts for the purpose of automatically analyzing nonverbal actions of human beings. First, based on the principle that a human action can be defined as a combination of multiple articulation movements, we apply the inference of stochastic grammars. We measure and quantize each human action in 3D coordinates and make two sets of 4-chain-code for xy and zy projection planes, so that they are appropriate for the stochastic grammar inference method. Next, we extend the stochastic grammar inferring method by applying nearness information. We confirm that various physical actions are correctly classified against a set of real-world 3D temporal data with this method in experiments. Our experiments show that this extended method reveals comparatively successful achievement with a 92.7% recognition rate of 60 movements of the upper body.
KeywordsRecognition Rate Production Rule Dynamic Time Warping Finite Automaton Learning Pattern
Unable to display preview. Download preview PDF.
- 2.Frey, S.: Das Berner System zur Untersuchung nonverbaler Interaktion. In: Methoden der Analyse von Face-to-Face-Situationen, Stuttgart, Metzler, pp. 203–236 (1981)Google Scholar
- 3.Inanov, Y.A.: Application of stochastic grammars to understanding action, MIT thesis (1998)Google Scholar
- 4.Cruz-Alcazar, P.P., Vidal-Ruiz, E.: Modeling musical style using grammatical inference techniques: a tool for classifying and generating melodies. In: Third International Conference on Web Delivering of Music, pp. 77–84 (2003)Google Scholar
- 6.Munkelt, O., et al.: A model driven 3D image interpretation system applied to person de-tection in video images. In: 14th ICPR 1998, pp. 70–73 (1998)Google Scholar
- 8.Bull, P.E.: Posture and Gesture, pp. 163–187. Pergamon Press, Oxford (1990)Google Scholar