Skip to main content

Recognition of Human Motion From Qualitative Normalised Templates

Abstract

This paper proposes a Qualitative Normalised Templates (QNTs) framework for solving the human motion classification problem. In contrast to other human motion classification methods which usually include a human model, prior knowledge on human motion and a matching algorithm, we replace the matching algorithm (e.g. template matching) with the proposed QNTs. The human motion is modelled by the time-varying joint angles and link lengths of an articulated human model. The ability to manage the trade-offs between model complexity and computational cost plays a crucial role in the performance of human motion classification. The QNTs is developed to categorise complex human motion into sets of fuzzy qualitative angles and positions in quantity space. Classification of the human motion is done by comparing the QNTs to the parameters learned from numerical motion tracking. Experimental results have demonstrated the effectiveness of our proposed method when classifying simple human motions, e.g. running and walking.

This is a preview of subscription content, access via your institution.

References

  1. Liu, H., Coghill, G.M.: Fuzzy qualitative trigonometry. In: Proceedings of the IEEE International Conference on Systems SMC’05, Man and Cybernetics vol. 2, pp. 1291–1296 (2005)

  2. Isard, M., Blake, A.: Condensation: Conditional density propagation for visual tracking. Int. J. Comput. Vis. (IJCV) 29(1), 5–28 (1998)

    Article  Google Scholar 

  3. Liu, H., Coghill, G.M., Xu, H.Y.: Qualitative modelling of kinematic robots for fault diagnosis. Int. J. Prod. Res. 43(11), 2277–2290 (2005)

    Article  Google Scholar 

  4. Haritaoglu, I., Harwood, D., Davis, L.S.: W4s: a real-time system detecting and tracking people in 2 1/2d. In: Proceedings of the 5th European Conference on Computer Vision-Volume I ECCV ’98, London, UK, pp. 877–892. Springer, Berlin Heidelberg New York (1998)

    Google Scholar 

  5. Wren, C., Azarbayejani, A., Darrell, T., Pentland, A.: Pfinder: real-time tracking of the human body. In: Proceedings of the 2nd International Conference on Automatic Face and Gesture Recognition FG’96, Washington, DC, p. 51. IEEE Computer Society (1996)

  6. Wilson, A.D., Bobick, A.F.: Parametric hidden markov models for gesture recognition. IEEE Trans. Pattern Anal. Mach. Intell. (PAMI) 21(9), 884–900 (1999)

    Article  Google Scholar 

  7. Fujiyoshi, H., Lipton, A.J.: Real-time human motion analysis by image skeletonization. In: Proceedings of the 4th IEEE Workshop on Applications of Computer Vision WACV ’98, Washington, DC, p. 15. IEEE Computer Society (1998)

  8. Ju, S.X., Black, M.J., Yacoob, Y.: Cardboard people: a parameterized model of articulated image motion. In: Proceedings of the 2nd International Conference on Automatic Face and Gesture Recognition FG ’96, Washington, DC, p. 38. IEEE Computer Society (1996)

  9. Yacoob, Y., Black, M.J.: Parameterized modeling and recognition of activities. Comput. Vis. Image Underst. (CVIU) 73(2), 232–247 (1999)

    Article  Google Scholar 

  10. Campbell, L.W., Bobick, A.F.: Recognition of human body motion using phase space constraints. In: Proceedings of the Fifth International Conference on Computer Vision ICCV ’95, Washington, DC, p. 624. IEEE Computer Society (1995)

  11. Niyogi, S., Adelson, E.: Analyzing and recognition walking figures in xyt. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition CVPR ’94, pp. 469–474 (1994)

  12. Pavlovic, V., Rehg, J., MacCormick, J.: Impact of dynamic model learning on classification of human motions. In: Proceedings of the International Conference on Computer Vision and Pattern Recognition CVPR ’00 (2000)

  13. Bregler, C.: Learning and recognizing human dynamics in video sequences. In: Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition CVPR ’97, Washington, DC, p. 568. IEEE Computer Society (1997)

  14. Madabhushi, A., Aggarwal, J.K.: A bayesian approach to human activity recognition. In: Proceedings of the Second IEEE Workshop on Visual Surveillance VS ’99, Washington, DC, p. 25. IEEE Computer Society (1999)

  15. Hoey, J., Little, J.J.: Representation and recognition of complex human motion. In: Proceedings of the Conference on Computer Vision and Pattern Recognition CVPR ’00 (2000)

  16. Little, J.J., Boyd, J.E.: Recognizing people by their gait: the shape of motion. J. Comput. Vis. Res. 1(2), 1–33 (1998)

    Google Scholar 

  17. Black, M.J., Jepson, A.D.: A probabilistic framework for matching temporal trajectories: condensation-based recognition of gestures and expressions. In: Proceedings of the 5th European Conference on Computer Vision-Volume I ECCV ’98, London, UK, pp. 909–924. Springer, Berlin Heidelberg New York (1998)

    Google Scholar 

  18. Chan, C.S., Liu, H., Brown, D.J.: Human arm-motion classification using qualitative normalised templates. In: Knowledge-Based Intelligent Information and Engineering Systems KES ’06 LNAI, vol. 4251, pp. 639–646. Springer, Berlin Heidelberg New York (2006)

    Chapter  Google Scholar 

  19. Craig, J.: Introduction to Robotics: Mechanics and Control. Addison-Wesley Reading, Boston, MA (1989)

    MATH  Google Scholar 

  20. Bregler, C., Malik, J.: Tracking people with twists and exponential maps. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition CVPR ’98, Washington, DC, p. 8. IEEE Computer Society (1998)

  21. Ounpuu, S.: The biomechanics of walking and running. Clin. Sports Med. 13(4), 843–863 (1994)

    Google Scholar 

  22. Thordarson, D.: Running biomechanics. Clin. Sports Med. 16(2), 239–247 (1997)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Chee Seng Chan.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Chan, C.S., Liu, H. & Brown, D.J. Recognition of Human Motion From Qualitative Normalised Templates. J Intell Robot Syst 48, 79–95 (2007). https://doi.org/10.1007/s10846-006-9100-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10846-006-9100-2

Key words

  • human motion classification
  • pattern recognition