A 3D Model Based Action Recorder Using Computer Vision

  • Yong Li
  • Yuan Rao
  • Youxiang Duan
  • Weishan Zhang
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7759)


In healthcare systems, video surveillance, interactive games and many other applications, human action recognition and recording are very important. This paper presents a comprehensive 3D model based action recording system using computer visions. First, a computer captures human motion videos with a network camera and conducts further detection and tracking of the video resources, then a 3D model is created based on the recorded data results. The action recording system includes background capturing, characters capturing, action tracking, 3D modeling and OGRE controlling. OpenCV is used for background and characters capturing where a background image difference algorithm is used to analyze a moving target and extract different elements. For the action tracking, the Camshift (Continuously Adaptive Mean shift Algorithm) tracking algorithm is used to realize continuous tracking and recognition of moving objects and ensure good performance of the action recorder. In our implementation, 3Dmax is used to build a 3D model and skeletal animations, where Ogremax is used to export models, and then to import the skeletal animations into a testing environment. The evaluations show that our motion recognition and recording system has good performance in one aspect, and can obtain accurate result on the other aspect.


Target detection and tracking Background difference Action recognition 


  1. 1.
    Mao, J., Zou, X., Zhu, J.: Improved Plane Template Two-step Camera Calibration. China Journal of Image and Graphics 9(7), 846–852 (2004)Google Scholar
  2. 2.
    Zhang, C., Su, Y.: Digital Image Compression, pp. 20–23. Tsinghua University Press (2006)Google Scholar
  3. 3.
    Park, J.S.: Interactive 3D reconstruction from multiple images: a primitive-based approach. Pattern Recognition Letters 26(16), 2558–2571 (2005)CrossRefGoogle Scholar
  4. 4.
    Intel Corporation. Open Source Computer Vision Library Reference Manual (December 2001) Google Scholar
  5. 5.
    de la Torre Frade, F., Marroquín, E.M., Pérez, M.E.S., Moreno, J.A.M.: Moving object detection and tracking system: a real-time implementation (1997)Google Scholar
  6. 6.
    Nascimento, J.C., Marques, J.S.: Performance evaluation of object detection algorithms for video surveillance. IEEE Trans. Multimedia, 761–774 (2006)Google Scholar
  7. 7.
    Wu, F., Li, H., Hu, Z.: A New Camera Self-calibration Method Based on Active Vision System. Chinese Journal of Computers 23(11), 1130–1139 (2000)MathSciNetGoogle Scholar
  8. 8.
    Feng, L., Wang, R.: Application of CCD Sensors in the Image Detection System of Human Motion. Instrument Technique and Sensor 5, 33–35 (2000)Google Scholar
  9. 9.
    Wang, T., Feng, W., Luo, D.: Application of Wireless Sensor Network for Detection of Human Body Movements. Instrumentation and Measurment 28(8), 83–86 (2009)Google Scholar
  10. 10.
    Pi, W., Liu, H., Cha, H.: Motion Detection for Human Bodies Basing Adaptive Background Subtraction by Using an Omnidirectional Camera. Journal of Peking University 40(3), 458–464 (2004)Google Scholar
  11. 11.
    Cao, D., Zou, W., Wu, Y.: Motion human detection based on difference background image. Opto-Electronic Engineering 34(6), 107–111 (2007)Google Scholar
  12. 12.
    Liu, Y., Ai, H., Xu, G.: Moving object detection and tracking based on background subtraction. Information and Control 31(8), 315–319 (2002)Google Scholar
  13. 13.
    Wei, J., Liu, Z., Zhang, H.: Moving objects detection algorithm under complex background environment. Microcomputer & Its Applications 2, 49–51 (2010)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Yong Li
    • 1
  • Yuan Rao
    • 2
  • Youxiang Duan
    • 1
  • Weishan Zhang
    • 1
  1. 1.College of Computer & Communication EngineeringChina University of PetroleumQingdaoChina
  2. 2.School of Software EngineeringXi’an Jiaotong UniversityXi’anChina

Personalised recommendations