Extraction of Multiple Motion Trajectories in Human Motion

  • Junghye Min
  • Jin Hyeong Park
  • Rangachar Kasturi
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2749)


This paper presents a method for extracting multiple motion trajectories in human motions. We extract motion trajectories of body parts (hands and feet) using a new method based on optical flow information. This procedure is not sensitive to complicated backgrounds or color distribution of scenes. No body part model or skin color information is used in our method. We first detect Significant Motion Points (SMPs) and obtain motion trajectories by connecting related SMPs through frames using Modified Greedy Optimal Assignment (MGOA) tracker based on the distance, motion similarity, and optical flow information. We test our approach on actual ballet sequences from videos. The resulting trajectories can be used as potential features for activity recognition.


  1. 1.
    C. J. Veeman, M.J.T. Reinders, E. Backer “Resolving Motion Correspondence for Densely Moving Points” IEEE Trans. Pattern Analysis and Machine Intelligence, Vol.23, no.1, pp. 54–72, Jan. 2001.CrossRefGoogle Scholar
  2. 2.
    I.J. Cox, S.L. Hingorani “An Efficient Implementation of Reid’s Multiple Hypothesis Tracking Algorithm and Its Evaluation for the Purpose of Visual Tracking” IEEE Trans. Pattern Analysis and Machine Intelligence, Vol.18, no.2, pp. 138–150, Feb. 1996.CrossRefGoogle Scholar
  3. 3.
    C. Rasmussen, G. D. Hager “Probabilistic Data Association Methods for Tracking Complex Visual Objects” IEEE Trans. Pattern Analysis and Machine Intelligence, Vol.23, no.6, pp. 560–576, June. 2001.CrossRefGoogle Scholar
  4. 4.
    H.W. Kuhn “The Hungarian Method for Solving the Assignment Problem” Naval Research Logistics Quarterly, Vol.2, no.1, pp. 83–97, 1955.CrossRefMathSciNetGoogle Scholar
  5. 5.
    M. Yang, N. Ahuja, M. Tabb. “Extraction of 2D Motion Trajectories and Its Application to Hand Gesture Recognition,” IEEE Trans. Pattern Analysis and Machine Intelligence, Vol.24, no.8, pp. 1061–1074, Aug. 2002.CrossRefGoogle Scholar
  6. 6.
    H. Lee, J.H. Kim “An HMM-based threshold model approach for gesture recognition,” IEEE Trans. Pattern Analysis and Machine Intelligence, Vol.21, no.10, pp. 961–973, Oct. 1999.CrossRefGoogle Scholar
  7. 7.
    D. Meyer, J. Posl, H. Niemann. “Gait Classification with HMMs for Trajectories of Body Parts Extracted by Mixture Densities,” The British Machine Vision Conference, Vol.21, no.10 pp. 961–973, Oct. 1999.Google Scholar
  8. 8.
    J.W. Deng, H.T. Tsui “An HMM-based approach for gesture segmentation and recognition,” In Proc. International Conference on Pattern Recognition, Vol.3, pp. 679–682, 2000Google Scholar
  9. 9.
    J. Ben-Arie, Z. Wang, P. Pandit, S. Rajaram “Human activity recognition using multidimensional indexing,” IEEE Trans. Pattern Analysis and Machine Intelligence, Vol.24, no.8, pp. 1091–1104, Aug.2002CrossRefGoogle Scholar
  10. 10.
    A.F. Bobick, A.D. Wilson. “A State-Based Approach to the Representation and Recognition of Gestures,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no.12, pp. 1325–1337, Dec. 1997CrossRefGoogle Scholar
  11. 11.
    V. Kwatra, A.F. Bobick, A.Y. Johnson “Temporal integration of multiple silhouette-based body-part hypotheses,” In Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 758–764, 2001Google Scholar
  12. 12.
    E. Polat, M. Yeasin, R. Sharma “Detecting and tracking body parts of multiple people,” In Proc. International Conference on Image Processing, vol. 1, pp. 405–408, 2001Google Scholar
  13. 13.
    M.J. Black, P. Anandan “The robust estimation of multiple motions: Parametric and piecewise-smooth flow fields,” Computer Vision and Image Understanding, 63(1), pp. 75–104, Jan. 1996.CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • Junghye Min
    • 1
  • Jin Hyeong Park
    • 1
  • Rangachar Kasturi
    • 1
  1. 1.Department of Computer Science and EngineeringThe Pennsylvania State UniversityUniversity ParkUSA

Personalised recommendations