Human Movement Analysis Based on Explicit Motion Models

  • K. Rohr
Chapter
Part of the Computational Imaging and Vision book series (CIVI, volume 9)

Abstract

Within the field of computer vision the automatic interpretation of human movements is one of the most challenging tasks. A central problem in analyzing such movements is due to the fact that the human body consists of body parts linked to each other at joints which allows different movements of the parts. Therefore, the human body generally has to be treated as a nonrigid or more precisely as an articulated body. In addition, for general camera positions always some of the body parts are occluded. Although occlusions can provide important cues in a recognition task, the automatic interpretation is more difficult. Another problem that has to be dealt with is the clothing which can have a large influence on the appearence of a person (wide or tight trousers, different jackets, etc.). Clothing can also cause complex illumination phenomena that, in addition, change during movement (compare with efforts in the field of computer graphics to simulate cloth objects, e.g., [83]).

Keywords

Body Part Kalman Filter Movement State Motion Curve Human Body Model 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in to check access.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Akita, K. Image sequence analysis of real world human motion, Pattern Recognition 17 (1984) 73–83CrossRefGoogle Scholar
  2. 2.
    Aristoteles, Uber die Bewegung der Lebewesen; Uber die Fortbewegung der Lebewesen, Datierung um 330 v.Chr., Teil II und III, J. Kollesch, Aristoteles Werke in deutscher Übersetzung, Band 17, Zoologische Schriften II, E. Grumach, H. Flashar (Hrsg.), Wissenschaftliche Buchgesellschaft, Darmstadt 1985Google Scholar
  3. 3.
    Attwood, C.I., Sullivan, G.D. and Baker, K.D. Model-based Recognition of Human Posture Using Single Synthetic Images, Proc. Fifth Alvey Vision Conf., Univ. of Reading, Reading/UK, 25–28 Sept. 1989, 25–30Google Scholar
  4. 4.
    Badler, N.I. Temporal scene analysis: conceptual descriptions of object movements, Tech. Rep. No. 80, Dept. Computer Science, Univ. Toronto, Feb. 1975Google Scholar
  5. 5.
    Badler, N.I. and Manoochehri, K.H. and Walters, G. Articulated Figure Positioning by Multiple Constraints, IEEE Computer Graphics E4 Appl. 7: 6 (June 1987) 28–38CrossRefGoogle Scholar
  6. 6.
    Baum, L.F. and Denslow, W.W. The Wonderful Wizard of Oz, Geo. M. Hill Co. Chicago New York 1900, Justin Knowles Publishing Group London 1987Google Scholar
  7. 7.
    Beveridge, J.R., Weiss, R. and Riseman, E.M. Optimization of 2-Dimensional Model Matching, Proc. Image Understanding Workshop, Palo Alto, California, May 23–26, 1989, 815–830Google Scholar
  8. 8.
    Binford, T.O. Visual perception by computer, IEEE Conf. on Systems and Control, Dec. 1971Google Scholar
  9. 9.
    Bister, D. Bestimmung der Trajektorien von zeitweise verdeckten Objekten aus einer Bildfolge, Diplomarbeit, Institut für Algorithmen und Kognitive Systeme, Fakultät für Informatik der Universität Karlsruhe (TH ), April 1991Google Scholar
  10. 10.
    Bister, D., Rohr, K. and Schnörr, C. Automatische Bestimmung der Trajektorien von sich bewegenden Objekten aus einer Bildfolge, 12. DAGM - Symposium Mustererkennung, 24.-26. Sept. 1990, Oberkochen-Aalen, Informatik-Fachberichte 254, R.E. Großkopf ( Hrsg. ), Springer-Verlag Berlin Heidelberg 1990, 44–51Google Scholar
  11. 11.
    Braune, W. and Fischer, O. Der Gang des Menschen, 1. Theil: Versuche am unbelasteten und belasteten Menschen,,Abhandlungen der Mathematisch-Physischen Classe der königlich sächsischen Gesellschaft der Wissenschaften, Einundzwanzigster Band, S. Hirzel Leipzig 1895Google Scholar
  12. 12.
    Broida, T.J. and Chellappa, R. Estimation of Object Motion Parameters from Noisy Images, IEEE Trans. on Pattern Anal. and Machine Intell. 8 (1986) 90–99Google Scholar
  13. 13.
    Bruderlin, A. and Calvert, T.W. Goal-Directed, Dynamic Animation of Human Walking, Computer Graphics 23: 3 (July 1989) 233–242CrossRefGoogle Scholar
  14. 14.
    Calvert, T.W. and Chapman, J. Aspects of the Kinematic Simulation of Human Movement, IEEE Computer Graphics & Appl. 2: 9 (Nov. 1982) 41–49CrossRefGoogle Scholar
  15. 15.
    Calvert, T.W. and Chapman, A.E. Analysis and synthesis of human movement, in T.Y. Young (Ed.), Handbook of Pattern Recognition and Image Processing (Vol. 2 ): Computer Vision, Academic Press, SanDiego, CA, 1994, 431–474Google Scholar
  16. 16.
    Canny, F. “A computational approach to edge detection”, IEEE Trans. on Pattern Anal. and Machine Intell. 8 (1986) 679–698CrossRefGoogle Scholar
  17. 17.
    Cédras, C. and Shah, M. Motion-based recognition: a survey, Image and Vision Computing 13: 2 (1995) 129–155CrossRefGoogle Scholar
  18. 18.
    Chen, Z. and Lee, H.-J. Knowledge-Guided Visual Perception of 3-D Human Gait from a Single Image Sequence, IEEE Trans. on Systems, Man and Cyb. 22: 2 (1992) 336–342Google Scholar
  19. 19.
    Cipolla, R. and Yamamoto, M. Stereoscopic Tracking of Bodies in Motion, Proc. Fifth Alvey Vision Conf., Univ. of Reading, Reading/UK, 25–28 Sept. 1989, 109–114Google Scholar
  20. 20.
    Deriche, R. and Faugeras, O. Tracking line segments, Image and Vision Computing 8: 4 (Nov. 1990) 261–270CrossRefGoogle Scholar
  21. 21.
    DIN 33402, Deutsche Normen, Iförpermafle des Menschen, Beuth Verlag Berlin 1987Google Scholar
  22. 22.
    Duda, R.O. and Hart, P.E. Pattern classification and scene analysis, Wiley New York 1973Google Scholar
  23. 23.
    Fischer, O. Theoretische Grundlagen für eine Mechanik der lebenden Körper mit speziellen Anwendungen auf den Menschen, sowie auf einige Bewegungsvorgänge an Menschen, B.G. Teubner Leipzig Berlin 1906Google Scholar
  24. 24.
    Ganapathy, S. Decomposition of transformation matrices for robot vision, Pattern Recognition Letters 2: 6 (1984) 401–412CrossRefGoogle Scholar
  25. 25.
    Gavrila, D.M. and Davis, L.S. 3-D model-based tracking of human upper body movement: a multi-view approach, Proc. Intern. Symposium Computer Vision (ISCV’95), L.s Alamitos, 21–23 Nov. 1995, IEEE Computer Society Press 1995, 253–258Google Scholar
  26. 26.
    Gelb, A. Applied Optimal Estimation, MIT Press, Cambridge/MA, 1974Google Scholar
  27. 27.
    Goddard, N.H. The Interpretation of Visual Motion: Recognizing Moving Light Displays, Proc. Workshop on Visual Motion, Irvine, CA, March 20–22, 1989, 21 2220Google Scholar
  28. 28.
    Guo, Y., Xu, G. and Tsuji, S. Tracking human body motion based on a stick figure model, J. of Visual Communication and Image Representation 5: 1 (1994) 1–9CrossRefGoogle Scholar
  29. 29.
    Hartmann, E. Computerunterstützte Darstellende Geometrie, B.G. Teubner Stuttgart 1988MATHGoogle Scholar
  30. 30.
    Hartrum, T.C. Computer implementation of a parametric model for biped locomotion kinematics, Ph.D. Thesis, School of the Ohio State University, Columbus, Ohio, 1973Google Scholar
  31. 31.
    Herzog, G. and Rohr, K. “Integrating Vision and Language: Towards Automatic Description of Human Movements”, Proc. 19th Conf. on Artificial Intelligence, KI-95: Advances in Artificial Intelligence, Sept. 1995, Bielefeld/Germany, Lecture Notes in Artificial Intelligence 981, I. Wachsmuth, C.-R. Rollinger, and W. Brauer ( Eds. ), Springer-Verlag Berlin Heidelberg 1995, 259–268Google Scholar
  32. 32.
    Herzog, G. and Wazinski, P. VIsual TRAnslator: Linking Perceptions and Natural Language Descriptions, Artificial Intelligence Review 8: 2 /3 (1994) 175–187Google Scholar
  33. 33.
    Hoffman, D.D. and Flinchbaugh, B.E. Interpretation of Biological Motion, Biol. Cybern. 42 (1982) 195–204MATHGoogle Scholar
  34. 34.
    Hogg, D. Model based vision: a program to see a walking person, Image and Vision Computing 1: 1 (1983) 5–20CrossRefGoogle Scholar
  35. 35.
    Hogg, D. Interpreting Images of a Known Moving Object, PhD dissertation, University of Sussex, Brighton/UK 1984Google Scholar
  36. 36.
    Hsu, Y.Z., Nagel, H.-H. and Rekers, G. New Likelihood Test Methods for Change Detection in Image Sequences, Computer Vision, Graphics, and Image Processing 26 (1984) 73–106CrossRefGoogle Scholar
  37. 37.
    Inman, H.V.T., Ralston, H.J. and Todd, F. Human walking, Williams & Wilkins Baltimore/London 1980Google Scholar
  38. 38.
    Johansson, G. Spatio-temporal differentiation and integration in visual motion perception, Psychological Research 38 (1976) 379–396CrossRefGoogle Scholar
  39. 39.
    Kalman, R.E. A New Approach to Linear Filtering and Prediction Problems, Trans. ASME J. Basic Eng., Series 82D (March 1960) 35–45Google Scholar
  40. 40.
    Kambhamettu, C., Goldgof, D.B., Terzopoulos, D. and Huang, T.S. Nonrigid motion analysis, in T.Y. Young (Ed.), Handbook of Pattern Recognition and Image Processing (Vol. 2): Computer Vision, Academic Press, SanDiego, CA, 1994, 405430.Google Scholar
  41. 41.
    Kinzel, W. and Dickmanns, E.D. Moving Humans Recognition using SpatioTemporal Models, Proc. ISPRS’92, Washington, D.C., Internat. Archives for Photogrammetry and Remote Sensing, Vol. XXIX, Part B5, L.W. Fritz and J.R. Lucas (Eds.), 1992, 885–892Google Scholar
  42. 42.
    Koenderink, J.J. and van Doom, A.J. The Internal Representation of Solid Shape with Respect to Vision, Biol. Cybernetics 32 (1979) 211–216MATHCrossRefGoogle Scholar
  43. 43.
    Korn, A.F. Toward a Symbolic Representation of Intensity Changes in Images, IEEE Trans. on Pattern Analysis and Machine Intelligence 10 (1988) 610–625CrossRefGoogle Scholar
  44. 44.
    Kunii, T.L. and Sun, L. Dynamic Analysis-Based Human Animation, CG International’90, T.S. Chua, T.L. Kunii (Eds.), Springer-Verlag Tokyo Berlin Heidelberg 1990, 3–15Google Scholar
  45. 45.
    Kurakake, S. and Nevatia, R. Description and Tracking of Moving Articulated Objects, Proc. 11th Intern. Conf. on Pattern Recogn., The Hague, The Netherlands, Aug. 30–Sept. 3, 1992, Vol. I, 491–495Google Scholar
  46. 46.
    Leister, W. and Rohr, K. Voruntersuchungen von Bildsynthesesmethoden zur Analyse von Bildfolgen, Techn. Report Nr. 25/90, Universität Karlsruhe (TH), Fakultät für Informatik, Sept. 1990Google Scholar
  47. 47.
    Leung, M.K. and Yang, Y.H. A region based approach for human body motion analysis, Pattern Recognition 20: 3 (1987) 321–339CrossRefGoogle Scholar
  48. 48.
    Lowe, D.G. The Viewpoint Consistency Constraint, Internat. J. of Computer Vision 1 (1987) 57–72CrossRefGoogle Scholar
  49. 49.
    Luo, Y., Perales, F.J. and Villanueva, J.J. An Automatic Rotoscopy System for Human Motion Based on a Biomechanic Graphical Model, Comput. f4 Graphics 16: 4 (1992) 355–362CrossRefGoogle Scholar
  50. 50.
    Marey, É.-J. Movement, William Heine London 1895Google Scholar
  51. 51.
    Marr, D. and Nishihara, H.K. Representation and recognition of the spatial organization of three-dimensional shapes, Proc. R. Soc. Lond. B 200 (1978) 269–294CrossRefGoogle Scholar
  52. 52.
    Marr, D. and Vaina, L. Representation and recognition of the movements of shapes, Proc. R. Soc. Lond. B 214 (1982) 501–524CrossRefGoogle Scholar
  53. 53.
    McIntosh, J.H. and Mutch, K.M. Matching straight Lines, Computer Vision, Graphics, and Image Processing 43 (1988) 386–408CrossRefGoogle Scholar
  54. 54.
    Murray, M.P. Gait as a total pattern of movement, American J. of Physical Med. 46: 1 (1967) 290–332Google Scholar
  55. 55.
    Murray, M.P., Drought, A.B. and Kory, R.C. Walking Patterns of Normal Men, The J. of Bone and Joint Surgery 46-A: 2 (1964) 335–360Google Scholar
  56. Muybridge, E. Muybridge’s complete Human and Animal Locomotion. All 781 Plates from the 1887 `Animal Locomotion’,Vol. 1, Dover Publications, Inc., New York 1979Google Scholar
  57. 57.
    Neumann, B. Natural Language Description of Time-Varying Scenes, in Semantic Structures, Advances in Natural Language Processing, D.L. Waltz (Ed.), Lawrence Erlbaum, Hillsdale/NJ, 1989, 167–206Google Scholar
  58. 58.
    Neumann, B. and Novak, H.-J. Event models for recognition and natural language description of events in real-world sequences, Proc. Internat. Joint Conf. on Artificial Intell. (IJCAI’83), 1983, 724–726Google Scholar
  59. 59.
    Newman, W.M. and Sproull, R.F. Grundzüge der interaktiven Computergrafik, McGraw-Hill Book Company Hamburg 1986Google Scholar
  60. 60.
    Niyogi, S.A. and Adelson, E.H. Analyzing and Recognizing Walking Figures in XYT, Proc. IEEE Conf. on Computer Vision é4 Pattern Recognition, Seattle, WA, June 21–23, 1994, 469–474Google Scholar
  61. 61.
    O’Rourke, J. and Badler, N.I. Model-based image analysis of human motion using constraint propagation IEEE Trans. on Pattern Anal. and Machine Intell. 2:6 (1980) 522–536 Google Scholar
  62. 62.
    Pentland, A. and Horowitz, B. Recovery of Non-Rigid Motion and Structure, IEEE Trans. on Pattern Anal. and Machine Intell. 13: 7 (1991) 730–742CrossRefGoogle Scholar
  63. 63.
    Perrett, D.I., Harries, M.H., Benson, P.J., Chitty, A.J. and Mistlin, A.J. Retrieval of Structure from Rigid and Biological Motion: An Analysis of the Visual Responses of Neurones in the Macaque Temporal Cortex, in AI and the Eye, A. Blake and T. Troscianko ( Eds. ), John Wiley & Sons Chichester/UK New York/NY 1990, 181–200Google Scholar
  64. 64.
    Pun, T. and Blake, E. Relationships between Image Synthesis and Analysis: Towards Unification, Computer Graphics Forum 9: 2 (1990) 149–163CrossRefGoogle Scholar
  65. 65.
    Qian, R.J. and Huang, T.S. Motion Analysis of Human Ambulatory Patterns, Proc. 11th Intern. Conf. on Pattern Recogn., The Hague, The Netherlands, Aug. 30–Sept. 3, 1992, Vol. I, 220–223Google Scholar
  66. 66.
    Rashid, R.F. Towards a System for the Interpretation of Moving Light Displays, IEEE Trans. on Pattern Anal. and Machine Intell. 2: 6 (Nov. 1980) 574–581Google Scholar
  67. 67.
    Rehfeld, N. Auswertung von Stereobildfolgen mit Kantenmerkmalen, Dissertation, Fakultät für Informatik der Universität Karlsruhe (TH), Juni 1990Google Scholar
  68. 68.
    Rieger, J.H. On the complexity and computation of view graphs of piecewise smooth algebraic surfaces, Phil. Trans. R. Soc. Lond. A 354 (1996) 1899–1940MathSciNetMATHCrossRefGoogle Scholar
  69. 69.
    Rogers, D.F. and Adams, J.A. Mathematical Elements for Computer Graphics, McGraw-Hill Book Company New York 1976Google Scholar
  70. 70.
    Rohr, K. Auf dem Wege zu modellgestütztem Erkennen von bewegten nicht-starren Körpern in Realweltbildfolgen, 11. DAGM - Symposium Mustererkennung, 2.-4. Okt. 1989, Hamburg, Informatik-Fachberichte 219, H. Burkhardt, K.H. Höhne, B. Neumann ( Hrsg. ), Springer-Verlag Berlin Heidelberg 1989, 324–328Google Scholar
  71. 71.
    Rohr, K. Incremental Recognition of Pedestrians from Image Sequences, Proc. IEEE Conf. on Computer Vision e.4 Pattern Recognition, New York/NY, USA, June 15–17, 1993, 8–13Google Scholar
  72. 72.
    Rohr, K. Towards Model-Based Recognition of Human Movements in Image Sequences, Computer Vision, Graphics, and Image Processing: Image Understanding 59: 1 (1994) 94–115Google Scholar
  73. 73.
    Schwarz, H.R. Numerische Mathematik, B.G. Teubner Stuttgart 1986MATHGoogle Scholar
  74. 74.
    Seitz, S.M. and Dyer, C.R. Affine Invariant Detection of Periodic Motion, Proc. IEEE Conf. on Computer Vision ê4 Pattern Recognition, Seattle, WA, June 21–23, 1994, 970–975Google Scholar
  75. 75.
    Sester, M. and Förstner, W. Object Location Based on Uncertain Models, 11. DAGM-Symposium Mustererkennung, Hamburg, 2.-4. Okt. 1989, Informatik-Fachberichte 219, H. Burkhardt, K.H. Höhne, and B. Neumann (Hrsg.), Springer-Verlag Berlin Heidelberg 1989, 457–464Google Scholar
  76. 76.
    Shiohara, M., Gotoh, T., Nakagawa, Y.M. and Yoshida, Surface Correspondence Based on Three-dimensional Structure Inference In Animation Images, 10th Intern. Conf. on Pattern Recognition, 16–21 June 1990, Atlantic City, New Jersey, USA, 194–197Google Scholar
  77. 77.
    Tost, D. and Pueyo, X. Human body animation: a survey, The Visual Computer 3 (1988) 254–264CrossRefGoogle Scholar
  78. 78.
    Tsuji, S., Osada, M. and Yachida, M. Tracking and Segmentation of Moving Objects in Dynamic Line Images, IEEE Trans. on Pattern Anal. and Machine Intell. 2: 6 (1980) 516–522Google Scholar
  79. 79.
    Tsukiyama, V.T. and Shirai, Y. Detection of the movements of persons from a sparse sequence of TV images, Pattern Recognition 18 (1985) 207–213CrossRefGoogle Scholar
  80. 80.
    Voss, K. Theoretische Grundlagen der digitalen Bildverarbeitung, Akademie Verlag Berlin 1988Google Scholar
  81. 81.
    Webb, J.A. and Aggarwal, J.K. Structure from Motion of Rigid and Jointed Objects, Artificial Intelligence 19 (1982) 107–130CrossRefGoogle Scholar
  82. 82.
    Weber, W. and Weber, E. Mechanik der menschlichen Gehwerkzeuge, Dietrichsche Buchhandlung, Göttingen 1836Google Scholar
  83. 83.
    Weil, J. The Synthesis of Cloth Objects, Computer Graphics 20: 4 (1986) 49–54MathSciNetCrossRefGoogle Scholar
  84. 84.
    Wilhelms, J. Using Dynamic Analysis for Realistic Animation of Articulated Bodies, IEEE Computer Graphics e4 Appl. 7: 6 (June 1987) 12–27CrossRefGoogle Scholar
  85. 85.
    Yamamoto, M. and Koshikawa, K. Human Motion Analysis Based on a Robot Arm Model, Proc. Computer Vision and Pattern Recogn., Lahaina, Maui, Hawaii, June 3–6, 1991, 664–665Google Scholar
  86. 86.
    Zeltzer, D. Motor Control Techniques for Figure Animation, IEEE Computer Graphics ê4 Appl. 2: 9 (Nov. 1982) 53–59CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media Dordrecht 1997

Authors and Affiliations

  • K. Rohr
    • 1
  1. 1.Arbeitsbereich Kognitive Systeme Fachbereich InformatikUniversität HamburgHamburgGermany

Personalised recommendations