Skip to main content
SpringerLink
Log in

A Markerless Motion Capture System to Study Musculoskeletal Biomechanics: Visual Hull and Simulated Annealing Approach

  • Published:
Annals of Biomedical Engineering Aims and scope Submit manuscript

Human motion capture is frequently used to study musculoskeletal biomechanics and clinical problems, as well as to provide realistic animation for the entertainment industry. The most popular technique for human motion capture uses markers placed on the skin, despite some important drawbacks including the impediment to the motion by the presence of skin markers and relative movement between the skin where the markers are placed and the underlying bone. The latter makes it difficult to estimate the motion of the underlying bone, which is the variable of interest for biomechanical and clinical applications. A model-based markerless motion capture system is presented in this study, which does not require the placement of any markers on the subject's body. The described method is based on visual hull reconstruction and an a priori model of the subject. A custom version of adapted fast simulated annealing has been developed to match the model to the visual hull. The tracking capability and a quantitative validation of the method were evaluated in a virtual environment for a complete gait cycle. The obtained mean errors, for an entire gait cycle, for knee and hip flexion are respectively 1.5° (±3.9°) and 2.0° (±3.0°), while for knee and hip adduction they are respectively 2.0° (±2.3°) and 1.1° (±1.7°). Results for the ankle and shoulder joints are also presented. Experimental results captured in a gait laboratory with a real subject are also shown to demonstrate the effectiveness and potential of the presented method in a clinical environment.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

FIGURE 1.
FIGURE 2.
FIGURE 3.
FIGURE 4.
FIGURE 5.
FIGURE 6.
FIGURE 7.
FIGURE 8.

Similar content being viewed by others

REFERENCES

  1. Balan, A. O., L. Sigal, and M. J. Black. A quantitative evaluation of video-based 3D person tracking. Proc. IEEE VS-PETS 349–356, 2005.

  2. Bottino, A., and A. Laurentini. A Silhouette based technique for the reconstruction of human movement. Comput. Vis. Image Understand. 83:79–95, 2001.

    Article  Google Scholar 

  3. Bregler, C., and J. Malik. Tracking people with twists and exponential maps. Proc. IEEE CVPR 8–15, 1998.

  4. Cappozzo, A., F. Catani, A. Leardini, M. G. Benedetti, and U. Della Croce. Position and orientation in space of bones during movement: experimental artifacts. Clin. Biomech. 11:90–100, 1996.

    Article  Google Scholar 

  5. Cappozzo, A., F. Catani, U. Della Croce, and A. Leardini. Position and orientation in space of bones during movement: anatomical frame definition and orientation. Clin. Biomech. 10:171–178, 1995.

    Article  Google Scholar 

  6. Cappozzo, A., U. Della Croce, A. Leardini, and L. Chiari. Human movement analysis using stereophotogrammetry Part 1: theoretical background. Gait Post. 21:186–196, 2004.

    Google Scholar 

  7. Cheung, G. K. M., S. Baker, and T. Kanade. Shape-from-silhouette across Time Part II: Applications to human modeling and markerless motion tracking. Int. J. Comp. Vis. 63(3):225–245, 2005.

    Article  Google Scholar 

  8. Chiari, L., U. Della Croce, A. Leardini, and A. Cappozzo. Human movement analysis using stereophotogrammetry Part 2: Instrumental errors. Gait Post. 21:197–211, 2004.

    Article  Google Scholar 

  9. Concalves, L., E. D. Bernardo, E. Ursella, and P. Perona. Monocular tracking of the human arm in 3rd Proceedings of the ICCV’95, pp. 764–770, 1995.

  10. Corazza, S., and C. Cobelli. An accurate model-based approach for markerless motion capture. Proceedings of the Medicon, Italy, 2004.

  11. Corazza, S., E. Alexander, A. Chaudhari, C. Cobelli, and T. Andriacchi. Surface from silhouette reconstruction for markerless motion capture. In Proceedings of the 7th Symposium Comp. Methods in Biomech., Madrid Spain, 2004.

  12. Davis, R. B., III, S. Ounpuu, D. Tyburski, and J. R. Gage. A gait analysis technique data collection and reduction. Human Mov. Sci. 4:575–587, 1991.

    Article  Google Scholar 

  13. Frigo, C., A. Pedotti, L. C. Deming, D. C. Kerrigan, and M. Rabuffetti. Functionally oriented and clinically feasible quantitative gait analysis method. Med. Biol. Eng. Comp. 36(2):179–185, 1998.

    Article  CAS  Google Scholar 

  14. Fuller, J., L. J. Liu, M. C. Murphy, and R. W. Mann. A comparison of lower-extremity skeletal kinematics measured using skin- and pin-mounted markers. Human Mov. Sci. 16:219–242, 1997.

    Article  Google Scholar 

  15. Gavrila, D. M., and L. S. Davis. Towards 3-D model-based tracking and recognition of human movement: A multi-view approach. In Proceedings of the International Workshop on Automatic Face and Gesture Recognition, Zurich, 1995.

  16. Ingber, L. Simulated annealing: practice versus theory. Math. Comp. Model. 18(11):29–57, 1993.

    Article  Google Scholar 

  17. Ingber, L. Very fast simulated re-annealing. J. Math. Comp. Model. 12:967–973, 1989.

    Article  Google Scholar 

  18. Ju, S. X., M. J. Black, and Y. Yacoob. Cardboard people: a parameterized model of articulated motion. In Proceedings of the 2nd International Conference on Automatic face- And Gesture Recognition, Vermont USA. pp. 38–44, 1996.

  19. Kakadiaris, I. A., and D. Metaxas. Model-based estimation of 3D human motion with occlusion based on active multi-viewpoint selection. Proc. IEEE CVPR 81–87, 1996.

  20. Laurentini, A. The visual hull concept for silhouette based image understanding. IEEE PAMI 16(2):150–162, 1994.

    Google Scholar 

  21. Leardini, A., L. Chiari, U. Della Croce, and A. Cappozzo. Human movement analysis using stereophotogrammetry Part 3: Soft tissue artifact assessment and compensation. Gait&Posture 21:212–225, 2004.

    Google Scholar 

  22. Locatelli, M. Simulated annealing algorithms for continuous global optimization: convergence conditions. J. Optim. Theory Appl. 104(1):121–133, 2000.

    Article  Google Scholar 

  23. Matusik, W., C. Buehler, R. Raskar, S. Gortler, and L. McMillan. Image-based visual hulls. Proceedigns of the ACM SIGGRAPH. pp. 369–374, 2000.

  24. Metropolis, N., A. W. Rosenbluth, M. N. Rosenbluth, A. H. Teller, and E. Teller. Equation of state calculations by fast computing machines. J. Chem. Phys. 21:1087–1092, 1953.

    Article  CAS  Google Scholar 

  25. Mündermann, L., A. Mündermann, A. Chaudhari, and T. P. Andriacchi. Conditions that influence the accuracy of anthropometric parameter estimation for human body segments using shape-from-silhouette. SPIE-IS&T Electron. Imag. 5665:268–277, 2005.

    Google Scholar 

  26. Mündermann, L., S. Corazza, A. Chaudhari, E. J. Alexander, and T. P. Andriacchi. Most favourable camera configuration for a shape-from-silhouette markerless motion capture system for biomechanical analysis. IS&T/SPIE Electron. Imag. 5665:278–287, 2005.

    Google Scholar 

  27. Murray, R. M., Z. Li, and S. S. Sastry. A Mathematical Introduction to Robotic Manipulation, Boca Raton, FL USA: CRC Press, 1994.

  28. Potmesil, M. Generating octree models of 3D objects from their silhouettes in a sequence of images. CVGIP 40:1–29, 1987.

    Google Scholar 

  29. Regh, J. M., and T. Kanade. Model-based tracking of self-occluding articulated objects. Proc. IEEE CVPR 612–617, 1995.

  30. Rohr, K. Incremental recognition of pedestrians from image sequences. Proc. IEEE CVPR 8–13, 1993.

  31. Salhi, S., and N. M. Queen. A hybrid algorithm for identifying global and local minima when optimizing functions with many minima. Eu. J. Oper. Res. 155:51–67, 2002.

    Article  Google Scholar 

  32. Sati, M., J. A. De Guise, S. Larouche, and G. Drouin. Quantitative assessment of skin marker movement at the knee. The Knee 3:121–138, 1996.

    Article  Google Scholar 

  33. Szeliski, R. Rapid octree construction from image sequences. CVGIP Image Understand. 58(1):23–32, 1993.

    Article  Google Scholar 

  34. Szu, H., and R. Hartley. Fast simulated annealing. Phys. Lett. A 122:157–162, 1987.

    Article  Google Scholar 

Download references

ACKNOWLEDGMENTS

Funding provided by NSF#03225715 and VA#ADR0001129

Author information

Authors and Affiliations

  1. Department of Mechanical Engineering, Stanford University, 496 Lomita Mall, Durand B. 201, Stanford, CA, USA

    S. Corazza, L. Mündermann, A. M. Chaudhari & T. P. Andriacchi

  2. Department of Information Engineering, University of Padova, Padova, Italy

    T. Demattio & C. Cobelli

  3. Bone and Joint Center, Palo Alto VA, Palo Alto, CA, USA

    T. P. Andriacchi

  4. Department of Orthopedic Surgery, Stanford University Medical Center, Stanford, CA, USA

    T. P. Andriacchi

  5. Department of Mechanical Engineering, Stanford University, 496 Lomita Mall, Durand B. 201, Stanford, CA, 94305-4038, USA

    S. Corazza

Authors
  1. S. Corazza
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. L. Mündermann
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. A. M. Chaudhari
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. T. Demattio
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. C. Cobelli
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. T. P. Andriacchi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to S. Corazza.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Corazza, S., Mündermann, L., Chaudhari, A.M. et al. A Markerless Motion Capture System to Study Musculoskeletal Biomechanics: Visual Hull and Simulated Annealing Approach. Ann Biomed Eng 34, 1019–1029 (2006). https://doi.org/10.1007/s10439-006-9122-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10439-006-9122-8

Keywords

Search

Navigation