Feature Tracking for Mesh-Based Performance Capture

  • Edilson de Aguiar
Part of the Cognitive Systems Monographs book series (COSMOS, volume 5)


In this chapter, we propose our second performance capture framework. First, a robust method to track 3D trajectories of features on a moving subject recorded with multiple cameras is described. Thereafter, by combining the 3D trajectories with a mesh deformation scheme, the performance of a moving actor is captured and the high-quality scanned model can be directly animated such that it mimics the subject’s motion.


Scale Invariant Feature Transform Camera View Feature Tracking Performance Capture Feature Trajectory 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    de Aguiar, E., Theobalt, C., Stoll, C., Seidel, H.: Marker-less 3d feature tracking for mesh-based human motion capture. In: Proc. ICCV HUM 2007, pp. 1–15 (2007)Google Scholar
  2. 2.
    Balan, A., Black, M.: An adaptive appearance model approach for model-based articulated object tracking. In: Proc. of CVPR, pp. 758–765 (2006)Google Scholar
  3. 3.
    Brox, T., Bruhn, A., Papenberg, N., Weickert, J.: High accuracy optical flow estimation based on a theory for warping. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3024, pp. 25–36. Springer, Heidelberg (2004)Google Scholar
  4. 4.
    Brox, T., Rosenhahn, B., Cremers, D., Seidel, H.-P.: High accuracy optical flow serves 3-D pose tracking: Exploiting contour and flow based constraints. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3952, pp. 98–111. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  5. 5.
    Kehl, R., Gool, L.V.: Markerless tracking of complex human motions from multiple views. CVIU 104(2), 190–209 (2006)Google Scholar
  6. 6.
    Lowe, D.G.: Distinctive image features from scale-invariant keypoints. IJCV 20, 91–110 (2004)CrossRefGoogle Scholar
  7. 7.
    Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. In: Proc. of CVPR, vol. 2, pp. 257–263 (2003)Google Scholar
  8. 8.
    Pebay, P.P., Baker, T.J.: A comparison of triangle quality measures. In: Proceedings to the 10th International Meshing Roundtable, pp. 327–340 (2001)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Edilson de Aguiar

    There are no affiliations available

    Personalised recommendations