Markerless 3D Face Tracking

  • Christian Walder
  • Martin Breidt
  • Heinrich Bülthoff
  • Bernhard Schölkopf
  • Cristóbal Curio
Conference paper

DOI: 10.1007/978-3-642-03798-6_5

Part of the Lecture Notes in Computer Science book series (LNCS, volume 5748)
Cite this paper as:
Walder C., Breidt M., Bülthoff H., Schölkopf B., Curio C. (2009) Markerless 3D Face Tracking. In: Denzler J., Notni G., Süße H. (eds) Pattern Recognition. DAGM 2009. Lecture Notes in Computer Science, vol 5748. Springer, Berlin, Heidelberg

Abstract

We present a novel algorithm for the markerless tracking of deforming surfaces such as faces. We acquire a sequence of 3D scans along with color images at 40Hz. The data is then represented by implicit surface and color functions, using a novel partition-of-unity type method of efficiently combining local regressors using nearest neighbor searches. Both these functions act on the 4D space of 3D plus time, and use temporal information to handle the noise in individual scans. After interactive registration of a template mesh to the first frame, it is then automatically deformed to track the scanned surface, using the variation of both shape and color as features in a dynamic energy minimization problem. Our prototype system yields high-quality animated 3D models in correspondence, at a rate of approximately twenty seconds per timestep. Tracking results for faces and other objects are presented.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Christian Walder
    • 1
    • 2
  • Martin Breidt
    • 1
  • Heinrich Bülthoff
    • 1
  • Bernhard Schölkopf
    • 1
  • Cristóbal Curio
    • 1
  1. 1.Max Planck Institute for Biological CyberneticsTübingenGermany
  2. 2.Informatics and Mathematical ModellingTechnical University of DenmarkDenmark

Personalised recommendations