3D Facial Landmark Localization Using Combinatorial Search and Shape Regression
This paper presents a method for the automatic detection of facial landmarks. The algorithm receives a set of 3D candidate points for each landmark (e.g. from a feature detector) and performs combinatorial search constrained by a deformable shape model. A key assumption of our approach is that for some landmarks there might not be an accurate candidate in the input set. This is tackled by detecting partial subsets of landmarks and inferring those that are missing so that the probability of the deformable model is maximized. The ability of the model to work with incomplete information makes it possible to limit the number of candidates that need to be retained, substantially reducing the number of possible combinations to be tested with respect to the alternative of trying to always detect the complete set of landmarks. We demonstrate the accuracy of the proposed method in a set of 144 facial scans acquired by means of a hand-held laser scanner in the context of clinical craniofacial dysmorphology research. Using spin images to describe the geometry and targeting 11 facial landmarks, we obtain an average error below 3 mm, which compares favorably with other state of the art approaches based on geometric descriptors.
KeywordsShape Model Deformable Model Gabor Wavelet Spin Image Statistical Shape Model
Unable to display preview. Download preview PDF.
- 5.Szeptycki, P., Ardabilian, M., Chen, L.: A coarse-to-fine curvature analysis-based rotation invariant 3D face landmarking. In: BTAS, pp. 1–6 (2009)Google Scholar
- 6.Faltemier, T., Bowyer, K., Flynn, P.: Rotated profile signatures for robust 3D feature detection. In: FG, pp. 1–7 (2008)Google Scholar
- 7.Yu, T., Moon, Y.: A novel genetic algorithm for 3D facial landmark localization. In: BTAS, pp. 1–6 (2008)Google Scholar
- 8.D’ Hose, J., Colineau, J.: Bichon, et al.: Precise localization of landmarks on 3D faces using Gabor wavelets. In: BTAS, pp. 1–6 (2007)Google Scholar
- 9.Romero-Huertas, M., Pears, N.: Landmark localisation in 3D face data. In: Int. Conf. on Adv. Video and Signal Based Surveillance, pp. 73–78 (2009)Google Scholar
- 10.Zhao, X., Szeptycki, P.: Dellandrea, et al.: Precise 2.5D facial landmarking via an analysis by synthesis approach. In: Workshop on Appl. of Comput. Vis., pp. 1–7 (2009)Google Scholar
- 12.Creusot, C., Pears, N., Austin, J.: 3D face landmark labelling. In: ACM Workshop on 3D Object Retrieval, pp. 23–32 (2010)Google Scholar
- 13.Amberg, B., Vetter, T.: Optimal landmark detection using shape models and branch and bound. In: ICCV, pp. 455–462 (2011)Google Scholar
- 18.Cootes, T., Taylor, C.: Statistical models of appearance for computer vision. Technical report, Wolfson Image Analysis Unit, University of Manchester, UK (2001)Google Scholar