Abstract
Three-dimensional object shape is commonly represented in terms of deformations of a triangular mesh from an exemplar shape. Existing models, however, are based on a Euclidean representation of shape deformations. In contrast, we argue that shape has a manifold structure: For example, summing the shape deformations for two people does not necessarily yield a deformation corresponding to a valid human shape, nor does the Euclidean difference of these two deformations provide a meaningful measure of shape dissimilarity. Consequently, we define a novel manifold for shape representation, with emphasis on body shapes, using a new Lie group of deformations. This has several advantages. First we define triangle deformations exactly, removing non-physical deformations and redundant degrees of freedom common to previous methods. Second, the Riemannian structure of Lie Bodies enables a more meaningful definition of body shape similarity by measuring distance between bodies on the manifold of body shape deformations. Third, the group structure allows the valid composition of deformations. This is important for models that factor body shape deformations into multiple causes or represent shape as a linear combination of basis shapes. Finally, body shape variation is modeled using statistics on manifolds. Instead of modeling Euclidean shape variation with Principal Component Analysis we capture shape variation on the manifold using Principal Geodesic Analysis. Our experiments show consistent visual and quantitative advantages of Lie Bodies over traditional Euclidean models of shape deformation and our representation can be easily incorporated into existing methods.
Chapter PDF
Similar content being viewed by others
References
Balan, A., Sigal, L., Black, M., Davis, J., Haussecker, H.: Detailed human shape and pose from images. In: CVPR, pp. 1–8 (2007)
Hasler, N., Ackermann, H., Rosenhahn, B., Thormahlen, T., Seidel, H.: Multilinear pose and body shape estimation of dressed subjects from image sets. In: CVPR, pp. 1823–1830 (2010)
Salzmann, M., Fua, P.: Linear local models for monocular reconstruction of deformable surfaces. PAMI 33, 931–944 (2011)
Weiss, A., Hirshberg, D., Black, M.: Home 3D body scans from noisy image and range data. In: ICCV, pp. 1951–1958 (2011)
Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., Davis, J.: SCAPE: Shape completion and animation of people. ACM ToG 24, 408–416 (2005)
Sumner, R., Popović, J.: Deformation transfer for triangle meshes. ACM ToG 23, 399–405 (2004)
Hasler, N., Stoll, C., Sunkel, M., Rosenhahn, B., Seidel, H.: A statistical model of human pose and body shape. Computer Graphics Forum 28, 337–346 (2009)
Chao, I., Pinkall, U., Sanan, P., Schröder, P.: A simple geometric model for elastic deformations. ACM ToG 29, 38:1–38:6 (2010)
Grenander, U.: General pattern theory: A mathematical study of regular structures. Clarendon Press (1993)
Grenander, U., Miller, M.: Pattern theory: From representation to inference. Oxford University Press, USA (2007)
Fletcher, P., Lu, C., Joshi, S.: Statistics of shape via principal geodesic analysis on Lie groups. In: CVPR, vol. 1, pp. 95–101 (2003)
Fletcher, P.T., Joshi, S.: Principal Geodesic Analysis on Symmetric Spaces: Statistics of Diffusion Tensors. In: Sonka, M., Kakadiaris, I.A., Kybic, J. (eds.) CVAMIA/MMBIA 2004. LNCS, vol. 3117, pp. 87–98. Springer, Heidelberg (2004)
Balan, A.: Detailed Human Shape and Pose from Images. PhD thesis, Brown Univ., Providence, RI (2010)
Robinette, K., Blackwell, S., Daanen, H., Boehmer, M., Fleming, S., Brill, T., Hoeferlin, D., Burnsides, D.: Civilian American and European Surface Anthropometry Resource (CAESAR) final report. AFRL-HE-WP-TR-2002-0169, US AFRL (2002)
Grenander, U., Miller, M.: Representations of knowledge in complex systems. J. Royal Stat. Soc. B (Methodological), 549–603 (1994)
Freifeld, O., Weiss, A., Zuffi, S., Black, M.: Contour people: A parameterized model of 2D articulated human shape. In: CVPR, pp. 639–646 (2010)
Miller, M., Christensen, G., Amit, Y., Grenander, U.: Mathematical textbook of deformable neuroanatomies. PNAS 90, 11944–11948 (1993)
Grenander, U., Miller, M.: Computational anatomy: An emerging discipline. Quarterly of Applied Math. 56, 617–694 (1998)
Fletcher, P.T., Joshi, S., Lu, C., Pizer, S.M.: Gaussian Distributions on Lie Groups and Their Application to Statistical Shape Analysis. In: Taylor, C.J., Noble, J.A. (eds.) IPMI 2003. LNCS, vol. 2732, pp. 450–462. Springer, Heidelberg (2003)
Alexa, M.: Linear combination of transformations. ACM ToG 21(3), 380–387 (2002)
Kilian, M., Mitra, N., Pottmann, H.: Geometric modeling in shape space. ACM ToG 26(3), 64:1–64:8 (2007)
Kendall, D.: Shape manifolds, Procrustean metrics, and complex projective spaces. Bull. London Math. Soc. 16, 81–121 (1984)
Lee, J.: Introduction to smooth manifolds, vol. 218. Springer (2003)
Freifeld, O., Black, M.: Lie bodies: Supplemental material. MPI-IS-TR-005, Max Planck Institute for Intelligent Systems (2012)
Murray, R., Li, Z., Sastry, S.: A mathematical introduction to robotic manipulation. CRC Press (1994)
Higham, N.: The scaling and squaring method for the matrix exponential revisited. SIAM J. Matrix Analysis and Applications 26(4), 1179–1193 (2005)
Karcher, H.: Riemannian center of mass and mollifier smoothing. Comm. Pure and Applied Math. 30, 509–541 (1977)
Sommer, S., Lauze, F., Hauberg, S., Nielsen, M.: Manifold Valued Statistics, Exact Principal Geodesic Analysis and the Effect of Linear Approximations. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part VI. LNCS, vol. 6316, pp. 43–56. Springer, Heidelberg (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Freifeld, O., Black, M.J. (2012). Lie Bodies: A Manifold Representation of 3D Human Shape. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds) Computer Vision – ECCV 2012. ECCV 2012. Lecture Notes in Computer Science, vol 7572. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33718-5_1
Download citation
DOI: https://doi.org/10.1007/978-3-642-33718-5_1
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33717-8
Online ISBN: 978-3-642-33718-5
eBook Packages: Computer ScienceComputer Science (R0)