Skip to main content
SpringerLink
Log in

Optimization over geodesics for exact principal geodesic analysis

  • Published:
Advances in Computational Mathematics Aims and scope Submit manuscript

Abstract

In fields ranging from computer vision to signal processing and statistics, increasing computational power allows a move from classical linear models to models that incorporate non-linear phenomena. This shift has created interest in computational aspects of differential geometry, and solving optimization problems that incorporate non-linear geometry constitutes an important computational task. In this paper, we develop methods for numerically solving optimization problems over spaces of geodesics using numerical integration of Jacobi fields and second order derivatives of geodesic families. As an important application of this optimization strategy, we compute exact Principal Geodesic Analysis (PGA), a non-linear version of the PCA dimensionality reduction procedure. By applying the exact PGA algorithm to synthetic data, we exemplify the differences between the linearized and exact algorithms caused by the non-linear geometry. In addition, we use the numerically integrated Jacobi fields to determine sectional curvatures and provide upper bounds for injectivity radii.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Blum, H., Wathen-Dunn, W.: A transformation for extracting new descriptors of shape, models for the perception of speech and visual form, 362–380 (1967)

  2. Caselles, V., Kimmel, R., Sapiro, G.: Geodesic active contours. Int. J. Comput. Vis. 22, 61–79 (1995)

    Article  Google Scholar 

  3. Decell, H.P.: On the derivative of the generalized inverse of a matrix. Linear and Multilinear Algebra 1(4), 357 (1974)

    Article  MathSciNet  Google Scholar 

  4. Dedieu, J.-P., Nowicki, D.: Symplectic methods for the approximation of the exponential map and the Newton iteration on Riemannian submanifolds. J. Complex. 21(4), 487–501 (2005)

    Article  MATH  MathSciNet  Google Scholar 

  5. do Carmo, M.P.: Riemannian geometry. In: Mathematics: Theory & Applications. Birkhauser Boston Inc., Boston (1992)

    Google Scholar 

  6. Ferreira, R., Xavier, J., Costeria, J., Barroso, V.: Newton algorithms for riemannian distance related problems on connected locally symmetric manifolds, Technical Report, Institute for Systems and Robotics (ISR) (2008)

  7. Fletcher, P.T., Joshi, S.: Principal geodesic analysis on symmetric spaces: Statistics of diffusion tensors. ECCV Workshops CVAMIA and MMBIA. 3117, 87–98 (2004)

  8. Fletcher, P.T.: Riemannian geometry for the statistical analysis of diffusion tensor data. Signal Process. 87(2), 250–262 (2007)

    Article  MATH  MathSciNet  Google Scholar 

  9. Fletcher, P.T., Venkatasubramanian, S., Joshi, S.: Robust statistics on Riemannian manifolds via the geometric median, 2008 IEEE Conference on Computer Vision and Pattern Recognition (Anchorage, AK, USA), pp. 1–8 (2008)

  10. Fletcher, P.T.: Geodesic regression on riemannian manifolds, Workshop on Mathematical Foundations of Computational Anatomy (MFCA) at MICCAI (2011)

  11. Fletcher, P.T., Lu, C., Joshi, S.: Statistics of shape via principal geodesic analysis on Lie groups, CVPR 2003, vol. 1, 2003, pp. I–95–I–101 vol.1.

  12. Fletcher, P.T., Lu, C., Pizer, S.M., Joshi, S.: Principal geodesic analysis for the study of nonlinear statistics of shape. IEEE Trans. Med. Imaging (2004)

  13. Fréchet, M.: Les éléments aléatoires de nature quelconque dans un espace distancie. Ann. Inst. H. Poincaré 10, 215–310 (1948)

    Google Scholar 

  14. Golub, G.H., Pereyra, V.: The differentiation of pseudo-inverses and nonlinear least squares problems whose variables separate. SIAM J. Numer. Anal. 10(2), 413–432 (1973)

    Article  MATH  MathSciNet  Google Scholar 

  15. Hairer, E., Lubich, C., Wanner, G.: Geometric numerical integration. Springer (2002)

  16. Hairer, E., Nørsett, S.P., Wanner, G.: Solving ordinary differential equations I: nonstiff problems (Springer Series in Computational Mathematics), 2nd edn., Springer (2008)

  17. Hanson, R.J., Lawson, C.L.: Extensions and applications of the householder algorithm for solving linear least squares problems. Math. Comput. 23(108), 787–812 (1969)

    Article  MATH  MathSciNet  Google Scholar 

  18. Hauberg, S., Sommer, S., Pedersen, K.S.: Natural metrics and least-committed priors for articulated tracking. Image Vis. Comput. 30(6–7) (2012)

  19. Huckemann, S., Hotz, T., Munk, A.: Intrinsic shape analysis: geodesic PCA for Riemannian manifolds modulo isometric Lie group actions. Stat. Sin. 20(1), 1–100 (2010)

    MATH  MathSciNet  Google Scholar 

  20. Joshi, S., Pizer, S., Fletcher, P.T., Yushkevich, P., Thall, A., Marron, J.S.: Multiscale deformable model segmentation and statistical shape analysis using medial descriptions. IEEE Trans. Med. Imaging 21(5), 538–550 (2002). PMID: 12071624

    Article  Google Scholar 

  21. Karcher, H.: Riemannian center of mass and mollifier smoothing. Commun. Pur. Appl. Math. 30(5), 509–541 (1977)

    Article  MATH  MathSciNet  Google Scholar 

  22. Keller, H.B.: Numerical methods for two-point boundary-value problems, Blaisdell, (Waltham, Mass) (1968)

  23. Kendall, D.G., Manifolds, S.: Procrustean metrics and complex projective spaces. Bull. London Math. Soc. 16(2), 81–121 (1984)

    Article  MATH  MathSciNet  Google Scholar 

  24. Klassen, E., Srivastava, A.: Geodesics between 3d closed curves using path-straightening, ECCV 2006, vol. 3951, pp. 95–106. Springer (2006)

  25. Klassen, E., Srivastava, A., Mio, W., Joshi, S.: Analysis of planar shapes using geodesic paths on shape spaces. IEEE Trans. Pattern. Anal. Mach. Intell. 26, 372–383 (2004)

    Article  Google Scholar 

  26. Lee, J.M.: Riemannian manifolds, Graduate Texts in Mathematics, vol. 176, Springer-Verlag, New York (1997)

  27. Luenberger, D.G.: The gradient projection method along geodesics. Manag. Sci. 18(11), 620–631 (1972)

    Article  MATH  MathSciNet  Google Scholar 

  28. Noakes, L.: A global algorithm for geodesics. J. Aust. Math. Soc. 64, 37–50 (1998)

    Article  MathSciNet  Google Scholar 

  29. Pennec, X.: Intrinsic statistics on Riemannian manifolds: basic tools for geometric measurements. J. Math. Imaging Vis. 25(1), 127–154 (2006)

    Article  MathSciNet  Google Scholar 

  30. Pennec, X., Fillard, P., Ayache, N.: A Riemannian framework for tensor computing. Int. J. Comput. Vis. 66(1), 41–66 (2006)

    Article  MathSciNet  Google Scholar 

  31. Pennec, X., Guttmann, C., Thirion, J.-P.: Feature-based registration of medical images: Estimation and validation of the pose accuracy, MICCAI 1998, pp. 1107–1114. Springer, Berlin (1998)

    Google Scholar 

  32. Rabier, P.J., Rheinboldt, W.C.: On a computational method for the second fundamental tensor and its application to bifurcation problems. Numer. Math. 57(1), 681–694 (1990)

    Article  MATH  MathSciNet  Google Scholar 

  33. Rheinboldt, W.C.: MANPAK: A set of algorithms for computations on implicitly defined manifolds. Comput. Math. Appl. 32(12), 15–28 (1996)

    Article  MATH  MathSciNet  Google Scholar 

  34. Said, S., Courty, N., Le Bihan, N., Sangwine, S.: Exact principal geodesic analysis for data on SO(3), EUSIPCO 2007 (2007)

  35. Schmidt, F., Clausen, M., Cremers, D.: Shape matching by variational computation of geodesics on a manifold, Pattern Recognition, pp. 142–151. Springer, Berlin (2006)

    Google Scholar 

  36. Sminchisescu, C., Jepson, A.: Generative modeling for continuous non-linearly embedded visual inference, In ICML, 759–766 (2004)

  37. Sommer, S.: Horizontal dimensionality reduction and iterated frame bundle development, Geometric Science of Information (GSI) (2013)

  38. Sommer, S., Lauze, F., Hauberg, S., Nielsen, M.: Manifold valued statistics, exact principal geodesic analysis and the effect of linear approximations, ECCV 2010, vol. 6316, Springer (2010)

  39. Sommer, S., Tatu, A., Chen, C., Jørgensen, D., de Bruijne, M., Loog, M., Nielsen, M., Lauze, F.: Bicycle chain shape models, MMBIA workshop at CVPR. IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Miami (2009)

  40. Urtasun, R., Fleet, D.J., Hertzmann, A., Fua, P.: Priors for people tracking from small training sets, 2005 IEEE International Conference on Computer Vision (ICCV), IEEE Computer Society, pp. 403–410 (2005)

  41. Wu, J., Smith, W., Hancock, E.: Weighted principal geodesic analysis for facial gender classification, progress in pattern recognition, Image Analysis and Applications, pp. 331–339. Springer, Berlin (2008)

  42. Yang, L.: Means of probability measures in Riemannian manifolds and applications to radar target detection, Ph.D. thesis, Poitiers University (2011)

  43. Yang, Y.: Globally convergent optimization algorithms on riemannian manifolds: uniform framework for unconstrained and constrained optimization. J. Optim. Theory Appl. 132(2), 245–265 (2007)

    Article  MATH  MathSciNet  Google Scholar 

  44. Younes, L., Arrate, F., Miller, M.I.: Evolutions equations in computational anatomy. NeuroImage 45(1) (2009). Supplement 1, S40–S50

  45. Zhang, Q., Xu, G.: Curvature computations for n-manifolds in and solution to an open problem proposed by R. Goldman. Comput. Aided Geom. Des. 24(2), 117–123 (2007)

    Article  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, University of Copenhagen, Copenhagen, Denmark

    S. Sommer, F. Lauze & M. Nielsen

Authors
  1. S. Sommer
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. F. Lauze
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. M. Nielsen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to S. Sommer.

Additional information

Communicated by: J. M. Peña

Rights and permissions

Reprints and permissions

About this article

Cite this article

Sommer, S., Lauze, F. & Nielsen, M. Optimization over geodesics for exact principal geodesic analysis. Adv Comput Math 40, 283–313 (2014). https://doi.org/10.1007/s10444-013-9308-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10444-013-9308-1

Keywords

Mathematics Subject Classifications (2010)

Search

Navigation