Advertisement

On the Superlinear Convergence of Newton’s Method on Riemannian Manifolds

  • Teles A. Fernandes
  • Orizon P. Ferreira
  • Jinyun Yuan
Article

Abstract

In this paper, we study Newton’s method for finding a singularity of a differentiable vector field defined on a Riemannian manifold. Under the assumption of invertibility of the covariant derivative of the vector field at its singularity, we show that Newton’s method is well defined in a suitable neighborhood of this singularity. Moreover, we show that the sequence generated by Newton’s method converges to the solution with superlinear rate.

Keywords

Riemannian manifold Newton’s method Local convergence Superlinear rate 

Mathematics Subject Classification

90C30 49M15 65K05 

Notes

Acknowledgements

The work was supported by FAPEG, UESB, and CNPq Grants 305158/2014-7 and 408151/2016-1.

References

  1. 1.
    Smith, S.T.: Optimization techniques on Riemannian manifolds, Hamiltonian and gradient flows, algorithms and control. In: Bloch, A. (ed.) Fields Institute Communication, vol. 3, pp. 113–136. American Mathematical Society, Providence, RI (1994)Google Scholar
  2. 2.
    Absil, P.A., Mahony, R., Sepulchre, R.: Optimization Algorithms on Matrix Manifolds. Princeton University Press, Princeton, NJ (2008)CrossRefzbMATHGoogle Scholar
  3. 3.
    Luenberger, D.G.: The gradient projection method along geodesics. Manag. Sci. 18, 620–631 (1972)MathSciNetCrossRefzbMATHGoogle Scholar
  4. 4.
    Gabay, D.: Minimizing a differentiable function over a differential manifold. J. Optim. Theory Appl. 37(2), 177–219 (1982)MathSciNetCrossRefzbMATHGoogle Scholar
  5. 5.
    Rapcsák, T.: Minimum problems on differentiable manifolds. Optimization 20(1), 3–13 (1989)MathSciNetCrossRefzbMATHGoogle Scholar
  6. 6.
    Udrişte, C.: Convex Functions and Optimization Methods on Riemannian Manifolds, Mathematics and its Applications, vol. 297. Kluwer Academic Publishers, Dordrecht (1994)CrossRefzbMATHGoogle Scholar
  7. 7.
    Absil, P.A., Amodei, L., Meyer, G.: Two Newton methods on the manifold of fixed-rank matrices endowed with Riemannian quotient geometries. Comput. Stat. 29(3–4), 569–590 (2014)MathSciNetCrossRefzbMATHGoogle Scholar
  8. 8.
    Huang, W., Gallivan, K.A., Absil, P.A.: A Broyden class of quasi-Newton methods for Riemannian optimization. SIAM J. Optim. 25(3), 1660–1685 (2015)MathSciNetCrossRefzbMATHGoogle Scholar
  9. 9.
    Li, C., López, G., Martín-Márquez, V.: Monotone vector fields and the proximal point algorithm on Hadamard manifolds. J. Lond. Math. Soc. 79(3), 663–683 (2009)MathSciNetCrossRefzbMATHGoogle Scholar
  10. 10.
    Li, C., Wang, J.: Newton’s method for sections on Riemannian manifolds: generalized covariant \(\alpha \)-theory. J. Complex. 24(3), 423–451 (2008)MathSciNetCrossRefzbMATHGoogle Scholar
  11. 11.
    Hu, Y., Li, C., Yang, X.: On convergence rates of linearized proximal algorithms for convex composite optimization with applications. SIAM J. Optim. 26(2), 1207–1235 (2016)MathSciNetCrossRefzbMATHGoogle Scholar
  12. 12.
    Ring, W., Wirth, B.: Optimization methods on Riemannian manifolds and their application to shape space. SIAM J. Optim. 22(2), 596–627 (2012)MathSciNetCrossRefzbMATHGoogle Scholar
  13. 13.
    Manton, J.H.: A framework for generalising the Newton method and other iterative methods from Euclidean space to manifolds. Numer. Math. 129(1), 91–125 (2015)MathSciNetCrossRefzbMATHGoogle Scholar
  14. 14.
    Bittencourt, T., Ferreira, O.: Kantorovichs theorem on Newtons method under majorant condition in Riemannian manifolds. J. Glob. Optim. (2016). doi: 10.1007/s10898-016-0472
  15. 15.
    Adler, R.L., Dedieu, J.P., Margulies, J.Y., Martens, M., Shub, M.: Newton’s method on Riemannian manifolds and a geometric model for the human spine. IMA J. Numer. Anal. 22(3), 359–390 (2002)MathSciNetCrossRefzbMATHGoogle Scholar
  16. 16.
    Nash, J.: The imbedding problem for Riemannian manifolds. Ann. Math. 2(63), 20–63 (1956)MathSciNetCrossRefzbMATHGoogle Scholar
  17. 17.
    Moser, J.: A new technique for the construction of solutions of nonlinear differential equations. Proc. Natl. Acad. Sci. USA 47, 1824–1831 (1961)MathSciNetCrossRefzbMATHGoogle Scholar
  18. 18.
    Li, C., Wang, J.H., Dedieu, J.P.: Smale’s point estimate theory for Newton’s method on Lie groups. J. Complex. 25(2), 128–151 (2009)MathSciNetCrossRefzbMATHGoogle Scholar
  19. 19.
    Argyros, I.K., Hilout, S.: Newton’s method for approximating zeros of vector fields on Riemannian manifolds. J. Appl. Math. Comput. 29(1–2), 417–427 (2009)MathSciNetCrossRefzbMATHGoogle Scholar
  20. 20.
    Schulz, V.H.: A Riemannian view on shape optimization. Found. Comput. Math. 14(3), 483–501 (2014)MathSciNetCrossRefzbMATHGoogle Scholar
  21. 21.
    Wang, J.H., Li, C.: Kantorovich’s theorems for Newton’s method for mappings and optimization problems on Lie groups. IMA J. Numer. Anal. 31(1), 322–347 (2011)MathSciNetCrossRefzbMATHGoogle Scholar
  22. 22.
    Ferreira, O.P., Silva, R.C.M.: Local convergence of Newton’s method under a majorant condition in Riemannian manifolds. IMA J. Numer. Anal. 32(4), 1696–1713 (2012)MathSciNetCrossRefzbMATHGoogle Scholar
  23. 23.
    Ferreira, O.P., Svaiter, B.F.: Kantorovich’s theorem on Newton’s method in Riemannian manifolds. J. Complex. 18(1), 304–329 (2002)MathSciNetCrossRefzbMATHGoogle Scholar
  24. 24.
    Li, C., Wang, J.: Newton’s method on Riemannian manifolds: Smale’s point estimate theory under the \(\gamma \)-condition. IMA J. Numer. Anal. 26(2), 228–251 (2006)MathSciNetCrossRefzbMATHGoogle Scholar
  25. 25.
    Ortega, J.M.: Numerical Analysis. A Second Course. Computer Science and Applied Mathematics. Academic Press, New York (1972)Google Scholar
  26. 26.
    Dedieu, J.P., Priouret, P., Malajovich, G.: Newton’s method on Riemannian manifolds: convariant alpha theory. IMA J. Numer. Anal. 23(3), 395–419 (2003)MathSciNetCrossRefzbMATHGoogle Scholar
  27. 27.
    do Carmo, M.P.: Riemannian Geometry. Mathematics: Theory & Applications. Birkhäuser, Boston (1992)CrossRefGoogle Scholar
  28. 28.
    Sakai, T.: Riemannian Geometry, Translations of Mathematical Monographs, vol. 149. American Mathematical Society, Providence, RI (1996)Google Scholar
  29. 29.
    Dieudonné, J.: Foundations of Modern Analysis, vol. 10-I. Academic Press, New York (1969). Enlarged and Corrected Printing, Pure and Applied MathematicsGoogle Scholar
  30. 30.
    Ferreira, O.P., Iusem, A.N., Németh, S.Z.: Concepts and techniques of optimization on the sphere. TOP 22(3), 1148–1170 (2014)MathSciNetCrossRefzbMATHGoogle Scholar
  31. 31.
    Rothaus, O.S.: Domains of positivity. Abh. Math. Sem. Univ. Hambg. 24, 189–235 (1960)MathSciNetCrossRefzbMATHGoogle Scholar
  32. 32.
    Nesterov, Y.E., Todd, M.J.: On the Riemannian geometry defined by self-concordant barriers and interior-point methods. Found. Comput. Math. 2(4), 333–361 (2002)MathSciNetCrossRefzbMATHGoogle Scholar
  33. 33.
    Lang, S.: Fundamentals of Differential Geometry, Graduate Texts in Mathematics, vol. 191. Springer, New York (1999)CrossRefGoogle Scholar
  34. 34.
    Milnor, J.: Morse theory. Based on lecture notes by M. Spivak and R. Wells. In: Annals of Mathematics Studies, No. 51. Princeton University Press, Princeton (1963)Google Scholar
  35. 35.
    Kristály, A., Rădulescu, V.D., Varga, C.G.: Variational Principles in Mathematical Physics, Geometry, and Economics, Encyclopedia of Mathematics and its Applications, vol. 136. Cambridge University Press, Cambridge (2010)zbMATHGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2017

Authors and Affiliations

  • Teles A. Fernandes
    • 1
  • Orizon P. Ferreira
    • 2
  • Jinyun Yuan
    • 3
  1. 1.Universidade Estadual do Sudoeste da BahiaVitória da ConquistaBrazil
  2. 2.IMEUniversidade Federal de GoiásGoiâniaBrazil
  3. 3.Universidade Federal do ParanáCuritibaBrazil

Personalised recommendations