On the Superlinear Convergence of Newton’s Method on Riemannian Manifolds

  • Teles A. Fernandes
  • Orizon P. Ferreira
  • Jinyun Yuan


In this paper, we study Newton’s method for finding a singularity of a differentiable vector field defined on a Riemannian manifold. Under the assumption of invertibility of the covariant derivative of the vector field at its singularity, we show that Newton’s method is well defined in a suitable neighborhood of this singularity. Moreover, we show that the sequence generated by Newton’s method converges to the solution with superlinear rate.


Riemannian manifold Newton’s method Local convergence Superlinear rate 

Mathematics Subject Classification

90C30 49M15 65K05 



The work was supported by FAPEG, UESB, and CNPq Grants 305158/2014-7 and 408151/2016-1.


  1. 1.
    Smith, S.T.: Optimization techniques on Riemannian manifolds, Hamiltonian and gradient flows, algorithms and control. In: Bloch, A. (ed.) Fields Institute Communication, vol. 3, pp. 113–136. American Mathematical Society, Providence, RI (1994)Google Scholar
  2. 2.
    Absil, P.A., Mahony, R., Sepulchre, R.: Optimization Algorithms on Matrix Manifolds. Princeton University Press, Princeton, NJ (2008)CrossRefMATHGoogle Scholar
  3. 3.
    Luenberger, D.G.: The gradient projection method along geodesics. Manag. Sci. 18, 620–631 (1972)MathSciNetCrossRefMATHGoogle Scholar
  4. 4.
    Gabay, D.: Minimizing a differentiable function over a differential manifold. J. Optim. Theory Appl. 37(2), 177–219 (1982)MathSciNetCrossRefMATHGoogle Scholar
  5. 5.
    Rapcsák, T.: Minimum problems on differentiable manifolds. Optimization 20(1), 3–13 (1989)MathSciNetCrossRefMATHGoogle Scholar
  6. 6.
    Udrişte, C.: Convex Functions and Optimization Methods on Riemannian Manifolds, Mathematics and its Applications, vol. 297. Kluwer Academic Publishers, Dordrecht (1994)CrossRefMATHGoogle Scholar
  7. 7.
    Absil, P.A., Amodei, L., Meyer, G.: Two Newton methods on the manifold of fixed-rank matrices endowed with Riemannian quotient geometries. Comput. Stat. 29(3–4), 569–590 (2014)MathSciNetCrossRefMATHGoogle Scholar
  8. 8.
    Huang, W., Gallivan, K.A., Absil, P.A.: A Broyden class of quasi-Newton methods for Riemannian optimization. SIAM J. Optim. 25(3), 1660–1685 (2015)MathSciNetCrossRefMATHGoogle Scholar
  9. 9.
    Li, C., López, G., Martín-Márquez, V.: Monotone vector fields and the proximal point algorithm on Hadamard manifolds. J. Lond. Math. Soc. 79(3), 663–683 (2009)MathSciNetCrossRefMATHGoogle Scholar
  10. 10.
    Li, C., Wang, J.: Newton’s method for sections on Riemannian manifolds: generalized covariant \(\alpha \)-theory. J. Complex. 24(3), 423–451 (2008)MathSciNetCrossRefMATHGoogle Scholar
  11. 11.
    Hu, Y., Li, C., Yang, X.: On convergence rates of linearized proximal algorithms for convex composite optimization with applications. SIAM J. Optim. 26(2), 1207–1235 (2016)MathSciNetCrossRefMATHGoogle Scholar
  12. 12.
    Ring, W., Wirth, B.: Optimization methods on Riemannian manifolds and their application to shape space. SIAM J. Optim. 22(2), 596–627 (2012)MathSciNetCrossRefMATHGoogle Scholar
  13. 13.
    Manton, J.H.: A framework for generalising the Newton method and other iterative methods from Euclidean space to manifolds. Numer. Math. 129(1), 91–125 (2015)MathSciNetCrossRefMATHGoogle Scholar
  14. 14.
    Bittencourt, T., Ferreira, O.: Kantorovichs theorem on Newtons method under majorant condition in Riemannian manifolds. J. Glob. Optim. (2016). doi: 10.1007/s10898-016-0472
  15. 15.
    Adler, R.L., Dedieu, J.P., Margulies, J.Y., Martens, M., Shub, M.: Newton’s method on Riemannian manifolds and a geometric model for the human spine. IMA J. Numer. Anal. 22(3), 359–390 (2002)MathSciNetCrossRefMATHGoogle Scholar
  16. 16.
    Nash, J.: The imbedding problem for Riemannian manifolds. Ann. Math. 2(63), 20–63 (1956)MathSciNetCrossRefMATHGoogle Scholar
  17. 17.
    Moser, J.: A new technique for the construction of solutions of nonlinear differential equations. Proc. Natl. Acad. Sci. USA 47, 1824–1831 (1961)MathSciNetCrossRefMATHGoogle Scholar
  18. 18.
    Li, C., Wang, J.H., Dedieu, J.P.: Smale’s point estimate theory for Newton’s method on Lie groups. J. Complex. 25(2), 128–151 (2009)MathSciNetCrossRefMATHGoogle Scholar
  19. 19.
    Argyros, I.K., Hilout, S.: Newton’s method for approximating zeros of vector fields on Riemannian manifolds. J. Appl. Math. Comput. 29(1–2), 417–427 (2009)MathSciNetCrossRefMATHGoogle Scholar
  20. 20.
    Schulz, V.H.: A Riemannian view on shape optimization. Found. Comput. Math. 14(3), 483–501 (2014)MathSciNetCrossRefMATHGoogle Scholar
  21. 21.
    Wang, J.H., Li, C.: Kantorovich’s theorems for Newton’s method for mappings and optimization problems on Lie groups. IMA J. Numer. Anal. 31(1), 322–347 (2011)MathSciNetCrossRefMATHGoogle Scholar
  22. 22.
    Ferreira, O.P., Silva, R.C.M.: Local convergence of Newton’s method under a majorant condition in Riemannian manifolds. IMA J. Numer. Anal. 32(4), 1696–1713 (2012)MathSciNetCrossRefMATHGoogle Scholar
  23. 23.
    Ferreira, O.P., Svaiter, B.F.: Kantorovich’s theorem on Newton’s method in Riemannian manifolds. J. Complex. 18(1), 304–329 (2002)MathSciNetCrossRefMATHGoogle Scholar
  24. 24.
    Li, C., Wang, J.: Newton’s method on Riemannian manifolds: Smale’s point estimate theory under the \(\gamma \)-condition. IMA J. Numer. Anal. 26(2), 228–251 (2006)MathSciNetCrossRefMATHGoogle Scholar
  25. 25.
    Ortega, J.M.: Numerical Analysis. A Second Course. Computer Science and Applied Mathematics. Academic Press, New York (1972)Google Scholar
  26. 26.
    Dedieu, J.P., Priouret, P., Malajovich, G.: Newton’s method on Riemannian manifolds: convariant alpha theory. IMA J. Numer. Anal. 23(3), 395–419 (2003)MathSciNetCrossRefMATHGoogle Scholar
  27. 27.
    do Carmo, M.P.: Riemannian Geometry. Mathematics: Theory & Applications. Birkhäuser, Boston (1992)CrossRefGoogle Scholar
  28. 28.
    Sakai, T.: Riemannian Geometry, Translations of Mathematical Monographs, vol. 149. American Mathematical Society, Providence, RI (1996)Google Scholar
  29. 29.
    Dieudonné, J.: Foundations of Modern Analysis, vol. 10-I. Academic Press, New York (1969). Enlarged and Corrected Printing, Pure and Applied MathematicsGoogle Scholar
  30. 30.
    Ferreira, O.P., Iusem, A.N., Németh, S.Z.: Concepts and techniques of optimization on the sphere. TOP 22(3), 1148–1170 (2014)MathSciNetCrossRefMATHGoogle Scholar
  31. 31.
    Rothaus, O.S.: Domains of positivity. Abh. Math. Sem. Univ. Hambg. 24, 189–235 (1960)MathSciNetCrossRefMATHGoogle Scholar
  32. 32.
    Nesterov, Y.E., Todd, M.J.: On the Riemannian geometry defined by self-concordant barriers and interior-point methods. Found. Comput. Math. 2(4), 333–361 (2002)MathSciNetCrossRefMATHGoogle Scholar
  33. 33.
    Lang, S.: Fundamentals of Differential Geometry, Graduate Texts in Mathematics, vol. 191. Springer, New York (1999)CrossRefGoogle Scholar
  34. 34.
    Milnor, J.: Morse theory. Based on lecture notes by M. Spivak and R. Wells. In: Annals of Mathematics Studies, No. 51. Princeton University Press, Princeton (1963)Google Scholar
  35. 35.
    Kristály, A., Rădulescu, V.D., Varga, C.G.: Variational Principles in Mathematical Physics, Geometry, and Economics, Encyclopedia of Mathematics and its Applications, vol. 136. Cambridge University Press, Cambridge (2010)MATHGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2017

Authors and Affiliations

  • Teles A. Fernandes
    • 1
  • Orizon P. Ferreira
    • 2
  • Jinyun Yuan
    • 3
  1. 1.Universidade Estadual do Sudoeste da BahiaVitória da ConquistaBrazil
  2. 2.IMEUniversidade Federal de GoiásGoiâniaBrazil
  3. 3.Universidade Federal do ParanáCuritibaBrazil

Personalised recommendations