On a Global Complexity Bound of the Levenberg-Marquardt Method
In this paper, we investigate a global complexity bound of the Levenberg-Marquardt method (LMM) for the nonlinear least squares problem. The global complexity bound for an iterative method solving unconstrained minimization of φ is an upper bound to the number of iterations required to get an approximate solution, such that ‖∇φ(x)‖≤ε. We show that the global complexity bound of the LMM is O(ε −2).
KeywordsLevenberg-Marquardt methods Global complexity bound Scale parameter
Unable to display preview. Download preview PDF.
- 7.Cartis, C., Gould, N.I.M., Toint, P.L.: Adaptive cubic regularization methods for unconstrained optimization. Part II: Worst-case function- and derivative-evaluation complexity. Math. Program. doi: 10.1007/s10107-009-0337-y
- 8.Cartis, C., Gould, N.I.M., Toint, P.L.: On the complexity of steepest descent, Newton’s and regularized Newton’s methods for nonconvex unconstrained optimization problems. Technical Report 09/14, Department of Mathematics, FUNDP—University of Namur (2009) Google Scholar
- 14.Ueda, K., Yamashita, N.: A regularized Newton method without line search for unconstrained optimization. Technical Report 2009-007, Department of Applied Mathematics and Physics, Graduate School of Informatics, Kyoto University (2009) Google Scholar