Abstract
The main purpose of this paper is to prove the global convergence of the new trust region method based on the smoothed CGS algorithm. This method is surprisingly convenient for the numerical solution of large sparse systems of nonlinear equations, as is demonstrated by numerical experiments. A modification of the proposed trust region method does not use matrices, so it can be used for large dense systems of nonlinear equations.
Similar content being viewed by others
References
Powell, M. J. D.,On the Global Convergence of Trust Region Algorithms for Unconstrained Minimization, Mathematical Programming, Vol. 29, pp. 297–303, 1984.
Shultz, G. A., Schnabel, R. B., andByrd, R. H.,A Family of Trust-Region-Based Algorithms for Unconstrained Minimization with Strong Global Convergence Properties, SIAM Journal on Numerical Analysis, Vol. 22, pp. 47–67, 1985.
Steihaug, T.,The Conjugate Gradient Method and Trust Regions in Large-Scale Optimization, SIAM Journal on Numerical Analysis, Vol. 20, pp. 626–637, 1983.
Sonneveld, P.,CGS, a Fast Lanczos-Type Solver for Nonsymmetric Linear Systems, SIAM Journal on Scientific and Statistical Computations, Vol. 10, pp. 36–52, 1989
Tong, C. H.,A Comparative Study of Preconditioned Lanczos Methods for Nonsymmetric Linear Systems, Report No. SAND91-8240B, Sandia National Laboratories, Livermore, California, 1992.
Gill, P. E., andMurray, W.,Newton Type Methods for Unconstrained and Linearly Constrained Optimization, Mathematical Programming, Vol. 7, pp. 311–350, 1974.
Lukšan, L.,Inexact Trust Region Method for Large Sparse Nonlinear Least Squares, Kybernetika, Vol. 29, pp. 305–324, 1993.
Paige, C. C., andSaunders, M. A.,LSQR: An Algorithm for Sparse Linear Equations and Sparse Least Squares, ACM Transactions on Mathematical Software, Vol. 8, pp. 43–71, 1982.
Bogle, I. D. L., andPerkins, J. D.,A New Sparsity-Preserving Quasi-Newton Update for Solving Nonlinear Equations, SIAM Journal on Scientific and Statistical Computations, Vol. 11, pp. 621–630, 1990.
Toint, P. L.,Numerical Solution of Large Sets of Algebraic Equations, Mathematics of Computation, Vol. 46, pp. 175–189, 1986.
Gomez-Ruggiero, M. A., Martinez, J. M., andMoretti, A. C.,Comparing Algorithms for Solving Sparse Nonlinear Systems of Equations. SIAM Journal on Scientific and Statistical Computations, Vol. 13, pp. 459–483, 1992.
Li, G.,Successive Column Correction Algorithms for Solving Sparse Nonlinear Systems of Equations, Mathematical Programming, Vol. 43, pp. 187–207, 1989.
Moré, J. J., Garbow, B. S., andHillström, K. E.,Testing Unconstrained Optimization Software, ACM Transactions on Mathematical Software, Vol. 7, pp. 17–41, 1981.
Author information
Authors and Affiliations
Additional information
Communicated by L. C. W. Dixon
Rights and permissions
About this article
Cite this article
Lukšan, L. Inexact trust region method for large sparse systems of nonlinear equations. J Optim Theory Appl 81, 569–590 (1994). https://doi.org/10.1007/BF02193101
Issue Date:
DOI: https://doi.org/10.1007/BF02193101