Algorithms for Continuous Optimization pp 333-356 | Cite as

# ABS Methods for Nonlinear Optimization

## Abstract

ABS methods have been introduced by Abaffy, Broyden and Spedicato (1984) initially for solving general linear systems and have been later extended to solving linear least squares and nonlinear systems. Applications to nonlinear optimization have been considered recently mainly by Chinese researchers. In this paper we present the basic results on ABS methods for linear systems and then we consider in more detail a number of applications to nonlinear optimization, particularly the construction of general Quasi-Newton updates, subject possibly to sparsity, and a unified formulation of feasible descent direction methods for linearly constrained optimization.

## Keywords

Gradient Projection Method Nest Dissection Search Vector Symmetric Algorithm Feasible Descent Direction## Preview

Unable to display preview. Download preview PDF.

## References

- [1]Adachi, N. (1971) ‘On variable metric algorithms’, J. Optim. Theory Appl. 7, 391–410.MathSciNetMATHCrossRefGoogle Scholar
- [2]Abaffy, J., Broyden, C.G. and Spedicato, E. (1984) ‘A class of direct methods for linear equations’, Numerische Mathematik 45, 361–376.MathSciNetMATHCrossRefGoogle Scholar
- [3]Abaffy, J. and Spedicato, E. (1989) ABS Projection Algorithms: Mathematical Techniques for Linear and Nonlinear Equations, Ellis Horwood, Chichester.MATHGoogle Scholar
- [4]Abaffy, J., Galantai, A. and Spedicato, E. (1987a) ‘Application of the ABS class to unconstrained function minimization’, Report DMSIA 14/87, University of Bergamo.Google Scholar
- [5]Abaffy, J., Galantai, and Spedicato, E. (1987b) ‘The local convergence of ABS methods for nonlinear algebraic equations’, Numerische Mathematik 51, 429–439.MathSciNetMATHCrossRefGoogle Scholar
- [6]Benzi, M. and Meyer, C.D. (1993) ‘A direct projection method and its application to sparse linear systems’, Report NCSU NA-01051593, North Carolina State University.Google Scholar
- [7]Bodon, E. (1992a) ‘Numerical experiments with ABS algorithms on upper banded systems of linear equations’, Report DMSIA 17/92, University of Bergamo.Google Scholar
- [8]Bodon, E. (1992b) ‘Numerical experiments with ABS algorithms on banded systems of linear equations’, Report DMSIA 18/92, University of Bergamo.Google Scholar
- [9]Bodon, E. (1993a) ‘Numerical results on the ABS algorithms for linear systems of equations’, Report DMSIA 9/93, University of Bergamo.Google Scholar
- [10]Bodon, E. (1993b) ‘Computational performance of the implicit QR algorithm for linear least squares on the Alliant FX 80’, Report DMSIA 17/93, University of Bergamo.Google Scholar
- [11]Bodon, E. and Spedicato, E. (1990) ‘Numerical evaluation of the implicit LU, LQ and QU algorithm in the ABS class’, Report DMSIA 20/90, University of Bergamo.Google Scholar
- [12]Bodon, E. and Spedicato, E. (1991) ‘Factorized ABS algorithms for linear systems: derivation and numerical results’, Report DMSIA 14/91, University of Bergamo.Google Scholar
- [13]Bodon, E. and Spedicato, E. (1992) ‘On some STOD-ABS algorithms for large linear systems’, Report DMSIA 15/92, University of Bergamo.Google Scholar
- [14]Broyden, C.G. (1985) ‘On the numerical stability of Huang and related methods’, J. Optim. Meth. Appl. 47, 7–16.MathSciNetGoogle Scholar
- [15]Broyden, C.G. (1991) ‘On the numerical stability of Huang’s update’, Calcolo 28, 303–311.MathSciNetGoogle Scholar
- [16]Chen, Z., Deng, N. and Xue, Y., (1992) ‘A general algorithm for underdetermined linear systems’, Proceedings of the First International Conference on ABS Algorithms, University of Bergamo.Google Scholar
- [17]Du, D. (1985) ‘A method of gradient projection under the conditions of nonlinear constraints’, ACTA Mathem. Appl. Sinica 8, 7–16.MATHGoogle Scholar
- [18]Falk, J.E. and Hoffmann, K.L. (1986) ‘Concave minimization via collapsing poly topes’, Operations Research 34, 919–929.MathSciNetMATHCrossRefGoogle Scholar
- [19]Fletcher, R. (1987) Practical Methods of Optimization, Wiley, New York.MATHGoogle Scholar
- [20]Gill, P.E. and Murray, W. (1974) Numerical Methods for Nonlinear Optimization, Academic Press, New York.Google Scholar
- [21]Giudici, S. (1993) ‘ABS algorithms for nonlinear least squares’, Dissertation, University of Bergamo.Google Scholar
- [22]Goldfarb, D. (1969) ‘Extension of Davidon’s variable metric methods to maximization under linear inequality and equality constraints’, SI AM J. Appl. Math. 17, 739–764.MathSciNetMATHCrossRefGoogle Scholar
- [23]Goldfarb, D. and Idnani, A. (1983) ‘A numerically stable dual method for solving strictly convex quadratic programming’, Mathem. Progr. 27, 1–33.MathSciNetMATHCrossRefGoogle Scholar
- [24]Huang, H.Y. (1975) ‘A direct method for the general solution of a system of linear equations’, J. Optim. Meth. Appl. 16, 429–445.MATHCrossRefGoogle Scholar
- [25]Huang, H.Y. (1975) ‘A direct method for the general solution of a system of linear equations’, J. Optim. Meth. Appl. 16, 429–445.MATHCrossRefGoogle Scholar
- [26]Powell, M.J.D. (1989) ‘The updating of matrices of conjugate directions in optimization’, Report DAMTP 89/NA7, University of Cambridge.Google Scholar
- [27]Pshenichny, B.N. and Danilin, Y.M. (1978) Numerical Methods in Extremal Problems, MIR, Moscow.Google Scholar
- [28]Rosen, J.B. (1960) ‘The gradient projection method for nonlinear programming, Part I: linear constraints,’ SIAM J. Appl. Math. 8, 181–217.MATHCrossRefGoogle Scholar
- [29]Rustem, B. (1981) Projection Methods in Constrained Optimization and Applications in Optimal Policy Decisions, Springer, Berlin.CrossRefGoogle Scholar
- [30]Shi, G. and Liu, X. (1992) ‘An ABS algorithm for concave minimum problems over a convex polyhedroid’, Proceedings of the First International Conference of ABS Algorithms, University of Bergamo.Google Scholar
- [31]Sloboda, F. (1978) ‘A parallel projection method for linear algebraic systems’, Apl. Mat. Ceskosl. Akad. Ved., 23, 185–198.MathSciNetMATHGoogle Scholar
- [32]Spedicato, E. (1991)‘De aliqua methodi Huang proprietate’, Report DMSIA 4/91, University of Bergamo.Google Scholar
- [33]Spedicato, E. (1992) ‘A class of sparse symmetric Quasi-Newton updates’, Ricerca Operativa 22, 63–70.Google Scholar
- [34]Spedicato, E. and Bodon, E. (1989) ‘Solving linear least squares by orthogonal factorization and pseudoinverse computation via the modified Huang algorithm in the ABS class’, Computing 42, 195–205.MathSciNetMATHCrossRefGoogle Scholar
- [35]Spedicato, E. and Bodon, E. (1992a) ‘Solution of linear least squares via the ABS algorithms’, Mathem. Progr. 58, 111–136.MathSciNetCrossRefGoogle Scholar
- [36]Spedicato, E. and Bodon, E. (1992b) ‘Numerical behaviour of the implicit QR algorithm in the ABS class for linear least squares’, Ricerca Operativa 22, 43–55.Google Scholar
- [37]Spedicato, E. and Huang, Z. (1992) ‘An orthogonally scaled ABS method for nonlinear least squares’, Optim. Meth. Soft. 1, 233–242.CrossRefGoogle Scholar
- [38]Spedicato, E. and Tuma, M. (1993) ‘Solving sparse unsymmetric linear systems by implicit Gauss algorithm: stability’, Report DMSIA 4/93, University of Bergamo.Google Scholar
- [39]Spedicato, E. and Vespucci, M.T. (1992) ‘Variations on the Gram-Schmidt and the Huang algorithms for linear systems: a numerical study’, Aplikace Mathematiky
**2, 81–100**.Google Scholar - [40]Spedicato, E. and Xia, Z. (1992a) ‘Finding general solutions of the Quasi-Newton equation via the ABS approach’, Optim. Meth. Soft. 1, 243–252.CrossRefGoogle Scholar
- [41]Spedicato, E. and Xia, Z. (1992b) ‘A class of descent algorithms for nonlinear function minimization with linear equality constraints’, Optim. Meth. Soft. 1, 265–272.CrossRefGoogle Scholar
- [42]Spedicato, E. and Xia, Z. (1992c) ‘On some ABS methods for the computation of the pseudoinverse’, Ricerca Operativa 22, 35–41.Google Scholar
- [43]Spedicato, E. and Zhao, J. (1993) ‘Explicit solution of the Quasi-Newton equation with sparsity and symmetry’, Optim. Meth. Soft., in press.Google Scholar
- [44]Spedicato, E. and Zhu, M. (1993) ‘A reduced ABS-type algorithm I: basic properties’, preprint, University of Bergamo.Google Scholar
- [45]Tan, Z. and Gao, Y. (1992) ‘An improved gradient projection method for nonlinearly constrained systems’, Proceedings of the First International Conference on ABS Algorithms, University of Bergamo.Google Scholar
- [46]Xia, Z. (1990a) ‘Application of ABS algorithms to constrained optimization II: linear inequality constraints’, Report DMSIA 29/90, University of Bergamo. /Google Scholar
- [47]Xia, Z. (1990b) ‘An algorithm for minimizing a class of quasidifferentiable functions’, Report DMSIA 12, University of Bergamo.Google Scholar
- [48]Xia, Z. (1991a) ‘Quadratic programming via the ABS algorithm I: equality constraints’, Report DMSIA 1/91, University of Bergamo.Google Scholar
- [49]Xia, Z. (1991b) ‘The ABS class and quadratic programming II: general constraints’, Report DMSIA 5/91, University of Bergamo.Google Scholar
- [50]Xia, Z. (1992) ‘Finding subgradients or descent directions of convex functions by external polyhedral approximation of subdifferentials’, Optim. Meth. Soft. 1, 253–264.CrossRefGoogle Scholar
- [51]Xia, Z., Liu, Y. and Zhang, L. (1992) ‘Application of a representation of ABS updating matrices to linearly constrained optimization I’, Northeast Operational Research 7, 1–9.Google Scholar
- [52]Xia, Z., Liu, Y. and Zhang, L. (1993) ‘Application of a representation of ABS matrices to linearly constrained optimization II’, preprint, University of Bergamo.Google Scholar
- [53]Wolfe, P. (1967) ‘Methods for nonlinear constraints’, in J. Abadie, Nonlinear Programming, North Holland, Amsterdam.Google Scholar
- [54]Zhang, L. (1992a) ‘Application of the ABS algorithm to Quasi-Newton methods for linearly constrained optimization problems’, Proceedings of the first international conference on ABS algorithms, University of Bergamo.Google Scholar
- [55]Zhang, L. (1992b) ‘A method for finding a feasible point of inequalities’, Proceedings of the first international conference on ABS algorithms, University of Bergamo.Google Scholar
- [56]Zhu, M. (1987) ‘The implicit
*LL*^{T}algorithm for sparse nested dissection linear systems’, Report NOC 196, Hatfield Polytechnic.Google Scholar - [57]Zhu, M. and Yang, Z. (1993) ‘The practical ABS algorithm for large scale nested dissection linear systems’, preprint, University of Bergamo.Google Scholar