Abstract
A trust-region algorithm for solving the equality constrained optimization problem is presented. This algorithm uses the Byrd and Omojokun way of computing the trial steps, but it differs from the Byrd and Omojokun algorithm in the way steps are evaluated. A global convergence theory for this new algorithm is presented. The main feature of this theory is that the linear independence assumption on the gradients of the constraints is not assumed.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Alexandrov, N.,Multi-Level Algorithms for Nonlinear Equations and Equality Constrained Optimization, PhD Thesis, Department of Computational and Applied Mathematics, Rice University, Houston Texas, 1993.
Alexandrov, A., andDennis, J. E.,Multi-Level Algorithms for Nonlinear Optimization, Technical Report 94-24, Department of Computational and Applied Mathematics, Rice University, Houston, Texas, 1994.
Byrd, R., Schnabel, B., andSchultz, G.,A Trust-Region Algorithm for Nonlinearly Constrained Optimization, SIAM Journal on Numerical Analysis, Vol. 24, pp. 1152–1170, 1987.
Dennis, J., El-Alem, M. M., andMaciel, M.,A Global Convergence Theory for General Trust-Region-Based Algorithms for Equality Constrained Optimization, Technical Report 92-28, Department of Computational and Applied Mathematics, Rice University, Houston, Texas, 1992.
El-Alem, M. M.,A Global Convergence Theory for a Class of Trust-Region Algorithms for Constrained Optimization, PhD Thesis, Department of Computational and Applied Mathematics, Rice University, Houston, Texas, 1988.
El-Alem, M. M.,A Global Convergence Theory for the Celis-Dennis-Tapia Trust-Region Algorithm for Constrained Optimization, SIAM Journal on Numerical Analysis, Vol. 24, pp. 266–290, 1991.
El-Alem, M. M.,A Robust Trust Region Algorithm with a Nonmonotonic Penalty Parameter Scheme for Constrained Optimization, SIAM Journal on Optimization, Vol. 5, pp. 348–378, 1995.
Maciel, M. C.,A Global Convergence Theory for a General Class of Trust-Region Algorithms for Equality Constrained Optimization, PhD Thesis, Department of Computational and Applied Mathematics, Rice University, Houston, Texas, 1992.
Powell, M. J. D. andYuan, Y.,A Trust-Region Algorithm for Equality Constrained Optimization, Mathematical Programming, Vol. 49, pp. 1890–211, 1991.
Vardi, A.,A Trust-Region Algorithm for Equality Constrained Minimization: Convergence Properties and Implementation, SIAM Journal on Numerical Analysis, Vol. 22, pp. 575–591, 1985.
Zhang, J., andZhu, D.,Projected Quasi-Newton Algorithm with Trust Region for Constrained Optimization, Journal of Optimization Theory and Applications, Vol. 67, pp. 369–393, 1990.
Byrd, R., andOmojokun, E.,Robust Trust-Region Methods for Nonlinearly Constrained Optimization, Paper Presented at the SIAM Conference on Optimization, Houston, Texas, 1987.
Omojokun, E.,Trust-Region Strategies for Optimization with Nonlinear Equality and Inequality Constraints, PhD Thesis, Department of Computer Science, University of Colorado, Boulder, Colorado, 1989.
Lalee, M., Nocedal, J., andPlantenga, T.,On the Implementation of an Algorithm for Large-Scale Equality Constrained Optimization, Technical Report 93, Electrical Engineering and Computer Science Department, Northwestern University, Evanston, Illinois, 1993.
Dennis, J. E., andSchnabel, R. B.,Numerical Methods for Unconstrained Optimization and Nonlinear Equations, Prentice-Hall, Englewood Cliffs, New Jersey, 1983.
Fletcher, R.,Practical Methods of Optimization, John Wiley and Sons, New York, New York, 1987.
Courant, R.,Variational Methods for the Solution of Problems of Equilibrium and Vibrations, Bulletin of the American Mathematical Society., Vol. 49, pp. 1–23, 1943.
Bartholomew-Biggs, M. C.,Recursive Quadratic Programming Methods for Nonlinear Constraints, Nonlinear Optimization., Edited by M. J. D. Powell, Academic Press, London, United Kingdom, pp. 213–221, 1981.
Celis, M. R.,A Trust-Region Strategy for Nonlinear Equality Constrained Optimization, PhD Thesis, Department of Computational and Applied Mathematics, Rice University, Houston, Texas, 1985.
Celis, M. R., Dennis, J. E., andTapia, R. A.,A Trust-Region Strategy for Nonlinear Equality Constrained Optimization, Numerical Optimization, Edited by P. Boggs, R. Byrd, and R. Schnabel, SIAM Publications, Philadelphia, Pennsylvania, pp. 71–82, 1985.
Maratos, N.,Exact Penalty Function for Finite-Dimensional and Control Optimization Problem, PhD Thesis, University of London, London, United Kingdom, 1978.
Moré, J. J.,Recent Developments in Algorithms and Software for Trust-Region Methods, Mathematical Programming: The State of The Art, Edited by A. Bachem, M. Grotschel, and B. Korte, Springer-Verlag, New York, New York, pp. 258–287, 1983.
Coleman, T., andConn, A.,Nonlinear Programming via an Exact Penalty Function: Asymptotic Analysis, Mathematical Programming, Vol. 24, pp. 123–136, 1982.
Fletcher, R.,Second-Order Correction for Nondifferentiable Optimization, Lectures Notes in Mathematics, Edited by G. A. Watson, Springer Verlag, New York, New York, Vol. 912, pp. 85–113, 1982.
Author information
Authors and Affiliations
Additional information
Communicated by R. A. Tapia
This research was supported in part by the Center for Research on Parallel Computation, by Grant NSF-CCR-91-20008, and by the REDI Foundation.
Rights and permissions
About this article
Cite this article
El-Alem, M.M. Global convergence without the assumption of linear independence for a trust-region algorithm for constrained optimization. J Optim Theory Appl 87, 563–577 (1995). https://doi.org/10.1007/BF02192134
Issue Date:
DOI: https://doi.org/10.1007/BF02192134