Abstract
This paper discusses optimization problems with nonlinear inequality constraints and presents a new sequential quadratically-constrained quadratic programming (NSQCQP) method of feasible directions for solving such problems. At each iteration. the NSQCQP method solves only one subproblem which consists of a convex quadratic objective function, convex quadratic equality constraints, as well as a perturbation variable and yields a feasible direction of descent (improved direction). The following results on the NSQCQP are obtained: the subproblem solved at each iteration is feasible and solvable: the NSQCQP is globally convergent under the Mangasarian-Fromovitz constraint qualification (MFCQ); the improved direction can avoid the Maratos effect without the assumption of strict complementarity; the NSQCQP is superlinearly and quasiquadratically convergent under some weak assumptions without thestrict complementarity assumption and the linear independence constraint qualification (LICQ).
Similar content being viewed by others
References
WILSON, R. B., A Simplicial Algorithm for Concave Programming, PhD Thesis, Graduate School of Business Administration, Harvard University, 1963.
MARATOS, N., Exact Penalty Function Algorithms for Finite-Dimensional and Control Optimization Problems, PhD Thesis, Imperial College of Science and Technology, University of London, 1978.
MAYNE, D. Q., and POLAK, E., A Superlinearly Convergent Algorithm for Constrained Optimization Problems, Mathematical Programming Study, Vol. 16, pp. 45–61, 1982.
FUKUSHIMA, M., A Successive Quadratic Programming Algorithm for Constraint Optimization Problems, Mathematical Programming, Vol. 35, pp. 253–264, 1986.
XU, X., and WANG, W., A Mixed Superlinearly Convergent Algorithm with Nonmonotone Search for Constrained Optimizations, Applied Mathematics: A Journal of Chinese Universities, Vol. 15B, pp. 211–219, 2000.
PANIER, E. R., and TITS, A.L., A Superlinearly Convergent Feasible Method for the Solution of Inequality Constrained Optimization Problems, SIAM Journal on Control and Optimization, Vol. 25, pp. 934–950, 1987.
GAO, Z. Y., and WU, F., A Superlinearly Feasible Method for Nonlinear Constraints, Acta Mathematica Sinica, Vol. 40A, pp. 895–900, 1997.
JIAN, J. B., and XUE, S.J., A Class of Superlinearly Convergent Feasible Methods for Nonlinear Constraint Optimization, Journal of Mathematical Research and Exposition, Vol. 19, pp. 135–140, 1999.
JIAN, J. B., ZHANG, K.C., and XUE, S.J., A Superlinearly and Quadratically Convergent SQP Type Feasible Method for Constrained Optimization, Applied Mathematics: A Journal of Chinese Universities, Vol. 15B, pp. 319–331, 2000.
KRUK, S., and WOLKOWICZ, H., Sequential Quadratic Constrained Quadratic Programming for General Nonlinear Programming, Handbook of Semidefinite Programming, Edited by H. Wolkowicz, R. Saigal, and L. Vandenberghe, Kluwer Academic Publishers, Boston, Massachusetts, pp. 563–575, 2000.
WIEST, E. J., and POLAK, E., A Generalized Quadratic Programming-Based Phase-I-Phase-II Method for Inequality Constrained Optimization, Applied Mathematics and Optimization, Vol. 26, pp. 223–252, 1992.
FUKUSHIMA, M., LUO, Z.Q., and PAUL, T., A Sequential Quadratically Constrained Quadratic Programming Method for Differentiable Convex Minimization, SIAM Journal on Optimization, Vol. xx, pp. xxx–xxx, xxxx.
ZOUTENDIJK, G., Methods of Feasible Directions, Elsevier, Admsterdam, Netherlands, 1960.
TOPKIS, D. M., and VEINOTT, A.F., On the Convergence of Some Feasible Direction Algorithms for Nonlinear Programming, SIAM Journal on Control, Vol. 5, pp. 268–279, 1967.
PIRONNEAU, O., and POLAK, E., Rate of the Convergence of a Class of Methods of Feasible Directions, SIAM Journal on Numerical Analysis, Vol. 10, pp. 161–173, 1973.
CAWOOD, M. E., and Kostreva, M.M., Norm-Relaxed Method of Feasible Directions for Solving Nonlinear Programming Problems, Journal of Optimization Theory and Applications, Vol. 83, pp. 311–320, 1994.
CHEN, X., and KOSTREVA, M.M., A Generalization of the Norm-Relaxed Method of Feasible Directions, Applied Mathematics and Computation, Vol. 102, pp. 257–273, 1999.
KOSTREVA, M. M., and CHEN, X., A Superlinearly Convergent Method of Feasible Directions, Applied Mathematics and Computation, Vol. 116, pp. 231–244, 2000.
LAWRENCE, C. T., and TITS, A.L., A Computationally Efficient Feasible Sequential Quadratic Programming Algorithm, SIAM Journal on Optimization, Vol. 11, pp. 1092–1118, 2001.
ZU, Z., and ZANG, K.C., A New SQP Method of Feasible Directions for Nonlinear Programming, Applied Mathematics and Computation, Vol. 148, pp. 121–134, 2004.
MONTEIOR, R. D. C., and TSUCHYIA, T., Polynomial Convergence of Primal-Dual Algorithms for the Second-Order Cone Programs Based on the MZ-Family of Directions, Mathematical Programming, Vol. 88, pp. 61–83, 2000.
JIAN, J. B., Researches on Superlinearly and Quadratically Convergent Algorithms for Nonlinearly Constrained Optimization, PhD Thesis, Xian Jiaotong University, Xian, China, 2000.
Author information
Authors and Affiliations
Additional information
Communicated by N. G. Medhin
Research supported by the National Natural Science Foundation of China Project 10261001 and Guangxi Science Foundation Projects 0236001 and 0249003.
The author thanks two anonymous referees for valuable comments and suggestions on the original version of this paper.
Rights and permissions
About this article
Cite this article
Jian, J.B. New Sequential Quadratically-Constrained Quadratic Programming Method of Feasible Directions and Its Convergence Rate. J Optim Theory Appl 129, 109–130 (2006). https://doi.org/10.1007/s10957-006-9042-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10957-006-9042-7