Abstract
In this paper, a sequential quadratically constrained quadratic programming method of feasible directions is proposed for the optimization problems with nonlinear inequality constraints. At each iteration of the proposed algorithm, a feasible direction of descent is obtained by solving only one subproblem which consist of a convex quadratic objective function and simple quadratic inequality constraints without the second derivatives of the functions of the discussed problems, and such a subproblem can be formulated as a second-order cone programming which can be solved by interior point methods. To overcome the Maratos effect, an efficient higher-order correction direction is obtained by only one explicit computation formula. The algorithm is proved to be globally convergent and superlinearly convergent under some mild conditions without the strict complementarity. Finally, some preliminary numerical results are reported.
Similar content being viewed by others
References
Zoutendijk, G.: Methods of Feasible Directions. Elsevier, Amsterdam (1960)
Topkis, D.M., Veinott, A.F.: On the convergence of some feasible direction algorithms for nonlinear programming. SIAM J. Control. 5, 268–279 (1967)
Pironneau, O., Polak, E.: On the rate of convergence of certain methods of centers. Math. Program. 2, 230–257 (1972)
Pironneau, O., Polak, E.: Rate of convergence of a class of methods of feasible directions. Numer. Anal. 10, 161–173 (1973)
Cawood, M.E., Kostreva, M.M.: Norm-relaxed method of feasible directions for solving nonlinear programming problems. J. Optim. Theory Appl. 83(2), 311–320 (1994)
Boggs, P.T., Tolle, J.W.: Sequential quadratic programming. Acta Numer. 4, 1–51 (1995)
Qi, L., Yang, Y.F.: A globally and superlinearly convergent SQP algorithm for nonlinear constrained optimization, AMR00/7. Applied Mathematics Report, University of New South Wales, Sydney (March 2000)
Spellucci, P.: A new technique for inconsistent QP problems in the SQP methods. Math. Methods Oper. Res. 47, 355–400 (1998)
Wright, S.J.: Superlinear convergent of a stabilized SQP to a degenerate solution. Comput. Optim. Appl. 11, 253–275 (1998)
Han, S.P.: A globally convergent method for nonlinear programming. J. Optim. Theory Appl. 22, 297–309 (1977)
Powell, M.J.D.: A fast algorithm for nonlinearly constrained optimization calculations. In: Numerical Analysis, Proc. 7th Biennial Conf., Univ. Dundee, Dundee, 1977. Lecture Notes in Math., vol. 630, pp. 144–157. Springer, Berlin (1978)
Facchinei, F.: Robust recursive quadratic programming algorithm model with global and superlinear convergence properties. J. Optim. Theory Appl. 92(3), 543–579 (1997)
Panier, E.R., Tits, A.L., Herskovits, J.N.: A QP-free, globally convergent, locally superlinearly convergent algorithm for inequality constrained optimization. SIAM J. Control. Optim. 26(4), 788–811 (1988)
Jian, J.B.: Two extension models of SQP and SSLE algorithms for optimization and their superlinear and quadratical convergence. Appl. Math. J. Chin. Univ. Ser. A 16(4), 435–444 (2001)
Panier, E.R., Tits, A.L.: A superlinearly convergent feasible method for the solution of inequality constrained optimization problems. SIAM J. Control. Optim. 25, 934–950 (1987)
Jian, J.B.: A superlinearly convergent feasible descent algorithm for nonlinear optimization. J. Math. (PRC) 15(3), 319–326 (1995)
Jian, J.B., Zhang, K.C., Xue, S.J.: A superlinearly and quadratically convergent SQP type feasible method for constrained optimization. Appl. Math. J. Chin. Univ. Ser. B 15(3), 319–331 (2000)
Lawrence, C.T., Tits, A.L.: A computationally efficient feasible sequential quadratic programming algorithm. SIAM J. Optim. 11, 1092–1118 (2001)
Kostreva, M.M., Chen, X.: A superlinearly convergent method of feasible directions. Appl. Math. Comput. 116, 245–255 (2000)
Panin, V.M.: A second-order method for the discrete min-max problem. USSR Comput. Math. Math. Phys. 19(1), 90–100 (1979)
Panin, V.M.: Some methods of solving convex programming problems. USSR Comput. Math. Math. Phys. 21(2), 57–72 (1981)
Wiest, E.J., Polak, E.: A generalized quadratic programming based on phase-I–phase-II method for inequality constrained optimization. Appl. Math. Optim. 26, 223–252 (1992)
Anitescu, M.: A superlinearly convergent sequential quadratically constrained programming algorithm for degenerate nonlinear programming. SIAM J. Optim. 12, 949–978 (2002)
Fukushima, M., Luo, Z.Q., Paul, T.: A sequential quadratically constrained quadratic programming method for differentiable convex minimization. SIAM J. Optim. 13(4), 1098–1119 (2002)
Kruk, S., Wolkowicz, H.: SQ2P, quadratically constrained quadratic programming. In: Yuan, Y.X. (ed.) Advances in Nonlinear Programming, pp. 177–204. Kluwer Academic, Dordrecht (1998)
Chen, X.B., Kostreva, M.M.: A generalization of the norm-relaxed method of feasible directions. Appl. Math. Comput. 102, 257–272 (1999)
Lobo, M.S., Vandenberghe, L., Boyd, S.: SOCP: Software for Second-Order Cone Programming. Information Systems Laboratory, Standford University (1997)
Gao, Z.Y., He, G.P., Wu, F.: A method of sequential systems of linear equations with arbitrary initial point. Sci. China Ser. A 27, 24–33 (1997)
Jian, J.B.: Researches on superlinearly and quadratically convergent algorithm for nonlinearly constrained optimization. Ph.D. Thesis, School of Xi’an Jiaotong University, Xi’an, China (2000)
Broyden, C.G., Dennis, J.E., More, J.J.: On the local and superlinear convergence of quasi-Newton methods. J. Inst. Math. Appl. 12, 223–245 (1973)
Facchinei, F., Lucidi, S.: Quadratically and superlinearly convergent algorithms for the solution of inequality constrained optimization problems. J. Optim. Theory Appl. 85, 265–289 (1995)
De, J.F.A., Pantoja, O., Mayne, D.Q.: Exact penalty function algorithm with simple updating of the penalty parameter. J. Optim. Theory Appl. 69(3), 441–467 (1991)
Hock, W., Schittkowski, K.: Test Examples for Nonlinear Programming Codes. Lecture Notes in Economics and Mathematical Systems, vol. 187. Springer, Berlin (1981)
Author information
Authors and Affiliations
Corresponding author
Additional information
Project supported by the National Natural Science Foundation (No. 10261001), Guangxi Science Foundation (Nos. 0236001, 064001), and Guangxi University Key Program for Science and Technology Research (No. 2005ZD02) of China.
Rights and permissions
About this article
Cite this article
Jian, Jb., Hu, Qj., Tang, Cm. et al. A Sequential Quadratically Constrained Quadratic Programming Method of Feasible Directions. Appl Math Optim 56, 343–363 (2007). https://doi.org/10.1007/s00245-007-9010-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00245-007-9010-0