Abstract
In this paper, a new sequential penalty algorithm, based on the Linfin exact penalty function, is proposed for a general nonlinear constrained optimization problem. The algorithm has the following characteristics: it can start from an arbitrary initial point; the feasibility of the subproblem is guaranteed; the penalty parameter is adjusted automatically; global convergence without any regularity assumption is proved. The update formula of the penalty parameter is new. It is proved that the algorithm proposed in this paper behaves equivalently to the standard SQP method after sufficiently many iterations. Hence, the local convergence results of the standard SQP method can be applied to this algorithm. Preliminary numerical experiments show the efficiency and stability of the algorithm.
Similar content being viewed by others
References
Boggs, P. T., Tolle, J. W., and Wang, P., On the Local Convergence of Quasi-Newton Methods for Constrained Optimization, SIAM Journal on Control and Optimization, Vol. 20, pp. 161-171, 1982.
Boggs, P. T., Kearsley, A. J., and Tolle, J.W., A Global Convergence Analysis of an Algorithm for Large-Scale Nonlinear Optimization Problems, SIAM Journal on Optimization, Vol. 9, pp. 833-862, 1999.
Facchinei, F., Robust Recursive Quadratic Programming Algorithm Model with Global and Superlinear Convergence Properties, Journal of Optimization Theory and Applications, Vol. 92, pp. 543-579, 1997.
Han, S.P., Superlinearly Convergent Variable-Metric Algorithm for General Nonlinear Programming Problems, Mathematical Programming, Vol. 11, pp. 263-282, 1976.
Han, S.P., A Global Convergent Method for Nonlinear Programming, Journal of Optimization Theory and Applications, Vol. 22, pp. 297-309, 1977.
Powell, M.J.D., A Fast Algorithm for Nonlinearly Constrained Optimization Calculations, Numerical Analysis, Edited by G.A. Watson, Springer Verlag, Berlin, Germany, pp. 144-157, 1978.
Powell, M.J.D., Variable Metric Methods for Constrained Optimization, Mathematical Programming—The State of Art, Edited by A. Bächen, M. Gröschel, and B. Korte, Springer Verlag, Berlin, Germany, pp. 288-311, 1983.
Burke, J. V., and Han, S. P., A Robust SQP Method, Mathematical Programming, Vol. 43, pp. 277-303, 1989.
Burks, J.V., A Sequential Quadratic Programming Method for Potentially Infeasible Mathematical Programs, Journal of Mathematical Analysis and Applications, Vol. 139, pp. 319-351, 1989.
Zhang, J. L., and Zhang, X.S., An SQP Method for Inequality Constrained Optimization, Acta Mathematicae Applicatae Sinica, Vol. 18, pp. 77-84, 2002.
Zhou, G. L., A Modified SQP Method and Its Global Convergence, Journal of Global Optimization, Vol. 11, pp. 193-205, 1997.
Qi, L., and Yang, Y., A Globally and Superlinearly Convergent SQP Algorithm for Nonlinearly Constrained Optimization, Journal of Global Optimization, Vol. 21, pp. 157-184, 2001.
Zhang, J. L., and Wang, C.Y., A Modified SQP Method and Its Superlinear Convergence, OR Transactions (in Chinese), Vol. 4, pp. 32-40, 2000.
Yuan, Y.X., A New Trust Region Algorithm for Nonlinear Optimization, Numerical Analysis, Edited by D. Bainov and V. Covachev, Utrecht, Netherlands: VSP, pp. 141-152, 1993.
Bazaraa, M. S., and Goode, J. J., An Algorithm for Solving Linearly Constrained Minimax Problems, European Journal of Operational Research, Vol. 11, pp. 158-166, 1982.
Maratos, N., Exact Penalty Function Algorithm for Finite-Dimensional and Control Optimization Problems, PhD Thesis, University of London, London, UK, 1978.
Sahba, M., Globally Gonvergent Algorithm for Nonlinearly Constrained Optimization Problems, Journal of Optimization Theory and Application, Vol. 52, pp. 291-309, 1987.
Liu, X. W., and Yuan, Y., A Robust Algorithm for Optimization with General Equality and Inequality Constraints, SIAM Journal on Statistical and Scientific Computing, Vol. 22, pp. 517-534, 2000.
Hock, W., and Schittkowski, K., Test Examples for Nonlinear Programming Codes, Lecture Notes in Economics and Mathematical Systems, Springer Verlag, Berlin, Germany, Vol. 187, 1981.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Zhang, J., Zhang, X. Sequential Penalty Algorithm for Nonlinear Constrained Optimization. Journal of Optimization Theory and Applications 118, 635–655 (2003). https://doi.org/10.1023/B:JOTA.0000004875.49572.10
Issue Date:
DOI: https://doi.org/10.1023/B:JOTA.0000004875.49572.10