Finite convergence of algorithms for nonlinear programs and variational inequalities

  • F. Al-Khayyal
  • J. Kyparisis
Contributed Papers


Algorithms for nonlinear programming and variational inequality problems are, in general, only guaranteed to converge in the limit to a Karush-Kuhn-Tucker point, in the case of nonlinear programs, or to a solution in the case of variational inequalities. In this paper, we derive sufficient conditions for nonlinear programs with convex feasible sets such that any convergent algorithm can be modified, by adding a convex subproblem with a linear objective function, to guarantee finite convergence in a generalized sense. When the feasible set is polyhedral, the subproblem is a linear program and finite convergence is obtained. Similar results are also developed for variational inequalities.

Key Words

Convergence of algorithms nonlinear programming variational inequalities 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    McCormick, G. P.,Nonlinear Programming Theory, Algorithms, and Applications, John Wiley and Sons, New York, New York, 1983.Google Scholar
  2. 2.
    Bazaraa, M. S., andShetty, C. M.,Nonlinear Programming: Theory and Algorithms, John Wiley and Sons, New York, New York, 1979.Google Scholar
  3. 3.
    Pang, J. S., andChan, D.,Iterative Methods for Variational and Complementarity Problems, Mathematical Programming, Vol. 24, pp. 284–313, 1982.Google Scholar
  4. 4.
    Dafermos, S.,An Iterative Scheme for Variational Inequalities, Mathematical Programming, Vol. 26, pp. 40–47, 1983.Google Scholar
  5. 5.
    Luenberger, D. G.,Linear and Nonlinear Programming, Addison-Wesley, Reading, Massachusetts, 1984.Google Scholar
  6. 6.
    Bertsekas, D. P.,On the Goldstein-Levitin-Polyak Gradient Projection Method, IEEE Transactions on Automatic Control, Vol. AC-21, pp. 174–184, 1976.Google Scholar
  7. 7.
    Goldstein, A. A.,Convex Programming in Hilbert Spaces, Bulletin of the American Mathematical Society, Vol. 70, pp. 709–710, 1964.Google Scholar
  8. 8.
    Levitin, E. S., andPolyak, B. T.,Constrained Minimization Problems, USSR Computational and Mathematical Physics, Vol. 6, pp. 1–50, 1966.Google Scholar
  9. 9.
    Bertsekas, D. P.,Projected Newton Methods for Optimization Problems with Simple Constraints, SIAM Journal on Control and Optimization, Vol. 20, pp. 221–246, 1982.Google Scholar
  10. 10.
    Gafni, E. M., andBertsekas, D. P.,Two-Metric Projection Methods for Constrained Optimization, SIAM Journal on Control and Optimization, Vol. 22, pp. 936–964, 1984.Google Scholar
  11. 11.
    Dunn, J. C.,On the Convergence of Projected Gradient Processes to Singular Critical Points, Journal of Optimization Theory and Applications, Vol. 55, pp. 203–216, 1987.Google Scholar
  12. 12.
    Calamai, P. H., andMoré, J. J.,Projected Gradient Methods for Linearly Constrained Problems, Mathematical Programming, Vol. 39, pp. 93–116, 1987.Google Scholar
  13. 13.
    Burke, J. V., andMoré, J. J.,On the Identification of Active Constraints, SIAM Journal on Numerical Analysis, Vol. 25, pp. 1197–1211, 1988.Google Scholar
  14. 14.
    Wright, S.,Convergence of SQP-Like Methods for Constrained Optimization, SIAM Journal on Control and Optimization, Vol. 27, pp. 13–26, 1989.Google Scholar
  15. 15.
    Dunn, J. C.,Global and Asymptotic Convergence Rate Estimates for a Class of Projected Gradient Processes, SIAM Journal on Control and Optimization, Vol. 19, pp. 368–400, 1981.Google Scholar
  16. 16.
    Dunn, J. C.,Rates of Convergence for Conditional Gradient Algorithms Near Singular and Nonsingular Extremals, SIAM Journal on Control and Optimization, Vol. 17, pp. 187–211, 1979.Google Scholar
  17. 17.
    Dunn, J. C.,Convergence Rate for Conditional Gradient Sequences Generated by Implicit Steplength Rules, SIAM Journal on Control and Optimization, Vol. 18, pp. 473–487, 1980.Google Scholar
  18. 18.
    Dunn, J. C.,Newton's Method and the Goldstein Steplength Rule for Constrained Minimization Problems, SIAM Journal on Control and Optimization, Vol. 18, pp. 659–674, 1980.Google Scholar
  19. 19.
    Ferris, M. C., andMangasarian, O. L.,Minimum Principle Sufficiency, Technical Report No. 853, Computer Sciences Department, University of Wisconsin, Madison, Wisconsin, 1989.Google Scholar
  20. 20.
    Robinson, S. M.,Generalized Equations and Their Solutions, Part 2: Applications to Nonlinear Programming, Mathematical Programming Study, Vol. 19, pp. 200–221, 1982.Google Scholar
  21. 21.
    Kyparisis, J., andFiacco, A. V.,Second-Order Sufficient Conditions for Strict and Isolated Local Minima in Nonlinear Programming, Preprint, Florida International University, Miami, Florida, 1985.Google Scholar
  22. 22.
    Rockafellar, R. T.,Convex Analysis, Princeton University Press, Princeton, New Jersey, 1970.Google Scholar
  23. 23.
    Bazaraa, M. S., andShetty, C. M.,Foundations of Optimization, Springer-Verlag, Berlin, Germany, 1976.Google Scholar
  24. 24.
    Mangasarian, O. L.,A Simple Characterization of Solution Sets of Convex Programs, Operations Research Letters, Vol. 7, pp. 21–26, 1988.Google Scholar
  25. 25.
    Al-Khayyal, F. A., andFalk, J. E.,Jointly Constrained Biconvex Programming, Mathematics of Operations Research, Vol. 8, pp. 273–286, 1983.Google Scholar
  26. 26.
    Tobin, R. L.,Sensitivity Analysis for Variational Inequalities, Journal of Optimization Theory and Applications, Vol. 48, pp. 191–204, 1986.Google Scholar
  27. 27.
    Al-Khayyal, F. A.,Note on Solving Linear Complementarity Problems as Jointly Constrained Bilinear Programs, Journal of Mathematical Analysis and Applications, Vol. 158, 1991.Google Scholar
  28. 28.
    Mangasarian, O. L.,Solution of Symmetric Linear Complementarity Problems by Iterative Methods, Journal of Optimization Theory and Applications, Vol. 22, pp. 465–485, 1977.Google Scholar

Copyright information

© Plenum Publishing Corporation 1991

Authors and Affiliations

  • F. Al-Khayyal
    • 1
  • J. Kyparisis
    • 2
  1. 1.School of Industrial and Systems EngineeringGeorgia Institute of TechnologyAtlanta
  2. 2.Department of Decision Sciences and Information Systems, College of Business AdministrationFlorida International UniversityMiami

Personalised recommendations