Mathematical Programming

, Volume 65, Issue 1–3, pp 331–345 | Cite as

A regularization of the Frank—Wolfe method and unification of certain nonlinear programming methods

  • Athanasios Migdalas


The Frank—Wolfe linearization technique is a popular feasible direction algorithm for the solution of certain linearly constrained nonlinear problems. The popularity of this technique is due in part to its ability to exploit special constraint structures, such as network structures, and in part to the fact that it decomposes nonseparable problems over Cartesian product sets. However, the linearization which induces these advantages is also the source of the main disadvantages of the method: a sublinear rate of convergence and zigzagging behaviour. In order to avoid these disadvantages, a regularization penalty term is added to the objective of the direction generating subproblem. This results in a generic feasible direction method which also includes certain known nonlinear programming methods.


Pseudoconvex programming Decomposition scheme Frank—Wolfe algorithm Feasible direction methods Proximal point algorithm Gap function 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    M.S. Bazaraa and C.M. Shetty,Nonlinear programming—Theory and Algorithms (John Wiley & Sons, New York, NY, 1979).Google Scholar
  2. [2]
    D.P. Bertsekas, “On the Goldstein—Levitin—Polyak gradient projection method,”IEEE Transactions on Automatic Control AC-21 (1976) 174–184.Google Scholar
  3. [3]
    D.C. Cantor and M. Gerla, “Optimal routing in a packet-switched computer network,”IEEE Transactions on Computers C-23 (1974) 1062–1069.Google Scholar
  4. [4]
    S.C. Dafermos and F.T. Sparrow, “The traffic assignment problem for a general network,”Journal of RNBS 73B (1969) 91–118.Google Scholar
  5. [5]
    C.F. Daganzo, “On the traffic assignment problem with flow dependent cost,”Transportation Research 11 (1977) 433–441.Google Scholar
  6. [6]
    J.P. Dussault, J. Ferland and B. Lemaire, “Convex quadratic programming with one constraint and bounded variables,”Mathematical Programming 36 (1986) 90–104.Google Scholar
  7. [7]
    M. Frank and P. Wolfe, “An algorithm for quadratic programming,”Naval Research Logistic Quarterly 3 (1956) 95–110.Google Scholar
  8. [8]
    L. Fratta, M. Gerla and L. Kleinrock, “The flow deviation method. An approach to store-and-forward communication network design,”Networks 3 (1973) 97–133.Google Scholar
  9. [9]
    D.W. Hearn, “The gap function of a convex program,”Operations Research Letters 1 (1982) 67–71.Google Scholar
  10. [10]
    B. von Hohenbalken, “A finite algorithm to maximize certain pseudoconcave functions on polytopes,”Mathematical Programming 8 (1975) 189–206.Google Scholar
  11. [11]
    C.A. Holloway, “An extension of the Frank and Wolfe method of feasible direction,”Mathematical Programming 8 (1974) 14–27.Google Scholar
  12. [12]
    J.L. Kennington and R.V. Helgason,Algorithms for Network Programming (John Wiley & Sons, New York, NY, 1980).Google Scholar
  13. [13]
    D. Kinderlehrer and G. Stampacchia,An Introduction to Variational Inequalities (Academic Press, New York, NY, 1980).Google Scholar
  14. [14]
    T. Larsson and A. Migdalas, “An algorithm for nonlinear programs over Cartesian product sets,”Optimization 21 (1990) 535–542.Google Scholar
  15. [15]
    T. Larsson, A. Migdalas and M. Patriksson, “The application of partial linearization algorithm to the traffic assignment problem,”Optimization 28 (1993) 47–61.Google Scholar
  16. [16]
    L.J. LeBlanc, E.K. Morlok and W.P. Pierskalla, “An efficient approach to solving the road network equilibrium traffic assignment problem,”Transportation Research 9 (1975) 308–318.Google Scholar
  17. [17]
    L.J. LeBlanc, R.V. Helgason and D.E. Boyce, “Improved efficiency of the Frank—Wolfe algorithm for convex network programs,”Transportation Science 19 (1985) 445–462.Google Scholar
  18. [18]
    E.S. Levitin and B.T. Polyak, “Constrained minimization methods,”USSR Computational Mathematics and Mathematical Physics 6 (1966) 787–823.Google Scholar
  19. [19]
    B. Martos,Nonlinear Programming: Theory and Methods (North-Holland, Amsterdam, 1975).Google Scholar
  20. [20]
    J.D. Murchland, “Gleich-gewichtsverteilung des Verkehrs im Strassennetz,”Operations Research Verfahren 8 (1970) 143–183.Google Scholar
  21. [21]
    S. Nguyen, “An algorithm for traffic assignment problem,”Transportation Science 8 (1974) 203–216.Google Scholar
  22. [22]
    E.R. Petersen, “A primal-dual traffic assignment algorithm,”Management Science 22 (1975) 87–95.Google Scholar
  23. [23]
    B.N. Pshenichny and Y.M. Danilin,Numerical Methods in Extremal Problems (Mir Publishers, Moscow, 1978).Google Scholar
  24. [24]
    R.T. Rockafellar, “Augmented Lagrangians and applications of the proximal point algorithm in convex programming,”Mathematics of Operations Research 1 (1976) 97–116.Google Scholar
  25. [25]
    P. Wolfe, “Convergence theory in nonlinear programming,” in: J. Abadie, ed.,Integer and Nonlinear Programming (North-Holland, Amsterdam, 1970) pp. 1–36.Google Scholar

Copyright information

© The Mathematical Programming Society, Inc 1994

Authors and Affiliations

  • Athanasios Migdalas
    • 1
  1. 1.Department of MathematicsLinköping Institute of TechnologyLinköpingSweden

Personalised recommendations