On the Superlinear Convergence Order of the Logarithmic Barrier Algorithm

  • Jean-Pierre Dussault
  • Abdellatif Elafia


Since the pioneering work of Karmarkar, much interest was directed to penalty algorithms, in particular to the log barrier algorithm. We analyze in this paper the asymptotic convergence rate of a barrier algorithm when applied to non-linear programs. More specifically, we consider a variant of the SUMT method, in which so called extrapolation predictor steps allowing reducing the penalty parameter rk +1}<rk are followed by some Newton correction steps. While obviously related to predictor-corrector interior point methods, the spirit differs since our point of view is biased toward nonlinear barrier algorithms; we contrast in details both points of view. In our context, we identify an asymptotically optimal strategy for reducing the penalty parameter r and show that if rk+1=r k α with α < 8/5, then asymptotically only 2 Newton corrections are required, and this strategy achieves the best overall average superlinear convergence order (∼1.1696). Therefore, our main result is to characterize the best possible convergence order for SUMT type methods.

logarithmic barrier penalty algorithms interior point methods 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    A. Benchakroun, J.-P. Dussault, and A. Mansouri, “Pénalités mixtes: un algorithme superlinéairement convergent en deux étapes, ” R.A.I.R.O. recherche opérationnelle, vol. 27, no. 4, pp. 353–374, 1993.Google Scholar
  2. 2.
    C.G. Broyden and N.F. Attia, “A smooth sequential penalty function method for solving nonlinear programming problems, ” in System Modelling and Optimization, P. Thoft-Christenses (Ed.), Springler-Verlag: Berlin, Germany, 1983, pp. 237–245.Google Scholar
  3. 3.
    R.H. Byrd, G. Lin, and J. Nocedal, “On the local behavior of an interior point method for nonlinear programming, ” Technical Report OTC 98/02, Optimization Technology Center, 1998.Google Scholar
  4. 4.
    R.S. Dembo and T. Steihaug, “Truncated-newton algorithms for large-scale unconstrained optimization, ” Mathematical Programming, vol. 26, pp. 190–230, 1983.Google Scholar
  5. 5.
    J.-P. Dussault, “Numerical stability and efficiency of penalty algorithms, ” S.I.A.M. Journal on Numerical Analysis, vol. 32, no. 1, pp. 296–317, 1995.Google Scholar
  6. 6.
    P.E. Gill, W. Murray, M.S. Saunders, J.A. Tomlin, and M.H. Wright, “On projected newton barrier methods for linear programming and an equivalence to karmarkar's projective method, ” Mathematical Programming, vol. 36, pp. 183–209, 1986.Google Scholar
  7. 7.
    N.I.M. Gould, “On the accurate determination of search directions for simple differentiable penalty functions, ” I.M.A. Journal on Numerical Analysis, vol. 6, pp. 357–372, 1986.Google Scholar
  8. 8.
    N.I.M. Gould, “On the convergence of a sequential penalty function method for constrained minimization, ” S.I.A.M. Journal on Numerical Analysis, vol. 26, pp. 107–108, 1989.Google Scholar
  9. 9.
    W. Hock and K. Schittkowski, Test Examples for Nonlinear Programming Codes, Springer Verlag: Berlin, 1981. vol. 187 in Lecture Notes in Economics and Mathematical Systems.Google Scholar
  10. 10.
    N.K. Karmarkar, “A new polynomial time algorithm for linear programming, ” Combinatorica, vol 4, pp. 373–395, 1984.Google Scholar
  11. 11.
    D. Ralph and S.J. Wright, “Superlinear convergence of an interior-ppoint method for monotone variational inequalities, ” in Complementarity and Variational Problems: State of the Art. M.C. Ferris and J.-S. Pang (Eds.), SIAM, 1998.Google Scholar
  12. 12.
    S.J. Wright, Primal-Dual Interior-Point Methods, SIAM, 1997.Google Scholar

Copyright information

© Kluwer Academic Publishers 2001

Authors and Affiliations

  • Jean-Pierre Dussault
    • 1
  • Abdellatif Elafia
    • 2
  1. 1.Professeur titulaire, département de Mathématiques et InformatiqueUniversité de SherbrookeSherbrooke (Québec)Canada
  2. 2.Département de Mathématiques et InformatiqueUniversité de SherbrookeSherbrooke (Québec)Canada

Personalised recommendations