Mathematical Programming

, Volume 112, Issue 2, pp 403–425 | Cite as

Dual multilevel optimization

  • Timothy A. Davis
  • William W. HagerEmail author
Full Length Paper


We study the structure of dual optimization problems associated with linear constraints, bounds on the variables, and separable cost. We show how the separability of the dual cost function is related to the sparsity structure of the linear equations. As a result, techniques for ordering sparse matrices based on nested dissection or graph partitioning can be used to decompose a dual optimization problem into independent subproblems that could be solved in parallel. The performance of a multilevel implementation of the Dual Active Set algorithm is compared with CPLEX Simplex and Barrier codes using Netlib linear programming test problems.


Multilevel optimization Dual optimization Dual separability Dual active set algorithm Parallel algorithms 

Mathematics Subject Classification (2000)

90C05 90C06 65Y20 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Andersen E.D., Andersen K.D. (1995) Presolving in linear programming. Math. Program. 71, 221–245MathSciNetGoogle Scholar
  2. 2.
    Bixby R.E. (1994) Progress in linear programming. ORSA J. Comput. 6, 15–22zbMATHMathSciNetGoogle Scholar
  3. 3.
    Brainman I., Toledo S. (2002) Nested-dissection orderings for sparse LU with partial pivoting. SIAM J. Matrix Anal. Appl. 23, 998–1012zbMATHCrossRefMathSciNetGoogle Scholar
  4. 4.
    Bramble J.H. (1993) Multigrid Methods. Wiley, New YorkzbMATHGoogle Scholar
  5. 5.
    Davis T.A. (2005) Algorithm 849: a concise sparse Cholesky factorization package. ACM Trans. Math. Softw. 31, 587–591CrossRefGoogle Scholar
  6. 6.
    Davis, T.A.: CHOLMOD users’ guide. University of Florida (2005). http: Scholar
  7. 7.
    Davis T.A., Gilbert J.R., Larimore S.I., Ng E.G. (2004) A column approximate minimum degree ordering algorithm. ACM Trans. Math. Softw. 30, 353–376zbMATHCrossRefMathSciNetGoogle Scholar
  8. 8.
    Davis T.A., Hager W.W. (1999) Modifying a sparse Cholesky factorization. SIAM J. Matrix Anal. Appl. 20, 606–627zbMATHCrossRefMathSciNetGoogle Scholar
  9. 9.
    Davis T.A., Hager W.W. (2001) Multiple-rank modifications of a sparse Cholesky factorization. SIAM J. Matrix Anal. Appl. 22, 997–1013zbMATHCrossRefMathSciNetGoogle Scholar
  10. 10.
    Davis, T.A., Hager, W.W.: A sparse proximal implementation of the LP dual active set algorithm. Math. Program (in press) (2006). DOI 10.1007/s10107-006-0017-0Google Scholar
  11. 11.
    Davis T.A., Hager W.W. (2005) Row modifications of a sparse Cholesky factorization. SIAM J. Matrix Anal. Appl. 26, 621–639zbMATHCrossRefMathSciNetGoogle Scholar
  12. 12.
    Dongarra J., Du Croz J., Hammarling S., Duff I. (1990) A set of level 3 basic linear algebra subprograms. ACM Trans. Math. Softw. 16, 1–17zbMATHCrossRefGoogle Scholar
  13. 13.
    Ferris M.C., Horn J.D. (1998) Partitioning mathematical programs for parallel solution. Math. Program. 80, 35–62MathSciNetGoogle Scholar
  14. 14.
    Gondzio J., Sarkissian R. (2003) Parallel interior-point solver for structured linear programs. Math. Prog. 96, 561–584zbMATHCrossRefMathSciNetGoogle Scholar
  15. 15.
    Goto, K., van de Geijn, R.: On reducing TLB misses in matrix multiplication. TR-2002-55, University of Texas at Austin, Departmentn of Computer Sciences (2002)Google Scholar
  16. 16.
    Hackbusch W. (1985) Multigrid Methods and Applications. Springer, Berlin Heidelberg New YorkGoogle Scholar
  17. 17.
    Hager, W.W.: The dual active set algorithm. In: Pardalos, P.M. (ed.) Advances in Optimization and Parallel Computing 137–142. North Holland, Amsterdam (1992)Google Scholar
  18. 18.
    Hager W.W. (1998) The LP dual active set algorithm. In: Leone R.D., Murli A., Pardalos P.M., Toraldo G. (eds) High Performance Algorithms and Software in Nonlinear Optimization. Kluwer, Dordrecht, pp. 243–254Google Scholar
  19. 19.
    Hager W.W. (2002) The dual active set algorithm and its application to linear programming. Comput. Optim. Appl. 21, 263–275zbMATHCrossRefMathSciNetGoogle Scholar
  20. 20.
    Hager W.W.: The dual active set algorithm and the iterative solution of linear programs. In: Pardalos, P.M., Wolkowicz, H. (eds.) Novel Approaches to Hard Discrete Optimization pp. 95–107, vol. 37. Fields Institute Communications (2003)Google Scholar
  21. 21.
    Hager W.W., Hearn D.W. (1993) Application of the dual active set algorithm to quadratic network optimization. Comput. Optim. Appl. 1, 349–373zbMATHCrossRefMathSciNetGoogle Scholar
  22. 22.
    Hager, W.W., Shi, C.-L., Lundin, E.O.: Active set strategies in the LP dual active set algorithm, Tech. Report, University of Florida, (1996)Google Scholar
  23. 23.
    Hall J.A.J., McKinnon K.I.M. (2005) Hyper-sparsity in the revised simplex method and how to exploit it. Comput. Optim. Appl. 32, 259–283zbMATHCrossRefMathSciNetGoogle Scholar
  24. 24.
    Heath M.T., Raghavan P. (1995) A Cartesian parallel nested dissection algorithm. SIAM J. Matrix Anal. Appl. 16, 235–253zbMATHCrossRefMathSciNetGoogle Scholar
  25. 25.
    Hendrickson, B., Leland, R.: A multilevel algorithm for partitioning graphs. In: Proc. Supercomputing ’95, ACM (1995)Google Scholar
  26. 26.
    Hendrickson B., Rothberg E. (1999) Improving the runtime and quality of nested dissection ordering. SIAM J. Sci. Comput. 20, 468–489zbMATHCrossRefMathSciNetGoogle Scholar
  27. 27.
    Karypis G., Kumar V. (1998) A fast and high quality multilevel scheme for partitioning irregular graphs. SIAM J. Sci. Comput. 20, 359–392CrossRefMathSciNetGoogle Scholar
  28. 28.
    Karypis G., Kumar V. (1999) Multilevel k-way partitioning scheme for irregular graphs. J. Parallel Distrib. Comput. 48, 96–129CrossRefGoogle Scholar
  29. 29.
    Karypis G., Kumar V. (1999) Parallel multilevel k-way partitioning scheme for irregular graphs. SIAM Rev. 41, 278–300zbMATHCrossRefMathSciNetGoogle Scholar
  30. 30.
    Liu J.W.H. (1991) A generalized envelope method for sparse factorization by rows. ACM Trans. Math. Softw. 17, 112–129zbMATHCrossRefGoogle Scholar
  31. 31.
    Luenberger D.G. (1984) Linear and Nonlinear Programming. Addison Wesley, ReadingzbMATHGoogle Scholar
  32. 32.
    Shannon C.E. (1948) A mathematical theory of communication. Bell Syst. Tech. J. 27, 623–653MathSciNetGoogle Scholar

Copyright information

© Springer-Verlag 2006

Authors and Affiliations

  1. 1.Department of Computer and Information Science and EngineeringUniversity of FloridaGainesvilleUSA
  2. 2.Department of MathematicsUniversity of FloridaGainesvilleUSA

Personalised recommendations