Continuous relaxation for discrete DC programming

Full Length Paper Series B


Discrete DC programming with convex extensible functions is studied. A natural approach for this problem is a continuous relaxation that extends the problem to a continuous domain and applies the algorithm in continuous DC programming. By employing a special form of continuous relaxation, which is named “lin-vex extension,” the produced optimal solution of the extended continuous relaxation coincides with the solution of the original discrete problem. The proposed method is demonstrated for the degree-concentrated spanning tree problem, the unfair flow problem, and the correlated knapsack problem.

Mathematics Subject Classification

90C27 Combinatorial optimization 



This work is supported by JSPS KAKENHI Grant Numbers 26280004 and 16K16011, by The Mitsubishi Foundation, by CREST, JST, and by JST, ERATO, Kawarabayashi Large Graph Project.


  1. 1.
    Bach, F., Jenatton, R., Mairal, J., Obozinski, G.: Optimization with sparsity-inducing penalties. Found. Trends Mach. Learn. 4, 1–106 (2012)CrossRefMATHGoogle Scholar
  2. 2.
    Donoho, D.L.: Compressed sensing. IEEE Trans. Inf. Theory 52, 1289–1306 (2006)MathSciNetCrossRefMATHGoogle Scholar
  3. 3.
    Favati, P., Tardella, F.: Convexity in nonlinear integer programming. Ricerca Oper. 53, 3–44 (1990)Google Scholar
  4. 4.
    Fujishige, S.: Submodular Functions and Optimization. 2nd ed., Ann. Discret. Math., vol. 58, Elsevier, Amsterdam (2005)Google Scholar
  5. 5.
    Fujishige, S.: Bisubmodular polyhedra, simplicial divisions, and discrete convexity. Discret. Optim. 12, 115–120 (2014)MathSciNetCrossRefMATHGoogle Scholar
  6. 6.
    Garey, M.R., Johnson, D.S.: Computers and Intractability: A Guide to the Theory of NP-Completeness. W. H. Freeman, San Francisco (1979)MATHGoogle Scholar
  7. 7.
    Hoai An, L.T., Tao, P.D.: A continuous approach for globally solving linearly constrained quadratic zero-one programming problems. Optimization 50, 93–120 (2001)MathSciNetCrossRefMATHGoogle Scholar
  8. 8.
    Horst, R., Thoai, N.V.: Global Optimization: Deterministic Approaches. Springer, Berlin (1996)CrossRefMATHGoogle Scholar
  9. 9.
    Horst, R., Thoai, N.V.: DC programming: overview. J. Optim. Theory Appl. 103, 1–43 (1999)MathSciNetCrossRefMATHGoogle Scholar
  10. 10.
    Ibaraki, T., Katoh, N.: Resource Allocation Problems: Algorithmic Approaches. MIT Press, Cambridge (1988)MATHGoogle Scholar
  11. 11.
    Iyer, R., Jegelka, S., Bilmes J.: Fast semidifferential-based submodular function optimization. In: Proceedings of the 30th International Conference on Machine Learning, pp. 855–863 (2013)Google Scholar
  12. 12.
    Katoh, N., Shioura, A., Ibaraki, T.: Resource Allocation Problems. In: Pardalos, P.M., Du, D.-Z., Graham, R.L. (eds.) Handbook of Combinatorial Optimization, vol. 5, 2nd edn, pp. 2897–2988. Springer, Berlin (2013)CrossRefGoogle Scholar
  13. 13.
    Kawahara, Y., Washio, T.: Prismatic algorithm for discrete D.C. programming problem. In: Proceedings of the 25th Annual Conference on Neural Information Processing Systems, pp. 2106–2114 (2011)Google Scholar
  14. 14.
    Kobayashi, Y.: The complexity of minimizing the difference of two M\({}^\natural \)-convex set functions. Op. Res. Lett. 43, 573–574 (2015)MathSciNetCrossRefGoogle Scholar
  15. 15.
    Larsson, M.O., Ugander, J.: A concave regularization technique for sparse mixture models. Adv. Neural Inf. Process. Syst. 24, 1890–1898 (2011)Google Scholar
  16. 16.
    Lemke, P.: The maximum leaf spanning tree problem for cubic graphs is NP-complete, IMA Preprint Series #428, University of Minnesota (1988)Google Scholar
  17. 17.
    Maehara, T., Murota, K.: A framework of discrete DC programming by discrete convex analysis. Math. Program. Ser. A 152, 435–466 (2015)MathSciNetCrossRefMATHGoogle Scholar
  18. 18.
    Moriguchi, S., Shioura, A., Tsuchimura, N.: M-convex function minimization by continuous relaxation approach–Proximity theorem and algorithm. SIAM J. Optim. 21, 633–668 (2011)MathSciNetCrossRefMATHGoogle Scholar
  19. 19.
    Moriguchi, S., Tsuchimura, N.: Discrete L-convex function minimization based on continuous relaxation. Pac. J. Optim. 5, 227–236 (2009)MathSciNetMATHGoogle Scholar
  20. 20.
    Murota, K.: Discrete Convex Analysis. Society for Industrial and Applied Mathematics, Philadelphia (2003)CrossRefMATHGoogle Scholar
  21. 21.
    Murota, K.: Recent developments in discrete convex analysis. In: Cook, W., Lovász, L., Vygen, J. (eds.) Research Trends in Combinatorial Optimization, Chapter 11, pp. 219–260. Springer, Berlin (2009)CrossRefGoogle Scholar
  22. 22.
    Narasimhan, M., Bilmes, J.: A submodular-supermodular procedure with applications to discriminative structure learning. In: Proceedings of the 21st Conference on Uncertainty in Artificial Intelligence, pp. 404–412 (2005)Google Scholar
  23. 23.
    Niu, Y.S., Tao, P.D.: A DC programming approach for mixed-integer linear programs. Model. Comput. Optim. Inf. Syst. Manage. Sci. Commun. Comput. Inf. Sci. 14, 244–253 (2008)MATHGoogle Scholar
  24. 24.
    Pardalos, P.M.: On the passage from local to global in optimization. In: Birge, J.R., Murty, K.G. (eds.) Mathematical Programming: State of the Art 1994, pp. 200–247. The University of Michigan, Ann Arbor (1994)Google Scholar
  25. 25.
    Pardalos, P.M., Prokopyev, O., Busygin, S.: Continuous approaches for solving discrete optimization problems. In: Appa, G., Pitsoulis, L., Williams, H.P. (eds.) Handbook on Modelling for Discrete Optimization, pp. 39–60. Springer, Berlin (2006)CrossRefGoogle Scholar
  26. 26.
    Schüle, T., Schnörr, C., Weber, S., Hornegger, J.: Discrete tomography by convex-concave regularization and D.C. programming. Discret. Appl. Math. 151, 229–243 (2005)MathSciNetCrossRefMATHGoogle Scholar
  27. 27.
    Tanenbaum, A.S.: Computer Networks, 5th edn. Prentice Hall, Upper Saddle River, New Jersey (2010)MATHGoogle Scholar
  28. 28.
    Tao, P.D., El Bernoussi, S.: Duality in D.C. (difference of convex functions) optimization: Subgradient methods. In: Hoffman, K.H., Zowe, J., Hiriart-Urruty, J.B., Lemaréchal, C. (eds.) Trends in Mathematical Optimization, International Series of Numerical Mathematics, vol. 84, pp. 277–293. Birkhäuser, Basel (1987)Google Scholar
  29. 29.
    Tao, P.D., Hoai An, L.T.: Convex analysis approach to D.C. programming: theory, algorithms and applications. Acta Math. Vietnam. 22, 289–355 (1997)MathSciNetMATHGoogle Scholar
  30. 30.
    Tuy, H.: D.C. optimization: theory, methods and algorithms. In: Horst, R., Pardalos, P.M. (eds.) Handbook of Global Optimization, pp. 149–216. Kluwer Academic Publishers, Dordrecht (1995)CrossRefGoogle Scholar
  31. 31.
    Yuille, A.L., Rangarajan, A.: The concave-convex procedure. Neural Comput. 15, 915–936 (2003)CrossRefMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg and Mathematical Optimization Society 2017

Authors and Affiliations

  1. 1.Department of Mathematical and Systems EngineeringShizuoka UniversityShizuokaJapan
  2. 2.RIKEN Center for Advanced Intelligence ProjectTokyoJapan
  3. 3.Department of Mathematical InformaticsUniversity of TokyoTokyoJapan
  4. 4.School of Business AdministrationTokyo Metropolitan UniversityTokyoJapan

Personalised recommendations