Skip to main content
SpringerLink
Log in

A new use of Douglas–Rachford splitting for identifying infeasible, unbounded, and pathological conic programs

Mathematical Programming volume 177, pages 225–253 (2019)Cite this article

Abstract

In this paper, we present a method for identifying infeasible, unbounded, and pathological conic programs based on Douglas–Rachford splitting. When an optimization program is infeasible, unbounded, or pathological, the iterates of Douglas–Rachford splitting diverge. Somewhat surprisingly, such divergent iterates still provide useful information, which our method uses for identification. In addition, for strongly infeasible problems the method produces a separating hyperplane and informs the user on how to minimally modify the given problem to achieve strong feasibility. As a first-order method, the proposed algorithm relies on simple subroutines, and therefore is simple to implement and has low per-iteration cost.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

USD 39.95

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Fig. 1

References

  1. Baillon, J.B., Bruck, R.E., Reich, S.: On the asymptotic behavior of nonexpansive mappings and semigroups in Banach spaces. Houst. J. Math. 4(1), 1–9 (1978)

    MathSciNet  MATH  Google Scholar 

  2. Bauschke, H.H., Boţ, R.I., Hare, W.L., Moursi, W.M.: Attouch–Théra duality revisited: paramonotonicity and operator splitting. J. Approx. Theory 164(8), 1065–1084 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  3. Bauschke, H.H., Combettes, P.L.: Convex Analysis and Monotone Operator Theory in Hilbert Spaces. CMS Books in Mathematics. Springer, New York (2011)

    Book  MATH  Google Scholar 

  4. Bauschke, H.H., Combettes, P.L., Luke, D.: Finding best approximation pairs relative to two closed convex sets in Hilbert spaces. J. Approx. Theory 127(2), 178–192 (2004)

    Article  MathSciNet  MATH  Google Scholar 

  5. Bauschke, H.H., Hare, W.L., Moursi, W.M.: Generalized solutions for the sum of two maximally monotone operators. SIAM J. Control Optim. 52(2), 1034–1047 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  6. Bauschke, H.H., Hare, W.L., Moursi, W.M.: On the range of the Douglas–Rachford operator. Math. Oper. Res. 41(3), 884–897 (2016)

    Article  MathSciNet  MATH  Google Scholar 

  7. Bauschke, H.H., Moursi, W.M.: The Douglas–Rachford algorithm for two (not necessarily intersecting) affine subspaces. SIAM J. Optim. 26(2), 968–985 (2016)

    Article  MathSciNet  MATH  Google Scholar 

  8. Bauschke, H.H., Moursi, W.M.: On the Douglas–Rachford algorithm. Math. Program. 164(1), 263–284 (2017)

    Article  MathSciNet  MATH  Google Scholar 

  9. Borwein, J., Wolkowicz, H.: Regularizing the abstract convex program. J. Math. Anal. Appl. 83(2), 495–530 (1981)

    Article  MathSciNet  MATH  Google Scholar 

  10. Borwein, J.M., Wolkowicz, H.: Facial reduction for a cone-convex programming problem. J. Aust. Math. Soc. 30(3), 369–380 (1981)

    Article  MathSciNet  MATH  Google Scholar 

  11. Davis, D., Yin, W.: Convergence rate analysis of several splitting schemes. In: Glowinski, R., Osher, S., Yin, W. (eds.) Splitting Methods in Communication, Imaging, Science and Engineering, vol. 4. Springer, Berlin (2016)

    Google Scholar 

  12. Drusvyatskiy, D., Wolkowicz, H.: The many faces of degeneracy in conic optimization. Found. Trends Optim. 3(2), 77–170 (2017)

    Article  Google Scholar 

  13. Eckstein, J.: Splitting methods for monotone operators with applications to parallel optimization. Ph.D. thesis, MIT (1989)

  14. de Klerk, E., Terlaky, T., Roos, K.: Self-dual embeddings. In: Wolkowicz, H., Saigal, R., Vandenberghe, L. (eds.) Handbook of Semidefinite Programming: Theory, Algorithms, and Applications, pp. 111–138. Springer, New York (2000)

    Chapter  Google Scholar 

  15. Lions, P.L., Mercier, B.: Splitting algorithms for the sum of two nonlinear operators. SIAM J. Numer. Anal. 16(6), 964–979 (1979)

    Article  MathSciNet  MATH  Google Scholar 

  16. Liu, M., Pataki, G.: Exact duals and short certificates of infeasibility and weak infeasibility in conic linear programming. Math. Program. 167(2), 435–480 (2017)

    Article  MathSciNet  MATH  Google Scholar 

  17. Loera, J.A.D., Malkin, P.N., Parrilo, P.A.: Computation with polynomial equations and inequalities arising in combinatorial optimization. In: Lee, J., Leyffer, S. (eds.) Mixed Integer Nonlinear Programming, pp. 447–481. Springer, New York (2012)

  18. Lofberg, J.: Pre- and post-processing sum-of-squares programs in practice. IEEE Trans. Autom. Control 54(5), 1007–1011 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  19. Lourenço, B.F., Muramatsu, M., Tsuchiya, T.: Solving SDP completely with an interior point oracle. arXiv:1507.08065 [math] (2015)

  20. Luenberger, D.G., Ye, Y.: Linear and Nonlinear Programming, 4th edn. Springer (2016)

  21. Luo, Z.Q., Sturm, J.F., Zhang, S.: Duality results for conic convex programming. Econometric Institute, Erasmus University Rotterdam, The Netherlands, Technical Report 9719/A (1997)

  22. Luo, Z.Q., Sturm, J.F., Zhang, S.: Conic convex programming and self-dual embedding. Optim. Methods Softw. 14(3), 169–218 (2000)

    Article  MathSciNet  MATH  Google Scholar 

  23. Mosek, A.: The MOSEK optimization toolbox for matlab manual. Version 7.1 (Revision 28) (2015)

  24. Moursi, W.M.: The Douglas–Rachford operator in the possibly inconsistent case: static properties and dynamic behaviour. Ph.D. thesis, University of British Columbia (2017)

  25. Nesterov, Y., Todd, M.J., Ye, Y.: Infeasible-start primal-dual methods and infeasibility detectors for nonlinear programming problems. Math. Program. 84(2), 227–267 (1999)

    Article  MathSciNet  MATH  Google Scholar 

  26. Pataki, G.: A simple derivation of a facial reduction algorithm and extended dual systems. Columbia University, Technical report (2000)

  27. Pazy, A.: Asymptotic behavior of contractions in Hilbert space. Israel J. Math. 9(2), 235–240 (1971)

    Article  MathSciNet  MATH  Google Scholar 

  28. Permenter, F., Friberg, H.A., Andersen, E.D.: Solving conic optimization problems via self-dual embedding and facial reduction: a unified approach. SIAM J. Optim. 27(3), 1257–1282 (2017)

    Article  MathSciNet  MATH  Google Scholar 

  29. Permenter, F., Parrilo, P.: Partial facial reduction: simplified, equivalent SDPs via approximations of the PSD cone. arXiv:1408.4685 (2014)

  30. Rockafellar, R.T.: Convex Analysis. Princeton University Press, Princeton (1970)

    Book  MATH  Google Scholar 

  31. Rockafellar, R.T.: Conjugate Duality and Optimization. Society for Industrial and Applied Mathematics, Philadelphia (1974)

  32. Rockafellar, R.T.: Monotone operators and the proximal point algorithm. SIAM J. Control Optim. 14(5), 877–898 (1976)

    Article  MathSciNet  MATH  Google Scholar 

  33. Sturm, J.F.: Using SeDuMi 1.02, a MATLAB toolbox for optimization over symmetric cones. Optim. Methods Softw. 11(1–4), 625–653 (1999)

    Article  MathSciNet  MATH  Google Scholar 

  34. Svaiter, B.F.: On weak convergence of the Douglas–Rachford method. SIAM J. Control Optim. 49(1), 280–287 (2011)

    Article  MathSciNet  MATH  Google Scholar 

  35. Tütüncü, R.H., Toh, K.C., Todd, M.J.: Solving semidefinite-quadratic-linear programs using SDPT3. Math. Program. 95(2), 189–217 (2003)

    Article  MathSciNet  MATH  Google Scholar 

  36. Waki, H.: How to generate weakly infeasible semidefinite programs via Lasserre’s relaxations for polynomial optimization. Optim. Lett. 6(8), 1883–1896 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  37. Waki, H., Muramatsu, M.: Facial reduction algorithms for conic optimization problems. J. Optim. Theory Appl. 158(1), 188–215 (2013)

    Article  MathSciNet  MATH  Google Scholar 

  38. Waki, H., Nakata, M., Muramatsu, M.: Strange behaviors of interior-point methods for solving semidefinite programming problems in polynomial optimization. Comput. Optim. Appl. 53(3), 823–844 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  39. Ye, Y., Todd, M.J., Mizuno, S.: An \(O(\sqrt{n}L)\)-iteration homogeneous and self-dual linear programming algorithm. Math. Oper. Res. 19(1), 53–67 (1994)

    Article  MathSciNet  MATH  Google Scholar 

  40. Yoshise, A.: Complementarity problems over symmetric cones: a survey of recent developments in several aspects. In: Anjos, M.F., Lasserre, J.B. (eds.) Handbook on Semidefinite, Conic and Polynomial Optimization, no. 166 in International Series in Operations Research and Management Science, pp. 339–375. Springer, New York (2012)

    Google Scholar 

Download references

Acknowledgements

W. Yin would like to thank Professor Yinyu Ye for his question regarding ADMM applied to infeasible linear programs during the 2014 Workshop on Optimization for Modern Computation held at Peking University.

Author information

Authors and Affiliations

  1. Department of Mathematics, UCLA, Los Angeles, CA, 90095-1555, USA

    Yanli Liu, Ernest K. Ryu & Wotao Yin

Authors
  1. Yanli Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ernest K. Ryu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Wotao Yin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wotao Yin.

Additional information

This work is supported in part by NSF Grant DMS-1720237 and ONR Grant N000141712162.

Rights and permissions

Reprints and Permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liu, Y., Ryu, E.K. & Yin, W. A new use of Douglas–Rachford splitting for identifying infeasible, unbounded, and pathological conic programs. Math. Program. 177, 225–253 (2019). https://doi.org/10.1007/s10107-018-1265-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10107-018-1265-5

Keywords

Mathematics Subject Classification

search

Navigation