Skip to main content
Log in

Inexact Alternating Direction Methods of Multipliers with Logarithmic–Quadratic Proximal Regularization

  • Published:
Journal of Optimization Theory and Applications Aims and scope Submit manuscript

Abstract

In the literature, it was shown recently that the Douglas–Rachford alternating direction method of multipliers can be combined with the logarithmic-quadratic proximal regularization for solving a class of variational inequalities with separable structures. This paper studies the inexact version of this combination, where the resulting subproblems are allowed to be solved approximately subject to different inexactness criteria. We prove the global convergence and establish worst-case convergence rates for the derived inexact algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Glowinski, R., Marrocco, A.: Sur l’approximation par éléments finis d’ordre un et la résolution par pénalisation-dualité d’une classe de problèmes de Dirichlet non linéaires. Rev. Fr. Autom. Inform. Rech. Opér., Anal. Numér. 2, 41–76 (1975)

    MathSciNet  Google Scholar 

  2. He, B.S., Liao, L.-Z., Han, D.R., Yang, H.: A new inexact alternating directions method for monotone variational inequalities. Math. Program. 92(1), 103–118 (2002)

    Article  MathSciNet  MATH  Google Scholar 

  3. Martinet, B.: Regularision d’inéquations variationnelles par approximations successive. Rev. Fr. Autom. Inform. Rech. Opér. 126, 154–159 (1970)

    MathSciNet  Google Scholar 

  4. Auslender, A., Teboulle, M.: Entropic proximal decomposition method for convex programs and variational inequalities. Math. Program. 91(1), 33–47 (2001)

    MathSciNet  MATH  Google Scholar 

  5. Yuan, X.M., Li, M.: An LQP-based decomposition method for solving a class of variational inequalities. SIAM J. Optim. 21(4), 1309–1318 (2011)

    Article  MathSciNet  MATH  Google Scholar 

  6. Auslender, A., Teboulle, M., Ben-Tiba, S.: A logarithmic-quadratic proximal method for variational inequalities. Comput. Optim. Appl. 12, 31–40 (1999)

    Article  MathSciNet  MATH  Google Scholar 

  7. Boyd, S., Parikh, N., Chu, E., Peleato, B., Eckstein, J.: Distributed optimization and statistical learning via the alternating direction method of multipliers. Found. Trends Mach. Learn. 3(1), 1–122 (2011)

    Article  Google Scholar 

  8. Tao, M., Yuan, X.M.: On the O(1/t) convergence rate of alternating direction method with logarithmic-quadratic proximal regularization. SIAM J. Optim. 22(4), 1431–1448 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  9. Facchinei, F., Pang, J.S.: Finite-Dimensional Variational Inequalities and Complementarity Problems, Vols. I and II. Springer, New York (2003)

    Google Scholar 

  10. He, B.S., Yuan, X.M.: On the O(1/n) convergence rate of the Douglas–Rachford alternating direction method. SIAM J. Numer. Anal. 50(2), 700–709 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  11. Nesterov, Y.: Gradient methods for minimizing composite objective function pp. 1–30. Core Discussion Paper, 2007/76 (2007)

  12. He, B.S., Liao, L.-Z., Yuan, X.M.: A LQP-based interior prediction-correction method for nonlinear complementarity problems. J. Comput. Math. 24(1), 33–44 (2006)

    MathSciNet  MATH  Google Scholar 

  13. Yamashita, N., Fukushima, M.: Equivalent unconstrained minimization and global error bounds for variational inequality problems. SIAM J. Control Optim. 35(1), 273–284 (1997)

    Article  MathSciNet  MATH  Google Scholar 

Download references

Acknowledgements

The first author was supported by National Natural Science Foundation of China grant 11001053, Program for New Century Excellent Talents in University grant NCET-12-0111 and Natural Science Foundation of Jiangsu Province grant BK2012662. The second author was supported in part by Hong Kong General Research Fund grants HKBU 201409 and HKBU 201611. The third author was supported by the grant FRG2/11-12/120 from Hong Kong Baptist University and the General Research Fund HKBU 203311 from Hong Kong Research Grants Council.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xiaoming Yuan.

Additional information

Communicated by Masao Fukushima.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Li, M., Liao, LZ. & Yuan, X. Inexact Alternating Direction Methods of Multipliers with Logarithmic–Quadratic Proximal Regularization. J Optim Theory Appl 159, 412–436 (2013). https://doi.org/10.1007/s10957-013-0334-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10957-013-0334-4

Keywords

Navigation