Abstract
In the literature, it was shown recently that the Douglas–Rachford alternating direction method of multipliers can be combined with the logarithmic-quadratic proximal regularization for solving a class of variational inequalities with separable structures. This paper studies the inexact version of this combination, where the resulting subproblems are allowed to be solved approximately subject to different inexactness criteria. We prove the global convergence and establish worst-case convergence rates for the derived inexact algorithms.
Similar content being viewed by others
References
Glowinski, R., Marrocco, A.: Sur l’approximation par éléments finis d’ordre un et la résolution par pénalisation-dualité d’une classe de problèmes de Dirichlet non linéaires. Rev. Fr. Autom. Inform. Rech. Opér., Anal. Numér. 2, 41–76 (1975)
He, B.S., Liao, L.-Z., Han, D.R., Yang, H.: A new inexact alternating directions method for monotone variational inequalities. Math. Program. 92(1), 103–118 (2002)
Martinet, B.: Regularision d’inéquations variationnelles par approximations successive. Rev. Fr. Autom. Inform. Rech. Opér. 126, 154–159 (1970)
Auslender, A., Teboulle, M.: Entropic proximal decomposition method for convex programs and variational inequalities. Math. Program. 91(1), 33–47 (2001)
Yuan, X.M., Li, M.: An LQP-based decomposition method for solving a class of variational inequalities. SIAM J. Optim. 21(4), 1309–1318 (2011)
Auslender, A., Teboulle, M., Ben-Tiba, S.: A logarithmic-quadratic proximal method for variational inequalities. Comput. Optim. Appl. 12, 31–40 (1999)
Boyd, S., Parikh, N., Chu, E., Peleato, B., Eckstein, J.: Distributed optimization and statistical learning via the alternating direction method of multipliers. Found. Trends Mach. Learn. 3(1), 1–122 (2011)
Tao, M., Yuan, X.M.: On the O(1/t) convergence rate of alternating direction method with logarithmic-quadratic proximal regularization. SIAM J. Optim. 22(4), 1431–1448 (2012)
Facchinei, F., Pang, J.S.: Finite-Dimensional Variational Inequalities and Complementarity Problems, Vols. I and II. Springer, New York (2003)
He, B.S., Yuan, X.M.: On the O(1/n) convergence rate of the Douglas–Rachford alternating direction method. SIAM J. Numer. Anal. 50(2), 700–709 (2012)
Nesterov, Y.: Gradient methods for minimizing composite objective function pp. 1–30. Core Discussion Paper, 2007/76 (2007)
He, B.S., Liao, L.-Z., Yuan, X.M.: A LQP-based interior prediction-correction method for nonlinear complementarity problems. J. Comput. Math. 24(1), 33–44 (2006)
Yamashita, N., Fukushima, M.: Equivalent unconstrained minimization and global error bounds for variational inequality problems. SIAM J. Control Optim. 35(1), 273–284 (1997)
Acknowledgements
The first author was supported by National Natural Science Foundation of China grant 11001053, Program for New Century Excellent Talents in University grant NCET-12-0111 and Natural Science Foundation of Jiangsu Province grant BK2012662. The second author was supported in part by Hong Kong General Research Fund grants HKBU 201409 and HKBU 201611. The third author was supported by the grant FRG2/11-12/120 from Hong Kong Baptist University and the General Research Fund HKBU 203311 from Hong Kong Research Grants Council.
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by Masao Fukushima.
Rights and permissions
About this article
Cite this article
Li, M., Liao, LZ. & Yuan, X. Inexact Alternating Direction Methods of Multipliers with Logarithmic–Quadratic Proximal Regularization. J Optim Theory Appl 159, 412–436 (2013). https://doi.org/10.1007/s10957-013-0334-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10957-013-0334-4