Asynchronous block-iterative primal-dual decomposition methods for monotone inclusions
We propose new primal-dual decomposition algorithms for solving systems of inclusions involving sums of linearly composed maximally monotone operators. The principal innovation in these algorithms is that they are block-iterative in the sense that, at each iteration, only a subset of the monotone operators needs to be processed, as opposed to all operators as in established methods. Flexible strategies are used to select the blocks of operators activated at each iteration. In addition, we allow lags in operator processing, permitting asynchronous implementation. The decomposition phase of each iteration of our methods is to generate points in the graphs of the selected monotone operators, in order to construct a half-space containing the Kuhn–Tucker set associated with the system. The coordination phase of each iteration involves a projection onto this half-space. We present two related methods: the first method provides weakly convergent primal and dual sequences under general conditions, while the second is a variant in which strong convergence is guaranteed without additional assumptions. Neither algorithm requires prior knowledge of bounds on the linear operators involved or the inversion of linear operators. Our algorithmic framework unifies and significantly extends the approaches taken in earlier work on primal-dual projective splitting methods.
KeywordsAsynchronous algorithm Block-iterative algorithm Duality Monotone inclusion Monotone operator Primal-dual algorithm Splitting algorithm
Mathematics Subject Classification47H05 49M27 65K05 90C25
- 4.Attouch, H., Briceño-Arias, L. M., Combettes, P. L.: A strongly convergent primal-dual method for nonoverlapping domain decomposition. Numer. Math. 133, 433–470 (2016)Google Scholar
- 14.Combettes, P.L.: Fejér-monotonicity in convex optimization. In: Floudas, C.A., Pardalos, P.M. (eds.) Encyclopedia of Optimization, vol. 2, pp. 106–114. Springer-Verlag, New York (2001). (Also available in 2nd ed., pp. 1016–1024, 2009)Google Scholar
- 21.Haugazeau, Y.: Sur les Inéquations Variationnelles et la Minimisation de Fonctionnelles Convexes. Thèse, Université de Paris, Paris, France (1968)Google Scholar