Skip to main content

A Tseng’s Type Penalty Scheme for Solving Inclusion Problems Involving Linearly Composed and Parallel-Sum Type Monotone Operators

Vietnam Journal of Mathematics volume 42, pages 451–465 (2014)Cite this article

Abstract

In this paper we consider the inclusion problem involving a maximally monotone operator, a monotone and Lipschitz continuous operator, linear compositions of parallel-sum type monotone operators as well as the normal cone to the set of zeros of another monotone and Lipschitz continuous operator. We propose a forward–backward–forward type algorithm for solving it that assumes an individual evaluation of each operator. Weak ergodic convergence of the sequence of iterates generated by the algorithmic scheme is guaranteed under a condition formulated in terms of the Fitzpatrick function associated to one of the monotone and Lipschitz continuous operators. We also discuss how the proposed penalty scheme can be applied to convex minimization problems and present some numerical experiments in TV-based image inpainting.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

USD 39.95

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Fig. 1
Fig. 2

References

  1. Attouch, H., Czarnecki, M.-O.: Asymptotic behavior of coupled dynamical systems with multiscale aspects. J. Differ. Equ. 248, 1315–1344 (2010)

    Article  MathSciNet  MATH  Google Scholar 

  2. Attouch, H., Czarnecki, M.-O., Peypouquet, J.: Prox-penalization and splitting methods for constrained variational problems. SIAM J. Optim. 21, 149–173 (2011)

    Article  MathSciNet  MATH  Google Scholar 

  3. Attouch, H., Czarnecki, M.-O., Peypouquet, J.: Coupling forward-backward with penalty schemes and parallel splitting for constrained variational inequalities. SIAM J. Optim. 21, 1251–1274 (2011)

    Article  MathSciNet  MATH  Google Scholar 

  4. Bauschke, H.H., Combettes, P.L.: Convex Analysis and Monotone Operator Theory in Hilbert Spaces. CMS Books in Mathematics. Springer, New York (2011)

    Book  MATH  Google Scholar 

  5. Bauschke, H.H., McLaren, D.A., Sendov, H.S.: Fitzpatrick functions: inequalities, examples and remarks on a problem by S. Fitzpatrick. J. Convex Anal. 13, 499–523 (2006)

    MathSciNet  MATH  Google Scholar 

  6. Borwein, J.M.: Maximal monotonicity via convex analysis. J. Convex Anal. 13, 561–586 (2006)

    MathSciNet  MATH  Google Scholar 

  7. Borwein, J.M., Vanderwerff, J.D.: Convex Functions: Constructions, Characterizations and Counterexamples. Cambridge University Press, Cambridge (2010)

    Book  Google Scholar 

  8. Boţ, R.I.: Conjugate Duality in Convex Optimization. Lecture Notes in Economics and Mathematical Systems, vol. 637. Springer, Berlin (2010)

    MATH  Google Scholar 

  9. Boţ, R.I., Csetnek, E.R.: An application of the bivariate inf-convolution formula to enlargements of monotone operators. Set-Valued Anal. 16, 983–997 (2008)

    Article  MathSciNet  MATH  Google Scholar 

  10. Boţ, R.I., Csetnek, E.R.: Forward-Backward and Tseng’s type penalty schemes for monotone inclusion problems. arXiv:1306.0352 (2013)

  11. Boţ, R.I., Hendrich, C.: Convergence analysis for a primal-dual monotone + skew splitting algorithm with applications to total variation minimization. arXiv:1211.1706v1 [math.OC] (2012)

  12. Burachik, R.S., Svaiter, B.F.: Maximal monotone operators, convex functions and a special family of enlargements. Set-Valued Anal. 10, 297–316 (2002)

    Article  MathSciNet  MATH  Google Scholar 

  13. Chambolle, A.: An algorithm for total variation minimization and applications. J. Math. Imaging Vis. 20, 89–97 (2004)

    Article  MathSciNet  Google Scholar 

  14. Combettes, P.L., Pesquet, J.-C.: Primal-dual splitting algorithm for solving inclusions with mixtures of composite, Lipschitzian, and parallel-sum type monotone operators. Set-Valued Var. Anal. 20, 307–330 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  15. Ekeland, I., Temam, R.: Convex Analysis and Variational Problems. North-Holland, Amsterdam (1976)

    MATH  Google Scholar 

  16. Fitzpatrick, S.: Representing monotone operators by convex functions. In: Workshop/Miniconference on Functional Analysis and Optimization, Canberra 1988. Proceedings of the Centre for Mathematical Analysis, vol. 20, pp. 59–65. Australian National University, Canberra (1988)

    Google Scholar 

  17. Noun, N., Peypouquet, J.: Forward–backward penalty scheme for constrained convex minimization without inf-compactness. J. Optim. Theory Appl. 158, 787–795 (2013)

    Article  MathSciNet  MATH  Google Scholar 

  18. Peypouquet, J.: Coupling the gradient method with a general exterior penalization scheme for convex minimization. J. Optim. Theory Appl. 153, 123–138 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  19. Rockafellar, R.T.: On the maximal monotonicity of subdifferential mappings. Pac. J. Math. 33, 209–216 (1970)

    Article  MathSciNet  MATH  Google Scholar 

  20. Rockafellar, R.T.: On the maximality of sums of nonlinear monotone operators. Trans. Am. Math. Soc. 149, 75–88 (1970)

    Article  MathSciNet  MATH  Google Scholar 

  21. Simons, S.: From Hahn–Banach to Monotonicity. Springer, Berlin (2008)

    MATH  Google Scholar 

  22. Zălinescu, C.: Convex Analysis in General Vector Spaces. World Scientific, Singapore (2002)

    Book  MATH  Google Scholar 

Download references

Acknowledgements

The authors are thankful to the anonymous reviewers for their recommendations which improved the quality of the paper.

Author information

Authors and Affiliations

  1. Faculty of Mathematics, University of Vienna, Oskar-Morgenstern-Platz 1, 1090, Vienna, Austria

    Radu Ioan Boţ & Ernö Robert Csetnek

Authors
  1. Radu Ioan Boţ
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ernö Robert Csetnek
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Radu Ioan Boţ.

Additional information

Dedicated to Professor Boris Mordukhovich on the occasion of his 65th birthday.

Research partially supported by DFG (German Research Foundation), project BO 2516/4-1.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Boţ, R.I., Csetnek, E.R. A Tseng’s Type Penalty Scheme for Solving Inclusion Problems Involving Linearly Composed and Parallel-Sum Type Monotone Operators. Vietnam J. Math. 42, 451–465 (2014). https://doi.org/10.1007/s10013-013-0050-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10013-013-0050-2

Keywords

  • Maximally monotone operator
  • Fitzpatrick function
  • Resolvent
  • Lipschitz continuous operator
  • Parallel-sum
  • Forward–backward–forward algorithm
  • Subdifferential
  • Fenchel conjugate
  • Infimal-convolution
  • Convex minimization problem

Mathematics Subject Classification (2010)

  • 47H05
  • 65K05
  • 90C25