Abstract
We present a method for finding common points of finitely many closed convex sets in Euclidean space. The Bregman extension of the classical method of cyclic orthogonal projections employs nonorthogonal projections induced by a convex Bregman function, whereas the Bauschke and Borwein method uses Bregman/Legendre functions. Our method works with generalized Bregman functions (B-functions) and inexact projections, which are easier to compute than the exact ones employed in other methods. We also discuss subgradient algorithms with Bregman projections.
Similar content being viewed by others
References
Bregman, L. M., Finding a Common Point of Convex Sets by the Method of Successive Projections, Doklady Akademii Nauk SSSR, Vol. 162, pp. 487–490, 1965 (Russian); English Translation in Soviet Mathematics Doklady, Vol. 6, pp. 688–692, 1965.
Censor, Y., and Lent, A., An Iterative Row-Action Method for Interval Convex Programming, Journal of Optimization Theory and Applications, Vol. 34, pp. 321–353, 1981.
Censor, Y., and Reich, S., Iterations of Paracontractions and Firmly Nonexpansive Operators with Applications to Feasibility and Optimization, Optimization, Vol. 37, pp. 323–339, 1996.
Bauschke, H. H., and Borwein, J. M., Legendre Functions and the Method of Random Bregman Projections, Journal of Convex Analysis, Vol. 4, pp. 27–67, 1997.
Corvellec, J. N., and FlÅm, S. D., Nonconvex Feasibility Problems and Proximal Point Methods, Working Paper, Department of Economics, University of Bergen, Bergen, Norway, 1996.
Kiwiel, K. C., Free-Steering Relaxation Methods for Problems with Strictly Convex Costs and Linear Constraints, Mathematics of Operations Research, Vol. 22, pp. 326–349, 1997.
Censor, Y., Iusem, A. N., and Zenios, S. A., An Interior-Point Method with Bregman Functions for the Variational Inequality Problem with Paramonotone Operators, Technical Report, Department of mathematics and Computer Science, University of Haifa, Haifa, Israel, 1994.
Chen, G., and Teboulle, M., Convergence Analysis of a Proximal-Like Minimization Algorithm Using Bregman Functions, SIAM Journal on Optimization, Vol. 3, pp. 538–543, 1993.
Eckstein, J., Nonlinear Proximal Point Algorithms Using Bregman Functions, with Applications to Convex Programming, Mathematics of Operations Research, Vol. 18, pp. 202–226, 1993.
Kiwiel, K. C., Proximal Minimization Methods with Generalized Bregman Functions, SIAM Journal on Control and Optimization, Vol. 35, pp. 1142–1168, 1997.
Alber, Ya., I., and Butnariu, D., Convergence of Bregman-Projection Methods for Solving Consistent Convex Feasibility Problems in Reflexive Banach Spaces, Technical Report, Department of Mathematics, University of Haifa, Haifa, Israel, 1994.
Bauschke, H. H., and Borwein, J. M., On Projection Algorithms for Solving Convex Feasibility Problems, SIAM Review, Vol. 38, pp. 367–426, 1996.
Censor, Y., and Elfving, T., A Multiprojection Algorithm Using Bregman Projections in a Product Space, Numerical Algorithms, Vol. 8, pp. 221–239, 1994.
Kiwiel, K. C., Block-Iterative Surrogate Projection Methods for Convex Feasibility Problems, Linear Algebra and Its Applications, Vol. 215, pp. 225–260, 1995.
Kiwiel, K. C., A Subgradient Method with Bregman Projections for Convex Constrained Nondifferentiable Minimization, Technical Report, Systems Research Institute, Warsaw, Poland, 1996.
Rockafellar, R. T., Convex Analysis, Princeton University Press, Princeton, New Jersey, 1970.
Elsner, L., Koltracht, I., and Neumann, M., Convergence of Sequential and Asynchronous Nonlinear Paracontractions, Numerische Mathematik, Vol. 62, pp. 305–319, 1992.
FlÅm, S. D., and Zowe, J., Relaxed Outer Projections, Weighted Averages, and Convex Feasibility, BIT, Vol. 30, pp. 289–300, 1990.
Tseng, P., On the Convergence of the Products of Firmly Nonexpansive Maps, SIAM Journal on Optimization, Vol. 2, pp. 425–434, 1992.
Polyak, B. T., Introduction to Optimization, Nauka, Moscow, USSR, 1983; English Translation by Optimization Software, New York, New York, 1987.
Eckstein, J., Approximate Iterations in Bregman-Function-Based Proximal Algorithms, Research Report RRR 12–96, RUTCOR, Rutgers University, New Brunswick, New Jersey, 1996.
Kiwiel, K. C., and Łopuch, B., Surrogate Projection Methods for Finding Fixed Points of Firmly Nonexpansive Mappings, SIAM Journal on Optimization (to appear).
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Kiwiel, K.C. Generalized Bregman Projections in Convex Feasibility Problems. Journal of Optimization Theory and Applications 96, 139–157 (1998). https://doi.org/10.1023/A:1022619318462
Issue Date:
DOI: https://doi.org/10.1023/A:1022619318462