Abstract
Given two arbitrary closed sets in Euclidean space, to guarantee that the method of alternating projections converges locally at linear rate to a point in the intersection, a simple transversality assumption suffices. Exact projection onto nonconvex sets is typically intractable, but we show that computationally cheap inexact projections may suffice instead. In particular, if one set is defined by sufficiently regular smooth constraints, then projecting onto the approximation obtained by linearizing those constraints around the current iterate suffices. On the other hand, if one set is a smooth manifold represented through local coordinates, then the approximate projection resulting from linearizing the coordinate system around the preceding iterate on the manifold also suffices.
Similar content being viewed by others
References
Bauschke, H.H., Borwein, J.M.: On the convergence of von Neumann’s alternating projection algorithm for two sets. Set-Valued Anal. 1, 185–212 (1993)
Drusvyatskiy, D., Ioffe, A.D., Lewis, A.S.: Transversality and alternating projections for nonconvex sets. Found. Comput. Math. 15, 1637–1651 (2015)
Facchinei, F., Pang, J.: Finite-Dimensional Variational Inequalities and Complementarity Problems. Springer Series in Operations Research and Financial Engineering. Springer, New York (2003)
Kruger, A.Y., Thao, N.H.: Regularity of collections of sets and convergence of inexact alternating projections. J. Convex Anal. 23, 823–847 (2016)
Lewis, A.S., Luke, D.R., Malick, J.: Local linear convergence for alternating and averaged nonconvex projections. Found. Comput. Math. 9, 485–513 (2009)
Noll, D., Rondepierre, A.: On local convergence of the method of alternating projections. Found. Comput. Math. 16, 425–455 (2016)
Poliquin, R.A., Rockafellar, R.T.: Amenable functions in optimization. In: Nonsmooth Optimization: Methods and Applicatio (Erice, 1991), pp 338–353. Gordon and Breach, Montreux (1992)
Poliquin, R.A., Rockafellar, R.T.: Prox-regular functions in variational analysis. Trans. Am. Math. Soc. 348, 1805–1838 (1996)
Poliquin, R.A., Rockafellar, R.T., Thibault, L.: Local differentiability of distance functions. Trans. Am. Math. Soc. 352, 5231–5249 (2000)
Rockafellar, R.T., Wets, R.J.-B.: Variational Analysis. Grundlehren der mathematischen Wissenschaften, vol. 317. Springer, Berlin Heidelberg (1998)
Yen, N.D.: Lipschitz continuity of solutions of variational inequalities with aparametric polyhedral constraint. Math. Oper. Res. 20, 695–708 (1995)
Funding
D. Drusvyatskiy: Research supported in part by AFOSR YIP award FA9550-15-1-0237 and by National Science Foundation Grants DMS 1651851 and CCF 1740551.
A.S. Lewis: Research supported in part by National Science Foundation Grant DMS-1613996.
Author information
Authors and Affiliations
Corresponding author
Additional information
Dedicated to our friend, colleague, and inspiration, Alex Ioffe, on the occasion of his 80th birthday.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Drusvyatskiy, D., Lewis, A.S. Local Linear Convergence for Inexact Alternating Projections on Nonconvex Sets. Vietnam J. Math. 47, 669–681 (2019). https://doi.org/10.1007/s10013-019-00357-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10013-019-00357-3