Journal of Fourier Analysis and Applications

, Volume 15, Issue 4, pp 431–436

A Note on the Behavior of the Randomized Kaczmarz Algorithm of Strohmer and Vershynin

Article

DOI: 10.1007/s00041-009-9077-x

Cite this article as:
Censor, Y., Herman, G.T. & Jiang, M. J Fourier Anal Appl (2009) 15: 431. doi:10.1007/s00041-009-9077-x

Abstract

In a recent paper by Strohmer and Vershynin (J. Fourier Anal. Appl. 15:262–278, 2009) a “randomized Kaczmarz algorithm” is proposed for solving consistent systems of linear equations {〈ai,x〉=bi}i=1m. In that algorithm the next equation to be used in an iterative Kaczmarz process is selected with a probability proportional to ‖ai2. The paper illustrates the superiority of this selection method for the reconstruction of a bandlimited function from its nonuniformly spaced sampling values.

In this note we point out that the reported success of the algorithm of Strohmer and Vershynin in their numerical simulation depends on the specific choices that are made in translating the underlying problem, whose geometrical nature is “find a common point of a set of hyperplanes”, into a system of algebraic equations. If this translation is carefully done, as in the numerical simulation provided by Strohmer and Vershynin for the reconstruction of a bandlimited function from its nonuniformly spaced sampling values, then indeed good performance may result. However, there will always be legitimate algebraic representations of the underlying problem (so that the set of solutions of the system of algebraic equations is exactly the set of points in the intersection of the hyperplanes), for which the selection method of Strohmer and Vershynin will perform in an inferior manner.

Keywords

Kaczmarz algorithmProjection methodRate of convergence

Mathematics Subject Classification (2000)

15A0615A2965F10

Copyright information

© Birkhäuser Boston 2009

Authors and Affiliations

  1. 1.Department of MathematicsUniversity of HaifaHaifaIsrael
  2. 2.Department of Computer Science, The Graduate CenterCity University of New YorkNew YorkUSA
  3. 3.LMAM, School of Mathematical SciencesPeking UniversityBeijingP.R. China