Abstract
Roland and Varadhan (Appl. Numer. Math., 55:215–226, 2005) presented a new idea called “squaring” to improve the convergence of Lemaréchal’s scheme for solving nonlinear fixed-point problems. Varadhan and Roland (Squared extrapolation methods: A new class of simple and efficient numerical schemes for accelerating the convergence of the EM algorithm, Department of Biostatistics Working Paper. Johns Hopkins University, http://www.bepress.com/jhubiostat/paper63, 2004) noted that Lemaréchal’s scheme can be viewed as a member of the class of polynomial extrapolation methods with cycling that uses two fixed-point iterations per cycle. Here we combine these two ideas, cycled extrapolation and squaring, and construct a new class of methods, called squared polynomial methods (SQUAREM), for accelerating the convergence of fixed-point iterations. Our main goal is to evaluate whether the squaring device is effective in improving the rate of convergence of cycled extrapolation methods that use more than two fixed-point iterations per cycle. We study the behavior of the new schemes on an image reconstruction problem for positron emission tomography (PET) using simulated data. Our numerical experiments show the effectiveness of first- and higher-order squared polynomial extrapolation methods in accelerating image reconstruction, and also their relative superiority compared to the classical, “unsquared” vector polynomial methods.
Similar content being viewed by others
References
Berlinet, A., Roland, Ch.: Acceleration schemes with application to the EM algorithm. Comput. Stat. Data Anal. 51, 3689–3702 (2007)
Brezinski, C., Redivo Zaglia, M.: Extrapolation Methods Theory and Practice. North-Holland, Amsterdam (1991)
Brezinski, C.: Vector sequence transformations: methodology and applications to linear systems. J. Comput. Appl. Math. 98, 149–175 (1998)
Brezinski, C.: A classification of quasi-Newton methods. Numer. Algorithms 33, 123–145 (2003)
Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum likelihood from incomplete data via the EM algorithm (with discussion). J.R. Stat. Soc. B 39, 1–38 (1977)
Jbilou, K., Sadok, H.: Vector extrapolation methods. Applications and numerical comparison. J. Comput. Appl. Math. 122, 149–165 (2000)
Lemaréchal, C.: Une méthode de résolution de certains systèmes non linéaires bien posés. C. R. Acad. Sci. Paris Ser. A 272, 747–756 (1971)
Marder, H., Weitzner, B.: A bifurcation problem in E-layer equilibria. Plasma Phys. 12, 435–445 (1970)
R Development Core Team: R: a language and environment for statistical computing. Version 2.3.1., http://www.R-project.org (2006)
Raydan, M., Svaiter, B.F.: Relaxed steepest descent and Cauchy–Barzilai–Borwein method. Comput. Optim. Appl. 21, 155–167 (2002)
Roland, Ch., Varadhan, R.: New iterative schemes for nonlinear fixed point problems, with applications to problems with bifurcations and incomplete-data problems. Appl. Numer. Math. 55, 215–226 (2005)
Sidi, A.: Efficient implementation of minimal polynomial and reduced rank extrapolation methods. J. Comput. Appl. Math. 36, 305–337 (1991)
Varadhan, R., Roland, Ch.: Squared extrapolation methods (SQUAREM): A new class of simple and efficient numerical schemes for accelerating the convergence of the EM algorithm, Department of Biostatistics Working Paper. Johns Hopkins University, http://www.bepress.com/jhubiostat/paper63 (2004)
Vardi, Y., Shepp, L.A., Kaufman, L.: A statistical model for positron emission tomography. J. Amer. Stat. Assoc. 80, 8–37 (1985)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Roland, C., Varadhan, R. & Frangakis, C.E. Squared polynomial extrapolation methods with cycling: an application to the positron emission tomography problem. Numer Algor 44, 159–172 (2007). https://doi.org/10.1007/s11075-007-9094-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11075-007-9094-2