Abstract
We investigate two greedy strategies for finding an approximation to the minimum of a convex function E defined on a Hilbert space H. We prove convergence rates for these algorithms under suitable conditions on the objective function E. These conditions involve the behavior of the modulus of smoothness and the modulus of uniform convexity of E.
Similar content being viewed by others
Notes
Here and later we will use the abbreviation (co) if an algorithm is used for convex optimization.
References
Borwein, J., Guiro, A., Hajek, P., Vanderwerff, J.: Uniformly convex functions on Banach Spaces. Proc. Am. Math. Soc. 137, 1081–1091 (2009)
Boyd, S., Vandenberghe, L.: Convex Optimization. Cambridge University Press, Cambridge (2009)
Candes, E., Tao, T.: Decoding by linear programming. IEEE Trans. Inf. Theory 51(12), 4203–4215 (2005)
DeVore, R., Temlyakov, V.: Some remarks on greedy algorithms. Adv. Comput. Math. 5, 173–187 (1996)
DeVore, R., Temlyakov, V.: Convex optimization on Banach spaces. Found. Comput. Math (to appear)
Donoho, D.: Compressed sensing. IEEE Trans. Inf. Theory 52(4), 1289–1306 (2006)
Mallat, S., Zhang, Z.: Matching pursuits with time-frequency dictionaries. IEEE Trans. Signal Process. 41(12), 3397–3415 (1993)
Juditsky, A., Nesterov, Y.: Deterministic and stochastic primal-dual subgradient algorithms for uniformly convex minimization. Stoch. Syst. 4, 1–37 (2014)
Shalev-Shwartz, S., Srebro, N., Zhang, T.: Trading accuracy for sparsity in optimization problems with sparsity constraints. SIAM J. Optim. 20, 2807–2832 (2010)
Temlyakov, V.: Greedy expansions in convex optimization. Proc. Steklov Inst. Math. 284(1), 244–262 (2014)
Temlyakov, V.: Greedy approximation in convex optimization. Constr. Approx. 41(2), 269–296 (2015)
Temlyakov, V.: Chebyshev Greedy Algorithm in Convex Optimization. arXiv:1312.1244v1
Temlyakov, V.: Greedy Approximation, Cambridge Monographs on Applied and Computational Mathematics. Cambridge University Press, Cambridge (2011)
Tewari, A., Ravikumar, P., Dhillon, I.: Greedy algorithms for structurally constrained high dimensional problems. Adv. Neural Inform. Process. Syst. (NIPS) 24, 882–890 (2011)
Zalinescu, C.: Convex Analysis in General Vector Spaces. World Scientific Publishing Co., Inc., River Edge (2002)
Zhang, T.: Sequential greedy approximation for certain convex optimization problems. IEEE Trans. Inform. Theory 49(3), 682–691 (2003)
Zhang, T.: Sparse recovery with orthogonal matching pursuit under RIP. IEEE Trans. Inform. Theory 57, 5215–6221 (2011)
Author information
Authors and Affiliations
Corresponding author
Additional information
This research was supported by the Office of Naval Research Contract ONR N00014-11-1-0712, by the NSF Grant DMS 1521067, and by the Bulgarian Science Fund Grant DFNI-T01/0001.
Rights and permissions
About this article
Cite this article
Nguyen, H., Petrova, G. Greedy Strategies for Convex Optimization. Calcolo 54, 207–224 (2017). https://doi.org/10.1007/s10092-016-0183-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10092-016-0183-2