Abstract
We consider two algorithms for orthogonal projection of a point to the standard simplex. These algorithms are fundamentally different; however, they are related to each other by the following fact: When one of them has the maximum run time, the run time of the other is minimal. Some particular domains are presented whose points are projected by the considered algorithms in the minimum and maximum number of iterations. The correctness of the conclusions is confirmed by the numerical experiments independently implemented in the MatLab environment and the Java programming language.
References
M. K. Gavurin and V. N. Malozemov, Extreme Problems with Linear Constraints (Izd. Leningrad. Univ., Leningrad, 1984) [in Russian].
V. F. Demyanov and G. Sh. Tamasyan, “On Direct Methods for Solving Variational Problems,” Trudy Inst. Mat. Mekh. Ural. Otdel. Ross. Akad. Nauk 16 (5), 36–47 (2010).
M. V. Dolgopolik and G. Sh. Tamasyan, “On Equivalence of the Methods of Steepest and Hypodifferential Descents in Some Constrained Optimization Problems,” Izv. Saratov. Univ. Ser. Mat. Mekh. Inform. 14 (4-2), 532–542 (2014).
V. N. Malozemov, “MDMMethod—40 Years,” Vestnik Syktyvkar. Univ. Ser. 1, No. 15, 51–62(2012).
V. N. Malozemov and A. B. Pevnyi, “Fast Algorithm for Projecting a Point on a Simplex,” Vestnik. St.- Peterburg. Univ. Ser. 1, No. 1, 112–113 (1992) [Vestnik St. Petersburg Univ. Math. 25 (1), 62–63 (1992)].
V. N. Malozemov and G. Sh. Tamasyan, “Two Fast Algorithms for Finding the Projection of a Point onto the Standard Simplex,” Zh. Vychisl. Mat. Mat. Fiz. (2016), DOI: 10. 7868/S0044466916050148 (to appear).
G. Sh. Tamasyan, “Methods of Steepest and Hypodifferential Descent in a Problem of Calculus of Variations,” Vychisl. Metody Program. 13 (1), 197–217 (2012).
G. Sh. Tamasyan, “Numerical Methods in Problems of Calculus of Variations for Functionals Depending on Higher Order Derivatives,” in Problems of Mathematical Analysis, Vol. 67 (Tamara Rozhkovskaya, Novosibirsk, 2012), pp. 113–132 [J. Math. Sci. 188 (3), 299–321 (2013)].
G. Sh. Tamasyan and A. A. Chumakov, “Finding the Distance between Ellipsoids,” Diskretn. Anal. Issled. Oper. 21 (3), 87–102 (2014) [J. Appl. Indust. Math. 8 (3), 400–410 (2014)].
A. Yu. Uteshev and M. V. Yashina, “Computation of the Distance from an Ellipsoid to a Linear Surface and a Quadric in Rn,” Dokl. Akad. Nauk 419 (4), 471–474 (2008) [Dokl. Math. 77 (2), 269–272 (2008)].
P. Brucker, “An O(n) Algorithm for Quadratic Knapsack Problems,” Oper. Res. Lett. 3 (3), 163–166 (1984).
A. Causa and F. Raciti, “A PurelyGeometric Approach to the Problem of Computing the Projection of a Point on a Simplex,” J. Optimization Theory Appl. 156 (2), 524–528 (2013).
V. F. Demyanov, F. Giannessi, and G. Sh. Tamasyan, “Variational Control Problems with Constraints via Exact Penalization,” in Variational Analysis and Applications Ed. by F. Giannessi and A. Maugeru (Springer, New York, 2005), pp. 301–342.
V. F. Demyanov and G. Sh. Tamasyan, “Exact Penalty Functions in Isoperimetric Problems,” Optimization 60 (1–2), 153–177 (2011).
V. F. Demyanov and G. Sh. Tamasyan, “Direct Methods in the Parametric Moving Boundary Variational Problem,” Numer. Funct. Anal. Optim. 35 (7–9), 932–961 (2014).
M. V. Dolgopolik and G. Sh. Tamasyan, “Method of Steepest Descent for Two-Dimensional Problems of Calculus of Variations,” in Constructive Nonsmooth Analysis and Related Topics, Ed. by V. F. Demyanov, P. M. Pardalos, and M. Batsyn (Springer, New York, 2014), pp. 101–113.
M. Held, P. Wolfe, and H. P. Crowder, “Validation of the Subgradient Optimization,” Math. Progr. 6 (1), 62–88 (1974).
R. V. Helgason, J. L. Kennington, and H. Lall, “A Polynomially Bounded Algorithm for a Singly Constrained Quadratic Program,” Math. Program. 18 (1), 338–343 (1980).
N. Maculan and G. Galdino de Paula, Jr., “A Linear-Time Median-Finding Algorithm for Projecting a Vector on the Simplex of Rn,” Oper. Res. Lett. 8 (4), 219–222 (1989).
C. Michelot, “A Finite Algorithm for Finding the Projection of a Point onto the Canonical Simplex of Rn,” J. Optim. Theory Appl. 50 (1), 195–200 (1986).
M. Patriksson, “A Survey on the Continuous Nonlinear Resource Allocation Problem,” European J. Oper. Res. 185 (1), 1–46 (2008).
G. Sh. Tamasyan and A. A. Chumakov, “Finding the Distance between the Ellipsoid and the Intersection of a Linear Manifold and Ellipsoid,” in Proceedings of 2015 International Conference “Stability and Control Processes” in Memory of V. I. Zubov (SCP) Joined with 21st International Workshop on Beam Dynamics and Optimization (BDO) (St. Petersburg, Russia, October 5–9, 2015) (IEEE, 2015), pp. 357–360. http://ieeexplore. ieee. org/xpl/articleDetails. jsp?arnumber=7342138
G. Tamasyan and E. Prosolupov, “Orthogonal Projection of a Point onto the Standard Simplex Algorithms Analysis,” in Proceedings of 2015 International Conference “Stability and Control Processes” in Memory of V. I. Zubov (SCP) Joined with 21st International Workshop on Beam Dynamics and Optimization (BDO) (St. Petersburg, Russia, October 5–9, 2015) (IEEE, 2015), pp. 353–356. http://ieeexplore. ieee. org/xpl/articleDetails. jsp?arnumber=7342137
Author information
Authors and Affiliations
Corresponding author
Additional information
Original Russian Text © G.Sh. Tamasyan, E.V. Prosolupov, T.A. Angelov, 2016, published in Diskretnyi Analiz i Issledovanie Operatsii, 2016, Vol. 23, No. 2, pp. 100–123.
Rights and permissions
About this article
Cite this article
Tamasyan, G.S., Prosolupov, E.V. & Angelov, T.A. Comparative study of two fast algorithms for projecting a point to the standard simplex. J. Appl. Ind. Math. 10, 288–301 (2016). https://doi.org/10.1134/S1990478916020137
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1134/S1990478916020137