Skip to main content
Log in

Comparative study of two fast algorithms for projecting a point to the standard simplex

Journal of Applied and Industrial Mathematics Aims and scope Submit manuscript

Abstract

We consider two algorithms for orthogonal projection of a point to the standard simplex. These algorithms are fundamentally different; however, they are related to each other by the following fact: When one of them has the maximum run time, the run time of the other is minimal. Some particular domains are presented whose points are projected by the considered algorithms in the minimum and maximum number of iterations. The correctness of the conclusions is confirmed by the numerical experiments independently implemented in the MatLab environment and the Java programming language.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price includes VAT (Canada)

Instant access to the full article PDF.

Institutional subscriptions

References

  1. M. K. Gavurin and V. N. Malozemov, Extreme Problems with Linear Constraints (Izd. Leningrad. Univ., Leningrad, 1984) [in Russian].

    MATH  Google Scholar 

  2. V. F. Demyanov and G. Sh. Tamasyan, “On Direct Methods for Solving Variational Problems,” Trudy Inst. Mat. Mekh. Ural. Otdel. Ross. Akad. Nauk 16 (5), 36–47 (2010).

    Google Scholar 

  3. M. V. Dolgopolik and G. Sh. Tamasyan, “On Equivalence of the Methods of Steepest and Hypodifferential Descents in Some Constrained Optimization Problems,” Izv. Saratov. Univ. Ser. Mat. Mekh. Inform. 14 (4-2), 532–542 (2014).

    MATH  Google Scholar 

  4. V. N. Malozemov, “MDMMethod—40 Years,” Vestnik Syktyvkar. Univ. Ser. 1, No. 15, 51–62(2012).

    Google Scholar 

  5. V. N. Malozemov and A. B. Pevnyi, “Fast Algorithm for Projecting a Point on a Simplex,” Vestnik. St.- Peterburg. Univ. Ser. 1, No. 1, 112–113 (1992) [Vestnik St. Petersburg Univ. Math. 25 (1), 62–63 (1992)].

    MathSciNet  Google Scholar 

  6. V. N. Malozemov and G. Sh. Tamasyan, “Two Fast Algorithms for Finding the Projection of a Point onto the Standard Simplex,” Zh. Vychisl. Mat. Mat. Fiz. (2016), DOI: 10. 7868/S0044466916050148 (to appear).

    Google Scholar 

  7. G. Sh. Tamasyan, “Methods of Steepest and Hypodifferential Descent in a Problem of Calculus of Variations,” Vychisl. Metody Program. 13 (1), 197–217 (2012).

    Google Scholar 

  8. G. Sh. Tamasyan, “Numerical Methods in Problems of Calculus of Variations for Functionals Depending on Higher Order Derivatives,” in Problems of Mathematical Analysis, Vol. 67 (Tamara Rozhkovskaya, Novosibirsk, 2012), pp. 113–132 [J. Math. Sci. 188 (3), 299–321 (2013)].

    Google Scholar 

  9. G. Sh. Tamasyan and A. A. Chumakov, “Finding the Distance between Ellipsoids,” Diskretn. Anal. Issled. Oper. 21 (3), 87–102 (2014) [J. Appl. Indust. Math. 8 (3), 400–410 (2014)].

    MathSciNet  MATH  Google Scholar 

  10. A. Yu. Uteshev and M. V. Yashina, “Computation of the Distance from an Ellipsoid to a Linear Surface and a Quadric in Rn,” Dokl. Akad. Nauk 419 (4), 471–474 (2008) [Dokl. Math. 77 (2), 269–272 (2008)].

    MathSciNet  MATH  Google Scholar 

  11. P. Brucker, “An O(n) Algorithm for Quadratic Knapsack Problems,” Oper. Res. Lett. 3 (3), 163–166 (1984).

    Article  MathSciNet  MATH  Google Scholar 

  12. A. Causa and F. Raciti, “A PurelyGeometric Approach to the Problem of Computing the Projection of a Point on a Simplex,” J. Optimization Theory Appl. 156 (2), 524–528 (2013).

    Article  MathSciNet  MATH  Google Scholar 

  13. V. F. Demyanov, F. Giannessi, and G. Sh. Tamasyan, “Variational Control Problems with Constraints via Exact Penalization,” in Variational Analysis and Applications Ed. by F. Giannessi and A. Maugeru (Springer, New York, 2005), pp. 301–342.

    Chapter  Google Scholar 

  14. V. F. Demyanov and G. Sh. Tamasyan, “Exact Penalty Functions in Isoperimetric Problems,” Optimization 60 (1–2), 153–177 (2011).

    Article  MathSciNet  MATH  Google Scholar 

  15. V. F. Demyanov and G. Sh. Tamasyan, “Direct Methods in the Parametric Moving Boundary Variational Problem,” Numer. Funct. Anal. Optim. 35 (7–9), 932–961 (2014).

    Article  MathSciNet  MATH  Google Scholar 

  16. M. V. Dolgopolik and G. Sh. Tamasyan, “Method of Steepest Descent for Two-Dimensional Problems of Calculus of Variations,” in Constructive Nonsmooth Analysis and Related Topics, Ed. by V. F. Demyanov, P. M. Pardalos, and M. Batsyn (Springer, New York, 2014), pp. 101–113.

    Chapter  Google Scholar 

  17. M. Held, P. Wolfe, and H. P. Crowder, “Validation of the Subgradient Optimization,” Math. Progr. 6 (1), 62–88 (1974).

    Article  MathSciNet  MATH  Google Scholar 

  18. R. V. Helgason, J. L. Kennington, and H. Lall, “A Polynomially Bounded Algorithm for a Singly Constrained Quadratic Program,” Math. Program. 18 (1), 338–343 (1980).

    Article  MathSciNet  MATH  Google Scholar 

  19. N. Maculan and G. Galdino de Paula, Jr., “A Linear-Time Median-Finding Algorithm for Projecting a Vector on the Simplex of Rn,” Oper. Res. Lett. 8 (4), 219–222 (1989).

    Article  MathSciNet  MATH  Google Scholar 

  20. C. Michelot, “A Finite Algorithm for Finding the Projection of a Point onto the Canonical Simplex of Rn,” J. Optim. Theory Appl. 50 (1), 195–200 (1986).

    Article  MathSciNet  MATH  Google Scholar 

  21. M. Patriksson, “A Survey on the Continuous Nonlinear Resource Allocation Problem,” European J. Oper. Res. 185 (1), 1–46 (2008).

    Article  MathSciNet  MATH  Google Scholar 

  22. G. Sh. Tamasyan and A. A. Chumakov, “Finding the Distance between the Ellipsoid and the Intersection of a Linear Manifold and Ellipsoid,” in Proceedings of 2015 International Conference “Stability and Control Processes” in Memory of V. I. Zubov (SCP) Joined with 21st International Workshop on Beam Dynamics and Optimization (BDO) (St. Petersburg, Russia, October 5–9, 2015) (IEEE, 2015), pp. 357–360. http://ieeexplore. ieee. org/xpl/articleDetails. jsp?arnumber=7342138

    Google Scholar 

  23. G. Tamasyan and E. Prosolupov, “Orthogonal Projection of a Point onto the Standard Simplex Algorithms Analysis,” in Proceedings of 2015 International Conference “Stability and Control Processes” in Memory of V. I. Zubov (SCP) Joined with 21st International Workshop on Beam Dynamics and Optimization (BDO) (St. Petersburg, Russia, October 5–9, 2015) (IEEE, 2015), pp. 353–356. http://ieeexplore. ieee. org/xpl/articleDetails. jsp?arnumber=7342137

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to G. Sh. Tamasyan.

Additional information

Original Russian Text © G.Sh. Tamasyan, E.V. Prosolupov, T.A. Angelov, 2016, published in Diskretnyi Analiz i Issledovanie Operatsii, 2016, Vol. 23, No. 2, pp. 100–123.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tamasyan, G.S., Prosolupov, E.V. & Angelov, T.A. Comparative study of two fast algorithms for projecting a point to the standard simplex. J. Appl. Ind. Math. 10, 288–301 (2016). https://doi.org/10.1134/S1990478916020137

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S1990478916020137

Keywords

Navigation