Abstract
We extend the Calabi-Polyak theorem on the convexity of joint numerical range from three to any number of matrices on condition that each of them is a linear combination of three matrices having a positive definite linear combination. Our new result covers the fundamental Dines’s theorem. As applications, the further extended Yuan’s lemma and S-lemma are presented. The former is used to establish a more generalized assumption under which the standard second-order necessary optimality condition holds at the local minimizer in nonlinear programming, and the latter reveals hidden convexity of the homogeneous quadratic optimization problem with two bilateral quadratic constraints and its fractional extension.
Similar content being viewed by others
Data availability
The manuscript has no associated data.
References
Anitescu, M.: Degenerate nonlinear programming with a quadratic growth condition. SIAM J. Optim. 10, 1116–1135 (2000)
Baccari, A., Trad, A.: On the classical necessary second-order optimality conditions in the presence of equality and inequality constraints. SIAM J. Optim. 15, 394–408 (2004)
Beck, A., Ben-Tal, A., Teboulle, M.: Finding a global optimal solution for a quadratically constrained fractional quadratic problem with applications to the regularized total least squares. SIAM J. Matrix Anal. Appl. 28, 425–445 (2006)
Bertsimas, D., Tsitsiklis, J.: Introduction to Linear Optimization. Athena Scientific, MA, USA (1998)
Bonnans, J.F., Shapiro, A.: Perturbation Analysis of Optimization Problems. Springer, New York, NY (2000)
Brickman, L.: On the field of values of a matrix. Proc. Am. Math. Soc. 12, 61–66 (1961)
Calabi, E.: Linear systems of real quadratic forms. II. Proc. Am. Math. Soc. 84(3), 331–334 (1982)
Chen, X., Yuan, Y.-X.: A note on quadratic forms. Math. Program. 86, 187–197 (1999)
Dines, L.L.: On the mapping of quadratic forms. Bull. Am. Math. Soc. 47, 494–498 (1941)
Fradkov, A.L.: Duality theorems for certain nonconvex extremal problems. Sib. Math. J. 14, 247–264 (1973)
Gauvin, J.: A necessary and sufficient regularity condition to have bounded multipliers in nonconvex programming. Math. Program. 12, 136–138 (1977)
Haeser, G.: An extension of Yuan’s lemma and its applications in optimization. J. Optim. Theory Appl. 174, 641–649 (2017)
Jeyakumar, V., Lee, G.M., Li, G.Y.: Alternative theorems for quadratic inequality systems and global quadratic optimization. SIAM J. Optim. 20, 983–1001 (2009)
Mangasarian, O., Fromovitz, S.: The Fritz John necessary optimality conditions in the presence of equality and inequality constraints. J. Math. Anal. Appl. 17, 37–47 (1967)
Martínez-Legaz, J.E.: On Brickman’s theorem. J. Convex Anal. 12, 139–143 (2005)
Nguyen, V.B., Nguyen, T.N., Sheu, R.L.: Strong duality in minimizing a quadratic form subject to two homogeneous quadratic inequalities over the unit sphere. J. Global Optim. 76, 121–135 (2020)
Nguyen, V.B., Sheu, R.L., Xia, Y.: An SDP approach for quadratic fractional problems with a two-sided quadratic constraint. Optim. Methods Software 31(4), 701–719 (2016)
Pólik, I., Terlaky, T.: A survey of the S-lemma. SIAM Rev. 49, 371–418 (2007)
Polyak, B.: Convexity of quadratic transformations and its use in control and optimization. J. Optim. Theory Appl. 99, 553–583 (1998)
Pong, T.K., Wolkowicz, H.: The generalized trust region subproblem. Comput. Optim. Appl. 58, 273–322 (2014)
Rockafellar, R.T.: Convex Analysis. Princeton University Press, Princeton, New Jersey (1972)
Wang, S., Xia, Y.: Strong duality for generalized trust region subproblem: S-lemma with interval bounds. Optim. Lett. 9, 1063–1073 (2015)
Xia, Y.: A survey of hidden convex optimization. J. Oper. Res. Soc. China 8, 1–28 (2020)
Yakubovich, V.A.: S-procedure in nonlinear control theory. Vestnik Leningrad University 1, 62–77 (1971)
Yuan, Y.-X.: On a subproblem of trust region algorithms for constrained optimization. Math. Program. 47, 53–63 (1990)
Funding
This research was supported by the Beijing Natural Science Foundation under grant Z180005, and the National Natural Science Foundation of China under grants 12171021 and 11822103.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Song, M., Xia, Y. Calabi-Polyak convexity theorem, Yuan’s lemma and S-lemma: extensions and applications. J Glob Optim 85, 743–756 (2023). https://doi.org/10.1007/s10898-022-01225-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10898-022-01225-0
Keywords
- Calabi-Polyak theorem
- Yuan’s lemma
- S-lemma
- Second-order optimality condition
- Quadratic optimization
- Hidden convexity