Abstract
We study sets defined as the intersection of a rank-one constraint with different choices of linear side constraints. We identify different conditions on the linear side constraints, under which the convex hull of the rank-one set is polyhedral or second-order cone representable. In all these cases, we also show that a linear objective can be optimized in polynomial time over these sets. Towards the application side, we show how these sets relate to commonly occurring substructures of a general quadratically constrained quadratic program. To further illustrate the benefit of studying quadratically constrained quadratic programs from a rank-one perspective, we propose new rank-one formulations for the generalized pooling problem and use our convexification results to obtain several new convex relaxations for the pooling problem. Finally, we run a comprehensive set of computational experiments and show that our convexification results together with discretization significantly help in improving dual bounds for the generalized pooling problem.
Similar content being viewed by others
Notes
With some abuse of terminology, we will be referring to matrices whose rank is at most one by simply rank-one matrices.
Boundedness is equivalent to \(A^1_{ij} > 0\) for all \(i\in [n_1],\ j \in [n_2]\).
References
Sherali, H.D., Adams, W.P.: A Reformulation–Linearization Technique for Solving Discrete and Continuous Nonconvex Problems, vol. 31. Springer Science & Business Media, Berlin (2013)
Lasserre, J.B.: Global optimization with polynomials and the problem of moments. SIAM J. Optim. 11(3), 796–817 (2001)
Ahmadi, A.A., Majumdar, A.: DSOS and SDSOS optimization: LP and SOCP-based alternatives to sum of squares optimization. In 2014 48th Annual Conference on Information Sciences and Systems (CISS), pp. 1–5. IEEE (2014)
Al-Khayyal, F.A., Falk, J.E.: Jointly constrained biconvex programming. Math. Op. Res. 8(2), 273–286 (1983)
Ryoo, H.S., Sahinidis, N.V.: Analysis of bounds for multilinear functions. J. Global Optim. 19(4), 403–424 (2001)
Liberti, L., Pantelides, C.C.: Convex envelopes of monomials of odd degree. J. Global Optim. 25(2), 157–168 (2003)
Benson, H.P.: Concave envelopes of monomial functions over rectangles. Naval Res. Logist. (NRL) 51(4), 467–476 (2004)
Meyer, C.A., Floudas, C.A.: Trilinear monomials with mixed sign domains: Facets of the convex and concave envelopes. J. Global Optim. 29(2), 125–155 (2004)
Belotti, P., Miller, A.J., Namazifar, M.: Valid inequalities and convex hulls for multilinear functions. Electron. Notes Discret. Math. 36, 805–812 (2010)
Bao, X., Khajavirad, A., Sahinidis, N.V., Tawarmalani, M.: Global optimization of nonconvex problems with multilinear intermediates. Math. Program. Comput. 7(1), 1–37 (2015)
Misener, R., Smadbeck, J.B., Floudas, C.A.: Dynamically generated cutting planes for mixed-integer quadratically constrained quadratic programs and their incorporation into glomiqo 2. Optim. Methods Softw. 30(1), 215–249 (2015)
Del Pia, A., Khajavirad, A.: A polyhedral study of binary polynomial programs. Math. Op. Res. 42(2), 389–410 (2016)
Sherali, H.D.: Convex envelopes of multilinear functions over a unit hypercube and over special discrete sets. Acta Mathematica Vietnamica 22(1), 245–270 (1997)
Rikun, A.D.: A convex envelope formula for multilinear functions. J. Global Optim. 10(4), 425–437 (1997). https://doi.org/10.1023/A:1008217604285
Meyer, C.A., Floudas, C.A.: Convex envelopes for edge-concave functions. Math. Program. 103(2), 207–224 (2005)
Tawarmalani, M., Sahinidis, N.V.: Convexification and Global Optimization in Continuous and Mixed-Integer Nonlinear Programming: Theory, Algorithms, Software, and Applications, vol. 65. Springer Science & Business Media, Berlin (2002)
Tawarmalani, M., Richard, J.P.P., Xiong, C.: Explicit convex and concave envelopes through polyhedral subdivisions. Math. Program. 138, 1–47 (2013)
Tuy, H.: Convex Analysis and Global Optimization, vol. 110. Springer, Berlin (2016)
Buchheim, C., D’Ambrosio, C.: Monomial-wise optimal separable underestimators for mixed-integer polynomial optimization. J. Global Optim. 67(4), 759–786 (2017)
Crama, Y., Rodríguez-Heck, E.: A class of valid inequalities for multilinear 0–1 optimization problems. Discret. Optim. 25, 28–47 (2017)
Adams, W., Gupte, A., Xu, Y.: Error bounds for monomial convexification in polynomial optimization. Math. Program. 175, 355–393 (2018)
Gupte, A., Kalinowski, T., Rigterink, F., Waterer, H.: Extended formulations for convex hulls of graphs of bilinear functions. arXiv preprint arXiv:1702.04813 (2017)
Nguyen, T.T., Richard, J.-P.P., Tawarmalani, M.: Deriving the convex hull of a polynomial partitioning set through lifting and projection. Technical report, working paper (2013)
Nguyen, T.T., Tawarmalani, M., Richard, J.-P.P.: Convexification techniques for linear complementarity constraints. In IPCO, volume 6655, pp. 336–348. Springer (2011)
Tawarmalani, M., Richard, J.-P.P., Chung, K.: Strong valid inequalities for orthogonal disjunctions and bilinear covering sets. Math. Program. 124(1), 481–512 (2010)
Gupte, Akshay: Mixed integer bilinear programming with applications to the pooling problem. Ph.D. thesis, Georgia Institute of Technology (2011)
Kocuk, B., Dey, S.S., Sun, X.A.: Matrix minor reformulation and SOCP-based spatial branch-and-cut method for the AC optimal power flow problem. Math. Program. Comput. 10(4), 557–596 (2018)
Rahman, H., Mahajan, A.: Facets of a mixed-integer bilinear covering set with bounds on variables. arXiv preprint arXiv:1707.06712 (2017)
Davarnia, D., Richard, J.-P.P., Tawarmalani, M.: Simultaneous convexification of bilinear functions over polytopes with application to network interdiction. SIAM J. Optim. 27(3), 1801–1833 (2017)
Li, O., Vittal, V.: Convex hull of the quadratic branch AC power flow equations and its application in radial distribution networks. IEEE Trans. Power Syst. 33(1), 839–850 (2018). https://doi.org/10.1109/TPWRS.2017.2712697
Burer S., Kılınç-Karzan, F.: How to convexify the intersection of a second order cone and a nonconvex quadratic. Math. Program. 162(1):393–429 (2017). https://doi.org/10.1007/s10107-016-1045-z
Modaresi, S., Vielma, J.P.: Convex hull of two quadratic or a conic quadratic and a quadratic inequality. Math. Program. 164(1–2), 383–409 (2017)
Dey, S.S., Santana, A., Wang, Y.: New SOCP relaxation and branching rule for bipartite bilinear programs. Optim. Eng. 20, 307–336 (2018)
Burer, S., Letchford, A.N.: On nonconvex quadratic programming with box constraints. SIAM J. Optim. 20(2), 1073–1089 (2009). https://doi.org/10.1137/080729529
Padberg, M.: The boolean quadric polytope: some characteristics, facets and relatives. Math. Program. 45(1–3), 139–172 (1989)
McCormick, G.P.: Computability of global solutions to factorable nonconvex programs: Part–convex underestimating problems. Math. Program. 10(1), 147–175 (1976)
Bonami, P., Günlük, O., Linderoth, J.: Globally solving nonconvex quadratic programming problems with box constraints via integer programming methods. Math. Program. Comput., 10(3), 333–382 (2018). ISSN 1867–2957. https://doi.org/10.1007/s12532-018-0133-x
Bienstock, D., Chen, C., Munoz, G.: Outer-product-free sets for polynomial optimization and oracle-based cuts. arXiv preprint arXiv:1610.04604 (2016)
Haverly, C.A.: Studies of the behavior of recursion for the pooling problem. ACM sigmap Bull. 25, 19–28 (1978)
Gupte, A., Ahmed, Shabbir, D., Santanu S., Cheon, M.S.: Relaxations and discretizations for the pooling problem. J. Global Optim. 67(3), 631–669 (2017). ISSN 1573-2916. https://doi.org/10.1007/s10898-016-0434-4
Ben-Tal, A., Nemirovski, A.: Lectures on modern convex optimization: analysis, algorithms, and engineering applications. SIAM (2001)
Santana, A., Dey, S.S.: The convex hull of a quadratic constraint over a polytope. arXiv preprint arXiv:1812.10160 (2018)
Misener, R., Thompson, J.P., Floudas, C.A.: Apogee: global optimization of standard, generalized, and extended pooling problems via linear and logarithmic partitioning schemes. Computers and Chemical Engineering, 35(5), 876–892, 2011. ISSN 0098-1354. https://doi.org/10.1016/j.compchemeng.2011.01.026. http://www.sciencedirect.com/science/article/pii/S0098135411000366. Selected Papers from ESCAPE-20 (European Symposium of Computer Aided Process Engineering - 20), 6–9 June (2010), Ischia, Italy
Dey, S.S., Gupte, A.: Analysis of MILP techniques for the pooling problem. Oper. Res. 63(2), 412–427 (2015). https://doi.org/10.1287/opre.2015.1357
Alfaki, M., Haugland, D.: A multi-commodity flow formulation for the generalized pooling problem. J. Global Optim. 56(3), 917–937 (2013a)
Alfaki, M., Haugland, D.: Strong formulations for the pooling problem. J. Global Optim. 56(3), 897–916 (2013b)
Haugland, D.: The computational complexity of the pooling problem. J. Global Optim. 64(2), 199–215 (2016)
Luedtke, J., D’Ambrosio, C., Linderoth, J., Schweiger, J.: Strong convex nonlinear relaxations of the pooling problem. arXiv preprint arXiv:1803.02955 (2018)
Haugland, D., Hendrix, E.M.T.: Pooling problems with polynomial-time algorithms. J. Optim. Theory Appl. 170(2), 591–615 (2016)
Boland, N., Kalinowski, T., Rigterink, F.: A polynomially solvable case of the pooling problem. J. Global Optim. 67(3), 621–630 (2017)
Baltean-Lugojan, R., Misener, R.: Piecewise parametric structure in the pooling problem: from sparse strongly-polynomial solutions to NP-hardness. J. Global Optim. 71(4), 655–690 (2018)
Adhya, N., Tawarmalani, M., Sahinidis, N.V.: A Lagrangian approach to the pooling problem. Ind. Eng. Chem. Res. 38(5), 1956–1972 (1999)
Boland, N., Kalinowski, T., Rigterink, F.: New multi-commodity flow formulations for the pooling problem. J. Global Optim. 66(4), 669–710 (2016)
Boland, N., Kalinowski, T., Rigterink, F., Savelsbergh, M.: A special case of the generalized pooling problem arising in the mining industry. Preprint at http://www.optimization-online.org/DB_HTML/2015/07/5025.html (2015)
Marandi, A., Dahl, J., de Klerk, E.: A numerical evaluation of the bounded degree sum-of-squares hierarchy of lasserre, toh, and yang on the pooling problem. Ann. Oper. Res. 265(1), 67–92 (2018)
Misener, R., Floudas, C.A.: GloMIQO 2.2 test suite (ares.tamu.edu/glomiqo/test\_suite.html) (2015)
Acknowledgements
This work was supported by NSF CMMI [Grant Number 1562578]; and the CNPq-Brazil [Grant Number 248941/2013-5]. We thank the referees for their helpful contribution that has significantly improved the quality of the final manuscript.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendices
A Omitted proofs
1.1 Proof of Part (iii) of Proposition 2
Proposition 9
\(\text {conv} \left( {{\mathcal {U}}}^{\text {row}}_{(n_1,n_2)}(l,u)\right) \) is described by the inequalities (17), (18), (19), and (20).
Proof
We will use Fourier-Motzkin elimination to obtain the convex hull in the original space. Now, we will project the t variables in the order \(t_{n_2}\), \(t_{n_2-1}\), \(t_{n_2 -2}\), ..., \(t_1\).
We claim that after projecting out variables \(t_{n_2}, \dots , t_{n_2 - j}\), the resulting system of the inequalities is:
Base case: After projecting out \(t_{n_2}\), we obtain the system:
Note that (68) and (69) imply (67). Therefore the above can be written as:
proving the base case.
Induction step: After projecting \(t_{n_2}\), \(\dots \), \(t_{n_2 -j}\), by the induction hypothesis we have the following system:
Note that a constraint of the form:
where \((T_1, T_2 \dots T_ {n_1}) \in {\mathcal {P}}_{n_1}(\{n_2 - j, \dots , n_2\})\) and \((T'_1, T'_2, \dots T'_ {|{\mathcal {I}}|})\in {\mathcal {P}}_ {|{\mathcal {I}}|} (\{n_2 - j, \dots , n_2\})\) is implied by constraints of the form \(u_{i_2}W_{i_1k} \ge l_{i_1} W_{i_2k} \forall i_2 \in [n_1], i_1 \in {\mathcal {I}}, k \in \{n_2 - j, \dots , n_2\}.\) Thus, after projecting \(t_{n_2 - (j +1)}\), we obtain:
It is straightforward now to see that after all t variables are projected, we obtain the result. \(\square \)
Proposition 10
The inequalities in (17) can be separated in polynomial-time.
Proof
For a given matrix \({{\hat{W}}}\), let us define an index \(j_{\text {row}}\) for each index \(j \in [n_2]\) as
Here we are breaking ties arbitrarily using the smallest index, when necessary. Then, we define a partition \(T_1^*,\dots ,T_{n_1}^*\) of the set \( [n_2]\) as
Let
If \(\theta >1\), then a violated inequality is discovered. Otherwise, we conclude that \({{\hat{W}}}\) satisfies all the inequalities in (17) (by construction, the partition \(T_1^*, \dots , T_{n_1}^*\) corresponds to the inequality with the largest deviation, if one exists). Finally, we note that the complexity of this separation routine is \({\mathcal {O}}(n_1n_2)\) since we need to find the maximum of \(n_1\) numbers \(n_2\) times to construct this partition. \(\square \)
Proposition 11
The inequalities in (18) can be separated in polynomial-time.
Proof
The proof is similar to the proof of Proposition 10. \(\square \)
1.2 Proof of Part (ii) Proposition 3
Proposition 12
\(\text {conv} \left( {{\mathcal {U}}}^{\text {row+}}_{(n_1,n_2)}(l,u, L, U)\right) \) is described by the inequalities (30), (31), (19), and (20).
Proof
We will use Fourier-Motzkin elimination to obtain the convex hull in the original space. Now, we will project the t variables in the order \(t_{n_2}\), \(t_{n_2-1}\), \(t_{n_2 -2}\), ..., \(t_1\).
We claim that after projecting out variables \(t_{n_2}, \dots , t_{n_2 - j}\), the resulting system of the inequalities is:
Base case: After projecting out \(t_{n_2}\), we obtain the system:
Note that (72) and (73) imply (71). Therefore the above can be written as:
proving the base case.
Induction step: After projecting \(t_{n_2}\), \(\dots \), \(t_{n_2 -j}\), by the induction hypothesis we have the following system:
Note that a constraint of the form:
where \((T_0, T_1{, \dots ,} T_ {n_1}) \in {\mathcal {P}}_{n_1+1}(\{n_2 - j, \dots , n_2\})\) and \((T'_0, T'_1, {\dots ,} T'_ {|{\mathcal {I}}|})\in {\mathcal {P}}_ {{|{\mathcal {I}}|+1}} (\{n_2 - j, \dots , n_2\})\) is implied by constraints of the form \(u_{i_2}W_{i_1k} \ge l_{i_1} W_{i_2k} \forall i_2 \in [n_1], i_1 \in {\mathcal {I}}, k \in \{n_2 - j, \dots , n_2\}\), and the fact that \(L \le U\). Thus, after projecting \(t_{n_2 - (j +1)}\), we obtain:
It is straightforward now to see that after all t variables are projected, we obtain the result. \(\square \)
Proposition 13
The inequalities in (30) can be separated in polynomial-time.
Proof
For a given matrix \({{\hat{W}}}\), let us define an index \(j_{\text {row+}}\) for each index \(j \in \{1,\dots ,n_2\}\) as
where \(j_{\text {row}}\) is defined according to (70).
Then, we define a partition \(T_0^*, T_1^*,\dots ,T_{n_1}^*\) of the set \( [n_2]\) as
Let
If \(\theta >1\), then a violated inequality is discovered. Otherwise, we conclude that \({{\hat{W}}}\) satisfies all the inequalities in (30) (by construction, the partition \(T_0^*, T_1^*, \dots , T_m^*\) corresponds to the inequality with the largest deviation, if one exists). Finally, we note that the complexity of this separation routine is again \({\mathcal {O}}(n_1n_2)\). \(\square \)
Proposition 14
The inequalities in (31) can be separated in polynomial-time.
Proof
The proof is similar to the proof of Proposition 13. \(\square \)
1.3 Proof of Theorem 4
The proof of SOC-representability follows due to [42] as the convex hull of a set described by the quadratic constraint \(W_{11} W_{22} = W_{21} W_{12}\) and bound constraints is SOCr.
We next present an example where the convex hull of \({{\mathcal {U}}}^{\text {row}}_{(2,2)}(l,u) \cap {{\mathcal {U}}}^{\text {col}}_{(2,2)}(l,u)\) is not polyhedral.
Proposition 15
A point of the form:
for \(a \in [0,\frac{1}{2}]\) is an extreme point of the set \({{\mathcal {U}}}^{\text {row}}_{(2,2)}(l,u) \cap {{\mathcal {U}}}^{\text {col}}_{(2,2)}(l,u)\) where \(l = (0,1)\) and \(u= (1,1)\).
Proof
Clearly the point is feasible. Also if it is not extreme, then it should be possible to write \((a, \frac{a^2}{1 - a}) \in {\mathbb {R}}^2\) as a convex combination of points of the form \((a_i, \frac{a_i^2}{1 - a_i}) \in {\mathbb {R}}^2\) with \(a_i \in [0,\frac{1}{2}]\setminus \{a\}\). However, since \(f(u) = \frac{u^2}{1 -u}\) is a strictly convex function, this is not possible (this is because, for example, \(f(u) > \frac{a^2}{1 - a} + \left( \frac{1}{(1-a)^2} - 1\right) (u - a) \) for all \(u \ne a\), while \(f(u) = \frac{a^2}{1 - a} + \left( \frac{1}{(1-a)^2} - 1\right) (u - a) \) for \(u = a\)). \(\square \)
B Instance description
In Tables 11, 12, 13, and 14, AIL denotes the subset of arcs \(A \cap (I\times L)\). The sets ALL, ALJ, and AIJ are defined analogously. The column Avg. Size\(x^s\) (resp. Avg. Size\(x^t\)) displays the average size, over all pools \(i\in L\), of the variable matrices \([x^s_{ij}]_{(s,j)}\) (resp. \([x^t_{ij}]_{(i,t)}\)) for each instance.
C Detailed results for discretization restrictions
In Tables 15, 16, 17, 18, we report the primal bounds obtained via discretization for Random instances with discretization levels \(H=1,2,4,5\), respectively (\(H=3\) is reported in Table 2).
Rights and permissions
About this article
Cite this article
Dey, S.S., Kocuk, B. & Santana, A. Convexifications of rank-one-based substructures in QCQPs and applications to the pooling problem. J Glob Optim 77, 227–272 (2020). https://doi.org/10.1007/s10898-019-00844-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10898-019-00844-4