Abstract
We study a variant of the weighted consecutive ones property problem. Here, a 0/1-matrix is given with a cost associated to each of its entries and one has to find a minimum cost set of zero entries to be turned to ones in order to make the matrix have the consecutive ones property for rows. We investigate polyhedral and combinatorial properties of the problem and we exploit them in a branch-and-cut algorithm. In particular, we devise preprocessing rules and investigate variants of “local cuts”. We test the resulting algorithm on a number of instances, and we report on these computational experiments.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction
A 0/1-matrix A has the strict consecutive ones property for rows (strict C1P) if the ones in each row appear sequentially. A matrix A has the consecutive ones property for rows (C1P) if the columns of A can be permuted such that the resulting matrix has the strict consecutive ones property for rows (see Fulkerson and Gross [16]). If A has the (strict) C1P, we say (somewhat abusing language) that A is (strictly) C1P. Therefore, being C1P is a property of 0/1-matrices that is preserved under row and column permutations.
The problem of checking whether a given 0/1-matrix is C1P can be solved in linear time using the algorithm of Booth and Lueker [5]. The situation is quite different for optimizing over the set of all C1P matrices of a given size. Indeed, the Weighted C1P Problem (WC1P), i.e., finding an \(m \times n\) C1P matrix of minimum cost with respect to a linear objective function, is NP-hard (Booth [4] and Papadimitriou [30]).
The weighted C1P problem was investigated by Oswald and Reinelt [27,28,29] who provided a polyhedral study and a branch-and-cut algorithm that produces a certified optimal solution. They also introduce applications in the fields of developmental psychology [31], computational biology [7], archaeology [22], and film-making. Their computational results show that the problem is very difficult to solve to certified optimality even for relatively small matrices. For example, in [29], Oswald and Reinelt report on computational results with randomly generated square instances. Even some instances of size \(13\times 13\) were not solvable within one hour by their implementation and hardware.
Fortunately, there are applications of the Weighted C1P Problem having a particular structure that can be exploited to make it possible to attack larger instances. This is the case, for example, when, in addition to the cost matrix C, a second matrix \(M\in \{0,1\}^{m\times n}\) is given, typically non C1P, and one is asked for the least cost C1P positive patching of M, i.e., a C1P matrix obtained from M by switching some of its 0 entries to 1. This Weighted Positive C1P Patching Problem is the subject of this paper.
The complementary weighted negative C1P patching problem, in which the least cost C1P matrix obtained from M by switching some of its 1 entries to 0 is determined, is less frequent in applications; we therefore concentrate on the positive C1P patching problem. Thus, from now on we will use the name “C1P patching” for “positive C1P patching” and we will denote this problem by WC1PP. It generalizes WC1P, since the two problems coincide when M is the zero matrix. Even if we restrict the objective function coefficients to be all nonnegative, the WC1PP Problem is NP-hard, since it generalizes the so-called average order spread problem, proved to be NP-hard by Fink and Voss [14]. Such a proof also works when the entries of the objective function are all 1s. In this case, we denote the WC1PP Problem as the Minimum Length C1P Patching (MLC1PP) Problem.
1.1 Applications
There are a number of applications of the WC1PP Problem that have been discussed in the literature. Actually, some of the examples mentioned in [27] are of this type, like the ones in archaeology and film-making. We give here a short description of some other typical applications and variants (see, e.g., [10] for additional details).
Open Stacks Problem The Open Stacks problem is to generate a set of cutting patterns that cut raw material into smaller items of required sizes and quantities in order to minimize the waste. Once the optimal patterns have been used to perform the cutting operations, another optimization problem arises in practical applications. Indeed, the items cut from the panels are stacked around the cutting machine. Such stacks remain “open” during the complete production time of the related items and the same stack can be used only for items whose production does not overlap over time. Then one has to find a cutting pattern permutation that minimizes either the total stack opening time or the maximum number of stacks that are simultaneously open during the cutting process. In the literature, the total stack occupation time and the maximum number of simultaneously open stacks problems are known as Time of Open Stacks (TOS) Problem and Maximum number of Open Stacks (MOS) Problem, respectively (see Linhares and Yanasse [25]). In both cases, a feasible solution is a positive patching X of the binary production matrix M in which columns (rows) are associated with the panels (items) and \(M(i,j) = 1\) if and only if at least one item of type i is produced in the panel j. The MOS Problem then seeks for such an X that minimizes the maximum number of 1s in each column, while the TOS Problem reduces to an MLC1PP Problem. The MOS problem has been investigated in the literature, see, for instance, Baptiste [2], de la Banda and Stuckey [11], and [10].
Very Large Scale Integration circuit design (VLSI) In VLSI design, the gates correspond to circuit nodes and different connections between them are required. Each connection involves a subset of nodes and is called net. Note that to connect the gates of a net, it may be necessary to cross other gates not included in the net, depending on the gate layout sequence. Also, a single connection track can be used to place non-overlapping net wires. The total wire length determines the connection cost, while the number of tracks determines the total circuit area, which may be limited by design constraints or efficiency issues. Both indicators give an estimate of the circuit layout efficiency and depend on how gates are sequenced. We define the Gate Matrix Connection Cost minimization Problem (GMCCP) as the problem of finding a gate permutation such that the connection cost is minimized and the number of required tracks is limited. Let M be the incidence matrix of the circuit, i.e., \(M(i,j) = 1\) if net i requires the connection of gate j, and \(M(i,j) = 0\), otherwise. Then, a feasible solution to the GMCCP is a positive patching X of M and the number of required tracks for each net is the number of 1s in the corresponding column of X. Therefore, it is not difficult to see that GMCCP reduces to an MLC1PP Problem with the further request to have a bounded value for the maximum number of 1s in each column, see [10].
1.2 Outline of the paper
In Sect. 2 we will introduce some notation and resume some polyhedral results related to the Weighted C1P Problem. In Sect. 3 we will consider the convex hull of the positive C1P patchings of a given matrix. In particular we will: i) describe how to extend the facet defining inequalities introduced for the C1P case to this polytope, ii) give some conditions for a 0-lifting procedure to obtain facet defining inequalities, iii) discuss some polyhedral properties of the dominant polyhedron. We will describe in Sect. 4 the cutting planes we used within the branch-and-cut procedure that we implemented to solve the WC1PP Problem. In particular, we will give special emphasis on the oracle-based generated cutting planes (“local cuts”). The implementation details of the branch-and-cut algorithm will be given in Sect. 5, while the computational experiments will be described and commented in Sect. 6. Finally, we will draw up our conclusions in Sect. 7.
2 Basic definitions and results
We collect here several definitions and results that we will use in the following.
We denote by \({\mathscr {P}}_{{{\,\mathrm{C1}\,}}}^{{m},{n}}\) the set of all C1P matrices with m rows and n columns and the corresponding C1P polytope by \(P_{{{\,\mathrm{C1}\,}}}^{{m},{n}} :={{\,\mathrm{conv}\,}}({\mathscr {P}}_{{{\,\mathrm{C1}\,}}}^{{m},{n}})\). We will always assume that n, \(m \in \mathbb {N}:=\{1, 2, \dots \}\).
Let M be a given 0/1 matrix of size \(m \times n\). Recall that a positive C1P patching of M is a C1P matrix A of size \(m \times n\) such that \(A\geqslant M\). Let \({\mathscr {P}}^+({M})\) be the set of all positive C1P patchings of M and \(P^+({M}) :={{\,\mathrm{conv}\,}}({\mathscr {P}}^+({M}))\) be the corresponding positive C1P patching polytope. The set \({\mathscr {P}}^+({M})\) is nonempty, since it contains the all ones matrix \(\mathbb {1}^{m \times n}\) (or just \(\mathbb {1}\), if the size is clear from the context). In the same way, we define \(\mathbb {0}^{m \times n}\) and \(\mathbb {0}\).
Moreover, we use the following notation. For \(k \in \mathbb {N}\), we write \([k] :=\{1, \dots , k\}\), and we denote by \({\mathcal {O}}({k})\) the set of all ordered subsets of [k]. For a matrix \(A \in \mathbb {R}^{m \times n}\) we write A(i, j) for the entry of A at position \((i,j) \in [m] \times [n]\). Let \(N_0(A)\) denote the set of indices (i, j) such that \(A(i,j) = 0\), and let \(n_0(A)\) be its cardinality. We use the inner product \(\langle {A},{B}\rangle = \sum _{i=1}^m \sum _{j=1}^{n} A(i,j)\, B(i,j)\) for two \(m \times n\) matrices A and B.
Booth and Lueker [5] gave a linear time algorithm to test whether a given matrix is C1P, which is very important in this context. It uses the so-called PQ-tree algorithm. However, if the matrix is not C1P, the algorithm does not generate a certificate. Such a certificate can be given by certain matrices that appear as minors. Indeed, Tucker [33] gave a characterization of C1P using the five types of Tucker matrices shown in Fig. 1: the infinite series of matrices \(T^{1}_{k}\), \(T^{2}_{k}\), and \(T^{3}_{k}\) for every \(k \in \mathbb {N}\) and the fixed size matrices \(T^{4}\) and \(T^{5}\). We need the following notation in order to state his result.
For two ordered sets \(I \in {\mathcal {O}}({n})\) and \(J \in {\mathcal {O}}({n})\), by \(A_{IJ}\) we denote the matrix obtained by selecting the rows and the columns of A with indices in I and in J, respectively, taken in the corresponding order. We say that \(A_{IJ}\) is a minor of A. Finally, Tucker’s characterization can be stated as follows.
Theorem 1
(Tucker [33]) A matrix \(M \in \{0,1\}^{m \times n}\) is C1P if and only if none of its minors is a Tucker matrix.
Oswald-Reinelt matrices \(F^{1}_{k}\) of size \((k+2)\times (k+2)\) and \(F^{2}_{k}\) of size \((k+2) \times (k+3)\). Here, “\(+\)” stands for “\(+1\)”, “−” for “\(-1\)”, and an empty entry stands for “0”. Note that \(F^{1}_{k}\) is transposed with respect to the one defined in [28]
Based on this characterization, Oswald and Reinelt [28, 29] gave an integer programming formulation for optimizing a linear objective function over the set \({\mathscr {P}}_{{{\,\mathrm{C1}\,}}}^{{m},{n}}\) described by inequalities that are all facet defining for the polytope \(P_{{{\,\mathrm{C1}\,}}}^{{m},{n}}\). Such a formulation is provided by four types of inequalities based on the matrices shown in Figs. 2 and 3. The result reads as follows.
Theorem 2
(Oswald and Reinelt [28])
-
(1)
The inequalities \(\langle {F^{1}_{k}},{X_{IJ}}\rangle \leqslant 2k+3\) for all \(k \in \mathbb {N}\) and all ordered index sets \(I, J \in {\mathcal {O}}({k+2})\) are facet-defining for \(P_{{{\,\mathrm{C1}\,}}}^{{m},{n}}\) with \(m \geqslant k+2\), \(n \geqslant k+2\).
-
(2)
The inequalities \(\langle {F^{2}_{k}},{X_{IJ}}\rangle \leqslant 2k+3\) for all \(k \in \mathbb {N}\) and all ordered index sets \(I \in {\mathcal {O}}({k+2})\) and \(J \in {\mathcal {O}}({k+3})\) are facet-defining for \(P_{{{\,\mathrm{C1}\,}}}^{{m},{n}}\) with \(m \geqslant k+2\), \(n \geqslant k+3\).
-
(3)
The inequalities \(\langle {F^{3}},{X_{IJ}}\rangle \leqslant 8\) for all ordered index sets \(I \in {\mathcal {O}}({4})\) and \(J \in {\mathcal {O}}({6})\) are facet-defining for \(P_{{{\,\mathrm{C1}\,}}}^{{m},{n}}\) with \(m \geqslant 4\), \(n \geqslant 6\).
-
(4)
The inequalities \(\langle {F^{4}},{X_{IJ}}\rangle \leqslant 8\) for all ordered index sets \(I \in {\mathcal {O}}({4})\) and \(J \in {\mathcal {O}}({5})\) are facet-defining for \(P_{{{\,\mathrm{C1}\,}}}^{{m},{n}}\) with \(m \geqslant 4\), \(n \geqslant 5\).
-
(5)
The inequalities in Parts (1)–(4), together with the trivial inequalities \(X\geqslant \mathbb {0}\) and \(X\leqslant \mathbb {1}\), define an integer programming formulation of the set \({\mathscr {P}}_{{{\,\mathrm{C1}\,}}}^{{m},{n}}\).
Remark 1
In the paper of Oswald and Reinelt, there is a typo in the definition of matrix \(F^{4}\). We verified the proof of the above theorem for the corrected matrix by enumerating all C1P matrices of size \(4 \times 5\), checking that the inequality \(\langle {F^{4}},{X_{IJ}}\rangle \leqslant 8\) is valid, and that there are 20 affinely independent vectors satisfying the inequality with equality for each \(I \in {\mathcal {O}}({4})\) and \(J \in {\mathcal {O}}({5})\) (Oswald and Reinelt proved that \(P_{{{\,\mathrm{C1}\,}}}^{{m},{n}}\) is full-dimensional). The result then follows from the trivial lifting theorem of Oswald and Reinelt [28, Theorem 2].
Remark 2
The set \({\mathscr {P}}^+({M})\) and the polytope \(P^+({M})\) are not monotone, i.e., if \(X \in P^+({M})\) and \(X \leqslant Y\) then not necessarily \(Y \in P^+({M})\). Indeed, the matrix
is C1P, and hence \(M \in {\mathscr {P}}^+({M})\). However,
-
(a)
\( \left( {\begin{matrix} 1 &{}\quad 1 &{}\quad 0 \\ 0 &{}\quad 1 &{}\quad 1 \\ 1 &{}\quad 0 &{}\quad 1 \end{matrix}} \right) \notin {\mathscr {P}}^+({M})\), since it coincides with the Tucker matrix \(T^{1}_{1}\), while
-
(b)
\(\left( {\begin{matrix} 1 &{}\quad 1 &{}\quad 1 \\ 0 &{}\quad 1 &{}\quad 1 \\ 1 &{}\quad 0 &{}\quad 1 \end{matrix}} \right) \in {\mathscr {P}}^+({M})\), since switching columns 2 and 3 yields a strict C1P matrix.
More recently, other inequalities, which are also facet-defining for \(P_{{{\,\mathrm{C1}\,}}}^{{m},{n}}\), have been presented by de Giovanni et al. [9].
3 Polyhedral properties of the C1P patching polytope
In this section, let \(M \in \{0,1\}^{m \times n}\) be the given matrix.
3.1 Basic results
The polytope \(P^+({M})\) has the following basic properties.
Proposition 1
Let \(M \in \{0,1\}^{m \times n}\) and \(X \in P^+({M})\). Then
Moreover, \(\dim (P^+({M})) = n_0(M)\).
Proof
Equation (1) follow by definition for all vertices of \(P^+({M})\) and by convexity for any \(X \in P^+({M})\). Therefore, \(\dim (P^+({M})) \leqslant n_0(M)\). We denote the \(m \times n\) matrix with entry (i, j) equal to one and all the other entries equal to zero by \(E_{ij}\). Then the \(n_0(M) + 1\) matrices \(\mathbb {1}\) and \(\mathbb {1}- E_{ij}\) for all (i, j) with \(M(i,j) = 0\) are contained in \({\mathscr {P}}^+({M})\) and are affinely independent. \(\square \)
Because of Proposition 1, from now on we assume that all inequalities \(\langle {A},{X}\rangle \leqslant \alpha \) that are valid for \(P^+({M})\) are in the standard form, i.e., \(A(i,j) = 0\), for all \(M(i,j) = 1\).
Proposition 2
Let \(M \in \{0,1\}^{m \times n}\). The trivial inequalities \(0 \leqslant X(i,j) \leqslant 1\) are facet defining for \(P^+({M})\) for all (i, j) with \(M(i,j) = 0\).
Proof
For \(X(i,j) \geqslant 0\), consider the matrices \(\mathbb {1}- E_{ij}\) and \(\mathbb {1}- E_{k\ell } - E_{ij}\) for all \((k,\ell ) \ne (i,j)\) with \(M(k,\ell ) = 0\), where \(E_{ij}\) is defined as in the proof of Proposition 1. These matrices are contained in \({\mathscr {P}}^+({M})\), since any matrix containing at most two 0s is C1P (the corresponding columns can be permuted to opposite ends of the matrix). These \(n_0(M)\) affinely independent matrices satisfy \(X(i,j) = 0\), which completes the proof.
For \(X(i,j) \leqslant 1\), consider the matrices \(\mathbb {1}\) and \(\mathbb {1}- E_{k\ell }\) for all \((k,\ell ) \ne (i,j)\) with \(M(k,\ell ) = 0\). They satisfy \(X(i,j) = 1\), are contained in \({\mathscr {P}}^+({M})\) and are affinely independent. \(\square \)
Another fundamental fact is that \(P^+({M})\) is a face of \(P_{{{\,\mathrm{C1}\,}}}^{{m},{n}}\). Indeed, any entry (i, j) of a matrix \(X \in P^+({M})\) for which \(M(i,j) = 1\) is fixed to 1. Thus, the inequalities in Theorem 2 yield nontrivial valid inequalities for \(P^+({M})\). In particular, their IP-formulation yields a valid formulation for the positive C1P patching problem as well. It turns out, however, that they do not always define facets. The following results deal with the corresponding conditions.
The support of a matrix A is the submatrix obtained from A by removing all its zero rows and its zero columns. Let \({\overline{M}} = \mathbb {1}- M \in \{0,1\}^{m \times n}\) denote the complement of M. We say that \(A \in \{0,1\}^{m \times n}\) supports \(B \in \{0,1\}^{m \times n}\) if \(A(i,j) \geqslant B(i,j)\), for all \(i,j \in [m] \times [n]\).
Theorem 3
-
(1)
The inequality \(\langle {F^{1}_{k}},{X_{IJ}}\rangle \leqslant 2k+3\) with \(k \in \mathbb {N}\) is facet defining for \(P^+({M_{IJ}})\) if \(k \geqslant 2\) and either \(M_{IJ} \in \{0,1\}^{k+2 \times k+2}\) is supported by \(T^{1}_{k}\) or \(M_{IJ} = T^{2}_{k-1}\).
-
(2)
The inequality \(\langle {F^{2}_{k}},{X_{IJ}}\rangle \leqslant 2k+3\) with \(k \in \mathbb {N}\) is facet defining for \(P^+({M_{IJ}})\) if \(M_{IJ} \in \{0,1\}^{k+3 \times k+2}\) is supported by a matrix obtained from \(T^{3}_{k}\) by removing the 1s in the last row.
Proof
The proof of Claim (1) is given by slightly modifying the arguments in [29]. To shorten notation, let \(A = F^{1}_{k}\) and \(\alpha = 2k+3\). Thus, \(\langle {A},{X_{IJ}}\rangle \leqslant \alpha \) (\((A,\alpha )\), for short) is the inequality under investigation. Let \(\langle {B},{X_{IJ}}\rangle \leqslant \beta \) be a valid inequality that is satisfied with equality by all the feasible solutions that satisfy \((A,\alpha )\) with equality. In order to prove the claim, it will be enough to show that there exists \(\delta > 0\) such that \(B(i,j) = \delta A(i,j)\) for any \((i,j) \in N_0(M_{IJ})\); recall that all variables \(X_{IJ}(i,j)\) with \((i,j) \in (I \times J) \setminus N_0(M_{IJ})\) are set to 1 and that \(P^+({M_{IJ}})\) has dimension \(n_0(M_{IJ})\) (as for Claim (2) in Proposition 1). Moreover, we will show that there exists at least one positive patching of \(M_{IJ}\) that satisfies both equalities, which implies \(\beta = \delta \alpha \). Consequently, the faces defined by \(\langle {A},{X_{IJ}}\rangle \leqslant \alpha \) and \(\langle {B},{X_{IJ}}\rangle \leqslant \beta \) coincide.
First partition \(N_0(M_{IJ})\) into \({\mathcal {S}}^+ :=\{(i,j) \in N_0(M_{IJ}) \,:\,A(i,j) = 1\}\), \({\mathcal {S}}^- :=\{(i,j) \in N_0(M_{IJ}) \,:\,A(i,j) = -1\}\) and \({\mathcal {S}}^0 :=\{(i,j) \in N_0(M_{IJ}) \,:\,A(i,j) = 0\}\).
Consider the matrix
as depicted in Fig. 4. Moreover, for each \((i,j) \in {\mathcal {S}}^0\), let \(Z^{ij}\) be defined as follows: \(Z^{ij} :=Z - E_{ij}\), if \(i \leqslant k + 1\), and \(Z^{ij} :=Z - E_{ij} + E_{k+1,1} - E_{k+2,k+1}\), if \(i = k + 2\). Observe that \(\langle {A},{Z}\rangle = \langle {A},{Z^{ij}}\rangle = \alpha \). In the following we prove that Z and \(Z^{ij}\) are positive patchings of \(M_{IJ}\). First, notice that both Z and \(Z^{ij}\) support \(M_{IJ}\), by construction. Then, Z is strict C1P, and it is not difficult to check that also \(Z^{ij}\) is C1P. Indeed, consider the case with \(i \leqslant k+1\). If \(j = 1\), \(Z^{ij}\) is strictly C1P, and if \(j > 1\) one has to exchange columns j and \(k+1\) (columns j and 2, if \(i = k + 1\)) to get a strict C1P matrix. On the other hand, if \(i = k+2\), moving columns j and \(k+1\) in the first two positions returns a strict C1P matrix. Therefore, Z and \(Z^{IJ}\) are roots of \((A,\alpha )\) (and thus also of \((B,\beta )\)). Hence, by subtracting the equations \(\langle {B},{X}\rangle = \beta \) for \(X = Z\) and \(X = Z^{ij}\), we obtain
Hence, \(B(i,j) = 0\) for all \((i,j) \in {\mathcal {S}}^0\).
Consider the matrix \(W^{ij} = T^{2}_{k-1} + E_{ij}\), for each \((i,j) \in {\mathcal {S}}^-\). It is not difficult to see that \(W^{ij}\) satisfies \((A, \alpha )\) with equality. We now show that \(W^{ij} \in {\mathscr {P}}^+({M})\). Indeed \(W^{ij} \geqslant M\). Observe that \({\mathcal {S}}^- = \{(k+2,k+1), (k+1,1)\} \cup \{(i,k+2) \,:\,i = 1, \dots , k\}\). If \((i,j) = (k+2,k+1)\) we have that \(W^{ij}\) is strictly C1P. If \(i \leqslant k\) and \(j = k+2\), then it is enough to move column \(k+2\) between columns i and \(i+1\) to get a strict C1P matrix. Finally, if \((i,j) = (k+1,1)\), we obtain a strict C1P matrix by moving column \(k+2\) in first position. Since all these \(W^{ij}\) are roots of \((A, \alpha )\) (and therefore of \((B, \beta ))\) that differ only for one element, we have that all coefficients B(i, j) for \((i,j) \in {\mathcal {S}}^-\) have the same value, say \(\gamma \).
If \(M_{IJ} = T^{2}_{k-1}\) or \(M_{IJ} = T^{1}_{k}\) then we are done, since, in this case, \({\mathcal {S}}^+ = \varnothing \).
Therefore assume that \(M_{IJ} \leqslant T^{1}_{k}\) and \({\mathcal {S}}^+ \ne \varnothing \). Notice that \(T^{1}_{k} - E_{ij}\) is a C1P positive patching of \(M_{IJ}\) for all \((i,j) \in {\mathcal {S}}^+\). Moreover, every such vector is a root of \((A, \alpha )\) and hence of \((B, \beta )\). It follows that all coefficients B(i, j) for \((i,j) \in {\mathcal {S}}^+\) have the same value, say \(\delta \). Let \(({\bar{\imath }}, {\bar{\jmath }}) \in {\mathcal {S}}^+\) (in particular, \(B({\bar{\imath }}, {\bar{\jmath }}) = \delta \)). Then
are C1P positive patchings of \(M_{IJ}\) and \((B,\beta )\) is tight to both of them. If \({\bar{\imath }} \leqslant k\), it follows that
Similarly, \(\gamma + \delta = 0\) holds for \({\bar{\imath }} = k+1\) and \({\bar{\imath }} = k+2\), too.
In conclusion, we know that \(B(i,j) = \delta \), if \((i,j) \in {\mathcal {S}}^+\), \(B(i,j) = -\delta \), if \((i,j) \in {\mathcal {S}}^-\), and \(B(i,j) = 0\), if \((i,j) \in {\mathcal {S}}^0\). Thus, \((B, \beta )\) is a multiple of \((A,\alpha )\), which concludes the proof.
Claim (2) can be proved by the same arguments used by Oswald and Reinelt [29] to prove case (3) of Theorem 2. \(\square \)
Remark 3
The statement of Part (1) in Theorem 3 becomes false, if \(M_{IJ} \geqslant T^{1}_{k}\), \(M_{IJ} \ne T^{1}_{k}\) (instead of \(T^{1}_{k} \geqslant M_{IJ}\)) and \(M_{IJ} \leqslant T^{2}_{k-1}\), \(M_{IJ} \ne T^{2}_{k-1}\) (instead of \(M_{IJ} = T^{2}_{k-1}\)): For \(k = 3\), the inequality \(\langle {F^{1}_{3}},{X}\rangle \leqslant 9\) does not define a facet for \(P^+({T^{2}_{2} - E_{4,4}})\).
Similarly, Part (2) in Theorem 3 becomes false, if \(M_{IJ} = T^{3}_{k}\): For \(k = 2\), the inequality \(\langle {F^{2}_{2}},{X}\rangle \leqslant 7\) does not define a facet for \(P^+({T^{3}_{2}})\).
Following the line of Theorem 3, we also checked whether inequalities \(\langle {F^{3}},{X}\rangle \leqslant 8\) and \(\langle {F^{4}},{X}\rangle \leqslant 8\) are facet defining for \(P^+({T^{4}})\) and \(P^+({T^{5}})\), respectively. The following two observations address these two questions.
Remark 4
Applying \(\langle {F^{3}},{X}\rangle \leqslant 8\) to \(T^{4}\) yields the inequality \(\langle {A},{X}\rangle \geqslant 1\) with
which defines a facet for \(P^+({T^{4}})\).
Remark 5
Applying \(\langle {F^{4}},{X}\rangle \leqslant 8\) to \(T^{5}\) yields the inequality \(\langle {A},{X}\rangle \geqslant 1\) with
which does not define a facet for \(P^+({T^{5}})\).
Remarks 3, 4, and 5 can be checked by using polymake [17,18,19]. The convex hull algorithm used by polymake is cdd [15], which in turn relies on the exact arithmetic of GMP [20]. The same holds for the rank computations that we have to perform in polymake.
3.2 Projection and lifting
In the following we will deal with the relation between the positive patching polytope \(P^+({M})\) and the polytope \(P^+({M_{IJ}})\) for a minor \(M_{IJ}\).
Lemma 1
For \(M \in \{0,1\}^{m \times n}\) and \(I \in {\mathcal {O}}({m})\), \(J \in {\mathcal {O}}({n})\), we have:
Equality holds if \(|{J} | = n\).
Proof
If \(X \in {\mathscr {P}}^+({M})\), then by definition X is C1P and so is the submatrix \(X_{IJ}\). Furthermore, since \(M \leqslant X\), then \(M_{IJ} \leqslant X_{IJ}\). Hence, \(X_{IJ} \in {\mathscr {P}}^+({M_{IJ}})\). This shows the first claim.
If \(|{J} | = n\), for \(Y \in {\mathscr {P}}^+({M_{IJ}})\) define the following matrix:
It follows from the construction that \(X \in {\mathscr {P}}^+({M})\) and \(X_{IJ} = Y\), which shows the second claim. \(\square \)
As we will show in the following subparagraph, an inequality keeps the property of being facet-defining if we restrict the inequality to its support (i.e., if we remove rows and columns with all zero coefficients). In order to prove this property, we first need the following result. Here, an inequality \(\langle {A},{X}\rangle \leqslant \alpha \), with A, \(X \in \mathbb {R}^{I \times J}\), is said to be obtained by (trivially) lifting the inequality \(\langle {A'},{X'}\rangle \leqslant \alpha \), with \(A'\), \(X' \in \mathbb {R}^{I' \times J'}\) and \(I' \subseteq I\), \(J' \subseteq J\), if \(A(i,j) = A'(i,j)\), for all \((i,j) \in I' \times J'\), and \(A(i,j) = 0\), for all \((i,j) \in (I \setminus I') \times (J \setminus J')\).
Lemma 2
Let \(A \in \mathbb {R}^{m \times n}\) and \(\langle {A_{IJ}},{X_{IJ}}\rangle \leqslant \beta \) be a valid inequality for \(P^+({M_{IJ}})\), where \(I \in {\mathcal {O}}({m})\) and \(J \in {\mathcal {O}}({n})\). Assume that \(A(i,j) = 0\) for \((i,j) \notin I \times J\). Then the trivially lifted inequality \(\langle {A},{X}\rangle \leqslant \beta \) is valid for \(P^+({M})\).
Proof
Let \(X^\star \in {\mathscr {P}}^+({M})\). By Lemma 1, \(X^\star _{IJ} \in P^+({M_{IJ}})\). Because the inequality \(\langle {A_{IJ}},{X_{IJ}}\rangle \leqslant \beta \) is valid for \(P^+({M_{IJ}})\), it follows that
i.e., the lifted inequality is valid for \(P^+({M})\). \(\square \)
We obtain the following.
Lemma 3
Let \(\langle {A},{X}\rangle \leqslant \beta \) be a facet defining inequality for \(P^+({M})\) and let I and J be such that \(A(i,j) = 0\) for each \((i,j) \notin I \times J\). Then \(\langle {A_{IJ}},{X_{IJ}}\rangle \leqslant \beta \) is facet defining for \(P^+({M_{IJ}})\).
Proof
Assume that there exists \(B \in \mathbb {R}^{m \times n}\) with \(B(i,j) = 0\) for all \((i,j) \notin I \times J\), such that \(\langle {B_{IJ}},{X_{IJ}}\rangle \leqslant \gamma \) defines a facet for \(P^+({M_{IJ}})\) and
i.e., \(\langle {A_{IJ}},{X_{IJ}}\rangle \leqslant \beta \) does not define a facet. Since, both A and B are zero outside \(I \times J\), by Lemma 2, \(\langle {B},{X}\rangle \leqslant \gamma \) is valid for \(P^+({M})\) and
i.e., \(\langle {A},{X}\rangle \leqslant \beta \) does not define a facet for \(P^+({M})\), a contradiction. \(\square \)
The reverse question asks whether we can get valid or even facet-defining inequalities from inequalities valid for minors.
Oswald and Reinelt [28, 29] proved that every trivial row and column lifting yields facets for the C1P polytope \(P_{{{\,\mathrm{C1}\,}}}^{{m},{n}}\). For positive C1P patching polytopes, this is not true.
Remark 6
Consider the matrix
By enumerating all positive C1P patchings with respect to M, one can verify that \(\langle {A},{X}\rangle \leqslant 7\) with
defines a facet of \(P^+({M})\). However, \(\langle {\left( {\begin{matrix}A\\ 0^T \end{matrix}}\right) },{X}\rangle \) \(\leqslant 7\) does not define a facet for
Thus, trivial row lifting does not always result in a facet-defining inequality.
Remark 7
Similarly, consider the matrix
As above, one can verify that \(\langle {A},{X}\rangle \leqslant 7\) with
defines a facet of \(P^+({M})\).
Moreover, the trivially column lifted inequality \(\langle {[A,\, 0]},{X}\rangle \leqslant 7\) does not define a facet for the polytope \(P^+({[M,\, \mathbb {1}^{m \times 1}]})\). (Note that in this case we have \(\dim P^+({M}) = \dim P^+({[M,\, \mathbb {1}^{m \times 1}]}) = 8\)).
Despite these examples, we can give some sufficient conditions for matrix M to obtain facet defining inequalities of \(P^+({M})\) by trivially lifting the inequalities defined in Theorem 3. The arguments are similar to the ones given in the proof of Theorem 3. We first consider the case of a general facet defining inequality.
Theorem 4
Consider the matrix
Assume \(\langle {A_{IJ}},{X_{IJ}}\rangle \leqslant \beta \) to be facet defining for \(P^+({M_{IJ}})\) and \({\overline{M}}\) strictly C1P for any permutation of its columns. Then \(\langle {A},{X}\rangle \leqslant \beta \), obtained as the trivial lifting of \(\langle {A_{IJ}},{X_{IJ}}\rangle \leqslant \beta \) to the M-space, is facet defining for \(P^+({M})\).
Proof
Let \(M_{IJ} \in \{0,1\}^{m_1 \times n}\) and \({\overline{M}} \in \{0,1\}^{m_2 \times n}\). Moreover, let \(z_1 = n_0(M_{IJ})\) and \(z_2 = n_0({\overline{M}})\). In the following we will construct \(z_1 + z_2\) affinely independent roots of \(\langle {A},{X}\rangle \leqslant \beta \). Since by Proposition 1 the dimension of \(P^+({M})\) is \(z_1 + z_2\), this will prove the claim of the theorem.
Since \(\langle {A},{X}\rangle \leqslant \beta \) is facet defining for \(P^+({M_{IJ}})\), there exist \(z_1\) affinely independent roots that can easily be extended to the \((m_1 + m_2) \times n\) space of M by adding the rows of matrix \({\overline{M}}\), so to obtain matrices \(X_1, \dots , X_{z_1}\). In particular, and w.l.o.g., let the columns of M be ordered in such a way that \(X_{z_1}\) is strictly C1P. Observe now that, in order to be strictly C1P for any permutation of the columns, each row of \({\overline{M}}\) must either contain at most one 1, or have all 1 entries. Now, iteratively for \(p = z_1+1, \dots , z_1+z_2\), let \(X_p\) be obtained from \(X_{p-1}\) by switching to 1 an entry \((i_p,j_p) \in N_0(X_{p-1})\) such that: i) \(m_1+1 \leqslant i_p \leqslant m_1 + m_2\) and ii) \(X_p\) is strictly C1P (as \(X_{p-1}\) is also strictly C1P, this can be easily done). Therefore, by construction, the matrices of \(\{X_1, \dots , X_{z_1+z_2}\}\) are affinely independent roots of \(\langle {A},{X}\rangle \leqslant \beta \), which proves the claim. \(\square \)
In some cases, also inequalities in Theorem 2 can be trivially lifted and still induce facets:
Theorem 5
Let
assume \((M_1|M_2)\) to be strictly C1P, and \(M_3 = 0\).
-
(1)
If \(M_{IJ} \in \{0,1\}^{(k+2) \times (k+2)}\), with \(k \geqslant 2\), is supported by \(T^{1}_{k}\) or \(M_{IJ} = T^{2}_{k-1}\), then the trivial lifting of \(\langle {F^{1}_{k}},{X_{IJ}}\rangle \leqslant 2k+3\) to the M-space is facet defining for \(P^+({M})\).
-
(2)
If \(M_{IJ} \in \{0,1\}^{(k+2) \times (k+3)}\), with \(k \geqslant 2\), is supported by a matrix obtained from \(T^{3}_{k}\) by removing the 1s in the last row, then the trivial lifting of \(\langle {F^{2}_{k}},{X_{IJ}}\rangle \leqslant 2k+3\) to the M-space is facet defining for \(P^+({M})\).
Proof
The proof of this theorem mimics the one given for Theorem 3.
Claim (1). Let \(M_2 \in \{0,1\}^{m_1 \times n_1}\); consequently, \(M_1 \in \{0,1\}^{m_1 \times (k+2)}\), \(M_3 = \{0\}^{(k+2) \times n_1}\), and \(M \in \{0,1\}^{(k + 2 + m_1)\times (k+2+n_1)}\). Moreover, let \((A, \alpha )\), with \(\alpha = 2k+3\), be the trivial lifting of \(\langle {F^{1}_{k}},{X_{IJ}}\rangle \leqslant 2k+3\) to the \((k + 2 + m_1)\times (k+2+n_1)\) space, and let \((B, \beta )\) be an inequality that is satisfied with equality by all the feasible solutions that satisfy \((A,\alpha )\) with equality.
By the same arguments used in the proof of Theorem 3 we can show that \(B(i,j) = A(i,j)\) for all \(i, j \in [k+2]\). Now, let \(Z \in \{0,1\}^{(k+2) \times (k+2)}\) be defined as in the proof of Theorem 3 and illustrated in Fig. 4, and let
Observe that \(Z_0\) is strictly C1P and it is a root of \((A, \alpha )\) (and consequently of \((B, \beta )\)). Let z be the number of 0s in the matrix \((M_1, M_2)\) (i.e., \( z = n_0([M_1,M_2])\)) and, iteratively for each \(s = 1, \dots , z\), let \(Z_s\) be obtained from \(Z_{s-1}\) by setting an entry \((i_s,j_s) \in N_0(Z_{s-1})\), with \(k+3 \leqslant i_s \leqslant k+2+m_1\) to 1, such that \(Z_s\) is still strictly C1P (always possible, since \(Z_{s-1}\) is strict C1P). Since \((A, \alpha )\) (and then also \((B,\beta )\)) is tight for \(Z_s\), this proves that \(B(i_s,j_s) = 0\), for each \((i_s, j_s) \in N_0([M_1,M_2])\).
It remains to consider the coefficients of B corresponding to the matrix \(M_3\). In this case, let \({\overline{Z}}_0\) be the matrix obtained from \(Z_0\) by setting all the entries of \([M_1, M_2]\) to 1. Again \({\overline{Z}}_0\) is strictly C1P and a root of both \((A, \alpha )\) and \((B, \beta )\). Now, iteratively for each row i from \(k+2\) to 1 and from each column j from \(k+3\) to \(k+2+n_1\), let \({\overline{Z}}_s\) be obtained from \({\overline{Z}}_{s-1}\) by setting \({\overline{Z}}_s(i,j) = 1\). Again, it is not difficult to see that \({\overline{Z}}_s\) is C1P (if \(i \leqslant k\), it suffices to move column \(k+2\) in the last position to get a strictly C1P matrix) and that it is a root of \((A, \alpha )\) (and thus of \((B, \beta )\)). This implies that \(B(i,j) = 0\) for all the entries corresponding to the matrix \(M_3\). Therefore, we have that \((B, \beta )\) coincides with \((A,\alpha )\) and this concludes the proof.
Similar arguments to those used for Claim (1) also prove Claim (2). \(\square \)
It is an open question whether one can obtain necessary and sufficient conditions for trivial lifting in general.
3.3 The dominant polyhedron
Of special interest is the case when the objective function of the WC1PP problem to be minimized has only nonnegative coefficients. This, for example, is the case in real world applications where turning a zero into a one is a costly, rather than a profitable, operation.
Clearly, minimizing a nonnegative linear function over \(P^+({M})\) is equivalent to minimizing the same function over \(D^+({M})\), the dominant of \(P^+({M})\) defined by the Minkowski sum of \(P^+({M})\) and \(\mathbb {R}_+^{m \times n}\):
Unfortunately, we do not have at hand an integer linear description of \(D^+({M})\). Despite this fact, we can derive facet defining inequalities for \(D^+({M})\) by minimizing over such polyhedron, as it will be discussed in Sect. 4. Therefore, here and in Sect. 4.3.5, we will discuss some properties of \(D^+({M})\) that we will use to obtain some algorithmic advantages exploited in the solution algorithm. We start with the following result on the facet defining inequalities of \(D^+({M})\). As it is usual in the literature about dominant polyhedra, here the valid inequalities will be presented in \(\langle {A},{X}\rangle \geqslant \alpha \) form, so to assume, w.l.o.g., \(A \geqslant {\mathbb {0}}\) and \(\alpha \geqslant 0\).
Theorem 6
Let \(M \in \{0,1\}^{m \times n}\) and let \(\langle {A},{X}\rangle \geqslant \alpha \) define a facet of \(D^+({M})\) that is not equal to a facet defined by \(X(i,j) \geqslant 0\) for some \(i \in [m]\) and \(j \in [n]\).
-
(1)
If row \({\bar{\imath }}\) of M contains at most one 1 entry, then \(A({\bar{\imath }}, j) = 0\) for each \(j \in [n]\).
-
(2)
If column \({\bar{\jmath }}\) of M contains all 0 entries, then \(A(i, {\bar{\jmath }}) = 0\) for each \(i \in [m]\).
Proof
We will first prove Case (1). Since for \(X\in D^+(M)\) we have that \(X+Y\in D^+(M)\) for all \(Y\in \mathbb {R}_+^{m\times n}\), validity of \(\langle {A},{X}\rangle \geqslant \alpha \) implies that \(A(i,j) \geqslant 0\) for all \(i \in [m]\) and \(j \in [n]\); consequently, in order the inequality to be supporting, \(\alpha \geqslant 0\). Let \(Q :=\{j \,:\,M({\bar{\imath }}, j) = 0\}\). Then assume, by contradiction, that there exists \({\bar{\jmath }} \in Q\) such that \(A({\bar{\imath }}, {\bar{\jmath }}) > 0\).
Now observe that there exists at least one positive patching of M, say \({\bar{X}}\), with \(\langle {A},{X}\rangle = \alpha \) (i.e., \({\bar{X}}\) is a root of \((A, \alpha )\)) such that \({\bar{X}}({\bar{\imath }}, {\bar{\jmath }}) = 1\). Indeed, if not, all roots of \(\langle {A},{X}\rangle \geqslant \alpha \) will also be roots of \(X({\bar{\imath }}, {\bar{\jmath }}) \geqslant 0\), contradicting the hypothesis that \((A, \alpha )\) defines a facet that does not arise from a trivial inequality of some variable.
Moreover, let \({\tilde{X}}\) be obtained from \({\bar{X}}\) by setting to 0 all the elements \(({\bar{\imath }}, j)\) with \(j \in Q\). Then, row \({\bar{\imath }}\) of \({\tilde{X}}\) coincides with row \({\bar{\imath }}\) of M and thus, as it contains at most one 1 entry, cannot contribute to any Tucker minor. Consequently, since \({\bar{X}} \in {\mathscr {P}}^+({M})\), also \({\tilde{X}} \in {\mathscr {P}}^+({M})\). Therefore, \(\langle {A},{{{\tilde{X}}}}\rangle < \langle {A},{{{\bar{X}}}}\rangle = \alpha \), contradicting the assumption that \(\langle {A},{X}\rangle \geqslant \alpha \) is valid for \(D^+({M})\).
Similar arguments also prove Case (2) (here we use the observation that no Tucker minor contains a column with all 0 entries). \(\square \)
The algorithmic consequences of this theorem will be detailed in Remark 9 below.
4 Separation
In the branch-and-cut algorithm described in Sect. 5 below we make use of three kinds of cutting planes:
-
A dictionary of inequalities derived from the Tucker matrices that appear as minors of the given matrix M;
-
exactly and heuristically separated inequalities as stated in Theorem 2, generated from the current fractional solution, and
-
cutting planes based on an optimization oracle (local cuts).
We describe the corresponding separation algorithms in the following.
4.1 A dictionary of inequalities
In order to create a dictionary of Tucker minors of the input matrix M, we use the following three procedures:
-
(1)
Relying on the proof of Tucker [33] for the characterization of C1P-matrices in Theorem 1, we use the method of Lekkerkerker and Boland [24] for recognizing interval graphs. Let \(G = (U \cup V, E)\) be the bipartite graph associated to to M, where U and V are nodes corresponding to the rows and columns of M, respectively, and \(E = \{\{u,v\} \,:\,u \in U,\; v \in V,\; M(u,v) \ne 0\}\). Each Tucker minor corresponds to an asteroidal triple in V, i.e., a triple \((a,b,c) \in V \times V \times V\) such that there exists a path between each of the two nodes that avoids the neighborhood of the third. Hence, to generate Tucker minors, one needs to enumerate all triples and, for each triple, all possible legal paths between each pair of its nodes. To keep the running time acceptable, we compute only one path for each pair of nodes. Then we check whether the resulting matrices form Tucker minors.
-
(2)
Starting from M, we iteratively (temporarily) remove rows and columns from front to back while the resulting matrix does not have the C1P. The matrix T at the end of this method is a Tucker minor, by Theorem 1. Then we randomly remove from M a row or a column containing a row or column of T and we repeat the process until a C1P matrix results.
-
(3)
For each of the Tucker minors found by applying (1) or (2), we look for other Tucker minors of the same type that can be generated by replacing one row or column in the current submatrix by equal parts of different rows or columns of M.
For each Tucker minor T provided by the procedures (1), (2), and (3), we generate the following inequalities that are stored in a pool, which is separated during the branch-and-cut procedure:
-
(a)
inequalities from Theorem 2. In particular, if T is \(T^{1}_{k}\) or \(T^{2}_{k-1}\) with \(k > 1\), we generate \(k+2\) symmetric copies of the corresponding inequality \(\langle {F^{1}_{k}},{X_{IJ}}\rangle \leqslant 2k+3\), all violated by T. In this case, observe that, because of Theorem 3, the produced inequalities are facet defining for \(P^+({T})\).
-
(b)
if \(T \in \{T^{1}_{1}, T^{1}_{2}, T^{2}_{1}, T^{2}_{2}, T^{3}_{1}, T^{3}_{2}, T^{5}\}\), we produce all the nontrivial facet defining inequalities of \(P^+({T})\);
-
(c)
if \(T \in \{T^{1}_{3}, T^{1}_{4}, T^{3}_{3}, T^{3}_{4}, T^{2}_{3}, T^{4}\}\), we produce all the nontrivial facet defining inequalities of \(D^+({T})\).
The facet defining inequalities produced for the cases (a) and (b) are generated off-line using the software suite polymake mentioned above.
4.2 Inequalities from Oswald and Reinelt
In order to separate the current fractional LP-solution \(X^\star \), we generate inequalities as stated in Theorem 2. In particular, we apply two separation procedures. First, we use a rounding algorithm as described by Oswald and Reinelt [28, 29]. The general idea is to first round \(X^\star \) to an integer matrix \(\bar{X}\) and then, if \(\bar{X}\) is not C1P, apply the Steps (2) and (3) described in the previous section to \(\bar{X}\). Here, for each Tucker minor T, we only generate inequalities from Theorem 2, since the facet defining inequalities from \(P^+({T})\) or \(D^+({T})\) could, in general, not be valid for \(P^+({M})\).
Then, for the inequalities (1) and (2) of Theorem 2, we also apply the exact separation procedures described in [29]. Such algorithms reduce the corresponding separation problem to the solution of a sequence of shortest path problems in a set of suitable graphs. Their overall complexity is rather time consuming (\(O(n^3 \, (n+m))\) and \(O(n^4 \, (n+m))\), respectively); therefore, we apply them only if no cuts are generated by the rounding procedure described above.
All the generated inequalities are stored in a pool that is used for separation at every later cutting plane phase. See [28, 29] for more details on this method.
4.3 Oracle-based separation
One can generate valid (facet defining) inequalities violated by an arbitrary given point by means of an optimization oracle, in the case when the size of the matrix M is small. Our approach refers to so-called “local cuts”, see Applegate, Bixby, Chvátal, and Cook [1] and to the so-called “target cuts”, see Buchheim et al. [6].
4.3.1 The local cuts method
We first describe the general idea, which is nothing but a rephrasing of the simpler of the two directions of the polynomial-time equivalence of the separation and the optimization problem given, e.g., by Grötschel, Lovász, and Schrijver [21].
Assume that we are given a nonempty polyhedron \(P\subseteq \mathbb {R}^d\), a point \(x^\star \in \mathbb {R}^d\), and we want to solve the separation problem for P with respect to \(x^\star \). In addition, we have an (efficient) optimization oracle for the following problem:
for any \(c\in \mathbb {R}^d\).
The goal is to find an inequality \(\langle {a},{x}\rangle \geqslant a_0\) that is valid for P and violated by \(x^\star \), or show that \(x^\star \in P\) (for reasons that will be clear in the forthcoming discussion, here we deal with valid inequalities in the \(\geqslant \) form). This can be obtained by solving the following separation problem:
where V and R are the sets of vertices and of extreme rays, respectively, of P. Clearly, an optimal solution \((a^\star ,a^\star _0)\) to (LCSP) defines an inequality \(\langle {a^\star },{x}\rangle \geqslant a^\star _0\) that is valid for P because it satisfies (3) and (4) and that is violated by \(x^\star \) if the optimal value of (LCSP) is negative. The constraints (5) are used to guarantee that (LCSP) is always bounded.
Usually (LCSP) is solved with a delayed row generation, i.e., with a cutting plane procedure that iteratively constructs the sets of constraints (3)–(4). At each iteration of the algorithm, the current solution \(({{\bar{a}}}, {{\bar{a}}}_0)\) is checked for feasibility w.r.t. P. This can be done by solving (2) with \(c={{\bar{a}}}\), by means of the optimization oracle. If the optimal value is at least \({{\bar{a}}}_0\), then \(({{\bar{a}}},{{\bar{a}}}_0)\) is optimal for (LCSP) and we stop. Otherwise, the oracle either returns a finite optimal solution \({{\bar{x}}}\) with \(\langle {\bar{a}},{{{\bar{x}}}}\rangle <{{\bar{a}}}_0\) or a direction \({{\bar{r}}}\) with \(\langle {{{\bar{r}}}},{\bar{a}}\rangle <0\). In this case, the inequality \(\langle {{{\bar{x}}}},{a}\rangle -a_0\geqslant 0\) or the inequality \(\langle {{{\bar{r}}}},{a}\rangle \geqslant 0\), respectively, is added to the current constraint set (3)–(4), and the procedure iterates.
Recall that the separation problem (LCSP) discussed in this section has the purpose to provide the inequalities of a cutting plane procedure that solves an optimization problem over P. However, we just showed how to solve the separation problem (LCSP) over the same polyhedron P by solving a series of optimization problems over P, although with different objective functions. This approach may look bizarre at a first sight: why not to use the oracle upfront to optimize over P?
The key idea is to set up a procedure where Problem (2) is solved over a polyhedron \(\bar{P}\) whose size is much smaller than the one of the original polyhedron P. Once a separating inequality is generated in the space of \(\bar{P}\), some lifting technique is used to end up with an inequality in the original space. We sketch such a procedure for the case of WC1PP:
-
LC1)
We identify a submatrix \(\bar{M}\) of M, and we call \(\bar{X}^\star \) the corresponding submatrix of matrix \(X^\star \) and \(\bar{P} = P^+({\bar{M}})\) (for details, see Sect. 4.3.5);
-
LC2)
We apply the above described “local cut” procedure to find a valid separating inequality \(\langle {{{\bar{A}}}},{\bar{X}}\rangle \geqslant {\bar{\alpha }}\), using an optimization oracle over the polytope \(\bar{P}\);
-
LC3)
we finally lift such an inequality \(({{\bar{A}}},{{\bar{\alpha }}})\) to an inequality \((A,\alpha )\) that is valid for \(P^+({M})\) and is violated by \(X^\star \). To do so, we apply the trivial lifting procedure, whose polyhedral properties have been investigated in Sect. 3.2.
Observe that, if matrix \(\bar{M}\) is chosen sufficiently small, even an optimization oracle based on total enumeration of all feasible patchings can be used in the step LC2 of the above procedure. However, even if \(X^\star \notin P^+({M})\), there is no guarantee that also \(\bar{X}^\star \) falls outside \(P^+({\bar{M}})\). Therefore, if \(\bar{M}\) is too small, the odds that the procedure terminates with no separating inequality found are pretty high. Thus, a tradeoff has to be made in practice.
The separation process described so far is usually called dual separation. An alternative approach is the so-called primal separation where one seeks for a valid inequality violated by the current fractional solution that, in addition, is satisfied at equality by a given integral vertex p of the polyhedron P. The rationale behind this kind of separation is that, if p turns out to be an optimal solution, no inequalities will be generated that are not tight at the optimum and thus not necessary to prove optimality. When, as in our case, P has only 0/1 vertices, primal separation and optimization are polynomially equivalent [12].
In our context, primal separation with respect to an integer vertex p of P is simply achieved by adding the constraint
to the linear program (LCSP).
4.3.2 Generating local cuts of high dimensions
The inequalities generated by the method described in Sect. 4.3.1 in general define faces of the polytope \(\bar{P}\) of dimensions that are not necessarily maximal. Moreover, the lifting procedures, to generate the inequality in the original space, typically do not increase the dimension, unless significant computational efforts are spent. Therefore, it is advisable to modify the “local cut” scheme in order to produce inequalities that define high dimensional faces of \(\bar{P}\).
Applegate et al. [1] (see also Chvátal et al. [8]) presented a procedure, called “tilting”, that takes a separating inequality (possibly not facet defining) and terminates with a separating inequality that defines a facet of \(\bar{P}\). This procedure starts with a maximal set S of affinely independent points of \(\bar{P}\) which are roots of the current inequality and iteratively extends S with a new point that is found by a (possibly long) series of calls to the optimization oracle. The procedure stops when \(|{S} | = \text{ dim }(\bar{P})\).
Here we use the following, slightly different, approach to obtain the same result. As usual, we are given a polyhedron \(\bar{P}\) and a point \({{\bar{x}}}^\star \notin \bar{P}\) to be separated. Let \(\langle {a},{{{\bar{x}}}}\rangle \geqslant a_0\) be a valid inequality for \(\bar{P}\) with \(\langle {a},{{{\bar{x}}}^\star }\rangle < a_0\). We are also given a point \({{\bar{x}}}_0\in \bar{P}\). Possibly such a point is chosen to be in the interior of the polyhedron. Let \({{\bar{z}}}\) be the intersection of the segment \([{{\bar{x}}}^\star ,{{\bar{x}}}_0]\) with a facet of \(\bar{P}\). With probability 1 such a facet F is unique and \({{\bar{z}}}\) belongs to its interior. If this is not the case, let F be the intersection of all the facets of \(\bar{P}\) containing \({{\bar{z}}}\). The procedure terminates with an inequality that defines F.
The algorithm iteratively generates a sequence of points in the segment \([{{\bar{x}}}^\star ,{{\bar{z}}}]\), that starts with \({{\bar{x}}}^\star \) and ends with \({{\bar{z}}}\), and with a separating inequality for each of these points. At each iteration i, we have a point \({{\bar{x}}}_i\) that needs to be separated and we find a separating inequality by means of the optimization oracle. If such an inequality does not exist, \({{\bar{x}}}_i={{\bar{z}}}\) and we are done. Otherwise, let \(\langle {a^i},{\bar{x}}\rangle \geqslant a^i_0\) be the inequality generated; then we set \(\bar{x}_{i+1}\) to the point of the segment \([{{\bar{x}}}^\star ,{{\bar{x}}}_0]\) that satisfies \(\langle {a^i},{{{\bar{x}}}}\rangle \geqslant a^i_0\) at equality.
4.3.3 The target cuts method
A similar method was proposed by Buchheim et al. [6] for the case when P is a polytope and a point \(x_0\) in its interior is known, in particular, P is full-dimensional. The corresponding model is based on the solution of the following linear program
where, as before, V is the set of vertices of P. Let \(P_0 :=\{x-x_0\in \mathbb {R}^d \,:\,x\in P\}\) be the polytope P shifted by \(x_0\). By assumption, 0 belongs to the interior of \(P_0\). Observe that (TP) is derived from (LCSP) by setting \(P=P_0\). Therefore, (4) can be removed because \(P_0\) is a polytope and \(a_0\) can be set to \(-1\) without loss of generality, since 0 is an interior point of \(P_0\). Moreover also (5) can be removed because, by setting \(a_0\) to \(-1\), Problem (TP) cannot be unbounded.
An optimal solution to (TP) provides an inequality valid for \(P_0\) that is violated by \(x^\star -x_0\) if its value is strictly less than \(-1\).
The advantage of this approach is that such an inequality \(\langle {a^\star },{x-x_0}\rangle \geqslant -1\) is also facet defining for \(P_0\), if (TP) is solved by the simplex algorithm or by any other method that provides vertex solutions. This can be seen by observing that an optimal basis has n rows, corresponding to points of \(P_0\) that are necessarily linearly independent and are roots of \((a^\star ,-1)\), see [6].
Besides the fact that the knowledge of an interior point of P is mandatory, a possible drawback of this method is that the constraint matrix of (TP) is usually dense and has non-integral coefficients (due to the shifting by the vector \(x_0\)) also in the case when the vertices of P are sparse and binary.
As in the case of local cuts, Problem (TP) is solved with a delayed row generation performed by calling an optimization oracle for Problem (2).
4.3.4 Interior point
The procedures described in Sects. 4.3.2 and 4.3.3 need to be given a point \(x_0\) in the (strict) interior of P as input. Due to the well known Carathéodory’s Theorem, such a point can be obtained as the (strict positive) convex combination of \(d+1\) affinely independent points \(x_1, \dots , x_{d+1} \in P\). This task can be achieved rather easily in our case. Indeed, let \(\bar{M}^{\bar{m} \times \bar{n}}\) be the submatrix of M that we identified in order to produce a violated inequality and recall that the dimension d is the number of 0 entries of \(\bar{M}\). Consider the matrix \(\mathbb {1}^{\bar{m} \times \bar{n}}\) and the d matrices \(\mathbb {1}^{\bar{m} \times \bar{n}} - E_{ij}\), for all (i, j) such that \(\bar{M}(i,j) = 0\) (again \(E_{ij}\) is the \(\bar{m} \times \bar{n}\) matrix with entry (i, j) equal to one and all the other entries equal to zero). It is not difficult to see that these \(d+1\) matrices are affinely independent and that they are all C1P. If we take their convex combination with weights \(\frac{1}{d+1}\) we get a point \(X_0 \in [0,1]^{\bar{m} \times \bar{n}}\) in the strict interior of \(P^+({\bar{M}})\). In particular, \(X_0(i,j) = 1\), if \(M(i,j) = 1\) and \(X_0(i,j) = \frac{d}{d+1}\), otherwise.
4.3.5 Optimization oracles
As mentioned before, a key element in local or target cut generation is the optimization oracle for P. Since the optimization over \(P^+({M})\) is an NP-hard problem, it seems hard to avoid some kind of pseudo-enumeration. In particular, for small sizes of the matrix M a brute-force approach is reasonably fast.
It is possible to generate all feasible solutions of \({\mathscr {P}}^+({M})\) by generating all permutations of the columns of M. This operation, which is obviously done in n! steps, can be implemented with the Johnson-Trotter algorithm (see, e.g., [23]), which has the advantage of generating the next permutation by exchanging two consecutive columns, thus simplifying the objective function computation. For each such permutation, it is then easy to generate all positive patchings that make the permuted matrix, say \(\bar{M}\), strongly C1P, and to find the patching, say \(X^\star \), that minimizes the objective function \(\langle {C},{X}\rangle \). For each row i of \(\bar{M}\), let \(i_\ell \) and \(i_r\) be the column indices of its leftmost and of its rightmost 1-entry, respectively. Then necessarily, \(X^\star (i,j)=1\) for all \(i_\ell \leqslant j\leqslant i_r\). Moreover, we can extend the sequence of 1’s of \(X^\star \) to the left of \(i_\ell \) and to the right of \(i_r\) if the contribution to the objective function corresponding to each of such two extensions is negative. If row i in \(\bar{M}\) contains at least one 1, this operation can clearly be performed in O(n) time. If all entries of row i of \(\bar{M}\) are 0’s, the optimal sequence of consecutive 1’s can be found, still in O(n), by Kadane’s algorithm (see, e.g., Column 7 in [3]). In conclusion, the oracle runs in \(O(n\,m\,n!)\) time.
An interesting simplification occurs when WC1PP has a nonnegative objective function, which is the case in most of the applications, in particular in all those mentioned in the Sect. 1.
When \(C \geqslant 0\), the optimal solutions over \(P^+({M})\) and over \(D^+({M})\) coincide. Therefore, any optimal solution \(X^\star \) of the current linear relaxation is either optimal for WC1PP or it lies outside \(D^+({M})\). Thus, we can separate \(X^\star \) from \(D^+({M})\) instead of \(P^+({M})\). Since all valid inequalities of \(D^+({M})\) have nonnegative coefficients, the set R in Problem (LCSP) is the set of the d rays of \(\mathbb {R}^d_+\) and we can simplify the formulation accordingly.
Moreover, in this case, as an optimization oracle we can use a straightforward adaptation of the dynamic programming algorithm that de la Banda and Stuckey [11] presented for the Open Stack problem. For completeness we describe the version of this algorithm for the Weighted Positive C1P Patching problem with the cost matrix \(C \in \mathbb {R}_+^{m \times n}\).
Assume that we build up the strictly C1P optimal patching \(X^\star \) column by column, such that at a given point in the algorithm we have constructed a submatrix \(X^\star _{[m],S}\) whose set of columns is S, and we still have to complete it with columns from \(\bar{S} :=[n] \setminus S\).
Let \(s \in \bar{S}\) be some column that will be placed after S and before \(\bar{S} \setminus \{s\}\). Then, to make \(X^\star _{[m],S\cup \{s\}}\) strongly C1P, we have to put 1’s at the following rows in column s:
If we call \({{\,\mathrm{OP}\,}}({S})\) the optimal value of the matrix with set of columns S, we get the following dynamic programming recursion:
When adding a new column s to S, the set \({\mathcal {R}}(s)\) can be updated in \(O({m})\) time. Thus, the computation of \({{\,\mathrm{OP}\,}}({S})\) takes \(O({m\,n})\) time, if \({{\,\mathrm{OP}\,}}({S'})\) has been computed for all \(S' \subset S\). Since we have to consider all subsets S, we get a total time of \(O({m\,n\,2^n})\).
Remark 8
The implementation of this dynamic programming algorithm runs amazingly fast. Instances with up to 25 columns can be solved in under a minute, almost independently of the number of rows. For slightly more columns, however, the method breaks down due to memory requirements.
Observe that the dynamic programming based oracle cannot be used to generate target cuts for \(D^+({M})\), since the inequalities produced may need negative coefficients in general.
Remark 9
One key decision is how the submatrices on which we generate local cuts is chosen. In our implementation, we always choose submatrices with an adjustable number of columns (in the computations we evaluate using 8, 9, 10, 11 or 12 columns). Since both optimization oracles mentioned above are relatively insensitive to the number of rows, we always include all rows of the original matrix. Moreover, when we optimize over the dominant polyhedron \(D^+({M})\), we can use Theorem 6 in order to remove all rows with less than two 1s, or columns with all 0 entries, without weakening the facial properties of the generated separating inequality.
![figure a](http://media.springernature.com/lw685/springer-static/image/art%3A10.1007%2Fs12532-021-00203-z/MediaObjects/12532_2021_203_Figa_HTML.png)
![figure b](http://media.springernature.com/lw685/springer-static/image/art%3A10.1007%2Fs12532-021-00203-z/MediaObjects/12532_2021_203_Figb_HTML.png)
We have experimented with several methods to choose the submatrices and a combination of Tucker minors and a random choice turned out to be the best one. More explicitly, we perform a filtering technique to detect important submatrices. At the beginning, we generate a list of candidate submatrices, which we initialize with random matrices and with submatrices containing a Tucker minor (possibly filling up with random columns). The details are presented in Algorithm 1; we use \(R=40\), \(c=3\), as well as by default \(K=10\) for the dominant and \(K=7\) for the polytope case. During the algorithm, we generate cuts for each submatrix currently available and store the violation (efficacy) of the cut produced with respect to the current optimal LP-relaxation point. The matrices are then considered according to non-increasing geometric mean violation in the next round, see Algorithm 2 for details. This means that a submatrix that produced the most efficient cut the last time is used first in the next separation round. If submatrices do not produce a violated cut, they are removed from the list, possibly filling up with new random matrices. Additionally, two submatrices, which are selected using the current LP-solution, are used for separation, see Algorithm 2.
5 Algorithmic aspects
We have implemented a branch-and-cut algorithm to solve the positive patching problem. In this section, we describe the main algorithmic tools that have been used.
5.1 Preprocessing
Preprocessing steps are indispensable for solving practical problem instances of almost any optimization problem. We first consider some rules to reduce the size of the input matrix \(M \in \{0,1\}^{m \times n}\). Recall that the objective function is defined by the nonnegative \(C \in \mathbb {R}_+^{m \times n}\).
We consider the following general fact.
Lemma 4
Let \(X^\star \) be a feasible solution for the positive patching problem with respect to the matrix M and let \(I \in {\mathcal {O}}({m})\), \(J \in {\mathcal {O}}({n})\). Then the matrix \(X^\star _{IJ}\) is feasible for the positive patching problem w.r.t. the matrix \(M_{IJ}\) and \(\langle {C_{IJ}},{X_{IJ}^\star }\rangle \leqslant \langle {C},{X^\star }\rangle \).
Proof
Since \(X^\star \) is C1P, by Lemma 1, \(X_{IJ}^\star \) is a positive C1P patching for \(M_{IJ}\). Since \(C \geqslant 0\), the claim about the objective function follows.\(\square \)
We now have the following preprocessing steps.
Proposition 3
-
(1)
One can remove any row i of M that contains at most one 1 without changing the optimal value.
-
(2)
Rows with all ones can be removed in M without changing the optimal value.
-
(3)
One can remove zero columns in M without changing the optimal objective value.
-
(4)
If row i dominates row k, i.e., \(M(i,j) \geqslant M(k,j)\) for all \(j \in [n]\), then there exists some optimal solution that satisfies the following inequalities:
$$\begin{aligned} X(k,j) \leqslant X(i,j) \qquad \text {for all } j \in [n]. \end{aligned}$$If row i is equal to row k then there exists an optimal solution that satisfies:
$$\begin{aligned} X(k,j) = X(i,j) \qquad \text {for all } j \in [n]. \end{aligned}$$ -
(5)
If column j and \(\ell \) (\(j \ne \ell \)) of M are equal then one can remove either column and replace the cost coefficients for the other by the sum of the original coefficients of both columns without changing the optimal value.
-
(6)
If the bipartite graph that has M as adjacency matrix is disconnected, one can treat the connected components separately.
Proof
-
(1)
Consider an optimal solution \(X^\star \) for the total matrix. By Lemma 4, we have \(\langle {C_{IJ}},{X_{IJ}^\star }\rangle \leqslant \langle {C},{X^\star }\rangle \) for \(i \in [m]\), \(I \in {\mathcal {O}}({m})\) with \(i \notin I\), and \(J \in {\mathcal {O}}({n})\) with \(|{J} | = n\). Conversely, we can trivially lift every solution for \(M_{IJ}\) to a solution of M, if the number of ones in row i is at most 1: because there exists no Tucker matrix with at most one 1 in a row, the lifted matrix yields a feasible solution with the same objective value.
-
(2)
A similar argument as for Part (1) applies.
-
(3)
Using that there exists no Tucker matrix containing a zero column, we can again use similar arguments.
-
(4)
Assume that an optimal solution \(X^\star \) satisfies \(X^\star (k,j) = 1\) for some \(j \in [n]\). Then either we can set \(X^\star (k,j) = 0\) and still obtain an (optimal) solution or there are 1s in the original matrix M to the left and right of column j in any C1P ordering of \(X^\star \). Hence, there exist distinct columns s, \(t \in [n] \setminus \{j\}\), such that \(M(k,s) = M(k,t) = 1\). Since row k is dominated by row i, we have \(M(i,s) = M(i,t) = 1\), as well. It follows that \(X^\star (i,j) = 1\) is necessary to obtain a C1P matrix.
The second statement follows by reversing the roles of k and i.
-
(5)
We prove that there exists an optimal solution in which columns j and \(\ell \) agree: Consider an optimal solution \(X^\star \) and assume w.l.o.g. that
$$\begin{aligned} \sum _{i \in [m]} C(i,j) \leqslant \sum _{i \in [m]} C(i,\ell ). \end{aligned}$$Then we obtain a feasible solution \(Y^\star \) by setting
$$\begin{aligned} Y^\star (r,s) = {\left\{ \begin{array}{ll} X^\star (r,s) &{} \text {if }s \ne \ell \\ X^\star (r,j) &{} \text {if }s = \ell \end{array}\right. } \qquad \forall \; r \in [m],\; s \in [n]. \end{aligned}$$Solution \(Y^\star \) is feasible, because if \(Y^\star \) contains a Tucker minor, then \(X^\star \) contains a Tucker minor as well (there is no Tucker minor that contains equal columns). This shows that \(\langle {C},{Y^\star }\rangle \leqslant \langle {C},{X^\star }\rangle \), i.e., if \(X^\star \) is optimal, \(Y^\star \) is optimal as well.
-
(6)
If the bipartite graph is disconnected, M can be reordered into a block diagonal form:
$$\begin{aligned} \left( {\begin{matrix} M_1 &{}\quad 0 &{}\quad \dots &{}\quad 0\\ 0 &{}\quad M_2 &{}\quad \dots &{}\quad 0\\ \vdots &{}\quad \vdots &{}\quad \ddots &{}\quad \vdots \\ 0 &{}\quad 0 &{}\quad \dots &{}\quad M_k \end{matrix}} \right) , \end{aligned}$$where the \(M_i\)’s are rectangular submatrices of M. Clearly, to turn M C1P, it suffices to make the submatrices C1P. Since \(C \geqslant 0\), the result follows.
\(\square \)
Remark 10
All of the preprocessing steps of Proposition 3 are used in our code, except for Part (6), since no disconnected graphs occurred in any of the instances. The inequalities of Part (4) are created in advance and added on demand during the branch-and-cut loop.
Remark 11
An extension of the cases discussed in Proposition 3 is not easily possible:
-
(1)
There are Tucker matrices that contain rows with a single 0 (\(T^{1}_{1}\) and \(T^{2}_{k}\)), columns with all ones (\(T^{2}_{1}\) and \(T^{3}_{1}\)), columns with exactly one 1 (\(T^{5}\)), and columns with exactly one 0 (\(T^{1}_{1}\), \(T^{3}_{1}\), and \(T^{5}\)). Thus, one cannot (easily) preprocess these cases.
-
(2)
If in the bipartite graph defined by M there exists an articulation node, i.e., a node such that the graph is disconnected when deleting this node, one cannot (easily) decompose the problems. This case occurs, when there is a row or column that is shared by two “blocks”, see Fig. 5. A decomposition is not possible here, because using Tucker matrix \(T^{4}\) yields examples that “cross the blocks”, see again Fig. 5. Hence, one cannot solve the two parts independently, because in the example each block is C1P, while the total matrix is not.
5.2 Primal heuristic
To obtain good feasible solutions, we use methods of Oswald and Reinelt, see [28, 29]. The idea is as follows. We generate some order of the rows of the matrix M by using the current fractional LP-solution. We then add one row after the other and test whether the resulting matrix is C1P. Once the matrix is not C1P anymore, we backtrack one step and consider all permutations that certify the C1P—these permutations can be generated from the PQ-tree. We compute the cost of generating a C1P solution by adding 1s according to this fixed permutation; this is easy: just order the columns and fill in the 1s that are needed for a strict C1P matrix. Each of the permutations yields a feasible primal solution.
This method is very successful, because it is able to test quite a number of permutations in a small amount of time.
6 Computational results
We implemented the discussed algorithms using a bugfix version of SCIP 4.0.1, see [26, 32]. We use CPLEX 12.7.1 as the underlying LP solver. The computations were performed on a cluster with 3.5 GHz Intel Xeon E5-1620 Quad-Core CPUs, having 32 GB main memory and 10 MB cache running Linux. All computations were performed single threaded. The time limit is 1 h.
6.1 Data sets
In order to evaluate the performance of the algorithms, in particular, local cuts, we created a testset as follows. We considered the following instances for the Weighted Positive C1P Patching problem:
-
5807 instances from the Constraint Programming Modeling Challenge 2005, available at http://www.dcs.st-and.ac.uk/~ipg/challenge,
-
250 instances from Faggioli and Bentivoglio [13],
-
11 instances based on the VLSI application [10].
We first filtered out all instances that had less then 20 columns, since these can be easily handled by dynamic programming. After this filtering the number of columns for all instances ranges from 20 to 30. We then sorted out instances for which a basic version of our code (RS-base, see below) took longer than one hour. This leaves 197 instances in a testset, which we call testopt. The instances not solved by the basic version within one hour are sorted by their gap into sets with gap in \((0,10]\%\), \((10,20]\%\), and \((20,30]\%\); we call the testsets testgap0-10, testgap10-20, and testgap20-30, respectively.
Details of the following results are given in an online supplement.
6.2 Results for preprocessing
On each input, we apply the preprocessing steps described in Sect. 5.1. Table 4 in the “Appendix” shows the number of rows and columns before and after preprocessing for each instance in the testopt testset. The effect depends on the particular matrix. The number of removed rows varies from 0 to 20 and the number of removed columns from 0 to 6. The average number of removed rows and columns is only 0.78 and 0.83, respectively. Thus, the effect is limited on average on this testset. However, preprocessing is cheap and it can be extremely effective on some instances. For example, when applied to some real world instances from manufacturing for the open stack problem, the resulting sizes become so small that all instances can be solved within seconds; we therefore do not report these results here.
Moreover, during preprocessing we search for Tucker minors as described in Sect. 4.1. The results are again shown in Table 4 in the “Appendix”. The number of found minors varies, but can be quite substantial. As described in Sect. 4.1, these Tucker minors are used to generate inequalities into a pool, which are later used in separation. Table 4 shows that the number of these cuts varies from 35 to 603 869.
6.3 Results with local cuts
We ran several variants of local cuts on the testopt test set. This includes local cuts (LC), local cuts with tilting (LCT), and target cuts (TC). For each basic variant, we consider subvariants. We vary the frequency of depths at which cuts are separated (from 0, i.e., only at the root node, to 5, i.e., every fifth depth level of the tree); this is indicated by the number attached to the basic variants, e.g., LCT1. Moreover, we vary the number of columns in the submatrix considered for separation (between 6 and 12), where 10 is the default for LC and LCT; this is indicated by attaching “size”, e.g., LCT1-size8. Finally, we consider the variant with primal separation, e.g., LCT1-primal, and a variant in which we turn the reduction of the submatrix sizes off, e.g., LCT1-nored. In order to reduce the effects of heuristics, we initialized the runs with an optimal solution in this section.
As a base case to compare with, we use three different settings using the separation methods described in Sect. 4 that do not apply oracles:
-
RS-base refers to the separation of dictionary inequalities (Sect. 4.1) and rounding inequalities (Sect. 4.2);
-
OR-base refers to the techniques that were used by Oswald and Reinelt, i.e., rounding inequalities and the exact separation of the inequalities in Theorem 2, see Sect. 4.2;
-
base refers to the separation of all three previously mentioned techniques.
The results are given in Table 1. The table shows the shifted geometric meanFootnote 1 of the number of nodes in the branch-and-bound-tree, the shifted geometric mean of the CPU time in seconds, the number of instances that could be solved within the time-limit (among 197), the geometric mean of the number of calls to the separation routine, the geometric mean of the number of cuts added to the LP, the shifted geometric mean of the total time used for separation, and the average gap of the root node. For the base settings, the last three numbers refer to the basic separation via Tucker minors, while for all other variants, the numbers refer to local cuts only.
Solving time diagram for local cuts with tilting with different separation frequencies on testopt: The x-axis depicts solving time and is truncated at 1000 seconds for better visibility, the y-axis shows the percentage of instances solved within the given time. LCT1 and LCT0 correspond to the left and right most solid line, respectively
We can draw the following conclusions:
-
Variant LCT1-size9 and LCT1-size11 are the overall best variants in terms of the average solving time, very closely followed by LCT1, which produces less nodes in comparison to the first two.
-
All variants of local cuts with tilting (LCT...), with the exception of variant LCT1-size12, are faster than the other local cut variants, see also Fig. 6.
-
Comparing LCT1 and LC1 shows that tilting significantly improves the performance of local cuts.
-
Target cuts are clearly the slowest: all target cuts are slower than the variants of any other type. This is because the separation needs too many LP-solves in order to converge to a possibly violated cut. Consequently, using target cuts only in the root node (TC0) is faster than the other target cut variants, because it limits this slow-down.
-
When varying the separation frequency of local cuts with tilting, separation in every node (LCT1) is the best option in terms of average performance, but LCT2 is closely behind and has a slightly smaller maximal solving time, see Fig. 7.
-
Primal separation is not successful, but LC1-primal slightly improves on LC1.
-
Turning off the submatrix reduction does not significantly increase the run times.
-
Increasing or decreasing the size of the submatrix has different effects for the different variants: For LCT1, the right choice seems to be unclear, but 9, 10 or 11 columns produce excellent results. For LC1, smaller sizes seem to be better. For TC1, the size does not significantly change the results.
6.4 Results for unsolved instances
The previous computations show the improvement of the additional cutting planes over RS-base. Most variants solved all 197 instances in the testopt testset. We now consider the instances that could not be solved by the RS-base settings within one hour in order to see the additional effect of cutting planes and local cuts in particular. Moreover, we consider the influence of the heuristics. Thus, we do not initialize the optimization runs with an optimal solution. The result on the corresponding testsets testgap0-10, testgap10-20, testgap20-30 are displayed in Table 2.
The results show that LCT1 is able to solve a significant number of instances within the time limit that cannot be solved by RS-base. In fact, LCT1 solves about 93 % of the instances in testgap0-10 and about 59 % in testgap10-20. However, the solution becomes significantly more difficult for the instances in which RS-base had a large gap. For example, LCT1 can only solve about 7 % of the instances in testgap20-30. Nevertheless, these results show the strength of the approach via local cuts with tilting.
6.5 Results of the heuristic
In this section, we investigate the effect of applying the heuristic explained in Sect. 5.2. To this end, we run base and LCT1 on the testopt testset with and without initializing with an optimal solution. The results are shown in Table 3. The last three columns display the geometric mean of the number of calls to the heuristic, the geometric mean of the number of solutions found, and the shifted geometric mean of the time spent in the heuristic.
Not initializing with an optimal solution shows a slowdown by about 12 % for base and by about 10 % for for LCT1. Surprisingly, the number of nodes even slightly decreases for the heuristic variant in shifted geometric mean. However, this is an artifact of the mean, since the total number of nodes slightly increases. In any case, the time difference essentially comes from the time needed for running the heuristic.
7 Conclusions
We considered the weighted positive C1P patching problem, as a variant of the weighted C1P problem. The problem is NP-hard and it has several applications, specially defined on weight matrices with nonnegative entries. In the paper, we exploited the polyhedral properties of the positive patching polytope \(P^+({M})\) in order to design a new branch-and-cut algorithm to solve the problem to optimality. In particular, we first extended some facet defining inequalities to \(P^+({M})\) that where known for the C1P polytope, we gave sufficient conditions for the 0-lifting procedure to produce facet defining inequalities, and we presented polyhedral properties of the dominant polyhedron of \(P^+({M})\).
Then we defined separation procedures for a large set of families of valid inequalities that we used as cutting planes in our implementation of a branch-and-cut algorithm. Among these separation procedures, we in particular focused on oracle-based methods for the on-line generation of valid inequalities.
We finally tested the overall solution algorithm via extensive computational experiments on instances taken from the literature. The results clearly show that the oracle-based methods are very effective. This good performance also results from the right choice of parameters, e.g., frequency and submatrix size. In general, this approach seems to be well suited for optimization problems for which it is difficult to obtain a polyhedral description like the weighted positive C1P patching problem.
Notes
The shifted geometric mean of values \(t_1, \dots , t_n\) with shift s is defined as
$$\begin{aligned} \big (\prod (t_i + s)\big )^{1/n} - s. \end{aligned}$$We use a shift \(s = 10\) for time and \(s = 100\) for branch-and-bound nodes in order to decrease the strong influence of very easy instances in the mean values.
References
Applegate, D., Bixby, R., Chvátal, V., Cook, W.: The Traveling Salesman Problem: A Computational Study. Princeton University Press, Princeton (2006)
Baptiste, P.: Simple MIP formulations to minimize the maximum number of open stacks. In: Smith, B.M., Gent, I.P. (eds.) Proceedings of IJCAI’05—Constraint Modelling Challenge 2005, pp. 9–13. Edimburgh (2005)
Bentley, J.: Programming Pearls. Addison-Wesley, Reading (1986)
Booth, K.S.: PQ-tree algorithms. Ph.D. thesis, University of California Berkeley (1975)
Booth, K.S., Lueker, G.S.: Testing for the consecutive ones property, interval graphs, and graph planarity using PQ-tree algorithms. J. Comput. Syst. Sci. 13, 335–379 (1976)
Buchheim, C., Liers, F., Oswald, M.: Local cuts revisited. Oper. Res. Lett. 36(4), 430–433 (2008)
Christof, T., Jüunger, M., Kececioglu, J., Mutzel, P., Reinelt, G.: A branch-and-cut approach to physical mapping of chromosomes by unique end-probes. J. Comput. Biol. 4, 433–447 (1997)
Chvátal, V., Cook, W., Espinoza, D.: Local cuts for mixed-integer programming. Math. Program. Comput. 5, 171–200 (2013)
De Giovanni, L., Brentegani, L., Festa, M.: New facets for the consecutive ones polytope. Tech. rep., Optimization Online (2018). http://www.optimization-online.org/DB_HTML/2018/06/6674.html
De Giovanni, L., Massi, G., Pezzella, F., Pfetsch, M., Rinaldi, G., Ventura, P.: A heuristic and an exact method for the gate matrix connection cost minimization problem. Int. Trans. Oper. Res. 20(5), 627–643 (2013). https://doi.org/10.1111/itor.12025
de la Banda, M.G., Stuckey, P.J.: Dynamic programming to minimize the maximum number of open stacks. INFORMS J. Comput. 19(4), 607–617 (2007)
Eisenbrand, F., Rinaldi, G., Ventura, P.: Primal separation for 0/1 polytopes. Math. Program. 95, 475–491 (2003)
Faggioli, E., Bentivoglio, C.A.: Heuristic and exact methods for the cutting sequencing problem. Eur. J. Oper. Res. 110, 564–575 (1998)
Fink, A., Voß, S.: Applications of modern heuristic search methods to pattern sequencing problems. Comput. Oper. Res. 26, 17–34 (1999)
Fukuda, K.: cdd home page. http://www.cs.mcgill.ca/~fukuda/soft/cdd_home/cdd.html
Fulkerson, D., Gross, O.: Incidence matrices and interval graphs. Pac. J. Math. 15(3), 835–855 (1965)
Gawrilow, E., Joswig, M.: polymake: a framework for analyzing convex polytopes. In: Kalai, G., Ziegler, G.M. (eds.) Polytopes—Combinatorics and Computation, DMV Seminar, vol. 29, pp. 43–74. Birkhäuser, Basel (2000)
Gawrilow, E., Joswig, M.: polymake: an approach to modular software design in computational geometry. In: Proceedings of the 17th Annual Symposium on Computational Geometry, pp. 222–231. ACM (2001)
Gawrilow, E., Joswig, M.: polymake: Version 2.1.0. http://www.math.tu-berlin.de/polymake (2007)
GNU Multiple Precision Arithmetic Library. http://gmplib.org
Grötschel, M., Lovász, L., Schrijver, A.: Geometric Algorithms and Combinatorial Optimization. Algorithms and Combinatorics, vol. 2, 2nd edn. Springer, Heidelberg (1993)
Kendall, D.: Incidence matrices, interval graphs and seriation in archaeology. Pac. J. Math. 28, 565–570 (1969)
Kreher, D., Stinson, D.: Combinatorial Algorithms: Generation, Enumeration, and Search, vol. 7. CRC Press, Cambridge (1998)
Lekkerkerker, C., Boland, J.: Representation of a finite graph by a set of intervals on the real line. Fund. Math. 51, 45–64 (1962)
Linhares, A., Yanasse, H.H.: Connections between cutting-pattern sequencing, VLSI design, and flexible machines. Comput. Oper. Res. 29, 1759–1772 (2002)
Maher, S.J., Fischer, T., Gally, T., Gamrath, G., Gleixner, A., Gottwald, R.L., Hendel, G., Koch, T., Lübbecke, M.E., Miltenberger, M., Müller, B., Pfetsch, M.E., Puchert, C., Rehfeldt, D., Schenker, S., Schwarz, R., Serrano, F., Shinano, Y., Weninger, D., Witt, J.T., Witzig, J.: The SCIP optimization suite 4.0. Tech. rep., Optimization Online (2017). http://www.optimization-online.org/DB_HTML/2017/03/5895.html
Oswald, M.: Weighted consecutive ones problems. Ph.D. thesis, University of Heidelberg (2003)
Oswald, M., Reinelt, G.: Constructing new facets of the consecutive ones polytope. In: Jünger, M., Reinelt, G., Rinaldi, G. (eds.) Combinatorial Optimization—Eureka, You Shrink! Papers Dedicated to Jack Edmonds, 5th International Workshop, Aussois, 2001, LNCS, vol. 2570, pp. 147–157. Springer, Berlin (2003)
Oswald, M., Reinelt, G.: Computing optimal consecutive ones matrices. In: Grötschel, M. (ed.) The Sharpest Cut, The Impact of Manfred Padberg and His Work, Optimization, pp. 173–184. MPS/SIAM (2004)
Papadimitriou, C.H.: The NP-completeness of the bandwidth minimization problem. Computing 16(3), 263–270 (1976)
Roberts, F.: Discrete Mahematical Models with Applications to Social, Biological, and Environmental Problems. Prenctice-Hall, Englewood Cliff (1976)
SCIP: Solving Constraint Integer Programs. http://scip.zib.de/
Tucker, A.: A structure theorem for the consecutive 1’s property. J. Comb. Theory Ser. B 12, 153–162 (1972)
Acknowledgements
We thank Sebastian Leipert for supplying his PQ-tree code. Moreover, we thank the three reviewers for their valuable comments and helpful suggestions.
Funding
Open Access funding enabled and organized by Projekt DEAL.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix
Appendix
See Table 4.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Pfetsch, M.E., Rinaldi, G. & Ventura, P. Optimal patchings for consecutive ones matrices. Math. Prog. Comp. 14, 43–84 (2022). https://doi.org/10.1007/s12532-021-00203-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12532-021-00203-z