Abstract
Decomposition of large matrix inequalities for matrices with chordal sparsity graph has been recently used by Kojima et al. (Math Program 129(1):33–68, 2011) to reduce problem size of large scale semidefinite optimization (SDO) problems and thus increase efficiency of standard SDO software. A byproduct of such a decomposition is the introduction of new dense smallsize matrix variables. We will show that for arrow type matrices satisfying suitable assumptions, the additional matrix variables have rank one and can thus be replaced by vector variables of the same dimensions. This leads to significant improvement in efficiency of standard SDO software. We will apply this idea to the problem of topology optimization formulated as a large scale linear semidefinite optimization problem. Numerical examples will demonstrate tremendous speedup in the solution of the decomposed problems, as compared to the original large scale problem. In our numerical example the decomposed problems exhibit linear growth in complexity, compared to the more than cubic growth in the original problem formulation. We will also give a connection of our approach to the standard theory of domain decomposition and show that the additional vector variables are outcomes of the corresponding discrete Steklov–Poincaré operators.
Introduction
General purpose algorithms and software for semidefinite optimization (SDO) are dominated by interior point and barrier type methods. Any such software exhibits two bottlenecks regarding computational complexity, and thus CPU time, and memory requirements. The first one is the evaluation of the system matrix (Schur complement matrix or Hessian of augmented Lagrangian) in every step of the underlying Newton method. The second one is then the solution of a linear system with this matrix. For problems with large matrix inequalities, it is often the first bottleneck that dominates the CPU time and that prevents the user from solving large scale problems.
To circumvent this obstacle, the technique of decomposition of a large matrix inequality into several smaller ones proved to be efficient, at least for certain classes of problems. Decomposition of positive semidefinite matrices with a certain sparsity pattern was first investigated in Agler et al. [1] and, independently, by Griewank and Toint [4]. An extensive study has been recently published by Vandenberghe and Andersen [13]. We will call this technique chordal decomposition. It was first used in semidefinite optimization by Kojima and his coworkers; see [3, 10] and, more recently, [8]. The group also developed a preprocessing software for semidefinite optimization named SparseCoLO [2] that performs the decomposition of matrix constraints automatically.
The goal of this paper is twofold. Firstly, we introduce a new decomposition of arrow type positive semidefinite matrices called arrow decomposition. Unlike the chordal decomposition that generates additional dense matrix variables, arrow decomposition only requires additional vector variables of the same size, leading to significant reduction of number of variables in the decomposed problem. The second goal is to apply both decomposition techniques to the topology optimization problem. This problem arises from finite element discretization of a partial differential equation. We will show that techniques known from domain decomposition can be used to define the matrix decomposition. In particular, we will be able to control the number and size of the decomposed matrix inequalities. Even when using the chordal decomposition, this will allow us to gain tremendous speedup when compared to approaches based on automatic chordal completion as in [2]. We will also give a connection of the arrow decomposition with the theory of domain decomposition and show that the additional vector variables are outcomes of the corresponding discrete SteklovPoincaré operators.
To solve all semidefinite optimization problems, we will use the state of the art solver MOSEK [9]. Numerical examples will demonstrate tremendous speedup in the solution of the decomposed problems, as compared to the original large scale problem. Moreover, in our numerical examples the arrow decomposition exhibits linear growth in complexity, compared to the higher than cubic growth when solving the original problem formulation.
Notation Let \(\mathbb {S}^n\) be the space of \(n\times n\) symmetric matrices, \(A\in \mathbb {S}^n\), and \(I\subset \{1,\ldots ,n\}\) with \(s=I\). We denote

by \((A)_{i,j}\) the (i, j)th element of A;

by \((A)_I\) the restriction of A to \(\mathbb {S}^s\), i.e., the \(s\times s\) submatrix of A with row and column indices from I ;

by \(O_{m,n}\) the \(m\times n\) zero matrix; when the dimensions are clear from the context, we simply use O.
A matrix is called dense if all its elements are nonzeros. Otherwise, the matrix is called sparse. A matrixvalued function A(x) is called dense if there exists \({\bar{x}}\) such that \(A({\bar{x}})\) is dense.
Let \(A\in \mathbb {S}^n\). The undirected graph G(N, E) with \(N=\{1,\ldots ,n\}\) is called sparsity graph of A (or just graph of A) when \((i,j)\in E\) if and only if \((A)_{i,j}\not = 0\).
For an index set \(I\subset \{1,\ldots ,n\}\) we define
Furthermore, let G(N, E) be an undirected graph with \(N=\{1,\ldots ,n\}\) and edge set \(E\subseteq N\times N\). We define
and analogously \(\mathbb {S}^n_+(G)\).
Let \(G_s(N_s,E_s)\) be an induced subgraph of G(N, E). Notice the difference between \(\mathbb {S}^n(G_s)\) and \(\mathbb {S}^n(N_s)\). If \(A\in \mathbb {S}^n(N_s)\) then its restriction \((A)_{N_s}\) is a dense matrix. This is not true for \(A\in \mathbb {S}^n(G_s)\), the sparsity pattern of which is given by the set of edges \(E_s\). In particular, \(\mathbb {S}^n(G_s) = \mathbb {S}^n(N_s)\) if and only if \(G_s\) is a maximal clique.
Finally, for functions from \(\mathbb {R}^d\rightarrow \mathbb {R}\) we will use bold italics (such as \({\varvec{u}}\) or \({\varvec{u}}(\xi )\)), while for vectors resulting from finite element discretization of these functions, we will use the same symbol but in italics (e.g. \(u\in \mathbb {R}^n\)).
Decomposition of positive semidefinite matrices
Matrices with chordal sparsity graphs
We first recall the wellstudied case of matrices with chordal sparsity graph. The following theorem was proved independently by Grone et al. [5], Griewank and Toint [4] and by Agler et al. [1]. A new, shorter proof can be found in [7].
Theorem 1
Let G(N, E) be an undirected graph with maximal cliques \(C_1,\ldots ,C_p\). The following two statements are equivalent:

(i)
G(N, E) is chordal.

(ii)
For any \(A\in \mathbb {S}^n(G)\), \(A\succeq 0\), there are matrices \(Y_k\in \mathbb {S}_+^n(C_k)\), \(k=1,\ldots ,p\), such that \(A = Y_1+Y_2+\cdots +Y_p\).
Notice that this decomposition is not unique. However, Kakimura [7] has shown that there exist matrices \(Y^*_k\) minimizing \(\sum \nolimits _{k=1}^p\mathrm{rank}\,Y_k\) subject to \(\sum \nolimits _{k=1}^p Y_k = A\) and \(Y_k\in \mathbb {S}_+^n(C_k)\) (\(k=1,\ldots ,p\)) and that \(\sum \nolimits _{k=1}^p \mathrm{rank}\,Y^*_k = \mathrm{rank}\,A \).
Matrices embedded in those with a chordal sparsity graph
Let \(A\in \mathbb {S}^n\), \(n\ge 3\), with a sparsity graph \(G=(N,E)\). Let the set of nodes \(N=\{1,2,\ldots ,n\}\) be partitioned into \(p\ge 2\) overlapping sets
Let \(I_{k,\ell }\) denote the intersection of the kth and \(\ell \)th set, i.e.,
with
Assumption 1
Let \(1\le k\le p\). There exists at least one index \(\ell \) with \(1\le \ell \le p\), \(\ell \not = k\), such that \(I_k\cap I_{\ell }\not =\emptyset \).
Assumption 2
\(I_k\cup I_\ell \not = I_k\) for all \(1\le k,\ell \le p\), \(k\not =\ell \), i.e., no \(I_\ell \) is a subset of any \(I_k\).
Assumption 3
The intersections are “sparse” in the sense that for each \(k\in \{1,\ldots ,p\}\) there are at most \(p_k\) indices \(\ell _i\) such that \(I_k\cap I_{\ell _i}\not =\emptyset \), \(i=1,\ldots ,p_k\), where \(1\le p_k\ll p\).
In a typical situation only \(I_{k,k+1}\), \(k=1,\ldots ,p1\), are not empty (corresponding to a block diagonal matrix with overlapping blocks) or \(I_k\) has a nonempty intersection with up to eight other sets (see Sect. 4).
Denote the induced subgraphs of G(N, E) corresponding to \(I_k\) by \(G_k(I_k,E_k)\), \(k=1,\ldots ,p\). These subgraphs are not necessarily cliques.
Lemma 1
Let A be defined as above and Assumptions 1–3 hold. Then there exist matrices \(Q_k\in \mathbb {S}^n(G_k)\) such that
The proof of the above lemma is obvious, as the principal submatrices associated with the subgraphs \(G_k(I_k,E_k)\) cover all the nonzeros in A. However, although matrices \(Q_k\) are obviously nonunique, in our application in Sect. 3 they will be specified a priori and will be, in fact, used for the construction of the matrix A.
For all \(k=1,\ldots ,p\), let \({\widehat{G}}_k(I_k,{\widehat{E}}_k)\) denote a completion of \(G_k(I_k,E_k)\), i.e., a clique in G(N, E). According to Assumption 2, \({\widehat{G}}_k(I_k,{\widehat{E}}_k)\) are even maximal cliques. Clearly, \(Q_k\in \mathbb {S}^n({\widehat{G}}_k)\).
Assumption 4
The union \({\widehat{G}}(N,{\widehat{E}}) := \bigcup \nolimits _{k=1}^p {\widehat{G}}_k(I_k,{\widehat{E}}_k)\) is a chordal graph.
The graph \({\widehat{G}}(N,{\widehat{E}}) \supset G(N,E)\) is called a chordal extension of G(N, E); see, e.g., [13, Section 8.3].
Notice that the rather restrictive Assumption 4 is satisfied when A is a block diagonal matrix with overlapping blocks. It may not be satisfied in the application in Sect. 4; we will see, however, that it will not be needed in this application.
Theorem 2
Let A be defined as above and Assumptions 1–4 hold. The following two statements are equivalent:

(i)
\(A\succeq 0\).

(ii)
There exist matrices \(S_{k,\ell }\in \mathbb {S}^n(I_{k,\ell }),\ (k,\ell )\in \varTheta _p\), such that
$$\begin{aligned} A = \displaystyle \sum _{k=1}^p {\widetilde{Q}}_k \text{ with } {\widetilde{Q}}_k = Q_k \sum _{\ell :\ell <k}S_{\ell ,k}+\sum _{\ell :\ell >k}S_{k,\ell } \end{aligned}$$and
$$\begin{aligned} {\widetilde{Q}}_k\succeq 0\quad k=1,\ldots ,p. \end{aligned}$$If \(I_{k,\ell }=\emptyset \) or is not defined then \(S_{k,\ell }\) is a zero matrix.
Proof
Using the chordal extension \({\widehat{G}}(N,{\widehat{E}})\) of G(N, E), we embed the matrix A into a set of matrices with chordal sparsity graphs with maximal cliques \({\widehat{G}}_k(I_k,{\widehat{E}}_k)\), \(k=1,\ldots ,p\). Then we can apply Theorem 1. Hence there exist matrices \(Y_k\in \mathbb {S}_+^n(I_k)\), \(k=1,\ldots ,p\), such that \(A=Y_1+\cdots +Y_p\). Now, \(Y_k\) must be equal to \(Q_k\) for the “internal” indices of \(I_k\), i.e., for all \((i,j)\in \left( I_k\backslash \left( \bigcup _{\ell :\ell >k}(I_{k,\ell })\cup \bigcup _{\ell :\ell <k}(I_{\ell ,k})\right) \right) ^2\). Therefore the unknown elements of \(Y_k\) reduce to the overlaps \(I_{k,\ell }\).
Having \(Q_k\) and \(Y_k\), \(k=1,\ldots ,p\), we will now define the matrices the \(S_{k,\ell }\) as follows. Firstly, for \(k=1\) we select any solution \(\left\{ S_{1,\ell }\right\} _{I_{1,\ell }\not =\emptyset }\) of the equation
Notice that many elements of matrices \(S_{1,\ell }\) \((I_{1,\ell \not =\emptyset })\) are uniquely defined by this equation. Only elements with indices from nonempty intersections \(I_{1,\ell }\cap I_{1,k}\) are not unique, as they appear in more than one matrix \(S_{\bullet ,\bullet }\) in the above equation.
Now, for \(1<k< p\), we solve the equation
All matrices \(S_{\ell ,k},\ \ell <k,\) were defined in steps \(1,\ldots ,k1\), hence we are in the same situation as above and select any solution \(\left\{ S_{k,\ell }\right\} _{\ell >k,I_{k,\ell }\not =\emptyset }\) of the above equation. Any selection of the nonunique elements of \(S_{\bullet ,\bullet }\) will be consistent with the last equation
because we know that \(A = \sum _{k=1}^p Y_k = \sum _{k=1}^p Q_k\). Therefore \(A = \sum _{k=1}^p{\widetilde{Q}}_k\) and the assertion follows.\(\square \)
Theorem 2 allows us to define the decomposition at our will, within the limits of the assumptions; even for matrices with chordal sparsity graph the decomposition does not have to be driven by the maximal cliques. This is illustrated in the following example.
Example 1
Consider a \(7\times 7\) fivediagonal matrix as schematically depicted in Fig. 1a; here crosses represent nonzero real numbers. The sparsity graph of this matrix is shown in Fig. 1b. This graph is chordal with six maximal cliques corresponding to the six triangles. Following Theorem 1, the chordal decomposition will use six principal submatrices shown in Fig. 1a. However, using Theorem 2 we can choose to decompose the matrix to only two principal submatrices, as shown in Fig. 1c. In this case, \(I_1=\{1,2,3,4,5\}\), \(I_2=\{4,5,6,7,8\}\) and \(I_{1,2}=\{4,5\}\). The corresponding chordal extension with two maximal cliques is shown in Fig. 1d. \(\square \)
Arrow type matrices
Let us now consider a particular type of sparse matrices, the arrow type matrices. Let again \(A\in \mathbb {S}^n\), \(n\ge 3\), and let \(I_k\), \(I_{k,\ell }\) and \(G_k(I_k,E_k)\), \(k=1,\ldots ,p\), be defined as in the previous section.
Assume again that A is a sum of matrices associated with \(G_k\):
Further, let \(B\in \mathbb {R}^{n\times m}\), \(B=\sum \nolimits _{k=1}^p B_k\) with \(B_k\), \(k=1,\ldots ,p\), being rectangular matrices such that
and assume that
We also define
and
Finally, let \(C\in \mathbb {S}^m\) be positive definite. We define the following arrow type matrix:
According to the definition of \(A_k\) and \(B_k\), we have that
The simplest example of an arrow type matrix is a block diagonal matrix with overlapping blocks and with additional rows and columns corresponding to matrices B and C. The next example presents another typical situation.
Example 2
Consider a \(7\times 7\) matrix as shown in Fig. 2a. The sparsity graph of this matrix is shown in Fig. 2b. This graph is not chordal: the cycle 1–2–3–4–5–6–1 does not have a chord. Let \(I_1=\{1,2,3,4\}\), \(I_2=\{3,4,5,6\}\), \(I_3=\{1,2,5,6\}\) and thus \({{{\widehat{I}}}}_{k} = {I}_{k}\cup \{7\}\). Notice that, due to (1), \(I_3\) must contain at least two nodes from \(I_1\). This decomposition satisfies Assumptions 1–4. In particular, if we extend all subgraphs associated with the decomposition to cliques, we will obtain a dense matrix with a complete, i.e., chordal sparsity graph; hence also Assumption 4 is satisfied. \(\square \)
Notice that the structure of the overlapping blocks can be more complicated and that, in general, A (the arrow “shaft”) does not have to be a band matrix. Such matrices arise in the application introduced later in Sect. 3; see Figs. 6 and 7. In this application, we will have \(m=1\), so that B will be an nvector and \(C\in \mathbb {R}\). However, in this section we consider the more general situation which may be useful in other applications.
Before going on, we need the following auxiliary result. It tells us that we do not need to consider all intersections of the extended sets \({\widehat{I}}_k\) but only those that are extensions of \(I_{k,\ell }\), i.e., only \({\widehat{I}}_{k,\ell }\) as defined in (2).
Lemma 2
Let \(G(N_G,E_G)\) be a chordal graph with maximal cliques \(G_k(I_k,E_k)\), \(k=1,\ldots ,p\). Let \(H(N_H,E_H)\) be a complete graph, disjoint with G. Define
where \(E_{GH}\) contains all edges with one vertex in \(N_G\) and one vertex in \(N_H\). Define the extension of G as \({\widetilde{G}}({\widetilde{N}} ,{\widetilde{E}} )\). Similarly, define \({\widetilde{G}}_k({\widetilde{I}}_k ,{\widetilde{E}}_k )\) with
where \(E_{kH}\) contains all edges with one vertex in \(I_k\) and one vertex in \(N_H\). Then \({\widetilde{G}}({\widetilde{N}} ,{\widetilde{E}} )\) is a chordal graph with maximal cliques \({\widetilde{G}}_k({\widetilde{I}}_k ,{\widetilde{E}}_k )\), \(k=1,\ldots ,p\).
Proof
Obviously, \({\widetilde{G}}_k({\widetilde{I}}_k ,{\widetilde{E}}_k )\) are cliques, as all vertices in \({\widetilde{I}}_k\) are adjacent, by assumption (\(G_k\) is a clique and H is complete) and by construction. Further, by construction, every maximal clique \(G_k(I_k,E_k)\) is included in some clique in \({\widetilde{G}}({\widetilde{N}} ,{\widetilde{E}} )\). Now suppose that \(K(N_K,E_K)\) is a maximal clique in \({\widetilde{G}}\); then \(N_H\subset N_K\). We want to show that \(K\backslash H\) is a maximal clique in G. Assume, by contradiction, that it is not. Then there is a vertex \(v\in G\) such that a graph with vertices \(v\cup (N_K\backslash N_H)\) is a clique in G. Hence a graph with vertices \(N_K\cup v\) is a clique in \({\widetilde{G}}\) which contradicts maximality of K. Finally, \({\widetilde{G}}\) is chordal, as any newly created cycle with vertices in \(N_H\) contains a chord in \(E_{GH}\).\(\square \)
We can now adapt Theorem 2 to the arrow type structure.
Corollary 1
Let Assumptions 1–4 hold. Let M be defined as in (3). The following two statements are equivalent:

(i)
\(M\succeq 0\).

(ii)
There exist matrices \(S_{k,\ell }\in \mathbb {S}^n({\widehat{I}}_{k,\ell }),\ (k,\ell )\in \varTheta _p\), such that
$$\begin{aligned} M = \displaystyle \sum _{k=1}^p {\widetilde{M}}_k ~~\text{ with }~~ {\widetilde{M}}_k = M_k  \sum _{\ell :\ell <k}S_{\ell ,k}+ \sum _{\ell :\ell >k}S_{k,\ell } \end{aligned}$$and
$$\begin{aligned} {\widetilde{M}}_k\succeq 0\quad k=1,\ldots ,p. \end{aligned}$$If \(I_{k,\ell }=\emptyset \) or is not defined then \(S_{k,\ell }\) is a zero matrix.
Proof
Let \(H(N_H,E_H)\) be a sparsity graph of the matrix C; this is a complete graph. Recall that \({\widehat{G}}(N,{\widehat{E}})\) is the chordal extension of G(N, E), the sparsity graph of the matrix A. The maximal cliques of \({\widehat{G}}\) are \({\widehat{G}}_k(I_k,{\widehat{E}}_k)\). The matrix B is dense and so all vertices from \(N_H\) are adjacent to all vertices in N. Then, by Lemma 2, the chordal extension of the sparsity graph of M has maximal cliques \({\widehat{G}}_k({\widehat{I}}_k,{\widehat{E}}_k)\). The rest is a direct application of Theorem 2 with \(Q_k=M_k\) for \(k=1,\ldots ,p1\), and \(Q_p =\begin{bmatrix} A_p &{} B_p\\ B_p^\top &{} C \end{bmatrix}\).\(\square \)
Under additional assumptions, but leaving out Assumption 4, we can strengthen the above corollary as follows.
Theorem 3
Let Assumptions 1–3 hold. Assume that \(A_k\succeq 0\), \(k=1,\ldots ,p\), \(A\succ 0\) and \(C\succ 0\). Let M be defined as in (3). The following two statements are equivalent:

(i)
\(M\succeq 0\).

(ii)
There exist matrices \(D_{k,\ell }\in \mathbb {R}^{n\times m}\) such that \((D_{k,\ell })_{i,j}=0\) for \((i,j)\notin I_{k,\ell }\times \{1,\ldots m\}\), \((k,\ell )\in \varTheta _p\), and matrices \(C_k\in \mathbb {S}^m\), \(k=1,\ldots ,p\), such that
$$\begin{aligned} M = \sum _{k=1}^p {\widetilde{M}}_k ,\ \text{ with }\ {\widetilde{M}}_k = M_k  \sum _{\ell :\ell <k}\begin{bmatrix} 0&{}\quad D_{\ell ,k}\\ D^\top _{\ell ,k}&{}\quad 0 \end{bmatrix}+ \sum _{\ell :\ell >k}\begin{bmatrix} 0&{}\quad D_{k,\ell }\\ D^\top _{k,\ell }&{}\quad 0 \end{bmatrix}+ \begin{bmatrix} 0&{}\quad 0\\ 0&{}\quad C_k \end{bmatrix} \end{aligned}$$and
$$\begin{aligned} {\widetilde{M}}\succeq 0,\quad k=1,\ldots ,p. \end{aligned}$$If \(I_{k,\ell }=\emptyset \) or is not defined then \(D_{k,\ell }\) is a zero matrix.
Proof
We will prove the theorem by constructing matrices \(D_{k,k+1}\) and \(C_k\). By assumption, A is positive definite, so that we can define
Then
We define \(D_{k,k+1}\) and \(C_k\) as follows. For \(k=1\), we solve the equation
As in the proof of Theorem 2, some elements of thus defined \(D_{1,\ell }\) may not be unique; in this case, we just select a solution. Then, for any \(1<k<p\), we solve the equation
to define \(D_{k,\ell },\ \ell >k,\) analogously to Theorem 2. Any selection of the nonunique elements of \(D_{\bullet ,\bullet }\) will be consistent with the last equation
because of (5). From (4) and (6) we see that \(D_{{k,\ell }}\) is only nonzero on \(I_{k,\ell }\), \((k,\ell )\in \varTheta _p\), as required.
Define further
Now the matrices defined for \(k=1,\ldots ,p\) by
are clearly positive semidefinite with (at least) m zero eigenvalues. We set \({\widetilde{M}}_k={\widehat{M}}_k\), \(k=1,\ldots ,p1,\) and \({\widetilde{M}}_p = M_p  \sum _{\begin{array}{c} \ell :\ell <p\\ I_{\ell ,p}\not =\emptyset \end{array}}\begin{bmatrix} 0&{}D_{\ell ,p}\\ D^\top _{\ell ,p}&{}0 \end{bmatrix} + \begin{bmatrix} 0&{}0\\ 0&{}{C}_p\end{bmatrix}\). By construction, \(M = \sum \nolimits _{k=1}^p {\widetilde{M}}_k\).
It remains to show that \({\widetilde{M}}_p=\begin{bmatrix} A_p&{}\quad A_pX\\ X^\top \!A_p\ &{}\quad C\sum \nolimits _{k=1}^{p1}C_k\end{bmatrix}\succeq 0\) whenever \(M\succeq 0\). As \(A_p\succeq 0\) by assumption, positive semidefiniteness of \({\widetilde{M}}_p\) amounts to
which, by (5), is the same as
By the Schur complement theorem, the last inequality is equivalent to \(M\succeq 0\). This completes the proof.\(\square \)
We will call the decomposition of arrow type matrices using Corollary 1chordal decomposition and the one using Theorem 3arrow decomposition.
Complexity remarks Let Assumptions 1–4 hold. Let r be the number of nonempty sets \(I_{k,\ell }\), \((k,\ell )\in \varTheta _p\). Comparing Corollary 1 with Theorem 3 we see that both provide us with a replacement of a “large” matrix inequality \(M\succeq 0\) to a number of smaller ones \({\widetilde{M}}_k\succeq 0\), \(k=1,\ldots ,p\). However, while in Corollary 1 we have to introduce r additional matrix variables of sizes \({\widehat{I}}_{k,\ell }\times {\widehat{I}}_{k,\ell }\), in Theorem 3 we only have r additional matrix variables of sizes \(I_{k,\ell }\times m\) and p matrix variables of size \(m\times m\). Recall that \(m< \min \nolimits _{\begin{array}{c} k,\ell =1,\ldots ,p\\ k<\ell \end{array}}{I_{k,\ell }}\) and, in our application below, \(m=1\), so the additional variables in Theorem 3 are vectors instead of matrices of the same dimension in Corollary 1, offering thus significant reduction in the dimension of the additional variables.
The example below shows that the arrow decomposition does not only lead to a problem of smaller dimension, it also allows us to use decompositions that do not satisfy Assumption 4. In particular, the arrow decompositions can be sparser, with smaller overlaps and hence leading to sparser and smaller SDO problem.
Example 3
Consider a \(13\times 13\) matrix as shown in Fig. 3a. The sparsity graph of this matrix is shown in Fig. 3b, where the central node corresponds to the last index in the matrix. Let us compare the arrow decomposition with the chordal decomposition.
 \(\textit{Arrow}\) \(\textit{decomposition}\):

As in Example 2, we decompose the \(12\times 12\) leading principal submatrix into six \(4 \times 4\) principal submatrices, as shown in Fig. 3c; here \(I^{\scriptscriptstyle \mathrm{A}}_1=\{1,2,3,4\}\), \(I^{\scriptscriptstyle \mathrm{A}}_2=\{3,4,5,6\}\), \(I^{\scriptscriptstyle \mathrm{A}}_3=\{5,6,7,8\}\), \(I^{\scriptscriptstyle \mathrm A}_4=\{7,8,9,10\}\), \(I^{\scriptscriptstyle \mathrm{A}}_5=\{9,10,11,12\}\), \(I^{\scriptscriptstyle \mathrm{A}}_6=\{1,2,11,12\}\). Hence, with \({\widehat{I}}^{\scriptscriptstyle \mathrm{A}}_k = I^{\scriptscriptstyle \mathrm{A}}_k\cup \{13\}\), \(k=1,\ldots ,6\), we get six intersections \({\widehat{I}}^{\scriptscriptstyle \mathrm{A}}_{k,\ell }\), all of dimension 3. This decomposition satisfies Assumptions 1–3 but not Assumption 4. Indeed, if we extend the subgraphs associated with the decomposition to cliques, we obtain the graph shown in Fig. 3d. This graph is, however, not chordal: for instance, the cycle 1–4–6–7–9–11–1 does not have a chord. Therefore, we cannot apply neither of the theorems based on chordal decomposition (Theorems 1, 2, Corollary 1); however, we can apply Theorem 3 above. As a result, we get six additional vector variables of dimension 3 corresponding to \({\widehat{I}}^{\scriptscriptstyle \mathrm{A}}_{k,\ell }\).
 \(\textit{Chordal}\) \(\textit{decomposition}\):

Chordal decomposition must satisfy Assumption 4: the closest one to the above is \(I^{\scriptscriptstyle {\mathrm{C}}}_1=\{1,2,3,4,12\}\), \(I^{\scriptscriptstyle {\mathrm{C}}}_2=\{3,4,5,6,12\}\), \(I^{\scriptscriptstyle {\mathrm{C}}}_3=\{5,6,7,8,12\}\), \(I^{\scriptscriptstyle {\mathrm{C}}}_4=\{7,8,9,10,12\}\), \(I^{\scriptscriptstyle {\mathrm{C}}}_5=\{9,10,11,12\}\) with \({\widehat{I}}^{\scriptscriptstyle {\mathrm{C}}}_k = I^{\scriptscriptstyle {\mathrm{C}}}_k\cup \{13\}\), \(k=1,\ldots ,5\), and thus with four intersections \({\widehat{I}}^{\scriptscriptstyle \mathrm{C}}_{1,2}=\{3,4,12,13\}\), \({\widehat{I}}^{\scriptscriptstyle \mathrm{C}}_{2,3}=\{5,6,12,13\}\), \({\widehat{I}}^{\scriptscriptstyle \mathrm{C}}_{3,4}=\{7,8,12,13\}\), \({\widehat{I}}^{\scriptscriptstyle \mathrm{C}}_{4,5}=\{9,10,12,13\}\); see Fig. 3e for the decomposition of the leading principal submatrix, Fig. 3f for the corresponding extended chordal graph and Fig. 3g for the matrix associated with the extended graph. In this case, we need five additional matrix variables of dimension \(4\times 4\). \(\square \)
Two natural questions arise:

1.
Are the additional assumptions of Theorem 3 too restrictive? Are there any applications satisfying them?

2.
Is it worth reducing the dimension of the additional variables? Will it bring any significant savings of CPU time when solving the decomposed problem?
Both questions will be answered in the rest of the paper using a problem from structural optimization.
Application: topology optimization problem, semidefinite formulation
Consider an elastic body occupying a ddimensional bounded domain \({\Omega }\subset \mathbb {R}^d\) with a Lipschitz boundary \(\partial {\Omega }\), where \(d\in \{2,3\}\). By \({\varvec{u}}(\xi ) \in \mathbb {R}^d\) we denote the displacement vector at a point \(\xi \), and by
the (small)strain tensor. We assume that our system is governed by linear Hooke’s law, i.e., the stress is a linear function of the strain
where \({\varvec{E}}\) is the elastic (planestress for \(d=2\)) stiffness tensor.
Assume that the boundary of \({\Omega }\) is partitioned as \(\partial {\Omega }={\Gamma }_u\cup {\Gamma }_f\), \({\Gamma }_u\cap {\Gamma }_f = \emptyset \) and that an external load function \({{\varvec{f}}}\in [L_2({\Gamma }_f)]^d\) is given. Define \({{\mathcal {V}}}=\{{\varvec{u}} \in [H^1({\Omega })]^d \,\, {\varvec{u}} = 0 ~\mathrm{on}~{{\Gamma }}_u \}\supset [H^1({\Omega })]^d\). The weak form of the linear elasticity problem reads as:
where
In the basic topology optimization problem, the design variable is the multiplier \({\varvec{x}}\in L_\infty ({\Omega })\) of the elastic stiffness tensor \({\varvec{E}}\) which is a function of the space variable \(\xi \). We will consider the following constraints on \({\varvec{x}}\):
with some given positive “volume” V and with \(\underline{{\varvec{x}}},\overline{{\varvec{x}}}\in L_\infty ({\Omega })\) satisfying \(0\le \underline{{\varvec{x}}}\le \overline{{\varvec{x}}}\) and \(\int _{\Omega }\underline{{\varvec{x}}}(\xi ) \;\mathrm{d}\xi< V < \int _{\Omega }\overline{{\varvec{x}}}(\xi ) \;\mathrm{d}\xi \).
The minimum compliance singleload topology optimization problem reads as
The objective, the so called compliance functional, measures how well the structure can carry the load \({\varvec{f}}\).
Problem (9) is now discretized using the standard finite element method; the details can be found, e.g., in [6, 11]. In particular, we use quadrilateral elements, elementwise constant approximation of function \({\varvec{x}}\) and elementwise bilinear approximation of the displacement field \({\varvec{u}}\). After discretization, the variables will be vectors \(x\in \mathbb {R}^m\) and \(u\in \mathbb {R}^n\), where m is the number of finite elements and n the number of degrees of freedom (the number of finite element nodes times the spatial dimension). With every element we associate the local (symmetric and positive semidefinite) stiffness matrix \(K_i\) and (for elements including part of the boundary \({\Gamma }_f\)) the discrete load vector \(f_i\), \(i=1,\ldots ,m\). Now we can formulate the discretized version of the linear elasticity problem (7) as the following system of linear equations
where \( K(x) = \sum _{i=1}^m x_i K_i \) is the global stiffness matrix and \( f =\sum _{i=1}^m f_i \) is the finite element assembly of the load vector.
The topology optimization problem (9) becomes
Using the Schur complement theorem, the compliance constraint and the equilibrium equation can be written as one matrix inequality constraint:
The minimum compliance problem can then be formulated as follows:
For ease of notation, in the rest of the paper we will restrict ourselves to the planar case \(d=2\). Generalization of all ideas to the threedimensional case is straightforward.
Decomposition of the topology optimization problem (13)
Let \({\Omega }_h\subset \mathbb {R}^2\) be a polygonal approximation of \({\Omega }\) discretized by finite elements. Assume that \({\Omega }_h\) is partitioned into p nonoverlapping subdomains \(D_k\), \(k=1,\ldots ,p\), whose boundaries coincide with finite element boundaries. In our examples \({\Omega }={\Omega }_h\) is a rectangle, the underlying finite element mesh is regular and so is the partitioning into the subdomains. Confront Fig. 4 that shows typical decomposition of \({\Omega }_h\) into \(N_x\times N_y\) subdomains.
Let \(I_k\) be the index set of all degrees of freedom associated with the subdomain \(D_k\), \(k=1,\ldots ,p\). The intersections of these index sets will include the degrees of freedom on the respective internal boundaries and will be again denoted by
Denote by \({{\mathcal {D}}}_{k}\) the index set of elements belonging to subdomain \(D_k\) and define
Matrix \({K}^{(k)}(x) = K^{(k)}\) can then be partitioned as follows
where the set \(\varGamma \) collects indices of all degrees of freedom corresponding with indices in one of he sets \(I_{\ell ,k}\) or \(I_{k,\ell }\), \(\ell =1,\ldots ,p\); the set \({{\mathcal {I}}}\) then collects indices of all remaining “interior” degrees of freedom in \({D}_{k}\).
We are now in a position to apply the theorems from Sect. 2. Notice that Assumptions 1–3 are satisfied, as well as the additional assumptions of Theorem 3. Assumption 4 is discussed below.
Case A – Chordal decomposition Let us first apply Corollary 1. It says that the matrix inequality \(Z(x)\succeq 0\) from (13) can be equivalently replaced by the following matrix inequalities
where
The additional variables are the matrices, vectors and scalars
Case B – Arrow decomposition Now we apply Theorem 3. In this case, the matrix inequality \(Z(x)\succeq 0\) from (13) can be replaced by the following matrix inequalities
where
The additional variables \(g_{\bullet ,\bullet }\) and \(\gamma \), respectively, have the same dimensions as the variables \(\sigma _{\bullet ,\bullet }\) and s in Case A.
Recall that Theorem 3 does not use the restrictive Assumption 4 from Sect. 2. This is important, because Assumption 4 is not satisfied when the domain \(\Omega \) contains holes, and so the decomposition technique would not be applicable to some practical problems. Consider, for instance, the finite element mesh in Fig. 4 and assume that the (i, j)th subdomain is not part of the domain \(\Omega \), it is a hole with no finite elements. Then, even if we assume all matrices \(K^{(k)}\) to be dense, the sparsity graph of K(x) is not chordal, as it contains the chordless cycle connecting (more than 3) nodes on the boundary of the internal hole.
Before formulating the decomposed version of problem (13) we notice that, according to Corollary 1 and Theorem 3, \(Z = \sum _{k=1}^p Z^{(k)}_A = \sum _{k=1}^p Z^{(k)}_B\), which means, in particular, that
We will therefore replace the variable \(\gamma \) in the decomposed problems by either \(s_k\) or \(\gamma _k\) and the objective function by one of the above sums.
Case A Using the chordal decomposition approach, the decomposed optimization problem in variables
is formulated as follows
with \(Z_A^{(k)}\) defined as in (15), (16), (17).
Case B Using the arrow decomposition approach, the decomposed optimization problem in variables
reads as
with \(Z_B^{(i,j)}\) defined as in (18), (19).
A versus B Consider now the finite element mesh and decomposition as in Fig. 4 with \(n_x\times n_y\) finite elements and \(N_x\times N_y\) subdomains. Instead of (13) we can solve one of the decomposed problems (20) and (21). In Case A of the chordal decomposition the single matrix inequality of dimension \((n+1)\times (n+1)\) is replaced by \(N_x\cdot N_y\) inequalities of dimension of order \(2(n_x/N_x+1)(n_y/N_y+1)+1\) and we have to add \(N_x(N_y1)+(N_x1)N_y\) additional vectors \(\sigma _{\bullet ,\bullet }\) of a typical size \(2(n_x/N_x+1)\) or \(2(n_y/N_y+1)\), the same number of additional (dense) matrix variables \(S_{\bullet ,\bullet }\) of the same order and \(N_x\cdot N_y\) scalar variables \(s_{\bullet }\). (Recall that the factor 2 stems from the fact that there are two degrees of freedom at every finite element node.) In Case B of the arrow decomposition, the number and order of the new matrix constraints is the same as above but we only need the additional scalar and vector variables; the additional matrix variables are not needed.
Later in Sect. 6 we will see that these decompositions leads to enormous speedup in computational time of a stateoftheart SDO solver. We will also see that the omission of the additional matrix variables in the arrow decomposition can make a big difference.
Example 4
The notation used in the above decomposition approaches is rather cumbersome, so let us illustrate it using a simple example.
Figure 5 presents a finite element mesh with 16 elements and 25 nodes. All nodes on the lefthand side are fixed and thus eliminated from the stiffness matrix. Hence the corresponding stiffness matrix will have dimension \(40 \times 40\) (two degrees of freedom associated with every free finite element node, as depicted in the figure). The structure of the corresponding stiffness matrix K is shown in Fig. 6; here the elements corresponding to interior degrees of freedom (index sets \({\mathcal {I}}\)) are denoted by circles, while elements associated with the the intersections \(I_{k,\ell }\) are marked by full dots.
Thus in the original topology optimization problem (13) we have \(n=40\) and \(m=16\) and the matrix constraint \(Z(x)\succeq 0\) is of dimension \(41\times 41\). We now decompose the problem into four subdomains, containing elements \(\{1,2,5,6\}\), \(\{3,4,7,8\}\), \(\{9,10,13,14\}\), \(\{11,12,15,16\}\); see Fig. 5–right. Then
The structure of the stiffness matrices associated with domains 1–4 is shown, lefttoright, in Fig. 7. Notice that indices 15,16 (marked by red dots in Figs. 6 and 7) are contained in all six sets \(I_{\bullet ,\bullet }\).
The chordal decomposition problem (20) will have four matrix constraints, two of order 13 and two of order 19, and additional variables \(s\in \mathbb {R}^6\), \(\sigma _{1,4}, \sigma _{2,3}\in \mathbb {R}^2\), \(\sigma _{1,2}\in \mathbb {R}^4\), \(\sigma _{1,3},\sigma _{2,4},\sigma _{3,4}\in \mathbb {R}^6\) and \(S_{1,4}, S_{2,3}\in \mathbb {S}^2\), \(S_{1,2}\in \mathbb {S}^4\), \(S_{1,3},S_{2,4},S_{3,4}\in \mathbb {S}^6\). The arrow decomposition problem (21) will have the same number of matrix constraints as (20) and additional variables \(\gamma \in \mathbb {R}^6\), \(g_{1,4}, g_{2,3}\in \mathbb {R}^2\), \(g_{1,2}\in \mathbb {R}^4\), \(g_{1,3},g_{2,4},g_{3,4}\in \mathbb {R}^6\).
\(\square \)
Decomposition by fictitious loads
So far, all the reasoning was purely algebraic. There is, however, an alternative, functional analytic view of the arrow decomposition in Theorem 3. We will present it in this section. The purpose is to illustrate a different viewpoint and so, to keep the notation simple, we will only consider the case of two subdomains.
Infinite dimensional setting
Let us recall the weak formulation (7) of the elasticity problem depending on parameter x:
Let \({\Omega }\) be partitioned into two mutually disjoint subdomains \({\Omega }_1\) and \({\Omega }_2\) such that \({\Omega }_1\cup {\Omega }_2={\Omega }\). Denote the interface boundary between the two subdomains by \({\Gamma }_I\); see Fig. 8. We consider the general situation when \({\Gamma }_u\) and \({\Gamma }_f\) may be a part of both, \(\partial {\Omega }_1\cap \partial \varOmega \) and \(\partial {\Omega }_2\cap \partial \varOmega \). Define \({\varvec{a}}_i\) as a restriction of the bilinear form \({\varvec{a}}\) to \({\Omega }_i\) (the integral in (8) is simply computed over \({\Omega }_i\)), \({\varvec{f}}_i={\varvec{f}}_{\partial {\Omega }_i}\),
and
Consider the following “restricted” problems:
The following theorem forms a basis of our approach.
Theorem 4
Assume that \({\varvec{u}}^*\) solves (22). For all \({\varvec{x}}\in L_\infty ({\Omega })\) there exists \({\varvec{g}}\in [H^{1/2}({\Gamma }_I)]^2\) such that solutions to (23) and (24) are equal to respective solutions of the following problems
where \(\langle \cdot ,\cdot \rangle _{{\Gamma }_I}\) denotes the duality pairing between \([H^{1/2}({\Gamma }_I)]^2\) and \([H^{1/2}({\Gamma }_I)]^2\).
Proof
The requested function \({\varvec{g}}\) is the outcome of the respective Steklov–Poincaré operator applied to \({\varvec{u}}^*\); see, e.g., [12].\(\square \)
In the above theorem, function g can be interpreted as a fictitious load applied to either of the problems (25), (26). The theorem says that there exists such a g that the solutions of (25), (26) are equivalent to the solution of the “full” problem (22) restricted to the respective subdomain. Or, in other words, the solutions of (25), (26) can be “glued” to form the solution of (22).
Finite dimensional setting
Now assume that the discretization of \({\Omega }\) is such that the interface boundary \({\Gamma }_I\) is a union of boundaries of some finite elements. More precisely, we assume that the index set of finite elements used to the discretization of \({\Omega }\) can be split into two disjoint subsets
such that \({\Omega }_i\) is discretized by elements with indices from \({{\mathcal {D}}}_i\), \(i=1,2\). Define
the restrictions of the load vector f on boundaries of \({\Omega }_1\) and \({\Omega }_2\), respectively.
Denote the index set of degrees of freedom associated with finite element nodes on \({\Gamma }_I\) by \(I_{1,2}\). Let \(n_{\scriptscriptstyle \Gamma }\) be the dimension of \(I_{1,2}\).
Finally, for a vector in \(z\in \mathbb {R}^{n_{\scriptscriptstyle \Gamma }}\) denote by \(\overleftrightarrow {z}\) its extension to \(\mathbb {R}^n\):
The discrete version of Theorem 4 can then be formulated as follows. (The following corollary is, in fact, trivial in the finite dimension; however, we need the above theorem to understand the meaning of the fictitious load and its existence in the original setting of the problem.)
Corollary 2
Assume that \(u^*\) solves (10). Then for all \(x\in \mathbb {R}^m\) there exists \(g\in \mathbb {R}^{n_{\scriptscriptstyle \Gamma }}\) such that
Notice that (27), (28) are still systems of dimension n; however, many rows and columns in the matrix and the right hand side are equal to zero, so they can be solved as systems of dimensions \({{\mathcal {N}}}^{(1)}\) and \({{\mathcal {N}}}^{(2)}\), respectively. Hence, if we knew the fictitious load g, we could replace the large system of Eq. (10) by two smaller ones which, numerically, would be more efficient. Of course, we do not know it. However, and this is the key idea of this section, the linear system (10) is a constraint in an optimization problem, hence we can add g among the variables and, instead of searching for the optimal design x and the corresponding u satisfying (10), search for optimal x and for a pair (u, g) satisfying two smaller equilibrium Eqs. (27) and (28).
We can now formulate a result regarding the decomposition of the discretized topology optimization problem (11).
Theorem 5
Problem (11) is equivalent to the following problem:
In particular, if \(({\tilde{x}},{\tilde{u}},{\tilde{\gamma }})\) is a solution of (11) then there is \({\tilde{\gamma }}_1\in \mathbb {R}_+, {\tilde{\gamma }}_2\in \mathbb {R}_+,{\tilde{g}}\in \mathbb {R}^{n_{\scriptscriptstyle \Gamma }}\) such that \({\tilde{\gamma }}={\tilde{\gamma }}_1+{\tilde{\gamma }}_2\) and \(({\tilde{x}},{\tilde{u}},{\tilde{\gamma }}_1,{\tilde{\gamma }}_2,{\tilde{g}})\) is a solution of (29). Vice versa, if \(({\hat{x}},{\hat{u}},{\hat{\gamma }}_1,{\hat{\gamma }}_2,{\hat{g}})\) is a solution of (29) then \(({\hat{x}},{\hat{u}},{\hat{\gamma }}_1+{\hat{\gamma }}_2)\) is a solution of (11).
Proof
The theorem follows from the comparison of the KKT conditions of both problems. Assuming that \(({\tilde{x}},{\tilde{u}},{\tilde{\gamma }})\) solves (11), we define \({\tilde{g}}=(\sum \nolimits _{i\in {{\mathcal {D}}}_1}{\tilde{x}}_i K_i){\tilde{u}}  f^{(1)}\) and \({\tilde{\gamma }}_1 = (f^{(1)}+{\tilde{g}})^\top u\), \({\tilde{\gamma }}_2 = (f^{(2)}{\tilde{g}})^\top u\). Then it is straightforward to check that \(({\tilde{x}},{\tilde{u}},{\tilde{\gamma }}_1,{\tilde{\gamma }}_2,{\tilde{g}})\) satisfies the KKT conditions of (29). Now assume that \(({\hat{x}},{\hat{u}},{\hat{\gamma }}_1,{\hat{\gamma }}_2,{\hat{g}})\) is a solution of (29). Then \(({\hat{x}},{\hat{u}},{\hat{\gamma }}_1+{\hat{\gamma }}_2)\) is feasible in (11). We know from above that \(({\tilde{x}},{\tilde{u}},{\tilde{\gamma }}_1,{\tilde{\gamma }}_2,{\tilde{g}})\) is a solution of (29) with the optimal objective value \({\tilde{\gamma }}_1+{\tilde{\gamma }}_2\). Because both problems are equivalent to convex problems (their semidefinite reformulations), then \({\tilde{\gamma }}={\tilde{\gamma }}_1+{\tilde{\gamma }}_2={\hat{\gamma }}_1+{\hat{\gamma }}_2\) is also the optimal objective value of (11), hence \(({\hat{x}},{\hat{u}},{\hat{\gamma }}_1,{\hat{\gamma }}_2,{\hat{g}})\) is also optimal for (11).\(\square \)
Using again the Schur complement theorem, we finally arrive at the decomposition of the SDO problem (13).
Corollary 3
Problem (13) can be equivalently formulated as follows:
Problem (30) is now exactly the same as problem (21) arising from arrow decomposition applied to two subdomains.
Numerical experiments
The decomposition techniques described in the article were applied to an example whose data (geometry, boundary conditions and forces) are shown in Fig. 9–left. We always use regular decomposition of the rectangular domain; an example of a decomposition into 8 subdomains is shown in Fig. 9–right. We have used finite element meshes with up to \(160 \times 80\) elements.
We tested several codes to solve the SDO problems. Here we present results obtained by MOSEK, version 8.0 [9]. The reason for this is that MOSEK best demonstrated the decomposition idea; the speedup achieved by the decomposition was most significant when using this software.
When solving the SDO problems, we used default MOSEK settings with the exception of duality gap parameter MSK_DPAR_INTPNT_CO_TOL_REL_GAP that was set to \(10^{9}\), instead of the default value \(10^{8}\). We will comment on the resulting accuracy of the solution later in the section.
We also tried to solve smaller problems by SparseCoLO [2], software that performs the decomposition of matrix constraints based on Theorem 1 automatically. In particular, the software checks whether the matrix in question has a chordal sparsity graph; if not, the graph is completed to be chordal. After that, maximal cliques are found and Theorem 1 is applied. Because the sparsity graph of the matrix in problem (13) is not chordal, a chordal completion is performed by SparseCoLO. Such a completion is not unique and may thus lead to different sets of maximal cliques. And here is the main difference to our approach: while we can steer the decomposition to result in smaller matrix constraints of the same size, matrix constraints resulting from application of SparseCoLO are of variable size, some small, some rather large. This fact has a big effect on the efficiency of SparseCoLO, as we will see in the examples below.
In all experiments we used a 2018 MacBook Pro with 2.3 GHz dualcore Intel Core i5, Turbo Boost up to 3.6 GHz and 16 GB RAM, and MATLAB version 9.2.0 (2017a).
Remark 1
(Elementwise decomposition) The above text suggests that we always perform decomposition of the original finite element mesh into several (possibly uniform) submeshes, each of them having interior points; cf. Figs. 4, 5 and 9, and the notation used in Sect. 4. However, nothing prevents us from associating each subdomain with a finite element. When every subdomain consist of a single finite element, then the subdomains have no interior points, apart from those lying on the boundary of \(\varOmega \) and having no neighboring element. For instance, in Example 1, Fig. 5, these would only be degrees of freedom number 31, 32, 39, 40. In the numerical examples below, we will see that the big number of additional variables makes this option less attractive that other decompositions. However, while not the most effective of all decompositions, it is still much less computationally demanding than the original problem. The elementwise decomposition has one big advantage in simplicity of data preparation: the user can use any standard finiteelement mesh generator and does not have to worry about definition of subdomains. This may be particularly advantageous in case of highly irregular meshes.
Computational results
In the following tables, we present results of the \(N_x \times N_y\) examples using the chordal and arrow decomposition. In these tables the first row of numbers shows data for the original problem (13), the remaining rows are for the decomposed problems. The first column shows the number of subdomains, the next two ones the number of variables and the size of the largest matrix inequality. After that, we present the total number of iterations needed by MOSEK before it terminated. The next two columns show the total CPU time and CPU time per one iteration and are followed by columns reporting speedup relative to the original problem formulation, both total and per iteration.
In the final column we see the MOSEK constant MSK_DINF_INTPNT_OPT_ STATUS, a number that is supposed to converge to 1. Let us call this constant \(\mu \), for brevity. In our experience, MOSEK delivers acceptable solution reporting “Solution status: OPTIMAL” when
When \(\mu \) is farther away from 1, MOSEK, typically in these examples, announces “Solution status: NEAR_OPTIMAL.” For instance, in the \(120 \times 60\) example with chordal decomposition with 800 subdomains, MOSEK finished with \(\mu =0.9946\) and the final objective value was correct to 3 digits, while with 1800 subdomains MOSEK reported \(\mu =0.9865\) and we only got 2 correct digits in the objective function.
We first present results for the \(40 \times 20\) example using the chordal decomposition; see Table 1.
The table shows that while we increase the number of the subdomains (refine the decomposition), the number of variables increases (those are the additional matrix variables in chordal decomposition) and the size of the constraints decreases. We can further see from Table 1 that the total number of iterations needed to solve any of the problem formulations is almost constant. The main message of Table 1 is in columns 5 and 6; here we can see tremendous decrease in the CPU time when solving the decomposed problems.
We now solve the same \(40\times 20\) example using the arrow decomposition. The results are presented in Table 2. We have added two more columns showing the speedup relative to the undecomposed problem, both total and per iteration.
In all examples presented in Table 2, MOSEK reported Optimal solution status. Comparing result in Tables 1 and 2, we can see that the arrow decomposition is not only more efficient than the chordal one, due to smaller number of variables, but also delivers more accurate solution, i.e., a better conditioned SDO problem.
For a comparison, in Table 3 we present result for example \(40 \times 20\) obtained by solving problems decomposed by the automatic decomposition software SparseCoLO. In this case, the size of the 34 matrix constraints varied from 11 to 260. The decomposed problem is still solved more efficiently that the original one but that speedup is negligible, compared to either the chordal or the arrow decomposition from Tables 1 and 2.
The next Table 4 presents results for the \(80 \times 40\) discretization and chordal decomposition, while Table 5 present the results for the same problem using arrow decomposition. This was the largest problem we could solve by MOSEK in the original formulation (13), due to memory limitations.
As we can see, for a larger problem the speedup obtained by arrow decomposition is even more significant.
Examples with finer discretization cannot be solved by MOSEK in the original formulation (13 )(on the laptop we used for the experiments). They can, however, easily be solved in the decomposed setting. The results are presented in the next tables. In these tables, we also show estimated number of iterations and CPU time for the original problem; these numbers are extrapolated from the lowerdimensional problems (also those that are not presented here).
Table 6 presents results for the \(120 \times 60\) discretization and chordal decomposition, while Table 7 shows the results for the same example, this time using arrow decomposition.
When using the chordal decomposition (Table 6), MOSEK had difficulties with convergence to the optimal solution. In case of 800 subdomains, the final objective value was correct to 3 digits, while for the 1800 subdomains only to 2 digits. In both cases, the solution status of MOSEK was “Nearly optimal”. In case of arrow decomposition, all problems finished with “Optimal” solution status. Again, the arrow decomposition outperforms the chordal one, so from now on we will only focus on the arrow decomposition.
From the results presented so far, it seems that the most efficient decomposition is either the finest or the secondfinest one (not counting the elementwise decomposition); in the first case, each subdomain contains four finite elements, in the second case 16 finite elements. To get a clearer idea about the relation of the problem size and speedup, we present the next Table 8 of results for examples with dimension increasing from \(40 \times 20\) to \(160 \times 80\) elements. For each example we only consider the finest decomposition with four finite elements per subdomain. So the size of every matrix inequality is always at most 19. The CPU times for original formulation of the larger problems have been extrapolated and are denoted by the \(^\dag \) symbol.
The last row of Table 8 presents the estimate of computational complexity of each approach, as a function \(c \nu ^q\) of problem size \(\nu \); in this case, \(\nu \) is the number of variables of the SDO problem, as reported in the table. The exponent q is estimated from the CPU times. In case of the original, undecomposed problem, we calculated \(q\approx 3.18\) which slightly underestimates the theoretical complexity of interior point methods for SDO. The decomposed problem, on the other hand, exhibits linear complexity with \(q\approx 1.0006\). See also Fig. 10 for graphical representation of the complexity of the original problem (top line), single iteration of the original problem (middle line) and of the decomposed problem (bottom line). This, in our opinion, is the principal contribution of the arrow decomposition method.
References
 1.
Agler, J., Helton, W., McCullough, S., Rodman, L.: Positive semidefinite matrices with a given sparsity pattern. Linear Algebra Appl. 107, 101–149 (1988)
 2.
Fujisawa, K., Kim, S., Kojima, M., Okamoto, Y., Yamashita, M.: User’s Manual for Sparsecolo: Conversion Methods for Sparse ConicForm Linear Optimization. Tech. Rep, Department of Mathematical and Computing Sciences, Tokyo Institute of Technology, Tokyo (2009)
 3.
Fukuda, M., Kojima, M., Murota, K., Nakata, K.: Exploiting sparsity in semidefinite programming via matrix completion i: general framework. SIAM J. Optim. 11(3), 647–674 (2001)
 4.
Griewank, A., Toint, P.L.: On the existence of convex decompositions of partially separable functions. Math. Program. 28(1), 25–49 (1984)
 5.
Grone, R., Johnson, C., Sà, E., Wolkowitz, H.: Positive definite completions of partial Hermitian matrices. Linear Algebra Appl. 5(8), 109–124 (1984)
 6.
Haslinger, J., Kočvara, M., Leugering, G., Stingl, M.: Multidisciplinary free material optimization. SIAM J. Appl. Math. 70(7), 2709–2728 (2010)
 7.
Kakimura, N.: A direct proof for the matrix decomposition of chordalstructured positive semidefinite matrices. Linear Algebra Appl. 433(4), 819–823 (2010)
 8.
Kim, S., Kojima, M., Mevissen, M., Yamashita, M.: Exploiting sparsity in linear and nonlinear matrix inequalities via positive semidefinite matrix completion. Math. Program. 129(1), 33–68 (2011)
 9.
MOSEK ApS: The MOSEK Optimization Toolbox for MATLAB Manual. Version 8.0 (2016)
 10.
Nakata, K., Fujisawa, K., Fukuda, M., Kojima, M., Murota, K.: Exploiting sparsity in semidefinite programming via matrix completion ii: implementation and numerical results. Math. Program. 95(2), 303–327 (2003)
 11.
Petersson, J.: A finite element analysis of optimal variable thickness sheets. SIAM J. Numer. Anal. 36(6), 1759–1778 (1999)
 12.
Quarteroni, A., Valli, A.: Theory and application of Steklov–Poincaré operators for boundaryvalue problems. In: Spigler, R. (ed.) Applied and Industrial Mathematics: Venice1, 1989, pp. 179–203. Springer Netherlands, Dordrecht (1991)
 13.
Vandenberghe, L., Andersen, M.S.: Chordal graphs and semidefinite optimization. Found. Trends Optim. 1(4), 241–433 (2015)
Acknowledgements
The author would like to thank Masakazu Kojima for initiating the discussions on chordal decomposition of the topology optimization problem. The work on this article was initiated while the author was visiting the Institute for Pure and Applied Mathematics, UCLA. The support and friendly atmosphere of the Institute are acknowledged with gratitude. Thanks go also to Allan Lo, University of Birmingham, and two anonymous referees; their comments lead to significant improvements of the paper. Last but not least, the author wishes to thank MOSEK ApS for providing him with the academic version of their software.
Author information
Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This work has been supported by European Union’s Horizon 2020 research and innovation programme under the Marie SkłodowskaCurie Grant Agreement 813211 (POEMA).
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Kočvara, M. Decomposition of arrow type positive semidefinite matrices with application to topology optimization. Math. Program. 190, 105–134 (2021). https://doi.org/10.1007/s1010702001526w
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s1010702001526w
Keywords
 Semidefinite optimization
 Positive semidefinite matrices
 Chordal graphs
 Domain decomposition
 Topology optimization
Mathematics Subject Classification
 90C22
 74P05
 65N55
 05C69