Abstract
In this paper, we construct and analyze a new dynamical low-rank integrator for second-order matrix differential equations. The method is based on a combination of the projector-splitting integrator introduced in Lubich and Oseledets (BIT 54(1):171–188, 2014. https://doi.org/10.1007/s10543-013-0454-0) and a Strang splitting. We also present a variant of the new integrator which is tailored to semilinear second-order problems.
Similar content being viewed by others
1 Introduction
Dynamical low-rank integrators [10] have been introduced for the approximation of large, time-dependent matrices which are solutions to first-order matrix differential equations that can be well approximated by low-rank matrices. Typically, such matrix differential equations stem from spatially discretized PDEs. The idea is to project the right-hand side of the problem onto the tangent space of the manifold of matrices with small, fixed rank. It was shown in [10], that this ansatz yields differential equations for the factors of a low-rank decomposition resembling a singular value decomposition. Compared to the approximation of the full matrix solution, working only with the factors of the low-rank decomposition significantly reduces the computational costs and the required storage. Unfortunately, the integrator of [10] suffers from ill-conditioning in the presence of small singular values, a situation which is called over-approximation, i.e., the rank chosen within the method exceeds the rank of the actual solution. A projector-splitting integrator which is robust in the case of over-approximation was introduced in [12] by Lubich and Oseledets. It is based on a clever Lie–Trotter splitting of the projected right-hand side, by which the subproblems can be solved exactly. Another dynamical low-rank integrator for first-order matrix differential equations is the unconventional robust integrator recently presented in [2]. It is especially suited for strongly dissipative problems. Although its derivation is rather different from the construction of the projector-splitting integrator, both methods share their robustness in the case of over-approximation and they satisfy the same error bounds.
Both the projector-splitting integrator and the unconventional integrator have been applied to a variety of first-order matrix differential equations, e.g., for Schrödinger equations in [2], for the Vlasov–Poison equation in [4], for Vlasov-Maxwell equations in [5], and for Burgers’ equation with uncertainty in [11]. However, to the best of our knowledge, for second-order matrix differential equations of the form
with large \(m, n\), such integrators have not been considered so far. The obvious technique of reformulating (1) into a first-order system and applying the projector-splitting integrator [12] for first-order matrix differential equations behaved poorly in our numerical experiments. The reason might be that the inherent structure of the second-order problem is ignored by this procedure, causing the approximation quality to deteriorate.
Therefore, we propose to combine the projector-splitting integrator with a Strang splitting. The resulting method is closely related to the leapfrog scheme and called LRLF method in the following. It is a robust and reliable dynamical low-rank integrator for second-order equations of type (1), provided that the exact solution A(t) and its derivative \(A'(t)\) can be well approximated by matrices of low rank. When the exact flows used within the Strang splitting preserve the low rank of the previous approximation, our integrator reduces to the leapfrog scheme if the rank chosen in the method is sufficiently large. We also develop a variant of the scheme which is tailored to semilinear second-order equations. For this, we combine our newly developed scheme with the ideas in [15], where a dynamical low-rank integrator for stiff semilinear first-order equations was derived based on the projector-splitting integrator.
For the projector-splitting integrator, a detailed error analysis was provided in [9]. It relies on an exactness property of the integrator, namely that it provides the exact solution if this solution preserves the (low) rank of the initial value for all times and the exact initial value is used to start the integrator. Unfortunately, this is no longer true for the LRLF scheme. Nevertheless, we will provide error bounds under similar assumptions as in [9].
The paper is organized as follows: In Sect. 2, we briefly recall the projector-splitting integrator introduced in [12] by Lubich and Oseledets. The construction of the LRLF scheme is presented in Sect. 3 and its error analysis in Sect. 4. A modification of the LRLF scheme which is tailored to semilinear second-order problems is developed in Sect. 5.
Throughout this paper, \(m,n\), and \(r\) are natural numbers, where w.l.o.g. \(m\ge n\gg r\). If \(n> m\), we consider the equivalent differential equation for the transpose. By \({\mathscr {M}}_r\) we denote the manifold of complex \(m\times n\) matrices with rank \(r\),
The Stiefel manifold of \(m\times r\) unitary matrices is denoted by
where \(I_r\) is the identity matrix of dimension \(r\) and \(U^H\) is the conjugate transpose of U.
The singular value decomposition of a matrix \(Y \in {\mathbb {C}}^{m\times n}\) is given by
where \(\sigma _1 \ge \ldots \ge \sigma _n\ge 0\) are its singular values. It is well known that for \(r< n\), the rank-\(r\) best-approximation to Y w.r.t. the Frobenius norm \(\Vert \cdot \Vert \) is given by
where \({{\widetilde{\varSigma }}} = {{\,\textrm{diag}\,}}(\sigma _1, \ldots , \sigma _r, 0, \ldots , 0)\) and
For a given step size \(\tau \) we use the notation \(t_k = k \tau \) for any k with \(2 k \in {\mathbb {N}}_0\).
2 The projector-splitting integrator
In this section, we briefly review dynamical low-rank approximations as introduced in [10, 12]. We start with the following problem: Given some time-dependent matrix A(t), find a low-rank approximation \({{{\widehat{A}}}}(t) \in {\mathscr {M}}_r\) such that
In [10], this is done by imposing that \({{{\widehat{A}}}}'(t)\), which is contained in the tangent space \({\mathscr {T}}_{{{{\widehat{A}}}}(t)} {\mathscr {M}}_r\) to \({\mathscr {M}}_r\) at \({{{\widehat{A}}}}(t)\), satisfies
For an initial value \({{{\widehat{A}}}}(0) = {{{\widehat{A}}}}_0 \in {\mathscr {M}}_r\), condition (2) is equivalent to a Galerkin condition. In fact, then \({{{\widehat{A}}}}\) solves the evolution equation
where \(P\big ({{{\widehat{A}}}}(t)\big )\) denotes the orthogonal projection onto the tangent space \({\mathscr {T}}_{{{{\widehat{A}}}}(t)} {\mathscr {M}}_r\). A natural choice for the initial value \({{{\widehat{A}}}}_0\) of (3) is the rank-\(r\) best approximation to A(0).
For all \({{{\widehat{A}}}}\in {\mathscr {M}}_r\) there is a non-unique low-rank factorization
which allows us to write the orthogonal projector \(P({{{\widehat{A}}}})\) onto \({\mathscr {T}}_{{{{\widehat{A}}}}(t)} {\mathscr {M}}_r\) as
cf., [10, Lemma 4.1]. The dynamical low-rank integrator constructed in [12] is based on a Lie–Trotter splitting, applied to the differential equation (3) with \(P({{{\widehat{A}}}})\) given in (4). Given a step size \(\tau >0\), the first integration step consists of solving the three subproblems
As shown in [12, Lemma 3.1], all subproblems (5) can be solved exactly on \({\mathscr {M}}_r\) when the additional conditions
are imposed. Then, the solutions
can be written in terms of the increment \(\Delta A = A(\tau ) - A(0)\),
The integration process is continued with initial value \(Y_\gamma (\tau ) \approx {{{\widehat{A}}}}(\tau )\) in the next time step. A single time step of the resultant projector-splitting integrator is presented in Algorithm 1, version \((\alpha )\).
The above approach is also suitable for the construction of low-rank approximations to the unknown solution A(t) of the first-order differential equation
As explained in [12, Section 3.4], the only change affects the replacement of the increment \(\Delta A\) in Algorithm 1 in a way resembling the explicit Euler method,
see version \((\beta )\). The global error of this first-order scheme depends on the quality of the approximation of the exact solution A(t) of (6) by a low-rank matrix (for \(t \in [0,T]\)) and on properties of the right-hand side F, cf. [9]. Alternatively, any other explicit scheme, e.g., a fourth order Runge-Kutta method can be used to replace the increment \(\Delta A\). We denote the latter method by PSI-RK.
Remark 1
The computational complexity of Algorithm 1 is dominated by the two products \(\Delta A {{{\widehat{V}}}}\) and \(\Delta A^H {{{\widehat{U}}}}\) in lines 7 and 11, respectively, the two QR-decompositions of matrices of dimension \(m\times r\) and \(n\times r\), respectively, and the three matrix-matrix products in lines 8, 10, and 11. For an efficient implementation, it is important to compute the products \(\Delta A {{{\widehat{V}}}}\) and \(\Delta A^H {{{\widehat{U}}}}\) without computing \(\Delta A\) explicitly.
3 Dynamical low-rank approximation of second-order matrix ODEs
Next, we devise a low-rank integrator for second-order matrix differential equations of the form (1). A straightforward practice would be to rewrite (1) as a first-order system
and to apply Algorithm 1. However, numerical tests showed that the quality of the numerical solutions deteriorates over time, possibly caused by the neglection of the structure of the the right-hand side of (7).
We thus use a different ansatz and first split (7) into
and then apply a standard Strang splitting. Solving the subproblems exactly leads to the well-known leapfrog or Störmer-Verlet scheme,
cf. [6, Section 1.5]. If approximations to \(A' = B\) are not required at full time steps, then the most economic implementation of the leapfrog scheme is to combine (9a) and (9c) via
For \(k=0\), \(B_\frac{1}{2}\) is computed from (9a).
A low-rank integrator for the second-order equation (1) is now designed by approximating the exact flows of the subproblems in (8) by their respective low-rank flows using the projector-splitting method [12]. First, we determine initial values \({{{\widehat{A}}}}_0\) and \({{{\widehat{B}}}}_0\) as rank-\({r_A}\) and rank-\({r_B}\) best-approximations to \(A_0\) and \(B_0\), respectively. After \(k\) time steps, the low-rank approximations \({{{\widehat{A}}}}_k\approx A(t_k)\) and \({{{\widehat{B}}}}_{k-\frac{1}{2}}\approx B(t_{k-\frac{1}{2}})\) are represented by (non-unique) decompositions
where
The low-rank matrices \({{{\widehat{A}}}}_{k+1}\approx A(t_{k+1})\) and \({{{\widehat{B}}}}_{k+ \frac{1}{2}}\approx B(t_{k+ \frac{1}{2}})\) are obtained by approximating the solutions of (8) by applying Algorithm 1 to
where for \(k= 0\), we have
Since the exact solutions of (10) read
the increments \(\Delta B_{k-\frac{1}{2}}\) and \(\Delta A_k\) are given explicitly as
The resulting dynamical low-rank integrator for second-order matrix ODEs will be named LRLF method, for low-rank leapfrog integrator. It is presented in Algorithm 2.
There is a close relationship between the LRLF and the leapfrog schemes:
Theorem 2
If for all \(t\in [0,T]\) the exact solutions A(t) and B(t) of the subproblems (8) with \({{\,\textrm{rank}\,}}A_0 = {r_A}, {{\,\textrm{rank}\,}}B_0 = {r_B}\) stay of rank \({r_A}\) and \({r_B}\), respectively, then the solutions of the LRLF and leapfrog schemes coincide.
Proof
The LRLF scheme is derived by exchanging the exact flows of the leapfrog scheme by their corresponding low-rank flows. Since the exact flows preserve the rank by assumption, the application of the exactness property of the projector-splitting integrator [12, Theorem 4.1] yields the desired result. \(\square \)
Clearly, in general the LRLF scheme does not inherit the exactness property of the projector-splitting integrator, because of the splitting error. A detailed error analysis of the LRLF iteration will be presented in Sect. 4.
In the same way, a variant of the LRLF method for the second-order matrix differential equation
or equivalently
is based on the non-staggered version of the leapfrog scheme (9), procuring approximations to \(A'\) on the same time-grid as approximations to A. Here, the function F has to be evaluated twice in each time step so that the computational effort is larger. The resulting method is called the \({\textsc {LRLF}({\omega })}\) scheme. It is described in Algorithm 3.
Remark 3
A dynamical low-rank integrator for second-order matrix differential equations (1) can also be derived based on the two-step formulation of the leapfrog scheme,
cf. [16, Section 4.2]. In numerical experiments it was observed that the resulting scheme does not yield better approximations than the LRLF method, and even produces larger errors in some examples.
4 Error analysis of LRLF
In the following, we analyze the error of the LRLF scheme given in Algorithm 2 when applied to (1) with a right-hand side F which is Lipschitz-continuous with a moderate Lipschitz constant L, i.e., F satisfies
Our analysis relies on the error analysis in [9] for the projector-splitting integrator.
Recall that the LRLF scheme is derived from the leapfrog scheme (9), which is stable under the CFL condition, cf. [8],
We therefore assume that the step size \(\tau \) always satisfies (14).
Assumption 1
The exact solution \(A : [0,T] \rightarrow {\mathbb {C}}^{m\times n}\) of (1) is in \({\mathscr {C}}^4([0,T])\). Furthermore, there are low-rank approximations \(X_A(t) \in {\mathscr {M}}_{r_A}, X_B(t) \in {\mathscr {M}}_{r_B}\) such that
Additionally, there exist sufficiently large constants \(\gamma _A\) and \(\gamma _B\) such that (15) is also satisfied for all \(Y_A(t),Y_B(t) \in {\mathbb {C}}^{m\times n}\) with
For the approximations \({{{\widehat{A}}}}_k\approx A(t_k)\) and \({{{\widehat{B}}}}_{k+ \frac{1}{2}}\approx B(t_{k+ \frac{1}{2}})\) computed with the LRLF scheme and for \({{\widetilde{A}}}_k\) and \({{\widetilde{B}}}_{k-\frac{1}{2}}\) given in (11), we define
By the triangle inequality, we have
The analysis of the LRLF scheme is organized in two lemmas and a theorem. Our first result are coupled, recursive inequalities for \(E^{{k+1}}_A\) and \(E^{{k+ \frac{1}{2}}}_B\).
Lemma 4
Let \(A : [0,T] \rightarrow {\mathbb {C}}^{m\times n}\) with \(A \in {\mathscr {C}}^4([0,T])\) be the exact solution of (1) with initial values \(A_0, B_0 \in {\mathbb {C}}^{m\times n}\) and \(B = A'\). Further, denote by \({{{\widehat{B}}}}_{k-\frac{1}{2}}\) and \({{{\widehat{A}}}}_k\) the low-rank approximations obtained by the LRLF scheme after \(k\) steps started with initial values \({{{\widehat{A}}}}_0 \in {\mathscr {M}}_{r_A}, {{{\widehat{B}}}}_0 \in {\mathscr {M}}_{r_B}\). Then, the errors introduced in (16) satisfy
and for \(k\in {\mathbb {N}}\) we have
The constants \(C^{\text {LF}}_A\) and \(C^{\text {LF}}_B\) are given explicitly as
Proof
By Taylor series expansion, we have
Hence for \(k= 0\), we have
by (20c), (11c), and (13). Employing (17) shows (18a). Using (18a) and (20a) yields
Together with (17) this proves (18b).
For \(k\ge 1\) we follow the same steps. We have by (11), (13), and (20b)
and by (17) thus (19a). Lastly, we have by (20a), using again (11), and inserting (19a)
which together with (17) completes the proof. \(\square \)
In [9, Section 2.6.1] it was shown that the error between a time-dependent matrix A(t) satisfying (15a) and the rank-\({r_A}\) approximation \(Y_1 \approx A(\tau )\) computed by Algorithm 1 started from \(X_A(0) \in {\mathscr {M}}_{r_A}\) is bounded by
In the next lemma we eliminate \({\widehat{E}}^{{k+ \frac{1}{2}}}_B\) and \({\widehat{E}}^{{k+1}}_A\) from (19) by using (25).
Lemma 5
Let the assumptions of Lemma 4 be satisfied. Furthermore, assume that
If Assumption 1 is fulfilled, then for all \(k\) such that \(t_{k+ 4} \le T\), the errors \(E^{{k+ \frac{1}{2}}}_B\) and \(E^{k+1}_A\) defined in (16) satisfy
respectively.
Proof
The proof is accomplished by induction on \(k\). First, we show that the errors \({\widetilde{E}}^{{k+1}}_A\) and \({\widetilde{E}}^{{k+ \frac{1}{2}}}_B\) are uniformly bounded by suitable constants \(\gamma _A\) and \(\gamma _B\). Then the auxiliary solutions \({{\widetilde{A}}}\) and \({{\widetilde{B}}}\) are sufficiently close to the exact solutions A and B, and hence they admit representations like (15) by Assumption 1. Since the approximations \({{{\widehat{A}}}}\) and \({{{\widehat{B}}}}\) are low-rank approximation to \({{\widetilde{A}}}\) and \({{\widetilde{B}}}\) computed by Algorithm 1 started from initial values of rank \({r_A}\) and \({r_B}\), respectively, the local errors \({\widehat{E}}^{{k+1}}_A\) and \({\widehat{E}}^{{k+ \frac{1}{2}}}_B\) are bounded by
cf. (25). The estimate on the global error then follows from (17).
For \(k= 0\) we deduce from (21) and (26)
By Assumption 1, for \(\gamma _B \ge \rho _B+ \frac{\tau }{2}L \rho _A+ C^{\text {LF}}_B\tau ^2\), it holds by (18a) and (28) that
which is (27a) for \(k= 0\).
Likewise, by (22), (26), and (29) we have
Choosing \(\gamma _A\) as the right-hand side of (30), by Assumption 1 and (28) we deduce
which shows (27b) for \(k= 0\).
Assuming that (27) holds true for some arbitrary, but fixed \({k-1}\in {\mathbb {N}}_0\), we now prove (27). Applying the Gronwall-type Lemma 7 below, we find from (27b) for \(j= 1,\ldots ,k\)
where
By (26), this bound is also valid for \(j= 0\). From (23) and (27a) we obtain
Inserting (31) into (33) for \(0\le t_{k+4} \le T\) results in constants \( C_B(T)\), \({{\widetilde{C}}}_B( T)\) depending on \(L, \rho _A, \rho _B, \rho '_A, \rho '_B, C^{\text {LF}}_A,\) and \(C^{\text {LF}}_B\) such that
By Assumption 1 for \(\gamma _B \ge C_B(T) + \tau ^2 {{\widetilde{C}}}_B( T)\), (28) shows that \({\widehat{E}}^{{k+ \frac{1}{2}}}_B \le 7 \tau \rho '_B\). Thus we obtain from (33) and (17)
which proves (27a) for all \(k\in {\mathbb {N}}_0\).
Similarly, using (24) and the induction hypothesis, we get
By employing the bound (31) on \(E^{j}_A\) for \(0 \le t_{k+4} \le T\), we define constants \(C_A(T)\), \({{\widetilde{C}}}_A(T)\) depending on \(L, \rho _A, \rho _B, \rho '_A, \rho '_B, C^{\text {LF}}_A,\) and \(C^{\text {LF}}_B\) such that
Now let Assumption 1 be fulfilled for some \(\gamma _A \ge C_A(T) + \tau ^2 {{\widetilde{C}}}_A(T)\). Then we have \({\widehat{E}}^{{k+1}}_A \le 7 \tau \rho '_A\) by (28). Finally, we conclude from (34) and (17)
This completes the proof. \(\square \)
We are now able to prove a global error bound.
Theorem 6
If the assumptions of Lemma 5 are satisfied, then the global errors \(E^{{k+1}}_A\) and \(E^{{k+ \frac{1}{2}}}_B\) are bounded by
where \(M^{k+1}_A\) is given in (32), and
for
respectively, as long as \(t_{k+4} \le T\).
Proof
The bound for \(E^{{k+1}}_A\) is a direct consequence of (31) with \(j={k+1}\). The bound for \(E^{{k+ \frac{1}{2}}}_B\) is obtained as for \(E^{{k+1}}_A\) in the proof of Lemma 5, but starting from substituting (19b) into (19a). \(\square \)
The error of the LRLF scheme is hence a combination of two error contributions: an error caused by the low-rank approximations, and a time discretization error stemming from the leapfrog scheme. If the low-rank errors \(\rho _A, \rho _B, \rho '_A, \) and \(\rho '_B\) are small, i.e., the solutions A, B of (1) are well-approximated by low-rank matrices, the time discretization error dominates.
In the proofs of Lemma 5 and Theorem 6 we used the following Gronwall-type lemma.
Lemma 7
Let \(\tau , L \ge 0\) and \(\{M_k\}_{k\ge 0}\) a nonnegative, monotonically increasing sequence. If the nonnegative sequence \(\{E_k\}_{k \ge 0}\) satisfies
then
Proof
Define \(\varepsilon _k{:}{=}E_k/M_k\) for all \(k\ge 0\). The sequence \(\{\varepsilon _k\}_{k\ge 0}\) is nonnegative and satisfies
due to the monotonicity of \(\{M_k\}_{k\ge 0}\). The statement then follows from [1, Lemma 3.8]. \(\square \)
5 Dynamical low-rank integrator for semilinear second-order matrix differential equations
We now consider semilinear second-order matrix differential equations of the form
with given Hermitian, positive semidefinite matrices \(\varOmega _1\in {\mathbb {C}}^{m\times m}\) and \(\varOmega _2\in {\mathbb {C}}^{n\times n}\) of large norm and a Lipschitz continuous function f with a moderate Lipschitz constant. Our aim is to construct a dynamical low-rank integrator which exploits the semilinear structure of the right-hand side of (35) and yields smaller errors than the LRLF scheme.
A dynamical low-rank integrator for stiff semilinear first-order equations was proposed in [15]. It is based on the important property of linear first-order equations, that the exact solution of an initial value problem stays in \({\mathscr {M}}_r\) for all times if the initial value is in \({\mathscr {M}}_r\). This is in general not the case for linear second-order equations, so that additional considerations are required here.
We transform (35) into an equivalent first-order problem and split the right-hand side into two linear and one nonlinear part by introducing weights \(\omega _{i}\ge 0\), \(i=1,2,3\), with \(\omega _1^2 + \omega _2^2+\omega _3^2= 1\), that is
A natural choice is \(\omega _i^2 = 1/3\), \(i=1,2,3\), but different weightings are feasible. The split equations can be written as
The solution of the linear problems (36a) and (36b) can be expressed in terms of the matrix exponential
The full splitting scheme reads
where \(\phi ^{\varOmega _1}_\frac{\tau }{2}\) and \(\phi ^{\varOmega _2}_\frac{\tau }{2}\) denote the numerical flows given by Algorithm 1 with step size \(\frac{\tau }{2}\) to the exact solutions of (36a) and (36b), respectively. \(\phi ^{\mathscr {S}}_\tau \) denotes the numerical flow of the LRLF(\(\omega \)) scheme, described in Algorithm 3, with right-hand side f. The overall method (37) is called LRLF-semi.
When approximations at full time steps are dispensable, the last half step \(\phi ^{\varOmega _1}_\frac{\tau }{2}\) in (37) can be combined with the first one of the next time step.
6 Numerical experiments
In this section, we present numerical experiments to confirm our theoretical findings. We consider the wave equation
with periodic boundary conditions on a rectangular domain \(\varOmega \subset {\mathbb {R}}^2\).
The codes for reproducing the numerical results are available on https://doi.org/10.5445/IR/1000152590.
6.1 Homogeneous wave equation
In our first example we set \(\varOmega = [-\pi ,\pi ]^2\) and \(\gamma = 0\). With the initial values
where \(k_x,k_y \in {\mathbb {R}}\), (38) models a planar wave traveling into the direction of \(k = (k_x,k_y)\). For the discretization in space we use second-order finite differences with n and m discretization points in x- and y-direction, respectively. This yields the second-order matrix differential equation (35) with \(f\equiv 0\), where \(\varOmega _1^2\) and \(\varOmega _2^2\) denote the positive semidefinite, symmetric Toeplitz matrices with first rows
respectively.
For \(m= n= 512\), \(T= 10\) and \(2 k_x= k_y = 2\), we compute low-rank approximations to the exact solution of (35) with the LRLF and the LRLF-semi schemes and ranks \({r_A}= {r_B}= 2\). For the latter method, we use the weight configurations
While the first choice treats the two subproblems equally, the second takes the direction of motion into account. Moreover, we compute low-rank approximations with the projector-splitting integrator (Algorithm 1), applied to the equivalent first-order system (7) of (35) and rank \(r=4\). For the inner integration we use the explicit Euler method (PSI) and the classical Runge–Kutta method of order 4 (PSI-RK).
In Fig. 1, the relative global error between the exact solution A and its low-rank approximations \({{{\widehat{A}}}}\) at time \(t = T\) is displayed. Temporal convergence of order 2 is observed for both the LRLF and the LRLF-semi scheme. Compared to the LRLF method, the LRLF-semi scheme is more accurate and allows slightly larger step sizes. Choosing the weights \(\omega _i\) in consideration of the direction of motion improves the approximation substantially. In contrast, the PSI and PSI-RK methods require significantly smaller step sizes \(\tau \) and come with larger errors than the schemes for second-order matrix differential equations.
6.2 Semilinear wave equation
In a second experiment, we set \(\varOmega = [- \pi , \pi ] \times [-2 \pi ,2 \pi ]\) and \(\gamma = 0.01\) in (38), and use the initial values
with \(l_0 = \pi /30\) and \(w_0 = \pi /3\). Due to the strong localization of the initial value, we discretize in space by a pseudospectral method in y-direction and fourth-order finite differences in x-direction. This yields the second-order matrix differential equation (35) with the cubic nonlinearity
where the symbol \(\bullet \) denotes the entrywise matrix product. The matrix \(\varOmega _1^2 \in {\mathbb {R}}^{m\times m}\) is given by
where \({\mathscr {F}}_m\) denotes the discrete Fourier transformation operator with \(m\) modes, and \(\varOmega _2^2 \in {\mathbb {R}}^{n\times n}\) denotes the positive semidefinite, symmetric Toeplitz matrix with first row
For \(m = 4096\), \(n=512\), \(T = 0.5 \pi \), and \({r_A}= {r_B}= 10\), we compute low-rank approximations to the solution of (35) with the LRLF and the LRLF-semi scheme. A reference solution has been computed with the leapfrog scheme and step size \(\tau _0 = 10^{-4} T\). For the LRLF-semi scheme, we again use two weight configurations, where the first treats all subproblems equally and the second takes the direction of propagation into account,
In Fig. 2, the relative global error of the low-rank approximations compared to the reference solution at time \(t = T\) is displayed. Both LRLF and LRLF-semi schemes show convergence of order 2. For both weight configurations the LRLF-semi scheme yields smaller errors, and the approximation quality improves if the weights are chosen according to the direction of motion. For all integrators, the error reaches a plateau for small \(\tau \). This is caused by the low rank best approximation error to the exact solution. In fact, the rank-\({r_A}\) best-approximation \({{{\widehat{A}}}}^{\text {best}}_{r_A}\) to the exact solution \(A \in {\mathbb {C}}^{m\times n}\) satisfies
which is a lower bound on the relative error of an arbitrary low-rank approximation.
The error plateau observed in Fig. 2 suggests to choose the rank adaptively such that the temporal convergence order is preserved for smaller step sizes. This issue has been addressed in [7].
7 Conclusion and outlook
In the present paper, we developed and analyzed dynamical low-rank integrators for second-order matrix differential equations of the forms (1) or (35). For LRLF we proved second-order convergence under reasonable assumptions. The theoretical results have been confirmed by numerical experiments.
Both the projector-splitting integrator and the unconventional robust integrator have been successfully adapted to first-order tensor differential equations, cf. [3, 13, 14] and references therein. We are confident that the constructed dynamical low-rank integrators for second-order matrix differential equations can be adapted to the tensor case as well. This is part of ongoing research and will be reported in the future.
References
Carle, C., Hochbruck, M., Sturm, A.: On leapfrog-Chebyshev schemes. SIAM J. Numer. Anal. 58(4), 2404–2433 (2020). https://doi.org/10.1137/18M1209453
Ceruti, G., Lubich, C.: An unconventional robust integrator for dynamical low-rank approximation. BIT 62(1), 23–44 (2022). https://doi.org/10.1007/s10543-021-00873-0
Ceruti, G., Lubich, C., Walach, H.: Time integration of tree tensor networks. SIAM J. Numer. Anal. 59(1), 289–313 (2021). https://doi.org/10.1137/20M1321838
Einkemmer, L., Lubich, C.: A low-rank projector-splitting integrator for the Vlasov–Poisson equation. SIAM J. Sci. Comput. 40(5), B1330–B1360 (2018). https://doi.org/10.1137/18M116383X
Einkemmer, L., Ostermann, A., Piazzola, C.: A low-rank projector-splitting integrator for the Vlasov–Maxwell equations with divergence correction. J. Comput. Phys. 403, 109,063 (2020)
Hairer, E., Lubich, C., Wanner, G.: Geometric numerical integration illustrated by the Störmer–Verlet method. Acta Numer. 12, 399–450 (2003). https://doi.org/10.1017/S0962492902000144
Hochbruck, M., Neher, M., Schrammer, S.: Dynamical low-rank integrators for second-order matrix differential equations. CRC 1173 Preprint 2022/12, Karlsruhe Institute of Technology (2022). https://doi.org/10.5445/IR/1000143198. https://www.waves.kit.edu/downloads/CRC1173_Preprint_2022-13.pdf
Joly, P., Rodríguez, J.: Optimized higher order time discretization of second order hyperbolic problems: construction and numerical study. J. Comput. Appl. Math. 234(6), 1953–1961 (2010). https://doi.org/10.1016/j.cam.2009.08.046
Kieri, E., Lubich, C., Walach, H.: Discretized dynamical low-rank approximation in the presence of small singular values. SIAM J. Numer. Anal. 54(2), 1020–1038 (2016). https://doi.org/10.1137/15M1026791
Koch, O., Lubich, C.: Dynamical low-rank approximation. SIAM J. Matrix Anal. Appl. 29(2), 434–454 (2007). https://doi.org/10.1137/050639703
Kusch, J., Ceruti, G., Einkemmer, L., Frank, M.: Dynamical low-rank approximation for Burgers’ equation with uncertainty. Int. J. Uncertain. Quantif. 12(5), 1–21 (2022). https://doi.org/10.1615/int.j.uncertaintyquantification.2022039345
Lubich, C., Oseledets, I.V.: A projector-splitting integrator for dynamical low-rank approximation. BIT 54(1), 171–188 (2014). https://doi.org/10.1007/s10543-013-0454-0
Lubich, C., Oseledets, I.V., Vandereycken, B.: Time integration of tensor trains. SIAM J. Numer. Anal. 53(2), 917–941 (2015). https://doi.org/10.1137/140976546
Lubich, C., Vandereycken, B., Walach, H.: Time integration of rank-constrained Tucker tensors. SIAM J. Numer. Anal. 56(3), 1273–1290 (2018). https://doi.org/10.1137/17M1146889
Ostermann, A., Piazzola, C., Walach, H.: Convergence of a low-rank Lie–Trotter splitting for stiff matrix differential equations. SIAM J. Numer. Anal. 57(4), 1947–1966 (2019). https://doi.org/10.1137/18M1177901
Schrammer, S.: On dynamical low-rank integrators for matrix differential equations. Ph.D. thesis, Karlsruher Institut für Technologie (KIT) (2022). https://doi.org/10.5445/IR/1000148853
Acknowledgements
Funded by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation)—Project-ID 258734477— SFB 1173. We thank the anonymous referees for their helfpul comments on an earlier version of this paper.
Funding
Open Access funding enabled and organized by Projekt DEAL.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
Not applicable.
Additional information
Communicated by Antonella Zanna Munthe-Kaas.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Hochbruck, M., Neher, M. & Schrammer, S. Dynamical low-rank integrators for second-order matrix differential equations. Bit Numer Math 63, 4 (2023). https://doi.org/10.1007/s10543-023-00941-7
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10543-023-00941-7