Abstract
We analyse the Krylov solvability of inverse linear problems on Hilbert space \(\mathcal {H}\) where the underlying operator is compact and normal. Krylov solvability is an important feature of inverse linear problems that has profound implications in theoretical and applied numerical analysis as it is critical to understand the utility of Krylov based methods for solving inverse problems. Our results explicitly describe for the first time the Krylov subspace for such operators given any datum vector \(g\in \mathcal {H}\), as well as prove that all inverse linear problems are Krylov solvable provided that g is in the range of such an operator. We therefore expand our knowledge of the class of Krylov solvable operators to include the normal compact operators. We close the study by proving an isomorphism between the closed Krylov subspace for a general bounded normal operator and an \(L^2\)-measure space based on the scalar spectral measure.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction
The question of ‘Krylov solvability’ of inverse linear problems is operator theoretic with deep roots in numerical applications and profound implications for the use of Krylov based methods to solve inverse linear problems. Recently this phenomenon has been studied for both bounded and unbounded operators [4,5,6, 8], after having received some past attention in the bounded setting [2, 3, 9, 11, 13, 14, 17, 18].
In general one has a linear operator \(A:\mathcal {H}\rightarrow \mathcal {H}\) acting on some Hilbert space \(\mathcal {H}\), that in many applications represents some physical law, and a datum vector \(g \in \textrm{ran}\,A\) that represents some measurable output. The inverse linear problem is formulated as
where \(f \in \mathcal {H}\) is a solution to the problem that in applications is often a-priori unknown. We call the problem (1.1) solvable as \(g \in \textrm{ran}\,A\). If A is injective, we call (1.1) well-defined, and if additionally \(A^{-1} \in \mathscr {B}(\mathcal {H})\) we call the problem (1.1) well-posed.
The question of ‘Krylov solvability’ becomes relevant in applications when one attempts to solve (1.1) by means of the very popular and celebrated family of Krylov algorithms that search for solution(s) to (1.1) in the distinguished Krylov subspace. Therefore, one naturally wants to know whether a solution(s) \(f \in \mathcal {H}\) is approximable by such vectors in the Krylov subspace
or in other words, whether there exists a solution to (1.1) \(f \in \overline{\mathcal {K}(A,g)}\). Such a solution we call a Krylov solution, and an inverse linear problem that exhibits such an occurrence we call Krylov solvable. The practical advantage of Krylov solvable inverse linear problems is that one may construct a solution(s) to (1.1) using the easy-to-compute vectors \(g, Ag, A^2g, \dots \). Of course, the critical importance of having such knowledge a-priori is that one may decide whether a given problem is indeed a suitable candidate for treatment using a Krylov based algorithm before it is used.
The above question is already well-understood and under good control in the finite-dimensional setting, and is treated in several well-known monographs [12, 16, 24]. To a lesser extent the question of Krylov solvability has been studied in several past works in the infinite-dimensional setting for bounded operators, most of which choose to remain within a particular class of operators (e.g., positive self-adjoint), using specific Krylov algorithms (e.g., GMRES, MINRES, CG, LSQR). Recently, the problem has been studied using operator-theoretic techniques in the infinite-dimensional setting, including unbounded operators [4, 5, 19], and has also resulted in a recent monograph on the topic [6].
In this work we choose to remain in the abstract infinite-dimensional Hilbert space setting where, innocent as the question of Krylov solvability may seem, there are several results that appear un-intuitive when coming from a finite-dimensional analysis perspective. (Indeed, several good examples of Krylov solvability, or lack thereof, of inverse linear problems may be found in [8, Ex. 3.1].)
One strategy to confront certain difficulties that naturally arise in the infinite-dimensional setting has been to identify certain classes of operators that have favourable Krylov solvability properties. In a previous study [8] we were able to identify that the bounded self-adjoint operators always give rise to Krylov-solvable inverse linear problems, and we also identified a new class of operators that we called the ‘\(\mathscr {K}\)-class’ that also always exhibit Krylov solvability. We recently expanded our study of the \(\mathscr {K}\)-class under the effects of perturbations in [7]. These operator classes just described in fact belong to the larger class of Krylov solvable operators, i.e., the collection of linear operators on \(\mathcal {H}\) that always admit a Krylov solution to (1.1) given any g in the range of the operator.
Here we expand our knowledge of the class of Krylov solvable operators by proving that the compact normal operators on Hilbert space always belong to this class. The analysis that permits us to conclude such a result is based primarily on the functional calculus for bounded operators on Banach space (see, for example [1, 15, 20, 23]), and the canonical decomposition of compact normal operators [1, 15]. Moreover, we are able to explicitly describe the Krylov subspace in terms of the datum g and the projection operators onto the eigenspaces of A.
We begin this note with a preparatory theorem in Sect. 2 (Theorem 2.2) before moving on to the analysis specific to compact normal operators in Sect. 3 (Propositions 3.1, 3.4, and 3.9), and finally in Sect. 4 we close with two theorems for general bounded normal operators (Theorems 4.1 and 4.4).
1.1 Notation
Throughout this note \(\mathcal {H}\) denotes an abstract Hilbert space with scalar product \(\langle \cdot , \cdot \rangle \) antilinear in the first argument, and norm \(\left\| \, \right\| _{\mathcal {H}}\). We use \(\left| \varphi \right\rangle \left\langle \psi \right| \), for \(\varphi ,\psi \in \mathcal {H}\), to denote the rank-1 linear map \(v \mapsto \langle \psi , v \rangle \varphi \) for \(v \in \mathcal {H}\); and \(\left\| \, \right\| _{\textrm{op}}\) to denote the standard operator norm on \(\mathscr {B}(\mathcal {H})\).
2 A Preparatory Theorem
Our preparatory Theorem 2.2 concerns the approximation generated by polynomials of \(A \in \mathscr {B}(\mathcal {H})\) of certain Riesz projections in the operator norm \(\left\| \, \right\| _{\textrm{op}}\). We shall use Theorem 2.2 in Sect. 3 in order to analyse the structure of the Krylov subspace \(\mathcal {K}(A,g)\) itself given some \(g \in \mathcal {H}\). We begin with a simple definition before deriving the main result.
Definition 2.1
([1, 20]) An admissible domain \(\mathcal {U}\) of an operator \(A \in \mathscr {B}(\mathcal {H})\) is a non-empty bounded open subset of the complex plane \(\mathbb {C}\) such that the boundary \(\partial \mathcal {U}\) consists of finitely many rectifiable Jordan curves contained in the resolvent \(\rho (A)\) of the operator A and oriented in the positive sense.
Theorem 2.2
Let \(A \in \mathscr {B}(\mathcal {H})\) with spectrum \(\sigma (A)\). Suppose that \(\sigma (A)\) be separated into two parts \(\sigma _1\) and \(\sigma _2\) such that there are admissible domains \(\mathcal {U}_1\) and \(\mathcal {U}_2\) containing \(\sigma _1\) and \(\sigma _2\) respectively; suppose further that \(\overline{\mathcal {U}_1}\cap \overline{\mathcal {U}_2} = \emptyset \) and \(\mathbb {C}{\setminus } (\overline{\mathcal {U}_1} \cup \overline{\mathcal {U}_2})\) is connected in \(\mathbb {C}\). Then there exist polynomial sequences \((p_n^{(j)})_{n \in \mathbb N}\) such that \(\left\| p_n^{(j)}(A) - P_j \right\| _{\textrm{op}} \rightarrow 0\) as \(n \rightarrow \infty \), where
for \(j \in \{1,2\}\).
Proof
Let \(\mathcal {V}_1\) and \(\mathcal {V}_2\) be disjoint open sets containing \(\overline{\mathcal {U}_1}\) and \(\overline{\mathcal {U}_2}\) respectively. Let \(f:\mathcal {V}_1\cup \mathcal {V}_2 \rightarrow [0,1]\) be a function such that \(f(\mathcal {V}_1) = \{1\}\) and \(f(\mathcal {V}_2) = \{0\}\). Clearly f is holomorphic on \(\mathcal {V}_1 \cup \mathcal {V}_2\), so using the holomorphic functional calculus (see [20, Ch. XI] or [1, Ch. II]) we see that
We know from [22, Th. 13.7] that there exists a polynomial sequence \((p_n^{(1)})_{n \in \mathbb N}\) such that \(p_n^{(1)}(z) \xrightarrow {n \rightarrow \infty } f(z)\) uniformly on \(\overline{\mathcal {U}_1} \cup \overline{\mathcal {U}_2}\). As the Cauchy integral
is expressible as a limit of Riemann sums, we see that
where \(l < +\infty \) is the length of the curve \(\partial \mathcal {U}_1\cup \partial \mathcal {U}_2\). The right side of (*) vanishes owing to the analyticity of \(\mathcal {R}\left( A, z\right) \) for all z in the compact curve \(\partial \mathcal {U}_1\cup \partial \mathcal {U}_2\) which guarantees
coupled with the uniform vanishing of \(\vert p_n^{(1)}(z) - f(z) \vert \) on \(\overline{\mathcal {U}_1} \cup \overline{\mathcal {U}_2}\) as \(n \rightarrow \infty \).
As \(f(A) = P_1\), we have our conclusion for \(j = 1\). The proof is similar for \(j = 2\) by replacing the function \(f:\mathcal {V}_1\cup \mathcal {V}_2 \rightarrow [0,1]\) with any function \(h:\mathcal {V}_1\cup \mathcal {V}_2 \rightarrow [0,1]\) such that \(h(\mathcal {V}_2) = \{1\}\) and \(h(\mathcal {V}_1) = \{0\}\). \(\square \)
3 Compact Normal Operators
In this section we derive fundamental results that describe both the Krylov subspace and prove the Krylov solvability for a compact normal operator. We use this to provide a simple proof of the cyclicity of these operators on separable Hilbert space (Corollary 3.2).
We use the representation given in [15, Ch. V] for a compact normal operator A on Hilbert space \(\mathcal {H}\), namely
where \(S \subset \mathbb N_0\) is an index set with \(0 \in S\), and \(\lambda _n \in \mathbb {C}{\setminus }\{0\}\) for all \(n \in S{\setminus }\{0\}\) are the distinct non-zero eigenvalues of A, with \(\lambda _0 = 0\) not necessarily an eigenvalue of A. \((\lambda _n)_{n \in S}\) is a bounded sequence in \(\mathbb {C}\) such that \(\lambda _n \xrightarrow {n \rightarrow \infty } 0\) when S is infinite. The \(P_n\)’s are mutually orthogonal projections given by
where \(\mathcal {U}_n\) is an admissible domain that contains only the single point \(\lambda _n\) from the spectrum \(\sigma (A)\). \(P_0\) is the orthogonal projection onto \(\ker A\) (which is \(\mathbb {O}\) when A is injective), and \(P_0 P_n = \mathbb {O}\) for all \(n \in \mathbb N\). Convergence of the sum (3.1) occurs in the operator norm topology.
We have that the partial sums of \((P_n)_{n \in S}\) form a resolution of the identity,
where convergence of the sum is in the strong operator topology, so that
Finally, we recall the important fact that for any normal operator we have the relation \(\ker A = \ker A^*\), ensuring that \(\textrm{ran}\,A^\perp = \ker A\).
Our first proposition reveals explicitly the structure of the Krylov subspace in a way that be more easily accessible and more meaningful for the purposes of investigating Krylov solvability and structural properties of the space than the standard definition (1.2).
Proposition 3.1
Let \(A \in \mathscr {B}(\mathcal {H})\) be a compact normal operator and \(g \in \mathcal {H}\). Then
Proof
When \(A = \mathbb {O}\), the result is trivially true as \(P_0 = \mathbbm {1}\) and \(S = \{0\}\).
Assume \(A \ne \mathbb {O}\) so that \(S \supsetneq \{0\}\), and take \(n_0 \in S{\setminus }\{0\}\). Let B be a bounded open ball about 0 such that \(\lambda _{n_0} \notin \overline{B}\) and \(\partial {B} \subset \rho (A)\) (this is always possible as \(\sigma (A) = \{\lambda _n\}_{n \in S}\) is discrete). There are at most finitely many points of \(\sigma (A)\) outside \(\overline{B}\) as 0 is the only point of accumulation possible in the spectrum. For each remaining point \(\lambda _n \in \sigma (A) {\setminus } \overline{B}\) we construct bounded open balls \(B_n\), containing only the respective point \(\lambda _n\), with disjoint closures and also disjoint closure from \(\overline{B}\) (clearly \(\partial B_n \subset \rho (A)\)). Let \(\mathcal {U}\) be
where \(S' \subset S\) is the finite set containing the indices of all the spectral points \(\lambda _n\) not in \(\overline{B}\). \(\mathcal {U}\) and \(B_{n_0}\) are admissible domains with mutually disjoint closures, and moreover \(\mathbb {C}{\setminus } (\overline{\mathcal {U}} \cup \overline{B_{n_0}})\) is connected (indeed, \(\overline{\mathcal {U}} \cup \overline{B_{n_0}}\) is the union of finitely many bounded, disjoint, closed balls).
Applying Theorem 2.2 taking \(\mathcal {U}_1 = B_{n_0}\) and \(\mathcal {U}_2 = \mathcal {U}\), there exists some polynomial sequence \((p^{(n_0)}_j)_{j \in \mathbb N}\) such that \(\left\| p_j^{(n_0)}(A) - P_{n_0} \right\| _{\textrm{op}} \xrightarrow {j\rightarrow \infty } 0\), and in particular \(\left\| p_j^{(n_0)}(A)g - P_{n_0} g \right\| _{\mathcal {H}} \xrightarrow {j\rightarrow \infty } 0\). Therefore \(P_{n_0} g \in \overline{\mathcal {K}\left( A,g\right) }\). As \(n_0 \in S {\setminus } \{0\}\) was arbitrary, we have following inclusion
As \(\sum _{n \in S {\setminus } \{0\}} P_n g \in \overline{\mathcal {K}\left( A,g\right) }\) from (3.6), combining this with (3.4) implies that \((\mathbbm {1}- P_0)g \in \overline{\mathcal {K}\left( A,g\right) }\). The linearity of \(\overline{\mathcal {K}\left( A,g\right) }\) and the fact that \(g \in \overline{\mathcal {K}\left( A,g\right) }\) imply \(P_0 g \in \overline{\mathcal {K}\left( A,g\right) }\). We therefore have the inclusion
The reverse inclusion is obtained from the fact that for any \(k \in \mathbb N\),
which implies that
From Eq. (3.3), \(g = \sum _{n \in S} P_n g\) so that \(g \in \overline{\textrm{span}\left\{ P_n g \,|\, n \in S \right\} }\), and so
We conclude by taking the closure. \(\square \)
Here we present the following corollary of Proposition 3.1 that provides a simple exposition of the cyclicity of compact normal operators with simple eigenvalues. We recall that an operator \(A \in \mathscr {B}(\mathcal {H})\) is called cyclic if there exists some \(g \in \mathcal {H}\) such that \(\mathcal {K}\left( A,g\right) \) is dense in \(\mathcal {H}\). Though the conclusion of Corollary 3.2 is already known (see, for example, [10, Cor. 30.15] or [21, Th. 1.1]), we choose to present it here through the lens of our explicit knowledge of the Krylov subspace provided by Proposition 3.1.
Corollary 3.2
Let \(A \in \mathscr {B}(\mathcal {H})\) be a compact normal operator on a separable Hilbert space \(\mathcal {H}\) with \(\dim (\ker A) \le 1\), and \(\dim (\textrm{ran}\,P_n) = 1\) for all \(n \in S {\setminus } \{0\}\). Then A is cyclic.
Proof
We know that the \(P_n\)’s form a resolution of the identity and are mutually orthogonal, so there exists an orthogonal basis \(\{\varphi _n\}_{n \in S}\) of \(\mathcal {H}\) such that \(P_n = \left| \varphi _n \right\rangle \left\langle \varphi _n \right| \), where \(\left\| \varphi _n \right\| _{\mathcal {H}} = 1\) for all \(n \in S{\setminus } \{0\}\), and
Let \(g = \varphi _0 + \sum _{n \in S{\setminus }\{0\}} \frac{1}{n} \varphi _n\) so that \(g \in \mathcal {H}\). By Proposition 3.1
\(\square \)
Remark 3.3
We elaborate on the comparison between the cyclicity result Corollary 3.2 and the more general cyclicity condition for normal operators presented in [21, Th. 1.1]. Theorem 1.1 of [21] states that a normal operator \(A \in \mathscr {B}(\mathcal {H})\) is cyclic if and only if there exists a positive, finite, Borel measure \(\mu \) on \(\sigma (A)\) such that A is unitarily equivalent to the multiplication operator \(M_z:L^2(\mu ) \rightarrow L^2(\mu )\) with action \(f(z) \mapsto zf(z)\).
Indeed, it is enough to consider A and \(g \in \mathcal {H}\) as given in the statement and proof respectively of Corollary 3.2, and the finite positive Borel measure \(\mu (\Omega ) {:}{=} \langle E^{(A)}(\Omega ) g, g \rangle \), where \(E^{(A)}\) is the unique projection valued spectral measure for A. \(\mu \) has support exactly on \(\sigma (A)\), and there exists the unitary operator \(T: L^2(\mu ) \rightarrow \mathcal {H}\) with action \(f(z) \mapsto f(A)g\). f(A) is understood in terms of the spectral functional calculus
We see that \(T ((M_z f)(z)) = A T f\) for all \(f \in L^2(\mu )\), i.e., \(M_z = T^*AT\), thus the statement of Corollary 3.2 satisfies the conditions of [21, Th. 1.1] and therefore A is cyclic.
The following proposition reveals our main result, namely that compact normal operators give rise to Krylov solvable inverse linear problems, and therefore belong to a larger class of operators that always exhibit Krylov solvability (this class contains, for example, the bounded self-adjoint and \(\mathscr {K}\)-class operators). The proof of this proposition is a result of the explicit knowledge of the Krylov subspace as revealed in Proposition 3.1.
Proposition 3.4
Let \(A \in \mathscr {B}(\mathcal {H})\) be a compact normal operator. If \(g \in \textrm{ran}\,A\), then \(Af = g\) has a unique and minimal norm Krylov solution. If in addition \(A \ne \mathbb {O}\), then the Krylov solution is
Proof
When \(A = \mathbb {O}\) the conclusion is obvious: \(g \in \textrm{ran}\,A\) implies that \(g = 0\) and therefore \(\overline{\mathcal {K}\left( A,g\right) } = \{0\}\) with a solution \(f_\circ = 0 \in \overline{\mathcal {K}\left( A,g\right) }\) to the inverse linear problem. Therefore we consider the case \(A \ne \mathbb {O}\).
First we show that the vector \(f_\circ \) in (3.7) is in \(\mathcal {H}\). Indeed, as \(g \in \textrm{ran}\,A\) there exists some \(f \in \mathcal {H}\) such that \(Af = g\), and therefore
Given any \(n \in S{\setminus }\{0\}\) owing to the mutual orthogonality of the projections \((P_n)_{n \in S}\), we get \(P_n g = \lambda _n P_n f\). Therefore \(P_n f = \frac{1}{\lambda _n} P_n g\) for all \(n \in S{\setminus } \{0\}\) and
where Eq. (3.4) is used in the last equality, so that indeed \(f_\circ \in \mathcal {H}\).
Next we show by direct substitution that \(f_\circ \) is a solution to \(Af = g\). Indeed,
As \(g \in \textrm{ran}\,A \perp \ker A\) this implies \(P_0 g = 0\) meaning that \(g = \sum _{n \in S{\setminus }\{0\}} P_n g\), and indeed \(f_\circ \) is a solution to the inverse linear problem as claimed.
As \(f_\circ \perp \ker A\), any solution f to \(Af = g\) must be of the form \(f = f_\circ + \psi \) where \(\psi \in \ker A\). Therefore, \(\left\| f \right\| _{\mathcal {H}}^2 = \left\| f_\circ \right\| _{\mathcal {H}}^2 + \left\| \psi \right\| _{\mathcal {H}}^2\) from which \(f_\circ \) is a minimal norm solution.
From Proposition 3.1
so it follows \(f_\circ \in \overline{\mathcal {K}\left( A,g\right) }\). This solution is unique in \(\overline{\mathcal {K}\left( A,g\right) }\) owing to [8, Prop. 3.9]. \(\square \)
Remark 3.5
We recall that for any \(A \in \mathscr {B}(\mathcal {H})\) normal with Krylov solvable inverse linear problem \(Af = g\), \(g \in \textrm{ran}\,A\), [8, Prop. 3.9] states that there exists exactly one Krylov solution.
Remark 3.6
The argument of the norm minimality of the Krylov solution (if it exists) from the proof of Proposition 3.4 can be extended beyond the class of compact normal operators to the whole class of bounded normal operators. Indeed, let \(f_\circ \in \overline{\mathcal {K}\left( A,g\right) }\) be the Krylov solution (when it exists) to the inverse linear problem. As \(\overline{\mathcal {K}\left( A,g\right) } \subset \overline{\textrm{ran}\,A} \perp \ker A\) it follows that \(f_\circ \perp \ker A\), and any solution f to \(Af = g\) has the form \(f = f_\circ + \psi \), where \(\psi \in \ker A\). Therefore, as \(f_\circ \perp \psi \) we have \(\left\| f \right\| _{\mathcal {H}}^2 = \left\| f_\circ \right\| _{\mathcal {H}}^2 + \left\| \psi \right\| _{\mathcal {H}}^2\) from which \(f_\circ \) is a minimal norm solution.
Remark 3.7
The above considerations in Remarks 3.5 and 3.6 also hold for Krylov solutions (if they exist) to the inverse linear problem arising from any operator \(A \in \mathscr {B}(\mathcal {H})\), provided that \(\ker A \subset \ker A^*\).
Our next proposition analyses an important structural property of the Krylov subspace informally known as Krylov reducibility, that is intimately linked to the Krylov solvability properties of inverse linear problems (see [8, Prop. 3.3]). First we recall the appropriate definition for bounded operators. (For the unbounded setting one may refer to [4].)
Definition 3.8
([8]) Let \(A \in \mathscr {B}(\mathcal {H})\) and \(g \in \mathcal {H}\). If both \(\overline{\mathcal {K}\left( A,g\right) }\) and \(\mathcal {K}\left( A,g\right) ^\perp \) are invariant under A, i.e.,
then we say that A is \(\mathcal {K}\left( A,g\right) \)-reduced. If A is \(\mathcal {K}\left( A,g\right) \)-reduced then we also have \(A^* \overline{\mathcal {K}\left( A,g\right) } \subset \overline{\mathcal {K}\left( A,g\right) }\) [8, Lem. 2.2].
Proposition 3.9
Let \(A \in \mathscr {B}(\mathcal {H})\) be a compact normal operator, and let \(g \in \mathcal {H}\). Then A is \(\mathcal {K}\left( A,g\right) \)-reduced.
Proof
The action of \(A^*\) is given by
Therefore
where by Proposition 3.1\(A^*g \in \overline{\mathcal {K}\left( A,g\right) }\). We know that for bounded normal operators, A is \(\mathcal {K}\left( A,g\right) \)-reduced if and only if \(A^* g \in \overline{\mathcal {K}\left( A,g\right) }\) [8, Prop. 2.4]. This completes the proof. \(\square \)
4 An Isomorphism of Krylov Subspaces Generated by Bounded Normal Operators
In this section we let \(E^{(A)}\) be the unique projection valued spectral measure for a normal operator \(A \in \mathscr {B}(\mathcal {H})\) (see [25, Ch. 5]), with associated scalar measure \(\mu _{g}^{(A)}(\Omega ) = \langle E^{(A)}(\Omega ) g, g \rangle \) for \(g \in \mathcal {H}\) and \(\Omega \subset \mathbb {C}\) a Borel set. It is known that \(E^{(A)}\) has support only over \(\sigma (A)\), and that \(\mu _{g}^{(A)}\) is a positive, regular Borel measure [25].
Theorem 4.1
Let \(A\in \mathscr {B}(\mathcal {H})\) be a normal operator and \(g \in \mathcal {H}\). If A is \(\mathcal {K}\left( A,g\right) \)-reduced, then there exists the isomorphism
where f(A) is understood in terms of the spectral functional calculus
Proof
Let \(g \in \mathcal {H}\) be such that A is \(\mathcal {K}\left( A,g\right) \)-reduced. Then
for any \(k \in \mathbb N_0\). This clearly implies \((A^*)^k A^n g \in \overline{\mathcal {K}\left( A,g\right) }\) for all \(k \in \mathbb N_0\) and for all \(n \in \mathbb N_0\). Let \(q(A,A^*)\) be a polynomial in A and \(A^*\). As A and \(A^*\) commute it follows \(q(A,A^*)g \in \overline{\mathcal {K}\left( A,g\right) }\).
By the Stone-Weierstrass theorem the algebra of complex coefficient polynomials in both z and \(\bar{z}\) on the compact set \(\sigma (A)\) is dense in the space of continuous functions on \(\sigma (A)\) equipped with supremum norm. As \(\mu _{g}^{(A)}\) is a regular Borel measure on the compact set \(\sigma (A)\), by standard approximation theorems (e.g., see [22, Th. 3.14]) the continuous functions on \(\sigma (A)\) are dense in \(L^2(\sigma (A), \mu _{g}^{(A)})\). Combining the two statements above, the space of polynomials in both z and \(\bar{z}\) over \(\sigma (A)\) is dense in \(L^2(\sigma (A), \mu _{g}^{(A)})\).
Therefore, given any \(f \in L^2(\sigma (A), \mu _{g}^{(A)})\) there exists a polynomial sequence \((q_n(z,\bar{z}))_{n \in \mathbb N}\) such that \(q_n(z,\bar{z}) \xrightarrow [n \rightarrow \infty ]{L^2} f(z)\). From the functional calculus
where the right side vanishes as \(n \rightarrow \infty \). As \(q_n(A,A^*)g \in \overline{\mathcal {K}\left( A,g\right) }\) for all \(n \in \mathbb N\), we have \(f(A)g \in \overline{\mathcal {K}\left( A,g\right) }\).
For any \(v \in \overline{\mathcal {K}\left( A,g\right) }\) there exists a sequence of polynomials in z only, \((p_n(z))_{n \in \mathbb N}\), such that \(p_n(A)g \xrightarrow [n \rightarrow \infty ]{\left\| \, \right\| _{\mathcal {H}}} v\). \((p_n(A)g)_{n \in \mathbb N}\) is Cauchy in \(\left\| \, \right\| _{\mathcal {H}}\) so that
for any \(m,n \in \mathbb N\), showing that \((p_n(z))_{n \in \mathbb N}\) is Cauchy in \(L^2(\sigma (A),\mu _{g}^{(A)})\) as well. Thus \(p_n\) converges to some \(h \in L^2(\sigma (A), \mu _{g}^{(A)})\). The mapping in (4.1) is therefore a linear bijection between the spaces \(L^2(\sigma (A), \mu _{g}^{(A)})\) and \(\overline{\mathcal {K}\left( A,g\right) }\). This concludes the proof. \(\square \)
Corollary 4.2
Let \(A \in \mathscr {B}(\mathcal {H})\) be compact and normal, and let \(g \in \mathcal {H}\). Then we have the isomorphism given in (4.1).
Proof
From Proposition 3.9 we know that A is \(\mathcal {K}\left( A,g\right) \)-reduced, and so the result follows by Theorem 4.1. \(\square \)
Remark 4.3
If A is a normal operator, then it is not necessarily \(\mathcal {K}\left( A,g\right) \)-reduced. The counter-example [8, Ex. 3.8] shows that the normality of an operator A coupled with the Krylov solvability of the inverse linear problem is in general not enough to guarantee that A is \(\mathcal {K}\left( A,g\right) \)-reduced.
Lastly, we state the converse to Theorem 4.1.
Theorem 4.4
Let \(A \in \mathscr {B}(\mathcal {H})\) be a normal operator and \(g \in \mathcal {H}\). Suppose that there exists the isomorphism (4.1), (4.2). Then A is \(\mathcal {K}\left( A,g\right) \)-reduced.
Proof
The function \(f:\sigma (A) \rightarrow \mathbb {C}\), \(z \mapsto \bar{z}\) is in \(L^2(\sigma (A), \mu _{g}^{(A)})\). Indeed, by the spectral integral
By hypothesis there exists the isomorphism (4.1), (4.2) that subsequently implies \(A^*g \in \overline{\mathcal {K}\left( A,g\right) }\) as \(f(A) = A^*\). According to [8, Prop. 2.4] this is equivalent to the \(\mathcal {K}\left( A,g\right) \)-reducibility of A. \(\square \)
References
Beauzamy, B.: Introduction to Operator Theory and Invariant Subspaces, North-Holland Mathematical Library. Elsevier, Amsterdam (1988)
Campbell, S., Ipsen, I., Kelly, C., Meyer, C., Xue, Z.: Convergence estimates for solution of integral equations with GMRES. J. Integr. Equ. Appl. 8, 19–34 (1996)
Campbell, S.L., Ipsen, I.C.F., Kelley, C.T., Meyer, C.D.: GMRES and the minimal polynomial. BIT Numer. Math. 36, 664–675 (1996)
Caruso, N.A., Michelangeli, A.: Krylov Solvability of Unbounded Inverse Linear Problems. Integr. Equ. Oper. Theory 93, Paper No. 1 (2021)
Caruso, N.A., Michelangeli, A.: Convergence of the conjugate gradient method with unbounded operators. Oper. Matrices 16, 35–68 (2022)
Caruso, N.A., Michelangeli, A.: Inverse Linear Problems on Hilbert Space and their Krylov Solvability. Springer Monographs in Mathematics. Springer, Cham (2022)
Caruso, N.A., Michelangeli, A.: Krylov solvability under perturbations of abstract inverse linear problems. J. Appl. Anal. 29, 3–29 (2023)
Caruso, N.A., Michelangeli, A., Novati, P.: On Krylov solutions to infinite-dimensional inverse linear problems. Calcolo 56, 32 (2019)
Caruso, N.A., Novati, P.: Convergence analysis of LSQR for compact operator equations. Linear Algebra Appl. 583, 146–164 (2019)
Conway, J.B.: A Course in Operator Theory, vol. 21 of Graduate Studies in Mathematics, American Mathematical Society (2000)
Engl, H.W., Hanke, M., Neubauer, A.: Regularization of Inverse Problems. Mathematics and its Applications, vol. 375. Kluwer, Dordrecht (1996)
Golub, G.H., van Loan, C.F.: Matrix Computations, 3rd edn. The John Hopkins University Press, Baltimore (1996)
Hanke, M.: Conjugate Gradient Type Methods for Ill-posed Problems. Pitman Research Notes in Mathematics Series, vol. 327. Longman Scientific & Technical, Harlow (1995)
Karush, W.: Convergence of a method of solving linear problems. Proc. Am. Math. Soc. 3, 839–851 (1952)
Kato, T.: Perturbation theory for linear operators, Classics in Mathematics, Springer, Berlin (1995). Reprint of the 1980 edition
Liesen, J., Strakoš, Z.e.: Krylov Subspace Methods. Numerical Mathematics and Scientific Computation. Oxford University Press, Oxford (2013). Principles and analysis
Nemirovskiy, A.S., Polyak, B.T.: Iterative methods for solving linear ill-posed problems under precise information. I. Izv. Akad. Nauk SSSR Tekhn. Kibernet. 203, 13–25 (1984)
Nemirovskiy, A.S., Polyak, B.T.: Iterative methods for solving linear ill-posed problems under precise information. II. Eng. Cybern. 22, 50–57 (1984)
Olver, S.: GMRES for the differentiation operator. SIAM J. Numer. Anal. 47, 3359–3373 (2009)
Riesz, F., Sz-Nagy, B.: Functional Analysis. Frederick Ungar Publishing Co., New York (1955). Translated by Leo F. Boron
Ross, W.T., Wogen, W.R.: Common cyclic vectors for normal operators. Indiana Univ. Math. J. 53, 1537–1550 (2004)
Rudin, W.: Real and Complex Analysis, 3rd edn. McGraw-Hill, New York (1987)
Rudin, W.: Functional Analysis, 2nd edn. McGraw-Hill, Singapore (1991)
Saad, Y.: Iterative Methods for Sparse Linear Systems, 2nd edn. Society for Industrial and Applied Mathematics, Philadelphia (2003)
Schmüdgen, K.: Unbounded Self-adjoint Operators on Hilbert Space. Graduate Texts in Mathematics, vol. 265. Springer, Dordrecht (2012)
Acknowledgements
The author gratefully acknowledges the support provided by the Italian National Institute of Higher Mathematics INdAM.
Funding
Open access publishing supported by the National Technical Library in Prague.
Author information
Authors and Affiliations
Contributions
Noè Angelo Caruso wrote and reviewed the manuscript.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare no competing interests.
Additional information
Communicated by Pierre Portal.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Caruso, N.A. A Note on the Krylov Solvability of Compact Normal Operators on Hilbert Space. Complex Anal. Oper. Theory 17, 109 (2023). https://doi.org/10.1007/s11785-023-01413-0
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s11785-023-01413-0