Reproducing Kernel Hilbert Space Associated with a Unitary Representation of a Groupoid

The aim of the paper is to create a link between the theory of reproducing kernel Hilbert spaces (RKHS) and the notion of a unitary representation of a group or of a groupoid. More specifically, it is demonstrated on one hand, how to construct a positive definite kernel and an RKHS for a given unitary representation of a group(oid), and on the other hand how to retrieve the unitary representation of a group or a groupoid from a positive definite kernel defined on that group(oid) with the help of the Moore-Aronszajn theorem. The kernel constructed from the group(oid) representation is inspired by the kernel defined in terms of the convolution of functions on a locally compact group. Several illustrative examples of reproducing kernels related with unitary representations of groupoids are discussed in detail. The paper is concluded with the brief overview of the possible applications of the proposed constructions.


Introduction
The theory of reproducing kernel Hilbert spaces (RKHS) provides research tools in such domains as complex analysis, probability theory and statistics [2], stochastic (Gaussian) processes [14], quantum physics [15,16] or computer science (especially artificial intelligence [9,11]). Basic properties and definitions together with the detailed analysis of RKHS can be found in [18,23]. In [1] RKHS associated with the continuous wavelet transform generated by the irreducible representations of the Euclidean Motion SE(2) are considered.
Groupoids are widely used in differential geometry, algebraic topology and physics. There is a well-known association of groupoids with C * -algebras [7,22]. The definition and main properties of (locally compact) groupoids can be found for example in [6,17]. In [20,21] unitary representations of groupoids are considered. The applications of theory of finite groudoids and their representations are presented in [12,13]. Considering representations of locally compact groups, the Haar measure and the tensor product of the Hilbert spaces, we refer the Reader to [24].
The aim of te present paper is to connect the above two domains. To this end, we study the relationship between unitary representations of groupoids and reproducing kernel Hilbert spaces, proposing how to construct one using the other provided certain conditions are met.
The content of the paper is as follows. In Section 2 the fundamental definitions and properties of the theory of reproducing kernel Hilbert spaces are introduced. Section 3 covers the concept of groupoids (propositions, examples Equality (1) is called the reproducing kernel property, and the function K : A × A → C defined as is called a reproducing kernel on the space H. If the latter is a Hilbert space, we call H a reproducing kernel Hilbert space (RKHS).
Clearly, by the Riesz representation theorem, any RKHS has a unique reproducing family and thus a unique reproducing kernel, which can be easily shown to be positive definite. The following seminal result shows that actually the converse is also true: Every positive definite kernel is a reproducing kernel on a certain Hilbert space.
Theorem 1 (Moore-Aronszajn). Let K be a positive definite kernel on a non-empty set A. Then there is a unique Hilbert space H(K) of complex-valued functions on A with the reproducing kernel K.
Proof. (A sketch; for details, see [18,Theorem 2.14]) One considers the vector space H 0 (K) := span{K a } a∈A . The map ·, · H0 : can be demonstrated to be a well-defined inner product. Then one shows that the completion of H 0 (K) in the norm induced by that inner product, denoted H(K) := H 0 (K) = span{K a } a∈A , can still be interpreted as a space of complex-valued functions on A, with K as its reproducing kernel.
In what follows, we shall be using the following general way of constructing positive definite kernels.

Theorem 2.
Let F : A → H be any function from a nonempty set A to a Hilbert space H equipped with an inner product ·, · . Then: • By Theorem 1, there exists an RKHS H(K) := span {K(·, a)} a∈A , for which K is the reproducing kernel.
Notice that the third bullet of the above theorem carries a lot of information about the functions belonging to H(K). For example, if F is weakly continuous, then H(K) ⊂ C(A).
The (unique) reproducing kernel of a given RKHS turns out be tightly related to the so-called Parseval frames, which can be thought of as generalizations of complete orthonormal systems of vectors.
Definition 3 (cf. Definition 2.6 & Proposition 2.8 in [18]). Let H be a Hilbert space (not necessarily of functions) with an inner product ·, · . The set where the series converges pointwise.

Reproducing kernel defined by the convolution of functions on a locally compact group
Let G be a locally compact group (not necessarily abelian) and let µ be a fixed left Haar measure on G. For two continuous compactly supported complex-valued functions f 1 , f 2 ∈ C c (G), their convolution f 1 * f 2 is another such function on G defined via The above definition extends to the space L 2 (G, µ) in the following sense [10, 444O & 444R]: Example 1. Let G be a locally compact group and µ be a left Haar measure on G. Fix f ∈ L 2 (G, µ) and consider the map K : By the preceding discussion, K is bounded and jointly continuous. Moreover, it is a positive definite kernel, because for any n ∈ N, λ 1 , . . . , λ n ∈ C and g 1 , . . . , g n ∈ G one has that n i,j=1 where in the antepenultimate step we employed the left-invariance of µ. By Theorem 1, K is a reproducing kernel on a certain Hilbert space H(K) equipped with the inner product ·, · H(K) with the reproducing family {K g := K(·, g)} g∈G . In fact, H(K) is a certain space of bounded continuous functions on G, which can be isometrically embedded into L 2 (G, µ). To see why this is the case, let L g : G → G, ξ → gξ denote the left shift by the element g ∈ G.
Employing the pullback L * g f := f • L g , one can write that for any g, h ∈ G. Thus, the above construction is actually a special case of the one described in Theorem 2, with the map F : G → L 2 (G, µ) defined as F (g) := L * g −1 f for every g ∈ G. Hence the elements of H(K) are mappings of the form g → v, L * g −1 f with v ∈ L 2 (G, µ), which are clearly bounded (by v L 2 f L 2 ) and continuous, whereas the isometric embedding S : . As a side remark, observe that the above positive definite kernel K can also be expressed as what is analogous to formula (3), only here instead of a Parseval frame {ϕ j } j∈I and a counting measure we have the family {L * τ −1f } τ ∈G of the left-translations of the mapf and the left Haar measure µ.

the inversion map
The element γ ∈ Γ can be regarded as an arrow with the starting point at x = s(γ) and the ending point at y = r(γ), where x, y ∈ X.
Remark 1. From the above definition it follows that the groupoid (Γ, X, s, r, ε, ·, −1 ) can be identified with a small category in which all morphisms are invertible. In this interpretation X is the set of objects, Γ is the set of morphisms, s(γ) is the domain of γ, r(γ) is the codomain of γ, ε(x) is the identity morphism at x, · is the composition of morphisms and γ −1 is the inverse of the morphism γ ∈ Γ.

Example 2.
A group G is a groupoid over the singleton X := {x} with the mappings defined as ∀ g∈G s(g) := x, r(g) := x and ε(x) := e -the unit of the group G. The inversion and multiplication mappings are given by the respective group operations.
Let Γ be a groupoid over the set X. It is easy to show that the relation ∼ on the set X defined as follows: is an equivalence relation on X. The equivalence class of any element x with respect to ∼ is the set We call Or x the orbit of the element x ∈ X with respect to the groupoid Γ. We say that Γ is transitive if for any x, y ∈ X we have x ∼ y (or, equivalently, if Or x = X for some and hence for every x ∈ X).
The set of arrows starting at x and ending at y is denoted by Γ y = x} of elements starting and ending at x together with the groupoid multiplication and inversion map has a group structure, and we call it the isotropy group of the element x.
Remark 2. If Γ is a transitive groupoid over X then it is easy to show that for any y ∈ X the groups Γ x x and Γ y y are isomorphic (albeit not canonically!). Without the transitivity, however, it may happen that for some x = y the fibers Γ x x and Γ y y are not isomorphic as groups. Remark 3. If (Γ, X, s, r, ε, ·, −1 ) is a groupoid and Γ, X are topological spaces then we call Γ a topological groupoid if all maps s, r, ε, ·, −1 are continuous. In this case the maps ε, −1 are homeomorphisms onto their images and all isotropy groups are topological groups.

Unitary representation of a groupoid
Recall that a unitary representation of a group G is a pair (U, H), where H is a Hilbert space and U is a map assigning to every g ∈ G a unitary operator U(g) : The notion of a unitary representation can be extended onto groupoids.
Notice that from the above definition it already follows that From the family H := {H x } x∈X one can construct a new Hilbert space H := x∈X H x defined as the completion of the direct sum x∈X H x with respect to the norm generated by the inner product x∈X ·, · x , where ·, · x denotes the inner product on H x .
Many authors [8,17,21] use a more general and somewhat more involved definition of a unitary representation of a groupoid, in which H is a Hilbert bundle or a measurable field of complex Hilbert spaces. This allows for constructing many more interesting Hilbert spaces from the fibers H x than just the completed direct sum H above. In the present paper, however, we keep the definition simple so that the constructions of the positive definite kernels and RKHS become more tractable.
Example 3. Let Γ be a groupoid over X and H be a fixed Hilbert space equipped with an inner product ·, · . Consider the family {H x := {x} × H} x∈X with H x endowed with the inner product

change of the fiber base point) is of course unitary. Any such a representation of the groupoid Γ is called a trivial representation.
A less trivial standard examples of groupoid representations arise for locally compact topological groupoids. Observe that for any such a groupoid Γ, the fibers Γ x := r −1 (x) and Γ x := s −1 (x) for any x ∈ X are locally compact spaces, too, and the same concerns the base space X itself. On such groupoids one introduces the following generalization of Haar measures [17,21]. Definition 6. Let Γ be a locally compact topological groupoid. The family {λ x } x∈X of regular Borel measures on Γ x is called a left Haar system for the groupoid Γ if Similarly, the family {λ x } x∈X of regular Borel measures on Γ x is called a right Haar system for the groupoid Γ if Observe that both f 0 and f 0 are automatically compactly supported. Conditions 1. and 1. ′ express the demand for the measures λ x and λ x to vary continuously over X, whereas conditions 2. and 2. ′ generalize the notions of, respectively, left and right invariance of Haar measures on locally compact groups.

Example 4. For any
Such a representation (U, {H x } x∈X ) is called the left regular representation of the groupoid Γ.
Such a representation (U, {H x } x∈X ) is called the right regular representation of the groupoid Γ.
For more examples of unitary representations of groupoids, the Reader is referred to [12,21].

Reproducing kernels and unitary representations 4.1 Reproducing kernel associated to a unitary representation of a group
Let G be a group and (U, H) be its unitary representation on a Hilbert space H equipped with an inner product ·, · . Additionally, let v ∈ H be any fixed vector. Formula (4) in Example 1 suggests considering the kernel K : G × G → C defined as Notice that thus defined K is a special case of the construction presented in Theorem 2 with the map F : G → H given by F (g) := U(g)v, g ∈ G. This means, in particular, that the RKHS H(K) provided by the Moore-Aronszajn theorem is a space of functions of the form g → w, U(g)v , where w ∈ H. Notice that, if U is a weakly continuous unitary representation of a topological group G, then H(K) ⊂ C(G). Moreover, if {w j } j∈I ⊂ H is a Parseval frame for H, then where ϕ j := T w j ∈ H(K) (cf. the third bullet in Theorem 2). On the strength of Theorem 3, {ϕ j } j∈I is a Parseval frame for H(K).
By the unitarity of the representation, the kernel K satisfies where e is the unit element of G.
Conversely, suppose we are given a positive definite kernel K : G × G → C on a group G satisfying (6). We can employ the Moore-Aronszajn theorem to define its representation (U, H(K)). Concretely, for any g ∈ G define U(g) n i=1 λ i K hi := n i=1 λ i K ghi for any element of H 0 (K) := span{K h } h∈G . Since there is no guarantee that the system {K h } h∈G is linearly independent, we must check that such a U(g) is well defined. To this end, it suffices to prove that if n i=1 λ i K hi ≡ 0 on G, then also n i=1 λ i K ghi ≡ 0. But thanks to (6) we have that, for any h ∈ G, by assumption. Since H 0 (K) is dense in H(K), thus defined U(g) can be uniquely extended to H(K). Moreover, also by (6) and by the density argument, one obtains the unitarity of U(g) by verifying that for any h, h ′ ∈ G Observe, finally, that one can retrieve the kernel K from the above 'Moore-Aronszajn representation' through formula (5). Indeed, one simply has to take v := K e .

Reproducing kernel associated to a unitary representation of a groupoid
Let us now generalize the above relationship between unitary representations of groups and reproducing kernels onto the groupoid setting. Let thus Γ be a groupoid over X and (U, H = {H x } x∈X ) be its unitary representation as specified by Definition 5. Additionally, let v be a fixed vector field, by which we shall understand a mapping X ∋ x → v(x) ∈ H x (note: vector fields need not belong to H := x∈X H x ). Define the kernel K : Observe that for each x ∈ X the restriction K x := K| Γ x ×Γ x is a positive definite kernel -it constitutes a special case of the construction presented in Theorem 2 with F x : Γ x → H x given by F x (γ) := U(γ)v(s(γ)) for every γ ∈ Γ x . Invoking the Moore-Aronszajn theorem (Theorem 1), we obtain an RKHS given by H(K x ) := span K x γ := K x (·, γ) γ∈Γ x , whose reproducing kernel is K x . By the third bullet of Theorem 2, every element of H(K x ) is a function on Γ x of the form γ → w x , U(γ)v(s(γ)) , where w x ∈ H x . Finally, by the fourth bullet of Theorem 2, for any x ∈ X the Hilbert space H(K x ) can be isometrically embedded into H x , its image being the closed subspace V x := span{U(γ)v(s(γ))} γ∈Γ x .
Notice that the two above constructions are of RKHS compatible in the sense that Indeed, observe that both spaces have the same dense subspaces, namely (cf. the sketch of the proof of Theorem 1 above) where the maps K γ : Γ → C and K x γ : Γ x → C have been identified (the former being the extension by zero of the latter). Since both above spaces are equipped with the same inner product (given by (2)), they yield the same Hilbert spaces after completion.
Similarly as before, by the third bullet of Theorem 2, every element of H(K) is a function on Γ of the form γ → w, U(γ)v(s(γ)) , where w ∈ H. Notice that such functions must vanish on all but countably many fibers Γ x . Moreover, if {w j } j∈I ⊂ H is a Parseval frame for H, then where ϕ j := w j , U(·)v(s(·)) H . Similarly as in the group case, by Theorem 3 we obtain that {ϕ j } j∈I is a Parseval frame for H(K).
Finally, by the fourth bullet of Theorem 2, the Hilbert space H(K) can be isometrically embedded into H, its image being the closed subspace V := span{U(γ)v(s(γ))} γ∈Γ = x∈X V x , where the last equality can be proven completely analogously to (8).
Additionally, the unitarity of the representation implies that for γ, χ ∈ Γ such that r(γ) = r(χ) which is nothing but a straightforward generalization of (6). Indeed, one has Let us now consider the converse problem. That is, given a groupoid Γ over X and a positive definite kernel K : Γ × Γ → C such that K(γ, χ) = 0 if r(γ) = r(χ) and (9) holds, we construct the 'Moore-Aronszajn representation' (U, {H(K x )} x∈X ) of Γ. To this end, define each U(γ) : H(K s(γ) ) → H(K r(γ) ) first on the dense subspace H 0 (K s(γ) ) := span{K χ } χ∈Γ s(γ) by where, similarly as for groups, one can easily check that this definition is sound (analogously as in the group case, it is here where property (9) steps in). Observe that r(χ i ) = s(γ) for all i = 1, . . . , n, so the products γχ i are all well defined. It is also straightforward to prove (again, thanks to (9)) that thus defined U(γ) preserves inner products. Extending it onto the entire H(K s(γ) ), by the arbitrariness of γ we obtain the desired unitary representation of Γ.
Finally, notice that the kernel K can be retrieved from the 'Moore-Aronszajn representation' through formula (7), where one has to take the vector field v(x) := K ε(x) , x ∈ X.
Before moving to examples, let us remark that formula (7) 'works well' with the basic algebraical operations on the groupoid representations. x for x ∈ X and j = 1, 2, . . . , l we can construct positive definite kernels K 1 , K 2 , . . . , K l on Γ, respectively, using formula (7). Consider now the direct sum ( x } x∈X ) of the above representations, and, taking the vector field v ⊕ := l j=1 v j , define a kernel K ⊕ on Γ via (7). Similarly, consider the tensor product ( x } x∈X ) of the representations and, taking this time the vector field v ⊗ := l j=1 v j , define another kernel K ⊗ on Γ, again employing formula (7). It follows from [23, p. 16,17] that Remark 5. Suppose now we have a family of groupoids x } x∈Xi ) be a unitary representation of the groupoid Γ i for every i ∈ I. The disjoint union Γ := i∈I Γ i has a natural groupoid structure with X := i∈I X i as a base space, Γ (2) Consider now the family of Hilbert spaces H := {H x } x∈X , where we put H x := H (i) x for x ∈ X i and define a mapping U assigning to each γ ∈ Γ a unitary transformation U(γ) : Then (U, H) is a unitary representation of Γ.
For any i ∈ I let us fix a vector field x and use formula (7) to obtain a positive definite kernel K i from the unitary representation (U (i) , H (i) ) of Γ i . Additionally, introduce a vector field v on X by setting v(x) := v i (x) if x ∈ X i and use it together with the representation (U, H) to obtain, again via (7), another positive definite kernel K on Γ. It is not difficult to observe that What is more, reasoning analogously as when proving formula (8), one can show that the RKHS H(K) obtained from K by means of the Moore-Aronszajn theorem satisfies H(K) = i∈I H(K i ).
Example 6. Fix a Hilbert space H endowed with the inner product ·, · and let (U, {H x := {x} × H} x∈X ) be the trivial representation of the groupoid Γ. For any fixed vector field v, which here can be regarded as an element of H X , we have U(γ)v(s(γ)) = v(r(γ)) and formula (7) yields the kernel In other words, for every x ∈ X the kernel's restriction K x is a constant map. Every denotes the indicator function of the fiber Γ x ) constitutes an orthonormal basis of H(K), and hence the latter Hilbert space is isometrically isomorphic to l 2 (X).
Notice that the columns of the above table contain the values of the functions K ε(+) , K α −1 , K α , K ε(−) , respectively. These four functions span the space H(K), but they are not linearly independent. In fact, one can write that H(K) = span{ϕ + , ϕ − }, where the functions ϕ ± : Γ → C are defined as Unless v + = v − = 0, the functions ϕ ± can be shown to be orthonormal: Therefore, we have H(K) ∼ = C 2 as Hilbert spaces, and so in this case H(K) is isomorphic to H := H + ⊕ H − and not just isometrically embedded in the latter (cf. Theorem 2). In addition, observe that the (restricted) functions ϕ + | Γ + , ϕ − | Γ − span the RKHS's H(K + ), H(K − ), respectively, built from the restricted kernels. All in all, we have that where again we have identified the restricted functions with its extensions by zero, in full agreement with formula (8). Finally, the set {ϕ + , ϕ − }, being an orthonormal basis of H(K), is a Parseval frame for H(K), and hence by Theorem 3 we must have, for every χ, γ ∈ Γ, As one can check directly, the above equality indeed holds in the considered case. For any fixed vector field X ∋ x → v(x) ∈ H x the reproducing kernel reads, in the case when r(χ) = r(γ), We note that this is an analogue of the kernel defined by the convolution on a group with respect to a left Haar measure (cf. Example 1). Although there exists a standard definition of a convolution on a groupoid (see, e.g., [17, p. 38]), the above expression does not entirely fit into it, because the convoluted functions v(s(γ)) and v(s(χ)) are not defined over entire Γ. In fact, v(s(γ)) ∈ L 2 (Γ s(γ) , λ s(γ) ), whereas v(s(χ)) ∈ L 2 (Γ s(χ) , inv * λ s(χ) ) (where inv denotes here the inversion map, inv(γ) := γ −1 ) and as such their convolution is well defined only on Γ s(γ) s(χ) . Of course, when r(γ) = r(χ) the kernel is by definition K(χ, γ) = 0. For any fixed vector field X ∋ x → v(x) ∈ H x the reproducing kernel reads, in the case when r(χ) = r(γ), This also can be seen as something analogous to the convolution (only this time, related to the right Haar measure in the group setting).
Of course, when r(γ) = r(χ) the kernel K(χ, γ) is defined to vanish, just as in the previous examples. Example 10. This example is inspired by [4]. Let X be the set of all pairs (Ω, z), where Ω is a domain (nonempty, open and connected set) in C n and z ∈ Ω. Let also Γ be the set of all pairs (Φ, z), where Φ : Ω 1 → Ω 2 is a biholomorphism between open domains in C n and z ∈ Ω 1 . We define the groupoid (Γ, X, s, r, ε, ·, −1 ) as follows.
In order to introduce a kernel on Γ, define a map k : Γ → C via where JΦ(z) denotes the complex Jacobian determinant of Φ at the point z. Notice that the map k is multiplicative, i.e., k(γχ) = k(γ)k(χ) for any (γ, χ) ∈ Γ (2) . Indeed, using elementary properties of the Jacobian, we can write where ζ = Φ(z) by the multiplicability of (Ψ, ζ), (Φ, z). What is more, for any (Ω, z) ∈ X one trivially has that k(ε(Ω, z)) = k(id Ω , z) = 1 and hence, moreover, for every γ ∈ Γ. Let now K : Γ × Γ → C be a kernel given by the formula that is One can easily show that the above kernel is positive definite. In fact, it is a realization of the general construction described in Theorem 2 with the function F : Γ → l 2 (X) defined as F (Φ, z) := k(Φ, z)δ r(Φ,z) , where δ x : X → C denotes the Kronecker delta concentrated at x ∈ X. Moreover, the above kernel satisfies (9). Indeed, by (11,12) one has that, whenever r(χ) = r(γ), On the strength the discussion following formula (9), the just proven properties of the kernel K mean that the latter can be used to construct a unitary 'Moore-Aronszajn representation' (U, {H(K x )} x∈X ) of Γ, with each U(γ) : H(K s(γ) ) → H(K r(γ) ) satisfying In order to better understand this representation, notice first that for any χ ∈ Γ where 1 Γ r(χ) denotes the indicator function of the fiber Γ r(χ) (cf. Example 6). This in particular means that for every x ∈ X the space H(K x ) is spanned by the functionk · 1 Γ x , which can be easily shown to be of norm 1. Observe now that, for any chosen χ ∈ Γ s(γ) where we have used (14) and (11). In other words, under the above choice of the orthonormal bases of the one-dimensional spaces H(K x ), the transformation U(γ) can be regarded simply as the multiplication by the complex number k(γ).

Applications and outlook
Let us briefly discuss possible applications of the presented relationship between unitary representations of groupoids and reproducing kernels.
Kernel methods are practically utilized, e.g., in the machine learning field. Currently, their typical implementation is the classification or regression task, where the kernel-based method can be used to process the feature vector (representing the analyzed object) and produce the desired output, ensuring the minimum error, even if the data are difficult to distinguish. The most popular method is the Support Vector Machines Classifier (SVC), used to identify linearly inseparable objects. Their original features, based on which the decision is made, are transformed using the kernel function to the new space, where separation of examples belonging to various categories is easier [9]. However, one of the requirements for the kernel function K(x, y) = τ (y), τ (x) is that its input arguments are real numbers. This function can be substituted by K(h, g) = U(g)v, U(h)v . As a result, the unitary representation U on the group (instead of object transformation τ ) is used.
Another domain in which kernel-based methods prove their usefulness is optimization. The problem, often encountered in data processing modules (implemented in such fields as electronics or control engineering) is the selection of the optimal kernel regarding the distance between feature vectors in the multidimensional space. According to [19], such a measure (on the groupoids) can be used to solve the generalized version of the Traveling Salesman Problem. The overall distance to minimize is given as: L = N i=1 d(c i , c i+1 ), where c i and c i+1 are two subsequent nodes from the graph in the optimized cycle. Using the kernel to describe distances between nodes in the new space allows for estimating the distance components as: d(x, y) = K(x, x) − 2K(x, y) + K(y, y), where kernel K is a real-valued function. This type of distance is described in [11, p. 78]. In our proposed application, selection of the optimal kernel among various candidates (ensuring the minimal or maximal distance between the points) can be done without the actual transformation of the original space to the new one (which is the core of the kernel applicability in the machine learning).
Yet another possible application concerns quantum physics, where both reproducing kernels [15] and groupoids and their representations [5] have been used in the description of quantum systems. For instance, the simple representation of the pair groupoid of a two-element set, considered in Example 7 above, can be used in the description of a qubit -the central notion of the theory of quantum information [13]. In the future work we shall investigate the physical meaning and significance of the kernels and RKHS associated to the quantum-mechanically relevant unitary representations of groupoids.
On the mathematical side, let us add that the simple definition of a unitary representation of a groupoid employed in the paper can be generalized onto the setting of measurable fields of Hilbert spaces [8,21,22]. The natural question whether the above-studied relationship between RKHS and unitary groupoid representations still holds in this more general setting will also be addressed in the future work. This line of research might in the end offer some new tools and insights in the fields of complex analysis, quantum physics and computer science.