An analog of the Dougall formula and of the de Branges--Wilson integral

We derive a beta-integral over $\mathbb{Z}\times \mathbb{R}$ , which is a counterpart of the Dougall $_5H_5$-formula and of the de Branges--Wilson integral, our integral includes $_{10}H_{10}$-summation. For a derivation we use a two-dimensional integral transform related to representations of the Lorentz group, this transform is a counterpart of the Olevskii index transform (a synonym: Jacobi transform).

Here a|a ′ ∈ Λ C ≃ Z × C. The Γ C -function has poles at points a|a ′ = −k| − l, where k, l ∈ N.
Let us explain a similarity of such formulas. Denote by I(s) the integrand in (1.5) and extend it into a complex domain writing and we get the left-hand side of (1.6) with b α = 1 − a α . Also, we get the same right-hand sides.
In [19] (see formula (1.28)) there was derived a one-dimensional hybrid of (1.5) and (1.6) including both integration over the real axis and a summation over a lattice on the imaginary axis.
Our integral (1.2) can be obtained by formal replacing Γ-factors in the integrand (1.5) by similar Γ C -factors. The function Γ C satisfies the reflection identity and we come to the integrand in (1.2).
1.4. Further structure of the paper. In Section 2 we derive our integral (1.2). For a calculation we use a unitary integral transform J a,b defined in [16], see below Subsect. 2.3. This transform is an analog of a classical integral transform known under the names generalized Mehler-Fock transform, Olevskii transform, Jacobi transform, see [14], [15], [17].
We write an appropriate family of functions H µ , and our integral (1.2) arises as the identity Section 3 contains a further discussion of Theorem 1.1.

Calculation
2.1. Convergence of the integral.
In particular, Remark. Our expression is single valued. Indeed, But λ + λ ∈ Z, and therefore the result does not depend on a choice of a branch of ln λ. ⊠ Proof. We use two expressions for Γ C (a + λ|a ′ − λ), namely, If | arg λ| < π − ε, then we apply the Stirling formula (see e.g., [2]) to the first expression. If | arg(−λ)| < π − ε, we apply it to the second expression. 2.2. The Gauss hypergeometric function of the complex field. For h|h ′ ∈ Λ C we denote [h|h ′ ] = 1 2 Re(h + h ′ ). Following [8] (see also [9], Subsect. II.3.7) we define the beta function B C [·] and the Gauss hypergeometric The integral absolutely converges iff The right hand side gives a meromorphic continuation of B C to the whole Λ 2 For a|a ′ , b|b ′ , c|c ′ ∈ Λ we define the hypergeometric function (2. 2) The integral has an open domain of convergence on any connected component of the set of parameters Λ 3 C ≃ Z 3 × C 3 , it admits a meromorphic continuation to the whole set Λ 3 C , see [16], Section 3. The functions 2 F C 1 [·] admit explicit expressions in terms of sums of products of Gauss hypergeometric functions 2 F 1 . The standard properties of Gauss hypergeometric functions can be transformed to similar properties of functions 2 F C 1 , see [16], Section 3. Below we need the following analog of the Gauss formula for 2 F 1 [a, b; c; 1]: see [16], Proposition 3.2, the last condition coincides with a condition of conti- Consider the measure on C given by Let Consider the following function on Λ ≃ Z × R: and consider the space L 2 even (Λ, κ a,b ) of even functions on Λ with inner product Next, define the kernel on C × Λ by In [16] there was obtained the following statement: The operator J a,b defined by

Application of the Mellin transform.
We define a Mellin transform M on C as the Fourier transform on the multiplicative group C × of C. Since C × ≃ (R/2πZ) × R, the Mellin transform is reduced to the usual Fourier transform and Fourier series. We have where ξ|ξ ′ ∈ Λ C . In the cases discussed below a function f on C \ 0 is differentiable except the point t = 1, where a singularity has a form Also in our cases the integral (2.6) absolutely converges for σ being in a certain strip A < [ξ|ξ ′ ] < B, therefore the Mellin transform is holomorphic in the strip. The inversion formula is given by the integration is taken over arbitrary line Re σ = γ, where A < γ < B. We understand the integral (which can be non absolutely convergent) as The inversion formula holds at points of differentiability of f , also it holds at points of singularities of the form In this case we can repeat the standard proof of pointwise inversion formula for the one-dimensional Fourier transform and pointwise convergence of Fourier series, see, e. g., [12], Sect. VIII.1, VIII.3; for advanced multi-dimensional versions of the Dini condition, see, e.g., [22], Sect. 9.
Convolution f 1 * f 2 on C × is defined by As usual, we have this identity holds in intersection of strips of holomorphy M(f 1 ) and M(f 2 ). We also define a function f ⋆ (t) = f (t −1 ). Then So we have the following corollary of the convolution formula: where the integration contour is contained in the intersection of domains of holomorphy of Mf ⋆ 1 and Mf 2 .
Then the Mellin transform sends a function Proof. The statement a) follows from the definition of B C -function (2.1). b) The function 2 F C 1 [z] has singularities at z = 0, 1, ∞ with asymptotics of the form see [16], Theorem 3.9. This gives us a strip of convergence of the Mellin transform. We must evaluate the integral We change an order of the integration and integrate in z: Integrating in t we again met a B C -function and after simple cancellations and an application of the reflection formula (1.7) we come to (2.8). The successive integration is valid under conditions (2.9). We must justify the change of order of integrations. In fact, (2.13) is absolutely convergent as a double integral, i.e., It is a special case of integral (2.13), we integrate it successively in z and in t under the same condition as for successive integration in (2.13).

Lemma 2.4 Let λ|λ ′ ∈ Λ and
(2.14) Proof. We apply formula (2.7) assuming We evaluate Mellin transforms of f 1 , f 2 applying Lemma 2.3. In the integrand in the right hand side of (2.7) we get a product of two factors. The first factor is The second factor is holomorphic in the strip It a, b are sufficiently small, then strips (2.16) and (2.17) have a non-empty intersection and we can apply formula (2.7). Two factors Γ C (a + b − ξ|a + b − ξ ′ ) cancel and we get a factor independent on ξ and the integral The integrand up to a constant factor is a Mellin transform of a function . By the inversion formula, integral (2.15) converts to For sufficiently small a we can apply the Gauss identity (2.3). Thus we get (2.15) for sufficiently small a, b > 0.
Thus, under these conditions the left hand side is holomorphic. The right hand side also is holomorphic in this domain. Therefore, they coincide.
. This is Theorem 1.1, where the parameters a 1 , a 2 , a 3 , a 4 are a, b, µ, ν. Our calculation is valid for positive reals a 1 , a 2 , a 3 , a 4 satisfying conditions a 1 + a + 2 + 2a 3 < 1, a 1 + a + 2 + 2a 4 < 1. For extending the identity to the domain (1.4) we refer to Corollary 2.2, the integral (1.3) is holomorphic in the domain (1.4), the right hand side also is holomorphic.

Final remarks
3.1. Barnes-Ismagilov integrals. Let p q. Let a α |a ′ α , b α |b ′ α ∈ Λ. Following Ismagilov [11], we define integrals of the form By [11], Lemma 2, such integrals admit a representation of the form where γ j (·) are products of Γ-factors and parameters of hypergeometric functions p F q−1 [·, z] are linear expressions in a α , b β and a ′ α , b ′ β . It is reasonable to claim that integrals I p,q =: p F C q−1 are hypergeometric functions of the complex field.
By Lemma 2.4.b, the functions 2 F C 1 defined by (2.2) are compatible with this definition. Ismagilov considered 4 F C 3 [. . . ; 1]-expressions that are counterparts of the Racah coefficients for unitary representations of the Lorentz group SL(2, C). Our theorem is an example of a hypergeometric identity for 5 F C 4 [. . . ; 1]. Some integrals of type (1.2) with products of Γ C -functions were obtained by Kells [13] and Derkachov, Manashov, and Valinevich in [6].
3.2. A difference problem. The de Branges-Wilson integral, the Dougall formula, and our integral (1.2) are representatives of beta integrals in the sense of Askey [1]. Quite often integrands w(x) in beta integrals are weight functions for systems of hypergeometric orthogonal polynomials. In particular, orthogonal polynomials corresponding to the de Branges-Wilson integral are the Wilson polynomials, see [21], [2]. Recall that they are even eigenfunctions of the following difference operator where i 2 = −1. If an integrand w(x) of a beta integral decreases as a power function, then only finite number of moments x n w(x) dx converge; however in this case a beta integral can be a weight for a finite system of hypergeometric orthogonal polynomials (this phenomenon was firstly observed by Romanovski in [20]), the system of orthogonal polynomials related to the Dougall 5 H 5 formula was obtained in [17]. On the other hand, such finite systems are discrete parts of spectra of explicitly solvable Sturm-Liouville problems (see, e.g., [10], [18]). In the case of our integral (1.2) the integrand decreases as |k +is| 2 aj −8 , we have no orthogonal polynomials. However a difference Sturm-Liouville problem can be formulated. We consider a space of meromorphic even functions Φ(λ|λ ′ ) on Λ C , a weight on Λ ⊂ Λ C defined by the integrand (1.2), and the following commuting difference operators: See a simpler pair of difference operators of this kind in [16]. On the other hand, see a one-dimensional operator with continuous spectrum similar to L in Groenevelt [10].