1 Introduction

The analysis of the spectroscopy and decays of the heavy flavored mesons is an essential source for obtaining useful information about the dynamics of QCD at “low” energies. Remarkable progress in this direction has been made on the experimental side. Starting from the observation of \(X(3872)\) [1] up to the present time 23 new charmonium line states have been discovered (for a review and relevant references to the original work on the charmonium spectroscopy, see for example [27]). All observed charmonium states might have more complex structures compared to those predicted by the simple quark model. These new states (referred to as \(XYZ\) states in the text) can be potential candidates of exotic states, and for this reason theorists make great efforts for understanding the dynamics of these states [27]. There are two attractive pictures in the interpretation of all observed states: tetra-quark, and bound states of two mesons (meson molecules).

The theoretical approaches which have been employed in the investigation of these states are QCD sum rules, lattice QCD, effective Lagrangian method, chiral perturbation theory, quark model, etc. Among all approaches the QCD sum rules method occupies a special place [8], which is based on the fundamental QCD Lagrangian. The mass and some of the strong coupling constants of \(XYZ\) mesons with light mesons are widely discussed in the framework of the QCD sum rules method. It is assumed in [9] that \(X(3872)\) is a mixture of charmonium and molecular states, whose interpolating current is taken as

$$\begin{aligned} j_\mu= & {} \cos \theta j_\mu ^{(2)} + \sin \theta j_\mu ^{(4)}, \end{aligned}$$
(1)

where

$$\begin{aligned} j_\mu ^{(2)}= & {} {1\over 6\sqrt{2}} \langle \bar{q} q \rangle \bar{c} \gamma _\mu \gamma _5 c,\end{aligned}$$
(2)
$$\begin{aligned} j_\mu ^{(4)}= & {} {1\over \sqrt{2}} \Big [ ( \bar{u} \gamma _5 c) (\bar{c} \gamma _\mu u) - (\bar{u} \gamma _\mu c)(\bar{c} \gamma _5 u) \Big ], \end{aligned}$$
(3)

and whose analysis in the QCD sum rules method predicted that if the mixing angle \(\theta \) lies in the range \((9 \pm 4)^0\), it can provide good agreement with the experimental value of the mass and decay width. \(X(3872)\) as an axial tetra-quark state is analyzed within the QCD sum rules method in [10], and the mass is found to be \(m_{X}=3.87~\hbox {GeV}\).

Using the QCD sum rules, the mass and the decay width of the channel \(J/\Psi \omega \) for the \(Y(3940)\) state is studied in [11, 12], assuming that it is described by the mixed scalar \(\chi _{c0}\) and \(D^*\bar{D}^*\) states, i.e.,

$$\begin{aligned} j = - {\langle \bar{q} q \rangle \over \sqrt{2}} \cos \theta j_{\chi _{c0}} + \sin \theta j_{D^*\bar{D}^*}, \end{aligned}$$
(4)

where \(j_{\chi _{c0}} = \bar{c}c\) and \( j_{D^*\bar{D}^*} = (\bar{q} \gamma _\mu c)(\bar{c} \gamma ^\mu q)\). As a result of this study it is found that one can reproduce the mass and decay width of \(Y(3940)\) in very good agreement with the experimental result if the mixing angle is chosen to be \(\theta =(76\pm 5)^0\). Being a molecular \(D^*D^*\) state, \(Y(3940)\) is analyzed in the framework of the QCD sum rules in [13].

A similar analysis is carried out in [14] for the \(Y(4260)\) state by assuming that it can be described by a mixture of the tetra-quark and charmonium currents, i.e.,

$$\begin{aligned} j_\mu = \cos \theta j^{(2)}_\mu + \sin \theta j^{(4)}_\mu , \end{aligned}$$
(5)

where

$$\begin{aligned} j^{(4)}_\mu= & {} {1\over \sqrt{2}} \varepsilon _{abc} \varepsilon _{dec} \Big [ (q_a^T C\gamma _5 c_b)(\bar{q}_d \gamma _\mu \gamma _5 C\bar{c}^T) \nonumber \\&+ (q_a^T C\gamma _5 \gamma _\mu c_b)(\bar{q}_d \gamma _5 C\bar{c}^T) \Big ],\end{aligned}$$
(6)
$$\begin{aligned} j^{(2)}_\mu= & {} {1\over \sqrt{2}} \langle \bar{q} q \rangle \bar{c}\gamma _\mu c, \end{aligned}$$
(7)

and it is found that the experimental result can be reproduced by setting the mixing angle to \(\theta =(53\pm 5)^0\).

Note that the flavor mixing in the light quark sector is studied in [15, 16]. In these works the \(U_A(1)\) anomaly plays a considerably important role in the flavor mixing, which leads to the mixing among the hadrons, and further enables estimation of the mixing angles for the \(\eta \)\(\eta ^\prime \) and \(\omega \)\(\phi \) states.

In determining the mixing angles we shall follow the method presented in [17, 18], in which the mixing angles among the hadronic states are determined from the QCD sum rules method. The main idea in the determination of the mixing angles is as follows. If the pure states \(H_1^0\) and \(H_2^0\) do mix, then the physical states with definite mass should be represented as linear combinations of these states. According to the QCD sum rules method, each hadronic state is described by the corresponding interpolating current carrying the same quantum numbers as the relevant hadrons. Therefore, the interpolating currents corresponding to the physical states can be represented as a linear combination of the “bare” currents as follows:

$$\begin{aligned} \begin{aligned}&\displaystyle j_{H_1} = \cos \theta j_{H_1^0} + \sin \theta j_{H_2^0}, \\&\displaystyle j_{H_2} = - \sin \theta j_{H_1^0} + \cos \theta j_{H_2^0}, \end{aligned} \end{aligned}$$
(8)

where \(j_{H_1^0}\) and \(j_{H_2^0}\) are the bare currents, and \(\theta \) is the mixing angle between them. For example in the case of the \(X(3872)\) meson, \(j_{H_1^0}\) corresponds to the \(j_\mu ^{(2)}\) current, and \(j_{H_2^0}\) corresponds to the \(j_\mu ^{(4)}\) current appearing in Eq. (1). For a determination of the mixing angles we consider a correlator which is formed from two orthogonal currents corresponding to two different hadronic states,

$$\begin{aligned} \Pi = i \int \mathrm{d}^4x \mathrm{e}^{ipx} \left<0 \left| T\{j_{H_1}(x) \bar{j}_{H_2} (0) \} \right| 0 \right>. \end{aligned}$$
(9)

In the present work we calculate the mixing angles among the two-quark and four-quark states given by Eqs. (1), (4), and (5). The origin of this mixing can be explained as follows: The \(\bar{c}c\) state can emit a gluon, which subsequently splits into a light quark–antiquark living like a molecular state during some time interval. According to the general strategy of the QCD sum rules method, this correlation function is calculated in terms of hadrons on the physical side, and in terms of quarks and gluons on the theoretical side. Using the duality ansatz these two representations are then equated to obtain the QCD sum rules. The correlation function from the hadronic side is calculated by saturating it with the corresponding hadrons carrying the same quantum numbers as the interpolating current. Obviously, the hadronic part of the correlation function should be equal to zero after this procedure, since the hadronic states given by Eq. (8) are orthogonal. Using Eq. (8) in the theoretical calculation of the correlation function we get

$$\begin{aligned} \Pi = \sin \theta \cos \theta \left[ \Pi _{22}^{(0)} - \Pi _{11}^{(0)} \right] + \left( \cos ^2\!\theta - \sin ^2\! \theta \right) \Pi _{12}^{(0)} = 0,\nonumber \\ \end{aligned}$$
(10)

where \(\Pi _{ij}^{(0)}\) is the correlation function corresponding to the unmixed case, i.e.,

$$\begin{aligned} \Pi _{ij}^{(0)} = i \int \mathrm{d}^4x \mathrm{e}^{ipx} \left<0 \left| T\left\{ j_{H_i}^{(0)}(x) \bar{j}_{H_j}^{(0)}(0)\right\} \right| 0 \right>, \end{aligned}$$

where \(i=1\) or \(2\), and \(j=1\) or 2.

In the case of a scalar current, the correlation function contains only one invariant function, which we shall denote by \(\Pi _{ij}^{(0)}\). In the case of a vector (axial-vector) current the two-point correlation function can be written in terms of two independent invariant functions as follows:

$$\begin{aligned} \Pi _{\mu \nu ij}^{(0)} (p^2) = \Pi _{ij}^{(1)} (p^2) \Bigg (g_{\mu \nu }-{p_\mu p_\nu \over p^2}\Bigg ) + \Pi _{ij}^{(2)} (p^2) {p_\mu p_\nu \over p^2}.\nonumber \\ \end{aligned}$$
(11)

From Eq. (10), for the mixing angle we get

$$\begin{aligned} \tan 2\theta = {2 \Pi _{12}^{(0)} \over \Pi _{11}^{(0)}-\Pi _{22}^{(0)}}. \end{aligned}$$
(12)

The invariant functions \(\Pi _{ij}^{(1)} (p^2)\) and \(\Pi _{ij}^{(2)} (p^2)\) in Eq. (11) are associated with the spin-1 and spin-0 mesons, respectively. Since \(X(3872)\) and \(Y(4260)\) mesons both have the quantum number \(J=1\), in the further discussions we shall consider only the structure \((g_{\mu \nu } -p_\mu p_\nu / p^2)\), i.e., we shall analyze the invariant function \(\Pi _{ij}^{(1)} (p^2)\) only.

Using the currents given in Eqs. (1), (4), (7), and their respective orthogonal combinations, the corresponding correlation functions are calculated in terms of quarks and gluons in the deep Euclidean region \(p^2 \small {\ll } 0\) using the operator product expansion [1922]. The results for each current are presented in the Appendix.

Having all the necessary formulas, we can now proceed to the numerical analysis of the mixing angles. It follows from the expressions of the mixing angles that the main input parameters involved in the numerical calculations are the quark and gluon condensates and the masses of the quarks whose values are given as \(\langle \bar{q} q \rangle (1~\hbox {GeV}) = -(246_{-19}^{+28}~\hbox {MeV})^3\) [23] (as regards the values of the input parameters see also [2438], \(\langle g_s^2 G^2 \rangle = 0.47~\hbox {GeV}^4\), \(m_0^2=0.8~\hbox {GeV}^2\) [39]. For the mass of the \(c\) quark we have used its \(\overline{MS}\) value \(\bar{m}_c(\bar{m}_c)=1.28 \pm 0.03~\hbox {GeV}\) [40].

Beside these input parameters, the sum rules do also contain two auxiliary parameters, namely, the Borel mass parameter \(M^2\) and the continuum threshold \(s_0\). The continuum threshold is correlated with the energy of the first excited state. It is usually chosen as \(\sqrt{s_0} = (m_{\mathrm{ground}} + 0.5)~\hbox {GeV}\) and we look for the domain of \(s_0\) which satisfies this restriction. In this work the continuum thresholds for \(X(3872)\), \(Y(3940)\) and \(Y(4260)\) are chosen as \(\sqrt{s_0} = (4.2 \pm 0.1)~\hbox {GeV}\) [9], \(\sqrt{s_0} = (4.4 \pm 0.1)~\hbox {GeV}\) [11, 12], \(\sqrt{s_0} = (4.7 \pm 0.1)~\hbox {GeV}\) [14], respectively, which are obtained from the analysis of two-point function. The working region of the Borel mass parameter \(M^2\) can be obtained using the following procedure. The upper bound of \(M^2\) is determined from the condition that the continuum and higher state contributions constitute about \(30~\%\) of the pole contribution, i.e.,

$$\begin{aligned} {\int _{s_0}^\infty \mathrm{d}s \rho (s) \mathrm{e}^{-s/M^2} \over \int _{4 m_c^2}^\infty \mathrm{d}s \rho (s) \mathrm{e}^{-s/M^2}}<1/3, \end{aligned}$$

where \(\rho (s)\) is the spectral density which is related to the imaginary part of the invariant function \(\Pi (s)\) according to

$$\begin{aligned} \rho (s) = {1\over \pi } \text{ Im }\Pi (s). \end{aligned}$$

The lower bound for \(M^2\) is determined from the condition that the perturbative contributions exceed the nonperturbative ones. From these conditions we get the following working regions for \(M^2\): \(2 \le M^2 \le 4~\hbox {GeV}^2\) for \(X(3872)\), \(Y(3940)\), and \(2 \le M^2 \le 5~\hbox {GeV}^2\) for the \(g_{\mu \nu }-p_\mu p_\nu /p^2\) structure.

In Fig. 1 we present the dependence of the mixing angle \(\theta \) on the Borel mass parameter \(M^2\) at \(\sqrt{s_0}= (4.4\pm 0.1)~\hbox {GeV}\) for the \(g_{\mu \nu }-p_\mu p_\nu /p^2\) structure for the \(X(3872)\) state. We observe from this figure that this structure predicts for the mixing angle \(\theta \simeq (2.4\pm 0.6)^0\), which is considerably small compared to the value of \(\theta =(9\pm 4)^0\) obtained in [9] in order to reproduce the mass of \(X(3872)\).

Fig. 1
figure 1

The dependence of the mixing angle \(\theta \) on the Borel mass square \(M^2\), at the fixed value of the continuum threshold \(\sqrt{s_0}=4.4~\hbox {GeV}\), for the structure \(g_{\mu \nu } - p_\mu p_\nu /p^2\) for the \(X(3872)\) state

In Fig. 2 we present the dependence of the mixing angle \(\theta \) on \(M^2\) at a fixed value of \(\sqrt{s_0}=(4.4\pm 0.1)~\hbox {GeV}\) for the \(Y(3940)\) state. The mixing angle we obtain from this figure is \(\theta =(20\pm 2)^0\), which is about 3.5 times smaller compared to the mixing angle \(\theta =(76\pm 5)^0\), which is predicted in [11, 12].

Fig. 2
figure 2

The dependence of the mixing angle \(\theta \) on the Borel mass square \(M^2\), at the fixed value of the continuum threshold \(\sqrt{s_0}=4.4~\hbox {GeV}\), for the \(Y(3940)\) state

Fig. 3
figure 3

The same as in Fig. 1, but at the fixed value of the continuum threshold \(\sqrt{s_0}=4.6~\hbox {GeV}\) for the \(Y(4260)\) state

In Fig. 3 we present the dependence of the mixing angle \(\theta \) on the Borel mass parameter \(M^2\) at \(\sqrt{s_0}= (4.6\pm 0.1)~\hbox {GeV}\) for the \(g_{\mu \nu }-p_\mu p_\nu /p^2\) structure for the \(Y(4260)\) state. We see from this figure that the mixing angle has the value \(\theta =(20\pm 3)^0\), which is approximately 2.5 times smaller than the mixing angle \(\theta =(53\pm 0.5)^0\), predicted in [14]. We finally note that, using the mixing angles obtained in this work, the masses of the states orthogonal to the \(X(3872)\), \(Y(3940)\), and \(Y(4260)\) are calculated in [41].

In summary, in this work, based on the assumptions that the \(X(3872)\) is a mixture of charmonium and \(D^{*0} \bar{D}^0\) states, \(Y(3940)\) is a mixture of scalar \(\bar{c}c\) and \(D^*D^*\) molecule, and \(Y(4260)\) is a mixture of tetra-quark and charmonium states, we estimate the respective mixing angles within the QCD sum rules method. The result is obtained that the mixing angles calculated in the present work for all considered pictures are considerably smaller than the ones predicted in [9, 11, 12, 14]. Therefore, in our view the considered pictures for \(X(3872)\), \(Y(3940)\), and \(Y(4260)\) are not successful in describing these states.