1 Introduction

This work is devoted to study of the process

$$\begin{aligned} e^+e^- \rightarrow \eta \eta \gamma \end{aligned}$$
(1)

in the center-of-mass (c.m.) energy range \(\sqrt{s} = 1.17\)–2.00 GeV at the experiment with the SND detector at the VEPP-2000 \(e^+e^-\) collider. Previously, this process was studied only near the \(J/\psi \) resonance by the Crystal Ball [1] and BESIII [2] collaborations.

The dominant contribution to the \(e^+e^-\rightarrow \eta \eta \gamma \) cross section in the energy region under study comes from the process \(e^+e^-\rightarrow \phi \eta \) with the decay \(\phi \rightarrow \eta \gamma \). This process was well studied in the SND [3], CMD-3 [4], BABAR [5, 6] and BESIII [7] experiments in the decay channel \(\phi \rightarrow K^+K^-\). In this work, the main objective of the analysis is the search of other intermediate states. In addition to the known \(\rho \eta \) and \(\omega \eta \) mechanisms, the most probable are radiative decays of excited vector mesons into \(f_{0}(1500)\gamma \) and \(f_{2}^{\prime }(1525)\gamma \). Measuring the widths of these decays is important for understanding of the quark structure of excited light vector mesons. In particular, there are indications that the excited states of \(\rho \) and \(\omega \) mesons can be a mixture of \(q\bar{q}\) and vector hybrid states [8]. The widths of radiative decays of excited vector mesons are sensitive to the hybrid state admixture [9].

In Ref. [9], the decay width of \(\phi (1680)\rightarrow f_{2}^{\prime }(1525)\gamma \) was calculated within the framework of the quark model. For the \(\rho (1700)\rightarrow f_0(1500)\gamma \) channel the additional assumption was used that the states \(f_0(1370)\), \(f_0(1500)\), and \(f_0(1710)\) are a mixture of states from light quarks and a glueball. It was shown that the width of this decay strongly depends on the glueball mass. The total cross section for the production of resonances \(\phi (1680)\) and \(\rho (1700)\) in \(e^+e^-\) collisions can be estimated as 11 and 15 nb, respectively. Using results of Ref. [9] and the branching ratios \(B(f_{2}^{\prime }(1525) \rightarrow \eta \eta )=11.6\pm 2.2\%\) and \(B(f_{0}(1500) \rightarrow \eta \eta )=6.0\pm 0.9\%\) [10] we obtain the following estimates for the cross sections at the maxima of the resonances \(\rho (1700)\) and \(\phi (1680)\):

$$\begin{aligned} \sigma (e^+e^-\rightarrow f_2^{\prime }(1525)\gamma \rightarrow \eta \eta \gamma )\approx & {} 1.7\text{ pb }, \end{aligned}$$
(2)
$$\begin{aligned} \sigma (e^+e^-\rightarrow f_0(1500)\gamma \rightarrow \eta \eta \gamma )\approx & {} 0.4{-}1.9~\text{ pb }. \end{aligned}$$
(3)

These cross sections are small compared to the cross section for the \(\phi \eta \) intermediate state, which is about 35 pb at \(\sqrt{s} = 1.68\) GeV.

2 Detector and experiment

SND is a general-purpose non-magnetic detector [11,12,13,14] collecting data at the VEPP-2000 \(e^+e^-\) collider [15]. Its main part is a three-layer spherical electromagnetic calorimeter consisting of 1630 NaI(Tl) crystals. The calorimeter covers a solid angle of 95% of 4\(\pi \). The energy resolution of the calorimeter for photons is \(\sigma _{E}/E=4.2\%/\root 4 \of {E(\mathrm{~GeV})}\). The angular resolution is about \(1.5^\circ \). Directions of charged particles are measured using a nine-layer drift chamber and one-layer proportional chamber in a common gas volume. The solid angle of the tracking system is 94% of 4\(\pi \). A system of threshold aerogel Cherenkov counters located between the tracking system and the calorimeter is used for charged kaon identification. Outside the calorimeter, a muon detector consisting of proportional tubes and scintillation counters is placed.

Monte-Carlo (MC) simulation of the signal and background processes takes into account radiative corrections [16]. The angular distribution of hard photon emitted from the initial state is generated according to Ref. [17]. Interactions of the particles produced in \(e^+e^-\) annihilation with the detector materials are simulated using the GEANT4 software [18]. The simulation takes into account variation of experimental conditions during data taking, in particular dead detector channels and beam-induced background. To take into account the effect of superimposing the beam background on the \(e^+e^-\) annihilation events, simulation uses special background events recorded during data taking with a random trigger. These events are superimposed on simulated events, leading to the appearance of additional tracks and photons.

The analysis presented in this work is based on data with an integrated luminosity of 201 pb\(^{-1}\) recorded in 2010–2020. These data were collected at 138 energy points in the energy region \(\sqrt{s} = 1.17\)–2.00 GeV. Since the cross section of the process under study is small, for the convenience of analysis, the data are combined into 6 energy intervals listed in Table 1.

The process \(e^+e^-\rightarrow \eta \eta \gamma \) is studied in the five-photon final state. Since there are no charged particles in the final state of the process under study, it is viable to use the process \(e^+e^-\rightarrow \gamma \gamma \) for normalization. As a result of the normalization a part of systematic uncertainties associated with the hardware event selection and beam-induced background is canceled out. Accuracy of the luminosity measurement using the process \(e^+e^-\rightarrow \gamma \gamma \) is estimated to be 2% [19].

3 Event selection

Selection of \(e^+e^-\rightarrow \eta \eta \gamma \rightarrow 5\gamma \) events is performed in two stages. At the first stage, we select events with exactly 5 photons with energies above 20 MeV and no charged tracks. The latter condition is ensured by requiring that the number of hits in the drift chamber is less than four. The transverse profile of energy deposition in the calorimeter for reconstructed photons must be consistent with the expected distribution for electromagnetic shower [20]. To suppress cosmic-ray background, absence of a signal in the muon system is required. The following conditions provides an approximate balance of energy and momentum in an event:

$$\begin{aligned} E_{\mathrm{EMC}} / \sqrt{s} > 0.6,\, P_{\mathrm{EMC}} / \sqrt{s} < 0.3, \end{aligned}$$
(4)

where \(E_{\mathrm{EMC}}\) is the total energy deposition in the calorimeter, and \(P_{\mathrm{EMC}}\) is the total event momentum calculated using energy depositions in calorimeter crystals.

The main background processes are

$$\begin{aligned} e^+e^-\rightarrow \omega \pi ^0\rightarrow \pi ^0\pi ^0\gamma , \end{aligned}$$
(5)

and

$$\begin{aligned} e^+e^-\rightarrow \omega \eta \rightarrow \eta \pi ^0\gamma . \end{aligned}$$
(6)

We also study background from the following reactions with multiphoton final states:

$$\begin{aligned} e^+e^-\rightarrow & {} \omega \pi ^0\pi ^0\rightarrow \pi ^0\pi ^0\pi ^0\gamma ,\nonumber \\ e^+e^-\rightarrow & {} \omega \eta \pi ^0\rightarrow \eta \pi ^0\pi ^0\gamma , \end{aligned}$$
(7)

and from the QED processes

$$\begin{aligned} e^+e^- \rightarrow 4\gamma , 5\gamma . \end{aligned}$$
(8)

Additional photons in the process \(e^+e^- \rightarrow 4\gamma \) arise from the splitting of electromagnetic showers, and the beam-induced background.

Fig. 1
figure 1

Left panel: The \(\chi ^2_{\eta \eta \gamma }-\chi ^2_{5\gamma }\) distribution for selected data events with \(\sqrt{s}=1.57\)–2.00 GeV (points with error bars). The solid histogram is the result of the fit with the sum of the signal and background distributions described in the text. The shaded histogram represents the background distribution. Right panel: The distribution of \(M_{\eta \gamma }\) closest to the \(\phi \) meson mass for data events with \(\sqrt{s}=1.57\)–2.00 GeV selected with the tighter condition \(\chi ^2_{\eta \eta \gamma } - \chi ^2_{5\gamma } < 10\) (points with error bars). The solid histogram is the simulated signal plus background distribution calculated with the fitted numbers of signal and background events. The shaded histogram is the simulated background distribution

To suppress background from the processes listed above, a kinematic fits are performed to the hypotheses \( e^+e^-\rightarrow 5\gamma \), \(e^+e^-\rightarrow \pi ^0\pi ^0\gamma \), \(e^+e^-\rightarrow \eta \pi ^0\gamma \), and \(e^+e^-\rightarrow \eta \eta \gamma \) with the requirements of energy and momentum balance in an event. For the hypotheses with final states \(\pi ^0\pi ^0\gamma \), \(\eta \pi ^0\gamma \), and \(\eta \eta \gamma \), the additional constraints are imposed that the invariant masses of photon pairs are equal to the masses of the \(\pi ^0\) and \(\eta \) mesons. As a result of the kinematic fit, the energies and angles of photons are refined, and the \(\chi ^2\) of the proposed kinematic hypothesis is calculated. In the kinematic fits, all possible combinations of photons are tested, and the combination with the smallest \(\chi ^2\) value is retained. The following conditions are applied to the obtained \(\chi ^2\) values

$$\begin{aligned} \chi ^2_{\eta \eta \gamma } - \chi ^2_{5\gamma }< 60, \quad \chi ^2_{5\gamma } < 30, \quad \chi ^2_{\pi ^0\pi ^0\gamma } - \chi ^2_{5\gamma } > 100. \end{aligned}$$
(9)

To suppress the \(e^+e^-\rightarrow \eta \pi ^0\gamma \) background, the condition

$$\begin{aligned} \chi ^2_{\eta \pi ^0\gamma } - \chi ^2_{5\gamma } > 30 \end{aligned}$$
(10)

is imposed. This background source is important only above the \(\omega \eta \) production threshold [19]. Therefore, the condition (10) is not applied for events from the first energy interval (see Table 1), at \(\sqrt{s}<\)1.32 GeV. Using the criteria described above, 183 data events are selected for further analysis.

4 Fitting the \(\chi ^2_{\eta \eta \gamma } - \chi ^2_{5\gamma }\) distribution

The \(\chi ^2_{\eta \eta \gamma } - \chi ^2_{5\gamma }\) distribution for selected data events from the energy range \(\sqrt{s}=1.57\)–2.00 GeV is shown in Fig. 1 (left). To determine the number of \(\eta \eta \gamma \) events, this distribution is fitted with the sum of signal and background distributions.

The signal distribution is obtained using MC simulation as a sum of the distributions for the processes

$$\begin{aligned} e^+e^-\rightarrow \phi \eta , \quad e^+e^-\rightarrow \rho \eta ,\quad e^+e^-\rightarrow \omega \eta \end{aligned}$$
(11)

with the subsequent decays of the vector mesons to \(\eta \gamma \). The interference between these processes is neglected in the sum. The total number of signal events is a free fit parameter. The fractions of the processes (11) in the sum are calculated using their measured cross sections [4, 21, 22] and the branching fractions of the decays \(\phi \), \(\rho \), \(\omega \rightarrow \eta \gamma \) [10]. The energy dependences of the cross sections for the processes (11) are shown in Fig. 2.

Imperfect simulation of the detector response may lead to difference between data and simulation in the \(\chi ^2_{\eta \eta \gamma } - \chi ^2_{5\gamma }\) distribution. To study this effect, we use events of the process \(e^+e^-\rightarrow \pi ^0\pi ^0\gamma \) from the energy region \(\sqrt{s} = 1.05\)–1.7 GeV, where they are selected practically without background. For these events, the distribution of the parameter \(\chi ^2_{\pi ^0\pi ^0\gamma } - \chi ^2_{5\gamma }\) is studied. The parameters \(\chi ^2_{\eta \eta \gamma }\) and \(\chi ^2_{\pi ^0\pi ^0\gamma }\) are calculated using the kinematic fits with the same number of constraints, differing only in the masses of intermediate particles. Although the photon spectra in \(\eta \eta \gamma \) and \(\pi ^0\pi ^0\gamma \) events are different, we expect that the correction to the \(\chi ^2_{\pi ^0\pi ^0\gamma } - \chi ^2_{5\gamma }\) distribution is close to the correction to the \(\chi ^2_{\eta \eta \gamma } - \chi ^2_{5\gamma }\) distribution. It turned out that the difference between data and simulation can be described by stretching the simulated distribution. To find the stretching parameter \(\alpha _b\), the data distribution is fitted by the simulated distribution of the parameter \(\alpha _b(\chi ^2_{\pi ^0\pi ^0\gamma } - \chi ^2_{5\gamma })\). The resulting value \(\alpha _b = 1.05\pm 0.01\) allows to match well the distributions for data and simulation. In particular, \(\chi ^2/\mathrm{ndf}\) changes from 49/29 at \(\alpha _b=1\) to 34/28 at \(\alpha _b=1.05\), where \(\mathrm{ndf}\) is the number of degrees of freedom. This correction is applied to the \(\chi ^2_{\eta \eta \gamma } - \chi ^2_{5\gamma }\) distribution obtained from simulation. To estimate the associated systematic uncertainty, \(\alpha _b\) is treated in the fit as a nuisance parameter with a Gaussian distribution, the standard deviation of which is conservatively estimated to be 0.05.

For description of the background distribution, the processes (5)–(8) are taken into account. Other multiphoton processes make a negligible contribution. The total number of background events is a free fit parameter, while the relative contributions (\(\beta _i\)) of the different processes are calculated using their measured cross sections. Since the \(\chi ^2_{\eta \eta \gamma } - \chi ^2_{5\gamma }\) distributions for different background processes (\(P_{\mathrm{bkg, i}}\)) are slightly different, the uncertainties in \(\beta _i\) lead to an uncertainty in background subtraction. To estimate this uncertainty, the background distribution used in the fit is presented as a sum \(\sum _i \beta _i P_{\mathrm{bkg, i}}\). The parameters \(\beta _i\) are treated as nuisance parameters with Gaussian constraints.

The result of the fit to the \(\chi ^2_{\eta \eta \gamma } -\chi ^2_{5\gamma }\) distribution for data events from the energy range \(\sqrt{s}=1.57\)–2.00 GeV is shown in Fig. 1 (left). The following values are obtained for the numbers of the signal and background events

$$\begin{aligned} N_{\eta \eta \gamma } = 69.7 \pm 12.0, \quad N_{\mathrm{bkg}} = 91.3 \pm 12.9. \end{aligned}$$
(12)

The quoted errors are statistical. The systematic uncertainty in the number of signal events due to the uncertainty in \(\alpha _b\) is 3%. The uncertainty due to the variation of the \(\beta _i\) coefficients is 1%. The total contribution from background processes (5)–(7) calculated using their measured cross sections and the detection efficiencies obtained from simulation is \(N_{\mathrm{bkg}}^{\mathrm{exp}} = 81.4 \pm 4.3\). The same number for the signal processes (11) is \(N_{\eta \eta \gamma }^{\mathrm{exp}} = 73.5 \pm 3.5\). Both numbers are in good agreement with the results of the fit.

Figure 1 shows the distribution of the \(\eta \gamma \) invariant mass (\(M_{\eta \gamma }\)) closest to the \(\phi \) meson mass for data events from the energy range \(\sqrt{s}=1.57\)–2.00 GeV selected with the tighter condition \(\chi ^2_{\eta \eta \gamma } - \chi ^2_{5\gamma } < 10\). The solid histogram represents the expected \(M_{\eta \gamma }\) distribution for the fitted numbers of the \(\eta \eta \gamma \) and background events . It is seen that our model describes the data distribution well. The clear peak at the \(\phi \) meson mass corresponds to the dominant \(\phi \eta \) intermediate mechanism.

The fit described above is performed in 6 energy intervals. The results are listed in Table 1. For the second energy interval, the fitted number of signal events is negative. negative number of events is allowed in the fit to obtain a correct estimate of the statistical uncertainty. Using the profile likelihood method [23] with a prior function that is uniform in the physical region \(\sigma > 0\) the upper limits on the cross section are calculated for the first two energy intervals.

Table 1 The energy range (\(\sqrt{s}\)), integrated luminosity (L), detection efficiency (\(\varepsilon \)), number of signal (\(N_{\eta \eta \gamma }\)) and background (\(N_{\mathrm{bkg}}\)) events obtained from the fit, number of expected background events (\(N^\mathrm{exp}_{\mathrm{bkg}}\)), radiative correction (\(1+\delta \)) and Born cross section (\(\sigma \)) for the process \(e^+e^-\rightarrow \eta \eta \gamma \). The quoted errors are statistical. For the first two energy ranges, the 90% confidence level upper limits on the cross section are given in parentheses. The systematic uncertainty in the cross section is 21% for \(\sqrt{s}< 1.32\) GeV, 23% for \(1.32<\sqrt{s}<1.57\) GeV, and 12% for \(\sqrt{s}>1.57\) GeV

5 Detection efficiency and radiative corrections

The Born cross section averaged over the energy interval is calculated as follows

$$\begin{aligned} \sigma = \frac{N_{\eta \eta \gamma }}{ L \varepsilon (1+\delta )}, \end{aligned}$$
(13)

where \(L=\sum _i L_i\) is the total integrated luminosity for the interval, \(L_i\) is the integrated luminosity at the ith energy point within the interval, \(\varepsilon \) and \(\delta \) are the detection efficiency and radiative correction averaged over the interval. To calculate \(\varepsilon \) and \(\delta \), it is necessary to know relations between different intermediate mechanisms of the process \(e^+e^-\rightarrow \eta \eta \gamma \) and the energy dependence of the cross section for each of the mechanisms. We assume that the intermediate mechanisms \(\phi \eta \), \(\omega \eta \) and \(\rho \eta \) make the dominant contribution to the cross section of the process under study. The Born cross section calculated as the sum of the contributions of these mechanisms is shown in Fig. 2. The calculation is based on the approximation of the experimental data [4, 21, 22].

Above 1.6 GeV, the main contribution to the cross section arises from the \(\phi \eta \) mechanism, while below 1.6 GeV, the dominant mechanism is \(\rho \eta \). In the sum, we neglect the interference between the amplitudes of the intermediate states. The highest interference is expected between amplitudes \(\rho \eta \) and \(\omega \eta \). Its value depends on the relative phase between the amplitudes. We estimate that at 1.5 GeV the maximum value of the interference contribution to the cross section can reach 30%. At 1.65 GeV, the interference contribution does not exceed 1%.

For each energy point i and each reaction mechanism j we calculate the visible cross section

$$\begin{aligned} \sigma _{vis,j}(s_i) = \int \limits _{0}^{x_{max}}F(x,s_i) \sigma _j(s_i (1-x))dx, \end{aligned}$$
(14)

where \(F(x,s_i)\) is a so-called radiator function [16] describing the distribution of the energy fraction \(x=E_r/2\sqrt{s}\) carried away by photons emitted from the initial state, and \(\sigma _j(s)\) is the Born cross section for jth mechanism.

Fig. 2
figure 2

The the \(e^+e^-\rightarrow \eta \eta \gamma \) Born cross section measured in this work (circles) compared with the \(e^+e^-\rightarrow \phi \eta \) cross section measured by CMD-3 in the decay mode \(\phi \rightarrow K^+K^-\) [4] multiplied by the branching fraction of the decay \(\phi \rightarrow \eta \gamma \) (triangles). The solid curve is the \(e^+e^-\rightarrow \rho \eta \) cross section, the dotted curve is the sum of the \(e^+e^-\rightarrow \rho \eta \) and \(\omega \eta \) cross sections, while the dashed line is the sum of the \(e^+e^-\rightarrow \phi \eta \), \(\rho \eta \) and \(\omega \eta \) cross sections

The detection efficiency and radiative correction averaged over the energy interval are calculated as

$$\begin{aligned} \varepsilon= & {} \sum \limits _{i,j} \varepsilon _{i,j} L_i \sigma _{vis,j}(s_i) \Big / \sum \limits _{i,j} L_i \sigma _{vis,j}(s_i), \end{aligned}$$
(15)
$$\begin{aligned} 1+\delta= & {} \sum \limits _{i,j} L_i \sigma _{vis,j}(s_i)\Big / \sum \limits _{i,j} L_i \sigma _j(s_i), \end{aligned}$$
(16)

where \(\varepsilon _{i,j}\) is the detection efficiency calculated using simulation for the jth intermediate mechanism at the ith energy point. The obtained values of \(\varepsilon \) and \((1+\delta )\) are listed in Table 1.

To estimate the model dependence of the measured cross section, the \(\phi \eta \), \(\omega \eta \) and \(\rho \eta \) contributions in Eqs. (15) and (16) are varied within their experimental errors. To determine the uncertainty associated with the interference between the \(\omega \eta \) and \(\rho \eta \) mechanisms, we increased/decreased the \(\omega \eta \) contribution by the value of the interference term between the \(\omega \eta \) and \(\rho \eta \) amplitudes. The efficiency is weakly dependent on the intermediate mechanism. Therefore, when calculating the efficiency, we assume that the efficiency for events corresponding to the interference term is close to the efficiency for \(\omega \eta \) events. We also added to the sums (15) and (16) terms corresponding to the mechanisms \(f_{0}(1500)\gamma \) or \(f_{2}^{\prime }(1525)\gamma \) with cross sections equal to the upper limits set in Sect. 6. The model uncertainty in the \(e^+e^-\rightarrow \eta \eta \gamma \) cross section determined in this way does not exceed 2% for \(\sqrt{s}> 1.57\) GeV and 20% for \(\sqrt{s}<1.57 \) GeV.

Imperfect simulation of the detector response leads to a systematic uncertainty in the detection efficiency obtained using the simulation. The difference between data and simulation in the distributions of \(\chi ^2\) of kinematic fits for the process \(e^+e^-\rightarrow \omega \pi ^0\rightarrow \pi ^0\pi ^0\gamma \) were studied using large statistics in Refs. [24, 25]. Based on this study, we conclude that the systematic uncertainty due to the conditions (9) does not exceed 5%. The condition \(\chi ^2_{\eta \pi \gamma }-\chi ^2_{5\gamma }> 30 \), specific for this analysis, reduces the detection efficiency by approximately 2 times. To determine the efficiency correction associated with this condition, its boundary is varied from 30 to 10. The observed variation of the measured cross section is \(1.01\pm 0.10\). Thus, no additional efficiency correction is introduced, and the error of the obtained correction 10% is taken as an estimate of the systematic uncertainty due to condition (10). The total systematic uncertainty of the detection efficiency due to the selection conditions is 11% for \(\sqrt{s}> 1.32\) GeV and 5% for \(\sqrt{s}< 1.32\) GeV.

In SND, photons converting into a \(e^+e^-\) pair in the material before the drift chamber, produce a charged track. Such events do not pass the selection criteria. Since the process under study and the process used for normalization contain different numbers of photons in the final state, improper simulation of the photon conversion lead to a shift in the measured cross section. The photon conversion probability is measured using events of the process \(e^+e^-\rightarrow \gamma \gamma \). The corresponding efficiency correction is found to be \((-0.79 \pm 0.02)\%\).

The values of the \(e^+e^-\rightarrow \eta \eta \gamma \) Born cross section for six energy intervals obtained using Eq. (13) are listed in Table 1. In Fig. 2, the measured cross section is compared with the calculation for the mechanisms \(\phi \eta \), \(\omega \eta \) and \(\rho \eta \) based on the approximation of the experimental data [4, 21, 22]. Figure 2 also shows the measurement of the cross section for the dominant mechanism \(e^+e ^-\rightarrow \phi \eta \) performed by CMD-3 in decay mode \(\phi \rightarrow K ^+K^-\) [4]. It is seen that our results agree with both the calculation and the CMD-3 measurement.

Only statistical errors are quoted in Table 1 and Fig. 2. The systematic uncertainty is 21% for \(\sqrt{s}< 1.32\) GeV, 23% for \(1.32<\sqrt{s}<1.57\) GeV, and 12% for \(\sqrt{s}> 1.57\) GeV. The sources of the systematic uncertainty are listed in Table 2.

Table 2 The main sources of the systematic uncertainty in the measured \(e^+e^-\rightarrow \eta \eta \gamma \) cross section

6 Search for radiative processes

Fig. 3
figure 3

The scatter plot of the two \(\eta \gamma \) invariant mass squared combinations for data events with \(\sqrt{s}=1.57\)–2.00 GeV selected with the condition \(\chi ^2_{\eta \eta \gamma } - \chi ^2_{5\gamma } < 10\). Events that satisfy the condition \(\chi ^2_{\phi \eta } - \chi ^2_{\eta \eta \gamma } > 20\) are marked by blue triangles

Fig. 4
figure 4

The \(\chi ^2_{\eta \eta \gamma }-\chi ^2_{5\gamma }\) (left panel) and \(M_{\eta \eta }\) distributions for data events from the energy region \(\sqrt{s} = 1.57\)–2.00 GeV selected with the additional condition \(\chi ^2_{\phi \eta } - \chi ^2_{\eta \eta \gamma } > 20\) (points with error bars). For the \(M_{\eta \eta }\) distribution, events are selected with the tighter condition \(\chi ^2_{\eta \eta \gamma } - \chi ^2_{5\gamma } < 10\). The shaded histogram is the expected distribution for the background processes (5)–(8) and the processes (11). The solid histogram is the sum of the shaded distribution and the distribution for events of the process \(e^+e^-\rightarrow f_{0}(1500)\gamma \rightarrow \eta \eta \gamma \) with a cross section of 5 pb

It is interesting to search for intermediate mechanisms of the \(e^+e^-\rightarrow \eta \eta \gamma \) reaction other than \(\phi \eta \), \(\omega \eta \), and \(\rho \eta \). The most likely additional mechanisms are \(f_{0}(1500)\gamma \) and \(f_{2}^{\prime }(1525)\gamma \). To increase the sensitivity to them, it is required to suppress the contribution of the dominant mechanism \(\phi \eta \). For this, an additional kinematic fit is performed to the hypothesis \(e^+e^- \rightarrow \phi \eta \rightarrow \eta \eta \gamma \), in which the constraint is added that one of the two invariant masses of the \(\eta \gamma \) system is equal to the \(\phi \) meson mass. The following condition is imposed on the \(\chi ^2\) of the kinematic fit:

$$\begin{aligned} \chi ^2_{\phi \eta } - \chi ^2_{\eta \eta \gamma } > 20. \end{aligned}$$
(17)

Figure 3 shows the scatter plot of the two \(\eta \gamma \) invariant mass combinations for data events with \(\sqrt{s}=1.57\)–2.00 GeV. Events of the \(e^+e^- \rightarrow \phi \eta \) process form bands around \(m_{\eta \gamma }^2\approx 1\) GeV\(^2\). Events that satisfy the condition (17) are marked by blue triangles. It is seen that several events with \(\chi ^2_{\phi \eta } - \chi ^2_{\eta \eta \gamma }<20\) have the \(\eta \gamma \) masses that are vary different from the \(\phi \) mass. In these events \(\chi ^2_{\eta \eta \gamma }\) for the wrong combination of photons has a smaller value than for the correct one. For this reason, the condition (17) suppresses \(\phi \eta \) events more effectively than cuts on \(m_{\eta \gamma }\)’s. It rejects about 90% of \(e^+e^-\rightarrow \phi \eta \) events. At the same time, the detection efficiency for the processes \(e^+e^- \rightarrow f_{0}(1500)\gamma \) and \(f_{2}^{\prime }(1525)\gamma \) decreases only by a factor of about 2. The number of selected events in the entire energy range decreases to 86 after applying the condition (17). The \(\chi ^2_{\eta \eta \gamma }-\chi ^2_{5\gamma }\) distribution for data events from the energy region \(\sqrt{s} = 1.57\) - 2.00 GeV is shown in Fig. 4 (left). The distribution of the \(\eta \eta \) invariant mass for data events with \(\chi ^2_{\eta \eta \gamma } - \chi ^2_{5\gamma } < 10\) is shown in Fig. 4 (right). It is seen that the data distributions is well described by the expected distribution for the background processes (5)–(8) and the processes (11).

Table 3 The energy range (\(\sqrt{s}\)), integrated luminosity (L), detection efficiency ( \(\varepsilon \)), 90% CL upper limit on number of events of radiative processes (\(N_{rad}\)), number of expected background events (\(N^{\mathrm{exp}}_{\mathrm{bkg}}\)), radiative correction (\(1+\delta \)), 90% CL upper limit on the Born cross section for the radiative processes (\(\sigma \))

Since no significant signal from radiative processes is observed, we set upper limits on their cross sections. To do this, we compare the data \(\chi ^2_{\eta \eta \gamma }-\chi ^2_{5\gamma }\) distribution with the same distributions for signal and background, using the \(CL_{s}\) technique [26, 27].

As input, the procedure [27] requires the measured distribution, the distributions for signal and background, the expected number of background events, and the systematic uncertainties for the signal and background. The systematic uncertainties due to the luminosity measurement, selection criteria, and imperfect simulation of the \(\chi ^2_{\eta \eta \gamma }-\chi ^2_{5\gamma }\) distribution are similar to those listed in Table 2. To estimate the expected number of background events, we use the measured cross sections for the background processes and the detection efficiencies obtained using simulation. In this case, background processes are not only the processes (5)–(8), but also (11).

The estimation of the systematic uncertainty in the expected number of background events is performed under assumption that it is completely determined by the experimental accuracy of the measured cross sections for the background processes. The detection efficiency for signal events is calculated as a half sum of the efficiencies for \(e^+e^-\rightarrow f_{0}(1500)\gamma \) and \(f_{2}^{\prime }(1525)\gamma \) events. Their half difference is used as an estimate of the model dependence of the detection efficiency. It does not exceed 6%.

To average the efficiency and radiative correction in Eqs. (15) and (16), we use the assumption that the Born cross section for the radiative process does not depend on energy.

The last 4 energy intervals listed in Table 1 are merged into 2 to increase statistics. The obtained values of 90% confidence level (CL) upper limits for 4 energy intervals are listed in Table 3.

7 Conclusion

In the experiment with the SND detector at the VEPP-2000 collider the cross section of the \(e^+e^-\rightarrow \eta \eta \gamma \) process has been measured in the c.m. energy range from 1.17 to 2.00 GeV. The main intermediate mechanism in this energy range is \(\phi \eta \). The measured \(e^+e^-\rightarrow \eta \eta \gamma \) cross section is in good agreement with the CMD-3 measurement of the \(e^+e^-\rightarrow \phi \eta \) process made in the \(\phi \rightarrow K^+K^-\) decay channel. A search for contributions to the cross section from radiative processes has been carried out. No significant signal has been found. In the energy region corresponding to the resonances \(\phi (1680)\) and \(\rho (1700)\), the upper limit is 10.6 pb and significantly exceeds the estimates of the cross sections based on the predictions of Ref. [9] (see Sect. 1), \(\sigma (e^+e^-\rightarrow \phi (1680)\rightarrow f_{2}^{\prime }(1525)\gamma \rightarrow \eta \eta \gamma ) =1.7\) pb and \(\sigma (e^+e^-\rightarrow \rho (1700)\rightarrow f_0(1500)\gamma \rightarrow \eta \eta \gamma ) = 0.4\)–1.9 pb.