1 Introduction

This work is devoted to study of the process

$$\begin{aligned} e^+e^- \rightarrow \eta \pi ^0\gamma \end{aligned}$$
(1)

in the center-of-mass energy range \(\sqrt{s} = 1.05\)–2.00 GeV at the experiment with the SND detector at the VEPP-2000 \(e^+e^-\) collider. Previously, this process was studied near the \(\phi \)-meson resonance by the SND at VEPP-2M [1], CMD-2 [2] and KLOE [3]. The dominant intermediate mechanism in this energy region is the decay \(\phi \rightarrow a_{0}(980)\gamma \). Below (\(\sqrt{s}=0.920\)–1.004 GeV) and above (\(\sqrt{s} = 1.03\)–1.38 GeV) the \(\phi \)-meson resonance the process (1) was studied by CMD-2 in Ref. [4], where a 90% confidence-level upper limit of about 0.1 nb was set on the cross section. At higher energy, there is only the BESIII measurement of the \(J/\psi \rightarrow \eta \pi ^0\gamma \) decay [5]. The \(\eta \pi ^0\) mass spectrum in this decay is well described by an uniform phase-space distribution. No significant signal from the \(J/\psi \) decays to \(a_{0}(980)\gamma \) and \(a_{2}(1320)\gamma \) was observed.

The dominant contribution to the \(e^+e^-\rightarrow \eta \pi ^0\gamma \) cross section in the energy region under study comes from the process \(e^+e^-\rightarrow \omega \eta \) with the decay \(\omega \rightarrow \pi ^0\gamma \). This process was measured in the BABAR [6], CMD-3 [7] and SND [8] experiments with the decay mode \(\omega \rightarrow \pi ^+\pi ^-\pi ^0\). In these works, the measurement was performed neglecting the interference between the \(\omega \eta \) and other intermediate mechanisms (\(a_{0}(980)\rho \), \(\rho (1450)\pi \) and \(\phi \eta \)) contributing to the \(e^+e^-\rightarrow \pi ^+\pi ^-\pi ^0\eta \) reaction. The measurements obtained under this assumption need additional verification, especially in the region \(\sqrt{s}=1.85\)–2.00 GeV, where the \(e^+e^-\rightarrow \omega \eta \) cross section is almost zero (\(<50\) pb) compared to the significant (\(\sim \) 2 nb) contribution from other mechanisms.

In this work, the most interesting is the search for radiation decays of excited vector mesons of the \(\rho \), \(\omega \) and \(\phi \) families to \(a_{0}(980)\gamma \), \(a_{2}(1320)\gamma \), and \(a_{0}(1450)\gamma \). The measurement of these decays is important for understanding the quark structure of excited vector mesons. In particular, there are indications that the excited states of the \(\rho \) and \(\omega \) mesons may contain an admixture of a vector hybrid state [9]. The widths of the radiation decays are sensitive to the hybrid admixture [10].

2 Detector and experiment

SND is a general-purpose non-magnetic detector [11] collecting data at the VEPP-2000 \(e^+e^-\) collider [15]. Its main part is a three-layer spherical electromagnetic calorimeter consisting of 1630 NaI(Tl) crystals. The calorimeter covers a solid angle of 95% of \(4\pi \). The energy resolution of the calorimeter for photons is \(\sigma _{E}/E=4.2\%/\root 4 \of {E(GeV)}\). The angular resolution is about \(1.5^\circ \). Directions of charged particles are measured using a nine-layer drift chamber and one-layer proportional chamber in a common gas volume. The solid angle of the tracking system is 94% of \(4\pi \). A system of threshold aerogel Cherenkov counters located between the tracking system and the calorimeter is used for charged kaon identification. Outside the calorimeter, a muon detector consisting of proportional tubes and scintillation counters is placed.

Monte-Carlo (MC) simulation of the signal and the background processes takes into account radiative corrections [16]. The angular distribution of hard photon emitted from the initial state is generated according to Ref. [17]. Interactions of the particles produced in \(e^+e^-\) annihilation with the detector materials are simulated using the GEANT4 software [18]. The simulation takes into account variation of experimental conditions during data taking, in particular dead detector channels and beam-induced background. To take into account the effect of superimposing the beam background on the \(e^+e^-\) annihilation events, simulation uses special background events recorded during data taking with a random trigger. These events are superimposed on simulated events, leading to the appearance of additional tracks and photons in events.

The analysis presented in this work is based on data with an integrated luminosity of 94.5 \(\hbox {pb}^{-1}\) recorded in 2010, 2011, 2012 and 2017. These data were collected at 101 energy points in the energy region \(\sqrt{s} = 1.05\)–2.00 GeV. Since the cross section of the process under study is small and relatively slowly changes with energy, the data are combined into 13 energy intervals shown in Table 4.

In this work, the process \(e^+e^-\rightarrow \eta \pi ^0\gamma \) is studied in the five-photon final state. Therefore, it is viable to use the process \(e^+e^-\rightarrow \gamma \gamma \) for normalization. As a result of the normalization a part of systematic uncertainties associated with the hardware event selection and the beam background are canceled out. Accuracy of the luminosity measurement using the process \(e^+e^-\rightarrow \gamma \gamma \) is estimated to be 2%.

3 Event selection

Selection of \(e^+e^-\rightarrow \eta \pi ^0\gamma \rightarrow 5\gamma \) events is performed in two stages. At the first stage, we select events with exactly 5 photons with energies above 20 MeV and no charged tracks. The latter condition is ensured by requiring that the number of hits in the drift chamber is less than four. The conditions on the total energy deposition in the calorimeter (\(E_\mathrm{EMC}\)) and the total event momentum (\(P_\mathrm{EMC}\)) calculated using energy depositions in calorimeter crystals are imposed:

$$\begin{aligned} E_{\mathrm{EMC}}/\sqrt{s} > 0.6, \quad P_{\mathrm{EMC}}/\sqrt{s} < 0.3. \end{aligned}$$
(2)

To suppress cosmic-ray background, absence of a signal from the muon system is required.

Most events selected at this stage come from the process

$$\begin{aligned} e^+e^-\rightarrow \omega \pi ^0\rightarrow \pi ^0\pi ^0\gamma . \end{aligned}$$
(3)

This background process was studied by SND in Ref. [24]. A noticeable contribution to the background comes also from the QED processes

$$\begin{aligned} e^+e^- \rightarrow 3\gamma ,\, 4\gamma ,\, 5\gamma . \end{aligned}$$
(4)

We also study background from the following reactions with multiphoton final states:

$$\begin{aligned}&e^+e^- \rightarrow \eta \gamma , \quad e^+e^- \rightarrow \pi ^0\gamma ,\nonumber \\&e^+e^- \rightarrow \omega \pi ^0\pi ^0\rightarrow \pi ^0\pi ^0\pi ^0\gamma ,\nonumber \\&e^+e^-\rightarrow \omega \eta \pi ^0\rightarrow \eta \pi ^0\pi ^0\gamma ,\nonumber \\&e^+e^- \rightarrow K_{S}K_{L}, \quad e^+e^- \rightarrow K_{S}K_{L}\pi ^0,\nonumber \\&e^+e^- \rightarrow K_{S}K_{L}\pi ^0\pi ^0. \end{aligned}$$
(5)

Additional photons in events with three and four photons in the final state arise from splitting of the electromagnetic showers, initial state radiation, and beam background.

To suppress background from the processes listed above, a kinematic fits are performed to the hypotheses \( e^+e^-\rightarrow 3\gamma \), \( e^+e^-\rightarrow 5\gamma \), \(e^+e^-\rightarrow \pi ^0\pi ^0\gamma \), and \(e^+e^-\rightarrow \eta \pi ^0\gamma \) with the requirement of energy and momentum balance in an event. For the two latter hypotheses, the additional constraints are imposed that the invariant masses of photon pairs are equal to the masses of the \(\pi ^0\) and \(\eta \) mesons. As a result of the kinematic fit, the energies and angles of photons are refined, and the \(\chi ^2\) of the proposed kinematic hypothesis is calculated. In the kinematics fits, all possible combinations of photons are tested, and the combination with the smallest \(\chi ^2\) value is retained. The following conditions are applied on the obtained \(\chi ^2\) values

$$\begin{aligned}&\chi ^2_{5\gamma }<30, \quad \chi ^2_{\eta \pi ^0\gamma }-\chi ^2_{5\gamma }<10, \nonumber \\&\chi ^2_{3\gamma }>50, \quad \chi ^2_{\pi ^0\pi ^0\gamma }-\chi ^2_{5\gamma }>80. \end{aligned}$$
(6)

498 events are selected using these conditions. To estimate the background, along with the signal region determined by the conditions (6), a control region is analyzed, for which the modified condition on the \(\chi ^2\) difference \(10<\chi ^2_{\eta \pi ^0\gamma }-\chi ^2_{5\gamma }<60 \) is used.

4 Fitting the \(\pi ^0\gamma \) mass and \(\chi ^2_{\eta \pi \gamma }-\chi ^2_{5\gamma }\) distributions

Selected events can be divided into four classes. The first class (\(\omega \eta \)) contains events of the process

$$\begin{aligned} e^+e^-\rightarrow \omega \eta \rightarrow \eta \pi ^0\gamma . \end{aligned}$$
(7)

The second class (\({\mathrm{res}}\)-\(\eta \pi \gamma \)) contains events of the remaining hadron processes with the \(\eta \pi ^0\gamma \) final state:

$$\begin{aligned}&e^+e^-\rightarrow \rho \eta ,\quad e^+e^-\rightarrow \phi \eta ,\quad e^+e^-\rightarrow \phi \pi ^0, \end{aligned}$$
(8)
$$\begin{aligned}&e^+e^-\rightarrow \omega \pi ^0,\quad e^+e^-\rightarrow \rho \pi ^0. \end{aligned}$$
(9)

The third class (\({\mathrm{rad}}\)-\(\eta \pi \gamma \)) includes events from radiation decays of excited vector mesons, i.e. the processes \(e^+e^-\rightarrow a_{0}(980)\gamma \), \(e^+e^-\rightarrow a_{0}(1450)\gamma \), and \(e^+e^-\rightarrow a_{2}(1320)\gamma \). The last fourth class (\(\mathrm bkg\)) are background events from the processes (3)–(5). The first three classes describe different intermediate mechanisms of the process \(e^+e^-\rightarrow \eta \pi ^0\gamma \).

Fig. 1
figure 1

Left panel: The \(\pi ^0\gamma \) invariant mass distribution for selected experimental events from the signal region \(\chi ^2_{\eta \pi \gamma }-\chi ^2_{5\gamma }<10\) (points with error bars). The histograms represent the results of the fit described in the text. The distributions for the four event classes are shown cumulatively. Right panel: The \(\chi ^2_{\eta \pi \gamma }-\chi ^2_{5\gamma }\) distribution for selected experimental events (points with error bars) from the signal and control regions. The histograms show cumulatively the simulated distributions for the four event classes. The distributions are normalized to the number of events in the signal region. The dashed histogram shows the result of the fit after the correction of the signal distribution described in the text. The vertical line separates the signal and control regions

The numbers of events in each class are determined using a combined fit to the \(\pi ^0\gamma \) invariant mass distribution (\(m_{\pi \gamma }\)) for events from the signal region (\(\chi ^2_{\eta \pi ^0\gamma }-\chi ^2_{5\gamma }<10\)) and the \(\chi ^2_{\eta \pi ^0\gamma }-\chi ^2_{5\gamma }\) distribution for events from the control region (\(10<\chi ^2_{\eta \pi ^0\gamma }-\chi ^2_{5\gamma }<60\)). The fit is performed using the maximum likelihood method. The distributions of these parameters for all selected data events (\(\sqrt{s} = 1.05 \)–2.00 GeV) are shown in Fig. 1.

The distributions for the four classes of events used in the fit are obtained by simulation. For the \(\omega \eta \) class, we use true particle parameters from the MC event generator to divide simulated \(e^+e^-\rightarrow \omega \eta \) events into two subsets. The first subset contains events, in which the kinematic fit chooses the correct photon combination for the candidate \(\eta \) meson. The second subset contains events with wrong combinations, which are responsible for the long tails in the \(m_{\pi \gamma }\) distribution. This distribution is described by a sum of distributions for the two subset: \((1-k_{\mathrm{wide}})H_1+k_{\mathrm{wide}}H_2\). The fraction of events of the second subset \(k_{\mathrm{wide}}\) determined using simulation decrease from 0.17 near the \(\omega \eta \) threshold to 0.12 at \(\sqrt{s}=2\) GeV.

To take into account the imperfect simulation of the \(\omega \) meson line shape, a mass shift \(\varDelta m\) and Gaussian smearing with the dispersion \(\varDelta \sigma ^2\) are introduced into the \(\pi ^0\gamma \) mass spectrum. These parameters are determined from comparison of the \(\omega \) meson peak position and width in data and simulation from the range \(\sqrt{s} = 1.41\)–1.80 GeV. They are found to be \(\varDelta m = 4.0 \pm 1.6\) MeV and \(\varDelta \sigma ^2 = -48\pm 48\) \(\hbox {MeV}^2\). We do not expect that the \(m_{\pi \gamma }\) resolution in data is better than that in simulation. Therefore, we regard the negative \(\varDelta \sigma ^2\) value as a statistical fluctuation and do not correct the \(\pi ^0\gamma \) mass resolution.

To estimate how accurate the simulation reproduces the value of the parameter \(k_{\mathrm{wide}}\), \(e^+e^-\rightarrow \omega \pi ^0\) events are studied in the energy range \(\sqrt{s}=1.05\)–1.6 GeV, where the background to this process is negligible. For this process, the fraction of events in the long distance tails of the \(m_{\pi \gamma }\) distribution is reproduced by simulation with a statistical accuracy of 10%. This number is taken as a measure of the systematic uncertainty of the \(k_{\mathrm{wide}}\) coefficient.

To describe the \({\mathrm{res}}\)-\(\eta \pi \gamma \) contribution, the simulation of the processes (8) is used. The distributions obtained from simulation are normalized to expected number of events and summed up. To calculate the expected number of events, we used the cross sections for the processes (8) measured in Refs. [19,20,21,22] and the \(\rho \rightarrow \pi ^0\gamma \), \(\phi \rightarrow \pi ^0\gamma \), and \(\eta \gamma \) branching ratios [23]. The contribution of the processes (9) estimated using Refs. [24, 26] is found to be negligibly small. The total \({\mathrm{res}}\)-\(\eta \pi \gamma \) contribution is calculated to be \(N_{{\mathrm{res}}} = 19.6 \pm 1.3\).

To describe the \({\mathrm{rad}}\)-\(\eta \pi \gamma \) contribution, the simulation of the processes \(e^+e^-\rightarrow a_{0}(1450)\gamma \) and \(e^+e^-\rightarrow a_{2}(1320)\gamma \) is used. The distributions for these processes are summed with the weights \(1-\alpha \) and \(\alpha \), respectively, where the coefficient \(\alpha = 0.22 \pm 0.21\). The choice of the value of this coefficient is discussed below in Sect. 5. It should be noted that the fit results very weakly depend on the value of \(\alpha \).

The \(m_{\pi \gamma }\) and \(\chi ^2_{\eta \pi ^0\gamma }-\chi ^2_{5\gamma }\) distributions for background are calculated using simulation of the processes (3)–(5). The distributions obtained for each process are normalized to the expected number of events and summed up. Only the shape of the distribution is used in the fit. The total number of background events is a free fit parameter.

The following relations between the numbers of signal and background events in the signal and control regions are used in the fit: \(N_{\mathrm{bkg}}=k_{\mathrm{bkg}}N^\mathrm{C}_{\mathrm{bkg}}\), \(N_{\eta \pi \gamma }^\mathrm{C}=k_{\mathrm{sig}}N_{\eta \pi \gamma }\), where \(N_{\eta \pi \gamma }\) and \(N_{\mathrm{bkg}}\) are the numbers of \(e^+e^- \rightarrow \eta \pi ^0\gamma \) and background events in the signal region, respectively, and \(N_{\eta \pi \gamma }^\mathrm{C}\) and \(N^\mathrm{C}_{\mathrm{bkg}}\) are the same numbers in the control region. The coefficients \(k_{\mathrm{sig}}\) and \(k_{\mathrm{bkg}} \) are calculated using simulation in each of the 13 energy intervals. The uncertainty of \(k_{\mathrm{bkg}}\) is estimated by varying the cross sections of the background processes (3)–(5) within their errors. The value of this coefficient averaged over the energy range \(\sqrt{s} = 1.05\)–2.00 GeV is \(k_{\mathrm{bkg}} = 0.53 \pm 0.01\). The coefficient \(k_{\mathrm{sig}}\) obtained from simulation is corrected to take into account the difference in the signal \(\chi ^2_{\eta \pi ^0\gamma }-\chi ^2_{5\gamma }\) distributions in the data and simulation. To do this, data from the energy range \(\sqrt{s} = 1.41\)–1.80 GeV are used, where the cross section of the process \(e^+e^-\rightarrow \omega \eta \) is maximal. The mass spectrum of \(\pi ^0\gamma \) is analyzed and the number of data events in the \(\omega \) meson peak is determined for the signal (\(N^{\mathrm{data}}_\mathrm{S}\)) and control (\(N^{\mathrm{data}}_\mathrm{C}\)) regions. The numbers of simulated \(e^+e^-\rightarrow \omega \eta \) events in the signal (\(N^{\mathrm{MC}}_\mathrm{S}\)) and control (\(N^{\mathrm{MC}}_\mathrm{C}\)) regions are also determined. The double ratio \(R = (N^{\mathrm{data}}_\mathrm{C}N^{\mathrm{MC}}_\mathrm{S})/(N^{\mathrm{data}}_\mathrm{S} N^{\mathrm{MC}}_\mathrm{C})=1.5 \pm 0.3\) is used to correct the coefficient \(k_{\mathrm{sig}}\). With this correction, this coefficient averaged over the full energy range is \(k_{\mathrm{sig}}=0.22 \pm 0.04\). The simulation shows that the difference between the \(\chi ^2_{\eta \pi ^0\gamma }-\chi ^2_{5\gamma }\) distributions for different intermediate mechanisms of the process \(e^+e^-\rightarrow \eta \pi ^0\gamma \) is very small.

To evaluate the systematic uncertainty associated with the procedure of determining the number of events in each class, the nuisance parameters corresponding to \(N_{{\mathrm{res}}}\), \(\varDelta m\), \(\varDelta \sigma ^2\), and the coefficients \(k_{\mathrm{wide}}\), \( k_{\mathrm{sig}} \), and \(k_{\mathrm{bkg}}\) are introduced into the likelihood function with Gaussian constraints. The fit results are represented by the solid histogram in Fig. 1 (left) for the \(m_{\pi \gamma }\) distributions, and by the dashed histogram for the \(\chi ^2_{\eta \pi ^0\gamma }-\chi ^2_{5\gamma }\) distribution in Fig. 1 (right). The latter take into account the scale factor R for the signal events described above, while the solid histogram in Fig. 1 shows the uncorrected distribution normalized to the number of events in the signal region. The following numbers of events of three classes are obtained in the fit:

$$\begin{aligned}&N_{\omega \eta } = 267 \pm 20, \quad N_{{\mathrm{rad}}} = 101 \pm 21,\nonumber \\&N_{\mathrm{bkg}} = 113 \pm 10. \end{aligned}$$
(10)

The correlations between these numbers are not large. The correlation coefficients are \(-0.25\) between \(N_{\omega \eta }\) and \(N_{rad}\), \(-0.51\) between \(N_{bkg}\) and \(N_{rad}\), and \(-0.16\) between \(N_{\omega \eta }\) and \(N_{bkg}\). The total contribution from the background processes (3)–(5) calculated using simulation is \(N_{\mathrm{bkg}}^{\mathrm{calc}} = 123\) and agrees well with the fit result.

The obtained numbers of \(\omega \eta \) and \({\mathrm{rad}}\)-\(\eta \pi \gamma \) events in 13 energy intervals are listed in Tables 2 and 4, respectively. Table 4 also shows the distribution over the energy intervals for background events and events of the class \({\mathrm{res}}\)-\(\eta \pi \gamma \).

Fig. 2
figure 2

The \(\eta \pi ^0\) invariant mass distribution for data (points with error bars) from the interval \(\sqrt{s}=1.05\)–2.00 GeV. Events from the \(\omega \) meson peak (\(700<m_{\pi \gamma }<900\) MeV) are rejected. Left panel: The shaded histogram shows the total distribution for the background and the processes (7) and (8). The solid, dotted and dashed histograms show the total distribution for events of all four classes, in which the distribution for the class \({\mathrm{rad}}\)-\(\eta \pi \gamma \) are calculated in the models \(a_{0}(1450)\gamma \), \(a_{2}(1320)\gamma \), and \(a_{0}(980)\gamma \), respectively. Right panel: The contributions of the four classes of events are shown cumulatively. The distribution for the class \({\mathrm{rad}}\)-\(\eta \pi \gamma \) is obtained from the fit to the two-dimensional distribution of \(m_{\pi \gamma }\) versus \(m_{\eta \pi }\) as described in the text

5 Model selection for the \({\mathrm{rad}}\)-\(\eta \pi \gamma \) event class

As it is mentioned in the previous section, the following three processes may contribute to the \({\mathrm{rad}}\)-\(\eta \pi \gamma \) class in the energy range 1.05–2.00 GeV:

$$\begin{aligned}&e^+e^-\rightarrow a_{0}(980)\gamma , \nonumber \\&e^+e^-\rightarrow a_{0}(1450)\gamma ,\nonumber \\&e^+e^-\rightarrow a_{2}(1320)\gamma \end{aligned}$$
(11)

Figure 2 (left) shows the \(\eta \pi ^0\) invariant mass (\(m_{\eta \pi }\)) spectrum for selected events from the interval \(\sqrt{s}=1.05\)–2.00 GeV. Events from the \(\omega \) meson peak (\(700<m_{\pi \gamma }<900\) MeV) are rejected. The shaded histogram shows the total distribution for the background and the processes (7) and (8). The solid, dotted and dashed histograms show the total distribution for events of all four classes, in which the distribution for the class \({\mathrm{rad}}\)-\(\eta \pi \gamma \) is calculated in the models \(a_{0}(1450)\gamma \), \(a_{2}(1320)\gamma \), and \(a_{0}(980)\gamma \), respectively. The distributions are normalized to the numbers of events (10) found in the previous section. It is seen the observed \(\eta \pi ^0\) mass spectrum is best described by the model \(e^+e^-\rightarrow a_{0}(1450)\gamma \).

The following model is tested to describe distributions for \({\mathrm{rad}}\)-\(\eta \pi \gamma \) events:

$$\begin{aligned} P_{rad}= & {} \alpha P_{a_2(1320)\gamma } + \beta P_{a_0(980)\gamma }\nonumber \\&+ (1-\alpha -\beta ) P_{a_0(1450)\gamma }, \end{aligned}$$
(12)

where P is, for example, a two-dimensional distribution of \(m_{\pi \gamma }\) versus \(m_{\eta \pi }\). This simple model does not take into account the interference between the three intermediate mechanisms, but can be used to estimate the model uncertainty of the efficiency for \({\mathrm{rad}}\)-\(\eta \pi \gamma \) events.

The data from the range \(\sqrt{s}=1.05\)–2.00 GeV are fitted as described in the previous section. To increase the sensitivity to the model of the intermediate states (12), the \(m_{\pi \gamma }\) distribution for the signal region is replaced by the two-dimensional distribution of \(m_{\pi \gamma }\) versus \(m_{\eta \pi }\). The parameters \(\alpha \) and \(\beta \) are determined from the fit with the constraints that \(\alpha \), \(\beta \) and \(\alpha +\beta \) vary from 0 to 1. The following values of these parameters are obtained: \(\alpha = 0.22\pm 0.21\) and \(\beta = 0.00^{+0.08}\). The \(m_{\eta \pi }\) distribution obtained using simulation with these parameters is shown in Fig. 2 (right).

To evaluate the significance of the \({\mathrm{rad}}\)-\(\eta \pi \gamma \) signal, we compare the values of likelihood function for the fit described above (\(L_1\)) and the fit with the \(N_{rad}\equiv 0\) (\(L_0\)). Taking into account that the numbers of parameters in these two fit differ by three, from the difference \(-2(\ln {L_0}-\ln {L_1})=39.5\), we obtain that the significance of the observed \({\mathrm{rad}}\)-\(\eta \pi \gamma \) signal (including the systematic uncertainty) is 5.6 \(\sigma \).

6 Detection efficiency and radiative corrections

Fig. 3
figure 3

The detection efficiency for \(e^+e^- \rightarrow \omega \eta \rightarrow \eta \pi ^0\gamma \) events as a function of the normalized ISR photon energy for two energy intervals

The detection efficiency is determined using simulation as a ratio of the number of selected events to the number of generated events. It includes both the detector acceptance and selection efficiency. The simulation of the process \(e^+e^- \rightarrow \eta \pi ^0\gamma \) takes into account initial state radiation (ISR). The detection efficiency for the process under study is calculated as a function of two parameters, \(\sqrt{s}\) and normalized energy of the ISR photon, \(x=2E_\gamma /\sqrt{s}\), and is parametrized as follows \(\varepsilon _r(s,x) = \varepsilon (s) g(s,x)\), where \(\varepsilon (s) \equiv \varepsilon _r(s, 0)\). The function g(sx) weakly depends on \(\sqrt{s}\) and on the intermediate mechanism of the process \(e^+e^- \rightarrow \eta \pi ^0\gamma \). Its dependence on x is shown in Fig. 3. The shape of this dependence is determined by two effects. The sharp decrease of the efficiency at x corresponding to \(E_{\gamma }=20\)–30 MeV is due to the condition that an event contain exactly five photon. This condition rejects events with the ISR photon emitted at a large angle. Photons are reconstructed if their energy deposition in the calorimeter exceeds 20 MeV. A further decrease of the efficiency is due to the requirement of energy-momentum balance in an event (\(\chi ^2_{5\gamma }<30\)).

The visible cross section of the process \(e^+e^- \rightarrow \eta \pi ^0\gamma \), which is defined as \(\sigma _{\mathrm{vis}}=N/L\), where N is the number of selected events of the process under study and L is the integrated luminosity, is related to the Born cross section \(\sigma (s)\) as follows:

$$\begin{aligned} \sigma _{\mathrm{vis}}(s) = \int \limits _{0}^{x_{max}}\varepsilon _r(s,x)F(x,s) \sigma (s (1-x))dx, \end{aligned}$$
(13)

where F(xE) is a so-called radiator function [16] describing the probability to emit extra photons with the total energy \(x\sqrt{s}/2\) from the initial state, and \(x_{max}=1-(m_\eta +m_{\pi ^0})^2/s\). The formula (13) can be rewritten in the conventional form:

$$\begin{aligned} \sigma _{\mathrm{vis}}(s) = \varepsilon (s)\sigma (s)(1+\delta (s)), \end{aligned}$$
(14)

where \(\delta (s)\) is the radiative correction.

Inaccuracy in simulation of the detector response for photons leads to systematic uncertainty in the detection efficiency determined using the simulation. To evaluate the efficiency corrections associated with the selection criteria, we change the boundaries of the conditions: on \(\chi ^2_{5\gamma }\) from 30  to  60, in \(\chi ^2_{\eta \pi ^0\gamma } - \chi ^2_{5\gamma }\) from 10  to  60, and on \(\chi ^2_{\pi ^0\pi ^0\gamma }-\chi ^2_{5\gamma }\) from 80  to  10, and remove the condition on \(\chi ^2_{3\gamma }\). The relative change in the \(e^+e^-\rightarrow \omega \eta \) cross section after loosening the selection condition is taken as a correction for the detection efficiency, while the uncertainty of this correction is added to its systematic uncertainty. The total efficiency correction due to these conditions is \(-(5.7 \pm 6.1)\%\). The minus sign means that the efficiency in the data is less than that in the simulation. The efficiency correction for the condition \(N_\gamma =5\) is determined using five-photon events of the process \(e^+e^-\rightarrow \omega \pi ^0\), the cross section for which can be measured with the condition \(N_\gamma \ge 5\), and found to be \(-(0.4\pm 0.2)\%\).

In SND, photons converting into a \(e^+e^-\) pair in the material before the drift chamber, produce a charged track. Such events do not pass the selection criteria. Since the process under study and the process used for normalization contain different numbers of photons in the final state, improper simulation of the photon conversion lead to a shift in the measured cross section. The photon conversion probability is measured using events of the process \(e^+e^-\rightarrow \gamma \gamma \). The corresponding efficiency correction is found to be \((-0.79 \pm 0.02)\%\). Thus, the total correction for the detection efficiency is \((-6.9\pm 6.1)\%\).

The detection efficiency for the class \({\mathrm{rad}}\)-\(\eta \pi \gamma \) is calculated in the model (12) with the coefficients \(\alpha = 0.22\pm 0.21\) and \(\beta =0.00^{+0.08}\). The model uncertainty of the efficiency is determined by varying the coefficients \(\alpha \) and \(\beta \) within their errors. It does not exceed 3%.

7 Fitting the measured cross sections

To calculate the radiative correction and determine the Born cross section, the energy dependence of the visible cross section is fitted by Eq. (13). The uncertainty on the radiative correction is estimated by varying the fitted parameters within their errors. The energy dependence of the Born cross section is parametrized by a sum of contributions of two vector resonances: of the as follows

$$\begin{aligned} \sigma (s)= & {} \frac{12\pi }{s^{3/2}} \left| \sqrt{\frac{B_{V^{\prime }}}{P_{f}(m_{V^{\prime }})}} \frac{m_{V^{\prime }}^{3/2}\varGamma _{V^{\prime }}}{D_{V^{\prime }}}\right. \nonumber \\&+ \left. \sqrt{\frac{B_{V^{\prime \prime }}}{P_{f}(m_{V^{\prime \prime }})}} \frac{m_{V^{\prime \prime }}^{3/2}\varGamma _{V^{\prime \prime }}}{D_{V^{\prime \prime }}} e^{i\varphi } \right| ^{2} P_{f}(s), \end{aligned}$$
(15)

where \(m_V\) and \(\varGamma _V\) are mass and width of the resonance, V (\(V=V^{\prime }\) or \(V^{\prime \prime }\)), \(D_{V}= s - m_{V}^2 +i \sqrt{s}~\varGamma _{V}\), \(B_{V} = B(V \rightarrow e^+e^-)B(V \rightarrow f)\) is the product of the branching fractions of V to \(e^+e^-\) and to the final state f, \(P_{f}(s)\) is the phase-space factor.

Fig. 4
figure 4

The energy dependence of the \(e^+e^-\rightarrow \omega \eta \rightarrow \eta \pi ^{0}\gamma \) Born cross section measured in this work (filled circles). For comparison, the SND [8] (open circles), CMD-3 [7] (squares), and BABAR [6] (triangles) measurements of the \(e^+e^-\rightarrow \omega \eta \) cross section in the decay mode \(\omega \rightarrow \pi ^+\pi ^-\pi ^0\) are shown. These data are multiplied by the branching fraction \(B(\omega \rightarrow \pi ^0\gamma )\) [27]. The curves show the results of the fit described in the text

In the fit to the \(e^+e^-\rightarrow \omega \eta \rightarrow \eta \pi ^{0}\gamma \) data, the first term in Eq. (15) is assumed to be the contribution of the \(\omega (1420)\) resonance, while the second effectively describes the contributions of two resonances, \(\omega (1650)\) and \(\phi (1680)\), which have close masses. The phase-space factor is calculated in the approximation of narrow \(\omega \) meson width: \(P_{f}(s) = q_{\omega }^3(s)\), where \(q_{\omega }(s)\) is the \(\omega \) meson momentum in the reaction \(e^+e^-\rightarrow \omega \eta \). The phase \(\varphi \) between the first and second terms is chosen equal to \(\pi \). The fit is performed in two variants. In the first, the \(V^{\prime }\) mass is fixed at the Particle Data Group (PDG) value [23] \(m_V^{\prime } = 1420\) MeV, while \(\varGamma _{V^{\prime }}\), \(m_{V^{\prime \prime }}, \varGamma _{V^{\prime \prime }}, B_{V^{\prime }}\) and \(B_{V^{\prime \prime }}\) are free parameters. In the second, we follow the works [7, 8] and fix also the \(\omega (1420)\) width at \(\varGamma _{V^{\prime }}=220\) MeV [23]. The fitted curves are shown in Fig. 4. The obtained values of the fit parameters are listed in Table 1. They are in good agreement with the results of the previous works [7, 8].

The first variant of the fit has a better \(\chi ^2\). It is used to calculate the radiative corrections. The obtained values of the radiative correction and the Born cross section are listed in Table 2. In the first column of the table we list the boundaries of the energy interval and the weighted average energy, which is calculated as \(\sum _i\sqrt{s_i}\sigma _{{\mathrm{vis}},i}L_i/\sum _i\sigma _{{\mathrm{vis}},i}L_i\), where the sum is taken over the energy points entering in the energy interval, and the visible cross section is calculated using Eqs. (13) and (15) with the parameters obtained in the fit. For the cross section, the statistical and systematic errors are quoted.

Table 1 The parameters obtained in the fits to the \(e^+e^-\rightarrow \omega \eta \) and \(e^+e^-\rightarrow {{\mathrm{rad}}}\text{- }\eta \pi \gamma \) cross sections. \(B_{V} = B(V\rightarrow e^+e^-)B(V\rightarrow \omega \eta )\) for \(\omega \eta \), and \(B_{V} = B(V\rightarrow e^+e^-)B(V\rightarrow \eta \pi \gamma )\) for \({\mathrm{rad}}\)-\(\eta \pi \gamma \). For the \(\omega \eta \) final state the results for the two variants of the fit are listed in comparison with the results of the SND [8] and CMD-3 [7] experiments obtained in the \(\omega \rightarrow \pi ^+\pi ^-\pi ^0\) decay mode
Table 2 The weighted average energy (\(\sqrt{s}\)) for the interval indicated in parentheses, integrated luminosity (L), detection efficiency (\(\varepsilon _{\omega \eta }\)), number of selected events (\(N_{\omega \eta }\)), radiative correction (\(1+\delta \)), and Born cross section (\(\sigma _{\omega \eta }\)) for the process \(e^+e^-\rightarrow \omega \eta \rightarrow \eta \pi ^0\gamma \). For the cross section, the first error is statistical, and the second is systematic
Table 3 The main sources of the systematic uncertainty on the measured \(e^+e^-\rightarrow \omega \eta \) and \(e^+e^-\rightarrow {{\mathrm{rad}}}\text{- }\eta \pi ^0\gamma \) cross sections, and the total \(e^+e^-\rightarrow \eta \pi ^0\gamma \) cross section
Table 4 The weighted average energy (\(\sqrt{s}\)) for the interval indicated in parentheses, integrated luminosity (L), detection efficiency (\(\varepsilon _{{\mathrm{rad}}}\)), number of selected events (\(N_{{\mathrm{rad}}}\)) for the process \(e^+e^-\rightarrow {{\mathrm{rad}}}\text{- }\eta \pi ^0\gamma \), number of events from the processes \(e^+e^-\rightarrow \rho \eta \), \(\phi \eta \), \(\phi \pi \) (\(N_{{\mathrm{res}}}\)), number of background events (\(N_{\mathrm{bkg}}\)), radiative correction (\(1+\delta \)), and Born cross section for the process \(e^+e^-\rightarrow {{\mathrm{rad}}}\text{- }\eta \pi ^0\gamma \). For the cross section, the first error is statistical, the second is systematic
Table 5 Weighted average energy (\(\sqrt{s}\)) for the interval indicated in parentheses, and the total \(e^+e^- \rightarrow \eta \pi ^0\gamma \) cross section (\(\sigma _{\eta \pi \gamma }\)). For the cross section, the first error is statistical, the second is systematic

The main sources of the systematic uncertainty are listed in Table 3. A significant contribution to the systematic uncertainty arises from the interference of the \(e^+e^-\rightarrow \omega \eta \) amplitude with \(e^+e^-\rightarrow \rho \eta \) amplitude. The \(\pi ^0\gamma \) mass distribution for the interference term has a peak in the \(\omega \) meson mass region. Therefore, in this analysis, the interference will increase or decrease the number of selected events of the process \(e^+e^-\rightarrow \omega \eta \). The absolute value of the amplitude of the process \(e^+e^-\rightarrow \rho \eta \) is extracted from the measured \(e^+e^-\rightarrow \pi ^+\pi ^-\pi ^0\) cross section [19], but the relative phase between the two amplitudes is unknown. We calculated the total cross section for the processes \(e^+e^-\rightarrow \omega \eta \) and \(e^+e^-\rightarrow \rho \eta \) with and without interference. The maximum difference between the two cross sections when varying the phase is taken as an estimate of the systematic uncertainty of the \(e^+e^-\rightarrow \omega \eta \) cross section. In the energy range under study it varies from 5 to 37%. The other sources of the systematic uncertainty are discussed in the previous sections.

To describe the cross section for the class \({\mathrm{rad}}\)-\(\eta \pi \gamma \), we use a model with one vector resonance decaying into \(a_0(1420)\gamma \). The energy dependence of the phase space is calculated using a Monte-Carlo event generator for the process \(e^+e^-\rightarrow a_0(1420)\gamma \). The free parameters of the fit to the \(e^+e^-\rightarrow {{\mathrm{rad}}}\text{- }\eta \pi ^{0}\gamma \) visible cross section are \(m_{V^{\prime }}\), \(\varGamma _{V^{\prime }}\), \(B_{V^{\prime }}\). Their fitted values are listed in Table 1. The values of the radiative corrections determined from the fit and the values of the Born cross section for the process \(e^+e^-\rightarrow {{\mathrm{rad}}}\text{- }\eta \pi \gamma \) with statistical and systematic errors are listed in Table 4. The main sources of systematic uncertainty are listed in Table 3. The fitted Born cross section is shown in Fig. 5. It is seen that events of the radiative processes are distributed over a wide energy range, from 1.3 to 1.9 GeV.

The total visible cross section for the process \(e^+e^-\rightarrow \eta \pi ^0\gamma \) is calculated as

$$\begin{aligned} \sigma _{\mathrm{vis}}=\frac{1}{L} \left( N_{\omega \eta }+ \frac{\varepsilon _{\omega \eta }}{\varepsilon _{{\mathrm{rad}}}}N_{{\mathrm{rad}}}+ \frac{\varepsilon _{\omega \eta }}{\varepsilon _{{\mathrm{res}}}}N_{{\mathrm{res}}} \right) \end{aligned}$$
(16)

and then fitted by Eq. (13) with the efficiency obtained for the process \(e^+e^-\rightarrow \omega \eta \). The model for the Born cross section used in the fit is a sum of the models for the \(e^+e^-\rightarrow \omega \eta \) and \(e^+e^-\rightarrow {{\mathrm{rad}}}\text{- }\eta \pi \gamma \) cross section. The obtained values of the Born cross section are listed in Table 5 and shown in Fig.  in comparison with the cross section for the intermediate state \(\omega \eta \). The main sources of the systematic uncertainty on the cross section are listed in Table 3. The total cross section for the process \(e^+e^-\rightarrow \eta \pi ^{0}\gamma \) measured by the described method includes the contribution from the interference of the \(e^+e^-\rightarrow \omega \eta \) and \(e^+e^-\rightarrow \rho \eta \) amplitudes. Therefore, the model uncertainty associated with the interference is absent.

8 Summary

In the experiment with the SND detector at the VEPP-2000 collider the cross section for the process \(e^+e^-\rightarrow \eta \pi ^0\gamma \) has been measured for the first time in the energy range from 1.05 to 2.00 GeV. The main contribution to the cross section arises from the intermediate mechanism \(\omega \eta \). The measured cross section for the subprocess \(e^+e^-\rightarrow \omega \eta \rightarrow \eta \pi ^0\gamma \) agrees well with previous measurements of this cross section by SND and CMD-3 in the decay mode \(\omega \rightarrow \pi ^+\pi ^-\pi ^0\). The significantly smaller contribution to the \(e^+e^-\rightarrow \eta \pi ^0\gamma \) cross section from other hadronic intermediate states \(\rho \eta \), \(\phi \eta \), \(\phi \pi ^0\), \(\omega \pi ^0\), and \(\rho \pi ^0\) has been calculated using existing data on their production cross section. It has been found, with a significance of 5.6\(\sigma \), that the process \(e^+e^-\rightarrow \eta \pi ^0\gamma \) is not completely described by the hadronic intermediate states. We assume that the missing contribution (\({\mathrm{rad}}\)-\(\eta \pi \gamma \)) arises from radiation processes, for example, \(e^+e^-\rightarrow a_{0}(980)\gamma \), \(a_{0}(1450)\gamma \), and \(a_{2}(1320)\gamma \). The cross section for the process \(e^+e^-\rightarrow {{\mathrm{rad}}}\text{- }\eta \pi ^0\gamma \) has been measured. It is 15–20 pb in a wide energy range, from 1.3 to 1.9 GeV. The spectrum of \(\eta \pi ^0\) invariant masses for the events \({\mathrm{rad}}\)-\(\eta \pi \gamma \) is consistent with the dominance of the intermediate mechanism \(a_{0}(1450)\gamma \).

Fig. 5
figure 5

The measured Born cross section for the process \(e^+e^-\rightarrow {{\mathrm{rad}}}\text{- }\eta \pi ^{0}\gamma \) (points with error bars). The curve is the result of the fit described in the text

Fig. 6
figure 6

The measured total cross section for the process \(e^+e^-\rightarrow \eta \pi ^{0}\gamma \) (circle) and the cross section for the process \(e^+e^-\rightarrow \omega \eta \rightarrow \eta \pi ^{0}\gamma \) (squares). The curve is the result of the fit described in the text

Our result on the \(e^+e^-\rightarrow {{\mathrm{rad}}}\text{- }\eta \pi ^0\gamma \) cross section can be compared with the predictions of Ref. [10], where the partial widths for the decays \(\rho (1450)\) and \(\omega (1420)\) to \(a_2(1320)\gamma \), and \(\omega (1420)\) and \(\omega (1650)\) to \(a_2(1320)\gamma \) and \(a_0(1420)\gamma \) are calculated in the framework of the quark model. Using the data on the \(e^+e^-\rightarrow \pi ^+\pi ^-\pi ^+\pi ^-\) [29], \(e^+e^-\rightarrow \pi ^+\pi ^-\pi ^0\pi ^0\)) [29] we estimate that the total production cross sections for \(\rho (1450)\) and \(\rho (1700)\) are about 60 nb and 15 nb, respectively. The production cross section for the isoscalar resonances \(\omega (1420)\) and \(\omega (1650)\) are estimated to be about 6 nb and 9 nb, respectively, from the data on the \(e^+e^-\rightarrow \pi ^+\pi ^-\pi ^0\) [30], \(e^+e^-\rightarrow \omega \pi ^+\pi ^-\) [31], and \(e^+e^-\rightarrow \omega \pi ^0\pi ^0\) [32] cross sections. Taking into account the branching fractions \(B(a_0\rightarrow \eta \pi )=0.093\pm 0.020\) and \(B(a_2\rightarrow \eta \pi )=0.145\pm 012\) [23], we obtain the cross sections listed in Table 6. Since resonances involved into these subprocesses listed in Table 6 are wide, we expect a significant interference between their amplitudes. So, the total \(e^+e^-\rightarrow {{\mathrm{rad}}}\text{- }\eta \pi ^0\gamma \) cross section based on the prediction from Ref. [10] may reach 3–5 pb. This value is several times lower than our measurement.

Table 6 The predicted contributions to the \(e^+e^-\rightarrow \eta \pi ^0\gamma \) cross section from the radiative decays of the exited vector mesons in pb. The predictions are based on the partial widths calculated in Ref. [10]