Despite its great success, the Standard Model (SM) does not provide a complete description of nature. For example it cannot explain the origin of dark matter, the neutrino masses and the baryon asymmetry problem. Furthermore, interesting discrepancies between some SM predictions and measurements have been observed. These include the LHCb results challenging lepton universality [1] and the long standing discrepancy of the muon anomalous magnetic moment \(a_{\mu }=(g_{\mu }-2)/2\) [2] which was recently confirmed [3]. The combination of the Brookhaven and Fermilab muon g-2 results compared to the latest theoretical calculations using dispersion relations [4] leads to a discrepancy of \(\sim 4.2\sigma \):

$$\begin{aligned} \varDelta a_{\mu } \equiv a_{\mu }(exp) - a_{\mu }(th) =(251 \pm 59)\cdot 10^{-11}. \end{aligned}$$

It should be noted that when compared to the latest QCD lattice calculations this is reduced to about 1.4\(\sigma \) [5]. In order to help elucidate the origin of this difference, a new experiment aiming to measure the contribution of hadronic corrections is being prepared at CERN [6].

In terms of new physics, among many interesting proposals, a way to explain this discrepancy is to introduce a 1-loop correction involving a \(U(1)_{D}\) dark sector massive gauge field \(A'\) to the QED 3-point vertex [7]. The Dark Photon \(A'\) can couple to both charged Dark Matter (DM) fields \(\chi _i\) with coupling strength \(g_D\), and to SM leptons via kinetic mixing \(\varepsilon \) with the SM photon field A. Considering models with a diagonal \( A'\) coupling to DM and SM fields, two decay modes are possible, \( A'\rightarrow e^+e^-\) (visible mode) [8] and \( A'\rightarrow \chi \overline{\chi }\) (invisible mode) [9]. These were excluded as explanations of the \(a_{\mu }\) anomaly by the combined results of NA64 and BaBar [9,10,11] (for \( A'\rightarrow \chi \overline{\chi }\)) and NA48 [12] (for \( A'\rightarrow e^+e^-\)). In addition, the prospected sensitivity for NA64 running in muon mode to probe the \((g_\mu -2)/2\) anomaly was estimated recently [13] in the anomaly free \(L_\mu -L_\tau \) gauge extension of the SM.

In this work we consider an alternative model for \( A'\) decay. This was initially proposed to recover an explanation of the \(g_{\mu }-2\) discrepancy still within the Dark Photon paradigm [14, 15]. This model is characterised by the \( A'\) decaying into a heavier \(\chi _2\) and a lighter \(\chi _1\) Dark Matter states. While \(\chi _1\) is a non-interacting stable state which determines the DM relic abundance, \(\chi _2\) is unstable and de-excites by emitting a \(\chi _1\) and an off-shell \( A'^{*}\), that subsequently decays into an electron-positron pair. Thus, a new semi-visible decay mode combining characteristics of both the visible and invisible decay signatures emerges. It is very remarkable that such a model can potentially explain both \((g_{\mu }-2)/2\) and the Dark Matter thermal relic abundance for 300 MeV\(\lesssim m_{ A'} \lesssim \) 1 GeV, thus making it of great phenomenological interest [14, 15].

In this study, we focus on a Dark Matter model that extends the SM symmetry group with a dark sector \(U(1)_D\), which is spontaneously broken by a dark Higgs field \(h_D\) [15]. The gauge mixing with the SM photon via the term \(-\varepsilon F^{\mu \nu }[A']F_{\mu \nu }[A]\), governed by the parameter \(\varepsilon \), generates a massive Dark Photon after spontaneous symmetry breaking.

The diagonalisation of the mixed gauge interaction [16] allows the removal of \(\varepsilon \) from the pure mixed-gauge Lagrangian. However, a new coupling appears between \( A'\) and the SM electromagnetic current, with interaction strength \(\varepsilon e\). The novel interaction term is the main phenomenological feature of the model: the possibility to have SM final states produced via kinetic mixing of \( A'\) with A. Nevertheless, the unique feature of the semi-visible model, that distinguishes it from the invisible and visible channels, is found in the Yukawa dark sector. In the unbroken theory, we start from a pseudo-Dirac field \(\varPsi \) charged under \(U(1)_D\). The chiral projections of \(\varPsi \) can then be coupled with \(h_D\) to produce Dirac and Majorana mass terms, after spontaneous symmetry breaking [15].

In this pseudo-Dirac scenario, the right and left Majorana masses are the same and are strongly suppressed relative to the Dirac mass \(M_D\). The diagonalisation of the mass matrix results in two eigenstates: a lighter stable \(\chi _1\) and a heavier \(\chi _2\) DM particle, with mass difference \(\varDelta \equiv m_{\chi _2} - m_{\chi _1}\) [17].

The effective Lagrangian for the semi-visible model is:

(1)

In Eq. 1, the coupling to muons is neglected since the di-muon production threshold \(\varDelta = 2m_{\mu }\) is not relevant for the sub-GeV mass range of \( A'\) probed in this study. The absence of elastic diagonal interaction terms derives from the choice of a pseudo-Dirac field, where only off-diagonal terms are permitted. This allows us to neglect the invisible and visible \( A'\) decay modes, where conversely only diagonal terms are present. A sketch of the dominating decay chain is shown in Fig. 1. The Dark Photon \(A'\) decays promptly in a lighter \(\chi _1\) and a heavier \(\chi _2\) via the mentioned inelastic interaction, followed by the subsequent decay \(\chi _2 \rightarrow \chi _1 e^{+}e^{-}\).

Fig. 1
figure 1

Production of \( A'\) and subsequent semi-visible decay chain of a Dark Photon, \(e^- Z \rightarrow e^-Z A'; A'\rightarrow \chi _1 \chi _2 (\chi _2 \rightarrow \chi _1 e^+ e^-)\)

Fig. 2
figure 2

A schematic view of the NA64 invisible mode setup used in 2018

The width of the process was calculated at leading order. A numerical approach was used to compute the 3-body decay phase-space, implemented in the module MadWidth of MadGraph5aMC@NLO [18]. Thus, a correction is obtained to the previous analytical approximations (valid for \(m_{A'} \gg m_{\chi _1} \gg m_e\)) of the \(\varGamma (\chi _2 \rightarrow \chi _1 e^+e^-)\) formula from Refs. [15, 19]. The newly attained formula reads

$$\begin{aligned} \varGamma (\chi _2 \rightarrow \chi _1 e^+e^-) \simeq K \frac{4 \varepsilon ^2 \alpha _{EM}\alpha _{D}\varDelta ^5}{15 \pi m_{A'}^4}, \end{aligned}$$
(2)

where \(K \simeq 0.640 \pm 0.004\) is the correction factor estimated using both Madgraph and CalcHep [20], found to be in good agreement. The quoted uncertainty on the K factor takes into account the difference between Madgraph and CalcHep and the slight dependence of K on \(m_A'\). The K-factor was found to be basically insensitive to the other parameters of the model.

An upper bound for the dark sector coupling constant \(\alpha _D\) can be found by requiring the absence of a Landau pole for the effective coupling constant \(\bar{\alpha }_D(\mu )\) up to an energy scale \(\varLambda \sim 1\) TeV: \(\alpha _D \lesssim 0.2\) [21, 22]. In this study, a benchmark value of \(\alpha _D = 0.1\) is used, compatible with other literature [14, 15]. Nevertheless, a discussion on the implications of different \(\alpha _D\) choices in our results will be provided. Furthermore, the resonance of the thermal averaged non-relativistic co-annihilation DM cross section \( \langle \sigma _{an}v_{rel} \rangle (\chi _1 \chi _2 \rightarrow e^+e^-)\) present at \( m_{A'} \sim 2 m_{\chi _1}\) [17, 19] can be avoided by setting as benchmark \(m_{A'} = 3 \cdot m_{\chi _1}\) such as in [15, 17, 19]. Finally, the parameter \(\varDelta \) has kinematic limits \(\varDelta < m_{ A'} - 2 \cdot m_{\chi _1}\) and \(\varDelta > 2 m_e\). A relatively large mass splitting \(\varDelta /m_{\chi _1} = 0.4\) is chosen in this study, as strong bounds for lower \(\varDelta \) already exist as explanation of \((g_{\mu }-2)/2\) by BABAR and E137 [10, 14, 15]. A complete discussion of the achievable \(\varDelta \) range, up to the limit \(\varDelta /m_{\chi _1} \simeq 1\), is provided below.

In this work, we present a direct search for the \( A'\) semi-visible signature using the NA64 experiment located at CERN SPS. The Dark Photons are produced in the process \(e^-Z \rightarrow e^-Z A'\) as 100 GeV electrons coming from the H4 beamline scatter inside the NA64 electromagnetic calorimeter (ECAL). The production mechanism is identical to the one described in Ref. [9]. The setup is schematically shown in Fig. 2. The experiment uses a set of scintillator and veto counters, a magnet spectrometer consisting of two dipole magnets, and a set of tracking detectors (six micromegas chambers [23], three straw detectors [24] and two GEMs [25]) to define the incoming \(e^-\) beam. A synchrotron radiation detector (SRD) is used to suppress the hadron contamination in the beam. The electrons are absorbed in a lead-scintillator sandwich Shashlick-type ECAL target of 40 radiation lengths. Downstream from the ECAL, a large high-efficiency VETO counter and three iron hadronic calorimeters (HCALs) complete the setup. An additional HCAL module is placed along the unbent beam path to further suppress background from upstream \(e^-\) interactions. Further details about the setup can be found in Refs. [9, 26, 27].

Fig. 3
figure 3

A schematic view of an event \( A'\rightarrow \chi _1 \chi _2 (\chi _2 \rightarrow \chi _1 e^+ e^-)\) from a \( A'\) produced after a 100 GeV \(e^-\) scatters off in the active dump, \(e^- Z \rightarrow e^- Z A'\). The \(\chi _2\) particle decaying within HCAL2 corresponds to the S1 signature (see text for more details)

The \( A'\) is produced in the target via Dark-Bremsstrahlung [28] and decays promptly into \(\chi _1 \chi _2\). The long-lived \(\chi _2\) travels through the VETO and HCAL1, which acts as a veto to reject particles leaking from the target, before decaying through \(\chi _2 \rightarrow \chi _1 e^+ e^-\). The result of this decay would be observed in the experiment through two characteristic signatures. The first (S1), is identified by the presence a significant energy deposition in HCAL2 or HCAL3, as the result of the decay to \(e^+e^-\) (see Fig. 3). In the second signature (S2), \(\chi _2\) decays outside the fiducial volume limited by the last HCAL module, traveling a distance \(\gtrsim 6\) m. All energy of the produced \( A'\) is undetected and the signature is effectively equivalent to the one used for the search \( A'\rightarrow \chi \overline{\chi }\) (invisible mode). These two signatures closely resemble the ones used in the previous NA64 analysis searching for pseudo-scalar and axion-like particles (see more details in Refs. [9, 26]). Since the data has already been unblinded, we chose a conservative approach and re-cast this analysis using the pseudo-Dirac model instead of performing a new one. We checked that the optimization of the selection criteria will enhance the sensitivity up to around 10%. This will be used in the future to perform a blinded analysis when new data will be available. In the following, we provide a brief description of the method.

Impurities from the beam, consisting mostly in \(\pi ^-\) (\(\lesssim \)1%) are suppressed using the SRD to a level of \(\lesssim 10^{-6}\) [29]. The tracking system measures the incoming energy of the electrons which is required to be within \(\sim \) 3 GeV from the nominal 100 GeV beam energy. The ECAL serves as an active dump measuring the energy deposition of the incoming particles. We require no activity in the VETO and the first HCAL module to reject any initial beam particles that penetrate the ECAL. For S2, no activity is required in all HCAL modules, since \(\chi _2\) is assumed to decay outside the fiducial volume. Finally, for S1, a cut \(R < 0.06\) is applied on the variable \(R \equiv (E_{HCAL} - E^c_{HCAL}) / E_{HCAL}\), defined as the ratio between the energy deposit in the periphery and the total energy deposited in the HCAL2 and HCAL3 modules.

The leading background of S1 is caused by \(K^0_L\) traveling undetected through the first HCAL module and deposit energy in either HCAL2 or HCAL3. The S2 signature can instead be misidentified due to large missing energy produced by electron-hadron interactions along the beamline. The total expected background for the two signatures is detailed in the previously published analyses, where it was determined that 0.19±0.07 events are expected in the signal box of S1 [26] and 0.53 ± 0.17 are expected for S2 [9, 11]. A full discussion of the uncertainties is also found in these references. In particular, the two leading contributions are \(\lesssim 10\%\) for the parametrisation of the form factor in the cross-section and an additional \(10\%\) coming from the data-MC discrepancy in the dimuon-yield (events where the interaction \(\gamma \rightarrow \mu ^+ \mu ^-\) is detected) [11, 26]. The difference in the estimate of the \(\chi _2 \rightarrow \chi _1 e^+ e^-\) width, between MadGraph and CalcHEP, leads to a negligible uncertainty \(\lesssim 1\%\). All uncertainties, summed in quadrature, do not exceed 20%.

The background for this new search is the same as the previous searches for \(A'\rightarrow invisible\) and \(a \rightarrow \gamma \gamma \). Thus, the applied cuts are already optimized for the best coverage of \( A'\). An exception is the cut applied on the variable R. A larger tail for high values of R is expected in this model, for two reasons: (i) smaller \(\chi _2\) energy due to the \(\chi _1\) emission in the original prompt decay, and (ii) the three-body decay of \(\chi _2\) which increases the phase space of the final decay products \(\chi _1 e^+e^-\). To be conservative, the cut of \(R<0.06\) was not changed, and the task of its optimization is left for a future analysis on new data. Instead, its effect was calculated with our detailed MC simulation. We found that on average this cut has an efficiency of \(\sim \) 52%, weakly dependent on the parameter of the model, with a minimum value of \(\sim \) 45%.

The signal yield was calculated using a full MC simulation based on the Geant 4 toolkit [30]. The framework used for the previous NA64 analysis of the 2016–2018 data [9, 26] was extended to include the new model containing the semi-visible decay. Both \(\chi _1\) and \(\chi _2\) particles are assumed to have no interaction with the detectors. For the S1 signature, \(\chi _2\) is forced to decay inside the fiducial volume, i.e., the space between the beginning of HCAL2 and the end of HCAL3. The event is then weighted by the probability of such decay to take place. In the case of S2, we assume that the full energy of \( A'\) is lost, and a weight corresponding to the probability for the Dark Photon to decay beyond all NA64 subdetectors is assigned to the event. This simulation is performed for a grid on the (\(m_{ A'};\varepsilon \)) plane to estimate the expected number of events for different masses and mixing strengths. We use \(\alpha _D=0.1\), \(m_{ A'} = 3 \cdot m_{\chi _1}\) and a mass splitting \(\varDelta /m_{\chi _1} = 0.4\) as benchmark for these simulations.

Fig. 4
figure 4

The NA64 90% exclusion limit for a new vector boson \( A'\) with a coupling to electrons with decay mode \( A'\rightarrow \chi _1 \chi _2 (\chi _2 \rightarrow \chi _1 e^+ e^-)\). The limits were derived in the (\(m_{ A'}\), \(\varepsilon \)) assuming \(\alpha _D =0.1\), \(m_{ A'}=3\cdot m_{\chi _1}\) and a mass splitting \(\bar{f} = 0.4\). The red band shows the region of parameter space within two sigma from the world average of \((g_{\mu }-2)/2\) [3]. The blue band shows the same region before the results at Fermilab were published. Constraints from BABAR and E137 are also shown following the recasting done in Refs. [14, 15], together with the bounds of NuCal and CHARM [37]. A thick black line shows the combination of parameters compatible with a DM thermal relic scenario

Fig. 5
figure 5

The NA64 90% exclusion limit for a new vector boson \( A'\) with a coupling to electrons with decay mode \( A'\rightarrow \chi _1 \chi _2 (\chi _2 \rightarrow \chi _1 e^+ e^-)\). The limits were derived in the (\(m_{ A'}\);\(\alpha _D\)) (top) and (\(m_{\chi _1}\);\(\bar{f}=\varDelta / m_{\chi _1}\)) (bottom) plane assuming \(\alpha _D =0.1\), \(m_{ A'}=3\cdot m_{\chi _1}\) and a \(\varepsilon = \varepsilon _{(g_{\mu }-2)/2}\), where \(\varepsilon _{(g_{\mu }-2)/2}\) is the value in the central band of the \((g_{\mu }-2)/2\) anomaly. Constraints from Babar and E137 are also shown following the recasting done in Refs. [14, 15], together with the bounds of NuCal and CHARM [37]. A thick black line shows the combination of parameters compatible with a DM thermal relic scenario. The projected limit for \(5\times 10^{12}\) EOT using a compact HCAL1 are drawn in the (\(m_{\chi _1}\);\(\bar{f}=\varDelta / m_{\chi _1}\)) plane

The exclusion limit was calculated using the multibin limit setting technique with the modified frequentist approach (the code based on the ROOSTATS package [31]), using the profiled likelihood as a test statistic [32, 33]. The corresponding 90% exclusion limit was obtained using Eq. 4 of [26] to compute the expected signal yield. The results are summarized in Fig. 4 in the 2D plane (\(m_{ A'}\);\(\varepsilon \)), where the relevant estimated bound of E137 and Babar are also shown [14, 15] together with the projection of Nucal [34, 35] and CHARM [36, 37]. Using the benchmark values discussed above, our data exclude the \((g_{\mu }-2)/2\) explanation of the semi-visible model up to a mediator mass \(m_{ A'} \lesssim 0.39\) GeV including a so-far uncovered area close to this boundary. Even though this might look only like as a slight improvement of the current bounds, we would like to stress that these are the first experimental limits in this region of parameter space obtained with a full analysis of the data including all efficiencies and uncertainties. In Fig. 5, the region of the parameter in the central band of the \((g_{\mu }-2)/2\) anomaly is also shown in the two planes (\(m_{ A'}\);\(\alpha _D\)) and (\(m_{\chi _1}\);\(\varDelta /m_{\chi _1}\)). To project this space we use the same assumption as in Fig. 4 for the parameters not considered, and we set \(\varepsilon = \varepsilon _{(g_{\mu }-2)/2}\) as the epsilon compatible with the central band of \((g_{\mu }-2)/2\), a convention used in previous studies of this model [15, 37]. Our results exclude the unexplored area for \(m_{ A'} \gtrsim 0.3\) GeV in the \((g_{\mu }-2)/2\) band, leaving space for models in which \(m_{ A'}\) is larger than 0.4 GeV, or with large mass splitting \(\varDelta \) that can still explain the anomaly. The largest limitation to probe the missing region comes from the increasingly short decay time of \(\chi _2\), which makes the chance of detection vanishingly small. This is particularly relevant for the mass splitting \(\varDelta \) (see Fig. 5 bottom), since the \(\varDelta ^5\) scaling of the decay width adds a large suppression to the signal yield. For \(\varDelta / m_{\chi _1} \gtrsim 0.5\), our limits become rapidly weak.

In order to increase the sensitivity for short-lived \(\chi _2\), the HCAL1 length should be shortened as much as possible while keeping the residual background under control. The use of an absorber with very short nuclear interaction length (Tungsten or Uranium compared to the stainless steel used in the current HCAL1 ) and an optimization of the ratio between active and passive material could bring to an HCAL1 shorter by a factor of three with respect to the current length (50 cm versus 150 cm). A similar study is planned for optimizing the design of the Tungsten target used for searching for \( A'\) into visible final states [38]. With a shorter HCAL1 the interesting parameter space that can account for the \((g_{\mu }-2)/2\) discrepancy and saturate the thermal relic density would be completely covered in all the dimensions of the model. A more compact HCAL1 would be also beneficial to improve the NA64 sensitivity of the search for axion-like particles (ALPS) into two photons, \(a \rightarrow \gamma \gamma \), for larger ALP-photon couplings."

In this work, we analysed the data collected by the NA64 experiment during three different runs in the “invisible-mode” configuration considering a new pseudo-Dirac scenario characterized by the decay \( A'\rightarrow \chi _1 \chi _2 (\chi _2 \rightarrow \chi _1 e^+ e^-)\) as signal candidate. In this model, the decay of the mediator \( A'\) results in both SM and DM particles in the final states, for an effective signature that combines features of both invisible and visible mode. This scenario can provide an explanation to the \((g_{\mu }-2)/2\) anomaly, recently confirmed at Fermilab [3], and at the same time is compatible with a freeze-out scenario capable to explain the observed DM relic-density. The previous limits on this model were improved by this analysis, excluding \(m_{ A'} \lesssim 0.39\) GeV at 90% confidence level (C.L.), assuming a DM coupling \(\alpha _D=0.1\) and a mass splitting \(\varDelta / m_{\chi _1} = 0.4\). A large region of parameter space characterized by short living \(\chi _2\) remains unexplored as an exciting prospect for future searches.