1 Introduction

Searches for top flavour-changing neutral (FCN) interactions [1] were an important component of the top physics program at the Tevatron and now at the Large Hadron Collider (LHC), and will be pursued at future facilities. Top FCN interactions are extremely weak in the standard model (SM), with branching ratios \(\text {Br}(t \rightarrow cZ) \sim 10^{-14}\), \(\text {Br}(t \rightarrow c\gamma ) \sim 10^{-14}\), \(\text {Br}(t \rightarrow cg) \sim 10^{-12}\), \(\text {Br}(t \rightarrow cH) \sim 10^{-15}\) [2,3,4], and values an order of magnitude smaller for the up quark. As such, they offer an excellent window for detectable effects from new physics. Top FCN interactions beyond the SM can be directly probed mainly in two classes of processes: (1) standard \(t {\bar{t}}\) production with FCN decay of one of the top quarks [5,6,7,8], or (2) in FCN production of a top quark, followed by a standard decay [8,9,10,11]. At the LHC, the processes in the first class are expected to be more sensitive for tc interactions, while for tu interactions the sensitivity is expected to be comparable in both cases. These projections are confirmed by actual analyses with data. Searching for \(t {\bar{t}}\) production with FCN decay of one top quark, the CMS Collaboration has obtained the limits \(\text {Br}(t \rightarrow cZ,uZ) \le 5 \times 10^{-4}\) with 95% confidence level (CL), using the full Run 1 dataset with 19.7 fb\(^{-1}\) [12]. A recent combination with anomalous tZ production has improved these limits to \(\text {Br}(t \rightarrow cZ) \le 4.9 \times 10^{-4}\) and \(\text {Br}(t \rightarrow uZ) \le 2.2 \times 10^{-4}\) [13]. For top decay processes, the ATLAS Collaboration sets weaker limits, \(\text {Br}(t \rightarrow cZ,uZ) \le 8 \times 10^{-4}\) [14], while searches for tZ production have not been performed.

At future facilities, limits on top FCN interactions resulting from \(t {\bar{t}}\) production will not significantly improve over the current ones. For example, the projections from the ATLAS Collaboration for the high-luminosity Large Hadron Collider (HL-LHC) with 3000 fb\(^{-1}\) at 14 TeV are \(\text {Br}(t \rightarrow cZ) \le 2.3 \times 10^{-4}\), \(\text {Br}(t \rightarrow uZ) \le 1.3 \times 10^{-4}\) [15]. The reason is that, unfortunately, those searches will soon be dominated by systematic uncertainties, and will not benefit from the huge luminosity upgrade. On the other hand, single top FCN production processes, when mediated by effective non-renormalisable interactions, lead to distinct kinematical signatures, which allow one to perform measurements at high transverse momenta where the SM background is small. These features were already exploited when estimating the LHC sensitivity to top FCN interactions in Zt and \(\gamma t\) production [16]. The Lagrangian for top flavour-changing interactions with the Z boson and photon can be written as [17]

$$\begin{aligned} {\mathcal {L}}_{Zt}= & {} - \frac{g}{2 c_W} {\bar{q}} \, \gamma ^\mu \left( X_{qt}^LP_L + X_{qt}^RP_R \right) t\; Z_\mu \nonumber \\&- \frac{g}{2 c_W} {\bar{q}} \, \frac{i \sigma ^{\mu \nu }q_\nu }{M_Z} \left( \kappa _{qt}^LP_L + \kappa _{qt}^RP_R \right) t\; Z_\mu + \text {H.c.}, \nonumber \\ {\mathcal {L}}_{\gamma t}= & {} - e {\bar{q}} \, \frac{i \sigma ^{\mu \nu }q_\nu }{m_t} \left( \lambda _{qt}^LP_L + \lambda _{qt}^RP_R \right) t\; A_\mu + + \text {H.c.}, \end{aligned}$$
(1)

with \(q=u,c\). Among these, the dipole \(\sigma ^{\mu \nu }\) terms have the high-energy enhancement mentioned before, and limits on them are naively expected to be very stringent in the ultraboosted regime. But, besides this improvement, in the ultraboosted regime there is a drawback: the decay products of the top quark merge into a single jet. In that situation, the main SM background is Zj and \(\gamma j\) production, with j a quark or gluon jet, whose cross section is huge, much larger than ZWj and \(\gamma Wj\), which would the corresponding irreducible backgrounds if the top decay products could be resolved. Then it is not obvious that considering the ultraboosted regime for these searches will actually be an advantage, and a detailed assessment of the sensitivity is necessary in order to seriously consider these channels from the experimental point of view. This is the purpose of this note, focusing on the HL-LHC and a future 100 TeV pp circular collider (FCC-hh), and restricting ourselves to Zt and \(\gamma t\) production mediated by non-renormalisable couplings. We consider in turn the sensitivity of the HL-LHC in Sect. 2 and of the FCC-hh in Sect. 3. In Sect. 4 we summarise our results and discuss possible improvements to the simple analyses outlined here.

2 Sensitivity at the HL-LHC

Our analysis is performed with a fast simulation of the (upgraded) CMS detector. The generation of the Zt and \(\gamma t\) signals is done with Protos [18, 19]. We set the anomalous couplings \(\kappa _{qt}^L= 0.01\), \(\kappa _{qt}^R= 0\), \(\lambda _{qt}^L= 0.01\), \(\lambda _{qt}^R= 0\). (The specific choice of left-handed chirality for the interactions hardly affects the results.) The showering and hadronisation is performed by Pythia8 [20] and the detector simulation by Delphes 3.4 [21]. The jets are reconstructed with FastJet [22] using the anti-\(k_T\) algorithm [23] and trimmed [24] using the parameters \(R=0.2\), \(f_\text {cut} = 0.05\). At LHC energies we require for event selection the presence of a large-radius \(R=1.0\) jet J, with transverse momentum \(p_T^J > 600\) GeV and pseudo-rapidity \(|\eta | < 2.5\). In Zt production we require the presence of two leptons \(\ell =e,\mu \) of the same flavour, with transverse momentum \(p_T^\ell > 200\) GeV and pseudo-rapidity \(|\eta | < 2.4\), having an invariant mass \(m_{\ell \ell }\) in the interval [60, 120] GeV. In \(\gamma t\) production we require a photon with \(p_T^\gamma > 400\) GeV. In addition, we require that the lego-plot separation \(\Delta R\) between the jet and the reconstructed Z boson or photon is larger than 1. We divide the event sample into ‘semileptonic’ and ‘hadronic’ channels depending on whether a hard lepton is found within the jet:

  1. 1.

    semileptonic: a lepton (the leading lepton in the event in \(\gamma t\), the third one in Zt) is found within \(\Delta R = 0.3\) distance of the jet, and with transverse momentum fraction \(z \equiv p_T^\ell / p_T^J > 0.1\);

  2. 2.

    hadronic: if the above condition is not fulfilled.

The choice of the cuts on z fraction and \(\Delta R\) distance are good to obtain a large rejection of the leading Zj and \(\gamma j\) backgrounds, in which leptons are produced from cascade decays within the jets, but is not optimised.

While for the hadronic channel the main backgrounds are, by far, Zj and \(\gamma j\) production, for the semileptonic channel \(Zb / \gamma b\) and \(ZWj / \gamma Wj\) are important too. These backgrounds are generated with MadGraph5 [25]. All the signals and backgrounds are generated by slicing the phase space in intervals of top or jet transverse momenta, so that the region of large \(p_T\), with cross sections two orders of magnitude smaller than the lowest \(p_T\) range considered, is populated with sufficient statistics. In all cases, top quark and anti-quark production is summed.

Pile-up events are a major issue at the HL-LHC, and unfortunately the simulation of the signals and backgrounds with enough statistics and the expected 140 pile-up events per beam crossing is computationally very CPU and storage demanding (around 20 TB of disk space for the Monte Carlo statistics of several million events used in our simulations). To overcome this technical difficulty, we base our signal and background discrimination on pile-up-robust observables, such as the jet \(p_T\) and mass, and do not simulate pile-up events to obtain our estimates. For illustration, we show in Fig. 1 the jet mass distribution after trimming for \(g u \rightarrow Zt\) events, with and without pile-up, for a sample of \(2 \times 10^4\) events generated with top transverse momentum between 1.2 and 1.4 TeV at the parton level. For comparison we also show the jet mass distribution for a sample of \(8 \times 10^5\) Zj events with jet \(p_T\) between 1.2 and 1.4 TeV, still at the parton level. The left panel corresponds to the hadronic channel, in which the mass is well reconstructed, and the right panel to the semileptonic channel, in which the missing neutrino does not contribute to the jet mass. One can observe that the trimmed jet mass is not significantly affected by pile-up. For our event selection, in the hadronic channel we further require a jet mass \(m_J \in [150,200]\) GeV, and in the semileptonic channel \(m_J \in [100,175]\) GeV.

Fig. 1
figure 1

Jet mass distribution for the Zt signal (with and without pile-up) and the Zj background. Left: hadronic channel. Right: semileptonic channel

Fig. 2
figure 2

Leading jet transverse momentum distribution for the Zt and \(\gamma t\) signals and their background at the HL-LHC, in the hadronic and semileptonic channels

The transverse momentum distribution of the hardest jet in the event, deemed to correspond to the top quark in the case of the signals, is presented in Fig. 2, for the Zt (top) and \(\gamma t\) (bottom) signals and their backgrounds, in the hadronic (left) and semileptonic (right) channels. One can clearly see that for the u-initiated signals the slope of the distributions is milder than for the background [26], showing the advantage of considering ultraboosted top quarks. On the other hand, for c-initiated processes the slope is similar and the benefit of going to high \(p_T^J\) is moderate.

The advantage of requiring a hard lepton within the jet [27, 28] to enhance the signal significance is also manifest: the leading \(Zj/\gamma j\) backgrounds are suppressed by two orders of magnitude. For illustration, we collect in Table 1 the cross sections of the different signal and background processes considered, after event selection. For comparison, the cross sections for SM tZj production with the event selection considered are 2.6 (0.36) ab in the hadronic (semileptonic) channel.

Table 1 Cross sections (in ab) for the different signal and background processes at the HL-LHC, after event selection. For the signals, we take \(\kappa _{qt}^L= 0.01, \lambda _{qt}^L= 0.01\)
Fig. 3
figure 3

Value of the estimator \({\mathcal {S}}_{20}\) in Eq. (2) as a function of the cut on minimum \(p_T^J\), for the HL-LHC

To estimate the upper limits that could be placed on a possible FCN signal, we use the estimator

$$\begin{aligned} {\mathcal {S}}_{20} = \frac{S}{\sqrt{B + (0.2 B)^2}}, \end{aligned}$$
(2)

with S and B the number of signal and background events, respectively. When the number of background events is sufficiently large, the denominator of this quantity gives the background uncertainty as the statistical one (\(\sqrt{B}\)), plus a 20% systematic uncertainty, summed in quadrature. We plot \({\mathcal {S}}_{20}\), assuming a luminosity of 3 ab\(^{-1}\), in Fig. 3, as a function of the lower cut on the leading jet transverse momentum, denoted min \(p_T^J\).

Of course, for very high values of this cut, the number of background events is small and Poisson statistics must be used, instead of the Gaussian approximation in the definition of \({\mathcal {S}}_{20}\). However, we have checked that for the values of the min \(p_T^J\) cut where \({\mathcal {S}}_{20}\) is near its maximum, the number of background events is sufficiently large, as it can also be seen from the distributions in Fig. 2. Using \({\mathcal {S}}_{20}\) as estimator, and translating the upper limits on \(\kappa _{qt}^L\) and \(\lambda _{qt}^L\) into top decay branching ratios, we obtain at 95% CL

$$\begin{aligned}&\text {Br}(t \rightarrow uZ)< 4.1 \times 10^{-5} \quad (1.1 \times 10^{-4}) \nonumber , \\&\text {Br}(t \rightarrow cZ)< 1.6 \times 10^{-3} \quad (9.6 \times 10^{-3}) \nonumber , \\&\text {Br}(t \rightarrow u\gamma )< 1.8 \times 10^{-5} \quad (5.3 \times 10^{-5}), \nonumber \\&\text {Br}(t \rightarrow c\gamma ) < 6.1 \times 10^{-4} \quad (5.2 \times 10^{-3}), \end{aligned}$$
(3)

with the numbers between parentheses corresponding to the hadronic channel. While the limits for top FCN couplings with the charm quark are relatively weak as expected, those with the up quark are very stringent. For \(t \rightarrow Zu\), a comparison with projected limits from \(t {\bar{t}}\) production in Ref. [15] is possible. Both the hadronic and the semilteptonic channel in Zt production improve over the expectations from top decays, up to an order of magnitude in the latter case.

3 Sensitivity at the FCC-hh

We perform this analysis with a fast simulation of a future FCC-hh detector. The event selection is analogous to the one described in the previous section, but using jets of radius \(R=0.4\) and raising the transverse momentum thresholds to \(p_T > 2000\) GeV for the leading jet, \(p_T > 500\) GeV for charged leptons and \(p_T > 1000\) GeV for the photon. The semileptonic channel is defined taking \(\Delta R = 0.2\) and keeping \(z > 0.1\). The corresponding distributions for the transverse momentum of the leading jet are given in Fig. 4.

Fig. 4
figure 4

Leading jet transverse momentum distribution for the Zt and \(\gamma t\) signals and their background at the FCC-hh, in the hadronic and semileptonic channels

Table 2 Cross sections (in ab) for the different signal and background processes at the FCC-hh, after event selection. For the signals, we take \(\kappa _{qt}^L= 0.01\), \(\lambda _{qt}^L= 0.01\)

The behaviour is qualitatively the same as seen in the previous section. The cross sections for the different processes after event selection are given in Table 2.

With the huge energy boost at the FCC-hh, Zt and \(\gamma t\) processes allow one to obtain competitive limits even on top FCN interactions with the charm quark. We present in Fig. 5 the estimator \({\mathcal {S}}_{20}\) as a function of the cut on \(p_T^J\), assuming a luminosity of 10 ab\(^{-1}\).

Fig. 5
figure 5

Value of the estimator \({\mathcal {S}}_{20}\) in Eq. (2) as a function of the cut on minimum \(p_T^J\), for the FCC-hh

The estimated 95% CL upper limits that could be achieved with that luminosity are quite remarkable, reaching and even surpassing the \(10^{-6}\) ballpark in the case of the up quark,

$$\begin{aligned}&\text {Br}(t \rightarrow uZ)< 2.7 \times 10^{-6} \quad (6.5 \times 10^{-6}) \nonumber , \\&\text {Br}(t \rightarrow cZ)< 5.0 \times 10^{-5} \quad (2.5 \times 10^{-4}) \nonumber , \\&\text {Br}(t \rightarrow u\gamma )< 9.1 \times 10^{-7} \quad (5.1 \times 10^{-6}), \nonumber \\&\text {Br}(t \rightarrow c\gamma ) < 2.3 \times 10^{-5} \quad (2.5 \times 10^{-4}). \end{aligned}$$
(4)

4 Discussion

The analysis performed in this note shows that searches for Zt and \(\gamma t\) production in the ultraboosted regime will provide competitive limits on top FCN interactions, despite the fact that backgrounds are very large when the top decay products cannot be resolved. We have performed a simple and robust analysis, based on fast detector simulations, in which the variables used to discriminate signal and background are the mass and transverse momentum of the leading jet, which corresponds to the top quark in the two signals under study. We have used a third variable, the fraction of transverse momentum of an additional lepton within the jet, to distinguish two top quark decay channels, semileptonic and hadronic, with the backgrounds being much smaller for the former.

With the analysis presented here we have found that the expected sensitivity to tuZ and \(tu\gamma \) interactions is excellent. For tuZ interactions for which a comparison with other analyses is possible, we find that the projected limits on the \(t \rightarrow uZ\) branching ratio from \(t {\bar{t}}\) production at HL-LHC can be improved by an order of magnitude in Zt production. Even stronger limits, at the \(10^{-6}\) level for tu and \(10^{-5}\) level for tc interactions, could be achieved at a future FCC-hh.

Besides the optimisation of the expected sensitivity, e.g. by varying the kinematical cuts, several improvements to the simple analyses presented here are possible, using additional information. In the semileptonic channel, the use of b-tagging would further reduce the main backgrounds from Zj and \(\gamma j\) production. In the hadronic channel, jet substructure observables like N-subjettiness [29] can be further used to reject the Zj and \(\gamma j\) backgrounds where the jets correspond to quarks and gluons. In both cases, the use of these variables requires a more delicate analysis, with the inclusion of pile-up and perhaps also a calibration of the Monte Carlo predictions against measured data. Such a study is beyond the scope of this work, and it is worth being pursued by experiments at the high-luminosity LHC run.