1 Introduction

Since the discovery in 2012 of the Higgs boson at the LHC, reported by the ATLAS [1] and the CMS [2] collaborations, with a mass \(m_h =\) 125.09 ± 0.21 (stat.) ± 0.11 (syst.) GeV [3], an intense experimental program has been developed in order to figure out if there is new physics behind it and, in particular, an extended Higgs sector. A clear signal of physics beyond the standard model (BSM) would be undoubtedly the presence of Higgs boson decays into two charged leptons of different flavor. The first search at the LHC of lepton-flavor-violating (LFV) decays of the Higgs boson was performed by CMS [4], observing a slight excess with a 2.4\(\sigma \) significance in the \(h \rightarrow \tau \mu \) channel at a center-of-mass energy of \(\sqrt{s} =\) 8 TeV and an integrated luminosity of 19.7 fb\(^{-1}\). Later on, ATLAS found a mild deviation of 1\(\sigma \) significance in the same LFV channel [5], corresponding also to \(\sqrt{s} =\) 8 TeV with 20.3 fb\(^{-1}\) of luminosity. In a subsequent CMS analysis at 13 TeV [6] no excess was observed but more data were needed to make definitive conclusions on the origin of that anomaly. Finally, CMS confirmed the disappearance of this excess with the results presented in [7]. Lepton flavor violation has also been searched for in the \(\mu e\) [8] and \(\tau e\) [8, 9] channels of the Higgs boson. This class of LFV processes is also being sought through the decays of heavy resonances [10,11,12,13] and neutral heavy Higgs bosons [14, 15].

LFV was firstly observed in the neutrino oscillations and one could expect that also occurs in the charged lepton sector of the SM. Indeed, LFV is intensely looked for through radiative decays (\(\mu \rightarrow e \gamma \) [16], \(\tau \rightarrow e \gamma \) [17], and \(\tau \rightarrow \mu \gamma \) [17]), leptonic decays (\(\mu \rightarrow eee\) [18], \(\tau \rightarrow eee\) [19], \(\tau \rightarrow \mu \mu \mu \) [19], etc), and \(\mu -e\) conversion in heavy nuclei [20, 21]. No evidence of LFV has been observed in any of these searches, imposing very restrictive bounds on the rates of these LFV processes. In this work we focus on the search for LFV in the decays of a heavy Higgs scalar H and a heavy pseudoscalar A. In principle, one should consider the three possible LFV Higgs boson decay (LFVHD) channels: \(H/A \rightarrow \mu e\), \(H/A \rightarrow \tau e\), and \(H/A \rightarrow \tau \mu \). The former represents the cleanest LFV signature at hadron colliders, however the present stringent upper limits on the related LFV lepton processes (\(\mu \rightarrow e \gamma \), \(\mu \rightarrow eee\), and \(\mu -e\) conversion in heavy nuclei) seem to indicate that \(H/A\rightarrow \mu e\) would be very suppressed. In addition, the LFVHD rates are usually proportional to the masses of the heaviest lepton involved in the decay. Therefore, this would mean also very tiny branching ratios for the \(H/A \rightarrow \mu e\) channel compared to the LFVHD with \(\tau \) leptons. In that sense, we expect very similar rates for the second channel, \(H/A \rightarrow \tau e\), to the latter one, \(H/A \rightarrow \tau \mu \). Nevertheless, the \(\tau e\) channel leaves a more contaminated signature than the \(\tau \mu \) channel, due specially to the fact that the jet fake rates are much larger for electrons than for muons. For all these reasons, we will concentrate along this work only on the most promising LFVHD channel, \(H/A \rightarrow \tau \mu \), for which there have been proposed several search strategies at the LHC, in a model-independent way [22,23,24] and within the framework of specific BSM models [25,26,27].

We develop a model-independent search strategy for LFV heavy Higgs boson decays at the LHC, that shows a plausible tendency to improve the sensitivity obtained by the current experimental limits, specially in the region of large Higgs boson masses. Our search strategy is performed in three Higgs boson mass windows (1–1.5 TeV, 1.5–2.5 TeV, 2.5–5 TeV) under the hypothesis that the decay rate into a tau-lepton pair is negligible. We focus on this mass range due to the fact that the current experimental searches become weaker with increasing values of the mass since the cuts stop being efficient. Besides, we do not consider mass values larger than 5 TeV because heavier particles are hardly produced with the current LHC energy. The most relevant kinematical variables in order to discriminate signal against background turn out to be the transverse momenta of the muon (\(p_T^\mu \)) and the tau (\(p_T^\tau \)), together with the missing transverse energy (\(E_T^\text {miss}\)), being the latter particularly decisive to deal with the QCD multijet background. We estimate the exclusion limits at 95% CL and the significances for evidence and discovery at 300 fb\(^{-1}\), and present these results along with those reported in a similar search by ATLAS in [13] for an integrated luminosity of 36.1 fb\(^{-1}\). As commented above, we observe a growth in the sensitivities for high Higgs boson masses at this luminosity.

Lastly, taking into account that the Higgs boson decay into a tau-lepton pair may mimic our LFV signal, we also study its impact on the exclusion limits and the significance for evidence and discovery, being this analysis not considered in the experimental searches so far. In particular, although the \(H/A \rightarrow \tau \tau \) decay has not been observed, it is worth mentioning that its impact on the exclusion limits of LFV heavy Higgs boson decays becomes significant when its branching ratio begins to compete with the corresponding to the \(H/A \rightarrow \tau \mu \) decay.

The paper is organized as follows: Sect. 2 is dedicated to the collider analysis of the \(pp\rightarrow H/A \rightarrow \tau \mu \) signal, with the performance of our model-independent search strategy and the sensitivities and exclusion limits that we obtain, while Sect. 3 is devoted to the study of the impact of considering the Higgs ditau channel on these previous results. Finally, we present in Sect. 4 the main conclusions of our work.

2 Collider analysis of the \(H/A\rightarrow \tau \mu \) channel

In this section we carry out the collider analysis and define our proposal of search strategies, at the next runs of the LHC, for heavy Higgs bosons decaying into a muon and a tau-lepton. In Sect. 2.1 we explain how we have proceeded to simulate the signal and estimate the different SM backgrounds, while we present in Sect. 2.2 the characterization of the signal that allows us to define a search strategy for three mass windows. Finally, Sect. 2.3 is dedicated to show the results of our search strategy, with the prospects for the sensitivities that could be reached at the LHC.

2.1 Signal simulation and background estimation

The experimental signature we are interested in consists of a final state with one tau and one muon of opposite sign charge originated from the decay of a heavy Higgs boson. The signal processFootnote 1 \(pp\rightarrow H/A \rightarrow \tau \mu \) has been simulated by means of an UFO model implemented in MadGraph_aMC@NLO 2.6 [28]. In this simplified model we have included an effective coupling for the heavy Higgs boson dominant production via gluon fusion,Footnote 2 as well as an effective coupling for the LFV Higgs boson decays into a tau and a muon. Both the signal and the SM backgrounds have been generated with MadGraph_aMC@NLO 2.6 [28], while the showering and hadronization have been performed with PYTHIA 8 [29]. Finally, the simulation of the detector response has been done with Delphes 3 [30], where the tau-leptons are reconstructed by means of their hadronic decays. We use the default set of parameters provided by Delphes 3 for the efficiencies and fake rates including, in particular, the miss-tagging of a jet as a tau-lepton.

The SM backgrounds for this exotic process can be sorted into a reducible category and an irreducible one. The irreducible category is made up of the Drell–Yan (DY) production of a tau-lepton pair, diboson production, \(t {\bar{t}}\), and single-top production. For the diboson process, we have taken into account all the combinations of \(W^\pm \) and Z bosons decaying leptonically or hadronically, with at least one of the two gauge bosons decaying leptonically (muon or tau). The \(t {\bar{t}}\) production considers both leptonic and hadronic tops, with at least one leptonic top, and the same for the single-top production, with at least the top or a \(W^\pm \) boson decaying into leptons. On the other hand, \(W+\)jets and QCD multijet processes are the main reducible backgrounds, in which there are jets faking a tau and/or a muon. The former has been computed with matching up to two extra jets, with the \(W^\pm \) boson decaying always leptonically and a jet faking an hadronic tau. For the QCD multijet background (matching up to two and three jets samples), we have assumed a constant fake-rate of detecting a jet as a muon of \(10^{-3}\) [32]. We notice, however, that a more realistic treatment of the reducible backgrounds requires the use of data-driven techniques that are out of the scope of this work.

In order to optimize the simulated events in our region of interest, we have imposed the following conditions at the generator level:

$$\begin{aligned} p_T^{j}&> 20 \text { GeV}, \quad |\eta ^{j}|< 5.0, \quad \Delta R_{j\ell }> 0.4,\nonumber \\ p_T^{\mu , \tau }&> 250 \text { GeV}, \quad |\eta ^{\mu , \tau }| < 2.5, \quad \Delta R_{\mu \tau } > 0.4, \end{aligned}$$
(1)

where \(p_T^j\) and \(\eta ^j\) are the transverse momentum and the pseudorapidity of the jets, respectively (the same definitions apply to the muon and tau leptons), \(\Delta R_{j\ell }\) is the angular distance between a jet and a lepton, and \(\Delta R_{\mu \tau }\) is the angular distance between the muon and the tau. The strong requirement over the transverse momentum of the charged leptons is due to the fact that we are interested in the LFV decays of heavy Higgs bosons, with \(M_{H,A} > rsim \) 1 TeV, resulting in very energetic \(\tau \) and \(\mu \) leptons. Therefore, these stringent cuts do barely affect the signal but reduce significantly the background cross sections and consequently the number of events to be generated. Moreover, given the large cross section of the multijet background, we adopted the procedure developed in [31] to accomplish a more realistic simulation of the tail of the kinematical distributions with an achievable number of events by generating in independent bins of increasing values of the variable \(H_{T2}\equiv p_T^{j_1}+p_T^{j_2}\), being \(j_1\) and \(j_2\) the leading and subleading jets in the event. This will allow us to obtain a reliable estimation of the acceptances corresponding to the cuts involved in our search strategies. We provide more details on the simulation of the QCD multijet background in the Appendix A.

The most important information about the generated events for the SM backgrounds is listed in Table 1. We estimated the cross sections at leading order (LO) by using MadGraph_aMC@NLO 2.6 for a center-of-mass energy of \(\sqrt{s} =\) 14 TeV after applying Eq. (1), and then rescaled them with the corresponding K-factors extracted from [28]. We also show in Table 1 the number of generated events for each background, which is consistent with a total integrated luminosity of \(\mathcal{L} =\) 300 fb\(^{-1}\).

Table 1 SM backgrounds along with the corresponding LO cross sections computed with the conditions of Eq. (1) at a LHC energy of 14 TeV, K-factors extracted from [28], and the number of simulated events. \(^*\)This number of events has been generated in exclusive bins of \(H_{T2}\), as explained in the Appendix A
Fig. 1
figure 1

Distribution of the transverse momentum of the muon (left panel) and the visible hadronic-tau lepton (right panel), for three signal benchmarks (\(M_H =\) 1 TeV, 2 TeV, and 3 TeV) and the main SM backgrounds, after minimal requirements in Eq. (2), for a LHC center-of-mass energy of \(\sqrt{s} =\) 14 TeV

2.2 Signal characterization and search strategies

Since we are interested in the search for heavy Higgs bosons, scalar H or pseudoscalar A with masses \(M_{H,A} > rsim \) 1 TeV, which decay into a muon and a hadronic-tau lepton, one expects their decay products to be very energetic. These leptons will have a higher transverse momentum than the ones corresponding to the background processes, which mainly come from the decays of much lighter particles (\(W^\pm \) and Z bosons, top quarks, and leptonic taus) or misidentified light jets. Therefore, the first step to characterize the signal, requires at the detector level one muon and one hadronic tau of opposite sign in the final state, with \(p_T^\mu>\) 250 GeV and \(p_T^{\tau \text {-vis}}>\) 250 GeV. This requirement is consistent with the conditions at the generator level in Eq. (1).

In summary, collecting all the requirements we mentioned so far,

$$\begin{aligned}&N_{\mu }=N_\tau =1, \quad Q_\mu \cdot Q_\tau< 0, \quad |\eta ^{\mu ,\tau }|<2, \nonumber \\&p_T^{\mu , \tau \text {-vis}} > 250~\mathrm{GeV}, \end{aligned}$$
(2)

where \(N_{\mu (\tau )}\) is the number of muons (taus) and \(Q_{\mu (\tau )}\) is the electric charge of the muon (tau). We have considered as tau candidates those with only one charged track, since the jets misidentified as hadronic taus tend to have associated more than one charged track. Moreover, we veto any event with electrons or bottoms, and require a stronger \(\eta \) selection than in Eq. (1), which barely affects the signal while avoiding values of \(\eta \) for which the jet missidentification rate could be higher [32]. Notice also that, since our search strategy is performed by taking the detector effects into account, the tau-leptons are only partially reconstructed via their visible (hadronic) component, with the associated neutrino contributing to the \(E_T^\text {miss}\). Nevertheless, in order to simplify the notation, we will use from now on the notation \(p_T^\tau \) to refer to the reconstructed visible momentum \(p_T^{\tau \text {-vis}}\).

After having characterized the signal, we can search for the best cuts to favor further the signal over the background. The main idea is to exploit the fact that the Higgs boson is heavy, from which it is expectable to have decay products with high momenta, peaked approximately at \(p_T^\mu \sim \) \(p_T^\tau \sim \) \(M_H/2\). This is seen in Fig. 1, where we display the profile of the distributions of the transverse momentum of the muon (left panel) and the visible hadronic-tau lepton (right panel), for three signal benchmarks (\(M_H =\) 1 TeV, 2 TeV, and 3 TeV) and the SM backgrounds, with a center-of-mass energy of \(\sqrt{s} =\) 14 TeV. The \(p_T^\mu \) distributions of all the backgroundFootnote 3 processes are concentrated on values below 400 GeV, peaked in most of the cases on the first bins of \(p_T^\mu \), whilst the distributions for the three signal benchmarks depicted here are peaked for high values of \(p_T^\mu \), following the Higgs boson mass hypothesis. It is patent then that a strong cut on the transverse muon momenta should be very helpful to increase the signal-to-background ratio, as we will discuss later. On the other hand, we cannot obtain the same conclusion from the \(p_T^\tau \) distributions, in which the signal \(p_T^\tau \) profiles do not reach values as large as the \(p_T^\mu \) ones. The reason is that the \(p_T^\tau \) is reconstructed from the visible hadronic tau but an important fraction of the total transverse tau-lepton momentum is carried by the invisible tau-decay product, the corresponding neutrino. Nevertheless, the latter will lead to an important amount of missing transverse energy, \(E_T^\text {miss}\), which can also be used to characterize our signal.

Fig. 2
figure 2

Distribution of the missing transverse energy \(E_T^\text {miss}\) (left) and \(E_T^\text {miss}/p_T^\mu \) (right) for three signal benchmarks (\(M_H =\) 1 TeV, 2 TeV, and 3 TeV) and the main reducible backgrounds \(W+\)jets and multijet, after minimal requirements in Eq. (2), for a LHC center-of-mass energy of \(\sqrt{s}=\) 14 TeV

Table 2 Definition of our analysis, which is split in three different search strategies depending on the \(M_H\) hypothesis. The cuts in each regime follow Eqs. (2) and (3)

We display the missing transverse energy in Fig. 2 for the three signal benchmarks as well as for the two reducible backgrounds. For simplicity, we show only these backgrounds as they are the dominant ones after minimum requirements of Eq. (2). We clearly see that the multijet background is peaked close to zero, as expected since it does not possess a genuine source of \(E_T^\text {miss}\). Therefore, a lower cut on the \(E_T^\text {miss}\) will be useful to suppress this background. On the other hand, in both the signal and the \(W+\)jets background there is a real source of \(E_T^\text {miss}\) from the neutrinos of the hadronic-tau leptons and the leptonic decays of \(W^\pm \) bosons. Nevertheless, these two cases can be partially decorrelated by studying the ratio \(E_T^\text {miss}/p_T^{\mu }\), as shown in the right of Fig. 2. The three signals studied here tend to lead to values smaller than one, since the only source of missing transverse momentum comes from the tau-lepton decay with \(p_T^\tau \sim p_T^\mu \). This is not necessarily the case for the \(W+\)jets background, therefore requiring that \(E_T^\text {miss} <p_T^\mu \) will help reducing it. Indeed, and more generally, what we will want to do is to look for events in which the leading particle is a muon, in a similar way to the dynamical jet veto proposed in [33].

In summary, we want to design a search strategy that selects events where the muon is the leading particle and imposes lower cuts for \(p_T^\mu \), \(p_T^\tau \) and \(E_T^\text {miss}\). As we see in Figs. 1 and 2, the heavier the Higgs boson, the stronger the cuts we could impose. In this sense, designing a strategy with very high-\(p_T\) and \(E_T^\text {miss}\) cuts would improve the sensitivities in the heavy \(M_H\) regime, however it would kill the sensitivities for lower masses. On the contrary, lowering the cuts to explore a wider range of \(M_H\) would not be as efficient as possible at high masses. And interesting compromise between the two is to design a strategy that varies the cuts according to the tested heavy mass hypothesis. Therefore, keeping that in mind, we found that the following set of kinematic cuts, on top of Eq. (2), improves the sensitivity for each hypothesis of the heavy Higgs boson mass:

$$\begin{aligned}&p_T^\mu /M_H> 0.4 \,, \quad p_T^\tau /M_H> 0.1\,, \quad E_T^\text {miss}/M_H > 0.25\,, \nonumber \\&p_T^\mu \ge p_T^\tau , p_T^{j}, E_T^{\mathrm{miss}}. \end{aligned}$$
(3)

In principle, one could apply the criteria in Eq. (3) for each hypothesis of \(M_H\), defining a dynamical set of cuts. Nevertheless, we split our search strategy in three \(M_H\) mass windows: [1, 1.5) TeV, [1.5, 2.5) TeV and [2.5, 5] TeV, denoted as low, medium and high from now on. In each of these mass windows, we use Eq. (3) with reference valuesFootnote 4 for \(M_H\) of 1, 1.5 and 2.5 TeV, respectively. We summarize the three analysis explicitly in Table 2, as well as the chosen \(M_H\) region for each case.Footnote 5

Fig. 3
figure 3

95% CL exclusion limits in the [\(M_H\), \(\sigma (pp \rightarrow H/A \rightarrow \tau \mu )\)] plane for the search strategies low (gray dashed line), medium (cyan dashed line), high (blue dashed line), and our global search strategy in the full mass range (maroon solid line), with \(\mathcal{L} =\) 36.1 fb\(^{-1}\). Dashed vertical lines indicate the mass region for each analysis, see Table 2. The dotted line is the expected exclusion for a sneutrino \(\widetilde{\nu }\rightarrow \tau \mu \) search by ATLAS at \(\mathcal{L} =\) 36.1 fb\(^{-1}\) [13]

Fig. 4
figure 4

Left: 3\(\sigma \) (blue) and 5\(\sigma \) (green) significances with \(\mathcal{L} =\) 300 fb\(^{-1}\). The shadowed contours over the lines show the effect of adding up to a 30% of systematic errors. Right: 95% exclusion limits with \(\mathcal{L} =\) 300 fb\(^{-1}\) (solid red line) and scaled, as explained in the text, to \(\mathcal{L} =\) 3000 fb\(^{-1}\) (dashed red line). Dashed vertical lines indicate the mass region for each analysis, see Table 2. The gray area is disfavored at 95% CL by the ATLAS similar search for LFV high-mass final states in the \(\widetilde{\nu }\rightarrow \tau \mu \) channel at \(\mathcal{L} =\) 36.1 fb\(^{-1}\) [13]

We show in Fig. 3 the 95% CL exclusion limits, computed as explained below, following the defined low, medium and high strategies for \(\mathcal L = 36.1~\mathrm{fb}^{-1}\). The reason to choose this integrated luminosity is also to show the sensitivity that ATLAS expected in a similar search for LFV sneutrino decays \(\widetilde{\nu }\rightarrow \tau \mu \) [13] as a qualitative reference for our strategy. Our three analysis show the above discussed behavior: the low strategy gives the best results for lower masses, however it is less efficient for higher masses. This is, to some extent, what also happens to the analysis performed by ATLAS. On the other hand, the high analysis is very efficient at high masses, improving the reach of the low analysis in one order of magnitude, nevertheless it is not competitive at lower \(M_H\). For the same reasons, the medium analysis covers more efficiently intermediate mass hypothesis. The crossings between the three analysis happen approximately at masses of 1.5 and 2.5 TeV, motivating thus our choice of \(M_H\) regions in the definition of our search strategy in Table 2. This is depicted with a maroon solid line in Fig. 3, showing that it combines the best qualities of each analysis. Consequently, from now on we will use our search strategy by mass windows to explore the future sensitivities.

As we can see from Fig. 3, for Higgs boson masses above 2.5 TeV the ATLAS analysis loses sensitivity due to a decrease in acceptance at very high \(p_T\) [13]. However, with improvements in the tau reconstruction at high \(p_T\) [34], it may be expected that the experimental limits follow a tendency similar to the one we obtain in the high mass window under the assumption that the tau reconstruction is not deteriorated for the high \(p_T\) values associated to this window.

2.3 LHC sensitivities and exclusion limits

After introducing our search analysis in the previous section, we can now compute and discuss the potential of the future LHC runs for exploring the LFV decays of heavy Higgs bosons.

Our statistical analysis is based on the tests statistic \(q_0\) and \(q_\mu \) [35]. In order to establish 95% CL exclusion limits, we consider the p-value of the \(q_\mu \) test (corresponding to the only-background hypothesis) lower than 0.05 and in terms of the significance:

$$\begin{aligned} \mathcal{S}_{\mathrm{excl}}= \sqrt{2 \left( B \log \left( \frac{B}{B+S}\right) +S\right) } \le 1.64, \end{aligned}$$
(4)

where S and B are the number of signal and background events at a given luminosity \(\mathcal {L}\). Using \(S=\sigma (pp \rightarrow H/A \rightarrow \tau \mu ) \times \mathcal {L}\), we obtain the exclusion limits on \(\sigma (pp \rightarrow H/A \rightarrow \tau \mu )\) for \(\mathcal {L}=\) 36.1 fb\(^{-1}\) showed in Fig. 3.

The evidence/discovery sensitivities are obtained from the \(q_0\) test given by

$$\begin{aligned} \mathcal{S} = \sqrt{2 \left( (B+S) \log \left( \frac{S+B}{B}\right) -S \right) }. \end{aligned}$$
(5)

The evidence (3\(\sigma \)) and discovery (5\(\sigma \)) sensitivities correspond to the constraints \(\mathcal{S} \le \) 3 and 5, respectively, and we set limits on \(\sigma (pp \rightarrow H/A \rightarrow \tau \mu )\) for a given luminosity \(\mathcal {L}\).

We display in the right panel of Fig. 4 the 95% CL exclusion limits for \(\mathcal{L} =\) 300 fb\(^{-1}\) (solid line) corresponding to our search strategy of Table 2. We separate the three mass regions (low, medium and high) using the dashed vertical lines. For the lighter Higgs boson masses, we can excluded cross sections of \(\mathcal {O}\)(1) fb but for heavier Higgs boson masses this search strategy is sensible to \(\mathcal {O}\)(0.1) fb. We assumed that the number of background events scales as the signal one, so we extrapolated our exclusion limits to \(\mathcal{L} =\) 3000 fb\(^{-1}\) (dashed line).

On the other hand, we present the evidence (blue band) and discovery (green band) sensitivities for \(\mathcal{L} =\) 300 fb\(^{-1}\) with a relative systematic uncertainty up to 30% [35] in order to give more realistic estimations with our search strategy. As heavier the Higgs boson mass hypothesis, less background events survives our search strategy, then the uncertainty band is thinner for the high mass window compared to the others. In particular, the low mass hypothesis is very constrained by the current bounds, specially taking into account the systematic uncertainties. This situation is slightly better for the medium hypothesis and, as we explained before, the best sensitivity is obtained in the high mass window.

Fig. 5
figure 5

3\(\sigma \) (blue) and 5\(\sigma \) (green) significances obtained with \(\mathcal{L} =\) 300 fb\(^{-1}\) for \(M_H=1\) TeV (upper left), 2 TeV (upper right) and 3 TeV (bottom) when the ditau channel is included as background

3 Impact of the heavy Higgs ditau channel

So far we have assumed that only the LFV process \(pp\rightarrow H/A \rightarrow \tau \mu \) contributes to the signal events in the three signal regions defined by the low, medium and high search strategies described previously. However, if the heavy Higgs bosons can decay into \(\tau \tau \), the process \(pp\rightarrow H/A \rightarrow \tau \tau \) also contributes since either of the tau-leptons could decay leptonically giving rise to a muon lepton in the final state. Given that the production cross section of H / A is common to both processes, the relative strength between the cross sections of the LFV and the lepton flavor conserving (LFC) processes will be determined by the ratio \(R\equiv \mathrm {BR}(H/A\rightarrow \tau \mu )/\mathrm {BR}(H/A\rightarrow \tau \tau )\). Now, a potential observation of the heavy Higgs bosons in the ditau channel would certainly impact on the capability of the search strategies developed in Sect. 2.2 to detect the LFV process. In order to quantify this, we have computed the evidence and discovery sensitivities to the LFV process incorporating the ditau process as an additional background. The results are depicted in Fig. 5, where we plot the \(3\sigma \) and \(5\sigma \) significances in terms of the ratio R for three benchmark masses of the low, medium and high search strategies. After imposing the cuts of Eqs. (2) and (3), the acceptances of the ditau channel with respect to the LFV channel are smaller by a factor of 0.009 (low), 0.02 (medium), and 0.009 (high).

As expected, the sensitivity worsens with decreasing values of R. More precisely, the impact of the ditau contribution becomes significant at different values of R depending on the heavy Higgs boson mass. For \(M_H=1\) TeV (low search strategy), the branching ratio of the ditau channel needs to be at least two orders of magnitude higher than the branching ratio of the LFV channel, while for \(M_H=2\) and 3 TeV (medium and high search strategies, respectively) the sensitivity already worsens when the ditau branching ratio is 50 and 10 times the LFV branching ratio, respectively. This behavior was expected, as the number of events corresponding to the SM backgrounds is reduced by approximately two orders of magnitude from the low to the high search strategy, making the latter more sensitive to the ditau contribution.

Let us now consider the impact of the ditau contribution on the exclusion limits imposed on the cross section of the LFV process \(pp\rightarrow H/A\rightarrow \tau \mu \). In general, in order to set exclusion bounds on a certain model all the contributing new-physics processes should be included in the signal, while the total background will arise exclusively from all the relevant SM processes. Therefore, when the process \(pp\rightarrow H/A\rightarrow \tau \tau \) is also possible, its contribution must be added to the signal in order to obtain the exclusion limits on the cross section of the LFV channel. The results are presented in Fig. 6. Starting from \(R\sim 10^{-2}\), a decrease of one order of magnitude in R translates into an improvement of the exclusion limit of one order of magnitude. This is due to the fact that the number of signal events associated to the ditau channel that survives the cuts becomes even more important as \(\mathrm {BR}(H/A\rightarrow \tau \tau )\) increases with respect to \(\mathrm {BR}(H/A\rightarrow \tau \mu )\). In particular, when R is lower than \(\sim 10^{-1}\), \(\mathrm {BR}(H/A\rightarrow \tau \tau )\) turns out to be at least one order of magnitude above \(\mathrm {BR}(H/A\rightarrow \tau \mu )\), which tends to compensate the smaller acceptance of the LFC channel, thus pushing the exclusion limits to smaller values of \(\sigma \times \mathrm {BR}(H/A\rightarrow \tau \mu )\). More precisely, for both \(M_H=1\) and 3 TeV the improvement becomes important at \(R\sim 10^{-2}\), while \(R\sim 10^{-1}\) is enough in the case of \(M_H=2\) TeV due to the fact that the medium search strategy is the one with the highest acceptance for the ditau channel. From this discussion, we conclude that the derived bounds on the LFV process could be more stringent for models in which the heavy Higgs bosons can decay into both \(\tau \mu \) and \(\tau \tau \) channels than for models where only the LFV decay is present.

Fig. 6
figure 6

95% exclusion limits on the cross section of the LFV process \(pp\rightarrow H/A\rightarrow \tau \mu \) when the LFC decay \(H/A\rightarrow \tau \tau \) is available. The three contours are obtained for \(\mathcal{L} =\) 300 fb\(^{-1}\) and correspond to \(M_H=1\) TeV (blue), 2 TeV (orange) and 3 TeV (green)

4 Conclusions

In this work we have developed a search strategy at the LHC for heavy Higgs bosons decaying into a tau and a muon leptons, which shows a plausible improvement in the sensitivities of the current experimental bounds. We have worked in a model-independent way with generic lepton-flavor-violating effective interactions for the heavy Higgs bosons. Our signal process corresponds to \(pp\rightarrow H/A \rightarrow \tau \mu \) produced via gluon fusion as the dominant channel but we have also found similar results considering instead the \(b\bar{b}\) annihilation as the dominant production mechanism.

We optimized the search in three Higgs boson mass windows within the range 1–5 TeV, exploiting the high transverse momenta of the final charged leptons and the missing transverse energy in order to maximize the significances at \(\sqrt{s}\) = 14 TeV with \(\mathcal {L}\) = 300 fb\(^{-1}\). We have found promising improvements in the present experimental sensitivities for masses above 2.5 TeV, even when the systematic uncertainties are included in the analysis.

Fig. 7
figure 7

Distribution of \(p_T^\mu \) and \(E^{\mathrm {miss}}_T\) in multijet events after applying the requirements in Eq. (1). We show the individual contributions of each of the six \(H_{T2}\) bins (dashed lines) as well as the final distribution obtained by combining all of them (black solid line)

Finally, we have discussed the role of the \(H/A\rightarrow \tau \tau \) decay channel in the LFV searches, exploring its impact on the discovery potential and the exclusion limits. We have found that sizable effects start to appear when the BR (\(H/A\rightarrow \tau \tau \)) is approximately ten times larger than the BR (\(H/A\rightarrow \tau \mu \)). In particular, the excluded regions for the LFV process become more stringent when both decay channels are present.