1 Introduction

After the discovery of a Higgs boson with a mass around 125 GeV [1, 2] the searches for new scalars have intensified and expanded into more and more search signatures. Evidence for the existence of additional neutral and/or electrically charged Higgs bosons would be an unambiguous sign of physics beyond the Standard Model (BSM), where the SM scalar sector is extended by new scalar field(s). These fields could be singlets, doublets or even higher representations of the electroweak gauge group \(\text {SU}(2)_L\). Well-known examples of such extensions are the real or complex scalar singlet extension [3,4,5,6], featuring one or two additional neutral scalar bosons, respectively, and the Two-Higgs-Doublet Model (2HDM) [7,8,9], which contains three neutral Higgs bosons – typically denoted hH and A in the CP-conserving case – and a pair of charged Higgs bosons, \(H^\pm \). The Higgs sector of the Minimal Supersymmetric Standard Model (MSSM), for instance, is at the tree-level a specific version of a 2HDM [10,11,12]. Examples of BSM Models containing both additional scalar doublets and singlets are the Next-to-2HDM [13, 14] and the Next-to-MSSM [15, 16], while higher representations of scalars are considered e.g. in the Georgi-Machacek model [17].

Since – so far – no additional Higgs bosons have been discovered at the LHC all of these searches have resulted in exclusion limits that constrain the possible parameter space of BSM theories with extended Higgs sectors. Due to the large number of results in many different search channels, the task of testing BSM model predictions against the assembled results from Higgs searches warrants dedicated tools. The tool HiggsBounds [18,19,20,21] has been developed to perform such a check against all available Higgs searches from LEP, the Tevatron, and the LHC. This paper presents the upgrades to the code in HiggsBounds-5 compared to the previous version HiggsBounds-4 described in Ref. [20] and discusses the most important new features.

The general approach of HiggsBounds remains unchanged compared to HiggsBounds-4 and we refer to Ref. [20] for the details. For each Higgs boson of the investigated model, based on the model predictions input by the user, HiggsBounds selects the most sensitive limit by comparing the model predictions to the expected limits of all analyses. It then checks the observed limit of this selected analysis against the model predictions to obtain a bound for each Higgs boson. The model parameter point is considered allowed if none of the Higgs bosons are excluded by the corresponding selected analysis. All of the individual limits implemented in HiggsBounds are exclusion limits at \(95\%\) confidence level (C.L.). This procedure ensures that the overall combined limit is still approximately at the \({95}{\%}~\text {C.L.}\)Footnote 1 Likelihood information has been made available by the experimental collaborations for several analyses at LEP and at the LHC. HiggsBounds utilizes this detailed input to reconstruct the corresponding \({95}{\%}~\text {C.L.}\) limit in a nearly model-independent fashion or, optionally, return the corresponding \(\chi ^2\) that can be used in a model fit.

In light of the increasing number of experimental search channels with improved sensitivity one of the most important aspects of HiggsBounds is to provide an input framework that works for a large class of BSM models and can incorporate all of the required model predictions. Most of the major changes in HiggsBounds-5 relate to improvements in the input framework – such as allowing additional cross sections and branching ratios to be set as input or providing precise, model-independent parametrizations of required input quantities. The extended input framework is also used by the code HiggsSignals-2 [22,23,24] which tests BSM models against the Higgs rate measurements at the LHC (and the Tevatron).

In Sect. 2 we describe the extended HiggsBounds input framework in detail, discussing the available input schemes and the production and decay channels supported by HiggsBounds-5. This includes the possibility of providing input beyond the narrow width approximation as detailed in Sect. 2.3. In Sect. 3 we review the experimental input used by HiggsBounds and consider possible improvements to the input presentation that could make the experimental results more readily useable. Section 4 discusses functional changes in HiggsBounds-5. This includes parametrizations of VH and charged Higgs production cross sections in the effective coupling approximation, as well as a description of improvements in the derivation of exclusion limits from the available likelihood information compared to the method first discussed in Ref. [21]. We give an overview of the technical changes relevant to users of the code in Sect. 5 and conclude in Sect. 6.

Table 1 Hadronic cross section input for neutral Higgs bosons. The cross sections are inclusive in the electric charges of the produced particles. Quantities added in HiggsBounds-5 are labeled as (NEW)

2 Theoretical input

The input for HiggsBounds consists of the phenomenologically relevant physical quantities of the Higgs sector, i.e. the number of neutral and charged Higgs bosons that should be considered, their masses, total decay widths, production and decay rates. By relying only on these physical quantities (in contrast to model-specific parameters), the code maintains a flexible input framework with rather minimal model assumptions.

HiggsBounds-5 supports three types of input specified in the variable whichinput when initialising the code. These are the hadronic cross section input (whichinput = ’hadr’), the effective coupling input (whichinput = ’effC’), and SLHA (SUSY Les Houches Accord [25, 26]) input (whichinput = ’SLHA’). The partonic input mode (whichinput = ’part’) present in previous versions of HiggsBounds has been removed and is no longer supported. We describe the available methods of providing input to HiggsBounds in more detail in Sect. 5.

For whichinput = ’hadr’ the inclusive hadronicFootnote 2 production cross sections have to be provided to the code. Cross sections for various colliders and center-of-mass (CM) energies are required – namely LEP, Tevatron, and the LHC at 7, 8 and 13 TeV. If the considered production mode also exists in the SM, the input cross section is normalized to the corresponding SM prediction for the same Higgs mass, and otherwise specified in picobarn ( pb). In effC and SLHA input the hadronic cross sections are calculated internally from the provided effective couplings whenever possible. The branching ratios (BRs) for all Higgs boson decays are also required as input. In effC mode the BRs for decay modes to SM particles are per default approximated from the provided effective couplings, and only the BRs for Higgs decay modes that are not present for a SM Higgs boson have to be specified explicitly. In contrast, in SLHA input, the BRs for all decay modes are directly taken from the SLHA DECAY blocks.

2.1 Neutral Higgs bosons

The quantities needed to describe the production and decay rates of neutral Higgs bosons are listed in Tables 1, 2 and 3. The hadronic cross sections in Table 1 have been extended by separate input for gluon fusion and \(b\bar{b}\) associated Higgs production, whereas HiggsBounds-4 only required the sum of the two processes (denoted as single Higgs production). This is particularly relevant for exclusion limits from analyses that have specific requirements on the b-jet multiplicity in the event, as is e.g. the case in searches for heavy BSM Higgs bosons decaying to \(\tau ^+\tau ^-\) (see also Sect. 4.3). Furthermore, the cross sections for processes of Higgs production in association with a single top quark have been added. We distinguish between the t-channel process \(q b\rightarrow t q h_j\) (specified in the 5-flavor scheme) and the s-channel process \(qq' \rightarrow tbh_j\) (see Ref. [27] for a comprehensive discussion and for the NLO QCD predictions in the SM). Similarly, separate cross sections for gluon- and quark-initiated Z-boson associated Higgs production have been added to the HiggsBounds input. These involve different Higgs couplings (see Sect. 4.1) and are partly separated in the simplified template cross section (STXS) measurements that are newly included in HiggsSignals-2 (see Ref. [24]). Since HiggsBounds handles the input for HiggsSignals, this also means that this subchannel information is available, such that differential information can be incorporated if it becomes available in a framework similar to the STXS. Finally, the non-resonant double Higgs production cross section has been added as input. Note that it is not normalized to the SM prediction but should instead be given in  pb.

The cross section input for LEP is unchanged with respect to HiggsBounds-4. For completeness, these quantities are listed in Table 2.

Table 2 LEP cross section input for neutral Higgs bosons. These are unchanged with respect to HiggsBounds-4

The branching ratio input for the decays of neutral Higgs bosons to SM particles has been extended by Higgs decays into top quarks and flavor-changing leptonic Higgs decays, see Table 3. Furthermore, we have generalized the BR array for neutral Higgs boson decays to two neutral Higgs bosons, \(h_k \rightarrow h_j h_i\), to allow for different Higgs bosons in the final states (\(h_j \ne h_i\)), and added input BR arrays for neutral Higgs boson decays to a neutral Higgs boson and a Z boson, \(h_j \rightarrow h_i Z\), and neutral Higgs boson decays to a charged Higgs boson and a W boson, \(h_i \rightarrow H_i^\pm W^{\mp }\).

Table 3 Branching ratios for neutral Higgs bosons. Possible decay modes for a SM-like Higgs bosons are on the left and decays involving new physics or flavor violation on the right. Quantities added in HiggsBounds-5 are labeled as (NEW)

Instead of giving the hadronic and leptonic Higgs production cross sections and branching fractions directly, HiggsBounds also features an effective coupling (or scale factor) approximation for all these quantities. In case this approximation is employed, the effective couplings listed in Table 4 have to be provided. With respect to HiggsBounds-4 we have changed the entire input from squared effective couplings (or scale factors) to the sign-sensitive single effective couplings (or scale factors). This allows us to take into account interference effects e.g. in the prediction for the \(h_j Z\) production cross section. Furthermore, we removed the effective (squared) \(h_j ggZ\) coupling present in earlier versions. Instead, the \(gg\rightarrow h_j Z\) contribution is derived from the \(h_j tt\) and \(h_j bb\) effective couplings. Note that the loop-induced \(h_j gg\), \(h_j \gamma \gamma \) and \(h_j\gamma Z\) couplings are still free input quantities not derived from the other coupling parameters.

Table 4 Effective Higgs couplings for neutral Higgs bosons. The fermionic couplings have a CP-even scalar (_s) and a CP-odd pseudoscalar (_p) part. All of these are (NEW) as they are now non-squared and sign-sensitive

The scalar and pseudoscalar components of the Higgs couplings to a generic fermion pair \(f\bar{f}\) are defined through

$$\begin{aligned} g_{h_jf\bar{f}} = {i}\left( g_{s,\,h_jf\bar{f}} + g_{p,\,h_jf\bar{f}} \gamma _5\right) \,, \end{aligned}$$
(1)

where \(g_s\) and \(g_p\) are the real-valued scalar and pseudoscalar coupling constants. As effective couplings, they are both normalized to the SM value of \(g_s\) for the corresponding fermion given by

$$\begin{aligned} g_s^\text {ref}=g^\text {SM}_{hf\bar{f}}= \frac{e m_f}{2\sin \theta _\text {w}M_W}, \end{aligned}$$
(2)

with electric charge e, the weak mixing angle \(\theta _\text {w}\), fermion mass \(m_f\) and the W-boson mass \(M_W\). The couplings to W and Z bosons are normalized to the corresponding SM tree-level couplings

$$\begin{aligned} g^\text {SM}_{hZZ} = \frac{e M_Z^2}{\sin \theta _\text {w}M_W}\,,\quad g^\text {SM}_{hWW} = \frac{e M_W}{\sin \theta _\text {w}}\,, \end{aligned}$$
(3)

where \(M_Z\) is the mass of the Z-boson. The loop-induced effective couplings to \(\gamma \gamma \) and \(Z\gamma \) are best defined through the partial decay widths normalized to the SM-value for the same Higgs mass. This can also be used for the gg effective coupling, however it is a better approximation in this case to use the normalized gluon fusion production cross section. Either way, these yield the squared effective coupling whose square-root is the input expected by HiggsBounds-5. The sign of these loop-induced couplings does not enter any observables, so the positive square root can be used without loss of generality.

Finally, the \(h_jh_iZ\) coupling does not have a SM equivalent that could be used for normalization. It is instead normalized to

$$\begin{aligned} g_{hh'Z}^\text {ref}=\frac{e}{2\sin \theta _\text {w}\cos \theta _\text {w}}\,. \end{aligned}$$
(4)

More details on the effective coupling input and how it is used to approximate the hadronic cross sections can be found in Ref. [20].

2.2 Charged Higgs bosons

The HiggsBounds input framework has been broadly extended in the charged Higgs sector. We list all relevant charged Higgs sector quantities in Table 5. HiggsBounds-5 supports direct charged Higgs boson production at hadron colliders, including \(H^\pm _j\) production in association with a top or charm quark and a bottom quark as well as flavor-suppressed production in association with lighter quark jets. We also include charged Higgs production in association with a vector boson or a neutral Higgs boson, as well as charged Higgs boson production in vector boson fusion and charged Higgs pair production. Note that all hadronic cross sections are directly given in pb, and not specified as normalized quantities. All input cross sections are required to be summed over the two possible charges. Note that at present there is no effective coupling input for the charged Higgs bosons.

For light charged Higgs bosons with mass below the top quark mass, the most important search channel is top quark pair production with successive decay of one top quark to a charged Higgs boson and a bottom quark. HiggsBounds thus also requires the branching fractions for \(t\rightarrow H^+_j b\) and \(t \rightarrow W^+ b\) – where the latter is needed to check for model assumptions – as input. The charged Higgs branching fractions have been extended by the decays to top and bottom quarks, W and Z bosons, as well as neutral Higgs and W bosons.

Note that, thus far,Footnote 3 LHC searches have only considered \(pp\rightarrow H^\pm t b\) and \(H^\pm \) production in vector boson fusion as direct production channels. The remaining cross sections listed in the upper section in Table 5 are therefore only placeholders at the moment, and setting them to zero in a HiggsBounds run will not affect the results until relevant experimental results become available.

Table 5 Hadronic charged Higgs boson production cross sections (in pb), top quark branching ratios, and branching ratios for charged Higgs bosons. For the production cross sections the input has to be given for the sum of \(H^+\) and \(H^-\) production. Quantities added in HiggsBounds-5 are labeled as (NEW)

2.3 Input beyond the narrow width approximation

All of the input schemes described above rely on the narrow width approximation (NWA) to construct the signal rates in specific collider channels from the provided cross sections and branching ratios. As such, in the NWA the channel rate \(r^{p,d}\) is given by

$$\begin{aligned} r^{p,d}\approx \sigma ^p \cdot \text {BR}^d\,,\end{aligned}$$
(5)

where p denotes the production and d the decay mode of the channel. In cases where the NWA is not applicable, the hadron collider channel rates \(r^{p,d}\) for neutral Higgs bosons can be specified directly by the user, which then replace the corresponding values obtained from the NWA. In this way, individual channel rates can be set while keeping the remaining HiggsBounds input unchanged. For instance, this is relevant if one of the neutral Higgs bosons of the model has a very large width, while the narrow width approximation is applicable for the remaining particles. Non-trivial modifications through signal–signal or signal–background interference can also be accounted for by explicitly setting the channel rate. For instance, destructive signal-signal interference of two heavy Higgs bosons can appear in the MSSM with CP-violation [28], leading to sizable differences in the exclusion obtained from BSM Higgs-to-\(\tau ^+\tau ^-\) searches, as compared to the naive, incoherent combination of the individual Higgs boson signal rates (see e.g. the discussion in [29]).Footnote 4

Note that there is currently no way to specify channel rates for charged Higgs processes. Channel rates can be input using the Fortran subroutine interface (using the subroutine HiggsBounds_neutral_input_hadr_channelrates or, for a single process, the subroutine HiggsBounds_neutral_input_hadr_channelrates_single), see the online documentation for details. These subroutines expect the channel rates to be normalized as \(r^{p,d}/\sigma _\text {SM}^p\) where \(\sigma _\text {SM}^p\) is the corresponding production cross section for a SM-like Higgs boson of the same mass. The HBwithchannelrates example programs illustrates the use of explicitly set channel rates.

Besides accounting for width effects in the theoretical input for the channel rates, the experimental limits in various search channels are often provided as a function of the total decay width. In that case, this width-dependence of the limit is fully implemented in HiggsBounds-5 and accounted for in the model testing, irrespectively of whether the NWA was employed or the channel rates have been set directly by the user.

3 Experimental input

In this section we describe the experimental results that are used by HiggsBounds , and we address possible limitations of the application of Higgs search limits to a model. In this context we discuss how search limits (at fixed confidence level (C.L.) or as a likelihood) should be presented, in particular how they should be parametrized and what information is required in order to apply an experimental limit to (nearly) arbitrary Higgs models. Finally, we make suggestions for possible future refinements in the presentation of experimental limits.

3.1 Experimental data in HiggsBounds and limitations of applicability

HiggsBounds currently incorporates results from LEP [30,31,32,33,34,35,36,37,38,39,40,41,42,43,44], the Tevatron [45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79], and the ATLAS [2, 80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95,96,97,98,99,100,101,102,103,104,105,106,107,108,109,110,111,112,113,114,115,116,117,118,119,120,121,122,123,124,125,126,127,128,129,130,131,132,133,134,135,136,137,138,139,140,141,142,143,144,145] and CMS [146,147,148,149,150,151,152,153,154,155,156,157,158,159,160,161,162,163,164,165,166,167,168,169,170,171,172,173,174,175,176,177,178,179,180,181,182,183,184,185,186,187,188,189,190,191,192,193,194,195,196,197,198,199,200,201,202,203,204,205,206,207,208,209,210,211,212,213,214] experiments at the LHC. A detailed list of the implemented analyses is returned by the AllAnalyses executable (see Sect. 5.2). An up-to-date version of this list, together with a bibliography of all implemented results is also available on the webpage, and the InspireHEP cite keys of the analyses are included in the HiggsBounds output (in the Keys.dat file). We expect all users of HiggsBounds to cite the relevant experimental analyses.

The application of the experimental exclusion limits to a model parameter point is described in detail in Ref. [20]. The basic procedure is as follows: In the first step, based on the expected exclusion limit (at \({95}{\%}~\text {C.L.}\)), HiggsBounds selects the most sensitive analysis for each Higgs boson of the model. In the second step, the model predictions for each Higgs boson are compared with the observed limit from the particular experimental search that is most sensitive to it. In both steps, per default, the signal rates of Higgs bosons with similar masses are added incoherentlyFootnote 5 if their mass difference is less than the mass resolution of the experimental search. If the predicted signal rate exceeds the observed limit for any of the Higgs bosons, the model parameter point is regarded as excluded (at \({95}{\%}~\text {C.L.}\)). The validity of this test depends, in short, on the following basic assumptions (see Ref. [20] for details):

  • the narrow width approximation is valid, i.e. the signal rate can be approximated by the product of the Higgs boson production cross section and branching ratio;Footnote 6

  • background processes in the experimental analyses are not altered significantly by the signal (new physics) model;

  • the kinematics of the signal processes are not altered significantly with respect to the signal hypothesis employed in the experimental analysis (typically, a scalar or pseudoscalar boson with renormalizable couplings).

Furthermore, there are experimental analyses that combine different Higgs boson search channels. Such combined limits may require an applicability test, i.e. a check whether the parameter point fulfills the assumptions on which the combination is based. If this applicability test fails, the corresponding search limit is not considered in the HiggsBounds test of the parameter point. Examples of such analyses are searches for a SM-like Higgs boson or an invisibly decaying Higgs boson, where various production modes are combined under the assumption of a signal composition as predicted in the SM. If no further information on the signal efficiencies is given (see below), the application of these search limits to a model requires a SM-likeness test of the parameter point (see Ref. [20] for details). In short, this test checks whether the model-predicted signal composition is similar to the SM prediction, where all relevant search channels quoted in the analysis are taken into account, and their inclusive cross sections are used as weights in the determination of the maximally allowed deviation of the individual channel signal strength from the total signal strength. The details of the SM-likeness test procedure are described in Ref. [20] and have not been changed in HiggsBounds-5. After the LHC discovery of a SM-like Higgs boson, the focus of Higgs searches has somewhat shifted towards more model-independent, less combined search channels. Nevertheless, there are still many searches that combine different production or decay modes, assuming the relative contributions to be equal to those predicted in the SM, as e.g. motivated by predictions in pure scalar singlet extensions of the SM with a non-zero singlet-doublet mixing (see e.g. Refs. [215,216,217,218,219,220,221,222] for phenomenological studies in the LHC Run-2 era).

The SM-likeness test would not be needed if more information was provided publicly for the considered experimental analysis. The limit is typically reported on an inclusive cross section, \(\sigma _\text {tot}\), often also as signal strength, \(\mu \), i.e. normalized to the corresponding SM prediction.Footnote 7 For a combination of search channels \(i=1,\dots ,N\), this signal strength can be calculated as

$$\begin{aligned} \mu = \frac{\sum _i \epsilon _i \sigma _i}{\sum _i \epsilon _i^\text {SM} \sigma _i^\text {SM}}, \end{aligned}$$
(6)

where \(\sigma _i\) (\(\sigma _i^\text {SM}\)) denotes the inclusive signal rate for search channel i – comprised of one production and one decay mode – in the model (SM), respectively, and \(\epsilon _i\) (\(\epsilon _i^\text {SM}\)) is the signal efficiency of channel i in the analysis, i.e. the fraction of signal events that pass the event selection, as predicted in the model (SM). If the three basic assumptions listed in the bullet points above are fulfilled, we have – to a good approximation – \(\epsilon _i = \epsilon _i^\text {SM}\). A complication arises, however, if the experimental analysis does not provide information of the signal efficiencies of the involved signal channels as predicted in the SM, \(\epsilon _i^\text {SM}\). Unfortunately, it has been common practice to not release this information until now.Footnote 8 If the \(\epsilon _i^\text {SM}\) are unknown, we can only safely calculate \(\mu \) in the model if \(\sigma _i/\sigma _i^\text {SM} \approx \mu \) for all channels \(i=1,\dots , N\), and this is exactly what the SM-likeness test in HiggsBounds verifies.

Besides the usual \({95}{\%}~\text {C.L.}\) limits, HiggsBounds contains additional exclusion likelihood approximations for several cases. These are available for the main Higgs boson search channels as well as the SM and MSSM Higgs boson search combinations at LEP [20, 41]. Moreover, HiggsBounds reconstructs the exclusion likelihood from BSM Higgs boson searches in the \(\tau ^+\tau ^-\) final state by ATLAS [127, 223] and CMS [164, 196], based on the numerical results presented in a single narrow resonance parametrization with two production modes. More details will be given in Sect. 4.3.

3.2 Recommendations for the presentation of future search results

Recently, a joint effort within the experimental and theoretical community led to the release of recommendations for the presentation of experimental results [224]. Following and partly expanding upon these recommendations, we propose the following guidelines for the publication of limits for LHC searches for new scalar bosons:

  1. 1.

    upper limits on the cross sections of the signal processes should be presented as a function of all relevant kinematical parameters, e.g. the masses and total widths of the involved scalar boson(s);

  2. 2.

    the search results should always contain the expected and the observed limit;

  3. 3.

    if the signal is comprised of several signal channels (i.e. different production and/or decay modes), the limit is set on a common scale factor – the signal strength \(\mu \) – or a total signal rate. In this case, the signal efficiency of each signal channel should be provided as a function of all relevant kinematical parameters (see point 1);

  4. 4.

    if the limit is presented as a normalized signal rate (e.g. to the SM prediction), the reference signal rate should be quoted by the experimental analysis along with the result, thus enabling the recalculation of the limit on the signal rate’s absolute value;

  5. 5.

    the search limit should always be presented at \({95}{\%}~\text {C.L.}\);

  6. 6.

    in addition, it would be beneficial to present results as exclusion likelihoods, using the same parametrization as the one used for the \({95}{\%}~\text {C.L.}\) upper limit (see point 1).

Table 6 A wishlist for the publication of exclusion likelihoods in several Higgs search channels. The left column denotes the search channel, the middle column the possible relevant parameters (quantities in square brackets seem less important), and the right column lists examples of BSM models for which the result would be valuable

These guidelines should result in a format of the search limit that is to a large extent model-independent, in the sense that all dependences on kinematic parameters are fully described and can thus be incorporated in a recast of the limit onto specific models. Presenting both the expected and observed result enables a well-defined selection of the most sensitive analysis out of many search results – as already done in HiggsBounds– such that the derived global exclusion result can be interpreted at the \({95}{\%}~\text {C.L.}\). As already mentioned in the previous subsection, quoting the signal efficiencies is necessary for the proper determination of the signal strength in the model if several signal channels are involved in the signal process, and would be a better alternative to the SM-likeness test that needs to be applied otherwise.

As already mentioned, the BSM Higgs searches in the \(\tau ^+\tau ^-\) final state by CMS [164, 196] and ATLAS [127, 223] pioneered the publication of (multi-dimensional) exclusion likelihoods in addition to the usual \({95}{\%}~\text {C.L.}\) upper limits at the LHC. These likelihoods were presented for a simplified model of a single narrow scalar resonance \(\phi \), parametrized in terms of its mass, \(m_\phi \), the signal rate for single scalar production, \(\sigma (pp\rightarrow \phi \rightarrow \tau ^+\tau ^-)\), and the signal rate for scalar production in association with bottom-quarks, \(\sigma (pp\rightarrow b\bar{b}\phi \rightarrow \tau ^+\tau ^-)\) (see Sect. 4.3 for details). This likelihood information has already turned out to be very useful in various phenomenological analyses (see e.g. Refs. [225,226,227,228]). Therefore, we strongly encourage the publication of exclusion likelihoods (in a similar form) also for other BSM Higgs search channels. We list in Table 6 a set of search channels, along with the relevant kinematic and signal rate parameters, which we deem suitable for providing this public information.

The table furthermore lists some model candidates for which these search results would be useful. In particular, fermionic final states are most relevant in models with additional Higgs doublets such as the MSSM or the 2HDM, where the couplings of \(\phi \) to fermions can be large even in the alignment limit where the 125 GeV Higgs boson, denoted as \(h_{125}\), has SM-like couplings [8, 225, 229,230,231,232,233,234,235]. On the other hand, the highly sensitive VV final states are very important for singlet extensions, where the production rates of additional BSM Higgs boson(s) are mixing-suppressed when requiring \(h_{125}\) to be approximately SM-like, see e.g. Refs. [215, 216, 222] for recent discussions of the impact of these searches on the model parameter space. The \(pp\rightarrow \phi _2\rightarrow Z\phi _1\) process (\(\phi _{1,2}\ne h_{125}\)) is of particular interest in 2HDMs, where it is correlated with a strong first order electroweak phase transition (see e.g. Refs. [236,237,238]). Resonant di-Higgs signatures are especially prominent in singlet extensions, where the coupling of the non-\(h_{125}\) scalars to all SM particles are suppressed. In non-minimal singlet extensions even resonant di-Higgs processes involving two additional scalars and \(h_{125}\) are well motivated [222]. Searches for charged Higgs bosons can also be highly complementary to neutral Higgs searches if additional scalar doublets are present in the model. Note that this table is neither complete, nor does it give a ranking in priority. Providing likelihood information along with the usual \({95}{\%}~\text {C.L.}\) limits is useful in any analysis, and should be done if feasible.

We also appreciate the efforts of using simplified workspaces provided by the experimental collaborations. In this approach it might be possible to retain the dominant theory nuisance parameters in the likelihood, while all experimental nuisance parameters that are not correlated with the dominant theory nuisance parameters are marginalized. Extensive tests would be necessary to explore the feasibility of this approach and the potential gain in information and precision over the current approach. A simplified approach based on the JSON format [239] has been proposed where only the most relevant theoretical (and, if necessary, experimental) systematic uncertainties are retained separately, and all other uncertainties are combined.

BSM Higgs boson searches at the LHC have so far considered inclusive signal processes, or, at least, have presented the result as a limit on the inclusive cross section. In the future a possible new path in the presentation of search results could be the presentation of limits on signal rates in specific phase space regions – so-called fiducial signal rates – instead of unfolding the result onto the inclusive signal rate. This is analogous to measurements of the discovered Higgs boson’s signal rates, where strong efforts have recently been made to define specific phase-space regions for measurements in order to reduce the theory-dependence introduced in the unfolding process. In a similar way, one could think of a generalization of the simplified template cross section (STXS) framework [240] to the case of search limits. As HiggsBounds is used as a framework for HiggsSignals, which already incorporates STXS measurements of the Higgs boson signal, it would be straight-forward to implement corresponding phase-space-dependent limits also in HiggsBounds.

Lastly, it would be desirable in the future to improve and automize the implementation of experimental search results in HiggsBounds. The first step is that the experimental collaborations provide search limits in a machine-readable format, e.g. via their TWiki pages or via HEPData [241]. This is already done in many cases. As a next step, it would be useful to define a common data format that contains all necessary information about the search limit. Such data files can then be read in automatically by HiggsBounds. Such a data interface would also allow the HiggsBounds user to select specific search limits for their study in a very versatile way.

4 New features in HiggsBounds-5

The most important improvement in HiggsBounds-5 over its predecessor HiggsBounds-4 is the inclusion of experimental results from the 13 TeV LHC. However, we will not discuss the newly implemented search limits in detail. Instead, we refer to the output of the AllAnalyses executable (see Sect. 5.2) to get a complete list of the experimental results included in a specific version of HiggsBounds. Instead, this section will describe the most relevant functional changes within HiggsBounds-5.

4.1 Effective coupling approximation for \({\phi }_i\) V production

In previous versions of HiggsBounds the cross section ratios for neutral Higgs boson (\(\phi \)) production in association with a massive gauge boson, \(pp/p\bar{p} \rightarrow V\phi \) (with \(V=W^\pm ,Z\)), were obtained in the effective coupling approximation purely from the effective \(\phi VV\) coupling. In HiggsBounds-5 we have extended this approximation beyond the leading order by including contributions proportional to the scalar and pseudo-scalar Higgs couplings to top and bottom quarks, as well as interference effects.

The production of a neutral scalar boson \(\phi \) in association with W-bosons always (up to next-to-leading order in QCD) takes place via Higgs-strahlung and is necessarily dependent on the coupling \(g_{\phi WW}\) of the respective particle to the W bosons. At next-to-next-to-leading order (NNLO) in QCD, corrections from virtual top-quark loops arise which depend on the scalar coupling to top-quarks, \(g_{s,\,\phi t\bar{t}}\). In case of \(Z\phi \) production, additional important box-diagrams from the partonic process \(g g \rightarrow Z\phi \) need to be accounted for.

In terms of the effective couplings for a scalar particle \(\phi \), Eq. (1) and Eq. (3), we define

$$\begin{aligned} \kappa _W:= & {} \left( \frac{g_{\phi WW}}{g_{HWW}^{\text {SM}}} \right) , \quad \kappa _Z := \left( \frac{g_{\phi ZZ}}{g_{HZZ}^{\text {SM}}} \right) , \nonumber \\ \kappa _t:= & {} \left( \frac{g_{s,\,\phi t\bar{t}}}{g_{Ht\bar{t}}^{\text {SM}}} \right) , \quad \kappa _b \quad := \left( \frac{g_{s,\,\phi b\bar{b}}}{g_{Hb\bar{b}}^{\text {SM}}} \right) , \nonumber \\ \kappa _{\tilde{t}}:= & {} \left( \frac{g_{p,\,\phi t\bar{t}}}{g_{Ht\bar{t}}^{\text {SM}}} \right) , \quad \kappa _{\tilde{b}} := \left( \frac{g_{p,\,\phi b\bar{b}}}{g_{Hb\bar{b}}^{\text {SM}}} \right) \,.\end{aligned}$$
(7)

The cross sections can been expanded as follows:

$$\begin{aligned} \sigma ^{W\phi }[m_{\phi }]&\approx \kappa _W^2 {\bar{\sigma }}^{ W\phi }_{WW}[m_{\phi }] + 2 \kappa _W \kappa _t {\bar{\sigma }}^{W\phi }_{W t}[m_{\phi }], \end{aligned}$$
(8)
(9)

Note that \(W\phi \) production is largely dominated by the leading-order Higgs-strahlung process and only gets minor corrections from virtual top-quark loops. This is why the effect of bottom quarks has been neglected and only the \(\kappa _W \kappa _t\) interference term is considered in Eq. (8). In contrast, for \(Z\phi \) production all possible combinations \(\kappa _a \kappa _b\) have been included. For this expansion we neglect the effects from other possible scalar bosons in the model that may contribute due to non-vanishing \(\phi \phi ' Z\) couplings. If these contributions turn out to be relevant in the investigated model, we advise the user to directly provide the hadronic cross sections instead of using the effective coupling approximation.

We calculate the inclusive \(W \phi \) and \(Z \phi \) production cross sections with VH@NNLO-2.0  [242, 243] at NNLO in QCD. The mass-dependent expansion coefficients \({{\bar{\sigma }}}^{V\phi }_{ab}[m_{\phi }]\) are determined by using the CP-violating 2HDM implementation of VH@NNLO to calculate various cross sections for different combinations of the effective couplings and solving the resulting system of linear equations. They are symmetric under \(a \leftrightarrow b\).

VH@NNLO does not evaluate contributions from \(b {\bar{b}} \rightarrow Z\phi \) for CP-mixed scalars which could lead to sizable differences in scenarios with large \(\kappa _{{\tilde{b}}}\). However, within our approximation \(g_{\phi \phi 'Z} = 0\) at tree-level

$$\begin{aligned} \frac{\sigma (b {\bar{b}} \rightarrow H Z)}{\kappa _b^2} = \frac{\sigma (b {\bar{b}} \rightarrow A Z)}{\kappa _{{\tilde{b}}}^2} \end{aligned}$$
(10)

holds for a pure CP-even scalar H and CP-odd scalar A with respective effective couplings \(\kappa _b\) and \(\kappa _{\tilde{b}}\) (and equal masses). We therefore use the VH@NNLO SM Higgs boson implementation to determine the \(b {\bar{b}} \rightarrow H Z\) contribution, and consider it for both the \({\bar{\sigma }}^{Z\phi }_{bb}\) and \({\bar{\sigma }}^{Z\phi }_{{\tilde{b}} {\tilde{b}}}\) term in Eq. (9).

The cross section calculation for a pure CP-even scalar particle H in VH@NNLO is more precise than the calculation for a CP-mixed scalar boson \(\phi \). For a SM-like CP-even Higgs boson Eq. (9) therefore produces a less accurate result than the dedicated calculation for a pure CP-even scalar boson in VH@NNLO. To circumvent this problem, we apply a K-factor approach and rescale the cross section for the CP-mixed scalar \(\phi \) by the ratio of the more accurate CP-even calculation \(\sigma ^{ZH}\) and the scalar terms of the CP-mixed calculation \(\sigma ^{\phi Z}\), i.e. 

(11)

with

(12)

The definition in Eq. (11) ensures that for a pure scalar, i.e. for \(\kappa _{{\tilde{t}}} = \kappa _{{\tilde{b}}} = 0\), our approximation coincides with the more accurate SM-like Higgs boson calculation in VH@NNLO. For a SM-like Higgs boson with all \(\kappa _i = 1\), the K-factor in Eq. (12) ranges between 1 and 2, with values larger than 1.1 only appearing for \(m_\phi \gtrsim {400}{\,\mathrm{GeV}}\). For gauge-phobic particles with \(\kappa _Z=0\), K is typically of the order of 2 and can range up to 5 for masses below 10 GeV.

Fig. 1
figure 1

Cross section contributions of Eq. (8) as a function of \(m_\phi \) for the process \(pp\rightarrow W\phi \) at the LHC with a CM energy of \({13}{\,\mathrm{TeV}}\). The dotted black line indicates the sum of the individual contributions

Fig. 2
figure 2

Cross section contributions of Eq. (9) as a function of \(m_\phi \) for the process \(pp\rightarrow Z\phi \) at the LHC with a CM energy of \({13}{\,\mathrm{TeV}}\). The dashed lines indicate contributions originating entirely from the loop-induced \(gg\rightarrow Z\phi \) subprocess. The dotted black lines indicate the sum of the individual contributions

The coefficients \({\bar{\sigma }}_{ab}\) in Eqs. (8) and (9) are shown in Figs. 1 and 2 as a function of \(m_\phi \). Figure 1 shows the two contributions to the \(pp\rightarrow W\phi \) process. Figure 2 shows the contributions to \(pp\rightarrow Z\phi \) grouped into pure CP-even (left) and pure CP-odd (right) contribtions. The dominant CP-even contribution is \({\bar{\sigma }}_{ZZ}\) until the tt and Zt contributions become similarly relevant for \(m_\phi \gtrsim {500}{\,\mathrm{GeV}}\). The CP-odd \(\tilde{t}\tilde{t}\) contribution is nearly identical to the tt contribution and is the largest contribution for the CP-odd case, where ZZ contributions are absent. Note that the bb and \(\tilde{b}\tilde{b}\) contributions contain the \(b\bar{b}\rightarrow Z\phi \) subprocess in addition to the b-quark boxes of the \(gg\rightarrow Z\phi \) subprocess. All cross-terms proportional to the product of a CP-even and a CP-odd coupling vanish in our parametrization. These can only originate from the contribution of additional Higgs bosons, which is neglected here.

Note that our expansions in Eqs. (8) and (9) have the following limitations in their applicability to BSM Higgs models:

  • In all processes, the higher-order correction terms only account for virtual top- and bottom-quark loops, thus we assume that no other particles with similar quantum numbers run in the loop and give a significant contribution. Models with additional, color-charged particles with scalar interactions, as e.g. the scalar top squarks in supersymmetric theories, may require a proper calculation of the quantum corrections of the additional particles.

  • As scalar-scalar-vector interactions, \(g_{\phi \phi 'V}^{\text {model}}\), are not accounted for, care must be taken in models with several light scalar degrees of freedom with non-negligible interaction between these particles. These may contribute in s-channel diagrams with the additional scalar particles as propagators.

The approximation described here is a very significant improvement over the effective coupling approximation for \(pp\rightarrow VH\) in previous versions of HiggsBounds. It is automatically used in the effective coupling input. In models where the assumptions above are satisfied it can also be used to substitute an explicit calculation of \(\sigma (pp\rightarrow VH)\) for the hadronic input scheme. In this case, the approximated hadronic cross sections can be accessed through the functions in the access_effC.f90 file. Furthermore, this approximation is not only used for the inclusive \(\sigma (pp\rightarrow ZH)\) cross section but also provides separate \(\sigma (qq\rightarrow ZH)\) and \(\sigma (gg\rightarrow ZH)\) cross sections that may be kinematically separable in some analyses.

4.2 Direct charged Higgs production

As discussed in Sect. 2.2, we have added many charged Higgs search channels to HiggsBounds that are or may – in the future – be probed at the LHC. The most thoroughly studied (and in many cases dominant) production channel is the production of a charged Higgs in association with a top-quark – denoted \(pp \rightarrow H^\pm t b\) in the four-flavor scheme or \(bg \rightarrow H^\pm t\) in the five-flavor scheme – which is typically considered in experimental searches at the LHC, see e.g. Refs. [130, 134, 199, 244]. The cross section has been calculated including NLO-QCD corrections in the 2HDM and MSSM [240, 245,246,247,248,249].

While the 2HDM is the simplest BSM model with a charged Higgs boson \(H^\pm \), the coupling structure of its charged-Higgs–quark couplings readily generalizes to a large variety of models. In the 2HDM (and also e.g. in the MSSM at tree-level) the relevant charged Higgs coupling to top and bottom quarks has the form

$$\begin{aligned} g_{t\bar{b}H^-}=\sqrt{2}\left( \frac{m_t}{v}P_R \kappa ^\pm _t + \frac{m_b}{v}P_L \kappa ^\pm _b \right) \end{aligned}$$
(13)

with \(\kappa ^\pm _t = 1/\tan \beta \), \(\kappa ^\pm _b = \tan \beta \) for flavor conserving 2HDM Yukawa sectors of type II (or in the MSSM) and \(\kappa ^\pm _t=\kappa ^\pm _b=1/\tan \beta \) in Yukawa type I. For a generic charged Higgs boson \(H_j^\pm \) we expand the cross section in terms of \(\kappa ^{j\pm }_{t,b}\) defined as in Eq. (13) and obtain

$$\begin{aligned} \sigma ^{tH_j^-}\displaystyle \big [m_{H_j^\pm }\big ]= & {} {\Big (\kappa ^{j\pm }_t\Big )}^2 {\bar{\sigma }}^{tH_j^-}_{tt}\big [m_{H_j^\pm }\big ] + \kappa ^{j\pm }_t \kappa ^{j\pm }_b {\bar{\sigma }}^{tH_j^-}_{tb}\big [m_{H_j^\pm } \big ] \nonumber \\&+ {\left( \kappa ^{j\pm }_b\right) }^2 {\bar{\sigma }}^{tH_j^-}_{bb}\big [m_{H_j^\pm }\big ]\,. \end{aligned}$$
(14)

We keep the interference term – even though it is suppressed by an additional mass insertion due to the helicity structure of the coupling – as its contribution becomes important for charged Higgs masses close to the top-threshold region.

For charged Higgs bosons lighter than the top-quark, the internal top-quark propagators can go on-shell introducing a dependence on the width of the top-quark, \(\Gamma _t\). According to Ref. [249], this can be approximately included by rescaling the cross section as

$$\begin{aligned}&\sigma ^{tH_j^-}\big [m_{H_j^\pm }<m_t-m_b\big ] \nonumber \\&\quad \rightarrow {\left( \frac{\Gamma _t^\text {SM}}{\Gamma _t^\text {BSM}}\right) }^2 \sigma ^{tH_j^-}\big [m_{H_j^\pm }<m_t-m_b\big ]\,.\end{aligned}$$
(15)

Neglecting decays of the top-quark into first and second generation quarks in the SM, this ratio of widths is simply given by \(\text {BR}(t\rightarrow W^+b)\) in the BSM model under consideration. We therefore parameterize \(\sigma ^{tH_j^-}\) in the entire \(m_{H_j^\pm }\) range as

$$\begin{aligned} \sigma ^{tH_j^-}\big [m_{H_j^\pm }\big ]= & {} \left( {\left( \kappa ^{j\pm }_t\right) }^2 {\bar{\sigma }}^{tH_j^-}_{tt}\big [m_{H_j^\pm }\big ] + \kappa ^{j\pm }_t \kappa ^{j\pm }_b {\bar{\sigma }}^{tH_j^-}_{tb} \big [m_{H_j^\pm }\big ] \right. \nonumber \\&\left. + {\left( \kappa ^{j\pm }_b\right) }^2 {\bar{\sigma }}^{tH_j^-}_{bb}\big [m_{H_j^\pm }\big ]\right) {\mathcal {S}}\,, \end{aligned}$$
(16)

where

$$\begin{aligned} {\mathcal {S}} = {\left\{ \begin{array}{ll}\mathrm {BR}(t\rightarrow W^+ b)^2 &{} \text {if}~\mathrm {BR}(t\rightarrow H_j^+ b)>0,\\ 1&{}\text {otherwise.}\end{array}\right. } \end{aligned}$$
(17)

We use the resultsFootnote 9 of Refs. [240, 249] tabulated in the 2HDM type II as a function of the charged Higgs mass and \(\tan \beta \) and extract the mass dependent coefficients \({\bar{\sigma }}_{ab}^{tH_j^-}\) by solving the resulting system of linear equations. In the region \(m_{H_j^\pm }<m_t\) we use HDECAY-6.52 [250, 251] to calculate the required branching ratios of the top-quark. The resulting parametrization reproduces the original results to a relative accuracy of better than \(10^{-4}\) for \(m_{H_j^\pm }> 2 m_t\) and – with deviations of at most 2% – stays well within the theoretical uncertainties of the original calculation [249] even for \(m_{H_j^\pm }<m_t\).

The parametrization in Eq. (16) holds for any charged Higgs boson \(H_j^-\) that has a coupling structure of the form Eq. (13), and is valid as long as no other BSM effects contribute up to NLO in QCD. In particular this neglects possible contributions of the form \(p p \rightarrow b\bar{b} \phi \rightarrow b\bar{b}H^+ W^-\) that can appear in 2HDM-like models. However, these are typically only relevant for resonant \(\phi \) production where they are treated separately. SUSY QCD corrections also impact these results, and the dominant \(\Delta _b\) corrections can be included through a rescaling of \(\tan \beta \).\(^9\) In the region \(m_{H_j^\pm }<m_t\) the approximation relies on the assumption \(\text {BR}(t\rightarrow W^+ b) + \text {BR}(t\rightarrow H_j^+ b)\approx 1\) (no sum over j). If this assumption is violated – e.g. because the top quark decays into multiple \(H^\pm _j\) or into additional new-physics decay modes – the threshold behavior would be incorrect and a full model-specific calculation should be performed. However, heavier \(H^\pm _j\) are insensitive to the top width, and valid cross sections for any number of \(H^\pm _j\) heavier than the top quark can be obtained.

In HiggsBounds-5 this approximation can be accessed through the HCCS_tHc function in the access_effC.f90 file, which requires \(m_{H^\pm }\), \(\kappa ^{j\pm }_t\), \(\kappa ^{j\pm }_b\), and \(\text {BR}(t\rightarrow H_j^+b)\) as input and assumes \(\text {BR}(t\rightarrow W^+b) = 1 - \text {BR}(t\rightarrow H_j^+b)\). The function returns the cross section

$$\begin{aligned} \sigma ^{tH_j^\pm } = 2\sigma ^{tH_j^-}, \end{aligned}$$
(18)

as the cross section is charge-symmetric, \(\sigma ^{tH_j^+} = \sigma ^{\bar{t}H_j^-}\). This inclusive value then corresponds to the required HiggsBounds input quantity CS_Hpmjtb, see Sect. 2.2.

4.3 Exclusion likelihoods for LHC Higgs to \(\tau ^+\tau ^-\) searches

In experimental searches for additional Higgs bosons decaying into \(\tau ^+\tau ^-\) the ATLAS [127, 223] and CMS [164, 196] collaborations have released simplified exclusion likelihoods as a function of the two contributing single Higgs production modes, \(gg\rightarrow \phi \) and \(gg\rightarrow b\bar{b}\phi \), and for a wide range of narrow scalar resonance mass hypotheses. The implementation of these nearly model independent likelihoods in HiggsBounds includes an approximate scheme for treating multiple contributing Higgs bosons of similar mass. The implementation of the first analysis from LHC Run-1 [164] for which this input was provided has been described in detail in Ref. [21]. We present the implementation and validation of new LHC Run-2 analyses and discuss improvements to the derivation of exclusion limits from the provided likelihood information. More details on the underlying likelihood reconstruction method can be found in Ref. [21].

The profiled likelihood analyses underlying the experimental results use the test statistic

$$\begin{aligned} q_\mu = -2\ln \frac{{\mathcal {L}}(N|\mu \cdot s(m) + b, {\hat{\theta }}_\mu )}{{\mathcal {L}}(N|{\hat{\mu }}\cdot s(m) + b, {\hat{\theta }})}\,,\end{aligned}$$
(19)

where N is the observed data, b is the background expectation, and s(m) is the signal expectation for a given hypothesized resonance mass m and given contributions of the two sub-channels. A limit is set on the signal strength modifier \(\mu \) in the presence of the globally optimized nuisance parameters \({\hat{\theta }}\), the globally optimized signal strength \({\hat{\mu }}\) and the conditionally optimized nuisance parameters \({\hat{\theta }}_{\mu }\) for the given value of \(\mu \). The experiments provide expected, \(q_\mu ^\text {exp}\), and observed, \(q_\mu ^\text {obs}\), values for this test as a function of the two sub-channel contributions for different resonance masses.

Since the likelihood was parametrized in terms of a single narrow scalar resonance, in a specific model application in HiggsBounds multiple Higgs bosons potentially contributing to the signal have to be combined and mapped onto the likelihood parametrization. This is done in HiggsBounds by a clustering algorithm. For this all Higgs bosons within

$$\begin{aligned} |m_i - m_j| \le \Delta _\text {res} \cdot \max (m_i,m_j) \end{aligned}$$
(20)

are combined into a cluster, their rates are incoherently summed,Footnote 10 and a signal-rate-weighted cluster mass is used to approximate the mass of the single resonance mass. The numerical coefficient \(\Delta _\text {res}\) is chosen to approximately match the mass resolution of the \(\tau ^+\tau ^-\) channel under consideration, and is currently set to \(20\%\) for all implemented analyses. This algorithm has already successfully been applied in various analyses, including cases in which more than two Higgs bosons form a cluster [21, 29, 225].

In the limit of large numbers the test statistic \(q_\mu \) can be treated as a \(\Delta \chi ^2\) above minimum such that \({68}{\%}~\text {C.L.}\) and \({95}{\%}~\text {C.L.}\) exclusion bounds are obtained at \(q_\mu =2.28\) and 5.99, respectively, corresponding to a two-sided limit (or fit). This approach was employed by the experimental collaborations to obtain the confidence regions in the presented two-dimensional cross section planes for fixed resonance mass, and hence also used to obtain \({95}{\%}~\text {C.L.}\) exclusion limits from the likelihood information in HiggsBounds-4 [21]. More appropriate for limit setting, however, is a one-sided upper limit on the signal cross section. Therefore, HiggsBounds-5 uses an improved approach in which \(\text {CL}_s\) is directly calculated from the provided likelihood information and the \({95}{\%}~\text {C.L.}\) allowed region is obtained at \(\text {CL}_s >0.05=1-{95}\%\). This reconstruction relies on the fact that the quantity \(q_\mu ^\text {exp}\) provided by the experiments can be interpreted asFootnote 11

$$\begin{aligned} q_\mu ^\text {exp}=\frac{\mu ^2}{\sigma ^2}\,,\end{aligned}$$
(21)

where \(\sigma \) is the expected effective Gaussian uncertainty of the signal strength modifier \(\mu \). The expected and observed \(\text {CL}_s\) can then be obtained just from \(q_\mu ^\text {exp}\) and \(q_\mu ^\text {obs}\) in the asymptotic limit as

$$\begin{aligned} \text {CL}_s = \frac{\text {CL}_{s+b}}{\text {CL}_b} \end{aligned}$$
(22)

using [252]

$$\begin{aligned} \text {CL}^\text {exp}_{s+b}&= 1 - \Phi \left( \sqrt{q_\mu ^\text {exp}}\right) \,,\end{aligned}$$
(23)
$$\begin{aligned} \text {CL}^\text {exp}_b&= 0.5\,,\end{aligned}$$
(24)

for the expected limit and

(25)
(26)

for the observed limit. In all of these, \(\Phi \) denotes the cumulative normal distribution function. The experimental collaborations use the \(\text {CL}_s >0.05\) criterion for model-specific limit setting, e.g. in the context of MSSM benchmark scenarios. HiggsBounds-5 uses the improved approach that directly employs \(\text {CL}_s >0.05\) instead of \(\Delta \chi ^2<5.99\) both for determining the sensitivity of the analysis via \(\text {CL}_s ^\text {exp}\) and for obtaining the \({95}{\%}~\text {C.L.}\) limit via \(\text {CL}_s ^\text {obs}\). This improved methodology in HiggsBounds that more closely resembles the one employed by the experimental collaborations enables a reliable reconstruction of limits from the provided likelihood information. As we will demonstrate below, with HiggsBounds it is now possible to even reproduce and understand methodical differences between the official ATLAS and CMS model interpretations.

Fig. 3
figure 3

Expected (left panels) and observed (right panels) exclusion likelihood from LHC \(pp\rightarrow H/A \rightarrow \tau ^+\tau ^-\) searches at ATLAS [223] (top panels) and CMS [196] (bottom panels) in the \(M^h_{125}\) scenario [29]. The solid black and white lines show the reconstructed \({95}{\%}~\text {C.L.}\) limit in HiggsBounds using the old (black, based on \(\Delta \chi ^2<5.99\)) and the improved new method (white, based on \(\text {CL}_s >0.05\)). For the limit based on \(\text {CL}_s >0.05\) the white-dotted lines indicate the variation of the limit due to signal-model-dependent theory uncertainties. The red dashed line shows the official ATLAS or CMS \({95}{\%}~\text {C.L.}\) limit

Figure 3 shows a validation of the HiggsBounds likelihood reconstruction algorithm against the most recent 13 TeV experimental analyses by ATLAS [223] (at \({139}\,{\mathrm{fb}}^{-1}\), top) and CMS [196] (at \({36}\,{\mathrm{fb}}^{-1}\), bottom) in the \(M^h_{125}\) scenario [29] of the MSSM. The theoretical predictions for the scenario are taken from the LHCHXSWG, based on the following prescription [240, 253]: FeynHiggs [254,255,256,257,258,259,260,261] is taken for the calculation of the MSSM masses and couplings, a combination of FeynHiggs and HDECAY [250, 251] for the \(\tau ^+\tau ^-\) branching ratio. The gluon fusion cross section predictions are obtained with SusHi [262, 263] including all available higher order corrections [264,265,266,267,268,269,270,271,272,273,274], and the \(b\bar{b}\) associated channel uses matched cross section predictions [275,276,277,278,279,280,281]. The prescription for the theoretical predictions in the MSSM benchmark scenarios is such that the model-dependent theoretical uncertainties of the predicted masses, cross sections and branching ratios should be incorporated by the user through appropriate variations of the theoretical predictions. We will discuss the impact of these theoretical uncertainties on the obtained limits below.

The color code in Fig. 3 shows the expected (observed) reconstructed likelihood value \(-2\ln (L)\) from HiggsBounds on the left (right). The black contour indicates the HiggsBounds \({95}{\%}~\text {C.L.}\) exclusion limit reconstructed using the old \(\Delta \chi ^2<5.99\) approach, while the solid white contour displays the \({95}{\%}~\text {C.L.}\) limit from the new \(\text {CL}_s\) method. The reconstructed limits displayed by the solid black and white contours do not take into account signal-model-dependent theoretical uncertainties. For the limit based on the \(\text {CL}_s\) method the white-dotted lines indicate the uncertainty band around the solid white contour according to the model-dependent theoretical uncertainties in the considered \(M^h_{125}\) benchmark scenario of the MSSM [29], see below. For comparison, the red-dashed lines show the official \({95}{\%}~\text {C.L.}\) limits from ATLAS (upper panels) and CMS (lower panels).

We start by comparing the limits obtained with the \(\Delta \chi ^2\) and the \(\text {CL}_s\) method (solid black and white contours). The \(\text {CL}_s >0.05\) criterion results in a larger excluded area compared to the \(\Delta \chi ^2<5.99\) criterion. This feature is expected and can be understood as follows. The \(\Delta \chi ^2=5.99\) limit corresponds to a \({95}{\%}~\text {C.L.}\) limit on \(\text {CL}_{s+b}\) in the Gaussian approximation. However, in order to prevent erroneous exclusions in regions where the search has no sensitivity [282] \(\text {CL}_s\) is constructed by dividing \(\text {CL}_{s+b}\) by \(\text {CL}_b\), see Eq. (22). Since the expectation value of \(\text {CL}_b\) in the absence of any signal is \(\langle \text {CL}_b\rangle ={0.5}\), a \({95}{\%}~\text {C.L.}\) limit on \(\text {CL}_s\) approximately corresponds to a \(1-{0.05}/\langle \text {CL}_b\rangle \approx {90}{\%}~\text {C.L.}\) limit on \(\text {CL}_{s+b}\).Footnote 12

We now compare the limit obtained with the \(\text {CL}_s\) method with the results obtained by ATLAS and CMS in their analyses for the \(M^h_{125}\) benchmark scenario. As explained above, the reconstructed limit in HiggsBounds is based on the (nearly) model-independent likelihood provided by ATLAS and CMS which by construction does not contain any model-specific theoretical uncertainties on the cross sections and branching ratios of the signal processes. Accordingly, the solid white contour corresponds to the limit obtained with the \(\text {CL}_s\) method without taking into account model-specific theoretical uncertainties. We find that the resulting limit agrees almost perfectly with the one obtained in the ATLAS analysis, both for the expected (left upper panel) and the observed limit (right upper panel). On the other hand, the benchmark analysis of CMS excludes a smaller region than in our \(\text {CL}_s\) analysis (solid white contour), both for the expected and the observed limit (lower panels). As we have verified via direct communication with members of the ATLAS and CMS collaborations [283], this feature can be understood from the fact that the experimental interpretation of the benchmark scenario by CMS includes model-specific theoretical uncertainties on the signal cross-sections, while in the ATLAS analysis no such signal-model-dependent theoretical uncertainties have been taken into account.

As a final step of this comparison we now take into account signal-model-dependent theoretical uncertainties with HiggsBounds. The dotted white contours indicate the uncertainty band around the solid white contour that has been obtained by running HiggsBounds with input rates at the upper and lower end of the theoretical uncertainties and interpreting the resulting difference in the \({95}{\%}~\text {C.L.}\) exclusion as a theoretical error band. In line with the CMS analysis, we include scale and parton distribution function uncertainties on the cross section predictions, provided by the LHCHXSWG for the \(M^h_{125}\) scenario. Theoretical uncertainties on the BRs are not considered since they are negligible by comparison [240]. The upper branch of this band shows how the limit is weakened by the incorporation of the signal-model-dependent theoretical uncertainties. We find that this contour agrees well with the limit that has been obtained in the CMS benchmark analysis. We expect that an ATLAS limit incorporating the signal-model-dependent uncertanties would be less constraining and closer to the upper white-dotted limit obtained with HiggsBounds.Footnote 13

By default, the likelihood information is used to reconstruct a \({95}{\%}~\text {C.L.}\) limit that is then treated like any other limit in HiggsBounds. HiggsBounds selects the Higgs cluster giving the largest expected exclusion likelihood as the most sensitive Higgs boson combination to be tested against the observation. The advantage of reconstructing the limit from the likelihood is that the full efficiency information on the two involved production channels is incorporated. This is especially important in the BSM \(\phi \rightarrow \tau ^+\tau ^-\) channel, since the relative contributions of \(gg\rightarrow \phi \) and \(gg\rightarrow b\bar{b}\phi \) can change drastically through the model parameter space, e.g. in the MSSM or the 2HDM. The value of the likelihood can also be accessed directly through the HiggsBounds_get_likelihood subroutines (see online documentation), such that it can be included in a global likelihood analysis of BSM models, see e.g. Refs. [225,226,227,228].

Fig. 4
figure 4

Likelihood of the ATLAS search [223] in the plane of \(\sigma _{gg}\cdot \mathrm {BR}(\phi \rightarrow \tau ^+\tau ^-)\) and \(\sigma _{bb}\cdot \mathrm {BR}(\phi \rightarrow \tau ^+\tau ^-)\) for \(M_\phi ={400}{\,\mathrm{GeV}}\). The color code in the left panel shows the likelihood as provided by ATLAS, while the right panel shows the processed likelihood used in HiggsBounds. The \({95}{\%}~\text {C.L.}\) contour and best fit point are indicated in grey. The black ellipse with the corresponding long axis (dashed) and the red ellipse shown in the left panel are used in the construction of the processed likelihood (see text)

The implementation of the recent ATLAS result [223] raised a different kind of issue, as it contains an observed excess with a local significance of more than \(2\sigma \) for masses in the range 400–500 GeV. Therefore, the parameter point of zero signal rates lies outside the \({95}{\%}~\text {C.L.}\) contour of the provided likelihoods. A direct application of these results in the original form to a model would exclude parameter points that feature scalar boson(s) with small or vanishing \(pp\rightarrow \phi \rightarrow \tau ^+\tau ^-\) rates in that mass range. At the same time, parameter points with no scalars in that mass range would not be excluded, as the likelihood would not be evaluated if no scalar boson is within the mass range. We therefore use an approximate approach to avoid this inconsistent behavior while keeping the overall features of the likelihood profile intact. This approach is applied to the mass range with an excess of more than \(1\sigma \), i.e. for the mass planes at 350,400 and 500  GeV provided by ATLAS. It restores the property \(q_\mu ^\text {obs}=0\) for \({\hat{\mu }} > \mu \) required of a test statistic used in limit setting [252], where \({\hat{\mu }}\) is the best fit rate.

We use the \(M_\phi ={400}{\,\mathrm{GeV}}\) mass plane, shown in Fig. 4, to illustrate the approach. The grey contours are the \({95}{\%}~\text {C.L.}\), \(\Delta \chi ^2=5.99\) contoursFootnote 14 of the original (processed, i.e. based on our approach for avoiding the exclusion of too small BSM rates) observed likelihood profile \(q_\mu ^\text {obs}\) shown on the left (right). We first fit an ellipse centered at the best fit point (grey cross) to the \({95}{\%}~\text {C.L.}\) contour of the original \(q_\mu ^\text {obs}\). In Fig. 4 (left) this ellipse is shown in black. We then construct the ellipse shown in red, which is centered at the origin with axes parallel to the coordinate axes. We fix the eccentricity by requiring this ellipse to be tangential to the long axis of the black ellipse in the best fit point (the black-dashed line). We consider all signal rates on this red ellipse to be equal to the best fit rate, \(\mu \sim {{\hat{\mu }}}\).Footnote 15 Accordingly, the likelihood inside the red ellipse is set to zero, since lower predicted rates than at the best-fit point should not be disfavored in a limit setting procedure. To obtain a smooth transition, we introduce polar coordinates \((r,\theta )\) and, for each angle \(\theta \), approximate the likelihood profile by

$$\begin{aligned} -2\ln (L) = q^\text {obs}_\mu \rightarrow {\left\{ \begin{array}{ll} 0 &{} \text {for }r\le r_E \Leftrightarrow \mu \le {{\hat{\mu }}} \,,\\ 5.99 \left( \frac{r - r_\text {E}}{r_{95}-r_\text {E}}\right) ^2 &{} \text {for }r_E< r < r_{95} \,,\\ q^\text {obs}_\mu &{} \text {for }r_{95}\le r \,,\end{array}\right. } \end{aligned}$$
(27)

where \(r_\text {E}\) (\(r_{95}\)) is the radial component of the red ellipse (the grey \({95}{\%}~\text {C.L.}\), \(\Delta \chi ^2=5.99\) contour) for the given \(\theta \). Outside the grey contour the likelihood remains unchanged from the original. This leads to the processed likelihood profile shown in the right panel of Fig. 4. The upper part of the grey \({95}{\%}~\text {C.L.}\) contour and the likelihood for larger rates remain unchanged, the inconsistent exclusion of low and vanishing rates is avoided, and the intermediate region is continuously interpolated. These processed likelihood profiles are used instead of the original ones in HiggsBounds. If HiggsBounds is used in a global fit and only the likelihood values, but no corresponding reconstructed limits are desired, the original values can be used instead by setting the logical preventOverexclusion parameter in likelihoods.F90 (see online documentation) to false.

5 User operating instructions

For HiggsBounds-5 we have made substantial changes on the structure and online platform of the HiggsBounds source code. The code has moved to a GitLab repository and is now available at https://gitlab.com/higgsbounds/higgsbounds. This modernization effort also included moving to CMake as the build system. HiggsBounds is now compiled by running:

figure a

The only requirements are CMake and a Fortran compiler. This will compile the library, the main executable and a number of example programs that illustrate different use cases. More detailed information on building and linking HiggsBounds can be found on the above-mentioned website.

5.1 Fortran subroutines

The Fortran subroutines are the most powerful and versatile way of using HiggsBounds. Up-to-date descriptions of the various Fortran subroutines and functions can be found in the online documentation at https://higgsbounds.gitlab.io/higgsbounds.

Compared to HiggsBounds-4, all of the input subroutines have been extended to include all of the quantities discussed in Sect. 2. The input subroutine arguments are named as in Tables 1, 2, 3, 4 and 5 and are either double precision or integer arrays with dimensions given by the number of neutral Higgs bosons and/or the number of charged Higgs bosons.

As a further improvement, HiggsBounds-5 includes a C interface to all of the Fortran subroutines to facilitate the use of HiggsBounds from C or C++ codes. This interface automatically handles type conversion and accounts for the different storage orders of multidimensional arrays between C and Fortran. The C interface is included in the online documentation.

5.2 Command-line version

Compiling HiggsBounds generates a main executable that can be run as

figure b

where the arguments specify the following: \({\mathtt {<whichanalyses>}}\) specifies which experimental data is selected for the model test – ‘LandH’ for all implemented results, ‘onlyL’ for LEP results only, ‘onlyH’ for hadron-collider results only, and ‘onlyP’ for published results only; \({\mathtt {<whichinput>}}\) specifies whether the model input on the production and decay rates is provided in the effective couplings approximation (‘effC’), at the cross section level (‘hadr’), or via an SLHA input file (‘SLHA’). The arguments \({\mathtt {<nHzero>}}\) and \({\mathtt {<nHplus>}}\) specify the number of neutral and charged Higgs bosons, respectively. The argument \({\mathtt {<prefix>}}\) denotes the path to the input files including any part of the filename that is common to all input files.

Additionally an executable called AllAnalyses is generated. It prints a table listing all of the experimental analyses implemented in HiggsBounds, including arXiv identifier or report numbers as well as InspireHEP cite keys. Since we continuously implement new experimental results in the code, we refer to this executable for an up-to-date list of what is included in the version of HiggsBounds that is being used. A bibliography file that includes entries for all implemented analyses is available on the website.

5.2.1 HiggsBounds data files input

Table 7 File names and data format for the contents of HiggsBounds input files. The right column shows the order of the input data arrays within one row of the input file (k is the line number). See the text for details on the order of elements within the arrays and the handling of symmetric multidimensional arrays (marked with \(^*\)). The middle columns indicate whether the files are required in the effective couplings approximation (effC) or hadronic cross section (hadr) input scheme [y(es), n(o), o(ptional)]

If HiggsBounds is run from the command line with the option \({\mathtt {<whichinput>=effC}}\) or hadr the model input needs to be specified via HiggsBounds specific input files. These are whitespace separated tabular text files containing the input quantities for one datapoint per row. With respect to HiggsBounds-4, the input files have been adjusted to the changes in the input quantities detailed in Sect. 2.

An overview of all data input files and their data structure is given in Table 7. For some higher-dimensional arrays only some elements have to be specified, as will be explained below. Table 7 also specifies whether the data file is required for either of the two HiggsBounds input schemes (effC or hadr), or used as optional input. If a required file is not provided as input, HiggsBounds warns the user but proceeds to run while setting the unspecified input quantities to zero. In Table 7 we assume that both neutral and charged Higgs bosons are present in the model. Obviously, if either the number of neutral or charged Higgs bosons is zero, the corresponding input files are also not required.

For the two-dimensional input arrays ghjhiZ and CS_lep_hjhi only the lower left triangle (including the diagonal) is required, since they are symmetric matrices. As an example, for three neutral Higgs bosons (\(N_{h^0} = 3\)) the symmetric matrix A,

(28)

should be specified in the input file in the order

$$\begin{aligned} {\mathtt {A[1,1]}},\ {\mathtt {A[2,1]}},\ {\mathtt {A[2,2]}},\ {\mathtt {A[3,1]}},\ {\mathtt {A[3,2]}},\ {\mathtt {A[3,3]}}\,.\end{aligned}$$

In contrast, for the two-dimensional input array BR_hjhiZ, all off-diagonal elements need to be specified. Again for the \(N_{h^0} = 3\) example, we have

(29)

thus, the elements should be specified as

$$\begin{aligned}&{\mathtt {BR_hjhiZ[1,2]}},\ {\mathtt {BR_hjhiZ[1,3]}},\ {\mathtt {BR_hjhiZ[2,1]}},\ \\&{\mathtt {BR_hjhiZ[2,3]}}, {\mathtt {BR_hjhiZ[3,1]}},\ {\mathtt {BR_hjhiZ[3,2]}}\,.\end{aligned}$$

The three-dimensional input array BR_hkhjhi[k,j,i] is symmetric under exchange of the final state Higgs boson indices i and j and elements with k=j or k=i are zero (k is the index of the decaying Higgs boson). The \(N_{h^0}^2 (N_{h^0}-1)/2\) non-redundant elements can be specified in the following way: For every \({\mathtt {k}}\in \{1,N_{h^0}\}\) we specify the lower left triangle (including the diagonal), but with the kth column and kth row removed, e.g. for \(N_{h^0} = 3\)

$$\begin{aligned} {\mathtt {BR}}\_{\mathtt {hkhjhi[1,2,2]}},~{\mathtt {BR}}\_{\mathtt {hkhjhi[1,3,2]}},\\ {\mathtt {BR}}\_{\mathtt {hkhjhi[1,3,3]}}, {\mathtt {BR}}\_{\mathtt {hkhjhi[2,1,1]}},\\ {\mathtt {BR}}\_{\mathtt {hkhjhi[2,3,1]}},~{\mathtt {BR}}\_{\mathtt {hkhjhi[2,3,3]}}, \\ {\mathtt {BR}}\_{\mathtt {hkhjhi[3,1,1]}},~{\mathtt {BR}}\_{\mathtt {hkhjhi[3,2,1]}},\\ {\mathtt {BR}}\_{\mathtt {hkhjhi[3,2,2]}}. \end{aligned}$$

The input arrays BR_hjHpiW, BR_HpjhiW and CS_Hpjhi are not reducible and should be specified row by row in the input files.

5.2.2 SLHA

Table 8 Example for the new SLHA Block ChargedHiggsLHC13 containing various charged Higgs production cross sections (in pb, arbitarity values). The cross sections for charged Higgs production in association with one or two light flavor quarks (u, d, s) are generally combined to inclusive production processes containing one or two untagged jets. For the vector boson fusion process we set both quark PDG numbers to 1 in order to differentiate it from the other quark-associated production processes. All cross sections correspond to the sum of \(H^+\) and \(H^-\) production, hence, all PDG numbers are taken to be positive (except for \(H^+H^-\) production)

In HiggsBounds-4 the squared SM-normalized effective Higgs couplings to bosons and third generation fermions were provided in the two SLHA blocks HiggsBoundsCouplingInputBosons and HiggsBoundsCouplingInputFermions, respectively. Since HiggsBounds-5 requires the sign information for the effective couplings, we have replaced these blocks by very similar blocks named HiggsCouplingsBosons and HiggsCouplingsFermions containing the non-squared, sign sensitive effective Higgs couplings as described in Sect. 2. In case only the old blocks are specified in the SLHA input file for HiggsBounds-5, the effective Higgs couplings are taken to be the positive square-root of the given values.

In addition, we introduced an SLHA input block containing the hadronic cross sections for direct charged Higgs boson production. In absence of a corresponding SLHA convention, we call these input blocks ChargedHiggsLHC8 and ChargedHiggsLHC13 for the predictions for the LHC at 8 and 13 TeV, respectively.Footnote 16 The first three columns specify the final state particle PDG numbers in increasing order (modulo a sign in case of anti-particles). In case of a two-body final state the first column is filled by a zero. The fourth column gives the cross section in pb. An example (employing the particle spectrum of a 2HDM Higgs sector) for one of these SLHA blocks is given in Table 8.

6 Summary

This paper documents a major update of the public Fortran code HiggsBounds which tests general BSM models against exclusion limits from LEP, Tevatron and LHC Higgs searches. We have presented the theoretical input framework of HiggsBounds-5, which has been significantly extended to allow predictions for all current and many potential future Higgs search channels. In particular this extension adds sub-channels for several production modes – such as \(q\bar{q}\)- and gg-induced Zh production – that may be kinematically separable, and incorporates flavor-violating decay modes and decays into BSM particles. The charged Higgs boson input framework has also been extended by many different direct production processes, some of which are already probed at the LHC.

We discussed the main experimental input for HiggsBounds – the (nearly) model-independent upper cross section limits – and the possible limitations of their application to BSM models. In fact, many of these limitations in current search results can be overcome if more detailed information, in particular on the signal composition in terms of Higgs production processes, is released publicly by the experimental collaborations. Therefore we suggested guidelines for the publication of experimental search results that we deem essential for a proper reinterpretation in terms of BSM models. These recommendations are in line with and partly extend those presented in Ref. [224].

In many BSM models precise calculations for “exotic” production cross sections are in many cases not readily available. Therefore, for two of the important production modes – neutral Higgs production in association with a massive gauge boson and top-associated charged Higgs production – we have added model-independent parameterizations of existing calculations. The effective coupling (or scale factor) approximations of the Zh and \(W^\pm h\) production cross sections are based on results obtained with the code VH@NNLO  [242, 243] and include CP-sensitive contributions. The \(tH^+\) cross section parametrizes the precise calculations in the 2HDM  [240, 245,246,247,248,249] through model-independent coupling scale factors.

In most searches for additional Higgs bosons the final result provided by the experimental collaborations is a – potentially multidimensional – upper limit on the cross section at \({95}{\%}~\text {C.L.}\) as a function of the relevant kinematic variables, i.e. the masses and widths of the involved particles. However, for the neutral Higgs boson searches in the \(\tau ^+\tau ^-\) final state a simplified exclusion likelihood was provided by both the ATLAS and CMS collaborations. These likelihoods are implemented in HiggsBounds, and the resulting likelihood value is made available for use in model fits. We encourage the release of such likelihoods also for other experimental search channels in the future [224]. We have improved the derivation of \({95}{\%}~\text {C.L.}\) limits from provided likelihood information by using the \(\text {CL}_s\) method and presented a procedure to prevent overexclusion in case of excesses in the searches. A validation of the likelihood implementation in the \(M_h^{125}\) scenario of the MSSM using these new techniques found very good agreement with the official results from CMS (ATLAS) taking into account (ignoring) the model-dependent theoretical uncertainties on the signal rates.

HiggsBounds-5 also involves substantial technical changes. The code is now available in a public git repository at

https://gitlab.com/higgsbounds/higgsbounds

with updates being released whenever new analyses have been implemented. We have modernized the build system to use CMake and added a C interface to make it easier for other codes to link to HiggsBounds. A technical description of the user subroutines and further details on the code are given in the online documentation at

https://higgsbounds.gitlab.io/higgsbounds .