Novel signatures for vector-like quarks

We consider supersymmetric extensions of the standard model with a vector-like doublet (T B) of quarks with charge 2/3 and −1/3, respectively. Compared to non-supersymmetric models, there is a variety of new decay modes for the vector-like quarks, involving the extra scalars present in supersymmetry. The importance of these new modes, yielding multi-top, multi-bottom and also multi-Higgs signals, is highlighted by the analysis of several benchmark scenarios. We show how the triangles commonly used to represent the branching ratios of the ‘standard’ decay modes of the vector-like quarks involving W, Z or Higgs bosons can be generalised to include additional channels. We give an example by recasting the limits of a recent heavy quark search for this more general case.

Recently, two of the authors have suggested a reinterpretation of the Higgs doublet superfields,Ĥ u andĤ d , as a fourth family of (vector-like) lepton superfields [22] in the context of the 'µ from ν' supersymmetric standard model (µνSSM) [23]. This seems to be more satisfactory from the theoretical viewpoint than the usual situation in supersymmetric models, where the Higgses are 'disconnected' from the rest of the matter and do not have a three-fold replication. In this framework, in analogy with the known first three families where for each JHEP06(2017)095 lepton representation there is a quark counterpart, the possible existence of a vector-like quark doublet representation (T B) was proposed in ref. [22] as part of the fourth family.
The collider phenomenology of the production and decay of vector-like quarks in supersymmetric extensions of the SM can be quite different from the minimal vector-like extensions with a single Higgs doublet [24,25]. As already mentioned, supersymmetry requires the presence of two Higgs doublet superfields, with their scalar components H d and H u generating charged lepton and down-type quark masses, and up-type quark masses, respectively. Additional neutral singlet superfields can also exist, and their scalar components are in general mixed with the Higgses. For example, in the next-to-minimal supersymmetric standard model (NMSSM) [26] one extra singlet superfieldN is included in order to solve the µ problem [27]. In the µνSSM [23,28], the µ problem is solved using three families of right-handed neutrino superfieldsν c L , simultaneously reproducing at the tree level the correct neutrino physics [23,[29][30][31][32][33][34]. In this model, since R-parity is explicitly violated, all fields with the same quantum numbers mix together, and in particular the Higgses H u and H d turn out to be mixed with the right and left sneutrinos, ν R and ν L , although the mixing with the left ones is very small and they are basically decoupled.
The additional scalars present in supersymmetry give new decay channels for the vector-like quarks, with distinctive signatures of multi-top, multi-bottom or even multi-Higgs signals. Current searches for heavy quarks T and B at the Large Hadron Collider (LHC) for heavy quark pair [35][36][37][38][39][40][41][42] or single production [43][44][45][46][47][48] focus on the standard decay modes, The aim of this paper is to explore the additional signatures that can arise in models with non-minimal scalar sectors, using as benchmark the supersymmetric model with a vectorlike quark doublet (T B) proposed in ref. [22]. Additional decay modes of vector-like quarks T have been considered in composite Higgs [49], little Higgs [50] and two-Higgs doublet models [51]. We begin by writing in section 2 the interactions for a vector-like doublet extension when the scalar sector comprises two doublets H u and H d , as in the case of the MSSM. This corresponds to a limit of negligible mixing of the neutral interaction eigenstates H 0 u , H 0 d with the additional scalars present in the benchmark model of ref. [22]. In section 3 we write the interactions in a more general scenario where H 0 u and H 0 d mix with a scalar singlet ν R . We then study in section 4 the decays of the heavy quarks T and B for the two scalar doublet model, and the model with two scalar doublets plus a singlet. There we analyse in particular the dependence on the model parameters of the T and B decay branching ratios for the standard and the new decay modes.
As we have remarked, current searches focus on the standard decay modes of the heavy quarks (1.1). For those searches, we generalise in section 5 the triangles that are commonly used by the ATLAS and CMS Collaborations, where they display the interpretation of their limits under the assumption that the branching ratios for the three modes (1.1) add up JHEP06(2017)095 to one, Br(W ) + Br(Z) + Br(h 0 ) = 1. Relaxing such assumption, we will be able to plot these branching ratios within three-dimensional pyramids. Alternatively, a graphical representation by a set of equilateral triangles obtained by slicing the pyramids will be presented, and an example of how a standard search can be recast is given in section 6, where we show in a realistic case the resulting limits in this set of triangular slices. Finally, we discuss our results in section 7. Two appendices are devoted to collecting the partial widths for the different decay modes of the heavy quarks, and giving the relation between coordinates in the triangles and heavy quark decay branching ratios.

Interactions for two scalar doublets
We consider a supersymmetric model with three SM quark generations q Li = (u 0 In the notation of four-component spinors, they are There is also a Yukawa interaction of the vector-like quark doublet with the scalar singlet ν R [22], where we have applied a phase redefinition of the B 0 R field to recover the conventions for the non-supersymmetric SM extensions with vector-like quarks [25], which we use in the following.
After the neutral scalars acquire vacuum expectation values H 0 We assume that the new vector-like doublet eigenstates dominantly mix with the third generation, as it is expected from the mass hierarchy [52]. (This assumption is also in agreement with stringent experimental constraints arising from flavour-changing processes at low energies [53][54][55][56].) Therefore, we can ignore the first two generations and write the relation between weak eigenstates and mass eigenstates as R3 . The mixing angles of left-and right-handed fields are not independent, but they satisfy [57][58][59] In the following we abbreviate s u L = sin θ u L , c u L = cos θ u L , etc. The agreement with the precisely measured S and T parameters and [60] requires that these angles are small. (Note that for small mixing the (4, 4) entries in the mass matrices are approximately the heavy quark masses.) We write in this section the interactions in the mass basis in a MSSM-like case where the neutral interaction eigenstates H 0 u , H 0 d have small mixing with the other scalars. In this case we have with h 0 being the SM-like Higgs boson, H 0 1 a scalar, P 0 1 a pseudo-scalar and G 0 a Goldstone boson. As usual, we define tan GeV, and α is the mixing angle between the two neutral scalars h 0 and H 0 1 . For the charged scalars we have with H + the physical charged scalar and G + the Goldstone boson. Furthermore, we take the alignment limit β − α = π/2, since a small misalignment has no phenomenological consequences on the heavy quark decays. We remark that the interactions written below are the same for a non-supersymmetric type-II two-Higgs doublet model in which one doublet H u couples to charge 2/3 quarks and the other doublet H d couples to charge −1/3 quarks.

Light-heavy interactions
These interactions determine the decay of the heavy quarks. The interactions with the W and Z bosons are the same as in the minimal model with one Higgs doublet, In terms of the mixing angles, the couplings are (2.9)

JHEP06(2017)095
Under the assumption of perfect alignment β − α = π/2, the interactions with the lightest neutral scalar h 0 also have the same form as in the minimal models, with the couplings (2.11) The interactions with H 0 1 and P 0 1 differ by tan β and −1, ±i phase factors, Finally, the interactions with the charged scalar can be written as with the new couplings (2.14)

Light-light interactions
The inclusion of the new quarks modifies the gauge boson interactions of the third generation, leading to constraints on the mixing [25,57]. These are written as For small mixing angles, these couplings are close to the SM predictions. The couplings to the SM-like scalar are the same as in the minimal vector-like extensions, Y bb is very close to unity due to experimental constraints, while Y tt can deviate from unity at the few percent level. Still, the deviations in the top quark amplitudes for gg → h 0 and h 0 → γγ caused by this difference are compensated by the contribution of the new T quark, yielding a sum very close to the SM amplitude [25]. The couplings to H 0 1 and P 0 1 are similar, but with extra tan β, −1, and ±i factors, and a γ 5 matrix for the pseudo-scalar, The interaction with the charged scalar is (2.21) For masses larger than 2m t , the heavy scalars H 0 1 and P 0 1 will dominantly decay into tt or bb, depending on tan β. (For lighter H 0 1 , the decay into h 0 h 0 may be sizeable [61].) The charged scalar is expected to decay mainly into tb.

Heavy-heavy interactions
The couplings between the two heavy quarks are not involved in production nor decay processes; we collect here only for completeness. The Lagrangians have the same form as for the light-light interactions but replacing t by T and b by B. The corresponding JHEP06(2017)095 couplings are

Interactions for two scalar doublets plus a singlet
We consider here the mixing with one additional scalar singlet ν R . We do not take the most general 3 × 3 unitary transformations for the scalars and pseudo-scalars, but instead we use simple two-angle rotations that ensure that there is a SM-like Higgs boson h 0 and still yield a richer phenomenology than in the two-scalar doublet model. We write The interactions with h 0 are unchanged with respect to the previous section. The lightheavy interactions for up-type quarks with the scalars and pseudo-scalars can be obtained from the interactions with H 0 1 and P 0 1 in eq. (2.12), respectively, with the replacements where we have defined κ R = v R /v. The terms proportional to 1/κ R arise from the vectorlike doublet coupling to the scalar singlet in eq. (2.2), which generates the (4, 4) entries in the mass matrices that approximately equal the heavy quark masses. Analogously, for the

JHEP06(2017)095
down-type quarks the interactions are obtained by replacing in the scalar and pseudo-scalar interactions written in eq. (2.12).
The light-light interactions are slightly more involved. For the top quark, they are obtained from eq. (2.19) by replacing and for the bottom quark, In addition to the decays into tt and bb, mediated by the couplings in (3.4) and (3.5), the scalars H 0 k , k = 1, 2, can have more exotic decay modes such as h 0 h 0 [62]. Finally, the heavy-heavy interactions have the same form as light-light interactions but replacing the quark masses and

Decay of the heavy quarks
The heavy quarks T and B can decay into SM gauge or Higgs bosons plus a lighter quark, cf. (1.1), as in the minimal models with a single Higgs doublet. Provided the channels are kinematically allowed, they can also decay into the extra scalars plus a top or bottom quark, with k = 1, 2. The expressions for the partial widths are collected in appendix A. They depend on the mixing angles s u R and s d R , the mixing in the scalar sector and the heavy quark and (pseudo-)scalar masses. If T and B are much heavier than H 0 k , P 0 k and H ± , the dependence on the masses is mild. We will therefore fix the quark masses to m T = m B = 1 TeV, 1 and new scalar masses to The angle θ d R determines the size of the charged current mixing of the T quark and the neutral current mixing of the B quark. Conversely, the angle θ u R determines the charged current mixing of the B quark and neutral current mixing of the T quark. Therefore, the decays of either T or B depend on both mixing angles. We will use several representative benchmarks for the quark mixing, all of them with the phases φ u and φ d set to zero: We take both of them equal to 0.05, fulfilling indirect constraints [25,63]. The couplings are collected in table 1.
(ii) Dominant mixing in the up sector, as it is expected from the quark mass hierarchy.
We take s u R = 0.05, s d R = 0.01 as well as the limit case s u R = 0.05, s d R ∼ 0. The couplings are collected in table 2.
(iii) Dominant mixing in the down sector. This inverted hierarchy needs some fine tuning of parameters, but is studied for completeness. We take s d R = 0.05, s u R = 0.01 and the limit case s d R = 0.05, s u R ∼ 0, giving the couplings in table 3.
We consider in turn the simpler model with only two scalar doublets (i.e. no mixing with the singlet) and with two scalar doublets plus a singlet.

Two scalar doublets
For each of the quark mixing benchmarks in tables 1-3, we plot in figures 1 and 2 the dependence of the branching ratios on tan β. The results can be understood from the relative size of the couplings and the tan β factors in the Lagrangian. In most cases it is found that the new channels with neutral scalars H 0 1 or P 0 1 and the channel with the charged one H ± in the final states do not compete among themselves, but only with the standard ones. For T decays we have:        coupling, therefore it is enhanced at large tan β and suppressed at low tan β, as in the equal mixing scenario.
For B decays, the situation is reversed because the dependence on tan β is the opposite as for the T quark. We can see that: • For equal mixing and tan β ∼ 1 all B decay modes have branching ratios of the same order. At large tan β the factor Z L tB cot β in the coupling, with Z L tB ∼ s u R , is suppressed (in this case the coupling Z R tB is very small) while the decays to H 0 1 b and P 0 1 b benefit from the tan 2 β enhancement and therefore dominate. For small tan β the opposite happens, and B → H − t dominates.
• For dominant up mixing the neutral couplings X bB and Y bB are small, and decays into Zb and h 0 b are negligible. The Z L tB cot β coupling is suppressed at large tan β and makes the B → H − t channel small; for the same reason it dominates at low tan β. If the mixing in the down sector is not too small, at large tan β the decays into H 0 1 b and P 0 1 b can be important, otherwise B → W − t is the leading channel at large tan β.

JHEP06(2017)095
• For dominant down mixing the charged current couplings V tB and Z tB of the B quark are very small, so we mainly have the neutral decays. B → H 0 1 b and B → P 0 1 b are enhanced at large tan β and suppressed in the small tan β region.
The neutral (pseudo-)scalars H 0 1 and P 0 1 produced in the heavy quark decays are expected to decay mainly into tt (low tan β, and provided the channel is kinematically open) and bb (high tan β), with equal branching ratios for tan β 6. The partial widths for the decays are given in appendix A.

Two scalar doublets plus a singlet
In this case there are three additional parameters: the ratio of VEVs κ R and the two mixing angles θ and θ . However, if we require that the Yukawa coupling y 44 of the quark doublet to the scalar singlet is of order one at most, then κ R 6 for m T,B = 1 TeV and the latter terms in eqs. (3.2) and (3.3) are small. Consequently, for the situations of interest the parameter κ R has little influence on the T and B decay branching ratios.
For T quark decays, we have found in section 4.1 that the H 0 1 and P 0 1 modes are only relevant when tan β 1. In such case, the 1/κ R terms in eqs. (3.2) are subdominant and the widths for T → H 0 1 t and T → P 0 1 t for the two scalar doublet model are shared with the additional modes, with weights proportional to the sine or cosine squared of the scalar mixing angles, up to small corrections from the 1/κ R term and the possibly different scalar masses. We give some examples in figure 3 (left), for the equal mixing and dominant up/down mixing scenarios, taking θ = θ = π/4. For clarity, we zoom on the low tan β region. For the rest of mixing scenarios the results can easily be obtained from figures 1 and 2 and the above equations. For B quark decays, we have also seen in section 4.1 that decays to H 0 1 b and P 0 1 b are relevant only for tan β 1. In this case, the 1/κ R terms in eqs. (3.3) are subleading and we have Some examples, for the equal mixing and dominant up/down mixing scenarios, are shown in the right panel of figure 3. Notice that the branching ratios for H 0 1 and P 0 1 decays, and also for H 0 2 and P 0 2 , almost coincide, in contrast with T decays, because the interference terms proportional to m b are negligible. We remark that the branching ratios for the rest of modes are almost the same as in the two doublet model, precisely due to eqs.    The decay widths of H 0 k and P 0 k into tt and bb can be obtained from the ones given in appendix A with the replacements (3.4) and (3.5). They thus depend not only on tan β but on the scalar mixing angles θ, θ and the quark mixing. In addition, the scalars H 0 k can decay into h 0 h 0 , with partial widths that depend on independent parameters [62], and the branching ratio for a mass eigenstate that is mostly aν R can be of order unity. Also, cascade decays are possible (note that here we have considered the same mass for all scalars, for simplicity, but this is not the general case), giving a variety of final states, whose detailed analysis is beyond the scope of this work.

JHEP06(2017)095 5 Connection to standard searches
In the minimal SM extensions with a vector-like singlet, doublet or triplet and one scalar doublet the branching ratios of T (B) decays to W b (W t), Zt (Zb) and h 0 t (h 0 b) add up to unity. We will refer to the branching ratios for these final states as Br(W ), Br(Z) and Br(h 0 ) when considering indistinctly T and B quarks. A given set of branching ratios, determined by the heavy quark masses and mixing parameters, can be represented in a triangle where two of the axes are, for example, Br(Z) and Br(h 0 ), and the third one is determined by the constraint that the sum equals one (see for example ref. [25]). This representation is also very convenient to give the result of experimental searches [38][39][40][41]. In models with more than one scalar doublet this is no longer the case, and instead we have an inequality A set of branching ratios to W , Z and h 0 final states can then be represented by a point in three-dimensional space, within the pyramid obtained by the intersection of the coordinate planes and the plane Br(W ) + Br(Z) + Br(h 0 ) = 1, as in figure 4. Notice that the apex of the pyramid is the origin, and the pyramid is resting on a lateral face. Points in the equilateral triangle that is the base of the pyramid saturate the inequality (5.1), i.e. no decays into the new modes involving H 0 k , P 0 k or H ± . As one approaches the origin, these new modes dominate and at the origin Br(W ) + Br(Z) + Br(h 0 ) = 0. This graphical representation does not capture the different weights of the new modes (H 0 k , P 0 k and H ± ) but to have a unique correspondence we would need a polyhedron in five-or seven-dimensional space, which is difficult to draw on a two-dimensional plot. In any case, this representation is useful as the current searches precisely target the W , Z and h 0 decay modes and in principle have less sensitivity to the new ones.
We also plot in figure 4 the branching ratios of the W , Z and h 0 decay modes for the heavy T quark (left) and B quark (right), with tan β ranging from 1 to 10, for the scenario with two scalar doublets and three quark mixing benchmarks. (In the model with an additional scalar singlet the results are very close due to eqs. (3.2) and (3.3).) The results are in agreement with those in figures 1 and 2: (i) In the equal mixing scenario (red), the points corresponding to tan β = 1 are located in the interior of the pyramid and approach the origin as tan β increases.  Although the three-dimensional pyramids are convenient to represent the model predictions, they may not be useful to give the results of searches that cover the full volume. Instead, one can work with triangular slices parallel to the base, with 0 ≤ ρ ≤ 1. One of such slices is represented in figure 5, and is analogous to the triangles sometimes used by the CMS Collaboration to give the results of the heavy quark searches [35,37,42]. The three vertices of the triangle correspond to Br(W ), Br(Z) or Br(h 0 ) equal to ρ. The lines of constant Br(h 0 ) are horizontal and the distance to the base is proportional to Br(h 0 )/ρ. The same can be said about the lines of constant Br(W ) or Br(Z): they are parallel to the opposite side of the triangle, and the distance to that side is proportional to Br(W )/ρ or Br(Z)/ρ, respectively. For illustration, in figure 5 we mark several points with the values of (Br(W ), Br(Z), Br(h 0 )). The details concerning the correspondence of triangle points with branching ratios are given in appendix B.

JHEP06(2017)095
6 Recasting searches: an example Limits on heavy quark masses for arbitrary branching ratios into W , Z and h 0 are obtained by the ATLAS and CMS Collaborations using the following procedure. For a given heavy quark mass, samples are generated corresponding to each pair i, j of decay modes, with i, j = W, Z, h 0 . The signal efficiency after event selection of each combination, which we denote as ij , is calculated from simulation. Then, the efficiency for arbitrary branching ratios of the heavy quark can be written as Given this efficiency, and the measured limit on cross section times efficiency, the limits on cross section can be obtained, which can be translated into limits on the mass of the heavy quark, using the cross section predictions from the theory.
In the presence of new decay modes the procedure is the same, but extending the sum on i, j over additional channels X. The results can be represented in the triangles introduced in the previous section, by making some hypothesis on these additional channels. The first possibility is to assume that the new decays are just invisible to the search, 2 which corresponds to setting iX = 0, XX = 0. That gives a conservative limit on cross sections. The second possibility is to make some hypothesis for the new decays and marginalise over these new degrees of freedom when interpreting the limits on the branching ratios of the standard modes. We will show an example of the latter.
We consider the search for TT production in ref. [64] by the ATLAS Collaboration. This analysis focuses on final states with a single charged lepton, large missing energy (from the invisible decay of the Z boson in T → Zt), and at least four jets, reconstructed with the anti-k T algorithm [65], two of which are large-radius jets with R = 1.0, corresponding to boosted W bosons. Small-radius jets with R = 0.4 are also used, requiring one of them to be b-tagged. where we have ordered the channels as W , Z, h 0 . We note in passing that this matrix has rank three, indicating that the efficiencies do not factorise, that is, they cannot be written as ij =ˆ iˆ j . The search in ref. [64] is performed in a single event category, for which the expected number of background events is 6.1, and the observed number of events is 7. For the luminosity of 36.1 fb −1 used in that measurement, we can obtain a 95% upper  Figure 6. Lower limits on the T quark mass for several values of ρ (see the text), from a recast of the limits of the heavy quark search in ref. [64]. limit on the signal cross section using Feldman-Cousins confidence intervals [66]. The limits obtained are similar to those obtained by the ATLAS Collaboration with a profile likelihood using the CL s method [67].
We recast the search by assuming that the efficiencies of decay modes involving the new channels are similar to the corresponding channels involving T → h 0 t, that is, iX = ih 0 , With the so-calculated efficiency we obtain upper limits on the cross section, which we convert into lower limits on the new quark mass m T , using the TT cross section at nextto-next-to-leading order [68]. We present our results in figure 6, for several values of ρ ranging from 1 to 0.2. For the standard case ρ = 1 our limits are in very good agreement with the ones shown in ref. [64]. We do not present limits for heavy quark masses lower than m T = 800 GeV because the efficiency changes with the mass, and for lower masses the approximation of taking the efficiency for m T = 1 TeV may not be adequate.

Discussion
In this paper we have considered a SM extension with an additional vector-like quark doublet and an extended scalar sector. The generalisation of the minimal vector-like models with one scalar doublet [69] is motivated by supersymmetric SM extensions, which at least have two Higgs doublets H u and H d as in the case of the MSSM. Supersymmetric models with extra scalar singlets are also possible. This is the case of the NMSSM where one extra singlet superfield is introduced to solve the µ problem. In the case of the µνSSM [23], three families of right-handed neutrino superfields are used to solve this problem as well as to generate correct neutrino masses and mixing. As a consequence, Higgses and right sneutrinos can have a sizeable mixing. Compared to standard signatures [24], in the models studied in this paper a wealth of new signals can be produced, among which we can mention the decays T → ttt, T → h 0 h 0 t, B → ttb, B → h 0 h 0 b, mediated by the new neutral scalars, as well as their combination with the standard modes, when the heavy quarks are produced in pairs. The vectorlike doublet has two independent mixing angles in the up and down sectors, s u R and s d R , respectively, which control the relative branching ratios of the charged and neutral decay modes. This freedom, together with the dependence of the new decay modes on the ratio of VEVs tan β, gives rise to a large number of possibilities for the decay of the new quarks, which have been studied in detail in section 4. The decay modes of the T and B quarks in a vector-like doublet are the same that would be produced for other vector-like multiplets. In this sense, the model considered here is representative of the possible new signals for vector-like quark decays in supersymmetric models.
A simple graphical representation of heavy quark branching ratios in three-dimensional pyramids has been given in section 5. For a generalised vector-like quark model, this allows us for example to see at a glance to which extent the collider signals of the heavy quarks T and B in the model under consideration are close to the standard signals searched for by ATLAS and CMS -and therefore covered by them. By using two-dimensional triangular slices, the same data can also be presented in two-dimensional plots. This latter representation is more convenient for the presentation of limits on quark masses from experimental searches, and is a generalisation of the equilateral triangles used by the CMS Collaboration.

JHEP06(2017)095
Heavy quark searches carried out at the LHC cannot cover all the possibilities for the decays of the T and B quarks. But, under reasonable assumptions, the results of experimental searches in the standard decay modes can be interpreted in more general scenarios where the branching ratios to W , Z and h 0 final states do not sum up to one, Br(W ) + Br(Z) + Br(h 0 ) < 1, due to additional channels. One very rough and conservative assumption would be to take the new channels just as invisible for the searches. More refined interpretations can be made by evaluating the efficiencies of the event selection for the new channels, and marginalising the limits obtained over their branching ratios. We have provided one example in section 6, by recasting an existing search. Such generalised interpretations of experimental searches are feasible and should be pursued by the ATLAS and CMS Collaborations.
Finally, we point out that some of the new signatures like multi-top and multi-Higgs production are quite striking and worth exploring with dedicated searches. And, in any case, these new decay modes should be kept in mind when designing the event selection of the searches, to try to make them as inclusive as possible, and sensitive to these new signatures of heavy quarks.

Acknowledgments
The work of J.A. Aguilar-Saavedra has been supported by MINECO Projects

A Decay widths
The partial widths for the heavy quark decays into gauge or SM Higgs bosons are well known, and we collect them here for completeness, together with the partial widths for the new modes, in the case of no mixing with the scalar singlet. When the mixing is significant, the corresponding expressions can be obtained from the ones below with the replacements (3.2) and (3.3).

JHEP06(2017)095
Open Access. This article is distributed under the terms of the Creative Commons Attribution License (CC-BY 4.0), which permits any use, distribution and reproduction in any medium, provided the original author(s) and source are credited.