Collider constraints and new tests of color octet vectors

We analyze the collider sensitivity for new colored resonances in tt¯\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$ t\overline{t} $$\end{document}, bb¯\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$ b\overline{b} $$\end{document}, and jj final states. While searches in the single production channel are model-dependent, the pair production rate is model independent and the existing (J J )(J J ) and 4t searches impose strong constraints on the relevant branching fractions, where J = j or b. We point out the missing, complementary searches in the mixed decay modes, tt¯jj\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$ t\overline{t}(jj) $$\end{document}, tt¯bb¯\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$ t\overline{t}\left(b\overline{b}\right) $$\end{document}, and bb¯jj\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$ \left(b\overline{b}\right)(jj) $$\end{document}. We propose analysis strategies for the tt¯jj\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$ t\overline{t}(jj) $$\end{document} and tt¯bb¯\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$ t\overline{t}\left(b\overline{b}\right) $$\end{document} decays and find their sensivity surpasses that of existing searches when the decay widths to tops and light jets are comparable. If no other decays are present, collective lower limits on the resonance mass can be set at 1.5 TeV using 37 fb−1 of 13 TeV data.


Introduction
Searches for new particles and new forces beyond the Standard Model (BSM) are a critical endeavor for the ATLAS and CMS experiments at the Large Hadron Collider (LHC), but such results have thus far come up null. The largest rates come from colored particle pair production, where leading order cross sections can be calculated knowing only the color charge and mass [1]. Even so, the colored particle decay patterns and corresponding collider signatures are highly model dependent.

JHEP09(2017)101
Given the possibility that the color octet vector has flavor dependent branching fractions to quark pairs, and because color octet vectors have a model independent pair production rate, the mixed decay signature of a paired ditop and dijet resonance is strongly motivated. This channel is complementary to the existing (JJ)(JJ) and 4t searches and even offers superior sensitivity when the branching fractions of the resonance to dijets and ditops are comparable.
In section 2, we review the theory motivation and collider phenomenology of massive color octet vectors. In section 3, we analyze the prospects for discovering color octet vector resonances in the tt(jj) and tt(bb) mixed decay modes at the LHC and compare with the current constraints. We conclude in section 4.

Theory background
Massive color octet vector resonances arise in various different beyond the Standard Model extensions, such as models with extended color gauge groups or models with extra dimensions. In the unbroken phase of electroweak symmetry, the general interaction Lagrangian between quarks and a massive color octet vector X µ is where g S is the strong coupling constant, T a are the SU(3) generators, and λ, κ, and η are the flavor-dependent couplings in the quark gauge basis. While these matrices must be symmetric by CP T , nonzero off-diagonal entries are possible in principle and correspond to tree-level flavor violation. Since these processes are strongly constrained by low-energy precision flavor measurements, such as meson mixing measurements and b → X s γ transitions [50,51], the simplest ansatz is to adopt a flavor-universal coupling structure, evading the most stringest flavor bounds. In such a scenario, however, the branching ratio for X to light quarks vs. tops is fixed, and there is no model freedom in the complementarity between searching in dijet vs. ditop resonances. Hence, we will focus on the scenario where the λ, κ, and η matrices are diagonal but not universal in the quark gauge basis. Moving to the quark mass basis will then induce off-diagonal entries proportional to Cabibbo-Kobayashi-Maskawa (CKM) mixing. We will first briefly review models of massive color octet vectors and then discuss the collider and flavor physics phenomenology of the general Lagrangian, eq. (2.1).

Color octet vectors from extended color gauge groups
In models with an extended color symmetry, such as a SU(3) 1 × SU(3) 2 gauge group, the two parent gauge groups are typically broken to the diagonal subgroup by the vacuum expectation value (vev) of a bifundamental, complex scalar field Σ [3,8]. The diagonal subgroup is then identified with the SM SU(3) c gauge group, which imposes the requirement where h 1 and h 2 are the gauge couplings of SU(3) 1 and SU(3) 2 , respectively. The Goldstone modes of the complex scalar field become the longitudinal degrees of freedom for the heavy JHEP09(2017)101 color octet vector, leaving one real and one pseudoreal color singlet scalar and one real color octet scalar as the dynamical scalar fields below Σ . Explicitly, the covariant derivative for Σ is and after Higgsing SU(3) 1 × SU(3) 2 → SU(3) c , we get the SM gluon and coloron fields, In this setup, different possibilities for the couplings in eq. (2.1) originate by considering various charge assignments of the quarks in the parent SU(3) 1 × SU(3) 2 gauge symmetry. The main feature for universally coupled models is that all flavor representations are assigned identically to the same gauge representation, which ensures that the gauge symmetry commutes with the global SM quark flavor symmetry.
In the coloron model [3,8], all SM quarks transform as under one SU(3) gauge group and singlets under the other. Hence, the coloron has flavor universal, purely vector couplings to the SM quarks as g s tan θqγ µ T a X a µ q . (2.5) An alternative prescription is the chiral color model [4,9,52], where left-handed (LH) and right-handed (RH) quark fields are charged under different SU(3) gauge groups. This construction generally requires new fermions to cancel anomalies, notably SU(3) 2 1 × U(1) Y and SU(3) 2 2 × U(1) Y , but this new matter content can be massive and unobservable at colliders. As a result, if the LH quarks transform as ( , 1) and the RH quarks transform as (1, ) under SU(3) 1 ×SU(3) 2 , for example, the resulting massive color vector interaction with quarks is where X a µ is commonly referred as an axigluon in the literature. To motivate a non-universal yet diagonal coupling structure in eq. (2.1), we can straightforwardly assign different quark flavors to different gauge representations under SU(3) 1 × SU(3) 2 . For example, the topcolor model charges the third generation quarks differently than the first two generations, with Q 1,2 . This assignment also requires additional matter to cancel anomalies, for which a minimal solution involves two electroweak singlet quarks transforming as (1, ) and ( , 1), each with hypercharge −2/3. The corresponding massive color octet vector does not have flavor-changing couplings in the quark gauge basis, but instead features distinct couplings to light and heavy generation quarks: with tan θ = h 1 /h 2 as before. Although topcolor models are generally motivated by composite Higgs scenarios triggered by top quark condensation [2], we will only focus on the motivated possibility that X µ has non-universal couplings.

Color octet vectors from extra dimensions
Models with extra spacetime dimensions provide an alternative framework for realizing massive color octet vector resonances [11][12][13]. In such models, the SM fields are the lowestlying states of a Kaluza-Klein tower, whose masses and dynamics result from solving the five-dimensional equations of motion [16][17][18][19][20]. In minimal universal extra dimensions [53], the level-2 KK gluon obtains a coupling to SM quarks from one-loop diagrams with level-1 KK particles running in the loop. These couplings are generated from boundary conditions on the KK gluon and the bulk masses, which provide the only source of translational invariance breaking, and read where Y u = 2 for up-type quarks, Y d = 1/2 for down-type quarks, Λ is an ultraviolet scale larger than the inverse size of the extra dimension, and µ is the renormalization scale to evaluate the coupling. In Randall-Sundrum warped scenarios [14,15], the fermion mass hierarchy can be explained by allowing fermions to propagate in the bulk, where the observed charged fermion mass hierarchy originates as O(1) differences in bulk mass parameters. Typically, the KK mass scale must then be O(5-10 TeV) to satisfy low-energy flavor violation probes, espe-ciallyK − K mixing [24], but this scale can be lowered in the case that the bulk fermions obey a flavor symmetry [54,55]. Since KK parity is absent, the first KK gluon decays to SM zero-mode quarks, and this coupling is given by calculating the wavefunction overlap between the zero modes and the KK gluon in the extra dimension. Using the general coupling structure in eq. (2.1) and identifying X µ with the first KK gluon, where RH up-type couplings are obtained by replacing λ → κ and Q → u, RH down-type couplings are obtained by replacing λ → η and Q → d, m X ≈ 2.4M KK is fixed by the boundary conditions of the 5D gluon, L is the length of the extra dimension, and c Q , c u , and c d are the bulk mass parameters for LH and RH quark fields [25]. In order to reproduce the known SM quark masses, these bulk mass parameters must be chosen to maximize the top quark wavefunction overlap with the TeV-scale infrared brane while the wavefunctions for the light quarks are skewed towards the ultraviolet brane. As a result, the first KK gluon preferentially decays to top quarks, with branching fractions that can exceed 80% [25].

Non-universal couplings and flavor constraints
As we have emphasized, massive color octet vectors arise in numerous models of beyond the Standard Model physics. Their collider and flavor physics phenomenology depends crucially on the particular λ, κ, and η structure defined in eq. (2.1) that is realized in a given model. Given the stringent constraints on tree-level flavor changing neutral currents [50,51], we

JHEP09(2017)101
adopt flavor-diagonal couplings for λ, κ, and η in the gauge basis. Nevertheless, flavor violating effects are still induced in interactions of LH down quarks by the rotation to the quark mass basis. From eq. (2.1), we rotate the quark fields to the mass basis by We see that the λ, κ, and η matrices can be chosen such that the effective interaction matricesλ,κ, andη are diagonal in the quark mass basis, The corresponding LH down quark interactions have small, off-diagonal entries induced by and hence X µ mediates tree-level flavor-changing neutral currents (FCNCs). Since the strongest FCNC constraints come fromK 0 − K 0 mixing [50], we minimize the impact of these constraints by assumingλ 11 =λ 22 =λ 33 , which leads toλ D,12 ≈λ D,21 ≈ −(3.3 − 1.3i) × 10 −4 (λ 33 −λ 11 ), using global fit values for the CKM elements [57]. A tree-level exchange of X µ can be matched to the four-fermion operator [24,50,51,[58][59][60]] with the Wilson coefficient (2.14) Using the requirement Λ > 1.1 × 10 3 TeV from Re C 1 K and Λ > 2.2 × 10 4 TeV from Im C 1 K [50], we can constrain the maximum size ofλ 11 ,λ 33 , assuming the other is vanishing: We see that these constraints are easily satisfied for O(TeV) scale color octets as long as λ ∼ O(0.1). Moreover, with this structure,λ 11 =λ 22 , the stronger constraints come from that an alternative assumption of the flavor structure can relax these bounds further. In particular, if instead V † CKMλ V CKM is diagonal, then the tree-level flavor violating couplings are shifted to the LH up-quark couplings [58,59]. We can defineλ = V † CKMλ V CKM as diagonal, and then the LH up-quark couples via V CKMλ V † CKM , which is constrained by D 0 −D 0 mixing, where Λ > 700 TeV [50]. The corresponding bound is The ∆F = 1 constraints, including b → X s γ and b → X s g penguin amplitudes, are also immediately satisfied if the X µ couplings are aligned in the down-quark sector [51,59].

Collider phenomenology of color octet vectors
Color octet vectors can be singly and doubly produced at colliders. The single-production rate scales with the corresponding partial width into qq, q = d, u, s, c, since single production via gluons is forbidden at tree-level. In our scenario, the induced flavor-violating couplingsλ D are at most 5% ×λ 11 ,λ 33 , which we will neglect and hence approximatẽ λ D ≈λ. The partial width of X to a pair of quarks q is where g L and g R are the corresponding diagonal entries inλ,κ, andη. 1 If the masses of the quarks can be neglected compared to the X mass, the partial width simplifies to The branching fractions for jj, bb, and tt final states are then simply ratios of the corresponding sum of squared couplings. We see that large branching fractions to top quarks can easily be realized by increasingκ 33 , while large branching fractions to bottom quarks corresponds to increasingη 33 . This is the effective description of the warped extra dimension scenario with t R and b R wavefunction profiles peaked close to the infrared brane [25], and small hierarchies in these third generation couplings are consistent with electroweak precision tests [58,59]. 1 For reference, the generalized flavor violating partial width is where g ij L = g ji L and g ij R = g ji R .

JHEP09(2017)101
As previously highlighted, the single dijet resonance constraints scale with the overal partial width into light flavor quarks. Pair-production rates, however, are robustly calculable knowing only m X and its color octet representation. Hence, all searches in pair-production modes provide important complementary reach compared to single resonance searches. The current LHC analyses focus on the simplest topologies, with XX * → (JJ)(JJ), with J = j or b inclusively [26-31] and XX * → 4t [32-38]. In the case where the X → bb decay width is preferred, additional signal discrimination is easily gained by requiring b-tags. The orthogonal (bb)(bb), (bb)(jj), and (jj)(jj) signal regions would then have enhanced and complementary sensitivity compared to the current (JJ)(JJ) searches. If the coupling to tops is preferred, then the 4t search and our proposed searches in the tt(jj) and tt(bb) mixed decay channels are critical. In particular, the tt(jj) and tt(bb) mixed decay searches offer substantial improvements in covering the sensitivity gap when the X decay widths to tops and light quarks are comparable. In the next section, we describe our collider analyses optimized for the tt(jj) and tt(bb) final states.

Collider analyses of the mixed channels, tt(jj) and tt(bb)
We analyze pair-produced resonances in a new mixed decay mode, pp → XX * → tt(jj) and pp → XX * → tt(bb). Although there are numerous possibilities for the top decays, we mainly focus on the semi-leptonic and fully leptonic final states, which provide clean handles for tagging the reconstructible tt and dijet systems. Of course, the main SM background is the irreducible tt+ jets background, where other single boson and diboson + jets backgrounds are subleading after requiring multiple b-jets.
We  [63], interfaced with Pythia v8.2 [64,65] for showering and hadronizations. We remark that the leading order calculation allows a direct comparison to existing (JJ)(JJ) and 4t search limits [26-38]. Since the signal will rely on tagging two top candidates, we simulate the SM background, ttj with up to two additional jets at leading order, using Sherpa v.2.1.0 [66]. We rescale the background by a flat K-factor of 1.5, adopted from Sherpa+BlackHat [66,67]. The inclusive SM tt + jets production cross section is known at next-to-next-to-leading order and next-to-next-to-leading log (NNLL) precision [68], whereas differential cross sections can be obtained at next-to-leading order and NNLL precision [69]. Since our X resonance should appear as a resonant peak over a smooth continuum background, a p T -dependent K-factor should not significantly affect our projected results.

Event selection strategy
We first discuss the semi-leptonic top decay channel, where our signal process is XX * → bb ± νjj(JJ), with J = j or b. Jets are clustered using the anti-k T algorithm [70] with R = 0.5, and we require jets to have p T > 50 GeV and |η| < 4.9. We identify bjets using a Delphes v3.1.2 [71] detector simulation, with a p T -and η-dependent tagging efficiency of about 70% for displaced tracks from B-mesons within ∆R < 0.3 from the main jet axis; the charm misidentification rate is roughly 15% and the light flavor mistag rate is 0.1%.

JHEP09(2017)101
Events must have at least 5 jets, at least two of which must be b-tagged and one must be untagged. The leading b-tagged and untagged jets must have p T ≥ 250 GeV, and the subleading untagged jet, if present, must have p T ≥ 80 GeV. Events must also have exactly one isolated lepton with p T > 20 GeV and |η| < 2.5, with isolation using Delphes default parameters. We furthermore cut on missing transverse energy (MET), requiring / E T > 80 GeV, as well as signal mass-optimized H T = Σ j |p T,j | ≥ (4/3) m X .
Naively, the X → JJ signal resonance is extracted from forming the invariant mass of the two leading jets. The jet combinatorics, however, present a major hurdle against using the dijet and ditop masses to discriminate the signal from the irreducible background. Thus, the main goal of our collider strategy is to solve the combinatorial ambiguity, taking advantage of the resonant high mass dijet signal, the large p T of the resonant dijet system, and the relevant angular spread between the b-jets, lepton, and jets. Difficulties in resolving multijet combinatorial ambiguities are discussed in, e.g., [72].
For this purpose, we define two signal regions. We target the bb mode by selecting events with more than two b-tagged jets, while the jj mode is optimized by requiring exactly two b-tagged jets. For the bb decay, we assume that the leading b-tagged jet comes from the X → JJ decay directly, not from tt. We then reconstruct the bb system by adding the remaining leading jet, whether tagged or untagged. We find that this reconstruction best reflects the dijet resonance in spite of the underlying combinatorial ambiguity.
For the jj mode, we start with the leading light jet j 1 and add to it the hardest light jet j 2 which satisfies ∆R j 1 j 2 ≤ π. We also add in the next hardest light jet j 3 with ∆R j 1 j 3 ≤ π if j 1 and j 2 are not balanced in p T , when p T,j 2 /p T,j 1 ≤ 0.15. This follows the hemisphere intuition, where the X → jj decays should be untagged and relatively hard. Adding the third hardest light jet accounts for the wide-angle final state radiation of our signal quarks.
For both bb and jj decay modes, we construct the dijet invariant mass as our final kinematic discriminant. The signal and background cut efficiencies for the semileptonic analysis are shown in table 1, while the most salient kinematic distributions for the background stacked with different signal hypotheses are shown in figure 1. The upper left panel in figure 1 shows the hardening of the H T distribution coming from the signal jets. The dijet p T,JJ distribution, however, only offers an overal rate shift from the additional signal events and no strong correlation with the signal X mass, which is because of the combinatorial ambiguity among the jets. The bottom panels show the invariant mass distributions in the jj and bb targetted modes. Again, the broad peak structure arises mostly from the combinatorial ambiguity in capturing the correct signal jets to reconstruct the resonance. We note that b-tagging efficiency and the combinatorial ambiguity also cause X → jj events to populate the m bb signal region and vice versa.
The search in the fully leptonic top quark decay channel is very similar. We again select jets and leptons as in the semi-leptonic channel, but we require only 4 jets, at least two of which are b-tagged, and also require exactly two isolated leptons of opposite charge. We loosen the MET cut, / E T > 50 GeV, and keep the H T cut, H T ≥ (4/3) m X . To avoid the anticipated Z+jets background we veto events with m ≤ 115 GeV. Again we distinguish between bb and jj dijet resonance decay modes, using the same method as the semi-leptonic search. The corresponding cut flow is presented in  Table 1. Cut flow for different resonance masses m X and dominant background tt+jets for the semi-leptonic search. All branching ratios are applied to signal and background when quoting cross sections. We normalize the signal assuming Br(X → tt) = Br(X → JJ) = 50%.  Table 2. Cut flow for a different resonance masses m X and dominant background tt+jets for the fully leptonic search. All branching ratios are applied to signal and background when quoting cross sections. We normalize the signal assuming Br(X → tt) = Br(X → JJ) = 50%.
the same relative signal to background ratios as the semi-leptonic analysis, but the absolute rate is only an ≈ 5% additional contribution compared to the semi-leptonic channel.

Comparison with current searches
We now compare the projected sensitivity from the mixed tt(JJ) searches in combination with the recasted exclusions from ATLAS and CMS for (JJ)(JJ) and 4t searches. We also show the single production limits for dijet and ditop resonance searches. Since we assume that our new physics state X only decays to quark pairs, we can express the pair production constraints in the branching fraction vs. mass plane, where Br(X → tt) = 1 − Br(X → JJ) . (3.1) So, the pair production limits can be translated according to: with Br JJ = Br(X → JJ). The 4t constraint and the tt(JJ) projected exclusion after replacing (Br JJ ) 2 with (Br tt ) 2 and 2(Br JJ Br tt ), respectively, where Br tt = Br(X → tt).
The single dijet resonance limits are determined only after specifying the total width of the resonance. If the total width is narrow, a reference cross section can be rescaled by the partial width into light quarks. We see that In the case of tt resonances, the above constraint becomes a bounded requirement on the branching fraction to tops. Hence, the tt resonance constraint follows Note that here we drop the acceptance factor since the experiments unfold the acceptance when presenting their results. We combine all four orthogonal signal regions of the semileptonic and fully leptonic search and compute the 95% C.L. limits based on the respective JJ invariant mass shapes, where we assume a 10% systematic uncertainty on signal and background. The result can be found in figure 2.

JHEP09(2017)101
[GeV] We remark that the width of our resonance, Γ X = 5 × 10 −4 m X , corresponds to diagonal entries ofλ,κ,η 0.1. As discussed in subsection 2.3, such LH quark couplings to X readily satisfy flavor violation bounds from meson oscillation measurements and neutral current transitions given m X > 1 TeV. On the other hand, these couplings generally arise from mixing the SM quarks with heavy vectorlike states, since otherwise perturbativity in the parent extended color gauge symmetry is violated [48]. The corresponding flavor violation bounds, collider constraints, electroweak precision observable tests are more model-dependent, but realistic and complete scenarios can be constructed [51,58,59].
As mentioned previously, the sensitivity from single production compared to the sensitivity from pair production strongly depends on the ratio Γ X /m X . Any direct resonance bounds from JJ searches could in principle be evaded completely with a suitably small choice of Γ X , but choosing Γ X /m X = 5×10 −4 allows complementary dijet constraints from CMS and ATLAS [39,40]. We remark that the tt resonance limits [47] are absent from JHEP09(2017)101 figure 2 for Γ X /m X = 5×10 −4 . These constraints are only relevant once Γ X /m X 7×10 −4 for m X around 1 TeV. As shown in eq. (3.4), the tt resonance limit is symmetric around Br tt = 50% since the maximum rate in this channel corresponds to equal partial widths to dijets and ditops.
The strongest existing bounds in figure 2 are therefore from (JJ)(JJ) [31] and 4t [38] searches, which are clearly optimal for their respective Br JJ and Br tt corners. The mass reach of both searches weakens by about 250 GeV in the intermediate regime, however, leaving significant room for our dedicated tt(JJ) search to explore. Our search will probe masses of up to 2 TeV at the HL-LHC. We expect the (JJ)(JJ) and 4t to reach a similar sensitivity in the respective Br JJ and Br tt corners at 3 ab −1 .
In figure 2, we assume that all quark couplings are flavour universal except for the top. We relax this assumption in figure 3, allowing both branching fractions Br(X → bb) = Br bb and Br tt to float. The results are presented in an equilateral triangle since the sum of the jj, bb and tt branching fractions must equal 100% in our model. The shading in the left panel of figure 3 shows the lower limit on the resonance mass m X as a function of the three branching fractions. The right panel of figure 3 indicates which particular dedicated search yields the corresponding lower mass limit. We see that our new search channels, tt(jj) and tt(bb), overtake the sensitivity in the central areas of the triangle compared to the existing (JJ)(JJ) and 4t searches.
We reiterate that a complete characterization of tt, bb, and jj decay channels for pair production colored resonances would necessitate optimizing the current (JJ)(JJ) search into (bb)(bb), (bb)(jj), and (jj)(jj) signal regions. In particular, the (bb)(bb) search would bear striking similarities with the current searches for pair production of the 125 GeV Higgs [73,74], where the main novelty would be varying the (bb) mass window to test for new resonances. The multijet background, however, is very challenging to simulate and thus substantial statistics in the b-tagged backgrounds would be required to suitably smooth paired invariant mass spectrum in the (bb)(bb) and (bb)(jj) channels.

JHEP09(2017)101 4 Conclusion
In this work, we have highlighted the tt(jj) and tt(bb) mixed decay channels of a massive, color octet vector as new targets for ATLAS and CMS searches. Hierarchies in the underlying couplings of the X resonance to light quarks, bottom pairs, or top pairs are entirely consistent with low energy FCNC constraints if the X mass is above 1 TeV and its couplings to quarks are at most 0.1. As a result, the LHC provides the leading reach to TeV-scale color octet vectors with variable couplings to heavy and light flavor quarks by virtue of the model independent pair production rate.
In our tt(JJ) analyses, we focused on resolving the jet combinatorial ambiguity to reconstruct the dijet or dibottom resonance. In principle, reconstructing the (tt) resonance is also possible, but our scenario with its many resolved jets did not afford any additional signal discrimination in this regard.
Nevertheless, our results show that new tt(jj) and tt(bb) searches will fill a sensitivity gap between the (JJ)(JJ) and 4t searches. This gap is clear in the Br JJ vs. m X plane, which itself provides a useful tool for easily presenting the results from different collider searches of pair-produced resonances. We stress that a post-discovery scenario of a new resonance greatly benefits from this complementary information, where single and pair production modes combined with different decay channels provide direct information about underlying Lagrangian couplings.