1 Introduction

The parity-violating gauge symmetries and spontaneous/explicit breaking of these symmetries for the hierarchy pattern of fermion masses have been at the center of a conceptual elaboration that has played a major role in donating to mankind the beauty of the Standard Model (SM) and possible scenarios beyond SM for fundamental particle physics. A simple description is provided on the one hand by the composite Higgs-boson model or the Nambu-Jona-Lasinio (NJL) model [1] with effective four-fermion operators, and on the other by the phenomenological model of the elementary Higgs boson [2,3,4,5,6,7]. These two models are effectively equivalent for the SM at low energies. After a great experimental effort for many years, using pp collision data at \(\sqrt{s} = 7, 8\) TeV at the Large Hadron Collider (LHC), the ATLAS [8] and CMS [9] collaborations have shown the first observations of a 125 GeV scalar particle in the search for the SM Higgs boson [10, 11]. This far-reaching result begins to shed light on this most elusive and fascinating arena.

Recently, in the Run 2 of the upgraded LHC, studies on \(\sqrt{s}\) = 13 TeV pp collision data are performed by ATLAS and CMS to search for new (beyond the SM) resonant and/or non-resonant phenomena [12,13,14,15,16]. These studies are continuously pushing up exclusion bounds on the parameter spaces of many possible scenarios beyond SM [17,18,19,20]. Among these models, are of particular interest composite-fermion scenarios that have offered a possible solution to the hierarchy pattern of fermion masses [21,22,23,24]. In this context [25,26,27,28,29], the assumption is that SM quarks “q” and leptons “\(\ell \)” are assumed to be bound states of some not yet observed fundamental constituents generically referred to as preons and to have an internal substructure and heavy excited states F of masses \(m_F^*\) that should manifest themselves at the high energy compositeness scale \(\Lambda \). Exchanging preons and/or binding quanta of unknown interactions between them results in effective contact interactions of SM fermions and heavy excited states. While different heavy excited states have been considered in literature [30,31,32], below, we take as a reference the case of a heavy composite Majorana neutrino, \(N_\ell \), for which the interaction Lagrangian would be \((g_*/\Lambda )^2{{\bar{q}}}_L\gamma _\mu q_L {{\bar{N}}}_\ell \gamma _\mu \ell _L \). Its theoretical studies and numerical analysis have been carefully elaborated in [33, 34]. Moreover, an experimental analysis of \(\sqrt{s}\) = 13 TeV pp collisions at the LHC of the process \(pp\rightarrow \ell N_\ell \rightarrow \ell \ell qq\) of the dilepton (dielectrons or dimuons) plus diquark final states has been carried out by the CMS collaboration [35] excluding the existence of \(N_\ell \) for masses up to 4.60 (4.70) TeV at \(95\%\) confidence level, assuming \(m_{N_{\ell }} = \Lambda \).

In this article, we present phenomenological studies of new composite states according to a scenario recently proposed in Refs. [43, 44] that relies on the four-fermion operators (interactions) of the NJL type and has escaped the spotlight of the LHC searches so far. The four-fermion interactions beyond SM considered in this new model are motivated by the theoretical inconsistency [36,37,38] between the SM bilinear Lagrangian of chiral gauged fermions and the natural UV regularization of unknown dynamics or quantum gravity, that implies quadrilinear four-fermion interactions (operators) of the NJL type, or Einstein-Cartan type [39,40,41,42], at high energies. On the basis of SM gauge symmetries, four-fermion operators of SM left- and right-handed fermions (\(\psi _L,\psi _R\)) in the charge sector “\(Q_i\)” and flavor family “f” can be written as

$$\begin{aligned} \sum _{f=1,2,3}G\, \Big [{{\bar{\psi }}}^{f}_{_L}\psi ^{f}_{_R}{{\bar{\psi }}}^{f}_{_R} \psi ^{f}_{_L}\Big ]_{Q_i=0,-1,2/3,-1/3}. \end{aligned}$$
(1)

From the point of view of an effective theory, these effective operators are attributed to the new physics at the high energy cutoff \(\Lambda _{\mathrm{cut}}\).

The effective coupling G (1) has two fixed points: (i) the weak-coupling infrared (IR) fixed point and (ii) the strong-coupling ultraviolet (UV) fixed point. In the scaling domain of IR fixed point of the weak four-fermion coupling G at the electroweak scale \(v\approx 239.5\) GeV, effective operators (1) give rise to SM physics with tightly composite Higgs particle via the NJL mechanism, and also offers possible solution to the hierarchy pattern of fermion masses [43, 45,46,47,48,49,50,51,52,53,54,55,56]. The heaviest top quark mass is generated by the spontaneous breaking of SM gauge symmetries in the top sector (in Eq. 1) [59] with a \(t{{\bar{t}}}\) bound state as a candidate for the SM Higgs particle, and three Goldstone bosons becoming the longitudinal modes of massive gauge bosons \(W^\pm \) and \(Z^0\). The reason why only the top sector undergoes the condensation is due to the energetically favorable ground state of NJL interactions (Eq. 1), as shown in Refs. [46, 60]. Other SM fermion masses are generated by the explicit breaking of SM gauge symmetries due to the CKM flavor mixing of three SM generations [43]. Most importantly, the measured Higgs mass makes it possible to uniquely determine the solutions of the renomalization group equations for the form factor and quartic interaction of the composite Higgs particle [69,70,71]. The extrapolation of these solutions to TeV regime implies that the composite Higgs is a tighly bound state and a strong-coupling dynamics occurs. In the scaling domain of UV fixed point of the strong four-fermion coupling G at the composite scale \(\Lambda \sim {{{\mathcal {O}}}} \) (TeV), composite fermions (bosons) form as bound states of three (two) SM elementary fermions and they couple to their constituents via effective contact interactions [44, 61,62,63,64,65,66,67,68].

We focus on the composite particles arising from four-fermion operators of NJL type, with massive (\(m_F\)) composite fermions \(F^{f}_R\sim \psi ^{f}_{_R}({{\bar{\psi }}}^{f}_{_R} \psi ^{f}_{_L})\) (bound states of three SM fermions) and massive (\(m_\Pi \)) composite bosons \(\Pi ^{f}\sim ({{\bar{\psi }}}^{f}_{_R} \psi ^{f}_{_L})\) (bound states of two SM fermions) forming in the scaling domain of a UV fixed point of the strong four-fermion coupling G at the composite scale \(\Lambda > rsim m_F > rsim m_\Pi \) [44, 69,70,71]. The effective coupling between the composite fermion (boson) and its constituents is given by the following contact interaction, which describes composite particle \(F^{f}\) (\(\Pi ^{f}\)) production and decay:

$$\begin{aligned}&(g_*/\Lambda )^2{{\bar{\psi }}}^{f}_{_L}({{\bar{\psi }}}^{f}_{_L} \psi ^{f}_{_R}) F^{f}_{_R} ~ + ~ {{\mathrm{h.c.}}}, \end{aligned}$$
(2)
$$\begin{aligned}&(F_\Pi /\Lambda )^2({{\bar{\psi }}}^{f}_{_L} \psi ^{f}_{_R}) \Pi ^{f} ~ + ~ {{\mathrm{h.c.}}}, \end{aligned}$$
(3)

where \((g_*/\Lambda )^2\) is a phenomenological parameter, and one can choose \(g_*^2=4\pi \) so that \(4\pi /\Lambda ^2\) is a geometric cross-section in the order of magnitude of inelastic processes forming composite fermions (Fig. 1). Whereas, \((F_\Pi /\Lambda )^2\) is the Yukawa coupling between composite boson (Fig. 2) and two fermionic constituents, and \((g_*/F_\Pi )^2\) relates to the form factor of composite boson. The composite fermion is in fact a bound state of an SM fermion and composite boson, namely \(F^f_R\sim \psi ^f_R\Pi ^f\). The composite scales \(\Lambda \) and \(F_\Pi \) can only be experimentally determined like the electroweak scale v. The composite-fermion (-boson) mass \(m_F, m_\Pi \propto \Lambda \) and the proportionality is of the order of unity.

Fig. 1
figure 1

A lepton \(\ell \), two quarks q (u-type) and \({{\bar{q}}}\) (d-type) form a composite fermion F via the contact interaction (dark blob) \(P_{L,R}(g_*^2/\Lambda ^2)\), where \(P_{L,R}=(1\mp \gamma _5)/2\). The thin solid line represents an SM elementary fermion, and the thick double line represents a composite fermion F. By a crossing symmetry applied to the lepton line \(\ell \rightarrow \ell ^\dagger \) (dashed line) the same diagram describes a \(2\rightarrow 2 \) production process \(q{{\bar{q}}} \rightarrow \ell ^\dagger F\)

Fig. 2
figure 2

We show the Feynman diagrammatic representation for the contact interaction between the composite boson and its constituent quarks, where the thin solid line represents an SM elementary fermion, double wave line represents a composite boson, and the blob represents an interacting vertex \((F_\Pi /\Lambda )^2P_{L,R}\)

Analogously to composite-fermion scenarios mentioned above where new particles originate from preons (for more details see Refs. [21,22,23,24,25,26,27,28,29,30,31,32]) the present scenario in the domain of UV fixed point has two model-independent properties that are experimentally relevant: (a) the existence of composite fermions; (b) the existence of contact interactions, in addition to SM gauge interactions, which represents an effective approach for describing the effects of the unknown internal dynamics of compositeness. However, the present scenario is not only conceptually, but also consequently and quantitatively rather different from the previous composite-fermion scenarios. In fact, the composite fermions are formed as bound states of SM fermions, not preons, by strong four-fermion interactions of SM fermions at high energies and they further have different contact interacting processes. Therefore, it deserves more detailed phenomenological studies to reveal new features of the present scenario that are relevant to LHC experiments. This is the aim of this article and we find that the model foresee a large number of new composite particles that could appear in signatures not yet investigated and hence of great interest for the ongoing LHC physics program related to searches of physics beyond SM.

The model parameters in Eqs. (2) and (3) are unique for all SM fermions f and composite fermions F and bosons \(\Pi \) together with their interacting channels and we aim to study them for detailing the complete phenomenology of F, for all the corresponding flavors “f”. In Sect. 2 composite fermions’ constituents and effective contact interactions among them are discussed considering the model in Eq. (1) with contact interactions of Eqs. (2) and (3). The production cross sections and decay widths of these composite fermions are calculated in Sect. 3, while in Sect. 4 the search for F, for all its flavors, is outlined deriving the final states and their topology that are relevant for its discovery at the LHC. It turns out that there is a wide range of new physical states that deserve dedicated searches at the LHC in order to investigate the entire phase space in which F can manifest. In Sect. 5, we take advantage of the aforementioned heavy composite Majorana neutrino N experimental studies [33, 34] in the channel \(pp\rightarrow N e^- \rightarrow e^-e^- qq'\) to determine some constraints on the model parameters. We further compute 5\(\sigma \) contour plots of the statistical significance and highlight the region of parameter space where F can appear in the same channel using 3 \(\hbox {ab}^{-1}\), as an example of the sensitivity to this model for a particular flavor of F. Finally, we summarize the work with some closing remarks in Sect. 6.

2 Four-fermion operators and contact interactions

In this section we describe the four-fermion operators and contact interactions that are relevant for the study of the phenomenology of the composite fermions at pp or ep collisions, including the LHC, which will be detailed in Sect. 3.

2.1 Composite fermions F

We consider, among four-fermion operators (1), the following SM gauge-symmetric and fermion-number conserving four-fermion operators,

$$\begin{aligned}&G\left[ ({{\bar{\ell }}}^{i}_Le_{R})({{\bar{d}}}^a_{R}\psi _{Lia}) +({{\bar{\ell }}}^{i}_L\nu ^e_{R})({{\bar{u}}}^a_{R}\psi _{Lia})\right] + {{\mathrm{h.c.}}}, \end{aligned}$$
(4)
$$\begin{aligned}&G\left[ ({{\bar{\psi }}}^{bi}_Ld_{Rb})({{\bar{d}}}^a_{R}\psi _{Lia}) +({{\bar{\psi }}}^{bi}_Lu_{Rb})({{\bar{u}}}^a_{R}\psi _{Lia})\right] + {{\mathrm{h.c.}}}, \end{aligned}$$
(5)

being the SM doublet \(\ell ^i_L=(\nu ^e_L,e_L)\) and singlet \(e_{R}\) with an additional right-handed neutrino \(\nu ^e_{R}\) for leptons; \(\psi _{Lia}=(u_{La},d_{La})\) and \(u^a_{R}, d^a_{R}\) for quarks, where the color ab and \(SU_L(2)\)-isospin i indexes are summed over. Equation (4) or (5) is for the first family only, as a representative of the three fermion families. The SM left- and right-handed fermions are mass eigenstates, their masses are negligible in TeV-energy regime and small mixing among three families encoded in G is also neglected [43].

Table 1 Four-fermion operators in Eq. (4) and possible composite fermions F and composite bosons \(\Pi \). The color a index is summed
Table 2 Four-fermion operators Eq. (5) and possible composite fermions F. The color a index is summed
Table 3 Composite fermions \(F_R\), their constituents and SM quantum numbers
Table 4 Composite fermions \(F_R\), their constituents and SM quantum numbers

In Eqs. (4) and  (5), each four-fermion operator has the two possibilities to form composite fermions, listed in Tables 1 and 2. Up to a form factor, E (N) or D (U) indicate a composite fermion made of an electron (a neutrino) or a down quark d (an up quark u) plus a color-singlet quark pair \(\Pi \), and its superscript for electric charge. In Eq. (4), there are four independent composite fields F: \(E^0_R\), \(N_R^-\), \(E^-_R\), \(N_R^0\) and their Hermitian conjugates: \({{\bar{E}}}^0_L=(E^0_R)^\dagger \gamma _0\), \(\bar{N}^+_L=(N^-_R)^\dagger \gamma _0\), \(\bar{E}^+_L=(E^-_R)^\dagger \gamma _0\), \(\bar{N}^0_L=(N^0_R)^\dagger \gamma _0\). Analogously, in Eq. (5), there are four independent composite fields F: \(D^{2/3}_{Ra}\), \(U_{Ra}^{-1/3}\), \(D^{-1/3}_{Ra}\), \(U_{Ra}^{2/3}\) and their Hermitian conjugates: \({{\bar{D}}}^{-2/3}_{La}=(D^{2/3}_{Ra})^\dagger \gamma _0\), \({{\bar{U}}}^{1/3}_{La}=(U_{Ra}^{-1/3})^\dagger \gamma _0\), \(\bar{D}^{1/3}_{La}=(D^{-1/3}_{Ra})^\dagger \gamma _0\), \(\bar{U}^{-2/3}_{La}=(U_{Ra}^{2/3})^\dagger \gamma _0\). They carry SM quantum numbers \(t^i_{3L},Y\), and \(Q_i=Y+t^i_{3L}\), which are the sum of SM quantum numbers (\(t^i_{3L}, Y, Q_i\)) of their constituents, i.e., the elementary leptons and quarks in the same SM family [44], listed in Tables 3 and 4, so that the contact interactions in Eq. (2) are SM gauge symmetric.

Table 5 Composite bosons \(\Pi ^{0,\pm }\), their constituents and SM quantum numbers

The contact interactions for the production and decay of a composite fermions F are:

$$\begin{aligned} {{\mathcal {L}}}^{F}_{{\mathrm{CI}}} = {{\mathcal {V}}}_{F} +{\mathcal V}_{F}^\dagger . \end{aligned}$$
(6)

In the case of Eq. (4) and Table 1,

$$\begin{aligned} {{\mathcal {V}}}_{{{\bar{E}}}^0}= & {} \frac{g_*^2}{\Lambda ^2}({{\bar{E}}}^0_{L} e_{R})({{\bar{d}}}^a_{R}u_{La}), \quad pp~{{\mathrm{or}}}~ep\rightarrow \bar{E}^0_{L} e_{R}, \end{aligned}$$
(7)
$$\begin{aligned} {{\mathcal {V}}}_{{{\bar{N}}}^+}= & {} \frac{g_*^2}{\Lambda ^2}(\bar{N}^+_{L}\nu ^e_{R})({{\bar{u}}}^a_{R}d_{La}), \quad pp~{{\mathrm{or}}}~ep\rightarrow {{\bar{N}}}^+_{L}\nu ^e_{R}, \end{aligned}$$
(8)
$$\begin{aligned} {{\mathcal {V}}}_{{{\bar{E}}}^+}= & {} \frac{g_*^2}{\Lambda ^2}(\bar{E}^+_{L}e_{R})({{\bar{d}}}^a_{R}d_{La}), \quad pp~{{\mathrm{or}}}~ep\rightarrow {{\bar{E}}}^+_{L}e_{R}, \end{aligned}$$
(9)
$$\begin{aligned} {{\mathcal {V}}}_{{{\bar{N}}}^0}= & {} \frac{g_*^2}{\Lambda ^2}(\bar{N}^0_{L}\nu ^e_{R})({{\bar{u}}}^a_{R}u_{La}), \quad pp~{{\mathrm{or}}}~ep\rightarrow {{\bar{N}}}^0_{L}\nu ^e_{R}, \end{aligned}$$
(10)

and their Hermitian conjugates,

$$\begin{aligned} {{\mathcal {V}}}^\dagger _{E^0}= & {} \frac{g_*^2}{\Lambda ^2}(\bar{e}_{L}E^0_{R})({{\bar{u}}}^a_{R} d_{aL}),\quad E^0_{R}\rightarrow \bar{e}_{L}({{\bar{u}}}^a_{R} d_{aL}), \end{aligned}$$
(11)
$$\begin{aligned} {{\mathcal {V}}}^\dagger _{N^-}= & {} \frac{g_*^2}{\Lambda ^2} (\bar{\nu }^e_{L}N^-_R)({{\bar{d}}}^a_{R}u_{aL}),\quad N^-_R\rightarrow \bar{\nu }^e_{L}({{\bar{d}}}^a_{R}u_{aL}), \end{aligned}$$
(12)
$$\begin{aligned} {{\mathcal {V}}}^\dagger _{E^-}= & {} \frac{g_*^2}{\Lambda ^2}(\bar{e}_LE^-_{R})({{\bar{d}}}^a_{L}d_{Ra}),\quad E^-_{R}\rightarrow \bar{e}_L({{\bar{d}}}^a_{L}d_{Ra}), \end{aligned}$$
(13)
$$\begin{aligned} {{\mathcal {V}}}^\dagger _{N^0}= & {} \frac{g_*^2}{\Lambda ^2}({{\bar{\nu }}}^e_LN^0_{R})(\bar{u}^a_{L}u_{Ra}),\quad N^0_{R}\rightarrow {{\bar{\nu }}}^e_L(\bar{u}^a_{L}u_{Ra}). \end{aligned}$$
(14)

In the case of Eq. (5) and Table 2,

$$\begin{aligned}&{{\mathcal {V}}}_{{{\bar{D}}}^{-2/3}} = \frac{g_*^2}{\Lambda ^2}(\bar{D}^{-2/3}_{Lb} d_{Rb})({{\bar{d}}}^a_{R}u_{La}); \!\!\!\quad pp~\rightarrow {{\bar{D}}}^{-2/3}_{La} d_{Ra}, \end{aligned}$$
(15)
$$\begin{aligned}&{{\mathcal {V}}}_{{{\bar{U}}}^{1/3}}= \frac{g_*^2}{\Lambda ^2}(\bar{U}^{1/3}_{Lb}u_{Rb})({{\bar{u}}}^a_{R}d_{La}); \quad pp~\rightarrow \bar{U}^{1/3}_{La}u_{Ra}, \end{aligned}$$
(16)
$$\begin{aligned}&{{\mathcal {V}}}_{{{\bar{D}}}^{1/3}} = \frac{g_*^2}{\Lambda ^2}(\bar{D}^{1/3}_{Lb}d_{Rb})({{\bar{d}}}^a_{R}d_{La}); \quad pp~\rightarrow \bar{D}^{1/3}_{La}d_{Ra}, \end{aligned}$$
(17)
$$\begin{aligned}&{{\mathcal {V}}}_{{{\bar{U}}}^{-2/3}} = \frac{g_*^2}{\Lambda ^2}(\bar{U}^{-2/3}_{Lb}u_{Rb})({{\bar{u}}}^a_{R}u_{La}); \!\!\!\quad pp~\rightarrow {{\bar{U}}}^{-2/3}_{Lb}u_{Rb}, \nonumber \\ \end{aligned}$$
(18)

and their Hermitian conjugates,

$$\begin{aligned} {{\mathcal {V}}}^\dagger _{D^{2/3}}= & {} \frac{g_*^2}{\Lambda ^2}({\bar{d}}_{Lb}D^{2/3}_{Rb})({{\bar{u}}}^a_{R} d_{La}); \!\!\quad \!\! D^{2/3}_{Rb}\rightarrow {\bar{d}}_{Lb}(\bar{u}^a_{R} d_{La}), \end{aligned}$$
(19)
$$\begin{aligned} {{\mathcal {V}}}^\dagger _{U^{-1/3}}= & {} \frac{g_*^2}{\Lambda ^2} ({{\bar{u}}}_{Lb}U^{-1/3}_{Rb})(\bar{d}^a_{R}u_{La});\!\!\!\quad U^{-1/3}_{Rb}\!\!\rightarrow \!\bar{u}_{Lb}({{\bar{d}}}^a_{R}u_{La}), \end{aligned}$$
(20)
$$\begin{aligned} {{\mathcal {V}}}^\dagger _{D^{-1/3}}= & {} \frac{g_*^2}{\Lambda ^2}({{\bar{d}}}_{Lb}D^{-1/3}_{Rb})(\bar{d}^a_{L}d_{Ra}); \!\!\!\quad D^{-1/3}_{Rb}\!\!\rightarrow \! {{\bar{d}}}_{Lb}({{\bar{d}}}^a_{L}d_{Ra}), \end{aligned}$$
(21)
$$\begin{aligned} {{\mathcal {V}}}^\dagger _{U^{2/3}}= & {} \frac{g_*^2}{\Lambda ^2}({{\bar{u}}}_{Lb}U^{2/3}_{Rb})(\bar{u}^a_{L}u_{Ra});\!\!\quad \!\! U^{2/3}_{Rb}\rightarrow \bar{u}_{Lb}({{\bar{u}}}^a_{L}u_{Ra}). \nonumber \\ \end{aligned}$$
(22)

These are relevant contact interactions for phenomenological studies of possible inelastic channels of composite-fermion production and decay in pp or ep collisions.

2.2 Composite bosons \(\Pi ^{0,\pm }\)

From the four-fermion interaction in Eqs. (4) or (5), it is possible to form composite bosons

$$\begin{aligned} \Pi ^+= & {} (g^*/F_\Pi )^2({{\bar{d}}}^a_{R}u_{La}), \quad \Pi ^-= (\Pi ^+)^\dagger , \end{aligned}$$
(23)
$$\begin{aligned} \Pi ^0_d= & {} (g^*/F_\Pi )^2({{\bar{d}}}^a_{R}d_{La}), \end{aligned}$$
(24)
$$\begin{aligned} \Pi ^0_u= & {} (g^*/F_\Pi )^2({{\bar{u}}}^a_{R}u_{La}), \end{aligned}$$
(25)

and their Hermitian conjugates. Such normalized composite boson field has the same dimension [energy] of elementary boson field. The composite boson carries the quantum numbers that are the sum over SM quantum numbers of its two constituents, see Table 5. These are pseudo composite bosons \(\Pi ^{0,\pm }\), analogous to charged and neutral pions \(\pi ^{0,\pm }\) in the low-energy QCD.

As shown in Fig. 2, the effective coupling between composite boson and its two constituents can be written as an effective contact interaction,

$$\begin{aligned} {{\mathcal {L}}}^{\Pi ^\pm }_{{\mathrm{CI}}}= & {} g_{_{{\mathrm{Y}}}}({{\bar{d}}}^a_{R}u_{La})\Pi ^- + {\mathrm{h.c.}}, \end{aligned}$$
(26)
$$\begin{aligned} {{\mathcal {L}}}^{ \Pi ^0_d}_{\mathrm{CI}}= & {} g_{_{\mathrm{Y}}} ({{\bar{d}}}^a_{R} d_{La})\Pi ^0_d + {\mathrm{h.c.}}, \end{aligned}$$
(27)
$$\begin{aligned} {{\mathcal {L}}}^{\Pi ^0_u}_{\mathrm{CI}}= & {} g_{_{\mathrm{Y}}}({{\bar{u}}}^a_{R} u_{Ra})\Pi ^0_u + {\mathrm{h.c.}}, \end{aligned}$$
(28)

where \(g_{_{\mathrm{Y}}}=(F_\Pi /\Lambda )^2\). By the appropriate normalizing the composite boson \(\Pi \) with the form factor \((g^*/F_\Pi )^2\) in Eqs. (2325), the effective contact interaction in Eqs. (2628) can be expressed as a dimensionless Yukawa coupling \(g_{_{\mathrm{Y}}}\), whose value, corresponding to \(F_\Pi \) value, can be different for composite bosons in Eqs. (2325), but we do not consider such difference here.

2.3 Contact interaction of composite fermion and boson

In the view of the composite fermion being a bound state of a composite boson and an SM fermion, using composite-boson fields in Eqs. (2325), we rewrite \({{\mathcal {V}}}^\dagger \) in Eqs. (1114) as follows:

$$\begin{aligned} {{\mathcal {V}}}^\dagger _{E^0}= & {} g_{_{\mathrm{Y}}}(\bar{e}_{L}E^0_{R})\Pi ^-,\quad E^0_{R}\rightarrow e_{L}\Pi ^+, \end{aligned}$$
(29)
$$\begin{aligned} {{\mathcal {V}}}^\dagger _{N^-}= & {} g_{_{\mathrm{Y}}} (\bar{\nu }^e_{L}N^-_R)\Pi ^+,\quad N^-_R\rightarrow \nu ^e_{L}\Pi ^-, \end{aligned}$$
(30)
$$\begin{aligned} {{\mathcal {V}}}^\dagger _{E^-}= & {} g_{_{\mathrm{Y}}}(\bar{e}_LE^-_{R})\Pi ^0_d,\quad E^-_{R}\rightarrow e_L\Pi ^0_d, \end{aligned}$$
(31)
$$\begin{aligned} {{\mathcal {V}}}^\dagger _{N^0}= & {} g_{_{\mathrm{Y}}}({{\bar{\nu }}}^e_LN^0_{R})\Pi ^0_u,\quad N^0_{R}\rightarrow \nu ^e_L\Pi ^0_u, \end{aligned}$$
(32)

and their Hermitian conjugates \({{\mathcal {V}}}\) in Eqs. (710), as shown in Fig. 3. In the same way, we rewrite \({{\mathcal {V}}}^\dagger \) in Eqs. (1922) as follows:

$$\begin{aligned} {{\mathcal {V}}}^\dagger _{D^{2/3}}= & {} g_{_{\mathrm{Y}}}(\bar{d}_{L}D^{2/3}_{R})\Pi ^-,\quad D^{2/3}_{R}\rightarrow d_{L}\Pi ^+, \end{aligned}$$
(33)
$$\begin{aligned} {{\mathcal {V}}}^\dagger _{U^{-1/3}}= & {} g_{_{\mathrm{Y}}} (\bar{u}_{L}U^{-1/3}_R)\Pi ^+,\quad U^{-1/3}_R\rightarrow u_{L}\Pi ^-, \end{aligned}$$
(34)
$$\begin{aligned} {{\mathcal {V}}}^\dagger _{D^{-1/3}}= & {} g_{_{\mathrm{Y}}}(\bar{d}_LD^{-1/3}_{R})\Pi ^0_d,\quad D^{-1/3}_{R}\rightarrow d_L\Pi ^0_d, \end{aligned}$$
(35)
$$\begin{aligned} {{\mathcal {V}}}^\dagger _{U^{2/3}}= & {} g_{_{\mathrm{Y}}}(\bar{u}_LU^{2/3}_{R})\Pi ^0_u,\quad U^{2/3}_{R}\rightarrow u_L\Pi ^0_u. \end{aligned}$$
(36)

These contact interactions in Eqs. (2932) and (3336) imply that composite fermions F: \(E^0_R\), \(N_R^-\), \(E^-_R\), \(N_R^0\) and F: \(D^{2/3}_R\), \(U^{-1/3}_R\), \(D^{-1/3}_R\), \(U^{2/3}_R\) can decay into composite bosons \(\Pi ^\pm \) and \(\Pi ^0\), which decay then to SM fermions, following the contact interactions in Eqs.  (2628) at the leading order of tree level. However, we shall consider other decay channels at the next-to-leading order, such as neutral composite boson decay to two SM gauge bosons \(\Pi ^0_{u,d}\rightarrow {{\tilde{G}}} + {{\tilde{G}}}'\).

Fig. 3
figure 3

We show the Feynman diagrammatic representation for the contact interaction between the composite fermion and boson, where the thin solid line represents an SM elementary fermion, the double solid line is a composite fermion and the double wave line represents a composite boson and the blob represents an interacting vertex \((F_\Pi /\Lambda )^2P_{L,R}\)

2.4 Contact interaction of \(\Pi ^0\) composite boson and gauge bosons

Analogously to \(\pi ^0\rightarrow \gamma \gamma \), the massive \(\Pi ^0_{u,d}\) composite boson can also decay into two gauge bosons [44] :

$$\begin{aligned} \Pi ^0_{u,d}\rightarrow & {} \gamma \gamma , \end{aligned}$$
(37)
$$\begin{aligned} \Pi ^0_{u,d}\rightarrow & {} \gamma Z^0, \end{aligned}$$
(38)
$$\begin{aligned} \Pi ^0_{u,d}\rightarrow & {} Z^0 Z^0, \end{aligned}$$
(39)
$$\begin{aligned} \Pi ^0_{u,d}\rightarrow & {} W^+ W^-, \end{aligned}$$
(40)

via the contact interaction

$$\begin{aligned} {{\mathcal {L}}}^{\Pi ^0}_{{{\tilde{G}}}{{\tilde{G}}}'} = \sum _{i=u,d}\frac{gg^\prime N_c}{4\pi ^2 F_\Pi }\epsilon _{\mu \nu \rho \sigma }(\partial ^\rho A^\mu )(\partial ^\sigma A^{\prime \nu })\Pi ^0_i, \end{aligned}$$
(41)

where g and \(g^\prime \) represent the couplings of gauge bosons \(A^\mu \) and \(A^{\prime \nu }\) to the SM quarks u and d with different \(SU_L(2)\)-isospin \(i=u,d\). Actually, this effective contact interaction (41) is an axial anomaly vertex, as a result of a triangle quark loop and standard renormalization procedure in SM. It should be mentioned that two gauge bosons can be two gluons that possibly fuse to Higgs and other particles in the final states.

Fig. 4
figure 4

On the left panel, we show the production cross section of \(pp\rightarrow f F\) as a function of \(m_F\) for the case \(m_F/\Lambda =0.8\) and at a center of mass energy \(\sqrt{s}=13\) TeV. The solid red line represents the results of an analytical and numerical calculation based on Eqs. (52) and (53) and the filled circles (black) represent the results from our implementation of the model in CalcHEP. We find good agreement. On the right panel, we plot the decay width of composite fermion F as a function of its mass \(m_F\) for the case \(m_F/\Lambda =0.8\). Again, we observe a good agreement between the expectation from a CalcHEP simulation and the analytical result based on Eq. (54)

3 Phenomenology of the composite fermions in pp collisions

In this section we study the phenomenology of the composite fermions in pp collisions. We first outline their production and decay mode and then calculate their cross section and decay width. This study leads us to the discussion on the search for F that will be discussed in the next section.

3.1 Production and decay of F

As already specified in Sect. 2, the composite fermion F can be

$$\begin{aligned}&E ~(E^0,{{\bar{E}}}^0, E^-,E^+),\nonumber \\&N ~(N^0,{{\bar{N}}}^0, N^-,N^+)\nonumber \\&D~(D^{2/3},{{\bar{D}}}^{-2/3}, D^{-1/3},{{\bar{D}}}^{+1/3})\nonumber \\&U~(U^{-1/3},{{\bar{U}}}^{+1/3}, U^{2/3},{{\bar{U}}}^{-2/3}), \end{aligned}$$
(42)

where ENDU stand for the charge sector \(Q=-1,0,-1/3,2/3\) respectively, and the corresponding composite fermions of the higher generation of families in the SM.

The kinematics of the processes is derived in the center of mass frame of pp collisions and virtual processes of F are not considered. If the energy \(\sqrt{s}\) in the parton center of mass frame is larger than composite fermion masses, the following resonant process can occur:

$$\begin{aligned} pp\rightarrow & {} f ~F \end{aligned}$$
(43)

where the Standard Model fermion f is produced in association with the corresponding composite fermion F. We note that f in Eq. (43) can be \(e,\nu ,u,d\), and the corresponding Standard Model fermions of the higher generation of families. The kinematics of final states is simple in the center of mass frame of pp collisions. If we neglect the quark-family mixing, the previous process can manifest at parton level as:

$$\begin{aligned} u{\bar{d}}\rightarrow & {} e^+ E^0 ~\;{\mathrm{or}}\;~ {\bar{\nu }} N^+ \;~{\mathrm{or}}\; ~{{\bar{d}}} D^{2/3}, \end{aligned}$$
(44)
$$\begin{aligned} {\bar{u}}d\rightarrow & {} e^- \bar{E^0}~ \;{\mathrm{or}}\;~ \nu N^- \;~{\mathrm{or}}\;~ {{\bar{u}}} U^{-1/3}, \end{aligned}$$
(45)
$$\begin{aligned} d{\bar{d}}\rightarrow & {} e^{+} E^{-} \;~{\mathrm{or}}\;~ e^{-} E^{+}\;~{\mathrm{or}}~{{\bar{d}}} D^{-1/3}, \end{aligned}$$
(46)
$$\begin{aligned} u{\bar{u}}\rightarrow & {} {\bar{\nu }}N^0 \;~ {\mathrm{or}}\;~ \nu {\bar{N}}^0 \;~{\mathrm{or}}\;~ {{\bar{u}}} U^{2/3} . \end{aligned}$$
(47)

The composite fermion F can decay through two different channels: \({{\bar{f}}}\) plus two quarks, via the interactions in Eqs. (1114) and Eqs. (1922); or \({{\bar{f}}}\) plus a composite boson \(\Pi \), via the interactions in Eqs. (2932) and Eqs. (3336), where \({{\bar{f}}}\) indicates a fermion that is the antiparticle of f. Then the composite fermion F decays as:

$$\begin{aligned} F~\rightarrow & {} {{\bar{f}}}~ qq^\prime , \end{aligned}$$
(48)
$$\begin{aligned} F~\rightarrow & {} {{\bar{f}}}~ \Pi ^{0,\pm }. \end{aligned}$$
(49)

The full decay chain is:

$$\begin{aligned} pp\rightarrow & {} f F \rightarrow f {{\bar{f}}} qq^\prime , \end{aligned}$$
(50)
$$\begin{aligned} pp\rightarrow & {} f F \rightarrow f {{\bar{f}}} ~ \Pi ^{0,\pm }. \end{aligned}$$
(51)

It appears clear, considering all the possible flavors of f and F, that a large range of final states is possible. The cross section of the process \(pp \rightarrow f F \), the decay branching ratio of F, and the final states and their topologies are discussed below.

3.2 Cross sections, decay widths and branching ratios

3.2.1 Cross sections

The partonic cross section of \(qq^\prime \rightarrow f F\) is calculated by standard methods via the contact interaction in Eqs. (722),

$$\begin{aligned} {{\hat{\sigma }}}({\hat{s}},m_F)= \frac{1}{3\times 64\pi }\left( \frac{g_*^2}{\Lambda ^2}\right) ^2 \frac{({\hat{s}}-m_F^2)^2}{m_F^2}, \end{aligned}$$
(52)

where \(\sqrt{{\hat{s}}}\) stands for the parton center-mass-energy of pp collisions in LHC experiments.

We consider the production cross section for the composite fermions F in pp collisions expected at the LHC collider according to Feynman’s parton model. The QCD factorization theorem allows to obtain any hadronic cross section (e.g. in pp collisions) in terms of a convolution of the hard partonic cross sections \({{\hat{\sigma }}}\), evaluated at the parton center of mass energy \(\sqrt{{{\hat{s}}}}=\sqrt{\tau s}\), with the universal parton distribution functions \(f_a(x,{\hat{{{\mathcal {Q}}}}})\) which depend on the parton longitudinal momentum fractions x, and on the factorization scale \({\hat{\mathcal {Q}}}\):

$$\begin{aligned} \sigma = \sum _{ij}\!\!\intop ^1_{\frac{m_F^{2}}{s}}\!\!d\tau \!\!\intop _\tau ^1 \!\!\frac{dx}{x} f_i(x,{\hat{\mathcal {Q}}}^2)f_j(\frac{\tau }{x},{\hat{\mathcal {Q}}}^2) {{\hat{\sigma }}}(\tau s,m_F)\, . \end{aligned}$$
(53)

The factorization and renormalization scale \({{{\mathcal {Q}}}}\) is generally fixed at the value of the mass that is being produced. The parametrization of the parton distribution function is NNPDF3.0 [72] and the factorization scale has been chosen as \(\hat{{{\mathcal {Q}}}}=m_F\).

The right panel of Fig. 4 shows the agreement between analytical calculations based on Eqs. (52) and (53) for the case of the composite fermion F, and the results of simulations with CalcHEP where the model with four-fermion interactions has been implemented. We remark the quite good agreement that validates our model implementation in CalcHEP.

3.2.2 Decay widths

Analytical calculations, in the similar way as the first term in Eq. (5) of Ref. [33], yield to the width of the 3-body process \(F \rightarrow {{\bar{f}}} qq^\prime \)

$$\begin{aligned} \Gamma _{3-\text {body}}(F \rightarrow {{\bar{f}}} qq^\prime )= \left( \frac{g_*^2}{\Lambda ^2}\right) ^2\frac{m_F^5}{4\times (8\pi )^3}. \end{aligned}$$
(54)

Note that at TeV energy scales, composite fermions are massive (\(m_F\)) Dirac fermions, whereas all SM elementary fermions are treated as massless Dirac fermions of four spinor components, consisting of right- and left-handed Weyl fermions of two spinor components. Alternatively, the decay width \(\Gamma _{F}\) has also been evaluated via CalcHEP, and numerical results are completely in agreement with analytical one in Eq. (54), see the left panel of Fig. 4.

The decay width of the composite fermion F in the process \(F \rightarrow {{\bar{f}}} \Pi \) can easily be computed from the effective contact lagrangian in Eqs. (2936)

$$\begin{aligned} \Gamma (F \rightarrow {{\bar{f}}} \Pi ) = \frac{1}{32\pi }\left( \frac{F_\Pi ^2}{\Lambda ^2}\right) ^2 \, m_F\, \left( 1-\frac{m_\Pi ^2}{m_F^2}\right) ^2, \end{aligned}$$
(55)

and the total width is

$$\begin{aligned} \Gamma _{\mathrm{tot}}(F)=\Gamma (F\rightarrow \bar{f}\Pi )+\Gamma _{3-body}(F\rightarrow {{\bar{f}}}qq^\prime ). \end{aligned}$$
(56)

The decay width of the \(\Pi \) boson to two quarks is simply calculated by using the effective contact Lagrangian in Eq. (26) and (27),

$$\begin{aligned} \Gamma (\Pi \rightarrow qq^\prime ) = \frac{3}{16\pi }\, \left( \frac{F_\Pi }{\Lambda }\right) ^4 \,m_\Pi . \end{aligned}$$
(57)

For the case that \(\Pi \) equals to \(\Pi ^+\) or \(\Pi ^-\) composite boson, \(\Pi \rightarrow qq^\prime \) of Eq. (57) is the only decay channel, see Eqs. (23) and (26). The \(\Pi ^0_{u,d}\) composite bosons, instead, can also decay to two gauge bosons \({{\tilde{G}}} {{\tilde{G}}}'\) (3740), according to the contact interaction (41), the corresponding decay widths are [44] :

$$\begin{aligned} \Gamma _{\Pi ^0_{u,d}\rightarrow \gamma \gamma }= & {} \left( \frac{5}{9}\right) ^2\Gamma , \end{aligned}$$
(58)
$$\begin{aligned} \Gamma _{\Pi ^0_{u,d}\rightarrow \gamma Z^0}= & {} \frac{1}{\sin ^2 2\theta _W}\left( \frac{1}{2}-\frac{5}{9}\sin ^2 \theta _W\right) ^2\Gamma , \end{aligned}$$
(59)
$$\begin{aligned} \Gamma _{\Pi ^0_{u,d}\rightarrow Z^0 Z^0}\!=\! & {} \left( \frac{1/2\!-\!\sin ^2\theta _W\!+\!(5/9)\sin ^4\theta _W}{\sin ^2 2\theta _W}\right) ^{\!2}\Gamma , \end{aligned}$$
(60)
$$\begin{aligned} \Gamma _{\Pi ^0_{u,d}\rightarrow W^+ W^-}= & {} \left( \frac{1}{8\sin ^2\theta _W}\right) ^2\Gamma , \end{aligned}$$
(61)

where \(\theta _W\) is the Weinberg angle,

$$\begin{aligned} \Gamma =\left( \frac{\alpha N_c}{3\pi F_\Pi }\right) ^2\frac{m_{\Pi ^0_{u,d}}^3}{64\pi }, \end{aligned}$$
(62)

and the number of colors \(N_c=3\). Total decay rate \(\Gamma ^{\mathrm{tot}}(\Pi ^0_{u,d}\rightarrow {{\tilde{G}}}{{\tilde{G}}}')\) is the sum over all contributions from Eqs. (5861). The total \(\Pi ^0_{u,d}\)-decay rate reads

$$\begin{aligned} \Gamma _{\mathrm{tot}}(\Pi ^0_{u,d})=\Gamma (\Pi ^0_{u,d}\rightarrow qq') +\Gamma ^{\mathrm{tot}}(\Pi ^0_{u,d}\rightarrow {{\tilde{G}}}{{\tilde{G}}}'), \end{aligned}$$
(63)

where \(\Gamma (\Pi ^0_d\rightarrow qq')\) is given by Eq. (57). Based on these results, we calculate the exact branching ratios of different channels for different parameters of the model.

3.2.3 Branching ratios

The branching ratios of the \(\Pi ^0_{u,d}\) decay to two quarks \(qq^\prime \),

$$\begin{aligned} {{\mathcal {B}}}(\Pi ^0_{u,d}\rightarrow qq^\prime ) = \frac{\Gamma (\Pi ^0_{u,d}\rightarrow qq^\prime )}{\Gamma _{\mathrm{tot}}(\Pi ^0_{u,d})}, \end{aligned}$$
(64)

and the \(\Pi ^0_{u,d}\) decay to two gauge bosons \({{\tilde{G}}}{\tilde{G}}^\prime \),

$$\begin{aligned} {{\mathcal {B}}}(\Pi ^0_{u,d}\rightarrow {{\tilde{G}}}{\tilde{G}}^\prime )=\frac{\Gamma ^{\mathrm{tot}}(\Pi ^0_{u,d}\rightarrow {\tilde{G}}{{\tilde{G}}}')}{\Gamma _{\mathrm{tot}}(\Pi ^0_{u,d})}. \end{aligned}$$
(65)

Whereas, the branching ratios of the composite fermion F decay to \(f\Pi \),

$$\begin{aligned} {{\mathcal {B}}}(F\rightarrow f\Pi )=\frac{\Gamma (F\rightarrow f\Pi )}{\Gamma _{\mathrm{tot}}(F)}. \end{aligned}$$
(66)

The branching ratios of the direct decay \(F\rightarrow {{\bar{f}}}qq'\),

$$\begin{aligned} {{\mathcal {B}}}(F\rightarrow {{\bar{f}}} qq^\prime ,{\mathrm{direct}})=\frac{\Gamma _{\mathrm{3-body}}(F\rightarrow {\bar{f}} qq')}{\Gamma _{\mathrm{tot}}(F)}, \end{aligned}$$
(67)

and indirect decay \(F\rightarrow {{\bar{f}}} \Pi \rightarrow {{\bar{f}}} qq'\),

$$\begin{aligned} {{\mathcal {B}}}(F\rightarrow {{\bar{f}}}\Pi \rightarrow {{\bar{f}}} qq^\prime )=\frac{ \Gamma (F\rightarrow {{\bar{f}}} \Pi )}{\Gamma _{\mathrm{tot}}(F)}~{{\mathcal {B}}}(\Pi \rightarrow qq'). \nonumber \\ \end{aligned}$$
(68)

The sum of these two branching ratios gives the total branching ratio \({{\mathcal {B}}}(F\rightarrow {{\bar{f}}}qq^\prime )\) of F decaying to \({{\bar{f}}}qq^\prime \),

$$\begin{aligned} {{\mathcal {B}}}(F\rightarrow {{\bar{f}}} qq^\prime )= & {} \Gamma ^{-1}_{\mathrm{tot}}(F) \times \Big [\Gamma _{3-body}(F\rightarrow {{\bar{f}}}qq^\prime )\nonumber \\&+\Gamma (F\rightarrow {{\bar{f}}}\Pi )~{{\mathcal {B}}}(\Pi \rightarrow qq^\prime )\Big ]. \end{aligned}$$
(69)

For the case \(\Pi ^\pm \), \({{\mathcal {B}}}(\Pi ^\pm \rightarrow qq^\prime )=1\). For the case \(\Pi ^0_{u,d}\), \({\mathcal B}(\Pi ^0_{u,d}\rightarrow qq^\prime )\) is given by Eq. (64), and the branching ratios of decay \(F\rightarrow {{\bar{f}}} \Pi ^0_{u,d}\rightarrow {{\bar{f}}} {{\tilde{G}}}{{\tilde{G}}}^\prime \) is given by

$$\begin{aligned} {{\mathcal {B}}}(F\rightarrow {{\bar{f}}} \Pi ^0_{u,d}\rightarrow {{\bar{f}}} {{\tilde{G}}}{{\tilde{G}}}^\prime )= & {} \frac{\Gamma (F\rightarrow {{\bar{f}}}\Pi ^0_{u,d})}{\Gamma _{\mathrm{tot}}(F)}\nonumber \\&\times {{\mathcal {B}}}(\Pi ^0_{u,d}\rightarrow {{\tilde{G}}}{\tilde{G}}^\prime ). \end{aligned}$$
(70)

As a result, the cross sections of these processes are:

$$\begin{aligned} \sigma (pp\rightarrow f F \rightarrow {{\bar{f}}} f qq^\prime )= & {} \sigma (pp\rightarrow fF)\nonumber \\&\times {{\mathcal {B}}}(F\rightarrow {{\bar{f}}}qq^\prime ), \end{aligned}$$
(71)

and

$$\begin{aligned} \sigma (pp\rightarrow f F \rightarrow {{\bar{f}}} f {{\tilde{G}}}{{\tilde{G}}}^\prime )= & {} \sigma (pp\rightarrow fF)\nonumber \\&\times {{\mathcal {B}}}(F\rightarrow {{\bar{f}}} \Pi ^0_{u,d}\rightarrow {{\bar{f}}} {{\tilde{G}}}{{\tilde{G}}}^\prime ).\nonumber \\ \end{aligned}$$
(72)

All channels of composite fermion F production and decay give the same results at this level of approximation by using contact interactions only.

For the processes with the \(e^+e^-qq^\prime \) final state in pp collisions, the total cross section is approximately given by

$$\begin{aligned} \sigma (pp\!\rightarrow \! e^+e^-qq^\prime )\approx & {} \, \sigma (pp\rightarrow e^+ E^0)\times {{\mathcal {B}}}(E^0 \rightarrow e^+ {{\bar{u}}} d)\nonumber \\&+\, \sigma (pp\rightarrow e^- {{\bar{E}}}^0)\times {{\mathcal {B}}}({{\bar{E}}}^0 \rightarrow e^- u {{\bar{d}}})\nonumber \\&+\, \sigma (pp\rightarrow e^+ {{\bar{E}}}^-)\times {{\mathcal {B}}}({{\bar{E}}}^- \rightarrow e^- d {{\bar{d}}})\nonumber \\&+\, \sigma (pp\!\rightarrow \! e^- E^+)\times {{\mathcal {B}}}( E^+\! \rightarrow \! e^+ d {{\bar{d}}}), \nonumber \\ \end{aligned}$$
(73)

and the total width is

$$\begin{aligned} \Gamma _{\mathrm{tot}}(F)=\Gamma (F\rightarrow e^+\Pi )+\Gamma _{3-body}(F\rightarrow e^+qq^\prime ). \end{aligned}$$
(74)

The calculation of these quantities will be given in the next sections.

Fig. 5
figure 5

The branching ratios of \(F \rightarrow f qq^\prime \) and \(F \rightarrow f \Pi \) (left column), \(\Pi \rightarrow qq^\prime \) and \(\Pi \rightarrow G{{\tilde{G}}}^\prime \) (center column), and the full decay chains \(F \rightarrow f qq^\prime \), \(F \rightarrow f \Pi \rightarrow f qq^\prime \), and \(F \rightarrow f \Pi \rightarrow f G{{\tilde{G}}}^\prime \) (right column) are plotted with respect to the ratio \(m_\Pi /m_F\) and for the values of \(m_F/\Lambda =0.8\), \(F_\Pi /\,m_\Pi =0.8\) (the 1st row), \(F_\Pi /\,m_\Pi =5\) (the 2nd row), \(F_\Pi /\,m_\Pi =15\) (the 3rd row). Further plots in a wider range of parameter space are in Appendix A, Fig. 8

4 Search for F at the LHC

After having discussed the production and decay of F and its cross-section, width, and decay branching ratio, we now examine these results in terms of parameters of the model and derive the possible final states and their topologies, highlighting their impact to the current program of beyond SM searches at the LHC.

Table 6 Summary of the relevant channels where F can decay considering two complementary values of \(F_\Pi / m_\Pi \) and the ranges of \(m_\Pi /m_F\) that correspond to different topologies of F. Similar considerations on the channels where F can decay and its topology apply to all values of \(F_\Pi / m_\Pi \), depending on the value of \(F_\Pi / m_\Pi \), the value of \(m_\Pi /m_F\), and the branching ratios of \(F\rightarrow f q{{\bar{q}}} ~{\mathrm{direct}}\) and \(F\rightarrow f\Pi \rightarrow f q{{\bar{q}}}~{\mathrm{indirect}}\)

4.1 Branching ratios and topology of F with respect to model parameters

In order to present the branching ratios of different possible channels in terms of parameters of the model, we are bound to discuss physically sensible parameters to explore. This model has four parameters that can be rearranged to three dimensionless parameters for a given \(\Lambda \) value: \( (\Lambda , m_F, F_\Pi , m_\Pi ) \rightarrow ( m_F/\Lambda , F_\Pi /m_\Pi , m_\Pi /m_F). \)

The ratio \(m_F/\Lambda < 1\) (\(m_\Pi /\Lambda < 1\)) of the composite fermion (boson) mass and the basic composite scale \(\Lambda \) gives us an insight into the dynamics of composite fermion (boson) formation. In addition, as the parameters \(m_\Pi \) and \(F_\Pi \) represent the same dynamics of composite boson formation we use the \(F_\Pi /m_\Pi \) ratio. Finally, to take into account the feature that a composite fermion F is composed by a composite boson and an elementary SM fermion, we adopt the ratio \(m_\Pi /m_F < 1\) as a parameter. As a result, for given \(\sqrt{s}\) and \(\Lambda \) values, we have three parameters \(m_F/\Lambda \), \(F_\Pi / m_\Pi \), and \(m_\Pi /m_F\) to represent the results of the possible branching ratios. Figure 5 shows three sets of plots for the branching ratios of \(F \rightarrow {{\bar{f}}} qq^\prime \) and \(F \rightarrow {{\bar{f}}} \Pi \) (left column), \(\Pi \rightarrow qq^\prime \) and \(\Pi \rightarrow G{{\tilde{G}}}^\prime \) (center column), and the full decay chains \(F \rightarrow {{\bar{f}}} qq^\prime \), \(F \rightarrow {{\bar{f}}} \Pi \rightarrow {{\bar{f}}} qq^\prime \), and \(F \rightarrow {{\bar{f}}} \Pi \rightarrow {{\bar{f}}} G{{\tilde{G}}}^\prime \) (right column). These branching ratios are plotted with respect to the \(m_\Pi /m_F\) ratio and for the values of \(F_\Pi /\,m_\Pi =0.8\), \(F_\Pi /\,m_\Pi =5\), \(F_\Pi /\,m_\Pi =15\). Note that the branching ratios of \(F \rightarrow f qq^\prime \) and \(F \rightarrow f \Pi \) (left column) do not depend on \(m_F/\Lambda \), which can be seen from Eqs. (5456). For the \(\Pi ^\pm \) decay, the channel (57) is unique, so the branching ratio is one, independent of \(m_F/\Lambda \). Whereas the \(\Pi ^0_{u,d}\) decays also to \(G^\prime G\), see Eqs. (64) and (65), and the branching ratio depends on \(m_F/\Lambda \). However, in the regime of \(m_\Pi /m_F\) we consider, the branching ratio of \(\Pi ^0_{u,d}\rightarrow G^\prime G\) is very small and negligible, compared with the branching ratio of \(\Pi ^0_{u,d}\rightarrow q^\prime q\). Therefore, our results of branching ratio of F decay presented in Fig. 5 are independent of the parameter \(m_F/\Lambda \). As a result, regarding the branching ratio and topologies of F decay, the model effectively depends only on two parameters \(F_\Pi /m_\Pi \) and \(m_\Pi /m_F\). However, the cross section of F production depends on the parameter \(m_F/\Lambda \), as indicated in Eq. 52.

In Fig. 5, it is shown that the branching ratios \(F\rightarrow f q{{\bar{q}}} ~{\mathrm{direct}}\) (67) and \(F\rightarrow f\Pi \rightarrow f q{{\bar{q}}}~{\mathrm{indirect}}\) (68) tend to swap each other for different values of \(F_\Pi /m_\Pi \). Increasing the coupling \(F_\Pi \) (and the ratio \(F_\Pi /m_\Pi \)) of composite boson \(\Pi \) to its two constituents (\(q{{\bar{q}}}\)), see contact interactions (26,27,28), the branching ratios \(F\rightarrow f\Pi \rightarrow f q{{\bar{q}}}~{\mathrm{indirect}}\) (68) becomes dominant over the branching ratios \(F\rightarrow f q{{\bar{q}}} ~{\mathrm{direct}}\) (67). We thus consider two reference cases of \(F_\Pi /m_\Pi \):

  1. (i)

    \(F_\Pi /m_\Pi \lesssim 0.8\) where \(F\rightarrow f q{{\bar{q}}} ~{\mathrm{direct}}\) dominates. We have verified that for the value 0.8 the direct production dominates by at least a factor 10 over the production with the \(\Pi \) for all values of \(m_\Pi /m_F\).

  2. (ii)

    \(F_\Pi /m_\Pi > rsim 5\) where \(F\rightarrow f\Pi \rightarrow f q{{\bar{q}}}~{\mathrm{indirect}}\) (68) becomes relevant for all values of \(m_\Pi /m_F\) and dominates above \(m_\Pi /m_F>\) 0.2 over \(F\rightarrow f q{{\bar{q}}} ~{\mathrm{direct}}\). We notice from Fig. 5 that as \(F_\Pi /m_\Pi \) increases above 15, the decay \(F\rightarrow f\Pi \rightarrow f q{{\bar{q}}}~{\mathrm{indirect}}\) dominates over all possible decays for all values of \(m_\Pi /m_F\).

The expected topologies related to the phenomenology of F are summarized in Table 6, considering the two complementary cases of \(F_\Pi /m_\Pi \le 0.8\) and \(F_\Pi /m_\Pi \ge 15\). These cases are representative of the topology of F in all the phase space, including the intermediate region \(0.8< F_\Pi /m_\Pi < 15\), in which the decay \(F\rightarrow f q{{\bar{q}}} ~{\mathrm{direct}}\) or \(F\rightarrow f\Pi \rightarrow f q{{\bar{q}}}~{\mathrm{indirect}}\) dominates depending on the specific value of \(F_\Pi /m_\Pi \) considered. To this purpose we provide in Appendix A the total decay branching ratios corresponding to Fig. 5 (right column) for values of \(F_\Pi /m_\Pi \) between 1 and 14, increasing in step of 1. We further outline that the value 0.2 for \(m_\Pi /m_F\) that separates the boosted from the resolved topology when F decays through a \(\Pi \) is indicative and may vary based on the mass of F. We have verified, using CalcHEP, that for a mass of F of 1 TeV, the two quarks decaying from the \(\Pi \) originating from F are indeed within a \(\Delta R(q,{\bar{q}}')\) below 0.8, which determines the cone size of a large-radius jets suitable for boosted jet at the LHC experiments. For a mass of F of 7 TeV instead, the value 0.2 is lowered to 0.15 to guarantee \(\Delta R(q,{\bar{q}}')<0.8\), as for higher masses of F its width increases.

Table 7 List of all the signatures foreseen by the model for the different flavors of f, F, their topology and final states. In the table “j” indicates any reconstructed jet that originates from a uds quark and “J” a large-radius (cone-size of 0.8) jet that is reconstructed from 2 quarks produced with low angular separation. The notation w\(/\Pi \) indicates the decay of F through a \(\Pi \). The LHC searches for these signatures are reported along with some comments on the features that are typical of this model and have not been exploited in the referenced LHC searches. In the table, “n/a” indicates the case in which an LHC search interesting the corresponding final state has not been found

So far we have presented the studies relying on the first SM generation, i.e. considering the electron flavor of F (\(F = E\)). However, these discussions and calculations are straightforwardly generalized to the second and third SM generations, and in the text we keep the general notation F instead of E. At the leading order of only contact interactions being taken into account, the formulae of cross-sections, decay rates and branching ratios of the second and third generations are the same as those of the first generation, however composite fermions F and their productions, decay channels and rates are different, depending on the values of their parameters \(m_F\), \(m_\Pi \) and \(F_\Pi \), which vary from one SM generation to another. The reasons are that the effective couplings \(\sim g_*^2/\Lambda ^2\) and \(\sim g_{_Y}\) of contact interactions can be different, due to the modifications from the flavor mixing and gauge interactions. However, we neglect these modifications in this article, and expect the variations of masses \(m_F\), \(m_\Pi \), decay constant \(F_\Pi \) to be small. In this sense, there are two basic parameters \(F_\Pi /m_\Pi \) and \(m_\Pi /m_F\) for each SM generation to be determined by different channels and their topologies in LHC experiments discussed in next sections.

4.2 Signatures to search for F at the LHC

We now summarize on the possible signatures with which F can manifest at the LHC. We remark that F can have the different flavors corresponding to the Standard Model flavors of f and the fact that these particles are not necessarily mass degenerate. This implies that they can have different masses with which they can appear within the energy reach of the LHC, and thus they have to be searched for independently. Based on the flavors of f, we expect 8 different final states to be investigated for the pair fF produced in the process \(pp\rightarrow fF\), which are: \(eE,\mu M,\tau {\mathcal {T}},\nu N,jJ,cC,bB,tT\). Here, we consider one single channel (\(\nu N\)) for all the \(\nu \) neutrinos of the Standard Model and one single channel (jJ) for the uds quarks. We notice that the flavors cC is taken separately, because of the improving performances in c-tagging algorithms at the LHC [93, 94] and dedicated searches for new physics with c quarks in the final state [95, 96]. Moreover, we distinguish the three topologies (resolved with and without \(\Pi \) and boosted) explained in the previous paragraph, so that we have in total 24 different signatures that have to be considered in order to pursue a comprehensive search of F.

In Table  7 we outline these signatures based on the flavors f and F, the possible topology, the corresponding final states, and the LHC search that, to the best of our knowledge, could be more sensitive to searching for F. In the last column, we further report on features of F and its decay that have not been exploited directly in the cited LHC searches and could be used to improve possible future searches dedicated to F. We especially remark that the F quark flavors appear to be completely unexplored yet and we urge on the importance of carrying out specific analyses at LHC to investigate it. This is certainly noteworthy and can have a relevant impact on the beyond the SM physics program of the LHC.

We notice that, despite possible and with a peculiar signature, the channel \(f F \rightarrow f ({{\bar{f}}} \Pi ) \rightarrow f ({{\bar{f}}} ({{\tilde{G}}}{{\tilde{G}}}^\prime ))\) is negligible since the decay \(\Pi ^0 \rightarrow ({{\tilde{G}}}{{\tilde{G}}}^\prime )\) is only relevant for \(F_\Pi /\,m_\Pi =0.1\) when, however, the decay \(F \rightarrow f (\Pi )\) has a branching ratio close to zero. Because of this we do not include this case in Table  7 and we point out that this case would become of interest in the case F is found in one of the possible signatures mentioned above, to study the nature of the new particle.

We put emphasis on the case of the composite fermions \(F=N^0,\bar{N}^0, N^+,N^-\) for the final state \(\nu \nu qq^\prime \), where \(\nu {{\bar{\nu }}}\) stands for the pairs of the SM left-handed neutrino \(\nu ^e_L\) and/or sterile right-handed neutrino \(\nu ^e_R\), as the latter is a candidate of dark-matter particles.

Finally, we acknowledge that the final state \(f {{\bar{f}}} qq^\prime \) is relevant for a wide range of the parameter space of the model and thus will consider it in the next section and, in particular, the case of \(f = e\) and \(F = E\) to derive limits on the model parameters based on existing LHC results.

Fig. 6
figure 6

Recast of the experimental upper limit on \(\sigma (pp \rightarrow eeqq^\prime )\) published in [35] against the model of composite fermions studied in this article. The dotted line (solid green line) is the 95% C.L. observed (expected) upper limit on \(\sigma (pp \rightarrow eeqq^\prime )\) as reported in [35]. The solid line (red) is the theoretical expectation from the model described in this work as given by Eq. (73) for the case \(m_F/\Lambda =1\), the dashed lines (orange) are the theoretical expectation from the model for the cases \(\Lambda =6,\,9,\,12\) TeV. If \(m_F/\Lambda =1\) one obtains that the composite fermions of this model are excluded up to masses \(m^{\mathrm{ex}}_F\approx 4.25\) TeV

5 Bounds on the model parameters

In this section we provide a discussion of the bounds of the model parameters taking as a reference the case \(F = E\) and the final state \(eeqq^\prime \) that has been shown to be sensitive to a wide portion of the parameter space of the model in the previous section. For this purpose, we recast the 95% confidence level (C.L.) experimental upper limit on \(\sigma (pp\rightarrow eeqq^\prime )\) using a recent analysis [35] of 2.3 fb\(^{-1}\) data from the 2015 Run II of the LHC by the CMS collaboration with respect to the predictions of the model of composite fermions discussed in this article. Note that both electrons and positrons are collected in the final states of \(eeqq^\prime \), electrons and positrons are not distinguished in the data analysis. For the case \(m_F/\Lambda =1\) one obtains that the composite fermions of this model are excluded up to masses \(m^\mathrm{ex }_F\approx 4.25\) TeV. This result is shown in Fig. 6, together with the exclusion limits \(m^\mathrm{ex }_F\approx 3.3, 2.4,1.5\) TeV for \(\Lambda \) fixed at 6, 9 and 12 TeV. Figure 7 shows the exclusion curve, lower (dashed) line, in the 2-dimensional parameter space \((\Lambda ,m_F)\) for the model obtained via the recasting of the analysis [35] of \(2.3\, \hbox {fb}^{-1}\) data from the 2015 Run II of the LHC by the CMS collaboration. Here the regions of the parameter space below the curves are excluded.

Fig. 7
figure 7

Recast of the experimental upper limit from [35] (dashed line) and the predicted contour curve at a 5-level statistical significance (solid line) in the 2-dimensional parameter space \((\Lambda ,m_F)\). The shaded region denotes unphysical values of the parameters (\(\Lambda < m_F\))

We also performed a study about the potential of a dedicated analysis in the High Luminosity LHC (HL-LHC) conditions (center of mass energy of 14 TeV and luminosity of \(3\, \hbox {ab}^{-1}\)). We used CalcHEP to generate the processes and DELPHES [73] to simulate the detector effects. In order to separate the signal from the background, we selected events with \(p_{t_{e_1}}\ge \) 180 GeV, \(p_{t_{e_2}}\ge \) 80 GeV, \(p_{t_{j_1}}\ge \) 210 GeV, \(m_{ee}\ge \) 300 GeV (\(p_t\) is the transverse momentum, \(e_1\) the leading electron, \(e_2\) the subleading electron, \(j_1\) the leading jet and \(m_{ee}\) the invariant mass of the two electrons). Then we evaluated the reconstruction and selection efficiencies for signal (\(\epsilon _s\)) and background (\(\epsilon _b\)) as the ratio of the selected and the total generated events. From these efficiencies, the signal and background cross sections (\(\sigma _s\), \(\sigma _b\)) and the integrated luminosity (L), it is possible to evaluate the expected number of events for the signal (\(N_s\)) and the SM background (\(N_b\)) and finally the statistical significance (S):

$$\begin{aligned} N_s=L\sigma _s\epsilon _s, \quad N_b=L\sigma _b\epsilon _b, \quad S=\frac{N_s}{\sqrt{N_b}}\, . \end{aligned}$$
(75)

The \(S=5\) contour curve is shown by the upper (solid) line in Fig. 7. It can be used to get indications about the potential for discovery or exclusion with the experiments at the HL-LHC, showing that there is a wide region of the model phase space where the existence of the composite fermions can be investigated; for the case \(m_F/\Lambda =1\) we can reach masses up to \(\approx 6.2\) TeV. We notice that, despite having considered the case of \(F = E\) in this section, it could be inferred that the cross section for F, which should approximately be the same for all its flavors, is sufficient for the F to appear at the LHC with the statistics already collected at the LHC experiments, and that is expected by the HL-LHC. Based on this result, we recommend that the physics program of the LHC consider the new particles foreseen by this model and their signatures in its investigations.

6 Summary and remarks

In the weak coupling regime the effective four-fermion operators of NJL-type possess an IR-fixed point, rendering the elegant Higgs mechanism of the SM of particle physics at low energies. In the strong coupling regime, on the other end, these operators could possess an UV-fixed point, giving rise to composite fermions F (bosons \(\Pi \)) composed by SM fermions as bound states of three (two) SM elementary leptons or quarks, and to their relevant contact interactions with them at high energies \({{\mathcal {O}}}(\mathrm{TeV})\).

We study, for the first time for this model, the spectrum of composite particles and contact interactions in quark-lepton and quark-quark sectors in relationship to their phenomenology at the LHC in order to unveil their discovery potential. The cross sections and decay rates of composite particles are calculated based on the LHC physics from pp collision at high energy TeV scale. We find out that a comprehensive investigation of the model presented here can be effectively achieved, for given \(\sqrt{s}\) and \(\Lambda \) values, by considering only two parameters: \(F_\Pi /\,m_\Pi \) and \(m_\Pi /m_F\). Based on these results, we exhaustively examine all the possible F states and the signatures with which they can manifest at the LHC, according to different \(F_\Pi /\,m_\Pi \) and \(m_\Pi /m_F\). Interestingly, we find that there is a broad variety of new composite particles that could manifest in signatures that have escaped the realm of the searches at the LHC. We summarize these cases in Table  7. They can offer an unprecedented discovery potential of physics beyond the SM and we urge on the importance for the LHC experiments to include such searches in their ongoing physics program.

In order to set bounds on the model parameters, we derive constraints for the particular case where F has electron-like flavor. We analyzed the particular processes giving \(e^+e^- qq'\) final state by using the recast of the experimental upper limit by the CMS collaboration on the cross-section \(\sigma (pp\rightarrow eeqq')\). We determine that a composite fermion F of mass \(m_F\) below 4.25 TeV can be excluded for \(\Lambda = m_F\). At the same time, we compute \(3\sigma \) and \(5\sigma \) contour plots of the statistical significance and highlight the phase space in which F can manifest using \(3 \hbox {ab}^{-1}\), foreseen at the high luminosity LHC (HL-LHC). This result shows that, even for final state traditionally considered at the LHC experiments, there is a vast range of model parameters to which a dedicated search can be sensitive to the F composite fermions. We encourage such efforts in future investigations in light of peculiar features of F not yet exploited at the LHC searches and highlighted in Table 7. We are preparing the next article presenting the investigation of phenomenology at the LHC of composite bosons.

Both composite bosons (\(\Pi \)) and fermions (F) are mass eigenstates and have definite SM quantum numbers, so that the CKM flavor mixing and the Feynman diagrammatic representations of SM perturbative gauge interactions can be easily implemented, see Eqs. (4.8)-(4.11) in Ref. [44]. At the leading order of contact interactions considered in this article, the contributions from all CKM flavor mixing and gauge interactions to composite particle masses are neglected. It should be mentioned that these effective couplings between composite particles and SM gauge bosons have two main effects. First, they give the possible decay channels of composite particles to final states involving SM gauge bosons, like two gauge bosons as in Sect. 2.4. The branching ratios of these channels are negligible in the composite fermion production and decay studied in this article. However, they could be important in the composite boson formation and decay, which is under examination in a separate effort. Second, these effective couplings between composite particles and SM gauge bosons should affect the well-measured SM quantities in the IR regime, like the electroweak oblique parameters or the decay width of the Z boson, as well as the Higgs physics. These issues are indeed important and necessary, and will be addressed in a future study. So far only some general and qualitative discussions have been presented [43, 44], showing that the composite Higgs boson is a tight bound state of \(t {{\bar{t}}}\), as if it was an elementary particle, and possible corrections to the SM quantities are small.

It is an interesting question to see how these phenomenologies can possibly account for some recent results obtained in both space and underground laboratories. The cosmic rays pp collisions might produce composite fermions \(F=E\) that decay into electrons and positrons. This may explain an excess of cosmic ray electrons and positrons around TeV scale [74,75,76,77]. In addition, recent AMS-02 results [78] show that at TeV scale the energy-dependent proton flux changes its power-law index. This implies that there would be “excess” TeV protons whose origin could be also explained by the resonance of composite fermions \(F=N\) due to the interactions of dark-matter and normal-matter particles. These composite fermions should appear as resonances by high-energy sterile neutrinos inelastic collisions with nucleons (xenon) at the largest cross-section, then resonances decay and produce some other detectable SM particles in underground laboratories [79]. Similarly, in the ICECUBE experiment [80], we expect events where the neutrinos change their directions (lower their energies) by their inelastic collisions to form the resonances of composite fermions N at a high energy scale (\(\approx \) TeV). It is worthwhile to mention that in the IR domain of this model there are effective coupling vertexes of the SM gauge boson W and the right-handed currents: \(g_R{{\bar{\nu }}}_R\gamma ^\mu e_R W^+_\mu \) or \(g_R{{\bar{u}}}_R\gamma ^\mu d_R W^+_\mu \), where \(g_R\propto (v/\Lambda )^2\) [81, 82]. The parity symmetry is restored at the scale \(\Lambda \) [43, 44] and none of additional intermediate gauge bosons \(W_R\) or \(W'\) is present. The recent phenomenological studies of this effective coupling in the quark sector can be found in Ref. [83]. In the lepton sector, these effective contact interactions relate to the dark-matter physics of right-handed neutrinos \(\nu _R\). Similarly to the analogy between the Higgs mechanism and BCS superconductivity, the composite-particle counterparts in condensed matter physics have been recently discussed [84].