1 Introduction

The top quark is the heaviest known elementary particle, which makes it an excellent candidate for new physics searches. The origin of its mass might be different from that of the other quarks and leptons; a top quark condensate (\(\langle t{\bar{t}}\rangle \)), for example, could be responsible for at least part of the mechanism of electroweak symmetry breaking (EWSB). An interesting model involving a role for the top quark in dynamical EWSB is known as the topcolor-assisted technicolor (TC2) model [13]. Higgsless models [4] have emerged as a novel way of understanding the mechanism of EWSB without the presence of a scalar particle in the spectrum. Recently, combing Higgsless and topcolor mechanisms, a deconstructed Higgsless model was proposed, called the top triangle moose (TTM) model [5, 6]. In this model, EWSB results largely from the Higgsless mechanism, while the top quark mass is mainly generated by the topcolor mechanism. The TTM model alleviates the tension between obtaining the correct top quark mass and keeping \(\Delta \rho \) small that exists in many Higgsless models, which can be seen as the deconstructed version of the TC2 model. The new physics models belonging to the topcolor scenario generically have two sources of EWSB and there are two sets of Goldstone bosons. One set is eaten by the electroweak (EW) gauge bosons \(W\) and \(Z\) to generate their masses, while the other set remains in the spectrum, which is called the top-pions (\(\pi ^0_t\) and \(\pi ^\pm _t\)). The topcolor scenario also predicts the existence of the top-Higgs \(h^0_t\), which is the \(t{\bar{t}}\) bound state. The possible signals of these new scalar particles have been extensively studied in the literature, however, most studies have been done in the context of the TC2 model. A phenomenological analysis of the top-pions and top-Higgs predicted by the TTM model [57] is necessary.

The Large Hadron Collider (LHC) generates high-energetic proton–proton (\(pp\)) collisions with a luminosity of \({\mathcal L}=10^{34}~\hbox {cm}^{-2}~\hbox {s}^{-1}\). It provides high statistics data at high energies. On the other hand hadronic interactions generally involve serious backgrounds. A new phenomenon called exclusive production was observed in the measurements of CDF collaboration including exclusive lepton pair production [8, 9], photon–photon production [10], dijet production [11], exclusive charmonium (\(J/\psi \)) meson photoproduction [12], etc. Complementary to \(pp\) interactions, studies of exclusive production of leptons, photons, and heavy particles might be possible and this opens a new field of studying very high-energy photon–photon (\(\gamma \gamma \)) and photon–proton (\(\gamma p\)) interactions.

Following the experience from HERA and the Tevatron, new detectors are proposed to be installed in the LHC tunnel as an additional upgrade of the ATLAS and CMS detectors. There is a program of studying forward physics with extra detectors located in a region nearly 100–400 m from the interaction point [1317]. Technical details of the ATLAS Forward Physics (AFP) projects can be found, for example, in Ref. [18]. This forward detector equipment allows one to detect intact scattered protons after the collision. Therefore the processes which spoil the proton structure can easily be discerned from the exclusive photoproduction processes. By the use of forward detector equipment we can eliminate many serious backgrounds. This is one of the advantages of exclusive photoproduction processes.

A brief review of the experimental prospects for studying high-energy \(\gamma \gamma \) and \(\gamma p\) interactions is discussed in Ref. [19] and cross sections are calculated for many EW and BSM processes. Many phenomenological studies of photon-produced processes are summarized here, involving: standard model productions [2022], supersymmetry [2328], extra dimensions [2931], unparticle physics [32], gauge boson self-interactions [3342], neutrino electromagnetic properties [4345], top quark physics [21, 22, 4648], and triplet Higgs production [49], etc.

Photoproduction of the charged top-pion at leading order (LO) has been studied in Refs. [50, 51], which proceeds via the subprocess \(\gamma c\rightarrow \pi ^\pm _t b\) mediated by the flavor changing couplings and through \(\gamma b \rightarrow \pi ^\pm _t t\) at the large hadron–electron collider (LHeC) [52]. At the LHC, in a general \(pp\) collision, the charged top-pion can be produced in association with a top quark through bottom–gluon fusion, \(gb\rightarrow t \pi ^-_t\), and through gluon–gluon fusion, \(gg\rightarrow {\bar{b}}t\pi ^-_t\), phenomenologically similar to a charged Higgs boson in a two-Higgs-doublet model with low \(\tan \beta \). A related NLO study can be found in Ref. [53]. On the other hand, \(\pi ^\pm _t\) \(t\) associated production at the \(\gamma p\) collision LHC will be very clean or at least with backgrounds easy going, thus leading to a good chance to be detected. It can be a complementary process to be studied in addition of \(gb\rightarrow t \pi ^-_t\). In this paper, we present this production at the \(\gamma p\) collision assuming a typical LHC multipurpose forward detector. Accurate theoretical predictions including higher order QCD corrections are included. This paper is organized as follows: in Sect. 2 we present a brief introduction to the calculation framework including the TTM model description, EPA implementation, and LO and NLO cross section calculations. Section 3 is arranged to present numerical checks and results of our studies. Finally we summarize the conclusions in the last section.

2 Calculation framework

2.1 The essential features of the TTM model

The detailed description of the TTM model can be found in Refs. [5, 6], and here we just briefly review its essential features which are related to our calculation. The EW gauge structure of the TTM model is \(SU(2)_{0}\times SU(2)_{1}\times U(1)_{2}\). The nonlinear sigma field \(\sum _{01}\) breaks the group \(SU(2)_{0}\times SU(2)_{1}\) down to \(SU(2)\) and field \(\sum _{12}\) breaks \(SU(2)_{1}\times U(1)_{2}\) down to \(U(1)\). To separate top-quark mass generation from EWSB, a top-Higgs field \(\Phi \) is introduced to the TTM model, which couples preferentially to the top quark. To ensure that most of EWSB comes from the Higgsless side, the VEVs of the fields \(\sum _{01}\) and \(\sum _{12}\) are chosen to be \(\langle \sum _{01}\rangle =\langle \sum _{12}\rangle =F=\sqrt{2} \nu \cos \omega \), in which \(\nu =246~\hbox {GeV}\) is the EW scale and \(\omega \) is a new small parameter. The VEV of the top-Higgs field is \(f=\langle \Phi \rangle =\nu \sin \omega \).

From the above discussions, we can see that, for the TTM model, there are six scalar degrees of freedom on the Higgsless sector and four on the top-Higgs sector. Six of these Goldstone bosons are eaten to give masses to the gauge bosons \(W^{\pm }\), \(Z\), \(W'^{\pm }\) and \(Z'\). The others remain as physical states in the spectrum, which are called top-pions (\(\pi _{t}^{\pm }\) and \(\pi _{t}^{0}\)) and top-Higgs (\(h_{t}^{0}\)). In this paper, we will focus our attention on photoproduction of the charged top-pions via \(\gamma p\) collisions at the LHC. The couplings of the charged top-pions \(\pi _{t}^{\pm }\) to ordinary particles, which are related to our calculation, are given by Ref. [6]:

$$\begin{aligned} {\mathcal L}_{\pi _{t}tb}&= i\lambda _{t}\cos \omega \left\{ 1-\frac{x^{2}[a^{4}+(a^{4}-2a^{2}+2)\cos 2\omega ]}{8(a^{2} -1)^{2}}\right\} \nonumber \\&\times \pi _{t}^{+} {\bar{t}}_R b_{L}+\hbox {h.c}., \end{aligned}$$
(1)

with

$$\begin{aligned}&\lambda _{t}=\frac{\sqrt{2}m_{t}}{\nu \sin \omega } \left[ \frac{M_{D}^{2}(\varepsilon _{L}^{2}+1) -m_{t}^{2}}{M_{D}^{2}-m_{t}^{2}}\right] ,\nonumber \\&a=\frac{\nu \sin \omega }{\sqrt{2}M_{D}},\quad x=\sqrt{2}\varepsilon _{L}=\frac{2\cos \omega M_{W}}{M_{W'}}. \end{aligned}$$
(2)

Here we assume the CKM matrix to be the identity and we omit the light quark masses. \(M_{D}\) is the mass scale of the heavy fermion and \(M_{W'}\) is the mass of the new gauge boson \(W'\). Since the top quark mass depends very little on the right-handed delocalization parameter \(\varepsilon _{tR}\), we have set \(\varepsilon _{tR}=0\) in Eq. (1). The parameter \(\varepsilon _{L}\) describes the degree of delocalization of the left-handed fermions and is flavor universal, the parameter \(x\) represents the ratio of the gauge couplings. The relationship between \(\varepsilon _{L}\) and \(x\), which is given in Eq. (2), is imposed by ideal delocalization.

Reference [54] has shown that \(M_{W'}\) should be larger than 380 GeV, as demanded by the LEPII data and smaller than 1.2 TeV by the need to maintain perturbative unitarity in \(W_{L} W_{L}\) scattering. It is obvious that the coupling \(\pi _{t}tb\) is not very sensitive to the parameters \(M_{W'}\) and \(M_{D}\). Thus, the production cross sections of the subprocesses \(\gamma b\rightarrow t \pi _{t}^{-}\) and \(\gamma \overline{b}\rightarrow \overline{t} \pi _{t}^{+}\) are not strongly dependent on the values of the mass parameters \(M_{W'}\) and \(M_{D}\). In our following numerical calculation, we will take the illustrative values \(M_{W'}=500~\hbox {GeV}\) and \(M_{D}=400~\hbox {GeV}\). In this case, we have \([M_{D}^{2}(\varepsilon _{L}^{2}+1)-m_{t}^{2}]/(M_{D}^{2}-m_{t}^{2}) \approx 1\) and Eq. (1) can be approximately written as

$$\begin{aligned} {\mathcal L}_{\pi _{t}tb}\approx i\frac{\sqrt{2}m_{t}C}{\nu }\cot \omega \pi _{t}^{+}{\bar{t}}_R b_L+ \hbox {h.c.} \end{aligned}$$
(3)

with

$$\begin{aligned} C=1-\frac{x^{2}[a^{4}+(a^{4}-2a^{2}+2)\cos 2\omega ]}{8(a^{2}-1)^{2}}. \end{aligned}$$
(4)

It is obvious that the constant \(C\) is not sensitive to the value of \(\sin \omega \) and its value is close to 1. The parameter \(\sin \omega \) indicates the fraction of EWSB provided by the top condensate. The top-pion mass \(M_{\pi _t}\) depends on the amount of top-quark mass arising from the extended technicolor (ETC) sector and on the effects of EW gauge interactions [55, 56], and thus its value is model-dependent. In the context of the TTM model, Ref. [6] has obtained the constraints on the top-pion mass via studying its effects on the relevant experimental observables. Similarly to Refs. [6, 57], we will assume it as a free parameter.

2.2 Equivalent photon approximation (EPA)

In \(\gamma p\) collisions, the quasi-real photons are emitted from protons with very low virtuality so that it is a good approximation to assume that they are on-mass-shell. These quasi-real photons are scattered with small angles and low transverse momentum. At the same time, protons emitting photons remain intact and are not spoilt. Intact protons thus deviate slightly from their trajectory along the beam path without being detected by central detectors. Deflected protons and their energy loss will be detected by the forward detectors with a very large pseudorapidity. Photons emitted with small angles by the protons show a spectrum of virtuality \(Q^2\) and energy \(E_\gamma \). This is described by the equivalent photon approximation (EPA) [5860], which differs from the point-like electron (positron) case by taking care of the electromagnetic form factors in the equivalent \(\gamma \) spectrum and effective \(\gamma \) luminosity:

$$\begin{aligned}&\frac{\mathrm{d}N_\gamma }{\mathrm{d}E_\gamma \mathrm{d}Q^2}=\frac{\alpha }{\pi }\frac{1}{E_\gamma Q^2}\left[ \left( 1-\frac{E_\gamma }{E}\right) \left( 1-\frac{Q^2_{min}}{Q^2}\right) F_E\right. \nonumber \\&\qquad \qquad \qquad \left. + \frac{E^2_\gamma }{2 E^2}F_M\right] \end{aligned}$$
(5)

with

$$\begin{aligned}&Q^2_{\min }=\frac{M^2_p E^2_\gamma }{E(E-E_\gamma )},\quad F_E= \frac{4 M^2_p G^2_E + Q^2 G^2_M}{4 M^2_p +Q^2}, \\&G^2_E\!=\!\frac{G^2_M}{\mu ^2_p}\!=\!\left( 1\!+\!\frac{Q^2}{Q^2_0}\right) ^{-4},\!\quad F_M\!=\!G^2_M,\quad \! Q^2_0\!=\!0.71~\hbox {GeV}^2, \end{aligned}$$

where \(\alpha \) is the fine-structure constant, E is the energy of the incoming proton beam, which is related to the quasi-real photon energy by \(E_\gamma =\xi E\), and \(M_p\) is the mass of the proton. \(\xi = (|p| - |p'|)/|p|\), where \(p\) and \(p'\) are the momenta of incoming protons and intact scattered protons, respectively. \(\mu ^2_p=7.78\) is the magnetic moment of the proton. \(F_E\) and \(F_M\) are functions of the electric and magnetic form factors. In this case, if both incoming emitted protons remain intact, that provides the \(\gamma \gamma \) collision and it can be cleaner than the \(\gamma p\) collision; however, \(\gamma p\) collisions have higher energy and effective luminosity with respect to \(\gamma \gamma \) interactions.

2.3 The cross sections up to NLO

We denote the parton level process as \(\gamma (p_1) b(p_2)\rightarrow \pi ^\pm _t(p_3) t(p_4)\) where \(p_i\) are the particle four momenta. The hadronic cross section at the LHC can be converted by integrating \(\gamma b \rightarrow \pi ^\pm _t t\) over the photon (\(\hbox {d}N(x,Q^2)\)) and quark (\(G_{b/p}(x_2,\mu _f)\)) spectra:

$$\begin{aligned} \sigma&= \int \limits ^{\sqrt{\xi _{max}}}_{\frac{M_{inv}}{\sqrt{s}}} 2z~\hbox {d}z \int \limits ^{\xi _{\max }}_{\mathrm{Max}(z^2,\xi _{\min })} \frac{\mathrm{d}x_1}{x_1} \int \limits ^{Q^2_{\max }}_{Q^2_{\min }} \frac{\mathrm{d}N_\gamma (x_1)}{\mathrm{d}x_1\mathrm{d}Q^2} G_{b/p}\left( \frac{z^2}{x_1},\mu _f\right) \nonumber \\&\cdot \int \frac{1}{\mathrm{avgfac}} \frac{|{\mathcal M}_n ({{\hat{s}}}=z^2 s)|^2}{2 {{\hat{s}}} (2 \pi )^{3n-4}}~\hbox {d}\Phi _n, \end{aligned}$$
(6)

where \(x_1\) is the ratio between scattered quasi-real photons and incoming proton energy \(x_1 = E_\gamma /E\) and \(x_2\) is the momentum fraction of the protons momentum carried by the bottom quark. The quantity \({{\hat{s}}} = z^2 s\) is the effective c.m.s. energy with \(z^2=x_1 x_2\). \(M_\mathrm{inv}\) being the total mass of the \(\pi ^\pm _t t\) final state. \(\frac{2z}{x_1}\) is the Jacobian determinant for transforming the differentials from \(\hbox {d}x_1\hbox {d}x_2\) into \(\hbox {d}x_1\hbox {d}z\). \(G_{b/p}(x,\mu _f)\) represent the bottom quark parton density functions, \(\mu _f\) is the factorization scale, which can be chosen equal to the renormalization scale \(\mu _r\) when the loop calculation is included. \(\frac{1}{\mathrm{avgfac}}\) is the spin-average factor, color-average factor, and identical particle factor. \(|{\mathcal M}_n|^2\) represents the squared \(n\)-particle matrix element and is divided by the flux factor \([2 {{\hat{s}}} (2 \pi )^{3n-4}]\). \(\hbox {d}\Phi _n\) is the \(n\)-body phase space differential.

The parton Feynman diagrams at tree level are shown in Fig. 1a, b. We only consider the \(\pi ^-_t t\) production while its charge-conjugate contribution is the same. At NLO QCD loop level, the Feynman diagrams are presented in Figs. 2 and 3, corresponding to loop (\(\sigma ^\mathrm{loop}\)) and real (\(\sigma ^\mathrm{real}\)) contributions, respectively. There exist ultraviolet (UV) and soft/collinear IR singularities in \(\sigma ^\mathrm{loop}\). To remove the UV divergences, we introduce the wave function renormalization constants \(\delta Z_{\psi _{q,L,R}}\) for massless bottom and massive top fields as \(\psi ^{0}_{q,L,R}=(1+\delta Z_{\phi _{q,L,R}})^{\frac{1}{2}} \psi _{q,L,R}\). In the modified minimal subtraction (\(\overline{MS}\)) renormalization scheme the renormalization constants for the massless quarks, and massive top quark (defined on shell) are expressed as \(\delta Z_{\psi _{q,L}} = -\frac{\alpha _{s}}{4\pi }C_{F}(\Delta _{\mathrm{UV}}-\Delta _{\mathrm{IR}})\), \(\delta Z_{\psi _{q,R}} = -\frac{\alpha _{s}}{4\pi }C_{F}\left( \Delta _{\mathrm{UV}}-\Delta _{\mathrm{IR}}\right) \) and \(\frac{\delta m_t}{m_t} = -\frac{\alpha _s}{3\pi } [3 \Delta _{\mathrm{UV}} + 4]\), with \(C_{F}=\frac{4}{3}\). \(\Delta _{\mathrm{UV},\mathrm{IR}}=\frac{1}{\epsilon _{\mathrm{UV},\mathrm{IR}}}\Gamma (1+\epsilon _{\mathrm{UV},\mathrm{IR}})(4\pi )^{\epsilon _{\mathrm{UV},\mathrm{IR}}}\) referring to the UV and IR divergences, respectively. By adding a renormalization part to the virtual corrections, any UV singularities are regulated leaving soft/collinear IR singularities untouched. These IR singularities will be removed by combining the real emission corrections. Singularities associated with initial state collinear gluon emission are absorbed into the definition of the parton distribution functions. We employ the \(\overline{MS}\) scheme for the parton distribution functions. Similar to the virtual part, we utilize dimensional regularization to control the singularities of the radiative corrections, which are organized using the two cutoff phase space slicing (TCPSS) method [61]. We adopt TCPSS to isolate the IR singularities by introducing two cutoff parameters \(\delta _{s}\) and \(\delta _{c}\). An arbitrary small \(\delta _{s}\) separates the three-body final state phase space into two regions: the soft region (\(E_{5}\le \delta _{s}\sqrt{{\hat{s}}}/2\)) and the hard region (\(E_{5}>\delta _{s}\sqrt{{\hat{s}}}/2\)). The quantity \(\delta _{c}\) separates the hard region into the hard collinear (HC) region and hard noncollinear (\(\overline{\hbox {HC}}\)) region. The criterion for separating the HC region is described as follows: the region for real gluon/light-(anti)quark emission with \({\hat{s}}_{15}\) (or \({\hat{s}}_{25}\)) \(< \delta _{c}{\hat{s}}\) (where \({\hat{s}}_{ij}=(p_{i}+p_{j})^{2}\)) is called the HC region. Otherwise it is called the \(\overline{\hbox {HC}}\) region which in our case is related to

$$\begin{aligned}&\gamma (p_1) b(p_2) \rightarrow \pi ^-_t(p_3) t(p_4) g(p_5), \nonumber \\&\gamma (p_1) g(p_2) \rightarrow \pi ^-_t(p_3) t(p_4) {\bar{b}}(p_5), \end{aligned}$$
(7)

corresponding to real gluon emission and real light-(anti)quark emission partonic processes, respectively. After combining all these contributions, the UV and IR singularities in \(\sigma ^{\mathrm{total}}=\sigma ^{\mathrm{Born}}+ \sigma ^{\mathrm{loop}}+\sigma ^S+\sigma ^{\mathrm{HC}}+ \sigma ^{\overline{\mathrm{HC}}}\) are exactly canceled. The dependence on the arbitrary small cutoff parameters \(\delta _{s}\) and \(\delta _{c}\) then vanishes. These cancelations can be verified numerically in our numerical calculations.

Fig. 1
figure 1

Tree parton level Feynman diagrams for \(rb\rightarrow \pi ^-_t t\) in the TTM frame

Fig. 2
figure 2

The QCD one-loop Feynman diagrams for the partonic process \(\gamma b \rightarrow \pi ^-_t t\) (ah). Counterterm diagrams corresponding to Fig. 1 are not shown here

Fig. 3
figure 3

Some the tree level Feynman diagrams for the real gluon/light-(anti)quark emission subprocess \(\gamma b \rightarrow \pi ^-_t t g\) related to the first process in Eq. 7 (af) and \(\gamma g\rightarrow \pi ^-_t t {\bar{b}}\) related to the second process in Eq. 7 (g, h)

3 Numerical results and discussions

We use FeynArts, FormCalc, and our modified LoopTools (FFL) [6264] packages to perform the numerical calculation. We use CT10 [65] for the parton distributions for collider physics and BASES [66, 67] to do the phase space integration. In the numerical calculations, we take the input as \(M_p=0.938272046~\hbox {GeV}\), \(M_Z=91.1876~\hbox {GeV}\), \(M_W=80.385~\hbox {GeV}\), \(M_t=173.5~\hbox {GeV}\), \(\alpha (M_Z^2)^{-1}=127.918\) [68], \(\sqrt{s}=14~\hbox {TeV}\). For the strong coupling constant \(\alpha _s(\mu )\), we use the two-loop evolution of it with the QCD parameter \(\Lambda ^{n_f=5}=226~\hbox {MeV}\) and get \(\alpha _s(\mu _0)= 0.113\). \(N_f\) is the number of active flavors. We choose two sets of the parameters related to the TTM model.

  • Scenario 1: \(M_D=400~\hbox {GeV}\), \(\sin \omega =0.5\), \(M_{W'}=500~\hbox {GeV}\), \(M_{\pi _t}=400~\hbox {GeV}\);

  • Scenario 2: \(M_D=400~\hbox {GeV}\), \(\sin \omega =0.2\), \(M_{W'}=500~\hbox {GeV}\), \(M_{\pi _t}=200~\hbox {GeV}\),

corresponding to high (low) \(M_{\pi _t}\) regions, respectively. The detected acceptances are chosen to be [69, 70]:

  • \(\xi _1\): CMS-TOTEM forward detectors with \(0.0015<\xi <0.5\);

  • \(\xi _2\): CMS-TOTEM forward detectors with \(0.1<\xi <0.5\);

  • \(\xi _3\): AFP-CMS forward detectors with \(0.0015<\xi <0.15\).

Before presenting the numerical predictions, several checks should be done. First, The UV and IR safeties are verified numerically after combining all the contributions at the QCD one-loop level. We display random phase space points as well as the cancelation for different divergent parameters with the help of OneLoop [71] to compare with our modified LoopTools. Second, when doing the phase space integration, we use Kaleu [72] to cross check especially for the hard emission contributions. Third, since the total cross section is independent of the soft cutoff \(\delta _s(=\Delta E_g/E_b, E_b=\sqrt{{\hat{s}}}/2)\) and the collinear cutoff \(\delta _c\), trivial efforts should be made to check such independence. Fourth, the scale (\(\mu \)) dependence should be reduced after considering the NLO corrections. Indeed, our results show that the scale uncertainty can be reduced significantly. Choosing the input scenario 1 as an example, if \(\mu \) varies from \(1/8\mu _0\) to \(\mu _0=M_t\), the LO cross section varies from 3.2 to 6 fb, while NLO predictions stay much flatter between 5.5 and 6.4 fb. For more details, see Fig. 4, where we show the scale (\(\mu \)) dependence of the LO and NLO QCD loop-corrected cross sections for \(pp\rightarrow p\gamma p \rightarrow \pi ^-_t t+X\). In the further numerical calculations, we fix \(\delta _s = 10^{-4}\), \(\delta _c=\delta _s/50\) and choose \(\mu =\mu _0=M_t\).

Fig. 4
figure 4

The scale (\(\mu \)) dependence of the LO and NLO QCD corrected cross sections for \(pp\rightarrow p\gamma p\rightarrow \pi ^-_t t+X\) at \(\sqrt{s} = 14~\hbox {TeV}\) LHC with \(\mu _0=M_t\), \(\delta _s=10^{-4}\), and \(\delta _c=\delta _s/50\). The experimental detector acceptances (\(\xi _{\min }<\xi <\xi _{\max }\)) are supposed to be \(0<\xi <1\). Solid and dashed lines are for scenario 1, LO, and NLO, respectively, while dotted and dot-dotted lines are for scenario 2, LO, and NLO, respectively

3.1 Cross sections and distributions

In Fig. 5 we present the cross sections (the left panel) for NLO predictions and the K-factor (the right panel) defined as \(\sigma ^\mathrm{NLO}/\sigma ^\mathrm{LO}\) for \(pp\rightarrow p\gamma p \rightarrow {\pi ^-_t} t+X\) as functions of different values of the input parameters in the TTM model. One is \(\sin \omega \) and the other is the top-pion mass \(M_{\pi _t}\). Here we choose the detector acceptance as \(0.0015<\xi <0.5\). The other parameters related to the TTM model are chosen to be \(M_D=400~\hbox {GeV}\) and \(M_{W'}=500\), with \(\sin \omega \) varying from 0.2 to 0.8 and \(M_{\pi _t}\) from 200 to 400 GeV, respectively. Our results show that the total LO and NLO cross sections are sensitive to the input parameter \(\sin \omega \). When \(\sin \omega \) becomes larger, the cross sections reduce obviously. The same behavior can be found for the charged top-pion mass \(M_{\pi _t}\). When the mass becomes heavier, the phase space of the final states is suppressed, thus leading lower cross sections. The right panel presents the K-factor dependence on \(\sin \omega \) and \(M_{\pi _t}\). No matter how \(\sin \omega \) changes, the K-factor does not change much with a fixed top-pion mass. While for \(M_{\pi _t}\) becoming larger from 200 to 400 GeV, the K-factor grows up step-by-step, however, not very much, we see, from 1.07 to 1.1, leading to NLO QCD corrections up to around \(7{-}11~\%\) within our chosen parameters.

Fig. 5
figure 5

Cross sections (the left panel) for NLO predictions and K-factor (the right panel) defined as \(\sigma ^\mathrm{NLO}/\sigma ^\mathrm{LO}\) for \(pp\rightarrow p\gamma p \rightarrow {\pi ^-_t} t+X\) as functions of different values of the parameters in TTM models at 14 TeV LHC. Here we choose \(0.0015<\xi <0.5\). The other parameters related to TTM models are chosen to be \(M_D=400~\hbox {GeV}\), \(M_{W'}=500\), with \(\sin \omega \) varying from 0.2 to 0.8 and \(M_{\pi ^-_t}\) from 200 to 400 GeV, respectively, and the other TTM model input parameters are chosen to be as in scenario 2

To see how the cross sections depend on the detector acceptances, in Fig. 6 we fix \(\xi _{\min }=0.0015\) and take \(\xi _{\max }\) as a running parameter. Cross sections for the two input scenarios are presented as \(\xi _{\max }\) running from 0.15 to 1. The left panel presents results for scenario 1 with dotted and dot-dotted lines for LO and NLO, while the right panel is for scenario 2 with solid and dashed lines for LO and NLO predictions, respectively. From these panels, we can see, for \(\xi _{\max }<0.5\), that the cross section enhances rapidly when the \(\xi \) acceptances become larger. The case is different for \(\xi _{\max }>0.5\) where few contributions contribute. Furthermore, no matter how the detector acceptances change, the ratio of \(\sigma ^{\mathrm{NLO}}\) to \(\sigma ^{\mathrm{LO}}\) does not change much. Typical values of the K-factor equal to 1.09 for scenario 1, and 1.07 for scenario 2 lead to the NLO QCD loop corrections up to 9 and \(7~\%\) and keep unchanged as functions of running \(\xi \). However, to avoid misleading ideas, we show Fig. 6 in order to see the dependence on \(\xi _{\max }\) with fixed \(\xi _{\min }\). If we change the choice of \(\xi _{\min }\), for example, from 0.0015 to 0.1, the results, i.e., the cross section of the signal at LO and NLO, the K-factor, will change to other values.

Fig. 6
figure 6

Cross sections for LO and NLO predictions for \(pp\rightarrow p\gamma p \rightarrow \pi ^-_t t+X\) as functions of the different values of the \(\xi _{\max }\) detector acceptances at the 14 TeV LHC. Here we fix \(\xi _{\min }=0.0015\) and take \(\xi _{\max }\) as a running parameter from 0.15 to 1. The left panel is in units of fb for TTM scenario 1 with solid and dashed lines for the LO and NLO predictions, while the right axis is in pb for TTM scenario 2 with dotted and dot-dotted lines for LO and NLO, respectively

We present the transverse momentum (\(p_T\)) and rapidity (\(y\)) distributions for the charged top-pion in Fig. 7. For \(p_T^{\pi ^-_t}\), the NLO predictions can clearly enhance the LO distributions around the peak range and the same behavior can be found for the \(p_T^t\) distributions. It will be interesting to see \(y^{\pi ^-_t}\) where the NLO corrections can shift the LO rapidity obviously in the way of moving the position where \(y^{\pi ^-_t}\) peaked. Take \(0.0015<\xi <0.5\) as an example, the distribution \(y^{\pi ^-_t}\) peaked at \(y=-0.18\) for LO while the NLO predictions move the LO \(y^{\pi ^-_t}\) peak to \(y=-0.42\) but there is no obvious enhancement to the LO predictions.

Fig. 7
figure 7

The LO (lower curves) and NLO (upper curves) transverse momentum (\(p_T\)) and rapidity (\(y\)) distributions of the charged top-pion \(\pi ^-_t\) for the process \(pp\rightarrow p\gamma p \rightarrow \pi ^-_t t+X\) at the 14 TeV LHC. The experimental detector acceptances (\(\xi _{\min }<\xi <\xi _{\max }\)) are chosen to be \(0.0015<\xi <0.5\) (solid lines), \(0.1<\xi <0.5\) (dashed lines), and \(0.0015<\xi <0.15\) (dotted lines), respectively, and the TTM model input parameters are chosen to be as in scenario 2

3.2 Signal background analysis and parameter sensitivity

Now let us turn to the signal and background analysis. From Ref. [6] we see that, for \(M_{h_t} \!\ge \! 300~\hbox {GeV}\) and \(M_{\pi _t} \!\le \! 600\) \(\hbox {GeV}\), the charged top-pions \(\pi ^-_t\) dominantly decay into \(\overline{t}b\) and we have \(Br(\pi ^-_t \rightarrow \overline{t}b)>90~\%\). As for the mass of \(M_{\pi _t}\) to become higher, the validity of this statement is no longer independent of the mass of, for example, the top-Higgs, \(M_{h_t}\). However, for each value of \(\sin \omega \), a specific range of masses for the top-Higgs is excluded by the Tevatron data. For example, taking the illustrative value \(\sin \omega = 0.5\), the data implies that the mass range \(140~\hbox {GeV}<M_{H_t}<195~\hbox {GeV}\) is excluded. Here we concentrate on the case where \(M_{h_t} \ge 350~\hbox {GeV}\). Even though, as the mass \(M_{\pi _t}\) becomes higher than 600 GeV, the decay mode \(\pi ^\pm \rightarrow W^\pm H_t\) becomes more and more competitive, where the assumption of a branching ratio \(Br(\pi ^-_t \rightarrow \overline{t}b) < 90~\%\) should be considered. We concentrate on the \(\pi ^\pm _t \rightarrow \overline{t}b(t\overline{b})\) decay modes. In this case, photoproduction of the charged top-pion associated with a top quark can easily be transferred to the \(t{\bar{t}}b\) final state through

$$\begin{aligned} pp&\rightarrow p\gamma p \rightarrow \pi ^-_t t \rightarrow {\bar{t}} b W^+ b \rightarrow W^-{\bar{b}} b W^+ b\nonumber \\&\rightarrow \ell ^{+}\ell ^{-} {\bar{b}}b b {/\!\!\! E\,}_T \end{aligned}$$
(8)

and thus gives rise to the \(\ell ^+\ell ^- {\bar{b}}b b {/\!\!\! E\,}_T\) signature via \(\gamma b\) collisions at the LHC.

The backgrounds appear in two kinds of processes. The first, called irreducible background, comes from photoproduction with a very similar final state as the signal. The second has the same final state but occurs through different processes induced by partonic interactions and is called a reducible background. The key difference between photoproduction and partonic interactions at the LHC lies in the absence of color exchange on the photon side. This causes an important zone of rapidity to be completely devoid of hadronic activity; it is called a large rapidity gap (LRG) and it is a natural way to distinguish photoproduction and partonic backgrounds. In the framework of EPA, emitted quasi-real photons from the protons have a low virtuality and are scattered with small angles from the beam pipe. Therefore when a proton emits a quasi-real photon it should also be scattered with a small angle. Hence, intact scattered protons exit the central detector without being detected. This causes a decrease in the energy deposit in the corresponding forward region compared to the case in which the proton remnants are detected by the calorimeters. Consequently, for any reaction like \(pp\rightarrow p\gamma p\rightarrow pX\), one of the forward regions of the central detector shows a significant lack of energy. The region with a lack of energy (or equivalently lack of particles) defines a forward LRG. Backgrounds from the usual \(pp\) deep inelastic processes can be rejected by applying a selection cut on this quantity.

In addition, another tagging method based on the same physics properties of photoproduction events is to place an exclusivity condition on the reconstructed particle tracks on the gap side which can obviously reduce partonic backgrounds [73]. Even if both conditions are used and the partonic background is reduced to a level that does not allow for proper signal extraction, elastic photon emission can be tagged using a very forward detector (VFD) [74] placed hundreds of meters away from the interaction point. For instance, the case for which VFD stations would be put at 220 and 420 m from the interaction point is mandatory in order to retain low partonic backgrounds [75]. Indeed, when an intact proton is scattered with a large pseudorapidity it escapes detection from the central detectors. But since its energy is lower than the beam energy, its trajectory decouples from the beam path into the very forward region. Forward detectors can detect particles with a large pseudorapidity. The detection of final state intact protons by the forward detectors provides a characteristic signature. Backgrounds from usual DIS processes can also be rejected by use of this characteristic signature provided by the forward detectors.

Therefore in our paper, the considered backgrounds come from protoproduction. Even though in high-energy \(\gamma p\) interactions at the LHC, one needs to pay attention to single diffractive (SD) backgrounds. SD backgrounds can most likely be suppressed using AFP and tuned exclusivity cuts. There are not many papers dealing with diffractive photoproduction processes at LHC. Here we use the most powerful cut: the \(p_T\) cut of a proton is larger than \(100~\hbox {MeV}\) to suppress the diffraction background from photon-induced processes with the help of Pythia 8 [76] and in-house modifications. After considering the b-tagging efficiency and the rejection factors for the light jets, we get the SD background for our production in about the order of 0.1 fb, which has been taken into our consideration. From this point we can see that the main backgrounds would still come from \(t{\bar{t}}\) plus jet (\(t{\bar{t}}j\)) photoproduction. Different from normal \(pp\) collision, in \(\gamma p\) collisions where photoproduction of top quark pairs has similar cross sections like, for example, \(W^- t\) productions, we have only \(\sim \)1.4 pb [19], while for \(t{\bar{t}}j\), we have roughly \(\sim \)16 fb after considering the fake b-tagging efficiency, leading to such related background processes going easier than in the case of the \(pp\) collision. Here we assume that the \(\pi ^\pm _t\) fully decay to \(t{\bar{b}}({\bar{t}}b)\) if \(M_{\pi _t} < 600~\hbox {GeV}\), while \(Br(\pi ^\pm _t \rightarrow t{\bar{b}}({\bar{t}}b) < 90~\%)\) [6] should be considered if \(M_{\pi _t} \ge 600~\hbox {GeV}\). For the SM gauge bosons \(W^{\pm }\) to decay leptonically, \(W^{\pm }\rightarrow l\nu \), the signal is \(S={\mathcal L} \times \sigma (pp\rightarrow prp \rightarrow \pi ^\pm _t t\rightarrow t{\bar{t}}b)\times K^{\mathrm{NLO}} \times [BR(t\rightarrow Wb)]^2 \times [3\times BR(W\rightarrow \ell \nu )]^2\), and the corresponding background as \(B={\mathcal L} \times \sigma (pp\rightarrow prp \rightarrow t{\bar{t}}j)\times Eff_{j} \times [BR(t\rightarrow Wb)]^2 \times [3\times BR(W\rightarrow \ell \nu )]^2\) with \(j=u,d,c,s, b, {\bar{u}},{\bar{d}},{\bar{c}},{\bar{s}},{\bar{b}},g\) and \(\hbox {Eff}_{j}\) is the fake b-tagging efficiency of the jets. For c-jets and light jets, a fake b-tagging efficiency of 10 and 1 \(\%\), respectively, is assumed. Here we take \(BR(t\rightarrow Wb) \approx 1\) and \(BR(W\rightarrow \ell \nu ) \approx 0.108\). For the luminosity \({\mathcal L}\) we take 1, 10, and \(100~\hbox {fb}^{-1}\), respectively. In Table 1, we present the parameters’ sensitivity on the signal background ratio \(S/\sqrt{B}\). Here we choose \(0.0015<\xi <0.5\). The background cross section after considering all the b-tagging efficiency and the rejection factors for the \(c, {\bar{c}}\), and light jets is 1.68 fb. The \(5\sigma \) and \(3\sigma \) bounds of the parameters are presented with three values of the luminosity. For \(S/\sqrt{B}>5\), the new physics signal will be detected obviously while for \(S/\sqrt{B}<3\) it will be a challenge to detect.

Table 1 The TTM parameters \(\sin \omega \) and \(M_{\pi _t}\) sensitivities on the signal background ratio \(S/\sqrt{B}\). \(5\sigma \) for the discovery boundary and \(3\sigma \) for the excluding boundary. The detector acceptance here is chosen to be \(0.0015<\xi <0.5\)

Our results show that, for low \(M_{\pi _t}\), the \(\sin \omega \) discovery range is larger than the case of high \(M_{\pi _t}\). As the top-pion mass becomes larger, the \(\sin \omega \) discovery range is suppressed. When \(M_{\pi _t} > 900~\hbox {GeV}\), the heavy final state strongly suppresses the phase space. The signal becomes much smaller and makes it more a challenge to detect. In this case, a higher luminosity is needed to make the detection possible and push the discovery boundary larger. Two ways can be used in order to constrain the parameters or the excluding boundary more strictly: one is, as we see, to enhance the luminosity which can expand the related parameter space, see Table 1, while the other one is to take more kinematical cuts to improve the ratio \(S/\sqrt{B}\). In our case for example, if a \(p_T^\mathrm{jet}\) cut is taken to be larger than 200 GeV, this can strongly suppress the \(ttj\) backgrounds and thus lead to better \(S/\sqrt{B}\) in parts of the TTM parameter space.

4 Summary

In this work, we present the precise photoproduced charged top-pion \(\pi ^\pm _t\) production associated with a top through \(pp\rightarrow p\gamma p \rightarrow \pi ^\pm _t t+X\) at the 14 TeV LHC at NLO QCD loop level. We find that the cross sections are sensitive to the TTM parameters, and the smaller the \(\sin \omega \) is or the lighter the top-pion \(\pi ^-_t\) is, the larger the cross sections will be. The typical QCD correction value is \(7{-}11~\%\), which does not depend much on the TTM parameter \(\sin \omega \) as well as the detector acceptances \(\xi \). We also present the \(5\sigma \) discovery and \(3\sigma \) excluding boundaries as functions of the TTM parameters for three values of the luminosity at the future LHC.