1 Introduction

Local U(1) extensions of the standard model (SM) are well-motivated new physics at the TeV-scale. It can be constructed either from the bottom-up approach, such as the flavorful gauge symmetry \(U(1)_{\mathbf {L}_i-\mathbf {L}_j}\) [1], or from the top-down approach, such as \(U(1)_{\mathbf {N}}\) [2] which comes from the spontaneous breaking of the \(E_6\) grand unification theory. Many models with new U(1) gauge symmetry have been proposed addressing various problems, such as \(U(1)_{\mathbf {L}_i-\mathbf {L}_j}\) [1], \(U(1)_{\mathbf {N}}\) [2], \(U(1)_{\mathbf { B-L}}\) [3,4,5], \(U(1)_\mathbf {B}\) [6, 7], \(U(1)_{\mathbf {L}}\) [6,7,8], \(U(1)_{\mathbf {B+L}}\) [9, 10] generic U(1) [11, 12] etc. For a review of various U(1) models and collider signatures of the U(1)-related gauge boson, we refer the reader to Ref. [13] for detail. Of various local U(1) models, the \(U(1)_{\mathbf {R}}\), a gauge symmetry for right-handed fermions, is attractive for following reasons:

  • its anomalies can be easily cancelled by introducing three right-handed Majorana neutrinos only,

  • it may occur in left-right symmetric models [14] and in SO(10) models [15, 16],

  • it may solve the vacuum stability problem [17] without appealing to for extra Higgs interactions,

but its phenomenology was not studied in detail in any reference.

In this paper phenomenology relevant to the \(U(1)_{\mathbf {R}}\) is investigated. We first focus on constraint on the model from \(Z-Z^\prime \) mixing since there is tree-level mixing between Z and \(Z^\prime \) in the local \(U(1)_{\mathbf {R}}\) model. Mixing angles of the \(Z_\mathbf {R}\) with Z and \(\gamma \) as well as the mass spectrum of gauge bosons are calculated. It shows that the \(Z-Z^\prime \) mixing puts a lower bound on \(v_\Phi /v\), which is the function of \(g_{\mathbf {R}}\), where v is the vacuum expectation value (VEV) of the SM Higgs, \(v_\Phi \) is the VEV of the scalar singlet \(\Phi \) that breaks the \(U(1)_{\mathbf {R}}\) spontaneously, \(g_{\mathbf {R}} \) is the gauge coupling of \(U(1)_{\mathbf {R}}\), while the precisely measured Z boson mass puts a stronger constraint on \(v_\Phi /v\): \(v_\Phi /v>73.32\).

Then we study how to naturally realize neutrino masses in the \(U(1)_{\mathbf {R}}\) model. The discovery of the neutrino oscillations has confirmed that neutrinos are massive and lepton flavors are mixed, which provides the first evidence for new physics beyond the SM. Canonical seesaw mechanisms [18,19,20,21,22,23,24,25,26,27,28,29,30] provide a natural way in understanding the tiny but non-zero neutrino masses. In the \(U(1)_{\mathbf {R}}\) model the mass matrix of right-handed Majorana neutrinos originates from their Yukawa couplings with \(\Phi \), and their masses are thus at the TeV-scale, such that it predicts a tiny Yukawa coupling of right-handed neutrinos with left-handed lepton doublets if active neutrino masses are generated from the type-I seesaw mechanism. We show that neutrino masses can be generated from the modified type-II seesaw mechanism, where the scalar triplet carries no \(U(1)_{\mathbf {R}}\) charge and its coupling with other scalars breaks the \(\mathbf {B-L}\) explicitly.

After that we focus on the phenomenology of \(Z_\mathbf {R}\)-portal dark matter. The fact that about \(26.8\%\) of the universe is made of dark matter with relic abundance \(\Omega h^2\) = 0.1189, has been firmly established, while the nature of the dark matter is still unclear. Imposing the \(Z_2\)-symmetry on right-handed neutrinos only, the lightest right-handed neutrino \(\mathbf {N}\) can be cold dark matter candidate. We study constraint on the model from the observed dark matter relic density, the exclusion limits of the spin-independent direct detection cross section mediated by \(\Phi \) and H, as well as the spin-dependent direct detection cross section mediated by the \(Z_\mathbf {R}\). It shows that right-handed neutrino dark matter is available only for its mass at near the resonance of SM Higgs, new scalar singlet and the \(Z_\mathbf {R}\), or for its mass being very heavy.

Finally we investigate collider signatures of the \(Z_\mathbf {R}\) at the LHC.Comparing its production cross section at the LHC the with upper limits given by the ATLAS, we get the lower limit on the \(Z_{\mathbf {R}}\) mass, which is the function of \(g_\mathbf {R}\). It shows that the constraint from the dilepton search at the LHC is stronger than that from the \(Z-Z_\mathbf {R}\) mixing only for \(g_\mathbf {R}<0.121\).

The paper is organized as follows: In Sect. 2 we introduce the model in detail. In Sect. 3 we study constraint on the model from \(Z-Z^\prime \) mixing. Sections. 4 and 5 are focused on the neutrino mass and the dark matter phenomenology, respectively. We study the collider signature of \(Z_{\mathbf {R}}\) in Sect. 6. The last part is concluding remarks.

2 The model

Table 1 Quantum numbers of various fields under the local \(U(1)_{\mathbf {R}}\), \(\ell _L\) and \(Q_L\) are left-handed fermion doublets, \(\mathbf {N}_R\) is right-handed neutrinos, \(\Phi \) is the electroweak singlet scalar

We formulate our model in this section. Only right-handed fermions and the SM Higgs carry non-zero \(U(1)_\mathbf {R}\) charge which we normalize to be multiples of “\(\beta \)”. The SM provides the even number of fermion doublets required by the global \(SU(2)_L^{}\) anomaly [31]. The absence of axial-vector anomalies [32,33,34] and the gravitational-gauge anomaly [35,36,37] require that the SM should be extended with three right-handed neutrinos. We list in Table 1 the quantum number of various fields under the \(U(1)_\mathbf {R}\). The anomaly cancellation conditions are listed in Table 2. In the following studies, we set \(\beta =1\) for simplicity.

Table 2 The anomaly cancellation conditions of the \(U(1)_{\mathbf {R}}\)

The covariant derivative can be written as \(D_\mu =\partial _\mu -ig\tau ^a A_\mu ^a -ig'YB_\mu -ig_\mathbf {R} Y_\mathbf {R}B^\prime _\mu \), where \(g_\mathbf {R}\) is the gauge coupling of \(U(1)_\mathbf {R}\) and \(Y_\mathbf {R}=0,\pm 1\). The scalar potential and the Yukawa interactions take the following form:

$$\begin{aligned} V_{~}^{}= & {} -\,\,\mu ^2 H^\dagger H + \lambda (H^\dagger H)^2 -\mu _\Phi ^2 \Phi ^\dagger \Phi + \lambda _1 (\Phi ^\dagger \Phi )^2\nonumber \\&+\,\, \lambda _2 (\Phi ^\dagger \Phi ) (H^\dagger H) \, \end{aligned}$$
(1)
$$\begin{aligned} \mathcal{L}_Y= & {} -\,\, \overline{Q_L^{}} Y_U^{} \widetilde{H} U_R^{} - \overline{Q_L^{}} Y_D^{} H D_R^{} \nonumber \\&-\,\,\overline{\ell _L^{}} Y_E^{} H E_R^{} - \overline{\mathbf {N}_R^C} Y_\mathbf {N} \Phi \mathbf {N}_R^{} + \mathrm{h.c.} \, \end{aligned}$$
(2)

where \(H\equiv [G^+, (h+iG^0_h + v)/\sqrt{2}]^T\) with v the VEV of H and \(\Phi \equiv (\phi +iG^0_s +v_\Phi )/\sqrt{2}\) with \(v_\Phi \) the VEV of \(\Phi \), \(Y_U,~Y_D\) and \(Y_E\) are \(3\times 3\) Yukawa matrices. The Yukawa interaction of right-handed neutrinos with left-handed lepton doublets is forbidden by the \(Z_2^{}\) discrete flavor symmetry and the lightest \(\mathbf {N}_R^{}\) is the cold dark matter candidate. Imposing the minimization conditions, one has

$$\begin{aligned} m_{h,\phi }^2= & {} (v^2 \lambda + v_\Phi ^2 \lambda _1^{} ) \mp \sqrt{ (v^2 \lambda - v_\Phi ^2 \lambda _1^{} ) ^2 + v^2 v_\Phi ^2 \lambda _2^2}\end{aligned}$$
(3)
$$\begin{aligned} \alpha ~~~= & {} {1 \over 2 } \arctan \left[ { v v_\Phi \lambda _2 \over v^2 \lambda -v_\Phi ^2 \lambda _1^{} }\right] \end{aligned}$$
(4)

where \(\alpha \) is the mixing angle between CP even scalars. The physical parameters in the scalar sector are \(m_h\), \(m_\phi \), \(\alpha \), v and \(v_\Phi \), while all other parameters can be reconstructed by them. The mixing angle \(\alpha \) is constrained by the data from Higgs measurements at the LHC. Universal Higgs fits [38] to the data of ATLAS and CMS collaborations were performed in Refs. [9, 10, 39], and one has \(\cos \alpha >0.865\) at the 95% confidence level. The constraint from electroweak precision observables is usually weaker than that from universal Higgs fit [40]. For the beta functions of \(\lambda _i\) and \(g_{\mathbf {R}}\) as well as their impacts on the vacuum stability of the SM Higgs, we refer the reader to Ref. [17] for detail, where the stability of the SM vacuum can be enhanced by the new gauge coupling.

Fig. 1
figure 1

Contours of \(\theta _{13}\) (left-panel) and \(\theta _{23}\) (right-panel) in the \(g_{\mathbf {R}}-v_\Phi /v\) plane

3 Vector boson Masses and Mixings

Masses of gauge bosons come from the spontaneous breaking of the \(SU(2)_L^{} \times U(1)_Y^{} \times U(1)_\mathbf {R}\) gauge symmetry. Since the SM Higgs carries non-zero \(U(1)_\mathbf {R}\) charge, there is mixing between Z and \(Z_\mathbf {R}\) at the tree-level.Footnote 1 The mass matrix of neutral vector bosons in the basis \((B_\mu ^{},~W_\mu ^3,~B_\mu ^\prime )\) is given by:

$$\begin{aligned} M_V^2 = {v^2\over 4}\left( \begin{array}{l@{\quad }l@{\quad }l} g^{\prime 2} &{} -g^\prime g &{} 2 g^\prime g_{\mathbf {R}}\\ -g^\prime g &{} g^2 &{} -2 g g_{\mathbf {R}} \\ 2 g^\prime g_\mathbf {R}^{} &{} -2 g g_{\mathbf {R}} &{} 4 g_{\mathbf {R}}^2 (1 + \delta ) \end{array}\right) , \end{aligned}$$
(5)

where \(g,~g^\prime \) are gauge couplings of \(SU(2)_L\) and \(U(1)_Y\) respectively; \(\delta = 4 v_\Phi ^2 /v^2\). In the limit \(g_\mathbf {R}^{} \rightarrow 0\), one gets the mass matrix of the SM gauge bosons. The mass matrix in Eq. (5) can be diagonalized by the \(3\times 3\) unitary transformation, \(\mathcal{U}^\dagger M_V^2 \mathcal{U}^* = \mathrm{diag} \{ 0 ,~M_Z^2,~M_{Z_{\mathbf {R}}}^2 \} \), where \(\mathcal{U}\) can be written in terms of the standard parameterization:

$$\begin{aligned} \mathcal{U } = \left( \begin{array}{l@{\quad }l@{\quad }l} c_{12} c_{13} &{} s_{12} c_{13} &{} c_{13}\\ -c_{23} s_{12} -c_{12} s_{13} s_{23} &{} c_{12} c_{23} -s_{12} s_{13} s_{23} &{} c_{13} s_{23} \\ -c_{12} c_{23} s_{13}+s_{12} s_{23} &{} -c_{23} s_{12} s_{13} -c_{12} s_{23 } &{} c_{13} c_{23} \end{array}\right) ,\nonumber \\ \end{aligned}$$
(6)

with \(c_{ij} \equiv \cos \theta _{ij}\) and \(s_{ij} \equiv \sin \theta _{ij}\). Mass eigenvalues of Z and \(Z_{\mathbf {R}} \) are

$$\begin{aligned}&M_{Z_\mathbf {R}(Z)}^2 ={v^2 \over 8 } \left\{ g^2 + g^{\prime 2} + 4 g_{\mathbf {R}}^2 (1+ \delta ) \right. \nonumber \\&\left. \pm \,\sqrt{-16 \delta (g^2 + g^{\prime 2}) g_{\mathbf {R}}^2 +[ g^2 + g^{\prime 2} + 4 g_{\mathbf {R}}^2(1+\delta )]^2} \right\} \end{aligned}$$
(7)

For the case \(4 g_{\mathbf {R}}^2 (1+ \delta ) \gg g^2 + g^{\prime 2} \), which corresponds to the decoupled limit, it has \(M_{Z^\prime }^2 \approx v^2 (1+\delta ) g_{\mathbf {R}}^2\) and \(M_Z^2 \approx (g^2 + g^{\prime 2} )v^2/4\). Mixing angles are actually the function of \(g_{\mathbf {R}}\) and \(\delta \):

$$\begin{aligned} \tan \theta _{23}^{}= & {} -{g \over 2 g_{\mathbf {R}} }\left( 1- { g_{\mathbf {R} }^2 v^2 \delta \over M_{Z_\mathbf {R}}^2 }\right) \; \end{aligned}$$
(8)
$$\begin{aligned} \sin \theta _{13}= & {} { g^\prime (M_{Z_\mathbf {R}}^2 -g_{\mathbf {R}}^2 v^2 \delta ) \over \left[ (g^2 + g^{\prime 2 } ) (M_{Z_\mathbf {R}}^2 - g_{\mathbf {R}}^2 v^2 \delta )^2 + 4 g_{\mathbf {R}}^2 M_{Z_\mathbf {R}}^4\right] ^{1/2} }\nonumber \\ \end{aligned}$$
(9)
$$\begin{aligned} \tan \theta _{12}= & {} { g^\prime (M_{Z}^2 -g_{\mathbf {R}}^2 v^2 \delta ) \sqrt{g^2 +g^{\prime 2}} \over g \left[ (g^2 + g^{\prime 2 } ) (M_{Z }^2 - g_{\mathbf {R}}^2 v^2 \delta )^2 + 4 g_{\mathbf {R}}^2 M_{Z }^4 \right] ^{1/2} }\nonumber \\ \end{aligned}$$
(10)

where \(\theta _{12}^{} \) corresponds to the conventional weak mixing angle, \(\theta _{13}\) and \(\theta _{23}\) are mixing angles of \(\gamma -Z_\mathbf {R}^{}\) and \(Z-Z_\mathbf {R}^{}\) respectively.

Fig. 2
figure 2

Contours of \(\Delta M_Z\) in the \(g_\mathbf {R}-v_\Phi /v\) plane

Due to the \(Z-Z_\mathbf {R}\) mixing, \(Z_\mathbf {R}\) may decay into charged gauge boson pairs \(W^-W^+\), which can be used to place constraint on the \(Z-Z_\mathbf {R}\) mixing using diboson production at the LHC. It shows that the \(Z-Z_\mathbf {R}\) mixing should be less than \(0.7\sim 2\times 10^{-3}\) [41] derived from the data recoded by ATLAS and CMS collaborations at \(\sqrt{s}=13~\text {TeV}\) with integrated luminosities of \(13.2~\mathrm{fb^{-1}}\) and \(35.9~\mathrm{fb}^{-1}\), respectively. In Fig. 1, we show contours of the \(\theta _{13}\) (left-panel) and \(\theta _{23}^{}\) (right-panel) in the \(g_{\mathbf {R}}-v_\Phi /v\) plane. We take \(\alpha (M_Z)^{-1}=127.918\), \(\sin ^2 \theta _W (M_Z^{})=0.23122\) and \(M_Z=91.1876~\mathrm{GeV}\) [42], which are used to get values of g and \(g^\prime \) respectively. One can see from the right-panel of Fig. 1 that, the scale of the \(U(1)_{\mathbf {R}}\) breaking should be at least one order higher than the electroweak scale. According to Eq. (7), the Z-boson mass is slightly changed in the \(U(1)_\mathbf {R}^{}\) model. There is thus constraint from the precision measurement of the Z boson mass. We show in the Fig. 2 contours of \(\Delta M_Z^{} \), namely \(M_Z^{}-M_Z^\mathrm{observed}\), in the \(g_\mathbf {R}^{} -v_\Phi /v\) plane. It shows that \(\Delta M_Z^{} \) is insensitive to the \(g_{\mathbf {R}}\) when it is larger than 0.04. Using the ambiguity of the Z-boson mass given by the PDG [42], which is \(\Delta M_Z^{}<0.0021~\text {GeV}\), one has \(v_\Phi /v>73.32\) (\(v_\Phi >18~\text {TeV}\)).

Before proceeding, we discuss how to distinguish the \(U(1)_{\mathbf {R}}\) from the \(U(1)_{\mathbf {B-L}}\), which share many similarities. From previous study, it is clear that precision measurement of the Z boson mass at the CEPC and (or) ILC can test the \(U(1)_{\mathbf {R}}\), so here we mainly discuss how to distinguish them in colliders. First, \(Z_\mathbf {R}^{}\) couples to the SM Higgs, while there is no such interaction for the \(Z^\prime \) of \(U(1)_{\mathbf {B-L}}\). The new interaction takes the form: \( 1/2 g_R^2 Z_{\mathbf {R} \mu }^{} Z_\mathbf {R}^\mu (h^2 + 2 h v)\), where the effect of \(Z-Z_\mathbf {R}\) mixing is neglected. As a result, one can discriminate \(U(1)_{\mathbf {R}}\) from \(U(1)_\mathbf {B-L}\) via the process \(\bar{q} q \rightarrow Z_\mathbf {R}^{} + h\), with \(Z_\mathbf {R}\) decaying into di-lepton and h decaying into \(b\bar{b}\), in future 100 TeV proton-proton collider. Second, \(Z_\mathbf {R}\) only couple to right-handed fermions, while \(Z^\prime \) of \(U(1)_{\mathbf {B-L}}\) couples to both left-handed and right-handed fermions. One can write down partially-polarized differential cross section for the process \(e^-e^+ \rightarrow Z_\mathbf {R} (Z^\prime ) \rightarrow f \bar{f} \) at the CEPC and (or) ILC, with concrete helicity of initial electron(positron) and summed over the helicity of final states. It can then be applied to study the sensitivity to new gauge bosons through the measurement of a forward-backward asymmetry defined in Ref. [66] at lepton colliders. A detailed analysis will be out of the reach of this paper.

4 Neutrino masses

In this section we investigate how to generate Majorana masses of active neutrinos in the \(U(1)_\mathbf {R}\) model. The solar, atmosphere, accelerator and reactor neutrino oscillation experiments have firmed that neutrinos are massive and lepton flavors are mixed. In our model right-handed neutrinos do not couple to left-handed lepton doublets, so that the conventional type-I seesaw mechanism does not work. We study the possibility of generating active neutrino masses via the type-II seesaw mechanism. Interactions relevant to the scalar triplet \(\Delta \) with \(Y=2\) can be written as

$$\begin{aligned}&-\mathcal{L}_\Delta ^{} = M_\Delta ^2 \Delta ^\dagger \Delta +\left( \tilde{\lambda }H^T i\sigma _2^{} \Delta H \Phi +\mathrm{h.c. }\right) \nonumber \\&\qquad \qquad \quad + \left( \overline{\ell _L^{} } Y_\Delta ^{} \Delta \ell _L^{} +\mathrm{h.c.} \right) +\cdots \end{aligned}$$
(11)

where dots represent interactions of \(\Delta \) that are irrelevant to the neutrino mass generation, \(Y_\Delta \) is the symmetric Yukawa coupling matrix. Full expression of triplet interactions can be found in Ref. [43]. After the spontaneous breaking of the \(SU(2)_L^{} \times U(1)_Y^{} \times U(1)_\mathbf {R}\) symmetry, the active neutrino masses can be written as

$$\begin{aligned} M_\nu = Y_\Delta ^{} v_\Delta ^{} \approx Y_\Delta \tilde{\lambda }{v^2 v_\Phi \over M_\Delta ^2 } \end{aligned}$$
(12)

where \(v_\Delta \) is the VEV of \(\Delta \). The smallness of active neutrino masses is own to the tiny \(v_\Delta \), which is suppressed by the \(M_\Delta ^2\). Notice that interactions in the first bracket of Eq. (11) breaks the lepton number \(\mathbf {L}\) explicitly and the global \(U(1)_\mathbf {L}\) can be recovered in the limit \(\tilde{\lambda }\rightarrow 0\). According to the naturalness criterion [44], \(\tilde{\lambda }\) should be naturally small. In this case \(\Delta \) can be at the TeV scale and we refer the reader to Refs. [45,46,47] for signatures of \(\Delta \) at the LHC.

5 Dark matter

About \(26.8\%\) of our universe is made of dark matter, whose relic abundance is given as \(\Omega _\mathrm{DM} h^2 =0.1198\pm 0.0015\) [48]. Weakly Interacting Massive Particle (WIMP) [49] is a promising dark matter candidate, since the observed relic density can be naturally derived for a WIMP mass around the electroweak scale. In the \(U(1)_\mathbf {R}\) model, the lightest right-handed Majorana neutrino can be cold dark matter candidate, stabilized by the \(Z_2\) symmetry.Footnote 2 We evaluate the relic abundance of the dark matter and study its implications in dark matter direct detections in this section. The dark matter \(\mathbf {N}\) mainly couple to the \(Z_\mathbf {R}\), \(\hat{s}\) and \(\hat{h}\), with Lagrangian:

$$\begin{aligned} -{\mathcal {L}} \sim {1\over 2} {\overline{\mathbf {N}}} ig_{\mathbf {R}}^{} \gamma _\mu ^{} \gamma _5^{} Z_{\mathbf {R}}^\mu {\mathbf {N}} + {1\over 2 } {m_{\mathbf {N}} \over v_\Phi } {\overline{\mathbf {N}}} (c_\alpha \hat{s}- s_\alpha {\hat{h}}) {\mathbf {N}} \end{aligned}$$
(13)

where \(\mathbf {N} =N_R^C + N_R^{}\), \(m_{\mathbf {N}}\) is the mass eigenvalue of \(\mathbf {N}\), \(\hat{h}\) and \(\hat{s}\) are the mass eigenstates of h and s respectively. The interaction of \(\mathbf {N}\) with Z can be neglected due to the tiny mixing angle \(\theta _{23}\).Footnote 3

The evolution of the dark matter density n is governed by the thermal average of reduced annihilation cross sections \(\langle \sigma v\rangle \), which can be approximated with the non-relativistic expansion: \(\langle \sigma v\rangle = a + b \langle v^2\rangle \). Contributions of various channels can be written as

$$\begin{aligned}&\langle \sigma v \rangle _{s_a s_b} = {1\over 1 + \delta } {\lambda ^{1/2} (4, \varvec{\zeta }_a^{}, \varvec{\zeta }_b^{}) \over 1024 \pi v_\Phi ^2 m_\mathbf {N}^2 } \left| {c_\alpha ^{} C_{s ab} \over 4-\varvec{\zeta }_s^{}} - { s_\alpha ^{} C_{hab}\over 4 -\varvec{\zeta }_h^{}} \right| ^2 \langle v^2 \rangle \nonumber \\ \end{aligned}$$
(14)
$$\begin{aligned}&\langle \sigma v \rangle _{ZZ} = \frac{s_{2\alpha }^2 m_Z^4}{512\pi m_\mathbf {N}^2 v^2 v_\Phi ^2} \sqrt{1-\varvec{\zeta }_Z^{}} \left( 3-{4 \over \varvec{\zeta }_Z^{}} + {4 \over \varvec{\zeta }_Z^{2}}\right) \nonumber \\&\qquad \qquad \qquad \qquad \left| { 1 \over 4-\varvec{\zeta }_s^{}} - { 1 \over 4 -\varvec{\zeta }_h^{}} \right| ^2 \langle v^2 \rangle , \end{aligned}$$
(15)
$$\begin{aligned}&\langle \sigma v \rangle _{WW} = \frac{s_{2\alpha }^2 m_W^4}{256\pi m_\mathbf {N}^2 v^2 v_\Phi ^2 } \sqrt{1-\varvec{\zeta }_W^{}} \left( 3-{4 \over \varvec{\zeta }_W^{}} + { 4 \over \varvec{\zeta }_W^{2}} \right) \nonumber \\&\qquad \qquad \qquad \qquad \left| { 1 \over 4 -\varvec{\zeta }_s^{}} - { 1\over 4 -\varvec{\zeta }_h^{}} \right| ^2 \langle v^2 \rangle \end{aligned}$$
(16)
$$\begin{aligned}&\langle \sigma v\rangle _{f\bar{f}} = \frac{n_C^f s_{2\alpha }^2 \varvec{\zeta }_f^{}}{32 \pi v^2 }(1- \varvec{\zeta }_f^{})^{3/2} \left| { 1 \over 4 - \varvec{\zeta }_s^{}} - { 1 \over 4 -\varvec{\zeta }_h^{}} \right| ^2 \langle v^2 \rangle \nonumber \\&\quad + { n_C^f g_{\mathbf {R}}^4\over 192 \pi m_\mathbf {N}^2 } \sqrt{1-\varvec{\zeta }_f^{}} \left( \varvec{\zeta }_f^{} + 2\right) \left| {1 \over 4 -\varvec{\zeta }_{Z_\mathbf {R}}^{}}\right| ^2 \langle v^2 \rangle + { n_C^f g_{\mathbf {R}}^4 \varrho _{Z_\mathbf {R}}^f \sqrt{1 -\varvec{\zeta }_f^{}} \over 32 \pi m_{Z_\mathbf {R}}^2} \nonumber \\&\quad +{ 23\varvec{\zeta }_f^{2} -192 \varrho _{Z_\mathbf {R}}^f \varvec{\zeta }_{Z_\mathbf {R}}^{-1} + 8(30 \varrho _{Z_\mathbf {R}}^{f2} + 12 \varrho _{Z_\mathbf {R}}^f+1 ) - 4 \varvec{\zeta }_f^{} (30 \varrho _{Z_\mathbf {R}}^f+7) \over 768 \pi m_\mathbf {N}^2 \sqrt{1-\varvec{\zeta }_f^{} }} \nonumber \\&\quad \times { n_C^f g_{\mathbf {R}}^4 \langle v^2 \rangle \over \left| 4-\varvec{\zeta }_{Z_\mathbf {R}}^{} \right| ^2 } \end{aligned}$$
(17)
$$\begin{aligned}&\langle \sigma v\rangle _{Z's}^{} ={ c_\alpha ^2 g_{\mathbf {R}}^2 m_{Z^\prime }^4\lambda ^{3/2} (4, \varvec{\zeta }_V^{}, \varvec{\zeta }_s^{} ) \over 1024 \pi v_\Phi ^2 m_\mathbf {N}^4 \varvec{\zeta }_{Z_\mathbf {R}}^{3} }+ \mathcal{O} (\langle v^2\rangle ) \end{aligned}$$
(18)

where \(\lambda (x,~y,~z)\equiv x^2+y^2+z^2-2xy-2xz-2yz\), \(\varvec{\zeta }_X^{} =m_X^2 /m_\mathbf {N}^2 \), \(\varrho _{Z_\mathbf {R}}^f = m_f^2 /m_{Z_\mathbf {R}}^2\); \(\delta _{ab}^{}=1\) (for \(a=b\)) and 0 (for \(a\ne b\)); \(C_{s_i s_j s_k}\) are trilinear couplings; \(s_{2\alpha } =\sin 2 \alpha \), \(c_\alpha =\cos \alpha \), \(n_C^f\) is the color factor of f.

Fig. 3
figure 3

The relic density of the dark matter as the function of the dark matter mass \(m_\mathbf {N}\), by setting \(c_\alpha =0.9\), \(m_s=750~\mathrm{GeV}\), \(v_\Phi =2.5~\mathrm{TeV}\) and \(m_{Z_\mathbf {R}}=3.2~\mathrm{TeV}\). The horizontal line is the observed dark matter relic density. This plot is produced from the analytical results given in Eqs. (14)-(19)

The final relic density can be given by [55]

$$\begin{aligned} \Omega _\mathrm{DM} h^2 = {1.07\times 10^9 \over M_{pl} } {x_F \over \sqrt{g_\star }} {1 \over a + 3 b/x_F} \end{aligned}$$
(19)

where \(M_{pl} =1.22\times 10^{19}~\text {GeV} \) being the Planck mass, \(x_F = m_\mathbf {N}/T_F\) with \(T_F\) the freeze-out temperature, \(g_\star \) is the effective degree of freedom at the freeze-out temperature. As an illustration, we show in Fig. 3 the dark matter relic density as the function of the dark matter mass \(m_\mathbf {N}\) by setting \(c_\alpha =0.9\), \(m_s=750~\mathrm{GeV}\), \(v_\Phi =2.5~\mathrm{TeV}\) and \(m_{Z_\mathbf {R}}=3.2~\mathrm{TeV}\). The value of \(g_\mathbf {R}\) is determined by the following formula \(g_\mathbf {R} \approx M_{Z_\mathbf {R}}/\sqrt{v^2 +4 v_\mathbf {R}^2}\). The horizontal line is the experimental value of the relic density. One can conclude from the plot that \(\mathbf {N}\) is qualified dark matter when its mass lies near the resonance of \(\hat{h}\), \(\hat{s}\) or \(Z_\mathbf {R}\) for low mass \(\mathbf {N}\). For high dark matter mass regime, the relic density turns to be under-abundant since new annihilation channel is kinematically allowed. Thus heavy \(\mathbf {N}\) is also good dark matter candidate.

Fig. 4
figure 4

The rescaled spin-independent cross section (left-panel) and spin-dependent cross section as the function of the dark matter mass, other inputs are the same as these in the Fig. 3. These plots originate from analytical results given in Eqs. (20) and (21)

The spin-independent \(\mathbf {N}-\)nucleus scattering cross section is

$$\begin{aligned} \sigma _\mathrm{SI} = {\mu ^2 s_{2\alpha }^2 m_N^2 \over 4 \pi v^2 v_\Phi ^2} \left( {1\over m_h^2} -{1\over m_s^2}\right) ^2 [Z f_p^{} + (A-Z) f_n^{} ]^2\nonumber \\ \end{aligned}$$
(20)

where \(\mu \) is the reduced mass of \(\mathbf {N}\)-nucleus system, \(f_{p,n}^{}=m_{p,n} (2/9+7/9\sum _{q=u,d,s} f_{T_q}^{p,n})\) with \(f_{T_u}^p=0.020\pm 0.004\), \(f_{T_d}^p=0.026\pm 0.005\), \(f_{T_u}^n=0.014\pm 0.003\), \(f_{T_d}^n=0.036\pm 0.008\) and \(f_{T_s}^{p,n}=0.118\pm 0.062\) [56]. We show in the left panel of Fig. 4 the rescaled spin-independent cross section, namely \(\sigma _\mathrm{SI} \times \Omega _\mathrm{DM} h^2 /0.1189\), as the function of \(m_\mathbf {N}\) by using the same inputs of the Fig. 3. We only focus on the resonant regime of \(\hat{s}\) in this plot since there is redundancy relic density in other mass region and the resonant regime of \(Z_\mathbf {R}\) (\(\hat{h}\)) predicts a too heavy (light) dark matter. The red-dashed and blue-solid lines are the exclusion limits of LUX 2016 [57] and PandaX II [58] respectively. The available parameter space is shrunk compared with the relic density allowed region.

Since \(\mathbf {N}\) couples to \(Z_\mathbf {R}\), there is spin-dependent cross section of \(\mathbf {N}\) with nucleus which takes the following form

$$\begin{aligned} \sigma ^\mathrm{SD} = {g_{\mathbf {R}}^4 \mu ^2 \over \pi M_{Z_\mathbf {R}}^4 } \left( \sum _{q=u,d,s} \lambda _q^{} \right) ^2 J_N^{} (J_N^{}+1), \end{aligned}$$
(21)

where \(\lambda _q\) reduces to \(\Delta ^{p,n}\) for scattering off free proton or neutron with \(\Delta ^p_u=0.78\pm 0.02\), \(\Delta ^p_d=-0.48\pm 0.02\), \(\Delta ^p_s=-0.15\pm 0.02\), \(\Delta ^n_u=-0.48\pm 0.02\), \(\Delta ^n_d=-0.78\pm 0.02\), \(\Delta ^n_s=-0.15\pm 0.02\) [56, 59, 60], \(J_N\) is the angular momentum of the nucleus and it equals to 1 / 2 for free nucleons. We show in the right-panel of the Fig. 4 the rescaled spin-dependent cross section of \(\mathbf {N}\) scattering off free neutron as the function of \(m_\mathbf {N}\). The smallest excluded WIMP-neutron cross section is \(\sigma ^\mathrm{SD}_n=4.3\times 10^{-41}\) at \(m_\mathrm{DM}=45~\text {GeV}\) from the PandaX-II [61]. One can conclude from the plot that the spin-dependent cross section at the resonant regime of \(\hat{s}\) is much smaller than the current exclusion limit.

Fig. 5
figure 5

Branching ratios of \(Z_\mathbf {R}\) decaying into various final states

6 Collider signatures

In this section we investigate the signature of \(Z_\mathbf {R}\) at the LHC. \(Z_\mathbf {R}\) can be produced at the LHC via the Drell-Yan process, while the dilepton channel provides a significant signature. We first study the branching ratio of \(Z_\mathbf {R}\). The decay rate of \(Z_\mathbf {R}\) into fermion pairs can be written as

$$\begin{aligned} \Gamma (\mathbf {Z}_\mathbf {R}\rightarrow \bar{f} f) = {1\over 1+\delta _f} {n^C_f g_{\mathbf {R}}^2 m_{\mathbf {Z}_\mathbf {R}}^{} \over 24 \pi } \left( 1- {m_f^2 \over m_{\mathbf {Z}_\mathbf {R}}^2 } \right) ^{3/2}, \end{aligned}$$
(22)

where \(\delta _f=1(0)\) if f is (not) identical particle. \(Z_\mathbf {R}\) can also decay into diboson pair (\(W^+W^-\)) due to its mixing with Z, which is suppressed by \(\theta _{23}^2\) and will be neglected in the following analysis. We show in the Fig. 5 the branching ratio of \(Z_\mathbf {R}\) decaying into various final states as the function of \(m_\mathbf {N}\) by setting \(m_{Z_\mathbf {R}}=3.6~\text {TeV}\), where the solid, dashed and dotted lines correspond to the decay channel of \(\overline{\mathbf {N}}\mathbf {N}\), \(\bar{e} e\) and \(\bar{t} t\) respectively. It shows that the branching ratio of dilepton with discrete flavor is about \(4.5\%\).

Fig. 6
figure 6

Production cross section of process (\(pp\rightarrow Z_\mathbf {R}\rightarrow \ell ^+ \ell ^-\)) as the function of \(M_{Z_\mathbf {R}}\), the solid, dashed and dotted lines correspond to \(g_\mathbf {R}=0.1,~0.2\) and 0.3 respectively

The cross section of the process \(pp\rightarrow Z_\mathbf {R}\rightarrow \ell ^+ \ell ^-\) can be written as

$$\begin{aligned} \sigma (pp\rightarrow Z_\mathbf {R}\rightarrow \ell ^+ \ell ^-)= & {} {3 \over s} {\Gamma _\mathrm{tot} \over M_{Z_\mathbf {R}}} \sum _q C_{q\bar{q} } \mathrm{BR} (Z_R \rightarrow q \bar{q} )\nonumber \\&\times \,\mathrm{BR} (Z_\mathbf {R}\rightarrow \ell ^+\ell ^-) \end{aligned}$$
(23)

where \(\sqrt{s}\) is the centre-of-mass energy, \(\Gamma _\mathrm{tot}\) is the total width of \(Z_\mathbf {R}\), \( \mathrm{BR} (Z_R \rightarrow q \bar{q} ) \) and \(\mathrm{BR} (Z_\mathbf {R}\rightarrow \ell ^+\ell ^-)\) are branching ratios of \(Z_\mathbf {R}\) decaying to \(q\bar{q} \) and \(\ell ^+ \ell ^-\) respectively, \(C_{q\bar{q}}\) are dimensionless partonic integrals with [62]

$$\begin{aligned} C_{q\bar{q}} = {4 \pi ^2 \over 9} \int _{M^2/s}^1 {dx \over x } \left\{ q (x) \bar{q} \left( {M^2 \over s x}\right) + \bar{q} (x) q \left( {M^2 \over s x}\right) \right\} . \nonumber \end{aligned}$$

Their numerical values are calculated with the NNPDF [63] at \(M=m_{Z_\mathbf {R}}\). We show in Fig. 6 the \(\sigma (pp\rightarrow Z_\mathbf {R}\rightarrow \ell ^+ \ell ^-)\) as the function of \(m_{Z_\mathbf {R}}\) where the solid, dashed and dotted lines correspond to \(g_\mathbf {R}=0.1,~0.2\) and 0.3 respectively. The green and yellow bands are upper limits on the \(\sigma (pp\rightarrow Z_\mathbf {R}\rightarrow \ell ^+ \ell ^-)\) at the \(1\sigma \) and \(2\sigma \) separately, given by the ATLAS collaboration [64] with \(36.1~\mathrm{fb}^{-1}\) of proton-proton collision data collected at \(\sqrt{s}=13~\text {TeV}\). Since the \(v_\Phi \) is constrained as \(v_\Phi >18~\text {TeV}\), there is a lower bound on the \(Z_\mathbf {R}\) mass from the \(Z-Z_\mathbf {R}\) mixing. By matching these two constraints, we find that the constraint from the dilepton search at the CERN LHC is stronger than that from the \(Z-Z_\mathbf {R}\) mixing derived from diboson search at the LHC as well as the precision measurement of Z boson mass only for \(g_\mathbf {R}<0.121\) (\(M_{Z_R}<4.37~\text {TeV}\)).

7 Conclusion

Although the \(U(1)_{\mathbf {R}}\) extension to the SM shares the same merit as the \(U(1)_{\mathbf {B-L}}\) extension of the SM on anomalies cancellations, its phenomenology was not investigated in detail in any reference except its effect in the vacuum stability of the SM Higgs. In this paper we constrained the parameter space of the model using the updated results of the \(Z-Z^\prime \) mixing as well as the search of new resonance in dilepton channel at the LHC. Our investigation shows that the constraint from the dilepton search at the LHC is stronger than that from the \(Z-Z_\mathbf {R}\) mixing derived from diboson search at the LHC and the precision measurement of Z boson mass only for \(g_\mathbf {R}<0.121\). We further studied the phenomenology of the \(Z_\mathbf {R}\)-portal dark matter and the possibility of generating active neutrino masses in the same model. It shows that the right-handed neutrino dark matter is self-consistent for its mass at near the resonant regime of \(\hat{h}\), \(\hat{s}\) and \(Z_\mathbf {R}\) or for its mass being very heavy; the Majorana masses of active neutrinos can be generated from the modified type-II seesaw mechanism. It should be mentioned that the collider signature of \(\hat{s}\) is Di-Higgs in various channels. We refer the reader to Ref. [65] for the Di-Higgs searches at various colliders for detail. \(\hat{s}\) may also be searched at the LHC via the \(pp\rightarrow \hat{s}\rightarrow Z_\mathbf {R}Z_\mathbf {R}\rightarrow \ell _\alpha ^+ \ell _\alpha ^- \ell _\beta ^+\ell ^-_\beta \) process if \(m_{\hat{s}} > 2 m_{Z_\mathbf {R}}\).

[Note added]: When this paper was being finalized, the paper [66] appeared, which partially overlaps with this one in discussing constraint from the precision measurement of Z-boson mass, They use approximated formulae when do this analysis, while we present both full analytical and numerical results in this paper. Their study is largely complementary to ours.