Vacuum stability conditions of the economical 3-3-1 model from copositivity

By applying copositivity criterion to the scalar potential of the economical $3-3-1$ model, we derive necessary and sufficient bounded-from-below conditions at tree level. Although these are a large number of intricate inequalities for the dimensionless parameters of the scalar potential, we present general enlightening relations in this work. Additionally, we use constraints coming from the minimization of the scalar potential by means of the orbit space method, the positivity of the squared masses of the extra scalars, the Higgs boson mass, the $Z'$ gauge boson mass and its mixing angle with the SM $Z$ boson in order to further restrict the parameter space of this model.


Introduction
Models addressing open questions concerning the standard model of particle physics (SM) usually resort to the use of new symmetries and/or the addition of extra particles. As a first example, we can mention models implementing different see-saw mechanisms (type I, II and III) which introduce bosonic or fermionic degrees of freedom in order to explain tiny neutrino masses and their mixings [1][2][3][4]. In combination with that, new abelian and nonabelian symmetries are also invoked in order to obtain highly predictive scenarios where not only neutrino masses are fixed but also further correlations between neutrino oscillation parameters appear [5][6][7][8][9][10][11][12][13][14][15][16]. A series of models with a matter content larger than the one of the SM are those dealing with the impressive observation that almost thirty percent of the energy content of the Universe is due to dark matter (DM) [17]. Arguably, the simplest model providing a DM candidate is that which extends the SM only by a real scalar transforming in a non trivial way under a stabilizing Z 2 discrete symmetry [18,19]. However, other well-motivated models based on supersymmetry [20][21][22][23], extra dimensions [24], the B − L symmetry [25][26][27][28] and those with an Axion/ALP [29][30][31][32][33][34][35] have been widely considered (see [36] for a review). All of them have additional symmetries and extra particles in their physical spectrum.
In the same vein, the so-called 3−3−1 models are interesting extensions of the SM. The fundamental idea behind all these models is to extend the SU(2) L gauge group to the SU(3) L a e-mail: bruce.sanchez@ufabc.edu.br b e-mail: rgambini@ifi.unicamp.br c e-mail: calvarez@ifi.unicamp.br arXiv:1811.00585v2 [hep-ph] 6 Apr 2019 one, in other words, the total gauge group of these models is G 331 ≡ SU(3) C ⊗ SU(3) L ⊗ U(1) N . Here, C and L stand, as in the SM, for color and left chirality, respectively. However, N stands for a new charge different from the SM hypercharge, Y , and its values are assigned to obtain the latter after the first spontaneous symmetry breaking. More specifically, the values of N together with an embedding parameter b determine the electric charges of the matter content in these models since the electric charge operator is Q = T 3 − bT 8 + N1 3×3 [37], where T 3, 8 are the diagonal Gell-Mann matrices, 1 3×3 is the 3 × 3 identity matrix and the parameter b can take two values: 1/ √ 3 or √ 3. In this paper, we consider the 3 − 3 − 1 model with b = 1/ √ 3 and the simplest scalar sector as proposed in Refs. [38,39] after a systematic study of all possible 3 − 3 − 1 models without exotic electric charges. This model is known in the literature as the "economical 3 − 3 − 1 model" and has some appealing features that turn it arguably the most interesting 3 − 3 − 1 model. Among these properties we can mention that right-handed neutrinos, N a , are in the same SU(3) L multiplet as the SM leptons, ν a and e a . This is possible because the fundamental representation of the SU(3) L gauge group is larger than the SU(2) L one and the parameter b = 1/ √ 3 allows the SU(3) L multiplet to have two electrically neutral components: ν a and N c a . This property allows for massive neutrinos at tree level. Yet, agreement with experiments is reached only when one-loop contributions to neutrino masses are considered [40]. Other no less important features of this model are the possibility of implementing the Peccei-Quinn mechanism in order to solve the strong CP problem [41] and the existence of axion dark matter [35]. Needless to say, this model also shares some appealing features with other versions [42][43][44][45][46][47][48][49] such as the capability to shed some light on the family replication issue of the SM.
Although the economical 3 − 3 − 1 model has several appealing features, it also introduces a considerable number of degrees freedom that turn it less predictive. For instance, its scalar potential has at least nineteen coupling constants. It is a large number when compared with two couplings in the SM scalar potential. Needless to say, a large number of extra Yukawa couplings is allowed by the 3 − 3 − 1 gauge group. Therefore, in this paper we search for constraints that allow to reduce this, in some sense, undesirable freedom. More specifically, we study vacuum stability at tree level, i.e. the conditions guaranteeing that the scalar potential is bounded from below in all directions in the field space as the field norms approach to infinity. It is well-known that in the SM, at tree level, it is enough to make the Higgs boson quartic coupling positive [50][51][52]. Nevertheless, in the case of the economical 3 − 3 − 1 model we face a more complicated problem even at tree level since we have to deal with nineteen coupling constants and the scalar fields belong to the fundamental and anti-fundamental representations of SU(3) L . However, the problem becomes simpler when a Z 2 symmetry acting on some fields is considered. This symmetry is already used in the 3 − 3 − 1 literature [37,38,41,[53][54][55][56][57] with different motivations. In the present context, this symmetry not only reduces the number of coupling constants to fourteen, but also makes the quartic terms in the scalar potential to have a λ i j φ 2 i φ 2 j form. Therefore, demanding that the scalar potential is bounded from below as the field norms approach to infinity is equivalent to ensuring that the λ i j matrix is copositive (positive on nonnegative vectors) [58][59][60][61]. In addition, to make the problem even more tractable, we use the method of the orbit space in Refs. [62,63] which greatly reduces the number of variables. At the end, the problem of vacuum stability is reduced to study the copositivity of a 3 × 3 matrix. This provides seventeen inequalities, for the ten quartic couplings, that at first sight seem too complicated in order to provide useful analytical relations. However, combining these inequalities with constraints coming from the first and second derivative tests for a minimum of the scalar potential, we manage to find enlightening analytical constraints for these coupling constants.
Finally, with the aim of restricting the rest of the scalar couplings we turn our attention to the scalar mass spectrum, since all of the squared scalar masses must be positive in general. However, these masses also depend on the vacuum expectation values (VEVs) of the scalar fields. Thus, we use the experimental limits on the mass of an extra neutral gauge boson Z [64][65][66][67], and the bound on the Z − Z mixing angle in this model [68] to estimate the VEVs. Doing so, we find relations for three of the remaining four scalar potential couplings. Also, the experimental limit on the Higgs mass [64][65][66][67] is used to constrain even more some couplings.
The rest of the paper is organized as follows. In Sec. 2 we introduce the generalities of the economical 3 − 3 − 1 model with a Z 2 symmetry that allows a scalar potential with quartic terms in a biquadratic form of the field norms. In Sec. 3, taking advantage of this property, we search for constraints on the scalar potential couplings imposing the vacuum stability conditions at tree level. Specifically, we use the method of the orbit space to simplify the application of the first and second derivative tests together with the copositivity criterion. After finding clear and useful relations for the values of some scalar potential parameters, in Sec. 4, we go further applying the positivity of the scalar masses and the experimental Higgs mass in order to constrain more scalar parameters. Finally, we present our conclusions in Sec. 5.

The model
In order to cancel the quantum gauge anomalies, the left-handed fermions of the economical 3−3−1 model have to belong to the (1, 3, −1/3) representation for the three lepton families and to the (3, 3, 1/3), 3,3, 0 representations for the quark families. More specifically, where a = 1, 2, 3, b = 2, 3 and "∼" means the transformation properties under the local symmetry group. Furthermore, in the right-handed field sector we have Leptons: e aR ∼ (1, 1, −1) , where a takes the same values as in Eq. (1), s = 1, . . . , 4 and t = 1, . . . , 5. It is also necessary to introduce, at least, three SU(3) L triplets, ρ, η, χ, in order to generate the appropriate fermion and boson masses. Note that the scalar sector can not be additionally reduced due to the appearance of accidental symmetries implying some massless "u" and "d" type quarks at all orders in perturbation theory as shown in Ref. [69]. In other words, the three SU(3) L scalar triplets are necessary to totally break the G 331 symmetry to the U (1) Q symmetry and, at the same time, to give the phenomenologically appropriate masses for the quarks. These scalar triplets are given by Once these fermionic and bosonic fields are introduced in the model, the most general Yukawa Lagrangian, renormalizable and invariant under the local gauge group, reads with where ε i jk is the Levi-Civita symbol and a , i, j, k = 1, 2, 3 and a, b, s, t are in the same range as in Eqs. (1)(2)(3)(4). It is also straightforward to write down the most general scalar potential consistent with gauge invariance and renormalizability as From Eqs. (5) and (6), we can see that there are five electrically neutral scalars, ρ 0 2 , η 0 1 , η 0 3 , χ 0 1 , χ 0 3 and, in principle, all of them can gain VEVs. However, it is well known that the minimal vacuum structure needed to give masses for all the particles in the model is which correctly reduces the G 331 symmetry to the U (1) Q one if v 2 η + v 2 ρ ≡ v 2 = 246 2 GeV 2 . There is at least another reason for choosing the minimal vacuum structure given in Eq. (12). If the remaining neutral scalars, η 0 3 and χ 0 1 , also gain VEVs, dangerous Nambu-Goldstone bosons can arise in the physical spectrum, as shown in Ref. [37]. Therefore, in order to avoid this issue and looking for simplicity, in this paper we are going to consider only the minimal vacuum structure given in Eq. (12).
We also consider the model with an extra simplifying assumption that is quite common in the 3 − 3 − 1 literature [37,38,41,[53][54][55][56][57]. It consists on the imposition of a discrete Z 2 symmetry given by: (4,5)R and the other fields being even under Z 2 . This symmetry not only brings simplicity to the model, allowing, for instance, to interpret the χ scalar as the responsible for the first step in the symmetry breaking pattern, but also to mitigate the FCNC issues [70]. Moreover, with this Z 2 symmetry the PQ mechanism can be easily implemented [41] and in some cases dark matter candidates can be stabilized [35,55]. In this scenario, the Yukawa Lagrangian interactions given in Eqs. (8)(9)(10) are slightly modified to Note that in this case the χ triplet only couples to the u 4R and d (4,5)R quarks, and it is also the reason to interpret χ as the scalar responsible for the first step in the symmetry breaking pattern. Furthermore, after imposing the Z 2 symmetry, the scalar potential becomes It is important to note that, even though the term λ 15 ε i jk η i ρ j χ k softly breaks the Z 2 symmetry, it must be included because in its absence appears a QCD axion with a small decay constant, 11.5 keV ≤ f a ≤ 246 GeV, already ruled out by experiments [34,71]. See Ref. [37] for a detailed study of this case.

Minimization and vacuum stability
Now, we turn our attention to find constraints on the µ i − and λ i −scalar parameters coming from minimization and vacuum stability. The general minimization of the scalar potential in Eq. (16) is a difficult task due to the large number of free parameters in the scalar potential (14 free parameters), the large number of components of the scalars triplets in the model (18 components for the ρ, η, χ triplets) and the degeneracies of the extremal points of the potential required by the G 331 −invariance. Fortunately, there is a powerful tool to simplify this problem which consists in working with the norm of the fields and orbit parameters. This method to minimize scalar potentials, also known as the method of the orbit space, is detailed in Refs. [60][61][62][63] in the context of spontaneous symmetry breaking. It has been used, for instance, in models with SU(5) and SO(10) gauge symmetries when scalars belong to different representations [60,[72][73][74]. The crucial observation of the method is that working with the norm of the fields, |φ | (|φ | 2 ≡ φ * k φ k -where a sum over repeated indices is implied) and the invariant orbit parameters θ θ θ 's (generically defined by θ θ θ = ) contain all the information needed to determine the minimum of the potential and, in addition, greatly reduce the number of variables.
In order to apply the method of orbit space, let's define the invariant orbit parameters of the scalar potential in Eq. (16) as whereφ k = φ k /|φ | and a sum over the repeated indices is implied. Note that all directional information is contained within the θ θ θ parameters. The scalar potential takes the following simple form when written using the θ θ θ parameters: where we have used the fact that making a redefinition of the scalar fields, e.g. η k → e −iδ 10 /4 η k , χ k → e iδ 10 /4 χ k and ρ k → e −iδ 15 ρ k , the phases of λ 10 = |λ 10 | e iδ 10 and λ 15 = |λ 15 | e iδ 15 couplings can be absorbed. Therefore, all couplings in the scalar potential can be considered as real numbers, without loss of generality.
Treating the modules of η, ρ, χ, and the θ θ θ parameters as independent variables, we could apply the first and second derivative tests to provide general conditions to have a minimum of the scalar potential in Eq. (16). However, we will restrict ourselves to the phenomenologically interesting vacuum given in Eq. (12). In other words, we consider the directional minima in the particular direction given by Thus, taking the directional derivative of the scalar potential in Eq. (18) in relation to the norm of the scalar fields, we obtain an expression for the µ i parameters: where we have used 2 which are the norm of the fields in the vacuum direction in Eq. (12).
Additional conditions on the scalar potential parameters come from second derivative test. Specifically, all principal minors of the Hessian matrix H 0 evaluated at the vacuum, , must be positive (see for example [75,76]). A straightforward calculation gives the Hessian matrix at the directional minimum as: where we have used the relations in Eq. (20) in order to simplify the Hessian matrix. From the positivity of the principal minors we get the conditions where we have not written explicitly an analytical expression for the determinant of H 0 , which is not very enlightening. In addition, det H 0 > 0 will be automatically satisfied provided we consider the positivity of the square masses of the CP-even scalars as will be shown in the next section. So far, we have studied the conditions for the vacuum configuration in Eq. (12) to be a minimum of the scalar potential. Nevertheless, for the scalar potential in Eq. (18) to make physical sense, it has to be bounded from below in the large field limit for all possible directions in the field space. To obtain these constraints it is enough to work with the quartic terms, which can be written in a matrix form as where h T = (|η| 2 , |ρ| 2 , |χ| 2 ) ≥ 0 and the matrix Λ is Λ =   λ 1 (λ 6 + λ 9 θ θ θ 3 )/2 (λ 4 + λ 7 θ θ θ 1 + |λ 10 |θ θ θ 4 )/2 Note that V 4 is a biquadratic form of the norm of the fields. Therefore, the scalar potential is bounded from below, h T Λ h > 0, if the symmetric matrix Λ is strictly copositive, i.e. positive on positive vectors h > 0. Note that we use the requirement of strong stability (V 4 > 0) because the stability in the marginal sense (V 4 ≥ 0) does not allow any cubic terms in the scalar potential. However, the term λ 15 ε i jk η i ρ j χ k must be included because in its absence appears a visible QCD axion (see Ref. [37]). Mathematical conditions for a general symmetric matrix being strictly copositive were found in [58,59] and applied in some elementary particle physics models in Refs. [61,77]. For the case of a symmetric matrix A 3×3 of special interest for this paper, these conditions read [78,79] a 11 > 0, a 22 > 0, a 33 > 0, where a i j stands for a generic element of the A 3×3 matrix.
In order to apply these conditions in our particular case, it is convenient to rewrite the orbit parameters involved in the definition of Λ as where ω θ θ θ 1 is defined throughχ * jη j = |θ θ θ 1 | exp(ω θ θ θ 1 /2) and 0 ≤ |θ θ θ 1,2,3 | ≤ 1. These orbit parameters can be determined from the following observation. If V 4 < 0 for a particular direction with |h| = 1 determined by a set of orbit parameters, then the scalar potential will not be bounded from below in the limit |h| −→ ∞. Therefore, to determine whether V 4 is stable in the limit of large field values, it is sufficient to find its minimum on a |h| = 1 hypersphere. Doing so, we immediately notice that ω θ θ θ 1 = π. The remaining orbit parameters are calculated by noting that V 4 is a monotonic function of them. Thus, the minimum is in some |θ θ θ i | values (with i = 1, 2, 3) on the frontier of their space.
At first glance, we could think the frontier for the |θ θ θ | | | is a cube with edge length equals one. However, from the definition of |θ θ θ | | | given in Eqs. (26), it can be found, without loss of generality, that the frontier is given by In Figure 1 we can see that the space of |θ θ θ 1,2,3 | is actually smaller than the cube. In general, note that |θ θ θ 1,2,3 | are independent orbit parameters; however, their frontiers are fixed by Eq. (27). Although we know the values of |θ θ θ 1,2,3 | which minimize V 4 on the hypersphere with Fig. 1: Allowed space for the orbit parameters θ θ θ 1,2,3 defined in Eq. (26). Note that the allowed volume in this space is not a cube, but a closed volume with boundaries given in Eq. (27). Here, it is important to remark that a similar reduction of the orbit parameter space happens in the context of the triplet seesaw model [80]. In that case, the relation on the boundary between the two orbit parameters makes that the allowed space is not longer a box. Thus, the stability conditions at tree level in that model are modified to a set less restrictive, correcting what had been done in the previous literature.
On the other hand, copositivity does not impose upper limits on λ 4,5,6 and therefore, limits from Eq. (22) still apply, i.e. bounds from copositivity < λ 4 < |λ 15 |v ρ + (H 0 ) 11 (H 0 ) 33 2v η v χ , bounds from copositivity < λ 5 < where (H 0 ) ii with i = 1, 2, 3 is the corresponding element of the Hessian matrix. In order to conclude this section, we can say that out of fourteen initial parameters in the scalar potential in Eq. (16), we can clearly constrain ten of them by applying the copositivity criterion in where the masses of the neutral gauge bosons Z 1 and Z 2 read with where θ W is the Weinberg's angle and g is the coupling constant of the SU(2) L group.
Using v = 246 GeV, g = 0.65, sin 2 θ W 0.22, M Z 1 91.19 GeV [67,84] and imposing −3.98×10 −3 tan φ 1.31 × 10 −4 we find the allowed region in the v χ − v η plane. As we can see in Fig. 5, v χ 100 TeV is needed to obtain significant deviations from the zeromixing value, v η 197.34 GeV. From the phenomenological point of view, v χ 100 TeV is not interesting due to the fact that all new particles in the model have masses of the order of v χ and therefore would be unattainable by the current particle colliders. Thus, we use v η 197.34 GeV and v ρ = v 2 − v 2 η 146.88 GeV. Now, it is also possible to estimate v χ from the fact that the mass of an extra neutral gauge boson, Z 2 , has to be larger than 2.9 TeV [67,85]. Applying this bound in Eq. (37) and using the values for v η and v ρ obtained above, we have that v χ 7.31 TeV. Thus, we can use these VEVs to estimate lower limits for λ 7 , λ 8 and λ 9 in terms of the value of |λ 15 | where we have used v χ = 7.31 TeV. In the case that λ 15 1 GeV, for instance, we have λ 7 0, λ 8 0.02 and λ 9 0.21.
Let's return to the square masses of the CP-even scalars, h, H 2 and H 3 . Their square masses are obtained from the eigenvalues of the matrix m i j = 1 2 , where φ i , i = 1, 2, 3, are the real parts of the fields η 0 1 , ρ 0 2 and χ 0 3 , respectively. In that basis, m i j coincides with 1 2 H 0 , where H 0 is the Hessian matrix given in Eq. (21). A perturbative analysis in powers of v/v χ shows that m 2 h ∝ v 2 and m 2 H 2,3 ∝ v 2 χ . For this reason, we have that m 2 This observation allows us to calculate an analytical expression for m 2 h . In order to do so, it is useful to write the characteristic polynomial of 1 2 H 0 , P, as where 1 3×3 is the 3 × 3 identity matrix and C is the m 2 coefficient of P when calculated from det m 2 1 3×3 − H 0 /2 . Now, since m 2 The formula for m 2 h in Eq. (41) is at 2% accuracy. Because m h is the Higgs boson mass, it must be m h = 125.18±0.16 GeV [64][65][66][67]. This imposes strong constraints on λ 1 , · · · , λ 6 and |λ 15 |. For instance, the λ 4 and λ 5 values required to get the Higgs boson mass lie on ellipses or hyperbolas. The particular form of the conic appearing in the λ 5 − λ 4 plane depends on the other λ values given by Eq. (41). To be more specific, let's write the eigenvalue equation where we have used |λ 15 | v η , v ρ for simplicity. Eq (42) represents an ellipse or a hyperbola centered at the origin and rotated by an angle θ given by tan 2θ = λ 6 Other characteristics such as the size of the conic are dominated by λ 1,2,3,6 and the ratios m 2 h /v 2 ρ and m 2 h /v 2 η . Some particular cases are shown in Fig. 6 and the region separating ellipses and hyperbolas in the plane λ 2 − λ 1 is shown in Fig. 7.
Similar conclusions are obtained for the planes λ 6 − λ 4 and λ 6 − λ 5 . Now, for the most general case, i.e. when |λ 15 | is not negligible, Eq. (42) takes the most general form a λ 2 4 + 2b λ 4 λ 5 + c λ 2 5 + 2d λ 4 + 2 f λ 5 + g = 0 where the coefficients a,· · · ,g depend on λ 1,2,3,6,15 . Thus, for the general case the ellipse/hyperbola is not centered at the origin and the rotation angle also acquires a dependence on |λ 15 |. We are not going to consider that case in detail.  Finally, we can calculate m 2 H 2,3 as a function of m 2 h as follows Because we are working in the approximation of m H 2,3 > m h and m h = 125.18 ± 0.16 GeV [64][65][66][67], the positivity of m 2 H 2,3 does not bring any additional constraint on the λ 's. Also, note that the positivity of the masses of CP-even scalars implies that det H 0 > 0 as required by the last condition in Eq. (22).

Conclusions
In this work, we find tree level constraints on the scalar potential couplings of the economical 3 − 3 − 1 model when considerations of vacuum stability and positivity of the squared scalar masses are taken into account. In particular, we consider the model with a discrete Z 2 symmetry acting on χ, u 4R , d (4,5)R fields in a non trivial way. Besides all the appealing features discussed in Sec. 2, this discrete symmetry makes the quartic terms in the scalar potential to have a biquadratic form of the norm of the fields. This allows us to apply copositivity criterion in order to guarantee that the scalar potential is bounded from below. When copositivity criterion is imposed in combination with the first and second derivative tests for the vacuum expectation values given in Eq. (12), ten of the scalar couplings are constrained. In more detail, λ 1,2,3 need to be positive and the µ 1,2,3 parameters are completely determined, c.f. Eq. (20). Besides that, λ 4,5,6 couplings are constrained from below by the copositivity and from above by the positivity of the principal minors of the Hessian matrix, Eq. (31). More interestingly, there is always an excluded region for λ 4,5,6 which we called the minimum excluded region in Figs. 2 and 3, respectively. This region comes from the copositivity criterion and gives a lower bound for λ 4,5,6 . It is remarkable that the excluded region for these λ couplings also has a maximum provided all copositivity conditions are satisfied. λ 7,8,9,10 play an important role in determining the form of both the minimum and the maximum excluded regions for λ 4,5,6 . On the other hand, copositivity does not have anything to say about the upper bound on λ 4,5,6 and it is here that second derivative test is important. We analyse the role that |λ 15 | (where we have applied a phase shift in the fields to make λ 15 real and positive without loss of generality) has in determining that upper bound. As the |λ 15 | coupling is technically small, we have studied the bound when |λ 15 | v η , v ρ showing that the smallest upper bound on λ 4,5,6 is always larger than 2 √ λ 1 λ 3 , 2 √ λ 2 λ 3 , 2 √ λ 1 λ 2 , respectively. In order to constrain the rest of λ couplings, we turn our attention on positivity of the squared scalar masses. After finding general expressions for the masses of the charged and CP-odd scalars, we find constraints on λ 7,8,9 given in Eqs. (34)(35), respectively. Actually, we apply a stronger limit for the case of the masses of charged scalars since these, roughly speaking, must be heavier than 80 GeV. As the constraints on λ 7,8,9 strongly depend on the VEVs, even in the case of |λ 15 | → 0, we estimate the lower bounds on λ 7,8,9 using the VEVs that satisfy the upper bound on the mixing angle between the two neutral gauge bosons in the model and the lower bound on the mass of Z gauge boson. Doing that, we obtain the lower bounds in Eq. (39).
Moreover, we find approximate formulas for the squared masses of the CP-even scalars in the model. If the v ρ , v η v χ hierarchy is satisfied (as assumed in this 3 − 3 − 1 model), the squared masses of the CP-even scalars different from the Higgs boson are proportional to v 2 χ , which allows us to find a 2% accurate formula for the Higgs squared mass, c.f. Eq. (41). Using the fact that the Higgs mass must be m h = 125.18 ± 0.16 GeV [64][65][66][67], we find that λ 5 − λ 4 , λ 6 − λ 4 and λ 6 − λ 5 satisfy the ellipse or the hyperbola general equations with coefficients determined by λ 1,2,3,6,15 couplings. We outline the behaviour of such conics for the case |λ 15 | v η , v ρ in Fig. 6. In that case, they are centered at the origin and their rotation angle strongly depends on λ 6 . Furthermore, we find equations for squared masses of the other two CP-even scalars in terms of m 2 h and the trace and determinant of the Hessian matrix, see Eq. (44). Because these squared masses are larger than m 2 h in our approach, their positivity do not bring new constraints on λ couplings.
Although the objective of this paper is to derive tree level conditions for the quartic couplings of the scalar potential coming from vacuum stability, the minimization of the scalar potential, the positivity of the squared masses of the extra scalars, the Higgs boson mass, the Z gauge boson mass and its mixing angle with the SM Z boson in order to restrict the parameter space, it is also interesting to comment some modifications coming from the running of the coupling constants. Roughly speaking, we expect that major differences when compared with the SM are due to the presence of new particles, such as heavy quarks and leptons. For example, there are three additional quarks (an up-type quark and two down-type quarks) which are assumed to have masses in the scale of the SU(3) L symmetry breaking, i.e. 1 − 10 TeV. For this reason, we expect that these quarks modify significantly the beta functions of the quartic couplings that involve the χ scalar triplet because the Z 2 symmetry acting on χ, u 4R and d 4,5R fields makes these new quarks gain masses mainly through the χ scalar triplet. Thus, the beta functions of λ 4,5 are expected to receive large contributions coming from the diagrams where the new quarks are running. However, other λ couplings can receive some contributions from these quarks due to the mixings between scalar mass eigenstates. Moreover, we expect that the beta function of the λ quartic couplings receive several positive contributions from the one-loop diagrams with scalars running in them. These positive contributions, roughly speaking, will reduce the allowed regions of the λ couplings in a similar way as in the triplet and inverse seesaw models [80,86]. Nevertheless, in order to give a quantitative answer to this question all coupled one-loop renormalization group equations must be carefully studied for this model.