Electroweak phase transition and Higgs phenomenology in the Georgi-Machacek model

In this work, we perform the electroweak phase transition study with the Georgi-Machacek model. We investigate both the one-step and two-step strong first order electroweak phase transition (SFOEWPT). The SFOEWPT viable parameter spaces could be tested by the future 14 TeV LHC, HL-LHC, and ILC. The LHC Higgs signal strength measurements severely bound the SFOEWPT valid parameter spaces, a tinny region of the mixing angle between the neutral fields of the isospin-doublet and isospin-triplet scalars around $\alpha\sim 0$ can allow the two-step SFOEWPT to occur. The triplet vacuum expectation value (VEV) is crucial for both SFOEWPT and related Higgs phenomenology. The two-step SFOEWPT can be distinguished from the one-step SFOEWPT through the triple Higgs coupling searches and the low mass doubly charged Higgs searches at colliders.


I. INTRODUCTION
The baryon asymmetry of the Universe (BAU) as a fundamental problem of the nature has puzzled particle and cosmology physicists for several decades. To address the problem, three Sakharov conditions are necessary [1]. Wherein, the CP violation and the departure from thermodynamic equilibrium all call for new physics beyond the SM. Among variant baryogenesis mechanisms, the electroweak baryogenesis mechanism (EWBG) inspires people interest recently due to the two key ingredients that are testable [2]: One crucial ingredient is the CP violation beyond the SM that bias the sphalerons to create baryon asymmetry, it could be probed indirectly with the high precision electric dipole moment experiments (EDMs). Another crucial ingredient is the strongly first order electroweak phase transition (SFOEWPT) that prevents the sphaleron process washing out the baryon asymmetry, which naturally provide an explanation of symmetry breaking as the Universe temperature cools down and could be tested at colliders [3].
In this work, we will focus on the SFOEWPT study where the Higgs phenomenology are more involved. The generated gravitational wave signals from which with a typical peak frequency O(10 −3 -10 −1 )Hz is detectable at the projected space-based interferometers, such as: eLISA [4], BBO, DECIGO (Ultimate-DECIGO) [5] and ALIA [6]. After the gravitational waves signals from the merging black holes are detected by LIGO [7], the gravitational waves from the SFOEWPT has inspired extensive studies in various BSM models with the SM Higgs sectors being extended. To achieve SFOEWPT, it is well known that the scalar sectors of the SM should be extended and can lead to testable signals at colliders [3], including the e + e − colliders (such as the projected CEPC [8], ILC [9], and FCC-ee [10]) and high luminosity pp colliders (such as FCC-hh [11][12][13] and SPPC [8]). On the other hand, in the present post-Higgs era, the ongoing collider search of heavy and charged Higgs beyond the SM also assumes the extension of the SM scalar sectors.
Among various extensions of the SM, the Georgi-Machacek model introduces a real and a complex isospin-triplet scalar to extend the SM Higgs sector [14,15], which introduce a new contribution of the electroweak symmetry breaking. The custodial symmetry there is preserved explicitly at tree level by assuming the same vacuum expectation value (VEV) to the neutral fields of the two isospin-triplet scalars [16]. The interaction strength of the SM vector bosons and the doubly-and singly-charged Higgs bosons of the quintuple is controlled by the vacuum expectation value (VEV) of the triplets, which can be probed through the charged Higgs searches [17][18][19]. A recent study on the heavy Higgs and charged Higgs in the "H5plane" benchmark scenario for the GM model (developed by the LHC Higgs Cross Section Working Group [20] ) can be found in Ref. [19]. The triplet scalars can introduce additional vacuum structures (local minimum), which might make the symmetry breaking history occur through a two-step pattern since the SU(2) L × SU(2) R → SU(2) V can occur before the electroweak symmetry breaking. Therefore, we perform the study of phase transition patterns to find the relation between the SFOEWPT conditions and the Higgs phenomenology. As for the relation between the SFOEWPT and the charged Higgs bosons phenomenology, we focus on the low mass benchmark not yet covered by the LHC [21]. This constitutes our motivation to study electroweak phase transition within the GM model and makes our study significantly different from the previous one [22]. In this work we focus on the SFOEWPT study utilizing the custodial vacuum alignment scenario of the GM model. The CP violation of the GM model requires custodial symmetry breaking, we left that to the future work.
This work is organized as follows: We first review the GM model under study in Sec. II. The electroweak phase transition methodology being adopted is explored in Sec. III. The interplay between the SFOEWPT condition and the related Higgs phenomenology are constructed in Sec. IV. The Sec. V is attributed to the conclusions.

A. The Model Setup
In the Georgi-Machacek model, there are one isospin doublet scalar field φ = (φ + , φ 0 ) T with hypercharge Y = 1 2 , one complex isospin triplet scalar field χ = (χ ++ , χ + , χ 0 ) T with hypercharge Y = 1, and one real triplet ξ = (ξ + , ξ 0 , −ξ + * ) T with hypercharge Y = 0. The custodial symmetry is introduced at tree level by imposing a global SU(2) L ×SU(2) R symmetry upon the scalar potential. In order to make this symmetry explicit, the doublet and the two triplets are written in the form of a bi-doublet and a bi-triplet under SU(2) L ×SU(2) R : with where the phase convention for the scalar field components is: and T a being the SU(2) generators. The most general scalar potential where summations over a, b = 1, 2, 3 are understood, σ 's and T 's are the 2 × 2 (Pauli matrices) and 3 × 3 matrix representations of the SU(2) generators, respectively The P matrix, which is the similarity transformation relating the generators in the triplet and the adjoint representations, is given by The neutral components in Eq.(1) can be parameterized into real and imaginary parts according to where ν φ , ν χ and ν ξ are the VEVs of φ 0 , χ 0 and ξ 0 , respectively. With only neutral components of this model, the potential reads: We can derived the EWSB vacuum from this conditions: where the fields other than φ 0 , χ 0 and ξ 0 take zero VEV's. In this paper, the solution satisfying the relation v χ = √ 2v ξ is selected, by which the EWSB vacuum maintains the diagonal SU(2) V symmetry. Thus the parameter ρ = m 2 W /(m 2 Z cos θ 2 w ) = 1 is established at the tree level. The W and Z boson masses from the EWSB give the constraint, When ν φ ν ξ = 0, with the help of Eq.(7) (under the relation ν χ = √ 2ν ξ ), we could rewrite m 2 1 , m 2 2 in terms of ν φ ,ν ξ and other parameters in the Higgs potential as: There are 13 scalar fields in this model. After diagonalizing the mass matrices, the fields can be rewritten as the physical scalars (quintuple, triplet and singlet respectively) The five dimensionless couplings in the potential, λ 1,2,3,4,5 , can be substituted by five physical parameters m H 1 , m H 3 , m H 5 , α, θ H .

B. The Theoretical Constraints
Three theoretical constraints are taken into account to constrain the dimensionless quartic couplings of the scalar potential at tree level: the unitarity of the perturbation theory, the stability of the electroweak vacuum and avoiding custodial symmetry-breaking vacuum. All these constraints have been investigated in detail in Ref. [16], and will be automatically imposed on our parameter scan using GMCalc [23].

Tree-level unitarity
The bound from perturbative unitarity is obtained by requiring that the zeroth partial wave amplitude, a 0 , for elastic 2 → 2 scalar boson scatterings does not become too large to violate Smatrix unitarity. That means that the amplitude a 0 satisfy |a 0 | ≤ 1 or |Rea 0 | ≤ 1/2. Then, the perturbative unitarity bound reads:

Vacuum stability constraints
Following the approach of Ref. [24], we can parameterize the potential using the following definitions: The quartic terms in the potential are given in this parametrization by, The vacuum stability requires the scalar potential to be bounded from below and leads to following constraints on the quartic couplings Ref. [25]. where

Absence of deeper custodial symmetry-breaking minima
With the notation in Eq. (24), the full scalar potential can be written as: For a check that the scalar potential possesses no custodial symmetry-breaking minima that are deeper than the desired custodial symmetry-preserving minimum, we could parameterize these values as below: Our desired electroweak-breaking and custodial SU(2)-preserving vacuum corresponds to θ = cos −1 (1/ √ 3), thus ζ = 1/3 and ω + = 1/2. The vacuum θ = π + a is also acceptable; it corresponds to a negative ν χ . Other values of θ correspond to vacua that spontaneously break custodial SU(2).

III. ELECTROWEAK PHASE TRANSITION METHODOLOGY
With the temperature cooling down, the Universe can evolve from the symmetric phase to the symmetry broken phase. The critical behavior can be studied with the finite temperature effective potential with particle physics models, through which one can obtain the critical classics field value and temperature being v C and T C . Roughly speaking, SFOEWPT can be obtained when v C /T C > 1, with which, one may have the electroweak sphaleron process quenched inside the bubble after bubble nucleation, and therefore prevent the washout of the baryon asymmetry generated within the EWBG mechanism [2]. We first analyse the vacuum structure of the potential at zero temperature, then demonstrate the phase transition computation method adopted in this work.

A. Vacuum structure analysis
Assume h χ = √ 2h ξ , the vacuum structure of the zero temperature potential could be obtained through the following minimization conditions In the classical field spaces of h χ,ξ , there are three minima: (1) The A point being the original point, which preserves the EW and SU(2) L × SU(2) R symmetries; (2) The B point being the electroweak vacuum; (3) and the C point where one have the symmetry breaking of the SU (2) Here, we note that the µ 2 parameter is crucial for the existence of the C point. As shown in Fig. 1, as the temperature of the Universe cools down, the symmetry breaking process may occurs along the direction of A → B by one-step or A → C → B by two-steps. The two correspond to one-step or two step phase transitions depending on the vacuum structure and potential height as will be explored in the following paragraph.
FIG. 1. One-step (red) and two-step phase (blue) transition process. A is the original point, which is SU(2) L × SU(2) R preserving vacuum. B is the EW vacuum and C is the SU(2) V preserving vacuum.
The scalar potential of the EW vacuum should be the lowest one and the scalar potential of the original point is the maximal one of the three. The three scalar potentials where The two step phase transition might happen only when −12m 2 The potential differences are given as, Depending on the zero temperature vacuum structure and potential height, one may have onestep or two-step phase transition. Two-step phase transition may occur when a local minimum exists as shown in the right panel of the Fig. 2, and for the left panel plot case there could be a one-step phase transition.

B. Phase Transition patterns
Utilizing the gauge invariant approach [26][27][28][29], the finite temperature potential adopted for the study of phase transition behavior in the GM model is given by, where the zero temperature potential V 0 is given by the Eq. (6) and the finite temperature corrections are calculated as, Here, the g, g , y t are gauge couplings and top Yukawa coupling respectively. We note that, with the high temperature approximation, the tadpole term involving T 2 h ξ ,χ that would make the symmetry break at high temperature does not appear as in the singlet model [30,31] due to the global symmetry of SU(2) L × SU(2) R being imposed to the tree level potential. After substituting h χ → √ 2h ξ in V T of Eq. (38), we obtain the finite temperature potential used for the phase transition study. Due to the rich vacuum structures of the potential at finite temperature, there can be one-step or two-step phase transitions depending on whether the symmetry breaking of SU(2) L × SU(2) R → SU(2) V occurs earlier than the EW symmetry breaking. Ref. [30] indicates that realization of the one step phase transition requires where tan θ H (T ) = 2 √ 2h ξ /h φ at finite temperature, the correspondence between the sin θ H (T C ) and sin θ H for both one-step and two-step SFOEWPT are given in Fig. 12. The m 1,2 here are given by the minimization of the tree level potential at the EW minimum, see Eq. (10). Through which, the above conditions implicitly relay on the cubic Higgs coupling µ 1 , µ 2 . For two step pattern phase transition, the T-dependence location of the minima can be described by the curves of [31], Following Ref. [31], to make the EW broken minimum (B point) the deepest one of the three vacua (A,B, and C point) for T < T C , one needs the condition of d(V T (C) − V T (B))/dT 2 > 0. In turn, one has where the B and C in the parentheses stand for the classical value of the fields (h φ ,ξ (T )) at the EW breaking vacuum (around B point of Fig. 1) and SU(2) L × SU(2) R → SU(2) V vacuum ( around C points of Fig. 1). To ensure the B point being the global minimum at zero temperature, one needs the additional vacuum structure conditions being analyzed in Sec. III A. The µ 1 parameter is useful for setting the tree level potential barrier for the phase transition, with the the term of µ 1 h ξ h 2 φ in Eq. (6). The µ 2 parameter, as studied previously in Sec. III A, is another key parameter to ensure the possibility to have two-step phase transition with the existence of the C point of Eq. (32). Our study will demonstrate that a typical region of µ 2 is necessary for a two-step SFOEWPT to occur.
Usually, the one-step SFOEWPT requires relatively large cubic Higgs coupling, which may suffer from perturbativity problem of the model at high scale [32,33]. The mixing between the SM Higgs and the additional Higgs can be easily tested by current and the future collider searches [3,[33][34][35], and therefore test the possibility to obtain the one-step SFOEWPT. Due to the typical vacuum structure, the two-step SFOEWPT can occur with much lower cubic Higgs coupling, see Ref. [36,37] for the complex singlet model scenario which have a similar vacuum structure with the custodial symmetry conserving GM model. For completeness, we study both one-step and twostep SFOEWPT in this work. The SFOEWPT condition being v C /T C ≡ h φ (T ) 2 + 8h ξ (T ) 2 /T C ≥ 1 is adopted in this work with the h φ ,ξ (T ) and T C evaluated as follows.

One-step phase transition
When the temperature of the Universe drops to the critical temperature with the Universe expands, two degenerate vacua (A and B points) occur with a potential barrier structure, which can be expressed as: through which, critical temperature and critical field value can be obtained. Here, we note that, to ensure two degenerate vacua occur the following constrains also should be satisfied: The h B φ ,ξ locates around v φ ,ξ at finite temperature T C .

Two-step phase transition
When the temperature of the Universe drops to the critical temperature with the Universe expands, two degenerate vacua (B and C points) occur with a potential barrier structure, which can be expressed as: Through which, the critical temperature and critical field value can be obtained. As the onestep case, to ensure two degenerate vacua occur the following condition needs to be fulfilled: Here, the h B φ ,ξ locates around v φ ,ξ , and the h C ξ locates around h ξ given in Eq. (32) at finite temperature T C .

PROSPECTS
We first study the general feature of the SFOEWPT in the GW model, which will reveal the relation between the triplet VEV and the SFOEWPT condition after considering the current and the projected experimental constraints: a lower magnitude of the triplet VEV is favored by both one-step and two-step SFOEWPT. The low mass m h 5 benchmark is subsequently studied where small sin θ H is accompanied with m h 5 < 200 GeV to be covered by future collider searches.

A. The phase transition features in the GM model
To consider theoretical and experimental constraints, we employ the GMCalc [23] to generate parameters of the GM model. Within these parameter spaces, we perform phase transition analysis with the approach explored in Sec. III. We first investigate how does the SFOEWPT relay on the cubic scalar couplings and the quartic scalar couplings. Fig. 3 depicts that one-step SFOEWPT usually requires a larger cubic scalar coupling of µ 1 , and the two-step SFOEWPT can occur with a relatively lower magnitude of µ 1 . This can trace back to the analysis of the phase transition patterns conditions in the Sec. III B. One can find that the one-step SFOEWPT can occur with both negative and positive λ 4 , and the two-step SFOEWPT can only occur in the parameter spaces with a positive λ 4 . The two-step SFOEWPT can occur with much lower magnitude of the cubic coupling µ 2 in comparison with the one-step SFOEWPT, that reconfirms the vacuum structure analysis in Sec. III.
To reveal the relation between the phase transition and the mixing among the h φ ,χ,ξ (the mixing angle α), we plot the SFOEWPT allowed points in α-µ 1,2 plane. In order to make clear how does the phase transition relay on the location of the B point for one-step and two-step phase transition, we also show the SFOEWPT valid points in ν ξ -µ 1,2 plane. The top-left plot of the Fig. 4 indicates that for a larger magnitude of |µ 1 | a larger mixing angle of α is necessary for the one-step SFOEWPT, mostly α < 0. Meanwhile, the two step SFOEWPT can occur with a much FIG. 4. The SFOEWPT viable points in the parameter spaces of α and µ 1 (upper-left), α and µ 2 (upperright), ν ξ and µ 1 (below-left) and ν ξ and µ 2 (below-right). The blue and red points satisfy the two step phase transition and one-step SFOEWPT conditions. higher probability around α ∼ 0 (both α < 0 and α > 0 are allowed) with small mixing between the light and heavy Higgs or h φ and h χ,ξ , and a smaller |α| is accompanied with a larger µ 1 . The top-right panel of Fig. 4 reflects the same information as the middle panel of Fig. 3 because the α is characterized by µ 1 . The bottom-left panel indicates that the two-step SFOEWPT can occur with a larger |µ 1 | in the parameter regions with a larger v ξ , which means a larger tan θ H . In addition to the negative value of α, positive α angel can also lead to two-step SFOEWPT. The bottomright plot demonstrates that the occurrence possibility of the one-step SFOEWPT decreases as v ξ (or sin θ H ) increases, while the two-step SFOEWPT almost occur with the same probability with relatively lower magnitude of µ 2 .
To make a better understanding how does the phase transition relay on the VEV of the triplet, and furthermore the phase transition patterns, we perform the survey of the relation between the SFOEWPT condition and v ξ in Fig. 5. The left plot shows that SFOEWPT can occur in the parameter regions of v ξ < 60 GeV. One can read the strength of the phase transition in the plot, which is found to be almost v C /T C ≤ 4.5 for one and two step cases. It seems that the possibility to reach one-step SFOEWPT is much higher than the two-step one, and there is a tendency that v C /T C increases with v ξ for the two-step case. The Ref. [38][39][40] performed the study of the constraints on the v ξ -α parameter spaces of the GM model. Their results mostly bound the parameter spaces to a negative α < 0 due to the LHC Higgs signal strength constraints. The projected 14 TeV LHC with 300 fb −1 , HL-LHC with 3000 fb −1 , and ILC at 250 and 500 GeV can also probe the The v C /T C > 1 viable points in the plane of α-v ξ for one step and two-step SFOEWPT. parameter spaces. The right plot of fig. 5 demonstrates that the one-step SFOEWPT can occur for an increasing ν ξ as α increases. The 13 TeV LHC Higgs signal strength fitted by Ref. [40] has been adopted here to restrict the GM model parameter, which set severe bounds on the parameter spaces of the two-step SFOEWPT: α ≈ 0 with v ξ ≤ 20 GeV, which corresponds to sin θ H < 0.23. To understand the relation between the SFOEWPT condition and the charged Higgs mass m h 5 , we plot Fig. 6. The left panel of Fig.6 shows the SFOEWPT valid point in the parameter spaces of m h 3 − m h 5 . The two-step SFOEWPT favors 200 GeV< m h 3 <600 GeV together with 100 GeV< m h 5 < 400 GeV. The right panel of Fig.6 indicates one can have only two-step SFOEWPT for sin θ H < 0.1, one-step SFOEWPT requires slightly larger m h 5 for smaller sin θ H or v ξ , for the twostep case one has relatively smaller v ξ and sin θ H accompany with lower value of m h 5 . We impose collider search bounds in the plane of sin θ H − m h 5 . Curves with different colors are the constraints from current experiment searches for heavy scalars, where the green, cyan and black lines are the upper bounds from W Z channel [41][42][43], the yellow and orange lines are the bounds from WW channel [44,45], the pink and brown lines are the bounds from ZZ channel [46,47]. The purple line which is the limit from same-sign WW searches of the doubly charged scalar is the strongest constraints in this parameter space. The same-sign WW channel ruled out the SFOEWPT validated parameter spaces (including both one-step and two-step) with relatively large sin θ H increasing with m h 5 . This motivates the study of the two-step SFOEWPT in the parameter spaces with low magnitudes of sin θ H and m h 5 .
We summarize the relation between the SFOEWPT and Higgs phenomenology explored in this section as follows: • On the trilinear scalar couplings We first review the information we got on the relation between the SFOEWPT condition and the trilinear scalar couplings, µ 1,2 , that constitute a main contribution to the triple Higgs couplings, as shown in Eq. (B1) and will be discussed later. In comparison with the two-step SFOEWPT, relatively higher magnitude of µ 1 is required for one-step SFOEWPT. Lower value of µ 2 (close to 0) is required to realize the two-step SFOEWPT.
• The SFOEWPT valid parameter spaces confronting with the experimental constraints The right panel of the Fig. 5 indicates that the 13 TeV LHC signal strength measurements would restrict the possibility to obtain two-step SFOEWPT in the relatively narrow region α ∼ 0. The projected electron-positron colliders would constrain the magnitude of v ξ to even lower value, and therefore narrow down the possibility to obtain the SFOEWPT through one-step and two-step patterns. The right panel of Fig. 6 shows that the larger sin θ H would be excluded by the same-sign WW boson channel search at 13 TeV LHC, which means that the possibility to reach SFOEWPT would be bounded to the parameter spaces with small sin θ H and small α.

B. On triple Higgs couplings and the SFOEWPT condition
To reveal the relation between the SFOEWPT and the triple Higgs coupling to be searched at e + e − and pp colliders, we plot Fig. 7. The top-left and top-middle plots of the Fig. 7 illustrate that the magnitude of the triple Higgs couplings(λ GM hhh and λ GM H 1 hh ) grows with the increase of the strength of phase transitions for both one-step and two-step SFOEWPTs, which means larger deviation from the SM case can lead to a larger v C /T C . The deviation of triple Higgs couplings can be probed through the Higgs associated production process at lepton colliders and Higgs pair search at hadron colliders (LHC, FCC-hh, and SPPC), we refer to Ref. [38] and Ref. [48] for recent studies. The top-right panel depicts that, the two-step phase transition can occur in the parameter spaces with a smaller λ GM hhh and a larger λ GM H 1 hh . In this situation, the constraint from Higgs pair productions is usually more powerful, see Ref. [48] for a recent study. The bottomleft plot shows that for the mixing angel of α ∼ 0, the two-step phase transition can occur with a largest value of m H 1 ∼600 GeV. For the parameter spaces with a positive value of α, the phase transition can be two-step SFOEWPT with a relatively lower mass of the CP-even Higgs (200 GeV < m H 1 <600 GeV). Furthermore, the bottom-middle (bottom-right) plot shows that the triple In the scenario with small α and small θ H , the g h ff ,hVV close to the SM case, g H 1 ff ,H 1 VV are suppressed. For small mixing angle α bounded by LHC, HL-LHC, and ILC, the triple Higgs coupling given in Eq. (B1) recast as The first formula implicit that a large µ 1 , corresponding to most parameter spaces of the onestep SFOEWPT, can lead to a large deviation of the λ GM hhh from the λ SM hhh . Thus the probe of the triple Higgs coupling of λ GM hhh through the e + e − colliders should be able to test the parameter regions where the one-step SFOEWPT can be realized. For small θ H , one has g H 1 ff × λ GM H 1 hh ≈ − At last, we comment on the phase transition behaviors within the "H5plane" benchmarks developed by the LHC Higgs Cross Section Working Group [20]. The Ref. [19] studied the "H5plane" benchmark scenarios, where the regions with smaller m h 5 ≤ 200 GeV and α ≥ 0 (see Fig. 5 and Fig.6) that are crucial for the two-step SFOEWPT are not covered. That results in losing of the possibility of the two-step SFOEWPT, see the Fig. 8. In the following section, we would go beyond this benchmark and study the phase transition in the scenario including low mass m h 5 ≤ 200 GeV case.

D. Low mass charged Higgs benchmarks
As illustrated in the previous section, the current same-sign WW channel searches of doubly charged Higgs at the LHC preclude the possibility to obtain SFOEWPT in the parameter spaces with large sin θ H along with the increase of m h 5 . Therefore, we consider the electroweak phase transition in one particular benchmark scenario, the low mass fermiophobic charged scalar considered in Ref. [21]. In this case, the quintuple is the lightest scalar multiplet, the usual searching channels involving gauge bosons are suppressed by sin θ H which is chosen to be much less than 1, as well as by the phase space where the quintuple is light and below the diboson threshold. This leaves only four physical input parameters that are relevant in this benchmark, which can be chosen as follows: two parameters m h 5 and δ m 2 that control the mass spectrum of the heavy Higgs bosons, and two parameters sin θ H and µ 2 that control the couplings. In particular, we adapt

Variable Parameters
Other Parameters 1000 GeV sin θ H the definition of the benchmark from Ref. [21] with small modifications as listed in Tab. I. The parameters are chosen to accommodate low sin θ H as indicated in Ref. [21]. In Fig. 9, we show SFOEWPT viable points in the parameter space of sin θ H and m h 5 . The blue and red points satisfy the two-step and one-step SFOEWPT conditions respectively. Several current experimental constraints are also imposed in this plane represented by the lines with different colors. By construction, the low mass benchmark can evade most searching channels involving gauge bosons (W Z channel (green, black and cyan lines) [41][42][43], WW channel (yellow and orange lines) [44,45] and ZZ channel (pink and brown lines) [46,47]). The same-sign WW search from doubly charged scalar (purple line) [49] has the sensitivity down to about 0.17 for sin θ H at m h 5 ∼ 200 GeV. In this case, the same-sign WW search is still the strong constraint and can explore large viable parameter spaces of one-step SFOEWPT for m h 5 > 200 GeV. The figure also indicates that extending the search of same-sign WW down to lower mass region could explore most one-step SFOEWPT parameter space. While two-step viable points can extend to lower sin θ H region, which is difficult for W Z/WW /ZZ channels that are suppressed by sin θ H .
For this low sin θ H and low mass region, as indicated in Ref. [21], the most sensitive channels are those loop-induced channels (γγ and W γ etc). The dominant contributions to these channels come from the triple scalar couplings which is proportional to µ 2 and is not suppressed by sin θ H . In the Fig. 10 we show the SFOEWPT valid points including one-step and two-step in the µ 2 - sin θ H plane, the SFOEWPT mostly occurs for a negative µ 2 . We can see that lower value for sin θ H is accompanied by larger range of µ 2 for one-step SFOEWPT valid point, which means the triple scalar coupling is generally large in this region and leads to large partial width of these loop-induced channels.
In the low mass region, when W Z/WW /ZZ channels are suppressed by the phase space as well as by sin θ H , the loop-induced channels will dominate. We impose the constraints from W γ channel from Ref. [21] as well as the diphoton search from 8 TeV ATLAS [52] in this low mass region, the results are shown in Fig. 11 where the red and blue points present the one-and twostep SFOEWPT viable points as before. The green line and cyan line are the constraints from W γ and γγ searches respectively. We find that the loop induced decay channel has the sensitivity for the two-step viable parameter space in low mass region. Further improvement (such as higher luminosity, extending to lower mass region for γγ channel) in these searches will explore most of the two-step SFOEWPT parameter space.

V. CONCLUSIONS
In this work, we study the EWPT in the frame work of GM model. The EWPT can be SFOEWPT through one-step or two-step as the Universe cools down. In comparison with the onestep SFOEWPT, the two-step SFOEWPT can occur with a relatively smaller trilinear couplings between the Higgs doublet and the triplet scalars. The contribution of the triplets to the electroweak symmetry breaking is crucial for the SFOEWPT and the Higgs phenomenology, which is characterized by the parameter sin θ H or v ξ . The bounds from LHC, HL-LHC and the projected ILC constraints in the α-ν ξ plane can lower the possibility to realize SFOEWPT, especially the two-step SFOEWPT. The 13 TeV LHC Higgs signal strength measurements limit the two-step SFOEWPT valid parameter spaces to a rather small region with α ∼ 0. The current same-sign WW search performed at the 13 TeV LHC ruled out a lot parameter spaces to realize SFOEWPT including both one-step and two-step.
The Higgs pairs search would be able to search the two-step SFOEWPT when one have a nonnegative mixing angle α ≥ 0 accompanied with a lower mass of m H 1 . For much smaller triplet VEV (with the sin θ H < 0.1) and lower quintuple mass, the phase transition could be two-step SFOEWPT rather than one-step. The WW , W γ and γγ searches for the m h 5 < 200 GeV parameter regions can probe the two-step SFOEWPT within the GM model in this low mass and small sin θ H region.
At last, we note that the custodial symmetry in the Higgs potential prohibits the CP violation in the GM model. To address the BAU with the EWBG mechanism in the GM model, one may need to introduce a tinny custodial symmetry breaking without violate the ρ parameter constraints to include CP violation phases or introduce additional CP violations through high dimensional operators. by, .

(C1)
Thought the custodial symmetry study is beyond this work, we briefly list useful formula for the finite temperature study. At finite temperature, with the ρ parameter can be parametrized as, In the first stage phase transition of the two-step phase transition, one have null h φ (T ) with the ρ(T ) ≡ 1. While, for the second stage phase transition of the two-step phase transition, one have, where Suppose the condition of h χ = √ 2h ξ maintains as studied in this work, the following relations maintains, with c χ,φ being given in Eq. 39. The correspondence of sin θ H (T ) = 2 √ 2h ξ (T ) √ h φ (T ) 2 +8h ξ (T ) 2 at T = T C and T = 0 is given in the Fig. 12, which indicates the match situation of the two. After the temperature drops below T C , the sin θ H (T C ) would evolve to be the sin θ H fininally (i.e., sin θ H (T = 0)) and one obtain the EW symmetry break vacuum with SU(2) V symmetry.