Searching for τ→μγ\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\tau \rightarrow \mu \gamma $$\end{document} lepton-flavor-violating decay at super Charm-Tau factory

We investigate the possibility of searching the lepton-flavor-violating (LFV) τ→μγ\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\tau \rightarrow \mu \gamma $$\end{document} rare decay at the Super Charm-Tau Factory (CTF). By comparing the kinematic distributions of the LFV signal and the standard model background, we develop an optimized event selection criterion which can significantly reduce the background events. It is concluded that the new 2σ\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$2 \sigma $$\end{document} upper limit of about 1.9×10-9\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$1.9 \times 10^{-9}$$\end{document} on Br(τ→μγ)\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\mathrm{Br}(\tau \rightarrow \mu \gamma )$$\end{document} can be obtained at the CTF, which is beyond the capability of Super-B factory in searching τ\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\tau $$\end{document} lepton rare decay. Within the framework of the scalar leptoquark model, a joint constraint on λ1λ2\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\lambda _1 \lambda _2$$\end{document} and MLQ\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$M_\mathrm{{LQ}}$$\end{document} can be derived from the upper bound on Br(τ→μγ)\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\mathrm{Br}(\tau \rightarrow \mu \gamma )$$\end{document}. With 1000fb-1\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$1000~ fb^{-1}$$\end{document} data expected at the CTF, we get λ1λ2<7.2×10-2(MLQ=800GeV)\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\lambda _1\lambda _2 < 7.2 \times 10^{-2}~(M_\mathrm{{LQ}} = 800~ \mathrm{GeV})$$\end{document} and MLQ>900GeV(λ1λ2=9×10-2)\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$M_\mathrm{{LQ}} > 900~\mathrm{GeV}~(\lambda _1 \lambda _2 = 9 \times 10^{-2})$$\end{document} at 95%\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$95~\%$$\end{document} confidence level.


Introduction
The standard model (SM) [1,2] of elementary particle physics provides a remarkably successful description of strong, weak and electromagnetic interactions at the energy scale up to O(10 2 ) GeV. It is an SU EM spontaneously broken gauge theory, which also conserves the total baryon number B and the three lepton numbers L e , L μ , and L τ , i.e., the lepton flavors, respectively. However, a number of conceptual and experimental difficulties, such as the hierarchy problem, dark matter, and neutrino oscillations, inspired physicists to consider new mechanisms beyond the SM. Many extensions of the SM, such as the supersymmetric models, left-right symmetric models, the little Higgs model with T parity, and leptoquark models, could bring in lepton-flavor-violating (LFV) terms in natural ways and introduce non-zero neutrino masses and rare decays of the charged lepton. As the heaviest lepa e-mail: zhangry@ustc.edu.cn ton, the τ lepton has more LFV decay modes compared to the μ lepton. The branching ratios of the τ lepton LFV decays are predicted at the level of 10 −10 -10 −7 [3][4][5][6]. Therefore, searching for τ LFV decays and improving limits on the branching ratio becomes increasingly important of current and future experiments.
All the LFV decays of τ lepton, such as τ → lγ , τ → lll ( ) , and τ → lh, where l, l = e or μ and h is a hadronic system, are sensitive to new physics beyond the SM. Among these modes, the radiative decays τ → μγ and τ → eγ are predicted to have the largest probability close to current experimental upper limits in a wide variety of new physics scenarios. So far the most stringent limits are Br(τ → eγ ) < 3.3×10 −8 and Br(τ → μγ ) < 4.4×10 −8 at 90 % confidence level (C.L.), with (963±7)×10 6 τ decays of data collected by the B factories [7]. To achieve more sensitivity in probing τ LFV decay, high intensive electron-positron beam facilities are desired. One main project is the wellestablished upgrade of the B factory, i.e., the Super-B factory, running at energies from open charm threshold to above ϒ(5S) resonance with intended accumulated luminosity of 75 ab −1 . The Super-B factory would provide great opportunity in searching τ rare decay, where a 90 % C.L. upper limit on Br(τ → μγ ) is expected as 2.4 × 10 −9 [8]. Another proposal, the so-called Super Charm-Tau factory (CTF), is an e + e − collider designed to work in the energy region from 2 to 5 GeV with instant luminosity of 10 35 cm −2 s −1 [9]. Compared to the Super-B factory, τ leptons can be copiously produced in pairs at the CTF with center-of-mass (c.m.s.) energies E e + e − not far above the 2m τ threshold, and the radiative background e + e − → τ + τ − γ is not significant.
In this paper, we investigate the potential of searching the τ → μγ LFV decay at the CTF and demonstrate its better chance than the Super-B factory. The paper is organized as follows: The LFV signal and dominant background at the CTF are discussed. Then a strategy of experimental event selection to improve signal significance is developed, and an expected upper limit on Br(τ → μγ ) is presented. Finally, the constraints on the leptoquark model parameters are given as an example of an interpretation of new physics.

LFV signal and background at the CTF
At the CTF, the cross section for e + e − → τ + τ − increases significantly as the increment of the colliding energy from the threshold of τ -pair production (∼3.55 GeV) to the threshold of D meson production (∼3.74 GeV). We set the CTF c.m.s. energy as 3.7 GeV, in order to get τ lepton pair produced copiously.
The signal under discussion is that one τ lepton follows LFV decay into a muon and a photon, while the other follows SM decay into a muon and two neutrinos, i.e., e + + e − → τ + (μ + ν μντ ) + τ − (μ − γ ) and e + + e − → τ + (μ + γ )+τ − (μ −ν μ ν τ ). The Feynman diagram for the signal process e + e − → τ + τ − → μ + ν μντ μ − γ is depicted in Fig. 1. Due to the fact that τ m τ ∼ O(10 −12 ) is sufficiently small, the naive narrow width approximation (NWA) is adopted when calculating the LFV decay τ → μγ , and the muon and photon are assumed isotropic in the rest frame of the τ lepton. However, we do not employ the naive NWA to deal with the SM decay τ → μν μ ν τ for the LFV signal, and keep the off-shell contribution and spin correlation effect from the potentially resonant intermediate τ lepton. In other words, we treat the LFV signal as 4-body production processes, e + e − → τ + * τ − → μ + ν μντ τ − and e + e − → τ − * τ + → μ −ν μ ν τ τ +1 , followed by sequential 2-body LFV decay τ → μγ . Then the cross section of the signal process e + e − → τ + τ − → μ + ν μντ μ − γ can be factorized as (2.1) Given the efficiency of detector resolution, no requirement on the missing energy / E raised by escaping neutrinos is imposed. Thus, the detectable LFV signal at the CTF is comprised of two muons and an isolated photon in the final state as μ + μ − γ + X , where X denotes all the undetected neutrinos and one hard muon is from τ LFV decay and the other soft one from the standard τ leptonic decay. Accordingly, the leading background to the LFV signal comes from the e + e − → μ + μ − γ process, which is depicted in Fig. 2 as the leading order (LO) contribution.
However, due to the smallness of the τ LFV decay branching ratio, the effect of the SM background that involves four The Feynman diagram for the signal process e + e − → τ + τ − → μ + ν μντ μ − γ neutrinos in final state cannot be ignored. In our calculation, we mainly consider the resonance contribution from e + e − → τ + τ − → μ + μ − γ ν μνμ ν τντ , where τ + and τ − are treated as on-shell particles. Specifically, the subleading background is that one τ lepton decays into a muon and two neutrinos and the other decays into a muon, two neutrinos, and a photon, i.e., e + +e − → τ Considering the geometric acceptance of the detector and to avoid the soft divergence induced by low energy infrared radiation, a set of kinematic cuts on the final particles is imposed as baseline, where E γ is photon energy, η γ and η μ are the pseudorapidities of photon and muon, and 2 is the separation on the pseudorapidity-azimuthal-angle plane between muon and photon. After applying the baseline cuts, the cross sections of the LFV signal and the SM background at the √ s = 3.7 GeV CTF are obtained:

Results and discussion
Following Eq. (2.3), one can see that the event number of background is about eight orders of magnitude larger than if only baseline cuts are taken. However, by exploring the distinction between the LFV signal and background kinematic distributions, an optimized event selection algorithm can be developed to suppress the SM background and enhance the sensitivity of searching τ → μγ LFV decay at the CTF. First, for an event of μ + μ − γ + X final state, the leading muon μ 1 can be defined as where M μ ± γ is the invariant mass of μ ± γ system. The invariant mass distributions of the μ 1 γ system are depicted in Fig.  3, for the LFV signal and the SM background, respectively, after applying baseline cuts. The leading muons in signal processes are predominately from the τ lepton LFV radiative decay, and the signal is manifested as a striking peak around m τ in the μ 1 γ mass spectrum. Therefore, a stringent mass window can be imposed to effectively suppress the continuous spectrum of the SM background. Since the τ lepton decay width is negligible, the spread of the signal mass peak is dominated by the detector resolution. Compared with the BESIII, the CTF puts forward a higher requirement on detector performance, e.g., the energy resolution of electromagnetic calorimeter for photon at the CTF is about 1.5 % at E γ = 1 GeV [9], whereas the corresponding resolution of the BESIII is about 2.5 % [10]. The momentum resolutions of the track system for both the CTF and the BESIII are about 0.5 %. Accordingly, a conservative mass window "cut1" on μ 1 γ system can be chosen as The second muon other than the leading one is denoted as μ 2 . After applying successive baseline cuts and cut1, the trailing μ 2 momentum spectrum of the LFV signal would be well separated from that of the SM leading background, as shown in Fig. 4. For the LFV signal, the trailing muon is from the branch of standard τ 3-body leptonic decay, whose momentum distribution is irrelevant to the μ 1 γ invariant mass window imposed around m τ . But the trailing muon momentum distribution for the SM leading background obviously depends on the μ 1 γ invariant mass window and will overlap that for the LFV signal as the mass window increases to about 0.3 GeV. For the SM subleading background, the trailing muon is certainly from the branch of standard τ → μγ + 2ν 4-body leptonic decay after cut1 and therefore is relatively soft. As shown in Fig. 4, the trailing muon momentum distribution for the SM subleading background overlaps that for the LFV signal in the low momentum region. Based on the behaviors of these trailing muon momentum distributions, a "cut2" on the trailing muon momentum can be defined to reduce the SM contamination, 0.45 GeV < p μ 2 < 1.1 GeV. (3.4) For the LFV signal, the energy and the momentum of μ 1 γ system are strictly limited to √ s/2 = 1.85 GeV and s/4 − m 2 τ = 0.515 GeV, respectively. While for the SM subleading background, the energy and the momentum of μ 1 γ system are continuously distributed. Therefore, an energy window centered at 1.85 GeV and a momentum window centered at 0.515 GeV on μ 1 γ system can greatly reduce the SM subleading background. Taking the energy and the momentum resolutions of the detector mentioned above into consideration, the energy window "cut3" and the momentum window "cut4" on μ 1 γ system can be chosen as Based on the above discussion, an optimized event selection criterion can be proposed: This four-step cut strategy could theoretically save 79.3 % of signal events, remove all the leading background events, and only retain 1.8 × 10 −5 of the subleading background events. Then the significance of the signal over background after the above kinematic cuts applied is given by where L is the accumulated luminosity in unit of f b −1 , and it is reasonable to presume an annual integrated luminosity of about 1 ab −1 at the CTF. If the LFV signal is not detected with certain accumulated luminosity at the CTF, a new upper bound on Br(τ → μγ ) can be set at a C.L. of 2σ , as shown in Fig. 5. The 2σ upper limits on Br(τ → μγ ) for some typical values of the integrated luminosity are also given in Table 1. We can see that the direct search for the τ → μγ LFV decay at the CTF would give much more stringent limit on Br(τ → μγ ) than

Constraints on new physics
New upper bound on Br(τ → μγ ) expected at the CTF would constrain new physics beyond the SM. Among all the extensions of the SM, the leptoquark (LQ) model is a promising one to interpret LFV decays and has been extensively studied. In addition to the spin and gauge quantum numbers, the leptoquarks carry both lepton number and baryon number, and the spin-0 and spin-1 particles are called scalar and vector leptoquarks, respectively. The renormalizable and SU (3) C ⊗ SU (2) L ⊗ U (1) Y invariant interactions between scalar leptoquarks and SM fermions are given by the following Lagrangian [11]: where q L and l L denote the left-handed SU (2) L doublet quarks and leptons of the SM, and u R , d R , and e R are the right-handed SU (2) L singlet quarks and charged leptons, respectively. We use S j, Y  In investigating the rare decay τ → μγ , we also require the interactions between the scalar leptoquarks and photon. The photon interactions arise from the following SU (2) L ⊗ U (1) Y invariant kinematic terms of the scalar leptoquarks: where W i μ (i = 1, 2, 3) and B μ are the SU (2) L and U (1) Y gauge fields, respectively, and T i (i = 1, 2, 3) are the generator matrices for the SU (2) L representation occupied by the scalar leptoquarks. From Eq. (4.2) we obtain the photon interaction for a scalar leptoquark as where A μ is the photon field and Q LQ represents the electric charge of the scalar leptoquark S. For simplicity, we assume that all the LFV couplings except λ L 1 2 ,i j (i = 1, j = 2, 3), where i and j are quark and lepton-flavor indices, are zero. Therefore, only τ -u-LQ and μ-u-LQ couplings are non-zero, and the τ lepton can decay into μ + γ via quark-leptoquark involved loops at the LO, as shown in Fig. 6.
The LO decay width for the LFV decay process τ → μγ is given by where M τ →μγ is the amplitude for the Feynman diagrams in Fig. 6 and p μ,cm is the three-momentum of μ in the rest frame of the initial τ lepton. The summation is taken over the spins of the initial and final state particles and the factor 1 2 arises from the spin average of the initial state. We compute M τ →μγ by using the related Feynman rules obtained from Eqs. (4.1) and (4.4), and we adopt the Passarino-Veltman reduction method to convert the one-loop amplitude to scalar integrals. The loop divergence is naturally canceled for these four diagrams with no necessity to introduce any counterterm. The LFV decay branching ratio for τ → μγ can thus be expressed as where λ 1 = λ L , denoting the μ-u-LQ and τ -u-LQ coupling strengths, respectively. The form factors F 1,2 are given in the appendix.
Under the simplicity assumption, there are only three parameters of scalar leptoquark determining the τ → μγ LFV decay, namely the couplings λ 1,2 and the scalar leptoquark mass M LQ . As shown in Eq. (4.6), the τ LFV decay branching ratio is proportional to (λ 1 λ 2 ) 2 but it is in a much complicated way related to M LQ . The dependence of Br(τ → μγ ) as functions of λ 1 λ 2 and the leptoquark mass M LQ is presented in Fig. 7.
According to the dependence, a joint constraint on λ 1 λ 2 and M LQ can be derived from the upper bound on Br(τ → μγ ) expected at the CTF, as shown in Fig. 8. One can estimate from the plot the upper bound on λ 1 λ 2 and the lower bound on M LQ for given M LQ and λ 1 λ 2 , respectively. For example, with 1000 f b −1 data expected at the CTF, one can get  Besides the above specified leptoquark interpretation, the τ LFV decay can be expressed in a model-independent formalism. An effective vertex τ -μ-γ can be introduced in the form of i m τ σ μν p ν (σ L P L +σ R P R ), where σ μν = i 2 [γ μ , γ ν ], P L ,R = (1 ∓ γ 5 )/2, and p ν is the momentum of the photon [12]. Then the branching ratio for τ → μγ can be simply Similarly, a joint upper bound on |σ L | and |σ R | can be deduced from the upper bound on Br(τ → μγ ). As shown in Fig. 9, a more stringent upper bound of |σ L | 2 + |σ R | 2 < 5.2 × 10 −10 , much smaller than the current experimental limit, could be derived, if the τ → μγ LFV decay is not detected with 1000 f b −1 integrated luminosity expected at the CTF.

Summary
In this paper, we investigate the potential of searching τ → μγ LFV decay at the CTF. With a center-of-mass energy of 3.7 GeV of electron-positron collisions, τ leptons can be copiously produced in pairs at the CTF. The LFV signal processes e + e − → τ + τ − → μ + μ − γ ν μ(τ )ντ (μ) are featured by a detectable final state of μ 1 μ 2 γ + X , namely one hard leading μ 1 along with a hard photon from τ radiative LFV decay and one soft trailing μ 2 from the standard τ leptonic decay, and leaving the missing energy from escaping neutrinos unmeasured. To improve the significance of the τ → μγ LFV decay at the CTF, we propose a four-step event selection strategy: an invariant mass window on μ 1 γ system around m τ and a momentum cut on μ 2 are imposed to eliminate the dominant e + e − → μ + μ − γ SM background, and then an energy window and a momentum window on μ 1 γ system are successively applied to significantly suppress the e + e − → τ + τ − → μ + μ − γ ν μνμ ν τντ subleading SM background. It can be predicted with a couple years of CTF running, new sensitivities on Br(τ → μγ ), which could surpass current experimental upper bound and those expected at the Super-B factory, can be achieved. The new upper limit on Br(τ → μγ ) expected at the CTF would cer-tainly constrain the parameter space of new physics beyond the SM, either in specific theories as leptoquark theory or in a model-independent effective formalism.