1 Introduction

The flavour-changing neutral current decays are known to be excellent probes of physics beyond the Standard Model (SM) [1,2,3,4]. Of particular interest are the loop level Glashow–Iliopoulos–Maiani (GIM) mechanism suppressed processes involving \(b\rightarrow s \gamma \) transitions that enable the photon polarization to be measured. The helicity flip required for the dipole transition in such decays is sensitive to new physics (NP). Unfortunately, the helicity structure of the quark level \(b\rightarrow s\,\gamma \) transition is hard to analyze using spinless B mesons, as handedness of the quark is difficult to retrieve after hadronization [5,6,7,8,9,10,11,12].

Recently the LHCb experiment performed several indirect measurements concerning the photon polarization in the B and \(B_s\) meson systems. Polarized photons in \(b \rightarrow s \,\gamma \) transitions were observed for the first time by analyzing the up-down asymmetry in \(B^+ \rightarrow K^+\,\pi ^-\,\pi ^+\gamma \) decays [13]. Angular observables in the \(B^{0} \rightarrow K^{*0}\,e^+\,e^-\) channel for dielectron invariant masses of less than 1 GeV\(/c^2\), sensitive to the polarization of the virtual photon, were measured in [14]. The first experimental study of the photon polarization in radiative \(B^{0}_{s}\) decays was reported in [15] by analyzing the time dependence of the \(B^{0}_{s} \rightarrow \phi \gamma \) decay rate.

A large number of b-baryons are also being produced at LHCb allowing for several interesting measurements to be performed using the ground state spin-1 / 2 b-baryons. The study of spin correlations in radiative decays of b-baryons allows one to directly infer the chirality of the dipole transition involved. The observable of interest, namely, the photon polarization asymmetry \(\alpha _{\gamma }\), defined as the ratio of shortfall in the observed number of right polarized photons compared to left polarized photons to the total number, is well recognized in the context of b-baryon radiative decays and has resulted in several studies [16,17,18,19,20,21,22,23,24,25,26]. Despite the rich phenomenology, the photon polarization asymmetry in radiative b-baryon decays is yet to be explored in experiments. In addition, it is worth mentioning that the initial b-baryon can have non-zero transverse polarization [27, 28] depending on the various production mechanism of a b-quark at the Large Hadron Collider (LHC). For finite quark masses (\(m_{b}\ne 0\)), a b-quark produced in a QCD process can have transverse polarization of the order of 10% [28, 29]. During hadronization, the polarization of the b-quark is retained to a large extent by the b-baryon as the depolarization effects [28] due to QCD interactions are suppressed by a factor of \(\varLambda _{\text {QCD}}\)/\(m_{b}\), a feature common to all b-baryons. A systematic study of b-baryon polarization \(P_{b}\) [30, 31], defined as the production asymmetry between its up and down spin components, is therefore important for our understanding of the production mechanism and hadronization process of heavy quarks.

In this paper we revisit the \(\varLambda _{b}^{0}\rightarrow \varLambda ^{0} \,\gamma \) and the analogous \(\varXi _b^{-} \rightarrow \varXi ^{-} \gamma \) decays. The \(\varLambda ^0\) and \(\varXi ^-\) subsequently decay to multibody final states that provide powerful handles not only on the photon polarization but also the initial b-baryon polarization. The complete angular distribution of the decay chains \(\varLambda _{b}^{0}\rightarrow \varLambda ^0 \,\gamma \) and \(\varXi _{b}^-\rightarrow \varXi ^-(\rightarrow \varLambda ^0\,\pi ^-)\,\gamma \), with the \(\varLambda ^0\) decaying into \(p\, \pi ^-\), is a function of the photon polarization, \(\alpha _{\gamma }\), the initial b-baryon polarization, \(P_b\), and known decay asymmetry parameters of intermediate baryons. We explore the potential of simultaneous measurement of the photon and b-baryon polarizations at LHCb through the study of the angular distribution of b-baryon decays using Monte Carlo simulations. With the expected yield from the LHC Run II a sensitivity of about 0.15 is achievable for the photon polarization along with a measurement of \(\varLambda _{b}^{0}\) polarization with a precision better than 10%. Despite of the challenges in \(\varXi _{b}^{-}\) due to scarcity of data, the decay mode \(\varXi _{b}^{-}\rightarrow \varXi ^{-}\gamma \) remains a promising channel for Run II and beyond where a sensitivity of the order of 0.2 can be achieved in \(\alpha _{\gamma }\) measurement along with a first time measurement of \(\varXi _{b}\) polarization.

The paper is laid out as follows: in Sect. 2 we have discussed the angular distribution of the radiative decays [32, 33] of \(\varLambda _{b}^0\) and \(\varXi _{b}^-\). Section 3 is devoted to the sensitivity analysis of these rare decays at the LHCb experiment. Finally, we provide constraints on new physics scenarios from the photon polarization asymmetry in Sect. 4 before concluding in Sect. 5.

2 Angular distribution of radiative b-baryon decays

2.1 Case study of \(\varLambda _{b}^{0} \rightarrow \varLambda ^0 \,\gamma \)

Assuming an initially polarized sample of \(\varLambda _{b}\) we study the complete angular distribution of \(\varLambda _{b}^{0} \rightarrow \varLambda ^0 \,\gamma \) where the \(\varLambda \) subsequently decays to a proton (p) and pion (\(\pi ^{-}\)). The transverse \(\varLambda _{b}^{0}\) polarization is defined [30, 31] as the mean value of the \(\varLambda _{b}^{0}\) spin along the unit vector

$$\begin{aligned} \hat{n}=\frac{\overrightarrow{p}_{p}\times \overrightarrow{p}_{\varLambda _{b}}}{\vert \overrightarrow{p}_{p}\times \overrightarrow{p}_{\varLambda _{b}} \vert }, \end{aligned}$$
(1)

normal to the production plane, where \(\overrightarrow{p}_{p}\) is the counterclockwise proton beam direction and \(\overrightarrow{p}_{\varLambda _{b}}\) the \(\varLambda _{b}^{0}\) momentum. A schematic view of the decay is shown in Fig. 1. The primary decay of \(\varLambda _{b}^0\rightarrow \varLambda ^0 \, \gamma \) is described by two complex helicity amplitudes \(H_{\lambda _{\varLambda },\lambda _{\gamma }}\) with \(\lambda _{\varLambda }=\pm 1/2\), \(\lambda _{\gamma }=\pm 1\) referring to the helicity values of the respective particles [34]. To define the angles we consider two Cartesian coordinate systems attached to the rest frames of \(\varLambda _{b}^{0}\) and \(\varLambda ^0\). In the rest frame of \(\varLambda _{b}^{0}\), the \(z_{1}\)-axis is chosen to be parallel to the \(\varLambda ^0_{b}\) polarization direction \(\hat{n}\). The relevant kinematic variables are defined as follows:

  • \(\theta _{\varLambda }\) is the polar angle of the \(\varLambda ^{0}\) momentum relative to \(\hat{n}\) in \(\varLambda _{b}^0\) rest frame, \(0\le \theta _{\varLambda }<\pi \).

  • \(\theta _{p},\phi _{p}\) are the polar and azimuthal angle of the proton momentum defined with respect to the axes \(z_{2}=\overrightarrow{p}_{\varLambda }/\vert \overrightarrow{p}_{\varLambda } \vert \) and \(y_{2}=\hat{n}\times \overrightarrow{p}_{\varLambda }/\vert \hat{n}\times \overrightarrow{p}_{\varLambda } \vert \) in \(\varLambda ^0\) rest frame.

Fig. 1
figure 1

Schematic view of the \(\varLambda _{b}^{0} \rightarrow \varLambda ^0 \,\gamma \) decay

The angular distribution is:

$$\begin{aligned} W(\theta _{\varLambda },\theta _{p}) \propto&\, 1-\alpha _{\varLambda }P_{\varLambda _b} \cos {\theta _p}\cos {\theta _{\varLambda }} \nonumber \\&-\alpha _{\gamma }(\alpha _{\varLambda } \cos {\theta _p}-P_{\varLambda _b}\cos {\theta _{\varLambda }}) \end{aligned}$$
(2)

Here, \(P_{\varLambda _b}\) is the initial \(\varLambda _b\) polarization and \(\alpha _\varLambda \) is the \(\varLambda ^0\) weak decay parameter, defined in Table 1.

2.2 Case study of \(\varXi _{b}^{-} \rightarrow \varXi ^{-} \gamma \)

Assuming an initially polarized sample of \(\varXi _{b}^{-}\) we study the complete angular distribution of \(\varXi _{b}^{-} \rightarrow \varXi ^{-} \gamma \), considering the subsequent decay \(\varXi ^{-} \rightarrow \varLambda ^0 \, \pi ^-\). The \(\varLambda ^0\) further decays to a proton and pion, resulting in a \(p \,\pi ^{-}\,\pi ^{-}\,\gamma \) final state. The transverse polarization of \(\varXi _{b}^-\) is defined as the mean value of \(\varXi _{b}^-\) spin along the unit vector

$$\begin{aligned} \hat{n}=\frac{\overrightarrow{p}_{p}\times \overrightarrow{p}_{\varXi _{b}}}{\vert \overrightarrow{p}_{p}\times \overrightarrow{p}_{\varXi _{b}} \vert }, \end{aligned}$$
(3)

normal to the production plane, where \(\overrightarrow{p}_{p}\) is the counter-clockwise proton beam direction and \( \overrightarrow{p}_{\varXi _{b}}\) the \(\varXi _{b}^-\) momentum. A schematic view of the decay is shown in Fig. 2. The primary decay \(\varXi _{b}^-\rightarrow \varXi ^-\, \gamma \) is described by two complex helicity amplitudes \(H_{\lambda _{\varXi },\lambda _{\gamma }}\) with \(\lambda _{\varXi }=\pm 1/2\), \(\lambda _{\gamma }=\pm 1\) referring to the helicity values of the respective particles. To define the angles we consider three Cartesian coordinate systems attached to the rest frames of \(\varXi _{b}^-\), \(\varXi ^-\) and \(\varLambda ^0\). In the rest frame of \(\varXi _{b}^{-}\), the \(z_{1}\)-axis is chosen to be parallel to the \(\varXi ^{-}_{b}\) polarization direction \(\hat{n}\). Similar to the previous case, the relevant kinematic variables are defined as follows:

  • \(\theta _{\varXi }\) is the polar angle of the \(\varXi ^{-}\) momentum relative to \(\hat{n}\) in \(\varXi _{b}^{-}\) rest frame, \(0\le \theta _{\varXi }<\pi \).

  • \(\theta _{\varLambda },\phi _{\varLambda }\) are the polar and azimuthal angle of the \(\varLambda ^0\) momentum defined with respect to the axes \(z_{2}=\overrightarrow{p}_{\varXi }/\vert \overrightarrow{p}_{\varXi } \vert \) and \(y_{2}=\hat{n}\times \overrightarrow{p}_{\varXi }/\vert \hat{n}\times \overrightarrow{p}_{\varXi } \vert \) in \(\varXi \) rest frame.

  • \(\theta _{p},\phi _{p}\) are the polar and azimuthal angle of the proton momentum defined with respect to the axes \(z_{3}=\overrightarrow{p}_{\varLambda }/\vert \overrightarrow{p}_{\varLambda } \vert \) and \(y_{3}=\hat{n}\times \overrightarrow{p}_{\varLambda }/\vert \hat{n}\times \overrightarrow{p}_{\varLambda } \vert \) in \(\varLambda ^0\) rest frame.

Table 1 Definition and measured values of the decay parameters and photon polarization used in Eqs. (2) and  (4)
Fig. 2
figure 2

Schematic view of the \(\varXi _b^{-} \rightarrow \varXi ^{-} \gamma \) decay

The complete angular distribution reads,

$$\begin{aligned}&W(\eta ,\theta _{\varLambda },\theta _{p},\theta _{\varXi })\propto 1+ \alpha _{\varLambda }\alpha _{\varXi }\cos \theta _{p} +\alpha _{\gamma }\alpha _{\varXi }\cos \theta _{\varLambda } \nonumber \\&\quad +\alpha _{\varLambda }\alpha _{\gamma }\cos \theta _{p} \cos \theta _{\varLambda }-2 \alpha _{\varLambda }\alpha _{\gamma } {\mathrm{Re}}(e^{i\eta }z_{\varXi })\sin \theta _{p} \sin \theta _{\varLambda } \nonumber \\&\quad - P_{\varXi _{b}}\alpha _{\varXi }\cos \theta _{\varXi } \cos \theta _{\varLambda } {-}P_{\varXi _{b}}\alpha _{\gamma }\cos \theta _{\varXi } \\&\quad -P_{\varXi _{b}}\alpha _{\varXi }\alpha _{\varLambda }\alpha _{\gamma }\cos \theta _{\varXi } \cos \theta _{p} -P_{\varXi _{b}}\alpha _{\varLambda }\cos \theta _{\varXi } \cos \theta _{\varLambda } \cos \theta _{p} \nonumber \\ {}&\quad +2 \alpha _{\varLambda } P_{\varXi _{b}} {\mathrm{Re}}(e^{i\eta }z_{\varXi })\cos \theta _{\varXi } \sin \theta _{p} \sin \theta _{\varLambda }, \nonumber \end{aligned}$$
(4)

where \(\eta =\phi _{\varLambda }-\phi _{p}\), and the \(\varXi _{b}^-\) polarization matrix \(\rho _{\scriptscriptstyle \lambda _{\scriptscriptstyle \varXi _{b}},\scriptscriptstyle \lambda _{\scriptscriptstyle \varXi _{b}}^{\prime } }\) is defined as \(\rho _{\scriptscriptstyle \frac{1}{2},\scriptscriptstyle \frac{1}{2}}+\rho _{-\scriptscriptstyle \frac{1}{2},-\scriptscriptstyle \frac{1}{2}}=1\) and \(\text {Tr}[\rho \hat{n}]= (\rho _{\scriptscriptstyle \frac{1}{2},\scriptscriptstyle \frac{1}{2}}-\rho _{-\scriptscriptstyle \frac{1}{2},-\scriptscriptstyle \frac{1}{2}})\, \hat{z}=P_{\varXi _{b}}\, \hat{z} \), with the off-diagonal entries averaging out to zero in absence of correlation between production and decay mechanisms. Here \(P_{\varXi _b}\) is the initial \(\varXi _b^-\) polarization, and \(\alpha _{\varXi }\) is the \(\varXi ^-\) weak decay parameter. The complete expressions of decay parameters and their values are summarized in Table 1.

3 Experimental prospects at the LHCb experiment

The potential to measure the photon and b-baryon polarization at LHCb through the angular distribution of b-baryon decays can be studied using fast Monte Carlo simulation method. The expected sensitivity as a function of the values of the \(\alpha _\gamma \), \(P_{\varLambda _b}\) and \(P_{\varXi _b}\) parameters, and depending on the number of reconstructed events, is determined. Effects due to the angular acceptance and resolution, coming from the event reconstruction, are included in the simulations. The impact of the amount and shape of the possible background is also studied. Results are detailed along this section. Since the expected number of events depend on the b-hadron production fractions in proton-proton collisions at the LHC energy, a summary of the present status is discussed below.

3.1 b-baryon fragmentation fractions

There are various processes through which a b quark can be produced in LHC. The b quark can then combine with a light diquark to produce a b-baryon. The probability of a b-quark fragment into a baryon is given by the fragmentation fraction (\(f_{B}\)). It is customary to express the fragmentation fraction [29, 36,37,38] for a specific b-baryon as

$$\begin{aligned} R_{B}=\frac{f_{B}}{f_{i}+f_{j}}, \end{aligned}$$
(5)

where \((f_{i}, \,f_{j})\) are: \((f_{u},\,f_{d})\) for \(B=\varLambda _{b}^{0}\), \((f_{u},\,f_{s})\) for \(B=\varXi _{b}^{0}\), \((f_{d},\,f_{s})\) for \(B=\varXi _{b}^{-}\) and \(f_{u,d,s}\equiv {{\mathcal {B}}}(b\rightarrow B^{-},\, {\bar{B}}^{0}, \, {\bar{B}}^{0}_{s})\). \(R_{B}\) is experimentally measured [39, 40] and along with the knowledge of \(f_{u,s,d}\) one can estimate \(f_{B}\) [36, 41, 42]. It is important to note that \(f_{\varLambda _{b}}/(f_{u}+f_{d})\) has a dependence on \(p_{\mathrm{{T}}}\) of the final state particles [36, 39, 43]. Latest results from LHCb yields [39]

$$\begin{aligned} \frac{ f_{\varLambda _{b}}}{f_{u}+f_{d}}= 0.404\pm 0.017\pm 0.027\pm 0.105. \end{aligned}$$
(6)

Recently LHCb has measured the fragmentation fraction of a b quark hadronizing into a \(\varXi _{b}^{-}\) (\(f_{\varXi _{b}^{-}}\)) with respect to fragmentation fraction of a b quark hadronizing into a \(\varLambda _{b}\) (\(f_{\varLambda _{b}}\)), using the \(\varXi _{b}^{-}\rightarrow \varXi ^{-} J/\psi \) and \(\varLambda _{b}\rightarrow \varLambda J/\psi \) decay modes [44,45,46].

Using the data samples collected at \(\sqrt{s}=7,\, 8, \,\text {and}\, 13\) TeV to measure the ratio of production rates of \(\varXi _{b}^{-}\) to \(\varLambda _{b}^0\) , with pseudorapidity and \(p_{T}\) in the range \(2\le \eta \le 6\), \(p_{T}\le \;20 \text {GeV}/c\), LHCb measured the following values:

$$\begin{aligned}&\frac{f_{\varXi _{b}^{-}}}{f_{\varLambda _{b}}}=(6.7 \pm 2.1)\times 10^{-2} \quad \nonumber [\sqrt{s}={7\;{\mathrm{and}} \, 8\text { TeV}}],\\&\frac{f_{\varXi _{b}^{-}}}{f_{\varLambda _{b}}}=(8.2\pm 2.6)\times 10^{-2} \quad [\sqrt{s}=\text {13 TeV}]. \end{aligned}$$
(7)

In these results the uncertainty is dominated by the departure from the SU(3) relation \(\varGamma (\varXi _{b}^{-} \rightarrow \varXi ^{-} \, J/\psi ) = \frac{2}{3} \) \(\varGamma (\varLambda _{b}^{0} \rightarrow \varLambda ^0 \, J/\psi )\), coming from SU(3) breaking of the order of 30% [44].

The fraction of b-baryon species produced in proton proton collisions at \(\sqrt{s} \)=1.96 TeV is about \(22\%\) [35]. Assuming that this proportion remains constant at \(\sqrt{s}\) = 13 TeV, and that the total cross section \(\sigma ( \mathrm{pp}\rightarrow b{{{\bar{b}}}} X)\) is \(\approx \;600~\mathrm{\mu b}\) [42], we get the values \(\sigma ( \mathrm{pp}\rightarrow \varLambda _b)^{13 \mathrm{TeV}} \sim 117\; \mathrm{\mu b}\) and \(\sigma ( \mathrm{pp}\rightarrow \varXi _b)^{13 \mathrm{TeV}} \sim 12\; \mathrm{\mu b} \). In this estimation the \(\varOmega _b^-\) contribution is taken to be about \(10\%\) of the \(\varXi _b^-\). These values are inside the range of the predictions by several Monte Carlo generators, as shown in Fig. 3.

Fig. 3
figure 3

b-hadron production fractions at LHC extracted from several physics generators: Sherpa  [47], Pythia  [48] and Herdwig  [49]. In the case of Sherpa \(\hbox {HBE} = 1\) the Heavy Baryon Enhancement parameter (HBE) is set to one to improve the modelling of heavy quark hadronization

3.2 Fit procedure

An unbinned maximum likelihood fit is used to determine the photon and b-baryon polarization. The angular distribution for \(\varLambda _{b}^{0}\) in Sect. 2.1 allows to extract the photon polarization fixing the \(\varLambda _{b}^{0}\) polarization, or extracting both parameters at the same time. Thus, Eq. (2) is used for obtaining these two polarizations simultaneously. The dependence on the initial b-baryon polarization can be eliminated by integrating out the \(\cos \theta _\varLambda \) in Eq. (2) obtaining:

$$\begin{aligned} W(\theta _{p}) \propto 1-\alpha _{\gamma }\alpha _{\varLambda } \cos {\theta _p}. \end{aligned}$$
(8)

In the case of \(\varXi _b^-\) angular distribution of Sect. 2.2, it is possible to integrate out the azimuthal angle \(\eta \) in Eq. (4). This removes the dependence on the unknown \(z_\varXi \) parameter:

$$\begin{aligned}&W(\theta _{\varLambda },\theta _{p},\theta _{\varXi })\propto 1+ \alpha _{\varLambda }\alpha _{\varXi }\cos \theta _{p} +\alpha _{\gamma }\alpha _{\varXi }\cos \theta _{\varLambda } \nonumber \\&\quad +\alpha _{\varLambda }\alpha _{\gamma }\cos \theta _{p} \cos \theta _{\varLambda } - P_{\varXi _{b}}\alpha _{\varXi }\cos \theta _{\varXi } \cos \theta _{\varLambda } \nonumber \\&\quad -P_{\varXi _{b}}\alpha _{\gamma }\cos \theta _{\varXi } -P_{\varXi _{b}}\alpha _{\varXi }\alpha _{\varLambda }\alpha _{\gamma }\cos \theta _{\varXi } \cos \theta _{p} \\&\quad -P_{\varXi _{b}}\alpha _{\varLambda }\cos \theta _{\varXi } \cos \theta _{\varLambda } \cos \theta _{p}. \nonumber \end{aligned}$$
(9)

This expression is used in the fit to extract the photon and \(\varXi _b^-\) polarization simultaneously. Integrating out the \(\cos \theta _\varXi \) angle in Eq. (9), the dependence with the b-baryon polarization can also be removed:

$$\begin{aligned} W(\theta _{\varLambda },\theta _{p})&\propto 1+ \alpha _{\varLambda }\alpha _{\varXi }\cos \theta _{p} +\alpha _{\gamma }\alpha _{\varXi }\cos \theta _{\varLambda } \nonumber \\&\quad +\alpha _{\varLambda }\alpha _{\gamma }\cos \theta _{p} \cos \theta _{\varLambda }. \end{aligned}$$
(10)

In order to validate the fit procedure, to check consistency between pseudo-experiments and to detect possible biases in the distribution of the fitted parameters, pull distributions, defined as the difference between the fitted and generated values, divided by the uncertainty from the fit, are determined. It is found that there is no bias in the fit and the pull distributions are correct.

3.3 Measurement of \(\alpha _\gamma \), \(P_{\varLambda _{b}}\) and \(P_{\varXi _{b}}\)

To understand the correlation of the value of the \(\alpha _\gamma \) parameter and its uncertainty, a large number of pseudo-experiments of 1000 events each are generated according to Eqs. (2) and (4) for the \(\varLambda _{b}^{0}\) and \(\varXi _b^-\) decay channels respectively. The generated value of \(\alpha _\gamma \) is varied in this study between − 1.0 and + 1.0 and the angular distribution is fitted for each case. The results of the fits are shown in Fig. 4a. A small dependence with the value of the photon polarization is observed for both channels, with maximum sensitivity at larger slopes, + 1 and − 1 values of the \(\alpha _\gamma \) parameter. The sensitivity for the \(\varLambda _{b}^{0} \rightarrow \varLambda ^0 \,\gamma \) decay channel is found to be slightly better (about 15%) as compared to the \(\varXi _b^- \rightarrow \varXi ^- \, \gamma \) channel. This is coming from the larger absolute value of the weak decay parameter, \(\alpha _\varLambda \), compared to the \(\alpha _\varXi \) parameter (see Eqs. (8) and (10)). Figure 4b shows the expected sensitivity to the \(\alpha _\gamma \) parameter as function of the reconstructed number of events for both channels. Pseudo-experiments with samples ranging between 100 and 4000 events are generated in this study with the Standard Model expectation of \(\alpha _\gamma \)= 1. The results show that the photon polarization can be potentially measured with less than 10% uncertainty with the reconstruction of about 1000 radiative b-baryon events.

Fig. 4
figure 4

a Sensitivity to the photon polarization parameter as function of its value for the \(\varLambda _b^0\) and \(\varXi _b^-\) decay channels. Dots with errors correspond to the fit results. A second order polynomial is superimposed for better visualization. b Statistical sensitivity of the photon polarization as function of the reconstructed number of events for the \(\varLambda _b^0\) and \(\varXi _b^-\) cases. In this case was fitted to a function \(1/\sqrt{x}\)

Table 2 Expected signal yield for \(\varLambda _b^{0} \rightarrow \varLambda ^{0} \gamma \) and \(\varXi _b^{-} \rightarrow \varXi ^{-} \gamma \) decay channels

In Table 2 the expected number of events for the different run periods at LHCb are estimated. Numbers are obtained according to the production fractions of the different b-baryon species (see Sect. 3.1) and assuming that the branching fraction for radiative b-baryon decays is about \(10^{-5}\) [50], in agreement with recent [51] LHCb results. A reconstruction efficiency of order \(10^{-4}\) is considered. This estimation is obtained by scaling the reconstruction efficiency for radiative B meson decays in [15] by a factor of 1/100. This assumption takes into account that the trigger and reconstruction algorithms at LHCb are less efficient for long living particles [52]. Besides, one expects the need of tighter selection criteria to suppress the large amount of combinatorial background expected from prompt \(\varLambda ^0\)’s and random photons.

Since the angular distribution of radiative b-baryon decays is also sensitive to the initial b-baryon polarization (see Eqs. (2) and (9)), one can extract \(P_{\varLambda _{b}}\) and \(P_{\varXi _{b}}\) values together with the photon polarization. Pseudo-experiments with 1000 events each are performed in this study using several values of the \(\varLambda _{b}^0\) and \(\varXi _{b}^-\) polarization, fitting simultaneously \(\alpha _\gamma \) and \(P_{\varLambda _{b}}\), for the \(\varLambda _{b}^{0} \rightarrow \varLambda ^0 \, \gamma \) decay channel, and \(\alpha _\gamma \) and \(P_{\varXi _b}\) for the \(\varXi _{b}^{-} \rightarrow \varXi ^{-}\, \gamma \) decay channel. Since the \(P_{\varXi _{b}}\) in hadron collisions is expected to be similar to the polarization of the \(\varLambda _b\), which has been measured in [53], a maximum polarization of \(10\%\) for the initial b-baryon polarization is considered in the generation for both channels. The results of the achieved sensitivity for the \(\alpha _\gamma \) and \(P_{\varLambda _{b}}\) or \(P_{\varXi _{b}}\) parameters as a function of its value is shown in Fig. 5.

Fig. 5
figure 5

a Sensitivity to the photon polarization as function of its value for different assumptions of the initial \(\varXi _b^-\) polarization. The black line corresponds to the fit of Eq. (10), which does not include the polar angle of the \(\varXi ^-\) momentum relative the normal vector to the production plane, while the other line correspond to the the fit of Eq. (9). Similar results are obtained for the \(\varLambda _b^0\) polarization. b Sensitivity to the \({\varXi _b^-}\) polarization as function of its value for \(\varXi _b^-\) for different values of \(\alpha _\gamma \) using Eq. (9). c Sensitivity to the \({\varLambda _b^0}\) polarization as function of its value for \(\varLambda _b^0\) for different values of \(\alpha _\gamma \) using Eq. (9). In these figures dots with errors correspond to the fit results. A second order polynomial is superimposed for better visualization

As it can be seen in Fig. 5b, the sensitivity to the \(\alpha _\gamma \) parameter is not affected by the measurement of the \(\varXi _{b}^{-}\) polarization in the simultaneous fit, given enough statistics. This is also true for the same study with the \(\varLambda _{b}^{0}\) polarization. In addition, the value of the \(\varLambda _{b}^{0}\) and \(\varXi _{b}^{-}\) polarization parameters can be extracted with good accuracy independently of its value, with improved precision as the photon polarization approaches the SM value.

3.4 Event reconstruction and background effects

To include the effect of the signal event reconstruction and background sources the angular distribution in Eqs. (8) and  (10) is modified. The signal probability density distribution is affected by an angular acceptance, \({{\mathcal {A}}}(\theta _\varLambda , \theta _{p})\), and a resolution function, \({{\mathcal {R}}}(\theta _\varLambda , \theta _{p}; \theta _\varLambda ', \theta '_{p} )\). Additionally, background sources with different angular shapes \(f_{B}\) and signal to background rate (S / B) are also considered in the fitting procedure. The angular distributions of the \(\varLambda _b^0\) and \(\varXi _b^-\) decay channels are modified:

$$\begin{aligned} \varGamma (\theta '_\varLambda , \theta '_{p}; \alpha _\gamma )= & {} \Big (f_{S}(\theta _\varLambda , \theta _{p}; \alpha _\gamma ) \times {{\mathcal {A}}}(\theta _\varLambda , \theta _{p}) \Big ) \\&*{{\mathcal {R}}}(\theta _\varLambda , \theta _{p}; \theta '_\varLambda , \theta '_{p}) + \frac{S}{B}\big (f_{B}(\theta _\varLambda , \theta _{p})\big ) \end{aligned}$$

The LHCb detector has been described elsewhere [54, 55]. The resolution of the proton and \(\varLambda ^0\) polar angles are expected to be worse if the \(\varLambda ^0\) particle decays after the first LHCb tracker, since the vertex and momentum resolutions degrade. If the information of the LHCb VELO detector is not included in the reconstruction of the proton and pion candidates, named downstream track category, the angular resolution can be as large as 90 mrad [56]. Since \(\varLambda ^0\) particles have a long lifetime, most of the events are expected in this category. No bias in the mean of the angular resolution is expected. For tracks which are reconstructed including the information of the VELO detector, named long track category, the angular resolution is expected to be better. Monte Carlo simulations are performed using angular resolutions from 30 to 90 mrad. Since the angular distributions are quite smooth the resolution is expected to have a negligible effect. Figure 6 shows the effect of the resolution and angular acceptance for the \(\varLambda _{b}^{0}\) and \(\varXi _{b}^{-}\) cases.

Fig. 6
figure 6

a Sensitivity to the photon polarization as function of its value for \(\varLambda _{b}^{0}\) (a) and \(\varXi _b^-\) (b) cases including angular resolution and acceptance effects. Dots with errors corresponds to the fit results. A second order polynomial is superimposed for better visualization

The angular acceptance is expected to be due to trigger and reconstruction selection criteria. The dominant source of bias is expected to come from pion momentum requirements, affecting the proton and \(\varLambda ^0\) angles in an asymmetric way. Following the results obtained in [30] for the proton angle, a third order polynomial function is implemented for the acceptance. Pseudo-experiments are generated using this function. Results of the fits, including the acceptance, are shown in Fig. 6. An important effect on the sensitivity to the photon polarization is observed, which will have to be controlled using data control samples. For the case of the \(\varXi _b^-\) small correlation between the proton and \(\varLambda ^0\) angles is expected.

One of the most important challenges when reconstructing radiative b-baryon decays is expected to be the background suppression. Since strange b-baryons have large lifetimes, and photons are involved in the decays, making a vertex fit from the b-baryon decay products is not possible. A large amount of combinatorial background is then expected from random photons and prompt \(\varLambda ^0\) particles. In this study a background source is considered and a large number of pseudo-experiments is generated and fitted considering different signal (S) to background (B) rates, as well as different shapes for the angular distribution of the background. The signal samples are of 1000 events each, and the amount of events in the background sample are varied. A flat, signal-like and a second order polynomial are tested for the angular distribution of the background. The samples are generated with SM values of the photon polarization parameter, \(\alpha _\gamma = 1\). Fig. 7 shows the results of the fit of the pseudo-experiments.

Fig. 7
figure 7

Sensitivity to the photon polarization as function of the signal over background ratio for \(\varLambda _b^{0}\) (a) and \(\varXi _b^-\) (b) including background effects. Dots with errors corresponds to the fit results. A function \(A + B/\sqrt{x}\) is superimposed for better visualization

As it can be observed, the shape of the background is not so relevant as the background rejection capability. An important S/B rate is necessary in order to measure the photon polarization with an accuracy below \(10\%\). To achieve this, multivariate analysis techniques will be crucial, in particular for rejecting the large amount of the expected combinatorial background.

3.5 Discussion of results

Assuming that the LHCb detector can reconstruct about 900 \(\varLambda _b^0 \rightarrow \varLambda ^0 \, \gamma \) events with the data of the Run II, and that systematic uncertainties can be controlled to the same order of the statistical uncertainty, a sensitivity of about 0.15 could be achieved for the photon polarization parameter \(\alpha _\gamma \). The \(\varLambda _b^0\) polarization can also be measured with a precision better than \(10\%\), the sensitivity depending on the value of the photon polarization.

The measurement for the \(\varXi _b^- \rightarrow \varXi ^- \, \gamma \) decay channel is more challenging and will need more data to reach the same sensitivity but it is a promising channel for Run III and beyond. It has the advantage of an additional track coming from the \(\varXi ^-\) (\(\rightarrow \varLambda ^0 \, \pi ^-\)) and the possibility to reconstruct the charged \(\varXi ^-\) baryon. If systematic uncertainties are controlled at the order of the statistical uncertainty, a sensitivity of around 0.2 could be achieved. This channel also offers the possibility to measure the \(\varXi _b^-\) polarization, which is unknown at present. The experimental angular resolution is found to have a negligible effect on the measurement of the photon polarization. In contrast, the effect of the angular acceptance due to the event reconstruction is found to be important and needs to be controlled from data.

The crucial task in these analyses is expected to be the background suppression. A signal-to-background rate less than one is needed to obtain a good precision in the photon polarization.

Estimations in Table 2 for the LHCb Run III do not assume any improvement of the LHCb detector, which is far from reality. In the next LHC run, from 2020-2023, in addition to upgrade its tracking and vertexing systems, the LHCb experiment will exploit a novel trigger concept where all subdetectors are read out in real time and the first level trigger is fully software implemented. Track momenta resolution will improve by 10–20% [57, 58]. For long living particles such as strange baryons, the efficiency is expected to increase at least by 10% using dedicated reconstruction algorithms [52], and could still be much larger with the improvement of the software trigger.

3.6 Normalization channel

A data-driven measurement of radiative b-baryon decays require the use of control and normalization decay modes. The \(\varLambda _{b}^{0} \rightarrow \varLambda ^0 \, J/\psi \) \( (\rightarrow \mu ^+\,\mu ^-)\) and \(\varXi _{b}^{-} \rightarrow \varXi ^- \,J/\psi (\rightarrow \mu ^+\,\mu ^-)\) are chosen as the preferred modes of normalization for the \(\varLambda _{b}^0 \rightarrow \varLambda ^0 \, \gamma \) and \(\varXi _{b}^- \rightarrow \varXi ^- \, \gamma \) channels, respectively. The advantage of this choice is that most of the systematic uncertainties coming from the track reconstruction of b-baryons cancel when the ratio of rates are considered. Also the fragmentation fractions, which have at present large uncertainties (see Sect. 3.1), cancel. The relative number of events of the radiative and di-muonic channels is then:

$$\begin{aligned}&\frac{N_{\varLambda _{b}^0\rightarrow \varLambda ^0 \, \gamma }}{N_{\varLambda _{b}^{0}\rightarrow \varLambda ^0 \, J/\psi }} \\&\qquad = \frac{\mathcal {B} (\varLambda _{b}^0 \rightarrow \varLambda ^0 \,\gamma ) \, \epsilon _{\varLambda ^0 \, \gamma } }{\mathcal {B} (\varLambda _{b}^0 \rightarrow \varLambda ^0 \, J/\psi ) \mathcal {B}(J/\psi \rightarrow \mu ^{+}\, \mu ^{-}) \,\epsilon _{\varLambda ^0\, J/\psi }}, \end{aligned}$$

assuming the same luminosity for both channels, and taking into account that \(f_{\varLambda _{b}}\), and \(\mathcal {B}(\varLambda ^0\rightarrow p\,\pi ^-)\) cancel in this ratio. \(\epsilon _{\varLambda ^0 \, \gamma }\) and \(\epsilon _{\varLambda ^0 \, J/\psi }\) are the remaining efficiencies which are different for both channels, coming mainly from photon and muon reconstruction. In a similar way:

$$\begin{aligned}&\frac{N_{\varXi _{b}^{-}\rightarrow \varXi ^{-} \gamma }}{N_{\varXi _{b}^{-} \rightarrow \varXi ^- J/\psi }} \\&\qquad = \frac{\mathcal {B}(\varXi _{b}^-\rightarrow \varXi ^- \gamma ) \, \epsilon _{\varXi ^- \gamma }}{\mathcal {B}(\varXi _{b}^-\rightarrow \varXi ^- J/\psi )\mathcal {B}(J/\psi \rightarrow \mu ^{+} \mu ^{-}) \, \epsilon _{\varXi ^- J/\psi }}, \end{aligned}$$

where again same luminosity for both channels is assumed, and \(f_{\varXi _{b}}\), \(\mathcal {B}(\varXi ^-\rightarrow \varLambda ^0 \, \pi ^-)\) and \(\mathcal {B}(\varLambda ^0 \rightarrow p \, \pi ^-)\) cancel. \(\epsilon _{\varXi ^- \,\gamma }\) and \(\epsilon _{\varXi ^- \, J/\psi }\) are the remaining efficiencies which are different for both channels. Note that no attempt is made to measure the angular distribution of di-muonic channels.

An alternative decay channel for normalization is the \(B^0\rightarrow K^{*0} \, \gamma \), which has larger efficiency but is also affected by larger amount of background. In this case the systematic uncertainty due to the photon reconstruction cancels.

4 New physics constraints

The process \(b \rightarrow s \gamma \), at the leading order in \(\alpha _{s}\), gets contribution from dimension six electromagnetic dipole operators:

$$\begin{aligned} O_{7}^{(\prime )}\,=(em_{b})/(16\pi ^2){\bar{s}}\sigma ^{\alpha \beta }P_{R(L)}b\, F_{\alpha \beta } \end{aligned}$$

corresponding to the emission of a left (L) or right (R) handed photon respectively. The small s-quark mass has been ignored in \(O_{7}^{(\prime )}\) and \(P_{R,L}\) are defined as \(P_{R,L}=(1\pm \gamma _{5})/2\). The Hamiltonian corresponding to the decay is given by

$$\begin{aligned} \mathcal {H}_{eff}= \frac{-4 G_{F}\,V_{tb}V_{ts}^{*}}{\sqrt{2}}(C_{7}O_{7}+C_{7}^{'}O_{7}^{'})~, \end{aligned}$$
(11)

where \(C_{7}^{(\prime )}\) are the Wilson coefficients [17] describing the short distance contributions, \(V_{tb}\) and \(V_{ts}\) are the relevant Cabibbo–Kobayashi–Maskawa (CKM) matrix elements for the transition, and \(G_{F}\) is the Fermi constant. The polarization asymmetry \(\alpha _\gamma \) in Table 1 can be thus defined as

$$\begin{aligned} \alpha _{\gamma }=\frac{\varGamma (\lambda _{\gamma }=L)-\varGamma (\lambda _{\gamma }=R)}{\varGamma (\lambda _{\gamma }=L)+\varGamma (\lambda _{\gamma }=R)}, \end{aligned}$$
(12)

Within SM the contribution to right-handed photons is suppressed by the ratio \(r=\frac{C_{7}^{'}}{C_{7}}\simeq \frac{m_{s}}{m_{b}}\), resulting in

$$\begin{aligned} \alpha _\gamma =\frac{1-\vert r \vert ^{2}}{1+\vert r \vert ^{2}}\simeq 1. \end{aligned}$$
(13)

However, various new physics (NP) scenarios as well as long distance effects within the SM can result in new contributions to the \(C_{7}^{'}\) causing a departure from the SM value [59]. Long distance contribution has been estimated to be small and of the order of 5% [17]. Thus, any significant deviation of the measured value of \(\alpha _{\gamma }\) from unity could indicate the presence of NP contributions to the Wilson coefficient \(C_7^{\prime }\). In general \(C_7^{\prime }\) can have both real and imaginary contributions. There are, however, already constraints on \(C_7^{\prime }\) using other measurements like \(A_\text {CP}\), the direct CP asymmetry, S, the mixing-induced CP asymmetry and \(A_{\Delta \varGamma }\), the mass-eigenstate rate asymmetry from the decays of neutral \(B_d\) and \(B_s\) mesons to CP eigenstates, for example in \(B_s\rightarrow \phi \, \gamma \) or \(B^0\rightarrow K^*(\rightarrow K_S\, \pi ^0)\, \gamma \) decays. In Fig. 8, the constraints in the \(C_7^{\prime }\) plane from measurements of \(A^{\Delta \varGamma }(B_s\rightarrow \phi \, \gamma )\), the inclusive branching ratio \(Br(B\rightarrow X_s\, \gamma )\) , \(S(B\rightarrow K^*\, \gamma )\) and angular asymmetries of \(B\rightarrow K^*\,e^+\,e^-\) are shown. The constraint for an estimate of \(\alpha _{\gamma }=1.0 \pm 0.15\) is also plotted. With the expected sensitivity of \(\alpha _{\gamma }\) it is clear that this measurement provides competitive constraints on new physics in comparison to the existing measurements using B mesons.

Fig. 8
figure 8

New Physics constraints on \(\text {Re}(C_7')-\text {Im}(C_7')\) using flavio [59, 60]. \(A_{\phi \gamma }^{\Delta \varGamma }\) in blue, \(S_{K^* \gamma }\) in violet, \(\alpha _\gamma \) (assuming a value of \(\alpha _\gamma = 1.0 \pm 0.15\)) in orange, the inclusive radiative branching ratio in yellow, the angular study of \(B\rightarrow K^* \,e^+\,e^-\) in purple and the combination of all this measurement except for the \(\alpha _\gamma \) one in green. Besides, the SM value is marked with a star

5 Conclusions

The flavour-changing GIM suppressed processes involving \(b\rightarrow s \gamma \) transitions are known to be excellent probes of physics beyond the Standard Model. In that context, we analyze the decays \(\varLambda _{b}^{0}\rightarrow \varLambda ^{0} \,\gamma \) and \(\varXi _b^{-} \rightarrow \varXi ^{-} \gamma \) undergoing the same transition. By exploiting the spin correlations in radiative decays of b-baryons we demonstrate that they offer a convenient method for direct measurement of the photon polarization asymmetry \(\alpha _{\gamma }\) along with a measurement of the initial b-baryon polarization. We presented expressions for the complete angular distribution of the decay chains \(\varLambda _{b}^{0}\rightarrow \varLambda ^0 \,\gamma \) and \(\varXi _{b}^-\rightarrow \varXi ^-(\rightarrow \varLambda ^0\,\pi ^-)\,\gamma \), with the \(\varLambda ^0\) decaying into \(p\, \pi ^-\), expressed as a function of \(\alpha _{\gamma }\), the photon polarization, \(P_b\), the initial b-baryon polarization and known decay asymmetry parameters of intermediate baryons. We then explored the potential of joint measurement of the photon and b-baryon polarization at LHCb through the angular distribution study of b-baryon decays using Monte Carlo simulations. We find that with the expected yield from the LHC Run II a sensitivity of about 0.15 is achievable for the photon polarization along with a measurement of \(\varLambda _{b}^{0}\) polarization with a precision better than 10%. Despite of the challenges in \(\varXi _{b}^{-}\) due to scarcity of data, even Run II allows a sensitivity of the order of 0.2 to be achieved for \(\alpha _{\gamma }\) along with a first time measurement of \(P_{\varXi _{b}}\). With higher yields, achievable in subsequent runs of the Large Hadron Collider, the photon polarization measurement using b-baryons will play a pivotal role in constraining different new physics scenarios.