β\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\upbeta $$\end{document}-Decay spectrum, response function and statistical model for neutrino mass measurements with the KATRIN experiment

The objective of the Karlsruhe Tritium Neutrino (KATRIN) experiment is to determine the effective electron neutrino mass m(νe)\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$m(\upnu _\text {e})$$\end{document} with an unprecedented sensitivity of 0.2eV/c2\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$0.2 \hbox {eV}/\hbox {c}^2$$\end{document} (90%C.L.\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$90 \%\,\hbox {C.L.}$$\end{document}) by precision electron spectroscopy close to the endpoint of the β\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\upbeta $$\end{document}-decay of tritium. We present a consistent theoretical description of the β\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\upbeta $$\end{document}-electron energy spectrum in the endpoint region, an accurate model of the apparatus response function, and the statistical approaches suited to interpret and analyze tritium β\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\upbeta $$\end{document}-decay data observed with KATRIN with the envisaged precision. In addition to providing detailed analytical expressions for all formulae used in the presented model framework with the necessary detail of derivation, we discuss and quantify the impact of theoretical and experimental corrections on the measured m(νe)\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$m(\upnu _\text {e})$$\end{document}. Finally, we outline the statistical methods for parameter inference and the construction of confidence intervals that are appropriate for a neutrino mass measurement with KATRIN. In this context, we briefly discuss the choice of the β\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\upbeta $$\end{document}-energy analysis interval and the distribution of measuring time within that range.

While neutrino oscillation experiments [1,2,3] have provided unambiguous evidence of non-zero neutrino masses, the absolute neutrino mass scale remains an open question.The primary objective of the Karlsruhe Tritium Neutrino (KATRIN) experiment is to probe this scale in a direct kinematic measurement at an unprecedented sensitivity of 0.2 eV/c 2 (90 % C.L.) [4].
The measurement principle is based on a shape analysis of the tritium β-decay spectrum by high precision electron spectroscopy.A non-zero neutrino mass will cause a distortion in the observed spectrum, which is most pronounced close to the endpoint energy of 18.6 keV.This technique has been successfully established by the direct neutrino mass experiments in Mainz and Troitsk, which place the most stringent direct upper limit on the effective electron neutrino mass [5,6,7,8]: Improving this limit in m(ν e ) by a factor of 10 demands an enhancement in statistical and systematic precision of the effective observable m 2 (ν e ) by a factor of 100.This requires both an in-depth understanding of the theoretical electron β-decay spectrum and an accurate knowledge of the experimental response in measuring the spectral shape.In section 3 we explain the KATRIN setup in more detail.
It is the goal of this work to provide a complete and up-to-date model of the experiment, such that it can be used as either a prescription or reference for upcoming analyses of tritium β-decay data observed with KATRIN.For established aspects of this model, we refer to the appropriate publications.For those not yet published at all or not in the required detail, we provide the necessary derivations.The later will mostly be the case for the description of the experimental response function, which has been considerably refined during recent commissioning phases.
In this work we first present a detailed account of the theoretical β spectrum of tritium, with an emphasis on molecular effects in T 2 (section 2).We then outline the experimental configuration of KATRIN (section 3), before we elaborate on the individual characteristics that define the response of our instrument in section 4. The statistical techniques suited to determine the effective neutrino mass from a fit of the modeled β spectrum to the measured data are treated in section 5.A summary of this work is given in section 6.
Throughout this article we use natural units (c = = 1) for better readability, except for sections 4.7 and 4.8 where we use SI units instead.

Theoretical description of the differential β-decay spectrum
In this section we compile a comprehensive analytical description of the differential β-decay spectrum, with specific focus on gaseous molecular tritium T 2 , the β emitter used by KATRIN.We will also evaluate the relevance of various theoretical correction terms on the neutrino mass analysis.
In the following, we use the shorthand notation m ν = m(ν e ) for better readability.Furthermore, we assume there is no difference between the masses of the neutrinos and the anti-neutrinos, i.e. m ν = m(ν e ) = m(ν e ).
In the β-decay of atomic tritium, the surplus energy Q is shared between the electron's kinetic energy E, the total neutrino energy and the recoil energy E rec of the much heavier daughter nucleus: In the case of a vanishing neutrino mass, the electron spectrum would terminate at the endpoint energy

Fermi theory
The differential decay rate of a tritium nucleus can be described with Fermi's Golden Rule as [9] dΓ The Fermi coupling constant G F is projected onto the (u, d) coupling by the Cabibbo angle θ C with |V ud | = cos θ C = 0.974 25 ± 0.000 22 [8].
For tritium β-decay -a super-allowed transitionthe nuclear transition matrix element M nuc is independent of the electron energy.It can be divided into a vector (Fermi) part and an axial (Gamow-Teller) part with the vector coupling constant g V = 1 and the axial-vector coupling constant defined by g A /g V = −1.2646± 0.0035 in tritium [10].
The classical Fermi function F (Z, E) accounts for the Coulomb interaction between the outgoing electron and the daughter nucleus with atomic charge Z (here Z = 2): with the Sommerfeld parameter η = αZ/β; α is the fine structure constant and β = v/c is the electron velocity relative to speed of light.Here F (Z, E) is written in the non-relativistic approximation; the relativistic F (Z, E) rel and its commonly-used approximation is given in appendix A.1.The full spectrum is an incoherent sum over the three known neutrino mass eigenstates m i (i = 1, 2, 3) with the intensity of each component defined by the squared magnitude of the neutrino mixing matrix elements |U ei | 2 [11].
The phase-space factor of the outgoing electron with momentum p is given by the factor p (E + m e ).The phase space of the emitted neutrino is the product of the neutrino energy = E 0 − E and the neutrino momentum 2 − m 2 i , which determines the shape of the β-electron spectrum near the tritium endpoint E 0 .The Heaviside step function Θ ensures that the kinetic energy cannot become negative.
The full β-decay spectrum is shown in figure 1.The dependence of the spectral shape on the effective neutrino mass close to the endpoint is depicted in figure 2. Electron energy E in eV E 0 Fig. 1: The differential β-electron energy spectrum for the β-decay of molecular tritium with the endpoint energy E 0 of 18.574 keV.The given units correspond to the decay rate of a single tritium nucleus.

Neutrino mass eigenstate splittings
In the KATRIN sensitivity range we can simplify the analysis by considering the effective electron neutrino mass square m 2 ν of a quasi-degenerate model in equation (4), given by an incoherent sum as Electron energy E -E 0 in eV m ν = 0000 meV m ν = 0350 meV m ν = 1000 meV Fig. 2: The differential β-electron energy spectrum near the endpoint for the decay of molecular tritium as given by equation ( 4), under the assumption of various neutrino masses m ν .
Calculations have shown this approximation of the βdecay spectrum to be valid, both for the normal and inverted mass hierarchies [12,13].

Molecular tritium T 2
When we consider the β-decay of gaseous molecular tritium T 2 , the released energy Q has to be corrected for the differences in electronic binding energies between the atomic and actual molecular systems (see [9] for a detailed explanation).The nuclear recoil also excites a spectrum of rotational and vibrational final states in the daughter molecular system, and generates excitations of its electronic shell.The neutrino energy in equation ( 4) has to be corrected by with the endpoint E 0 (T 2 ) = (18 574.00 ± 0.07) eV for molecular tritium [9,14].The recoil energy reaches a maximum of E rec = 1.72 eV at the β-endpoint, which gives a fixed endpoint energy E 0 (T 2 ) = Q(T 2 )−E rec [9].The differential decay rate, with the additional summation over each final state f with energy V f and weighing by the transitional probability P f to a state f in the daughter molecule, is then:

Excited molecular final states
After the decay, the daughter molecular system is left in an excited rotational, vibrational and electronic state.According to theoretical calculations, about 57 % of all T 2 β-decays result in the rovibronically-broadened electronic ground state with an average excitation energy of about 1.7 eV, while the others go to the excited electronic states [17].Each discrete final state effectively branches into its own β spectrum with a distinct endpoint energy.
The accuracy of a neutrino mass measurement critically depends on the knowledge of the distribution of these final states, which have to be taken from theory.Precise calculations of the final state distributions of the hydrogen isotopologues (T 2 → HeT + , DT → HeD + and HT → HeH + ) have been performed in the endpoint region [15,16].The discrete energy states and their transition probabilities have been determined below the dissociation threshold, while continuous distributions are available above the threshold.A comprehensive review of the theory of the tritium final-state spectrum and current validation efforts can be found in [18].
Figure 3 gives a comparison of the final-state distributions of HeT + and HeD + .The differences in their distributions arise from the mass difference; thus, a precise knowledge of the source gas isotopological composition and its stabilization on the 0.1 % level are necessary.Laser Raman spectroscopy [19] provides two important input parameters for our source model: the tritium purity T denoting the fraction of tritium nuclei 1 , and κ denoting the ratio of DT versus HT.
In the calculations provided by [15,16,20], the higher recoil energies of the lighter isotopologues are incorporated into their respective energy spectra that are given relative to the recoil energy of HeT + .That way, the final-state distributions of each isotopologue can be summed and weighted according to its abundance in the source gas.Furthermore, these calculations provide separate distributions for each initial quantum state of molecular angular momentum, denoted by the quantum number J.These must be weighted according to the population of their respective J states before the β-decay, which is given by a Boltzmann distribution where T is the local temperature of the source gas, k B the Boltzmann constant and ∆E J the energy to 1 If we denote the fraction of all hydrogen isotopologues X by c(X) with X c(X) = 1, then the tritium purity is given by the electronic ground state.The rotational degeneracy of the distribution is given by the factor g J = (2J + 1), whereas g s accounts for the spin degeneracy of the nuclei.It is g s = 1 for heteronuclear molecules (DT, HT) without spin coupling.For T 2 as a homonuclear molecule, it is given by the ratio λ of molecules in an ortho (parallel nuclei spins) state or the ratio 1−λ in the para states (anti-parallel nuclei spins).Hence, g s = λ for ortho states with odd J and g s = 1−λ for para states with even J [21].In the KATRIN tritium circulation system the source gas is forced into thermal equilibrium at T = 300 K by a permeator membrane2 , resulting in λ 0.75 [18].

Exact relativistic three-body calculation
The β spectrum formalism outlined above contains approximations to the exact relativistic calculations of the three-body phase space density [22,23].In deriving equation (10), the dependence of the daughter molecule's recoil energy E rec on the neutrino mass m i and the final-state spectrum V f is neglected.This approximation results in a minute shift of the maximum electron energy, which is on the order of 0.1 meV [23], as depicted in figure 4. In the neutrino mass analysis, such a shift in the energy scale is compensated by the external constraint of the endpoint E 0 ; thus, the effective two-body representation of equation ( 10) is an adequate approximation in the energy region of interest (also see table 1).A summary of the energy-dependent, higher-order correction terms is given in section 2.6.

Additional correction terms
In addition to the Fermi function (F (Z, E)) correction factors arising from other nuclear and atomic physics effects must be evaluated and applied multiplicatively.
The formulae and the references to these effects are given in appendix A.1.The following is a synopsis.
-Radiative corrections: In addition to the Coulomb interaction described by F (Z, E), electromagnetic effects involving contributions from virtual and real photons give rise to a correction factor G(E, E 0 ).-Screening: The unscreened F (Z, E), which describes the Coulomb interaction between the daughter nucleus and the departing β-electron, must be corrected by a factor S(Z, E) that accounts for the Electron energy E -E 0 in eV non-relativistic relativistic Fig. 4: Comparison of the differential β-electron energy spectrum of atomic tritium for the full relativistic kinematic treatment and the non-relativistic approximation, assuming a neutrino mass of m ν = 1 eV.
screening effect on the Coulomb field by the 1sorbital electrons left behind by the parent molecule.-Recoil effects: In the relativistic elementary particle treatment of the β-decay (see for instance [24,23]), energy-dependent recoil effects on the order of 1/M can be calculated, with M being the mass of 3 He.These effects -spectrum shape modification due to a three-body phase space, weak magnetism and V −A interference -are typically combined into a common factor R(E, E 0 , M ).-Finite structure of the nucleus: Because the 3 He + daughter nucleus is not a point-like object, the Coulomb field does not scale with an inversesquared relationship within the radius, leading to a correction factor L(Z, E).A proper convolution of the electron and neutrino wave functions with the nucleonic wave function throughout the nuclear volume leads to another factor C(Z, E). -Recoiling Coulomb field: The departing electron does not propagate in the field of a stationary charge, but one which is itself recoiling from the electron emission.This effect introduces another correction factor Q(Z, E, E 0 , M ).-Orbital-electron interactions: A correction factor I(Z, E) is introduced to account for possible quantum mechanical interactions between the departing β-electron and the 1s-orbital electrons.
The differential β spectrum, including all the theoretical correction factors discussed above, can be written as follows: The corrections connected to the recoil of the daughter nucleus, namely R and Q, and the radiative corrections G, depend on the endpoint energy and the phase space of a specific excited final state.This dependency is reflected in equation (12), as these factors are summed over the possible final states.
In figure 5, a graphical overview of these correction factors in the energy interval 30 eV below the tritium endpoint is given.The radiative corrections have the E -E 0 in eV Fig. 5: Theoretical correction factors to the differential β-decay spectrum of T 2 , evaluated in an interval 30 eV below the endpoint E 0 and summed over possible final states.
most significant effect with a pronounced energy dependence, as they deplete the spectrum completely towards the endpoint.Most other corrections are negligible in the neutrino mass analysis, as further detailed in section 4.12 and table 1.

The KATRIN experiment
The experimental setup of KATRIN combines a highluminosity windowless gaseous molecular tritium source (WGTS) with an integrating electrostatic spectrometer of MAC-E filter (magnetic adiabatic collimation with electrostatic filter) type [25,26,27], offering a narrow filter width and a wide solid-angle acceptance at the same time.The apparatus depicted in figure 6 features several major subsystems.The isotopological composition, temperature, and density fluctuations of the tritium source are monitored by a set of calibration devices housed in the rear section (a).The windowless gaseous tritium source (b) contains a beam tube of length L = 10 m and diameter d = 90 mm, residing in a nominal magnetic field of 3.6 T, where re-purified molecular tritium (T 2 ) is continuously circulated by injection at the center and pumping at both ends through a closed loop system [28,29,30].To prevent tritiated gas from entering the spectrometer section, the transport section (c) combines differential pumping with cryogenic pumping to reduce the tritium flow by 14 orders of mag-nitude [31,32].The β-electrons are guided through the entire beamline by a magnetic field [33] into the prespectrometer (d), which acts as a pre-filter that blocks the low-energy electrons of the β-spectrum [34].The energy analysis around the endpoint region takes place in the main spectrometer (e), which is operated under ultra-high vacuum conditions [35] at a retarding voltage of about −18.6 kV.Both spectrometers are designed as MAC-E filters, and the main spectrometer achieves a very narrow filter width ( 1 eV) [9] while providing high luminosity for the β-electrons.Electrons with sufficient energy pass both the MAC-E filters and are then counted at a segmented silicon PIN diode detector (f) [36] with 148 individual pixels.An integrated β-spectrum is recorded by scanning the retarding voltage in the endpoint region.

MAC-E filter principle
The electrons emitted isotropically from tritium βdecay in the gaseous source are guided adiabatically by magnetic fields.In the forward direction the βelectrons are confined in cyclotron motion along the magnetic field lines towards the MAC-E filter.Along their path to the analyzing plane (central plane) of the spectrometer, the magnetic field strength decreases by several orders of magnitude 3 .Due to the conservation Fig. 6: The KATRIN experimental setup, 70 m in length.The monitoring and calibration section (a) residing at the rear of the high-luminosity windowless source (b) provides stable and precise monitoring of tritium gas properties.The transport system (c) magnetically guides the electrons further downstream and prevents tritiated gas from entering the spectrometer section, which features two spectrometers operating as MAC-E-filters.The smaller pre-spectrometer (d) acts as a pre-filter for low energy electrons, and the larger main spectrometer (e) is used for the energy analysis in the endpoint region.A segmented detector (f) acts as a counter for the transmitted signal electrons.
of magnetic moment in a slowly varying field, most of the electrons' transverse momentum is adiabatically transformed into longitudinal momentum.With a high negative potential (U ≈ −18.6 kV, corresponding to the endpoint energy of tritium) at its center and most of the electron momentum being parallel to the magnetic field lines, the MAC-E filter acts as an electrostatic high-pass energy filter.Only electrons with positive longitudinal energy (the kinetic energy in direction of the magnetic field line) along their entire trajectory are transmitted, while the others are reflected and re-accelerated towards the entrance of the spectrometer.
The residual transverse energy, which cannot be analyzed by the filter, is defined by the ratio of the maximum B max to the minimum magnetic field B min = B A .This key characteristic of the MAC-E filter is commonly called the filter width (or sometimes energy resolution) with E being the electron kinetic energy and γ = E me + 1 the relativistic gamma factor with the electron rest mass m e .

Response function of the KATRIN experiment
In the KATRIN experiment, the energy of the βelectrons is analyzed using the MAC-E filter technique as described in section 3.For a specific electrostatic retardation potential U , the count rate of electrons at lyzing plane, and to compensate for influences by the earth's magnetic field and solenoid fringe fields [37,38].
the detector can be calculated, given the probability of an electron with a starting energy E to traverse the whole apparatus and hit the detector.This probability is described by the so-called transmission function T (E, U ).Additional modifications arise from energy loss and scattering in the source, and reflection of signal electrons propagating from their point of origin until detection.These effects are incorporated together with the transmission function into the response function R(E, U ), which is vital for the neutrino mass analysis as it describes the propagation of signal electrons that contribute to the integrated β-spectrum.
For illustrative purposes, we first consider a source containing a given number of tritium nuclei (N T ) that decay with an isotropic angular distribution 4 .The emitted electrons are guided by magnetic fields through the spectrometer.The detection rate at the detector for a given spectrometer potential U can be expressed as: where the factor of 1 2 incorporates the fact that the response function R(E, U ) only considers electrons emitted in the forward direction.
In the following, an analytical description of the response function of the KATRIN experiment will be laid out.At first, we derive the transmission function of the MAC-E filter that is implemented by the main spectrometer (section 4.1).In section 4.2 we consider energy loss in the source and develop a first description of the response function.Inhomogeneities in the MAC-E filter (section 4.3) and the source (section 4.4) requires extension of the model by a segmentation of the source and spectrometer volume.Further modifications to the response function arise from considering the effective source column density which an individual β-electron traverses (section 4.5), changes to the electron angular distribution (section 4.6), thermal motion of the source gas (section 4.7), and energy loss by cyclotron radiation (section 4.8).After discussing these contributions, in section 4.9 we arrive at a description of the integrated spectrum that is measured by the KATRIN experiment.We close the discussion with a general note on experimental energy uncertainties (section 4.11) and give a quantitative overview of theoretical corrections and systematic effects (section 4.12) on the neutrino mass analysis.

Transmission function of the MAC-E filter
The transmission of β-electrons through the MAC-E filter is an important characteristic of the measurement and a significant part of the response function.In the simplest case, one can assume that electrons enter the MAC-E filter with an isotropic angular distribution and propagate adiabatically towards the detector.In the discussion here we apply the adiabatic approximation (see equation ( 15) below), which is fulfilled in the case of KATRIN.
In general, an electron from the source will reach the detector if the momentum p parallel to the magnetic field lines (or the corresponding fraction E of the kinetic energy) is always positive.The transformation of transverse to parallel momentum and back in a slowly varying magnetic field B is governed by the following adiabatic invariant (which corresponds to the conserved orbital momentum µ = E ⊥ /B in the non-relativistic limit): In the following discussion we use the general relation between the transverse momentum p ⊥ of an electron with its transverse kinetic energy E ⊥ : with the relativistic gamma factor γ = E me + 1, and thereby define the transverse kinetic energy as: Similarly, we define the longitudinal kinetic energy as E = E cos 2 θ.The polar angle θ = ∠(p, B) of an electron momentum to the magnetic field is called the pitch angle.
We can now define the adiabatic transmission condition for an electron starting at the position z S with a magnetic field B S = B(z S ), an electrostatic potential U S = U (z S ), a kinetic energy E = E(z S ) with a corresponding gamma factor γ, and a pitch angle θ = θ(z S ).The transmission condition then reads for all longitudinal positions z: where γ(z) corresponds to the gamma factor at an arbitrary position z along the beam line where the electron has a kinetic energy E(z) = E (z) + E ⊥ (z) at a magnetic field B(z) and an electrostatic potential U (z).
Usually in a MAC-E filter the highest retarding potential U and at the same time the smallest magnetic field B A is reached in the analyzing plane (located at z ap = 0 in our definition).Secondly we can assume the electrical potential U S at the start to be zero and the relativistic factor in the analyzing plane at the largest retardation (minimum kinetic energy) to equal one, γ(z ap ) = 1.Therefore the transmission condition in equation ( 18) simplifies to For a given electric potential and magnetic field configuration of the MAC-E filter, the transmission condition T is thus just governed by the starting energy E, the starting angle θ and the retarding voltage U .
For an isotropically emitting electron source with angular distribution ω(θ) dθ = sin θ dθ, we can integrate T (E, θ, U ) over the angle θ and define a response or transmission function.From here on we associate the remaining energy in the analyzing plane of the MAC-E filter -the surplus energy -with the expression E = E − qU .
In the KATRIN setup the maximum magnetic field B max is larger than B S , so that β-electrons emitted at large pitch angles in the source are reflected magnetically before reaching the detector.The magnetic reflection occurs at the pinch magnet (with B = B max and zero potential), and in the source the electric potential is zero.The maximum pitch angle of the transmitted electrons is therefore independent of the electron energy and given by: For the standard operating parameters of KATRIN (see table 2), θ max evaluates to about 50.8 • .This reflection is desired by design, since β-electrons emitted with larger pitch angles have to traverse a longer effective column of source gas and are therefore more likely to scatter and undergo energy loss, as detailed in the following sections.
With this additional magnetic reflection after the analyzing plane, the transmission function is given by: with the filter width ∆E from equation (13).In figure 7, the transmission function is shown for the nominal KATRIN operating parameters and for the case B S = B max .The magnetic reflection imposes an upper limit on the pitch angle, which reduces the effective width of the transmission function.As indicated in figure 7, this improves the filter width of the spectrometer to 0.93 eV, compared with 1.55 eV for θ max = 90 • without magnetic reflection.

Response function and energy loss
In the next step we consider the energy loss when the electron traverses the gaseous source.The dominant energy loss process is the scattering of electrons on gas molecules within the source.Because the pressure decreases rapidly outside the source, scattering processes in the transport section or thereafter are of no concern.
Two ingredients are required to appropriately treat electron scattering in the source.First, the energy loss function f ( , δϑ) describes the probability for a certain energy loss and scattering angle δϑ of the β-electrons to occur in a scattering process.Because the scattering angles δϑ are small5 , we will neglect them in the following formulae and describe the scattering energy losses by the function f ( ).Here we do not consider a  20) relates the surplus energy to the pitch angle θ, as shown at the top of the figure.The solid red line shows the cut-off caused by a magnetic reflection of all electrons with high pitch angle in the strongest magnetic field at reference conditions Bmax BS = 6.0 3.6 .The dashed blue line shows the transmission function without magnetic reflection.dependence of f or P s on the incident kinetic energy E of the electrons, since for the KATRIN experiment the energy range of interest amounts to a very narrow interval of a few times 10 eV below the tritium endpoint only, where these functions can be considered as independent of E. The other important ingredients are the scattering probability functions P s (θ) for an electron with pitch angle θ to scatter s times before leaving the source.These scattering probabilities depend on θ, since electrons with a larger pitch angle must traverse a longer path, meaning a larger effective column density, and are thus likely to scatter more often.
With these considerations, the response function no longer comprises only the transmission function, but is modified as follows: Electrons leaving the source without scattering (s = 0) do not lose any energy, hence f 0 ( ) = δ( ).For s-fold scattering, f s ( ) is obtained by convolving the energy loss function f ( ) s times with itself.
The scattering cross section can be divided into an elastic and an inelastic component.The inelastic cross section and the energy loss function for electrons with kinetic energies of ≈ 18.6 keV scattering from tritium molecules have both been measured in [40,41].In this work, the inelastic scattering cross section was determined to be σ inel = (3.40 ± 0.07) • 10 −18 cm 2 and an empirical model was fit to the energy loss spectrum.
To obtain a continuous transition between the two parts of f ( ), a value c = 14.09eV was chosen.The Gaussian part summarizes the energy loss due to (discrete) excitation processes, while the Lorentzian part describes the energy loss due to ionization of tritium molecules.This parameterization of the energy loss function is used for the response model presented in this paper.However, the parameters are not precise enough for KATRIN to meet its physics goals.Dedicated electron gun measurements with the full experimental KATRIN setup have been planned for the determination of the inelastic scattering cross section and the energy loss function with higher precision; the analysis of these data will involve a sophisticated deconvolution technique [42].
At σ el = 0.29 • 10 −18 cm 2 , the total cross section of elastic scattering of 18.6 keV electrons with molecular hydrogen isotopologues is smaller than that for inelastic scattering by an order of magnitude [43,44].In addition, the elastically scattered electrons are strongly forward peaked with a median scattering angle of θ scat = 2.1 • near the tritium endpoint energy.The energy loss due to elastic scattering is given by the relation With an angular distribution for elastic scattering of molecular hydrogen by electron impact measured in [45], the corresponding median energy loss amounts to ∆E = 4.0 meV.The energy loss function, containing the elastic and inelastic components weighted by their individual cross section, is shown in figure 8.The elastic energy loss component can be accurately calculated.Due to its narrow width and steep slope, ∼ meV binning is required for incorporating it accurately in the response function, thereby increasing computational cost considerably.We will neglect the elastic scattering component in neutrino mass measurements as the associated systematic error on an m 2 ν is minute (∼ 5 • 10 −5 eV 2 , see table 1).

Radial inhomogeneity of the electromagnetic field
To calculate the transmission and response functions of the KATRIN setup as explained in section 4.1 and section 4.2, it is in principle sufficient to only consider the axial position of an electron to identify the initial conditions such as electromagnetic fields or scattering probabilities.In the case of the main spectrometer, radial dependencies must be incorporated in the description of the magnetic field and the electrostatic potential in the analyzing plane.Additional radial dependencies in the source are discussed in section 4.4; these are then incorporated into the model together with the spectrometer effects.
In order to achieve a MAC-E filter width in the eVregime, a reduction of the magnetic field strength in the analyzing plane on the order of BA Bmax ≈ ∆E E ≈ 10 −4 is required (see equation ( 13)).Consequently the diameter of the flux-tube area A is drastically increased due to the conservation of magnetic flux Φ = const ≈ B • A. When nominal field settings are applied (see table 2), the projection of the detector surface with radius r det = 4.5 cm has a radius of about 4 m in the analyzing plane.A larger (smaller) magnetic field in the analyzing plane B A shifts the transmission edge to a larger (lower) energy, see equation (20).This effect is even more pronounced for larger electron pitch angles.Consequently, the transmission function (see equation (22)) is also widened or narrowed.Utilizing a set of magnetic field compensation coils, operated with an optimal current distribution, around the spectrometer vessel, the spread of the radial inhomogeneity of the magnetic field is minimized to a few µT when an optimized current distribution is applied [37,38].The resulting variation in the filter width in the analyzing plane due to the magnetic field inhomogeneity is thus reduced to about 10 meV [46].
In the case of the electrostatic potential, unavoidable radial variation arises from the design of the spectrometer.To fulfill the transmission condition in equation (19), the electrode segments at the entrance and exit are operated on a more positive potential than in the central region close to the analyzing plane 6 .De-pending on the final potential setting, the radial potential variation in the analyzing plane is expected to be of order 1 V [39].In comparison, azimuthal variations are negligible.It is possible to considerably reduce the radial potential inhomogeneity by operating the MAC-E filter at larger B A .However, this would require better knowledge of the magnetic field in the analyzing plane [46] and also increase the filter width.Even with these optimizations of the setup, the small radial variations in the electromagnetic fields at the analyzing plane, as shown in figure 9, cannot be neglected.The segmentation of the KATRIN main detector into annuli of pixels allows us to incorporate such radial variations in the response function model for each individual detector pixel.Because the tritium source also features radial variations of certain parameters, this segmentation is combined with a full segmentation of the source volume as described in section 4.4.Dependencies of the electromagnetic field are typically averaged over the surface area of a pixel.The specific detector geometry with thinner annuli towards outer radii (each with equal surface area) helps minimize the potential variation within individual annuli, despite the increasing steepness of the potential.

Source volume segmentation and effects
In addition to radial dependencies of the analyzing plane parameters that govern the energy analysis of Fig. 10: In the numerical model, the source is partitioned in such a way that each radial/azimuthal segment (index j) in the source, consisting of stacked longitudinal slices (index i), corresponds to the part of the magnetic flux tube seen by the matching detector pixel (index j).(Diagram not drawn to scale.) the β-electrons (section 4.3), the tritium source also features radial and axial dependencies of its parameters.In the following, we will briefly outline the most relevant source parameters that are required to accurately model the differential β spectrum and the response function.These parameters include the beam tube temperature T bt , the magnetic field strength B S , plasma potentials U P , the particle density ρ and the bulk velocity u of the gas, all of which may vary slightly in longitudinal, radial and azimuthal directions.The complex gas dynamic simulations, which are needed to calculate these local source parameters, are described in comprehensive detail in [47,48].
In order to model accurately these effects for each individual detector pixel, the simulation source model is partitioned to match the detector geometry.It is partitioned longitudinally into N L slices and segmented radially into N R annuli (rings) of N S segments each, resulting in a total of N L • N R • N S segments (see figure 10).The geometry of these segments is chosen in such a way, that a longitudinal stack of segments is magnetically projected7 onto a corresponding detector pixel.Note that all detector pixels have identical surface area, which leads to broader annuli at the center and thinner annuli towards larger radii.In the following, we index the longitudinal slices by the subscript i and radial/azimuthal segments with their corresponding detector pixel by the subscript j.
At a retarding potential U , the detection rate for a specific detector pixel j can then be stated as where N T,i is the number of tritium nuclei (assuming that the gas density has no radial or azimuthal dependence).The response function R i,j (E, U ) depends on the index i (i.e. the axial position) and the index j (i.e. the radial/azimuthal position) of the source segment.With the indices i, j we can describe the dependence on local source parameters such as the magnetic field.The most significant effect on the response is caused by the scattering probabilities, as detailed in section 4.2.The index j further describes non-uniformities of the retarding potential U and the magnetic field B A in the spectrometer (see figure 9).

Scattering probabilities
As discussed in section 4.2, inelastic scattering results in an energy loss that directly affects the energy analysis of the signal electrons, and needs to be incorporated accurately into the analytical description.Changes to the angular distribution of the emitted electrons due to scattering processes, which also modify the response function, are discussed in section 4.6.
The scattering probability for β-electrons is considerably different depending on their starting position in the 10 m long source beam tube, as visualized in figure 11.The longitudinal segmentation of the source volume in our model allows us to incorporate this behavior.The probability P s for an electron to leave the source after scattering exactly s times depends on the total cross section σ and the effective column density N eff that the electron traverses.This effective column density depends not only on the electron's starting position z inside the source and the axial density distribution ρ(z), but also on the starting pitch angle θ in the source (equation ( 21)): L denotes the length of the source beam tube with −L/2 ≤ z ≤ L/2.The nominal column density is then given by N = N eff (z = −L/2, θ = 0).Because of the low probability to scatter off a single tritium molecule, the number of scatterings during propagation can be calculated according to a Poisson distribution: The mean scattering probabilities for a specific position z can be calculated using the isotropic angular distribution ω(θ) = sin θ and the maximum pitch angle θ max : This integration assumes that the angular distribution is not significantly affected by the small angular change in the discussed scattering processes.A higher total column density N , as well as a larger θ max , would provide a larger number of β-electrons at the exit of the source and at the detector.However, they also raise the proportion of scattered over unscattered electrons, thereby increasing the systematic uncertainties due to energy loss, and at some point, limiting the β-electron detection rate close to the endpoint.The optimal design values of N = 5 • 10 17 cm −2 and θ max = 50.8• [4] balance these effects.

Response function for non-scattered electrons
The transmission function in equation ( 22) describes the transmission probability of isotropically emitted electrons.Even if we consider only non-scattered electrons, the β-electrons do not follow an isotropic angular distribution before entering the spectrometer due to the pitch angle dependence of the s-fold scattering probabilities P s (z, θ) in the source (see section 4.5).
The zero-scattering transmission function therefore needs to be modified to the following form: The zero-scattering probability P 0 (θ) is computed by averaging P 0 (z, θ) over z. Figure 12 illustrates the resulting difference in the response function.The surplus energy range E < 10 eV corresponds to the steep increase in the response function at low energies as shown in figure 11, where energy loss from inelastic scattering does not contribute.Surplus energy E -q U in eV Fig. 12: The transmission edge of the response function.The dashed curve is calculated with an isotropic angular distribution, and the solid curve with a realistic angular distribution for unscattered electrons.

Doppler effect
The thermal translational motion and the bulk gas flow of the β-emitting tritium molecules in the WGTS lead to a Doppler broadening of the electron energy spectrum, which further modifies the response function model that was derived in section 4.2 and thereafter.These two effects can be expressed as a convolution of the differential spectrum dΓ dE with a broadening kernel g, denoted by the subscript D: with E cms being the electron kinetic energy in the βemitter's rest frame (which is approximately the centerof-mass system), and E lab the electron energy in the laboratory frame.
The magnitude of the thermal tritium gas velocity follows a Maxwell-Boltzmann distribution.However, considering only the velocity component v M that is parallel to the electron emission direction, the thermal velocity distribution of the tritium isotopologue mass M is described by a Gaussian which centers around v M = 0 with a standard deviation σ v = k B T bt /M .For the component of the bulk gas velocity u that is parallel to the electron emission direction with pitch angle θ, the mean v M is shifted by cos θ • u.Integrating over all emission directions up to θ max , the expression expands to Using the Gaussian error function this expression can be rewritten as Finally, the tritium gas velocity distribution g(v M ) can be translated into an electron energy distribution g(E cms , E lab ).Using the Lorentz factors and the electron velocities defined in the CMS and lab frames, we can write with The standard deviation of this convolution kernel evaluates to With σ v ≈ 203 m/s for T 2 molecules at T bt = 30 K and the weighted mean bulk velocity at nominal source conditions being ū ≈ 13 m/s, thermal Doppler broadening clearly is a dominating effect.The standard deviation of the broadening function g(E cms , E lab ) at a fixed bulk velocity u = 0 for T bt = 30 K and E ≈ E 0 evaluates to σ E ≈ 94 meV (also see figure 13).This value can be interpreted as a significant smearing of the energy scale.Its implication for the neutrino mass measurement is shown in table 1.

Cyclotron radiation
As electrons move from the source to the spectrometer section in KATRIN, they lose energy through cyclotron radiation.In contrast to energy loss due to scattering with tritium gas (section 4.5), this energy loss process applies to the entire trajectory of an electron as it traverses the experimental beamline [49].
For a particle with kinetic energy E spending a time ∆t in a fixed magnetic field B, the cyclotron energy loss is (in SI units): In general, cyclotron radiation reduces the transverse momentum component of the particle 8 .Consequently, the losses are maximal for large pitch angles and vanish completely at θ = 0 • .For complex geometric and magnetic field configurations as in the KATRIN experiment, the overall cyclotron energy loss can be computed using a particle tracking simulation framework such as Kassiopeia [50].By this means, the cyclotron energy loss from the source to the analyzing point in the main spectrometer can be obtained as a function of the electron's starting position z and pitch angle θ.Particles starting in the rear of the source will lose more energy due to their longer path through the whole setup.The total cyclotron energy loss can be up to 85 meV for electrons with the maximum pitch angle θ max = 50.8• .
Because the resulting decrease in the angle ∆θ due to the loss of transverse momentum is of order 10 −6 or less, it can be neglected.We thus consider the loss of cyclotron energy ∆E cycl (θ, z) to be a decrease in the total electron kinetic energy E. Essentially, this effect causes a shift of the electron transmission condition (see equation (20)) with the index i denoting the longitudinal slice where the electron starts from the source position z (see figure 10).The influence of the cyclotron energy loss on the averaged response function is shown in figure 14.

Expected integrated spectrum signal rate
Earlier in this section we have laid out the different contributions to the response function of the experiment, which describes the probability for β-electrons to arrive at the detector where they contribute to the measured integrated spectrum.The response function describes the energy analysis at the spectrometer (section 4.

Response function R
Surplus energy E -q U in eV Fig. 14: The impact of energy losses due to cyclotron radiation on the shape of the response function near the transmission edge.section 4.3), energy loss caused by scattering in the tritium source (section 4.2 and section 4.5), and additional corrections (section 4.6 and following).
Combining the response function with the description of the differential spectrum that was developed in section 2, the integrated spectrum signal rate observed on a single detector pixel j for a retarding potential setting U can finally be expressed as This expression incorporates all theoretical corrections (see equation (12) with subscript C) and the Doppler broadening (see equation (33) with subscript D) of the differential spectrum dΓ dE (see equation ( 10)), and the full response function which incorporates the energy loss as a result of source scattering and cyclotron radiation: The response function depends on the path traversed by the β-electron between its origin in source segment (i, j) and the target detector pixel j (see figure 10 for the segmentation schema).The detection efficiency det,j is an energy-dependent quantity, which needs to be measured for each pixel j.Its value is between ≈ 90 % and 95 % [36].
To first order (due to nearly constant magnetic field and tritium concentration in the source), the integrated signal rate in equation ( 41) depends on N σ -which can be accurately determined by calibration measurements with a photoelectron source -but is independent of the longitudinal gas density profile ρ(z) which cannot be measured directly (see [47,48] for simulation results).

Scan of the integrated spectrum
A scan of the integrated β spectrum comprises a set of detector pixel event counts N j (U k ), observed at various retarding potential settings U k for the duration of ∆t k each, with k ∈ {1 . . .n k }.In the following, the indices j and k are condensed by writing N jk = N j (U k ), with N jk denoting the event count on a single detector pixel j for a specific retarding potential setting k.
The observed event count N obs jk is a Poissondistributed quantity with the expectation value given by where Ṅ bg j is an energy-independent background rate component (possibly with a radial dependency indicated by the index j).
KATRIN will be operated for a duration of 5 calendar years in order to collect 3 live years of spectrum data over multiple runs.

Energy uncertainties
At the end of this section we will briefly discuss the influence of energy uncertainties on the neutrino mass measurement.In general, any fluctuation with variance σ 2 induces a spectrum shape deformation which -if not considered in the analysis -is indistinguishable to first order from a shift of the measured value of m 2 ν in the negative direction with ∆m 2 ν = −2σ 2 [11].This shift of ∆m 2 ν also holds if an accounted fluctuation or distribution of true variance σ 2 true is described wrongly in the analysis by the variance σ 2 ana = σ 2 true − σ 2 .Different sources of fluctuations and distributions with uncertainties can be distinguished.One group comprises β-decay and source physics, such as molecular final states, scattering processes and the Doppler effect (all discussed in this work).Others are experimental systematics originating in the energy measurement, which have to be studied during commissioning of the setup and then incorporated into the model.An example is the distortion of the spectrometer transmission function due to retarding-voltage fluctuations [51,52].

Impact of theoretical and experimental corrections
In table 1 we review and quantify the impact of theoretical corrections to the differential β-spectrum, discussed in section 2, and of experimental corrections which have been introduced above.Many individual model components can be safely neglected, while others need to be considered more accurately, such as the radial dependence of retarding potentials (section 4.3), energy loss due to cyclotron radiation (section 4.8) or the Doppler effect (section 4.7).

Measurement of the neutrino mass
Having compiled a complete description of the theoretical β-decay spectrum and the response function of KATRIN into a parameterizable model, we will now outline the statistical terms and methods required for actual neutrino mass measurements.In the next (sections 5.1 to 5.2) we review the process of parameter inference (model fitting) and the construction of confidence intervals in the case of a KATRIN neutrino mass analysis, and we explain the relation between observed data, fit parameters and their uncertainties.After introducing Frequentist methods of inferring m 2 ν we give an example of a Bayesian approach in section 5.3.We briefly list statistical and systematic uncertainty contributors for KATRIN in section 5.4 and in that context discuss the relevance of the choice of the energy analysis interval in section 5.5 and the distribution of accounted measuring time among that interval in section 5.6.In section 5.7 we give an explanation of negative m 2 ν estimates and provide a non-physical extension of the β-decay spectrum model.

Parameter inference
The statistical technique for analyzing β-decay spectrum data is well established.By comparing the observed number of counts N obs jk on each pixel j for each experimental setting k with the prediction from the spectrum and response model N jk (U k , m 2 ν , E 0 , . . . ) (see equation (41) and ( 43)), m 2 ν and other unknown model parameters can be inferred.In the case of a KATRINlike neutrino mass measurement, a continuous model that depends on m 2 ν is fit to unbinned spectral shape data.The method of least squares is most commonly applied.
The probability to have an observed outcome N obs = N obs 1,1 . . .N obs nj ,n k , given the predicted number .For m ν a true value of 200 meV is assumed. 1 Instead of using the non-relativistic variant. 2 Instead of pulling these effects outside the FSD summation in equation (12).
A set of parameter point estimates θ is obtained by maximizing the likelihood L. Equivalently, a minimization of the negative log-likelihood − ln L can be performed, which is often more practical numerically.If the number of observed events N obs jk is large enough ( 25), so that the Poisson distribution can be approximated by a Gaussian, that expression is approximately a χ 2 function: In case of σ jk = N pre jk , the above χ 2 equals the Pearson's chi-square statistic [53].
Our parameter of interest is m 2 ν , which distorts the spectrum shape close to the endpoint.Because the fitted β-spectrum shape essentially only depends on m 2 ν , with χ 2 being approximately parabolic in m 2 ν , it is the preferred fit parameter over m ν [54].
Other model parameters are nuisance parameters.In KATRIN-like experiments typically three such quantities are treated as free fit parameters: -The tritium endpoint energy E 0 , the maximum electron energy assuming a vanishing neutrino mass, has to be estimated from the data, due to uncertainties in the measured T + / 3 He + mass difference [55] and in the experimental energy scale.-The signal amplitude A sig , a multiplicative factor close to 1, is applied to the predicted signal rate 9 Ṅ sig j to correct for any energy-independent model uncertainty.E 0 and A sig are estimated from the slope of the spectrum at lower energies of the analysis interval (≈ 30 -40 eV below the endpoint), where the absolute signal rate is highest.-The background rate amplitude A bg is another normalization factor, which is applied to the background model component Ṅ bg j .It is estimated using the data from retarding potentials above the tritium endpoint, where no signal is expected.Note that we assume a constant background rate without retarding potential dependence in the energy interval near the tritium endpoint.However, such an energy dependence could be incorporated into the model using additional data above the endpoint.
Considering only the aforementioned four model parameters, the predicted number of electrons on a detector pixel j for a retarding potential setting k in a counting period ∆t k is given by A point estimate for this set of parameters, obtained from maximizing the likelihood (or minimizing χ 2 ) is denoted in the following as ( m 2 ν , E 0 , A sig , A bg ).Depending on the method of treating systematic uncertainties, the number of free (or constrained) model parameters can be higher.

Confidence intervals
Due to the stochastic nature of the observed data, a single parameter point estimate by itself cannot relate to the unknown true value of a parameter.In parameter inference, a confidence interval defines an interval of parameter values that contain the true value of the parameter to a certain proportion (confidence level), assuming an infinite number of independent experiments.Various methods of constructing such intervals exist.
Using the Neyman construction [56] (a Frequentist method), ensembles of pseudo-experiments are sampled for a range of true values of m 2 ν , leading to the construction of a confidence belt (see figure 15).Incorporating an ordering principle proposed by Feldman and Cousins [57,58], empty confidence intervals for nonphysical estimates of m 2 ν can be avoided, while ensuring correct Frequentist coverage.
When parameter point estimates are constructed following the maximum likelihood ordering principle, the profile likelihood ratio [59] can be used to estimate their uncertainties.With this method the 1 σ uncertainty of a parameter estimate is identified by those Fig.15: Frequentist confidence belt (95 % C.L.) constructed according to the unified approach by Feldman and Cousins [57].In this example, the horizontal ranges (green dashed lines) are constructed by choosing 95 % of the m 2 ν estimates from an ensemble test with fixed true m 2 ν , following the ordering principle.These horizontal ranges define the edges of the confidence belt (blue solid lines).The subsequent result of an actual neutrino mass measurement (x-axis, indicated by red dotted lines) is used to select the vertical intersections with the confidence belt to determine the reporting of an upper limit (e.g. in case of m 2 ν = 0 eV 2 ) or a two-sided confidence interval (e.g. in case of m 2 ν = 0.07 eV 2 ).
parameter values where the likelihood has decreased to half its maximum value, while profiling (maximizing) with respect to any involved nuisance parameter.Equivalently, a chi-square curve can be scanned for parameter values with ∆χ 2 = 1, again profiling over nuisance parameters.

Bayesian statistics
Bayesian inference is typically based on the posterior PDF (probability density function) of a parameter of interest.Using Bayes' theorem, the posterior distribution p(θ) of a set of parameters θ is given by the likelihood L(θ) and a prior probability π(θ): In contrast to Frequentist approaches, which make a statement about the repeatability of an experiment, Bayesian statistics inevitably introduce the concepts of probability, belief and credibility.The prior probability π(θ) has to be chosen by the analyst, based on prior belief.In the case of m 2 ν , an objective option is the flat uniform prior (possibly zero for m 2 ν < 0 eV 2 ), or a normalizable Gaussian distribution that reflects the results from previous measurements.Middle panel: The relative rate difference near the endpoint energy.Under the nominal background conditions, the largest deficit in rate due to a non-zero neutrino mass is expected to be about 4 eV below the endpoint, where the signal-to-background ratio is ≈ 1.For the scenario of a higher background rate, this point of maximal distortion is shifted to lower energies.The shaded bands indicate the statistical uncertainties.Bottom panel: The measuring time ∆t k attributed to each retarding potential setting U k .The Poisson uncertainty of the generated toy rates Ṅk is directly related to the measuring time through σ( Ṅk ) = Ṅk / ∆t k .correct Frequentist coverage (see also figure 15).In a Bayesian framework the prior for m 2 ν is typically set to 0 for values of m 2 ν < 0 eV 2 , making the above extrapolation redundant.

Conclusion
Using β spectroscopy, the KATRIN experiment aims to probe the absolute neutrino mass scale with an unprecedented sub-eV sensitivity.Both the statistical and systematic uncertainties of the model parameter of interest, the squared electron neutrino mass m 2 ν , are re- quired to be on the order of O(0.01 eV 2 ).This demands a solid understanding and consistent implementation of the theoretical β-decay spectrum model and the experimental response function.
With this work, an effort was made to summarize the β spectrum calculation with all known theoretical corrections relevant for spectroscopy in the endpoint region.Furthermore, a response function model of the KATRIN experiment was outlined, including its dependencies on source-gas dynamics and the spectrometer electromagnetic configuration.Finally, the statistical methods applicable to the intended measurement were investigated and concrete examples of their application to the KATRIN neutrino mass measurement were given.
In section 4.12, an overview of the impact of various model components on the measured squared neutrino mass was given.The purpose is to provide a quantitative measure of their relative importance, indicating components that are negligible in the neutrino mass analysis.Among the most important effects are the radial dependencies of analyzing magnetic field and retarding potential, energy loss of signal electrons due to cyclotron motion and the Doppler broadening of the electron β-spectrum due to the source gas thermal motion.
The calculations presented here are implemented as part of a common C++ simulation and analysis software framework called Kasper, which is used by the KATRIN collaboration to investigate the effect of model corrections and possible systematics, and to optimize the operational parameters of the setup for the neutrino mass measurement [62,64,39,65,66].
During the ongoing commissioning measurement campaign of the KATRIN experiment, many aspects of the current response model will be verified with experimental data.The results of recent investigations are described in [38], [67] and [49].This thorough characterization of the complex setup will allow a quantitative evaluation of the systematic effects in the neutrino mass analysis at KATRIN.

Fig. 7 :
Fig.7: Transmission function T at a retarding potential of U = 18 545 V with nominal magnetic field configuration ( Bmax BA = 20 000).The transmission condition in equation (20) relates the surplus energy to the pitch angle θ, as shown at the top of the figure.The solid red line shows the cut-off caused by a magnetic reflection of all electrons with high pitch angle in the strongest magnetic field at reference conditions Bmax BS = 6.0 3.6 .The dashed blue line shows the transmission function without magnetic reflection.
Energy loss function f 1 = f ( ) -the energy loss probability of electrons scattered once.Shown is the normalized probability distribution, ∞ 0 f 1 ( ) d = 1.Convolved energy loss function f 2 = f ( ) ⊗ f ( ) -the energy loss probability of electrons scattered twice.

Fig. 8 :
Fig.8: Theoretical energy loss function for elastic and inelastic scattering processes, shown as a probability density function.The leftmost enlarged region ( 0.01 eV) is dominated by elastic scattering, and the region at higher energy is due to inelastic excitation and ionization, as parameterized by Aseev et al.[40].

Fig. 9 :
Fig.9: The calculated radial inhomogeneity of the electrostatic potential and the magnetic field in the analyzing plane of the main spectrometer, for the standard setting of U = −18 600 V and B A = 0.3 mT.The plot shows the offset in the potential and the magnetic field values in the spectrometer center.The vertical dashed lines mark the corresponding outer radii of annuli mapped to the 13 detector rings.

Fig. 11 :
Fig. 11: The response function R(E, qU ) at a retarding energy of qU = 18 545 eV.The dash-dotted and dashed curves show the response function close to the front (spectrometer-facing, z = +4 m) vs. rear (z = −4 m) of the WGTS, which has a length of 10 m in total.An averaged version, weighted by the gas density in each source segment, is shown as the solid curve.

Fig. 13 :
Fig.13: Convolution kernels describing the Doppler broadening of the β spectrum due to the thermal motion and bulk velocity u of the source gas.A temperature of T bt = 30 K is assumed, leading to a Gaussian broadening with σ E ≈ 94 meV at E cms = 18 575 eV.

Fig. 20 :
Fig. 20: An illustration of a hypothetical neutrino mass signal, using toy data simulated for m ν = 350 meV (red points + stat.error bars), compared against the theoretical model expectations for m ν = 0 meV (blue solid line), m ν = 350 meV (green dashed line) at nominal background of R bg = 10 mcps, and m ν = 350 meV at elevated background R bg = 100 mcps (orange dash-dotted line).Top panel: The absolute rate j Ṅjk (U k ) = N k (U k ) is plotted against the retarding energy qU k relative to the endpoint energy E 0 .Middle panel: The relative rate difference near the endpoint energy.Under the nominal background conditions, the largest deficit in rate due to a non-zero neutrino mass is expected to be about 4 eV below the endpoint, where the signal-to-background ratio is ≈ 1.For the scenario of a higher background rate, this point of maximal distortion is shifted to lower energies.The shaded bands indicate the statistical uncertainties.Bottom panel: The measuring time ∆t k attributed to each retarding potential setting U k .The Poisson uncertainty

Fig. 21 :
Fig. 21: The measuring time ∆t k attributed to various retarding potential settings U k in a more sparse, statistically optimized distribution.

2 Fig. 22 :
Fig. 22: Extrapolation of the differential β spectrum model for different values of the measured neutrino mass squared, including an nonphysical value of m 2 ν = −1 eV 2 (dashed red line).

Table 1 :
Impact of individual theoretical and experimental model corrections on the measured squared neutrino mass m 2 ν , if neglected or approximated.The analysis energy window is restricted to [E 0 − 30 eV; E 0 + 5 eV]