1 Introduction

The neutrino mixing angle \(\theta _{13}\) has been measured precisely and was found to be larger than previously expected by the current generation of short-baseline reactor neutrino and long-baseline accelerator neutrino experiments [1,2,3,4,5]. The large value of \(\theta _{13}\) allows for the measurement of a leptonic CP-violating phase and the resolution of neutrino mass hierarchy (MH). Particularly, it opens a gateway to determine the MH from (approximately) vacuum oscillation in medium-baseline reactor neutrino oscillation (MBRO) experiments [6,7,8,9,10,11,12,13,14,15]. These experiments are designed to resolve the neutrino MH via precise spectral measurement of reactor \({{\bar{\nu }}}_e\) oscillations. A large liquid-scintillator detector (\(\sim \) 10–20 ktons) with excellent energy resolution (3%/\(\sqrt{E/{\mathrm {MeV}}}\)), located \(\sim \) 50 km from the reactor core(s) is expected to be able to observe the sub-dominant oscillation pattern and thus discriminate the MH by measuring the resulting spectral distortions [13, 14]. However, there has been concern that the fine structure predicted to exist in the reactor neutrino spectrum might constructively or destructively interfere with the spectral distortions used to determine the MH.

In parallel, reactor neutrino experiments have also measured the reactor antineutrino flux and spectrum with unprecedented statistics at distances from dozens of meters to \(\sim \) 2 km from reactor sources. Together with the results from previous experiments, a neutrino deficit was found relative to predictions [16]. Current experiments also found an excess of events with respect to predictions in the region of 4–6 MeV prompt energy, which came to be known as the “bump” or “shoulder” [17,18,19]. Recently, it was also found that predictions of the (unoscillated) reactor antineutrino spectrum [20, 21] is inconsistent with the latest experimental measurements in the ratio between \(^{235}\)U and \(^{239}\)Pu yields [22,23,24]. In addition to the larger scale shape discrepancy, attempts to predict reactor antineutrino flux and spectrum using ab initio approaches predict percent-level sub-structures in the \({{\bar{\nu }}}_e\) spectrum due to Coulomb effects in beta decay [25, 26]. After the “bump” is found, Ref. [27] is one of the earliest articles which examined the impact of undetermined reactor antineutrino spectrum on the sensitivity of MH resolution, but the impact of fine structure was not discussed in details at that time. Recently, Ref. [28] concludes that the undetermined structure of reactor antineutrino spectrum will not lead to significant impact based on an approach using Fourier transforms. In this paper, we would like to estimate the scale of fine structure and the corresponding impact on mass ordering resolution based on direct calculation of \(\chi ^2\) sensitivities. Our analysis indicates that fine structure would not significantly affect the resolution of neutrino MH, as found in [28].

In this context, we present numerical simulations to investigate the potential impact of fine structure in the reactor neutrino flux on the determination of the MH. We start with the simplest arrangement for a MBRO experiment, namely, one powerful source and one single large detector with a baseline of 52.5 km. We also investigate whether a near detector can provide significant improvement on MH sensitivity, and the effect on this sensitivity from different values of near detector energy resolution.

This paper is organized as follows. In Sect. 2, we review the discrepancies between reactor flux measurements and conventional predictions. Then, in Sect. 3, we present our estimation of the scale of fine structure and our simulation of MH resolution sensitivity, with additional shape uncertainties due to fine structure taken into account. In Sect. 4, we present our study concerning the proposed near detector. Finally, a summary of our results and perspectives are concluded in Sect. 5.

2 The undetermined reactor spectrum and discrepancies between experiments and conventional predictions

The conventional method of predicting reactor neutrino flux is based on measurements of electron spectra from the beta decays of fission daughters. These spectra are fit with fake beta branches from high energy bins to low, subtracting each “virtual branch” spectrum before fitting the next energy bin [20]. Those virtual branches are then converted to \({{\bar{\nu }}}_e\) spectra via the relation \(E_{0} - E_{{{\bar{\nu }}}_e} = T_{\beta }\), where \(E_{0}\) is the available energy for the beta decay. Beta-conversion antineutrino spectra of \(^{235}\)U, \(^{239}\)Pu, \(^{241}\)Pu from Huber [20] and \(^{238}\)U spectra from Mueller [21] have been the most widely-used in reactor neutrino experiments. The conversion method was favored because corresponding uncertainties were well-defined and associated with the conversion procedure. Such predictions of the \(\beta \) decay spectrum estimate that the uncertainties of \({{\bar{\nu }}}_e\) would be around a few percent. However, the recent measurements at Daya Bay [23, 24] suggest that a 7.8\(\%\) larger \(^{235}\)U yield and a 7% (9%) discrepancies of \(^{235}\)U (\(^{239}\)Pu) spectra at 4–6 MeV energy region from the Huber–Mueller prediction may be the primary contributors to the reactor antineutrino anomaly [16] and shoulder in the reactor neutrino spectrum [29], respectively.

Another method of predicting reactor neutrino spectra is the summation method described in Refs. [22, 25, 26, 29, 30]. To generate a summation prediction, one first calculates beta decay spectrum for every contributing isotope. Following that normalize each total beta spectrum to the cumulative yield of its corresponding isotope. The cumulative yield (\(Y_c\)) is the probability that the isotope appears as a result of either a fission, or the decay of the other fission products, and therefore represents the fraction of the reactor neutrino spectrum which decays from that isotope will contribute. In principle, the result should be the true reactor neutrino spectrum though still not exact due to some approximations used in correcting for various effects. However, the dominant uncertainty and bias comes from the underlying data (Q values, transition probabilities, energy levels, and cumulative fission yields). Besides the uncertainties, the bias in the underlying measurements is a larger concern for the method. The most well understood of these is the pandemonium effect [31], which overestimates feeding to lower energy levels. Recent experiments conducted by the IGISOL collaboration have addressed this bias for a few isotopes, which contribute strongly to the reactor neutrino spectrum [32,33,34], and these results are included in our analysis. However, additional biases likely remain, such as results which suffer from the pandemonium effect, but have not yet had new experiments measure the structure data to greater precision.

The majority of fissioning isotopes in Pressurized Water Reactors (PWRs) are \(^{235}\)U and \(^{239}\)Pu. As discussed above, the conversion method predicts the \(^{239}\)Pu rate more accurately than the summation method, but predicts the \(^{235}\)U spectrum poorly. Whereas the summation method overestimates the flux from both, and the associated uncertainties are poorly defined [22]. Nevertheless, summation calculations which incorporate the most recent data have found better agreement with overall flux [35]. In any case regardless of the quality of overall flux prediction, we are forced to use the summation method in this analysis because we aim to estimate the fine structure in the spectrum. Each beta decay has a sharp discontinuity at its endpoint. When all the individual beta decay spectra are summed fine structure emerges. Because the conversation method uses fake beta branches, fine structure can only be predicted by the summation method, therefore the summation method is used exclusively in this paper.

The origin of the discontinuities which give rise to fine structure is as follows. The beta spectrum from the beta decay of a free neutron will go to zero at zero kinetic energy. However, when an isotope decays into another, the electron is generated quite close to the positively charged nucleus. Therefore, the effect of this charge on the negatively charged electron needs to be accounted for in the available final states. This results in a relatively soft electron energy spectrum, which importantly does not go to zero at zero kinetic energy. If we recall the relationship \(E_{0} = T_{\beta } + E_{{{\bar{\nu }}}_e}\), which tells us that if many electrons are created with zero kinetic energy, we should also see many neutrinos created with an energy equal to \(E_{0}\), the maximum available energy. This implies a sharp discontinuity at the endpoint of each neutrino spectrum corresponding to each beta decay branch. When the neutrino spectra of these beta branches are summed together, the discontinuities at the end of each generate fine structure in the total reactor neutrino spectrum, which is found to be at the few percent level [36], as shown in Ref. [25]. The size of the fine structure is dominated by the relative Fission Yields between isotopes. Large buildups of discontinuities also occur which can combine together to form what appears to be a single large discontinuity. More details and discussions of fine structure in reactor spectra can be found in Refs. [26, 36, 37].

Recent short baseline reactor neutrino experiments such as Daya Bay, cannot measure fine structure as their detectors have only \(\approx \) 8% energy resolution.Footnote 1 However, the future MBRO experiments such as JUNO [14] and RENO-50 [13], are expected to have finer detector energy resolution (around 3%) and thus are expected to observe more fine structure in the spectrum. However, it has been speculated that undetermined fine structure could give rise to unexpected variation in the measured spectrum which happens to mimic one or another MH, and therefore either reinforce the correct MH, or wash out its signal, resulting in either an artificially low or artificially high sensitivity. For this to be true the fine structure would need to be at approximately the scale of the sub-dominant oscillation pattern, and would have to fall in the right places and at the right magnitudes to mimic the MH signal. In the following, we treat the scale of the fine structure as an additional shape uncertainty because we expect to see fine structure but do not assume that the exact shape of fine structures could be predicted perfectly. The next section will discuss the impact of fine structure on MH resolutions in details.

3 The potential impact of fine structure on the resolution of neutrino MH

3.1 The conventional simulations of the MBRO experiments

Future MBRO experiments are expected to identify the neutrino MH with \(\varDelta \chi ^2\) > 9. A large liquid-scintillator detector (20 ktons) is expected to be able to observe the sub-dominant oscillation pattern and thus extract the MH signal from the predicted spectral distortion, as illustrated in Fig. 1. To distinguish between normal hierarchy (NH) and inverted hierarchy (IH), we quantify the sensitivity of MH resolution by employing a least-squares method, calculating the difference between the (assumed) true event rate and the fitting event rates.

Fig. 1
figure 1

Expected reactor neutrino energy spectrum observed by a detector with 3% energy resolution locating at 52.5 km. The red (blue) curve corresponds to the NH(IH) assumption. In our simulation, the NH (and also IH) spectrum is generated based on the Daya Bay measured spectrum (un-oscillated) [38], which will be discussed in details in the following sections. A medium-baseline reactor neutrino oscillation experiment(s) is expected to observe the subdominant \(\theta _{13}\) oscillation and distinguish the tiny differences between the blue and red curves [13, 14]

In our simulation, we assume the ideal detector is 20 ktons with 3% energy resolution,Footnote 2 located 52.5 km from the reactor core at medium-baseline reactor neutrino oscillation experiment(s). The electron antineutrino survival probability is given by [9, 12, 14]:

$$\begin{aligned} P_{{\bar{e}}{\bar{e}}}&= 1 - {\mathrm {cos}}^4(\theta _{13}){\mathrm {sin}}^2(2\theta _{12}){\mathrm {sin}}^2\left( \dfrac{\varDelta m^2_{21} L}{4E}\right) \nonumber \\&\quad - {\mathrm {sin}}^2(2\theta _{13})\left[ {\mathrm {cos}}^2(\theta _{12}){\mathrm {sin}}^2\left( \dfrac{\varDelta m^2_{31} L}{4E}\right) \right. \nonumber \\&\quad \left. +{\mathrm {sin}}^2(\theta _{12}){\mathrm {sin}}^2\left( \dfrac{\varDelta m^2_{32} L}{4E}\right) \right] \nonumber \\&= 1 - {\mathrm {cos}}^4(\theta _{13}){\mathrm {sin}}^2(2\theta _{12}){\mathrm {sin}}^2\left( \dfrac{\varDelta m^2_{21} L}{4E}\right) - \dfrac{1}{2}{\mathrm {sin}}^2(2\theta _{13}) \nonumber \\&\quad \times \left[ 1 - \sqrt{1-{\mathrm {sin}}^2(2\theta _{12}){\mathrm {sin}}^2 \left( \dfrac{\varDelta m^2_{21} L}{4E}\right) }\right. \nonumber \\&\quad \times \left. {\mathrm {cos}}\left( \dfrac{2|\varDelta m^2_{ee}L|}{4E}\pm \phi \right) \right] . \end{aligned}$$
(1)

where \(\varDelta m^2_{ee}\) is the effective mass-squared difference [39, 40]. The values of \(\varDelta m^2_{ee}\) and \(\phi \) in Eq. (1) are given by:

$$\begin{aligned}&\varDelta m^2_{ee} = {\mathrm {cos}}^2 \theta _{12} \varDelta m^2_{31} + {\mathrm {sin}}^2 \theta _{12} \varDelta m^2_{32}, \end{aligned}$$
(2)
$$\begin{aligned}&{\mathrm {sin}}\phi \nonumber \\&\quad = \dfrac{{\mathrm {cos}}^2 \theta _{12} {\mathrm {sin}}\left( 2{\mathrm {sin}}^2 \theta _{12}\frac{\varDelta m^2_{21} L}{4E}\right) - {\mathrm {sin}}^2 \theta _{12} {\mathrm {sin}}\left( 2\mathrm {cos}^2 \theta _{12}\frac{\varDelta m^2_{21} L}{4E}\right) }{\sqrt{1-{\mathrm {sin}}^2(2\theta _{12}){\mathrm {sin}}^2\left( \frac{\varDelta m^2_{21} L}{4E}\right) }}, \end{aligned}$$
(3)
$$\begin{aligned}&{\mathrm {cos}}\phi \nonumber \\&\quad = \dfrac{{\mathrm {cos}}^2 \theta _{12} {\mathrm {cos}}\left( 2{\mathrm {sin}}^2 \theta _{12}\frac{\varDelta m^2_{21} L}{4E}\right) + {\mathrm {sin}}^2 \theta _{12} {\mathrm {cos}}\left( 2{\mathrm {cos}}^2 \theta _{12}\frac{\varDelta m^2_{21} L}{4E}\right) }{\sqrt{1-{\mathrm {sin}}^2(2\theta _{12}){\mathrm {sin}}^2\left( \frac{\varDelta m^2_{21} L}{4E}\right) }}. \end{aligned}$$
(4)

In Eq. (1), the positive sign corresponds to NH and negative sign corresponds to IH respectively. In our simulations, the values of the oscillation parameters are assumed to be \(\varDelta m^2_{21}\) = 7.53 \(\times \) 10\(^{-5}\) eV\(^2\), \(\varDelta m^2_{ee}\) = 2.56 \(\times \) 10\(^{-3}\) eV\(^2\), sin\(^2 2\theta _{12}\) = 0.851, sin\(^2 2\theta _{13}\) = 0.083 [41].

We quantify the sensitivity of the MH measurement by employing the least-squares method, which is also used in JUNO Yellow Book [14] and Refs. [42, 43]. This method is based on a \(\chi ^2\) function given by:

$$\begin{aligned} \chi ^2&= \sum _i^{N_{{\mathrm {bins}}}} \dfrac{[T_i - F_i(1 + \eta _R + \eta _d + \eta _i)]^2}{T_i} \nonumber \\&\quad + \left( \dfrac{\eta _R}{\sigma _R}\right) ^2 + \left( \dfrac{\eta _d}{\sigma _d}\right) ^2 + \sum _i^{N_{{{\mathrm {bins}}}}}\left( \dfrac{\eta _i}{\sigma _{s,i}}\right) ^2 \end{aligned}$$
(5)

where \(T_i\) is measured neutrino event in the ith energy bin, and \(F_i\) is the predicted number of neutrino events with oscillations taken into account (the fitting event rate). \(\eta \) with different subscripts are nuisance parameters corresponding to reactor-related uncertainty (\(\sigma _R\)), detector-related uncertainty (\(\sigma _d\)) and shape uncertainty (\(\sigma _s\)). In Refs. [14, 42, 43], \(\sigma _R\) is assumed to be 2% and \(\sigma _d\) is assumed to be 1%. Since MH determination mainly depends on shape analysis, these uncertainties are minor and we follow the same assumptions in our analysis. Shape uncertainties (\(\sigma _{s,i}\)) are modified by adding the scale of potential substructure in the spectrum as additional shape uncertainties. The values of shape uncertainties are crucial to the MH resolution. In our analysis, we do not follow the assumption in Refs. [14, 42, 43], which assume \(\sigma _s\) to be constant at 1%. We treat the shape uncertainties as energy dependent, \(\sigma _s\) = \(\sigma _s (E_{\nu })\) and related to the scale of fine structure. This is one of the main differences between the conventional analyses and ours.

Without loss of generality, in our simulations, the NH is assumed to be the true MH. The number of bins used \(N_{{\mathrm {bins}}}\) is 200, equally spaced between 1.8 and 8 MeV. In this article, we focus on the potential impact of unknown structure in the reactor neutrino flux, and neglect the potential impact of detector non-linearity [14, 42], actual reactor distribution [14, 42], and matter effects [44]. The capability to resolve the MH is then given by the difference between the minimum \(\chi ^2\) value for IH and NH:

$$\begin{aligned}&\varDelta \chi ^2 \equiv |\chi ^2_{{\mathrm {min}}} (\text {IH}) - \chi ^2_{{\mathrm {min}}} (\text {NH})| \end{aligned}$$
(6)

In the next two subsections, we will focus on treatment of the fine structure as an additional shape uncertainty and evaluate its effects on the sensitivity of MH resolution.

3.2 Our analysis method

To study the impact of fine structure on the discrimination of neutrino MH, we estimate the scale of such structure (especially in the energy range between \(E_{\nu } = 2\)–6 MeV), treat it as additional shape uncertainty in the \(\varDelta \chi ^2\) calculation and investigate how this affects the sensitivity. We define the scale of the fine structure relative to a hypothetical measured spectrum smeared out with an energy resolution of 8%. In particular, this scale is determined by taking the ratio of the unaltered spectrum to the smeared spectrum. Therefore, the scale of fine structure can only be determined with reference to a choice of energy resolution for the smeared spectrum. For the purposes of this analysis, we choose 8%, which is the energy resolution of the Daya Bay detectors. We take the measured spectrum from Daya Bay, which is currently the most precise reactor neutrino measurement, as the nominal (un-oscillated) spectrum in our simulation. We start with the measured spectrum from Daya Bay (26 bins) [38] and obtain a smooth spectrum, then estimate the sensitivity of MH resolution by calculating Eqs. (5) and (6) with this smooth Daya Bay spectrum used to estimate both \(T_i\) and \(F_i\). Of course, fine structure is absent due to the finite (8%) detector energy resolution, so we need to estimate the scale of this missing fine structure and add it to Eq. (5) as an additional shape uncertainty.

3.2.1 Estimation of fine structure

Scale of fine structure is a potentially imprecise term so we should make it clear what our working definition is. Our “scale” here is a ratio of a spectrum with a certain energy resolution applied (which has the effect of smearing out the jaggedness) to a spectrum with perfect energy resolution. Since the Daya Bay measured spectrum is taken as the reference spectrum in our simulation, we are interested in the scale of unobserved fine structure with an 8% energy resolution detector. Therefore, the summation spectrum we use is smeared out with 8% energy resolution and 26 bins. Then we compare the original jagged spectrum with the smeared spectrum to estimate the scale of fine structure which is unobserved by Daya Bay. Figure 2 shows the comparison of the original jagged spectrum with the smeared spectrum. The red curve corresponds to the smeared out spectrum with 8% energy resolution. The blue curve represents the original jagged spectrum, which is a summation spectrum we generated, based on the cumulative yield datasets from the Evaluated Nuclear Data File (ENDF) [45, 46] and Joint Evaluated Fission File (JEFF) [47]. Total absorption spectroscopy (TAS) nuclear structure data is included where available. Our spectrum using ENDF yield data is identical to Ref. [25] but with TAS data replacing previous structure data where available. Unless noted, all results are based on ENDF cumulative yields.

Fig. 2
figure 2

Comparison of “the (un-oscillated) spectrum with fine structure” to the “smooth (un-oscillated) spectrum after smearing”. The red curve corresponds to the expected smooth spectrum (the smeared out spectrum with 8% energy resolution). The blue curve shows the original jagged spectrum without smearing

Fig. 3
figure 3

Comparison of our estimated scale of fine structure (red) with the ratio between IH and NH (blue). The IH and NH spectra are shown in Fig. 1, which are generated based on the Daya Bay measured (un-oscillated) spectrum

Based on the ratio of the blue curve to the red curve in Fig. 2, we attain the scale of fine structure,Footnote 3 which is shown as the red curve in Fig. 3. Our estimation shows that the scale of substructure could be large at high energy (\(E_{\nu } > 7\) MeV), but is relatively small in the range of \(E_\nu = 2\)–6 MeV, compared with the ratio of spectra corresponding to the IH and NH.Footnote 4 Since the determination of neutrino MH in medium-baseline reactor neutrino oscillation experiments is mainly dependent on this energy region, the sensitivity of such an experiment is expected to be mostly unaffected by the undetermined fine structure in the spectrum. The following subsections will investigate this more quantitatively.

3.2.2 Fine structure as additional shape uncertainty

Thus far, we have measured the scale of the fine structure at each point in the spectrum. However, each bin needs a single value treated as additional shape uncertainty because the same number applies across each bin. Because the bins are sufficiently narrow, the middle value is used. We treat the deviation from 1 at the middle of each bin as an additional shape uncertainty. It is because the deviation reveals the estimated scale of fine structure, which is absent in our reference spectrum (the measurement from Daya Bay). Therefore, the red curve in Fig. 3 is considered as the uncertainty of our reference spectrum, which leads to additional shape uncertainty in our simulation. There is a clear excess at low energy in the smooth spectrum. This is likely due to the effect of energy resolution causing events from higher energies to be detected in lower energy bins due to the sharp increase in rate from 1.8 to 3 MeV. Since we are treating the scale of fine structure as a shape uncertainty, this can be left in and will only make the result more conservative.

Besides, we also compare the scale of our estimated fine structure with different assumptions of shape uncertainties, as shown in Fig. 4. We want to investigate whether the scale of fine structure is actually comparable or even smaller than other shape uncertainties. The scale of fine structure could lead to additional shape uncertainties in the analysis of neutrino MH. However, if we find out that the shape uncertainties are actually dominated by other systematic uncertainties, we believe that the fine structure would not give rise to significant impact on MH resolution sensitivity. In Fig. 4, we compare our estimated scale of fine structure with the conventional assumption of 1% shape uncertainty [14, 42, 43]. Moreover, we also compare the estimated scale of fine structure with the current uncertainties of the Daya Bay measurement [23], since we also need to consider the shape uncertainty from our reference spectrum, which is based on the Daya Bay measurement. We believe that instead of simply assuming the shape uncertainties of all energy bins are 1%, considering the corresponding uncertainties of our reference spectrum could be more realistic.

Fig. 4
figure 4

Comparison of our estimated scale of fine structure (red) with the current uncertainties of the Daya Bay measured (black) spectrum [23]. We also plot the expected shape uncertainty (1%) in the literatures [14, 42, 43] (blue dashed lines) as well as the smoothed and symmetrized uncertainty from [27] as a comparison (the dashed green curve)

Fig. 4 shows that according to our estimation, the scale of fine structure which Daya Bay fails to measure is smaller than the current experimental uncertainties of the Daya Bay measurement in the range \(E_{\nu } = \) 2 to 8 MeV. The red curve representing scale of unmeasured fine structure does not exceed the shape uncertainty of the Daya Bay measurement [23]. In our simulations, we consider both the shape uncertainties due to the uncertainties of the Daya Bay measurement, and also additional shape uncertainties due to fine structure.Footnote 5 As mentioned before, we have to consider the intrinsic uncertainties of Daya Bay spectrum, which are the error bars plotted in Fig. 28(a) in Ref. [23], since it is taken as the reference spectrum in our analysis of neutrino MH sensitivities at MBRO experiment.

We sum these two different kinds of shape uncertainties in quadrature to calculate the total shape uncertainties of each bin. Specifically, in Eq. (5), \(\sigma _{s,i}^2 = \sigma _{\text {sub},i}^2 + \sigma _{\text {DYB},i}^2\). We also calculate a result using the conventional assumption of 1% shape uncertainty summed in quadrature with the scale of fine structure in each bin.

3.3 The results of our simulations

Figure 5 shows the comparison of our results with the estimated sensitivities of different considerations of shape uncertainties. As mentioned in the previous subsection, the uncertainties of the Daya Bay measurement [38] are taken into account and the corresponding sensitivit ies are shown as red curves in Fig. 5. The dashed red curve corresponds to the case “\(\sigma _{s,i}^2 = \sigma _{\text {DYB},i}^2\)”, and the solid one represents the scenario “\(\sigma _{s,i}^2 = \sigma _{\text {sub},i}^2 + \sigma _{\text {DYB},i}^2\)”, with the additional shape uncertainties due to fine structure taken into account. On the other hand, the sensitivities of considering the conventional assumption of 1% shape uncertainty [14, 42] are also shown as the blue curves in Fig. 5. The dashed blue curve shows the MH sensitivity with just 1\(\%\) shape uncertainties in each energy bin, while the solid one corresponds to the case that additional uncertainties due to fine structure are also considered.

For both the red curves and blue curves, the minima of the dashed and solid curves are close to each other. It implies that the consideration of fine structure does not significantly affect neutrino MH resolution. The difference between the assumption of 1% shape uncertainty and Daya Bay spectrum shape uncertainty is much larger than the difference between the results with and without fine structure. With the current Daya Bay spectrum uncertainty taken into account, the sensitivity of our simulation is given by \(\varDelta \chi ^2\) = 7.87 (8.05) with (without) shape uncertainty from fine structure. With the conventional assumption of 1% shape uncertainty [14, 42], we find \(\varDelta \chi ^2\) = 11.65 (12.01) with (without) fine structure. The effect on these results from fine structure is small when compared to the difference between different assumptions of shape uncertainty. Additionally, because our treatment of fine structure is conservative, we are over-estimating its impact.

Fig. 5
figure 5

Sensitivity of MH resolution using shape uncertainty from fine structure (solid lines) and without (dashed lines). NH is assumed to be the true MH. The curves on the left side correspond to the fitting of NH and curves on right side correspond to the assumption of IH (false MH). The blue curves represent the conventional assumption of 1% shape uncertainties (named as “CS” in the legend) for each bin; The red curves correspond to intrinsic uncertainties from the Daya Bay measurement (named as “DYB” in the legend). The green curves are the results based on shape uncertainties reported in Ref. [27]

The result based on uncertainties reported in Ref. [27] is also shown as a comparison and the corresponding MH sensitivity is lowest. It is because it has not considered fine structure but using the 1 \(\sigma \) uncertainty bands estimated in Ref. [25].Footnote 6 Reference [27] has also studied the potential impact of shape uncertainties. Our simulations are based on reference spectrum from Daya Bay measurement and our estimation of additional shape uncertainties suggests a better sensitivity than the result based on the discussion from Ref. [27], as our suggested shape uncertainties are smaller, which are based on the estimation of potential fine structure.Footnote 7

In order to account for possible variation in the spectrum, we generate 100 spectra based on both the JEFF and ENDF databases with all inputs varied randomly within their uncertainties. Figure 6 shows the sensitivities of MH resolution based on the random samples generated from the ENDF (red) and JEFF (blue) datasets. The left panel shows results based on Daya Bay shape uncertainties, while the right panel shows results based on the conventional assumption of 1% shape uncertainty. However, both panels show that different summation spectra give similar \(\varDelta \chi ^2\) values. The spread in results from each alternate spectrum is far narrower than the spread between results with and without shape uncertainty from fine structure. Bias in the underlying data is not contained in the published uncertainties, but the minimal effect from varying the spectra indicates that the true spectrum is unlikely to give results which will appreciably diminish the sensitivity of MH resolution.

Fig. 6
figure 6

Sensitivities from spectra with inputs varied within their uncertainties based on ENDF (red) and JEFF (blue). The left panel shows results based on Daya Bay shape uncertainties and the right shows results based on 1% shape uncertainty

3.4 Estimated fine-structure from summation spectra from the literature

In this section, we repeat the analysis using two spectra from Refs. [25, 26], also based on the summation method. As employed in the previous simulations, we use the Daya Bay measured spectrum as a reference spectrum. Then smeared out the summation spectra with 8% energy resolution and estimate the scale of (unobserved) fine structure based on the ratio of the original jagged spectrum to the smeared out spectrum. Again, even the exact shape of these two summation spectra are so different, we find that the corresponding scales of (unobserved) fine structures are similar and smaller than 1–2% over the low energy range (\(E_{\nu } = 2\)–6 MeV). The comparison of these two fine structures is shown in Fig. 7.

As we would expect from the similarity between the scale of fine structure obtained from each summation spectrum, the sensitivity of MH resolution is only slightly affected by these summation spectra. Results based on the estimated fine structures from Refs. [25] and [26] are shown in Fig. 8. The \(\varDelta \chi ^2\) based on the spectrum from [25] is 7.90, while the \(\varDelta \chi ^2\) based on the spectrum from [26] is 7.80. Both results use Daya Bay shape uncertainty and have very similar \(\varDelta \chi ^2\) values to that obtained from our own spectrum (\(\varDelta \chi ^2\) = 7.87). This suggests that the choice of summation spectra does not significantly affect the sensitivity of neutrino MH resolution, and reinforces the conclusion that introducing fine structure as additional shape uncertainty only slightly degrades sensitivity. As showed in Fig. 5, in both panels of Fig. 8, the sensitivities of the conventional assumption of 1% uniform shape uncertainties are much larger, regardless of whether we include shape uncertainty from fine structure.

Fig. 7
figure 7

The estimated scale of fine structure from two additional summation spectra generated by Dwyer [25] (green curve) and Sonzogni [26] (red curve)

4 MH discrimination with a near detector

In this section, we consider the scenario that using the spectrum measured by a proposed near detector (such as JUNO-TAO [48]), rather than the existing measurement from Daya Bay, as the reference spectrum in our simulation of MH resolution.

4.1 Motivations of a near detector

The results from previous sections suggest that fine structure is not likely to significantly degrade the sensitivity of MH resolution. However, it is still worthwhile to examine the potential effect of a near detector on MH discrimination in terms of its ability to measure fine structure. In fact, building an additional detector for MBRO experiments has been recently discussed in the literatures [43, 49, 50]. Particularly, the JUNO experiment [14] is planning to build a near detector 30–35 m from a European pressure water reactor (EPR) of 4.6 GW thermal power, JUNO-TAO [48]. Such detector is designed to be with target mass around 1 ton and the energy resolution is expected to be \(\sim \) 1.5\(\%/\sqrt{E/{\mathrm {MeV}}}\). With such an excellent energy resolution, the JUNO-TAO detector or any other near detector could improve the measurement on the undetermined fine structure and provide a more precise reactor neutrino spectrum.

Fig. 8
figure 8

Same as Fig. 5, but fine structure is estimated based on the summation spectra from the literature instead of our own generated samples. Left: Results with fine structure based on the spectrum in Ref. [25]; Right: Results with fine structure based on the spectrum from Ref. [26]

Taking the spectrum measured by a near detector as a reference spectrum will help cancel correlated systematic uncertainties, such as reactor neutrino shape uncertainties and also uncertainties due to the non-linear detector energy response correction [51]. However, building an identical far and near detector is not feasible because any far detector capable of determining the MH is quite large with a unique geometry, and there will therefore be many uncorrelated uncertainties to deal with. Additionally, if a near detector starts data taking after the far detector, this could introduce additional uncorrelated uncertainties. In our simulations, the proposed near detector is not used to cancel the correlated uncertainties, and we do not implement any model of detector nonlinearity. Our analysis focuses instead on determining the benefit of a near detectors ability to constrain the fine structure and thus reducing the uncertainty of the reference spectrum, which leads to smaller shape uncertainties in our simulation of the neutrino MH resolution at the original far detector.

Similar to the proposal of JUNO-TAO, we assume a small detector with 1 ton target-mass, located 33 m from the reactor core. In reality, there are several reactor cores located at different positions. Therefore, one small detector located near just one reactor will observe a slightly different spectrum than the original far detector due to differing fuel compositions between reactors. Such differences will generate more uncorrelated uncertainties. However, in this paper, we focus on the ideal case: one powerful reactor, one large far detector and one small near detector.

4.2 The energy resolution of the near detector

We first assume the systematic uncertainties of the near detector (ND) are same as the far detector: 1% detector-related uncertainty [14, 42, 43]. The baseline is set to be just 33 m. We assume sufficient exposure time for this mass and baseline that statistical uncertainty is negligible. Without loss of generality, we assume our summation spectrum (ENDF with additional TAS data) is the true spectrum which will be measured by a near detector. We use this spectrum to estimate the unobserved fine structure in the near detector. This spectrum is used to calculate the values of \(T_i\) in Eq. (5), which is the expected event rates measured in the far detector with 3% energy resolution. The near detector (measured) spectrum is taken as the reference spectrum, which is smoothed according to several different energy resolutions and used to calculate the values of \(F_i\) in Eq. (5). In other words, we fit the far detector data based on the smooth spectrum measured by the ND.Footnote 8

The results of this approach, shown in Fig. 9, shows that as we would expect from results reported in the previous section, detector uncertainty is more important to MH sensitivity than energy resolution. The lack of impact on sensitivity from energy resolution of ND, indicates that MH sensitivity is not appreciably affected by the fine structure predicted by current summation predictions, which is consistent with the results in our previous section. On the other hand, the detector uncertainty of ND could be important as it represents the uncertainty of the reference spectrum, which would be treated as shape uncertainty in our analysis of the data collected in far detector. More details about the detector uncertainty of ND will be discussed in Appendix B.

Fig. 9
figure 9

Sensitivity of MH resolution as the energy resolution of the near detector increases and for different detector uncertainty of ND. The near detector provides the reference spectrum, which is smoothed according to the energy resolution of the ND. Similar to our previous simulations based on the Daya Bay measurement in Sect. 3, the detector uncertainty of ND is treated as part of the shape uncertainty in the resolution of MH

5 Conclusion

In order to resolve the neutrino MH with MBRO experiments, it was argued that a precise measurement of the fine structure of the reactor antineutrino spectrum should be achieved. To study the impact of fine structure on neutrino MH determination, we have used different summation spectra to estimate the potential scale of the un-observed fine structure in the Daya Bay measurement and also a proposed near detector. All of these spectra predict similar scales of fine structure, which are small over the low energy range (\(E_{\nu } = 2\)–6 MeV) even with 8%/\(\sqrt{E/{\mathrm {MeV}}}\) energy resolution. Our simulations show that the impact of such fine structure on MH resolution is insignificant,Footnote 9 especially when compared to the intrinsic uncertainties of the reference spectrum. Compared to the unobserved fine structure, the detector uncertainty of the proposed near detector (or the systematic uncertainties of the Daya Bay measured spectrum) could be more important to the discrimination of the neutrino MH.