1 Introduction

Accumulation of more and stronger evidences of neutrino oscillations from several outstanding neutrino oscillation experiments with atmospheric [15], solar [616] and reactor [1720] neutrinos have proven beyond any doubt that neutrinos have mass and they oscillate. In fact, neutrino oscillations were the first unambiguous hint for physics beyond the standard model of elementary particles. In the standard framework of oscillations, the neutrino flavor states are linear superpositions of the mass eigenstates with well defined masses:

$$\begin{aligned} \left| \nu _{\alpha }\right\rangle =\sum _{i}U_{\alpha i} \left| \nu _{i}\right\rangle , \end{aligned}$$
(1)

where \(U\) is the \(3 \times 3\) unitary Pontecorvo–Maki–Nakagawa–Sakata (PMNS) [21, 22] mixing matrix. In the standard parameterisation [23], the PMNS matrix is given as:

$$\begin{aligned} U^{PMNS}= \left( \begin{array}{l@{\quad }l@{\quad }l} c_{12}c_{13} &{} s_{12}c_{13} &{} s_{13}e^{-i \delta } \\ -s_{12}c_{23}-c_{12}s_{23}s_{13}e^{i \delta }&{} c_{12}c_{23}-s_{12}s_{23}s_{13}e^{i \delta } &{} s_{23}c_{13} \\ s_{12}s_{23}-c_{12}c_{23}s_{13}e^{i \delta }&{} -c_{12}s_{23}-s_{12}c_{23}s_{13}e^{i \delta } &{} c_{23}c_{13} \end{array} \right) .\nonumber \\ \end{aligned}$$
(2)

Here, \(c_{ij}=\cos \theta _{ij}\), \(s_{ij}=\sin \theta _{ij}\) and \(\delta \) is the charge-parity (CP) violating phase. The neutrino mixing matrix \(U^{PMNS}\) can be parameterized in terms of three mixing angles \(\theta _{12}\), \(\theta _{23}\) and \(\theta _{13}\), and a CP phase \(\delta \) so that neutrino oscillations are determined in terms of these parameters as well as two mass squared differences, \(\Delta m^{2}_{21}\) and \(\Delta m^{2}_{32}\). The neutrino oscillations are only sensitive to differences of the squares of three neutrino masses \(m_{1}\), \(m_{2}\) and \(m_{3}\): \(\Delta m^{2}_{21} = m_{2}^{2}-m_{1}^{2}\) and \(\Delta m^{2}_{32}=m_{3}^{2}-m_{2}^{2}\).

The parameters \(\Delta m^{2}_{21}\) and \(\theta _{12}\) are constrained by the solar neutrino experiments. The atmospheric oscillation parameters \(\Delta m^{2}_{32}\) and \(\theta _{23}\) were first constrained by the Super-Kamiokande [1] experiment. The sensitivities of these atmospheric parameters were further improved by the MINOS [3] and T2K [4] experiments. Recently, the DAYA Bay [19], RENO [20], MINOS [24] and T2K [25] experiments have measured the third mixing angle \(\theta _{13}\). With the conclusive measurement of relatively large and non-zero value of \(\theta _{13}\) from these experiments, the effect of CP violation in neutrino oscillations is expected to be within the reach of future neutrino experiments. This discovery has also opened up a possibility to answer the various unsolved issues of current neutrino physics like whether the neutrino mass hierarchy is normal (\(m^{2}_{3} > m^{2}_{2}\)) or inverted (\(m^{2}_{3} < m^{2}_{2}\)), what the octant of \(\theta _{23}\) is (whether \(\theta _{23}\) \(<\) \(45^{\circ }\) or \(\theta _{23}\) \(>\) \(45^{\circ }\)), what is the value of CP violating phase \(\delta \), etc. Apart from these questions, the higher precision measurement of current neutrino mixing angles and mass square differences is also very important. The current best fit values and errors in the oscillation parameters on the basis of global neutrino analyses [2629] are summarised in Table 1. A large number of neutrino experiments are ongoing and proposed to achieve the above mentioned goals viz. MINOS [30], T2K [31], INO [3234], PINGU [5], Hyper-Kamiokande [35], NO\(\nu \)A [36] etc. Present work is focused only on the magnetised Iron CALorimeter (ICAL) detector at the India-based Neutrino Observatory (INO).

Table 1 Current best fit values of oscillation parameters and their 3 standard deviation range

India-based Neutrino Observatory (INO) is an approved project to construct an underground laboratory to be located at Theni district in southern India. The ICAL detector at INO will study mainly the atmospheric muon neutrinos and anti-neutrinos. Because of being magnetised, the ICAL detector can easily distinguish between atmospheric \(\nu _{\mu }\) and \(\bar{\nu }_{\mu }\) by identifying the charge of muons produced in Charged-Current interactions of these neutrinos in the detector. Re-confirmation of atmospheric neutrino oscillations, precision measurement of oscillation parameters and the determination of neutrino mass hierarchy through the observation of earth matter effects in atmospheric neutrinos are the primary physics goals of the INO-ICAL experiment. Matter effects in neutrino oscillations are sensitive to the sign of \(\Delta m^{2}_{32}\). Though the ICAL experiment is insensitive to \(\delta \) [37], it has been observed that INO mass hierarchy results together with other experiments can help to determine the value of \(\delta \) [38].

In this paper, we present the precision measurement of atmospheric neutrino oscillation parameters (\(|\Delta m^{2}_{32}|\) and \(\sin ^{2} \theta _{23}\)) and \(\theta _{23}\) deviation from the maximal mixing in a 3-flavor mixing scheme through the earth matter effect for the ICAL detector at INO.

The precision study of these parameters is important to assess the ICAL capability vis-a-vis other experiments. The sensitivity of the ICAL experiment for these oscillation parameters has already been studied by binning the events in the muon energy and muon angle, using realistic muon resolutions and efficiencies [39]. Here, however, we use a different approach to determine the sensitivity of the ICAL detector for the atmospheric neutrino mixing parameters. When an atmospheric \(\nu _{\mu }(\bar{\nu }_{\mu })\) interacts with the ICAL detector, it produces a \(\mu ^{+}(\mu ^{-})\) and a shower of hadrons. In order to extract the full information about the parent neutrino, information of muons along with that of hadrons is used in the analysis. Recently, it has been shown that including hadron information together with the muon events improves the ICAL potential for the measurement of neutrino mass hierarchy [40, 41]. Since the neutrino energy cannot be measured directly, therefore, in the analysis presented here, the neutrino energy is obtained by adding the energy deposited by the muons and hadron inside the ICAL detector. We then use this neutrino energy (\(E_{\nu }\)) and muon angle (\(\cos \theta _{\mu }\)) as observables for the \(\chi ^{2}\) estimation. An earlier analysis have used hadron information, but with constant resolutions to obtain the neutrino energy [42]. In the present work, we show the ICAL potential for the neutrino oscillation parameters using effective realistic ICAL detector resolutions.

The analysis starts with the generation of the neutrino events with NUANCE [43] and then events are binned into \(E_{\nu }\) and \(\cos \theta _{\mu }\) bins. Various resolutions and efficiencies obtained by the INO collaboration from a GEANT4 [44] based simulation are applied to these binned events in order to reconstruct the neutrino energy and muon direction. Finally, a marginalised \(\chi ^{2}\) is estimated over the allowed ranges of neutrino parameters, other than \(\theta _{23}\) and \(|\Delta m^2_{32}|\), after including the systematic errors.

2 The ICAL detector and atmospheric neutrinos

The ICAL detector at INO [32, 33] will be placed under approximately 1 km of rock cover from all directions to reduce the cosmic background. The detector will have three modules, each of size 16 m \(\times \) 16 m \(\times \) 14.45 m in the x, y and z directions respectively. ICAL consists of 151 horizontal layers of 5.6 cm iron plates with 4 cm of gap between two successive iron layers. Gaseous detectors called Resistive Plate Chambers (RPCs) of dimension 2 m \(\times \) 2 m will be used as active detector elements and will be interleaved in the iron layer gap. RPC detectors are known for their good time resolution (\(\sim \)1 ns) and spatial resolution (\(\sim \)3 cm). The RPCs provide two dimensional readouts through the external copper pick up strips placed above and below the detector. Total mass of the detector is approximately 50 kt which will provide the statistically significant data to study the weakly interacting neutrinos. A magnetic field of upto 1.5 T will be generated through the solenoidal shaped coils placed around the detector [45, 46]. The ICAL detector can easily identify the charge of muons due to this applied magnetic field, and hence, can easily distinguish between neutrinos and anti-neutrinos.

Atmospheric muon neutrinos and anti-neutrinos are the main sources of events for the ICAL detector. When cosmic rays interact with the earth’s upper atmosphere, they produce pions which further decay into leptons and corresponding neutrinos. The dominant channels of the decay chain producing atmospheric neutrinos, are

$$\begin{aligned}&\pi ^{+} \rightarrow \mu ^{+} \nu _{\mu }, \quad \mu ^{+} \rightarrow e^{+}\nu _{e}\bar{\nu _{\mu }}, \nonumber \\&\pi ^{-} \rightarrow \mu ^{-} \bar{\nu _{\mu }}, \quad \mu ^{-} \rightarrow e^{-}\bar{\nu _{e}}\nu _{\mu }. \end{aligned}$$
(3)

Atmospheric neutrinos come in both \(\nu _{\mu }\) and \(\nu _{e}\) ( \(\bar{\nu }_{\mu }\) and \(\bar{\nu }_{e}\)) flavors with the \(\nu _{\mu }\) flux almost double that of \(\nu _{e}\) flux. Due to the large flight path and the wide coverage of the energy range (from few hundred MeV to TeV), atmospheric neutrinos play an important role in studying the neutrino oscillations. Neutrinos and anti-neutrinos interact differently with earth matter. We can use this special feature to measure the sign of \(\Delta m^{2}_{32}\), and hence, the correct mass ordering.

3 Analysis

The atmospheric neutrino events are generated with the available 3-dimensional neutrino flux provided by HONDA et al. [47] using ICAL detector specifications. The interactions of atmospheric muon neutrino and anti-neutrino fluxes with the detector target are simulated by the NUANCE neutrino generator for 1000 years of exposure of the 50 kt ICAL detector. For the purpose of quoting the final sensitivity we normalise the 1000 years data to 10 years of exposure to keep Monte Carlo fluctuations under control; following a similar approach used in the earlier ICAL analyses [37, 39]. The ICAL is highly sensitive to charged-current (CC) interactions where charged muons produced along with the hadron shower can be identified clearly though the RPC detectors. Since the resolutions and efficiencies studies for such events have been done by the INO collaboration [46, 48] and are available, only the events generated through CC interactions are considered for the present analysis. It has been estimated that the background from the neutral current (NC) interactions for a magnetised iron neutrino detector (MIND), similar to ICAL, can be reduced to the level of about a percent, and the contribution of \(\nu _{\mu } \rightarrow \nu _{\tau }\) oscillation background is between 1–4 % [49]. Therefore, we have neglected these effects in the current analysis for the time being.

Neutrino oscillations can be incorporated into the NUANCE code to generate the oscillated neutrino flux at the detector for different values of the oscillation parameters. However, this process requires large computational time and resources. Therefore, we simulate the interactions of atmospheric neutrinos with the detector in the absence of oscillations and the effect of oscillations is included by using the re-weighting algorithm described in Refs. [37, 39]. For each neutrino event of a given energy \(E_{\nu }\) and zenith direction \(\theta _{z}\), oscillation probabilities are estimated taking earth matter effects into account. The path length traversed by neutrinos from the production point to the detector, which is needed as an input parameter in the oscillation probability estimation, is obtained as:

$$\begin{aligned} L \!=\! \sqrt{(R_{earth}+R_{atm})^{2}\!-\!(R_{earth}\sin \theta _{z})^{2}} \!-\! R_{earth}\cos \theta _{z},\nonumber \\ \end{aligned}$$
(4)

where \( R_{earth}\) is the radius of the earth and \(R_{atm}\) is the average height of the production point of neutrinos in the atmosphere. We have used \(R_{earth}\) \(\approx \) 6371 km and \(R_{atm}\) \(\approx \) 15 km. Here, we assume that \(\cos \theta _{z}=1\) is the downward and \(\cos \theta _{z}=-1\) is the upward direction for incoming neutrinos. The oscillation parameters used in the analysis are listed in Table 1. For the precision measurement studies, we assume normal hierarchy of neutrinos.

In order to separate the muon neutrino and anti-neutrino events on the basis of their oscillation probabilities, each NUANCE generated unoscillated neutrino event was subjected to the oscillation randomly by applying the event re-weighting algorithm. Since \(\nu _{e}\) may also change flavor to \(\nu _{\mu }\) due to oscillations, therefore, in order to include this contribution, we simulate the interactions of \(\nu _{e}\) flux with the ICAL detector in the absence of oscillations using NUANCE and applying a re-weighting algorithm for the \(\nu _{e} \rightarrow \nu _{\mu }\) channel. Hence, the total event spectrum consists of \(\nu _{\mu }\) events coming from both the oscillation channels (i.e. \(\nu _{\mu } \rightarrow \nu _{\mu }\) and \(\nu _{e} \rightarrow \nu _{\mu }\)).

3.1 ICAL detector resolutions and the neutrino energy reconstruction

Due to the charged-current interaction of the neutrinos in the detector, muons along with the showers of hadrons are produced. Reconstruction of the neutrino energy requires the reconstruction of muon as well as hadron energy. Once we have the reconstructed muon and hadron energies, we directly add them together to get the final reconstructed neutrino energy. Muon and hadron energy resolutions have been obtained by the INO collaboration as a function of true energies and true directions of muons or hadrons using a GEANT4 [44] based code [39, 46]. Muons give a clear track of hits inside the magnetised detector, therefore the energy of muons can be reconstructed easily using a track fitting algorithm. It was observed that the muons energy reconstructed by the ICAL detector follows a Gaussian distribution for \(E_{\mu } \ge 1\) GeV whereas it follows a Landau distribution for \(E_{\mu } < 1\) GeV. On the other hand, hadrons do not travel too far in the ICAL and hence they feel a negligible effect of the magnetic field before depositing their energies in a shower like pattern [48]. The total energy deposited by the hadron shower (\(E^{\prime }_{had} = E_{\nu }-E_{\mu }\)) has been used to calibrate the detector response. It has been found that hadron hit patterns follow a Vavilov distribution [50]. The hadron energy resolution has been fitted as a function of \(E^{\prime }_{had}\) [48]. In the present analysis, muon energy and angular resolutions are implemented by smearing the true muon energy and direction of each \(\mu ^{+}\) and \(\mu ^{-}\) event using the ICAL muon resolution functions [46]. True hadron Energies are smeared using the ICAL hadron resolution functions [48]. Reconstructed neutrino energy is then taken as the sum of smeared muon and hadron energy. Figure 1 shows the true and reconstructed neutrino and anti-neutrino energies obtained from the \(\nu _{\mu }\rightarrow \nu _{\mu }\) channel while Fig. 2 shows the same for \(\nu _{e}\rightarrow \nu _{\mu }\) channel. It can be seen that at lower incoming neutrino energies (\(E_{\nu }\le 1\)), reconstruction of neutrino energy at ICAL is poor due to the effect of detector resolutions in this range.

Fig. 1
figure 1

True neutrino energy (red-dashed line) and the reconstructed neutrino energy (blue-solid line) from NUANCE simulated data for a neutrino events and b anti-neutrino events, from \(\nu _{\mu }\rightarrow \nu _{\mu }\) oscillation channel

Fig. 2
figure 2

True neutrino energy (red-dashed line) and the reconstructed neutrino energy (blue-solid line) from NUANCE simulated data for a neutrino events and b anti-neutrino events, from \(\nu _{e}\rightarrow \nu _{\mu }\) oscillation channel

Since the muon direction reconstruction is extremely good for ICAL, and hadron direction information not available yet, we have used the reconstructed muon directions in the final analysis.

The reconstruction and charge identification efficiencies (CID) for \(\mu ^{-}\) and \(\mu ^{+}\) for the ICAL detector are included into analysis by simply weighting each event with its reconstruction and relative charge identification efficiency. Though the CID efficiencies of the ICAL detector are \(\ge \!\!90\,\%\) beyond \(E_{\nu }\sim 1\) GeV [46], it is still possible that some muon events (say \(\mu ^{+}\)) are wrongly identified as of the opposite charge particle (say \(\mu ^{-}\)). So, the total number of events reconstructed as \(\mu ^{-}\) will increase by

$$\begin{aligned} N^{\mu ^{-}}= N^{\mu ^{-}}_{RC}+(N^{\mu ^{+}}_{R}- N^{\mu ^{+}}_{RC}), \end{aligned}$$
(5)

where \(N^{\mu ^{-}}\) are the number of total reconstructed \(\mu ^{-}\) events. \(N^{\mu ^{-}}_{RC}\) are the number of \(\mu ^{-}\) events reconstructed and correctly identified in charge and \(N^{\mu ^{+}}_{RC}\) are the number of \(\mu ^{+}\) events with their respective reconstruction and CID efficiencies folded in; whereas \(N^{\mu ^{+}}_{R}\) are the number of \(\mu ^{+}\) events with the reconstruction efficiency only. Hence, \(N_{R}-N_{RC}\) gives the fraction of reconstructed events that have their charge wrongly identified. Total reconstructed \(\mu ^{+}\) events can be obtained using a similar expression with charge reversal.

4 \(\chi ^{2}\)- Estimation

The sensitivity of the atmospheric neutrino oscillation parameters for ICAL is estimated by minimising the \(\chi ^{2}\) for the neutrino data simulated for the ICAL detector. The re-weighted events, with detector resolutions and efficiencies folded in, are binned into reconstructed neutrino energy and muon direction for the determination of \(\chi ^{2}\). The data has been divided into total 20 varied neutrino energy bins in the range of 0.8–10.8 GeV. Since most of the atmospheric neutrino events come below the neutrino energy \(E_{\nu } \sim \) 5 GeV, we have a finer energy binning with a bin width of 0.33 GeV from 0.8 to 5.8 GeV with a total of 15 energy bins. The high energy events, i.e. from 5.8 to 10.8 GeV, are divided into total 5 equal energy bins with a bin width of 1 GeV. A total of 20 \(\cos \theta _{\mu }\) direction bins in the range [\(-1\), 1] with equal bin width, have been chosen. The bin size for the analysis has been optimised such that each bin contains at least one event. The above mentioned binning scheme is applied for both \(\nu _{\mu }\) and \(\bar{\nu }_{\mu }\) events.

We use the maximal mixing, that is, \(\sin ^{2}\theta _{23}=0.5\) as the reference value. The atmospheric mass square splitting is related to the other oscillation parameters, so for the precision study we have used \(\Delta m^{2}_{eff}\), which can be written as [37, 51],

$$\begin{aligned} \Delta m^{2}_{eff}= & {} \Delta m^{2}_{32}\nonumber \\&-(\cos ^{2}\theta _{12}-\cos \delta \sin \theta _{23}\sin 2\theta _{12}\tan \theta _{23})\Delta m^{2}_{21}.\nonumber \\ \end{aligned}$$
(6)

The other oscillation parameters (\(\theta _{12}\), \(\Delta m^{2}_{21}\) and \(\delta \)) are kept fixed both for observed and predicted events as the marginalisation over these parameters has negligible effects on the analysis results. Since in our analysis, the event samples are distributed in terms of reconstructed neutrino energy and the muon zenith angle bins, we call these events as neutrino-like events that is, we refer to \(N^{\mu ^-}\) as \(N(\nu _\mu )\) and \(N^{\mu ^+}\) as \(N(\bar{\nu }_\mu )\).

The various systematic effects on the \(\chi ^{2}\) have been implemented through five systematic uncertainties, viz. 20 % error on atmospheric neutrino flux normalisation, 10 % error on neutrino cross-section, a 5 % uncertainty due to zenith angle dependence of the fluxes, an energy dependent tilt error, and an overall 5 % statistical error, as applied in earlier ICAL analyses [37, 39]. The systematic uncertainties are applied using the method of “pulls” as outlined in Ref. [52]. Briefly, in the method of pulls, systematic uncertainties and the theoretical errors are parameterised in terms of set of variables \(\zeta _{k}\), called pulls. Due to the fine binning, some bins may have very small number of entries, therefore, we have used the poissonian definition of \(\chi ^{2}\) given as

$$\begin{aligned} \chi ^2(\nu _{\mu })= & {} min\sum _{i,j}\left( 2 (N^{th^{\prime }}_{ij}(\nu _{\mu })-N^{ex}_{i,j}(\nu _{\mu })) \right. \nonumber \\&\left. +\,2N^{ex}_{i,j}(\nu _{\mu }) (\ln \frac{N^{ex}_{i,j}(\nu _{\mu })}{N^{th^{\prime }}_{i,j}(\nu _{\mu })})\right) +\sum _{k}\zeta ^{2}_{k}, \end{aligned}$$
(7)

where

$$\begin{aligned} N^{th^{\prime }}_{ij}(\nu _{\mu }) = N^{th}_{i,j}(\nu _{\mu })\left( 1 + \sum _{k}\pi ^{k}_{ij}\zeta _{k}\right) . \end{aligned}$$
(8)

Here, \(N^{ex}_{ij}\) are the observed number of reconstructed \(\mu ^{-}\) events, as calculated from Eq. (5), generated using true values of the oscillation parameters as listed in Table 1 in the \(i\mathrm{th}\) neutrino energy bin and \(j\mathrm{th} \cos \theta _{\mu }\) bin. In Eq. (8), \(N^{th}_{ij}\) are the number of theoretically predicted events generated by varying oscillation parameters, \(N^{th^{\prime }}_{ij}\) represents the modified events spectrum due to the systematic uncertainties, \(\pi ^{k}_{ij}\) is the systematic shift in the events of \(i\mathrm{th}\) neutrino energy bin and \(j\mathrm{th} \cos \theta _{\mu }\) bin due to \(k\mathrm{th}\) systematic error. \(\zeta _{k}\) is the univariate pull variable corresponding to the \(\pi ^{k}_{ij}\) uncertainty. An expression similar to Eq. (7) can be obtained for \(\chi ^{2}(\bar{\nu }_{\mu })\) using reconstructed \(\mu ^{+}\) event samples. We have calculated \(\chi ^2(\nu _{\mu })\) and \(\chi ^2(\bar{\nu }_{\mu })\) separately and then these two are added to get total \(\chi ^2_{total}\) as

$$\begin{aligned} \chi ^2_{total} =\chi ^{2}(\nu _{\mu }) + \chi ^{2}(\bar{\nu }_{\mu }). \end{aligned}$$
(9)

We impose the recent \(\theta _{13}\) measurement as a prior while marginalising over \(\sin ^{2}\theta _{13}\) as

$$\begin{aligned} \chi ^2_{\textit{ical}} =\chi ^{2}_{total} +\left( \frac{\sin ^{2}\theta _{13}(true)-\sin ^{2}\theta _{13}}{\sigma _{\sin ^{2}\theta _{13}}}\right) ^2. \end{aligned}$$
(10)

The value of \(\sigma _{\sin ^{2}\theta _{13}}\) was taken as \(10\,\%\) of the true value of \(\sin ^{2}\theta _{13}\).

Finally, in order to obtain the experimental sensitivity for \(\theta _{23}\) and \(|\Delta m^{2}_{32}|\), we minimise the \(\chi ^2_{\textit{ical}}\) function by varying oscillation parameters within their allowed ranges over all systematic uncertainties.

The octant sensitivity for ICAL has been estimated using neutrino-like events considering Normal hierarchy. The significance of ruling out the wrong octant is given by

$$\begin{aligned} \Delta \chi ^{2} = \chi ^{2} (false~octant)-\chi ^{2} (true~octant), \end{aligned}$$
(11)

where \(\chi ^{2}\) (true octant) has been obtained by considering both the predicted and observed event spectrum in the true octant while the \(\chi ^{2}\) (false octant) has been obtained by assuming predicted events with the true octant and observed events with the false octant. Note that for this study we kept all the oscillation parameters fixed and the analysis has been performed for different true values of \(\sin ^{2}\theta _{23}\).

We also performed the mass hierarchy determination using analysis method and the oscillation parameters discussed in this paper and found no appreciable improvement in the hierarchy determination over muon angle and muon energy analysis [37] as already verified earlier [40].

5 Results

The two dimensional confidence region of the oscillation parameters (\(|\Delta m^{2}_{eff}|\), \(\sin ^{2}\theta _{23}\)) are determined from \(\Delta \chi ^{2}_{\textit{ical}}\) around the best fit. The resulting region is shown in Fig. 3. These contour plots have been obtained assuming \(\Delta \chi ^{2}_{\textit{ical}} = \chi ^{2}_{min} + m\), where \(\chi ^{2}_{min}\) is the minimum value of \(\chi ^{2}_{\textit{ical}}\) for each set of oscillation parameters and values of \(m\) are taken as 2.30, 4.61 and 9.21 corresponding to 68, 90 and 99 % confidence levels [23] respectively for two degrees of freedom. Figure 4a depicts the one dimensional plot for the measurement of test parameter \(\sin ^{2}\theta _{23}\) at constant value of \(|\Delta m^{2}_{eff}|=2.4\,\times \,10^{-3}\) (eV\(^{2}\)) and Fig. 4b for the \(|\Delta m^{2}_{eff}|\) at constant \(\sin ^{2}\theta _{23} = 0.5\) at 1\(\sigma \), 2\(\sigma \) and 3\(\sigma \) levels for one parameter estimation [23].

Fig. 3
figure 3

Contour plots for \(\sin ^2(\theta _{23})\) and \(|\Delta m^{2}_{eff}|\) measurements at 68, 90 and 99 % confidence level for 10 years exposure of ICAL detector

Fig. 4
figure 4

a \(\Delta \chi ^{2}\) as a function of different test values of \(\sin ^{2}\theta _{23}\) and b \(\Delta \chi ^{2}\) as a function of different input values of \(|\Delta m^{2}_{32}|\)

The precision on the oscillation parameters can be defined as:

$$\begin{aligned} Precision = \frac{P_{max}-P_{min}}{P_{max}+P_{min}}, \end{aligned}$$
(12)

where \(P_{max}\) and \(P_{min}\) are the maximum and minimum values of the oscillation parameters concerned at a given confidence level. The current study shows that ICAL is capable of measuring the atmospheric mixing angle \(\sin ^{2}\theta _{23}\) with a precision of 13, 21 and 27 %, at 1\(\sigma \), 2\(\sigma \) and 3\(\sigma \) confidence levels respectively. The atmospheric mass square splitting \(|\Delta m^{2}_{32}|\) can be measured with a precision of 4, 8 and 12 % at 1 \(\sigma \), 2 \(\sigma \) and 3 \(\sigma \) confidence levels respectively. These numbers show an improvement of 20 and 23 % on the precision measurement of \(\sin ^{2}\theta _{23}\) and \(|\Delta m^{2}_{32}|\) parameters respectively at 1\(\sigma \) level over muon energy and muon direction analysis [39]. These results shows that the inclusion of hadron information together with muon information significantly improves the capability of the ICAL detector for the estimation of oscillation parameters. These results may further be improved by including the neutrino direction in the \(\chi ^{2}\) definition, a work under progress in the INO collaboration.

Figure 5 show the \(\chi ^2\) plot for the identification of octant sensitivity for different true values of \(\sin ^{2}\theta _{23}\) assuming Normal hierarchy. It can be seen from this figure that using neutrino energy and muon direction as two dimensional observables, ICAL can identify the lower octant when \(\sin ^{2}\theta _{23}<0.46 \) (\(\sin ^{2}\theta _{23}<0.40\)) with 1\(\sigma \) (2\(\sigma \)) confidence levels. Similarly, the higher octant can be identified when \(\sin ^{2}\theta _{23} > 0.58\) (\(\sin ^{2}\theta _{23} > 0.63\)) with 1\(\sigma \) (2\(\sigma \)) confidence levels. It has also been observed that the ICAL sensitivity deteriorates on approaching the \(\theta _{23}\) closer to its maximal mixing value (\(\sin ^{2}\theta _{23} =0.5 \)).

Fig. 5
figure 5

\(\Delta \chi ^{2}_{false-true~octant}\) for different input values of \(\sin ^{2}\theta _{23}\)

The two-dimensional contour plots in the \(\sin ^{2}\theta _{23}\) and \(\Delta m^{2}_{32}\) plane provides the significance levels for the octant sensitivity assuming the true lower octant value (\(\sin ^{2}\theta _{23} =0.4\)) and true higher octant value (\(\sin ^{2}\theta _{23} =0.65\)) and is shown in Fig. 6. It can be seen from Fig. 6 that the ICAL is able to determine the deviation of \(\theta _{23}\) from the maximal mixing upto 2\(\sigma \) confidence level in 10 years of running. The results presented here for octant sensitivity studies are comparable with the results of the three-dimensional analysis using hadron information at ICAL [41].

Fig. 6
figure 6

Contour plots indicating 68, 90 and 99 % CL a at true \(\sin ^{2}\theta _{23}= 0.4\) and b at true \(\sin ^{2}\theta _{23}= 0.65\) assuming NH is true for 10 year of ICAL exposure. The fluctuations in the plots results from the implementation of resolutions and efficiencies through Monte-Carlo method

6 Conclusions

The magnetised ICAL detector at INO has a potential to reveal several neutrino properties, especially the mass hierarchy of the neutrino through earth matter effect and a comprehensive information on neutrino oscillation parameters. We have studied the ICAL detector capability for the precise measurement of atmospheric neutrino oscillation parameters using neutrino energy and muon angle as observables. A Monte Carlo simulation using NUANCE generated neutrino data for 10 years exposure of the ICAL detector has been carried out. The analysis has been performed in the framework of three neutrino flavor mixing and by taking the earth matter effect into account. A marginalised \(\chi ^{2}\) analysis in fine bins of reconstructed neutrino energy and muon angle has been performed. Realistic detector resolutions and efficiencies, generated from ICAL detector simulation have been utilised. The effect of various systematic uncertainties have also been included in the analysis.

The current analysis takes into account \(\nu _{\mu }\) events coming from CC interactions. However, there will also be a small (\(\sim \)1 %) contribution from NC interactions and from the \(\nu _{\tau }\) CC interactions which we have neglected for the time being. These small effects are being studied and will be included in the future ICAL analysis. Moreover, this study is a demonstration of the fact that the ICAL experiment has the capability of harnessing hadron information to further improve the measurement of oscillation parameters.

We conclude that by using reconstructed neutrino energy and muon direction there is an average improvement of about 20 \(\%\) on the precision measurement of both the parameters (\(\sin ^{2}\theta _{23}\) and \(|\Delta m^{2}_{32}|\)) over muon energy, muon angle analysis [39]. The octant sensitivity study shows that ICAL is able to discrimante the octant of \(\theta _{23}\) with a significance of 2\(\sigma \) for 10 year exposure. The mass hierarchy determination using the present analysis does not improve significantly over the muon energy and muon angle only analysis.