Back analysis was performed for 14 events following the chart flow on Fig. 2. Examples of the results shown here are from Step 4 to Step 6 (Fig. 2).
Examples from Step 4 to Step 6
In Figs. 4, 5, 6 and 7, a (indicates expected behavior before an event occurred, “warning”) b (indicates an event occurrence (ML ≥ 0.8) without expected precursory behavior before, “missed event”) and c (indicates expected behavior with no event occurrence, “false warning”).
In one case the ore-pass-related events were filtered out (Step 4). Examples of hazard indicators behavior for this event with unfiltered and filtered ore-pass-related events are shown in Figs. 4 and 5.
An example of an event that is possibly related to two blasts: production blast 22 h before (65 m away) and development blast 20 h (94 m away) is shown in Fig. 5. It should be noted that these two blasts were outside the analyzed source sphere with a radius of 48 m.
An example of an event that is related neither to a blast or is ore-pass-related event is shown in Fig. 6.
The example of an event with ore-pass-related events (Fig. 3) shows all the events within a sphere with a source radius of 48 m (Fig. 3, top left. The indicator behavior for SAR (Fig. 3, top right) and ASF (Fig. 3, bottom right) before the main analyzed event were found to be not as expected (b case). Both SAR and ASF are expected to increase. However, CSM (Fig. 3, middle left), EI (Fig. 3, middle right) and CAV (Fig. 3, bottom left) showed an expected behavior—an increase in CSM and CAV and drop in EI (a cases) before the main analyzed event. On the same Fig. 3, the background behavior for the 25-day period before 5 days analyzed for the main event showed expected behavior for several occasions but no event occurrence was observed in the sphere (false warning, case c) and many of these false warnings were recorded from ASF (Fig. 3, bottom right).
When the ore-pass-related events were manually filtered out from the sphere around the main event, some of the indicator behaviors changed as shown in Fig. 4. For example one more false warning case of (c case) was observed (Fig. 4, bottom left). The behavior of SAR, remained the same however, small change without substantial increase was observed in SAR (b case, again) and decrease in ASF (b case, again). The number of false warnings for ASF (expected behavior with no event occurring, b) decreased in the first 25 days from 6 to 4 (Fig. 4, bottom right).
An example of an event with blasts in proximity (Fig. 5) showed opposite behaviors (event but no alarms, case b) before the main analyzed event, for all indicators: SAR, CSM, EI, CAV, ASF (Fig. 5).
An event with ML > 0 in the background (25-day period before the main event) occurred around 11 June 2012, where all indicators showed expected behavior (case b) a day before. At the end of May 2012 expected behavior with no event occurrence was observed for SAR, CSM and CAV but not for EI and ASF (Fig. 5). It should be noted that this was right in the beginning of analysed period.
An example of an event with neither ore pass events nor blasts in proximity (Fig. 6) showed foreshock event with ML > 0 before the main analyzed event. All indicators showed expected behaviors (case a) before the event. Expected behavior with no event occurring (case c) for other events in the 25-day period background was also observed on all indicators with many counts of ASF (Fig. 6).
Indicator Performance for the Main Analyzed Events
For each back analyzed event a value of the indicator was set equal to “1” if the expected behavior (warning) was observed before the analyzed event occurrence (case a), and equal to “0” if there was no expected behavior (no warning) before the event occurred (case b). Each indicator was assessed to determine its performance in terms of warning (A) or no warning (B) using the following equations:
$$A_{i} = \frac{{\mathop \sum \nolimits_{j} a_{ij} }}{N} \times 100$$
(1)
$$B_{i} = \frac{{\mathop \sum \nolimits_{j} b_{ij} }}{N} \times 100,$$
(2)
where i = \(1 (SAR),\;2(SCM),\;3(EI),\;4(CAV) \;{\text{or}} \;5(ASF)\), j = 1,…, N (14 analyzed events).
$$a_{ij} = \left\{ {\begin{array}{*{20}c} {0 - no\; expected \;precursor\; behaviour} \\ {1 - expected \;precursor \;behaviour } \\ \end{array} } \right\}$$
$$b_{ij} = \left\{ {\begin{array}{*{20}c} {1 - no \;expected \;precursor\; behaviour} \\ {0 - expected \;precursor \;behaviour } \\ \end{array} } \right\}$$
N = total number of analyzed events (14 events), Ai = total percentage of warnings for indicator i before an event occurred, Bi = total percentage of no warnings for indicator i before an event occurred.
Equations (1) and (2) were applied for each indicator i for all events N and the results are presented in Fig. 7.
The results showed that SAR, CSM, and CAV were equally reliable with warning in 71.4% of cases, followed by EI (in 64.3%). ASF was the least reliable with warning only in 50% of all cases (Fig. 8).
Indicator Behavior Before the Main Event (Background Seismicity)
During the period of 30–5 days before the main event (background seismicity), it was observed that events with ML > 0 had prominent warnings for all five indicators (SAR, CSM, EI, CAV and ASF). We have decided to look separately into these events and evaluate the warning merits for them.
The behavior of all five indicators (SAR, CSM, EI, CAV and ASF) was also analyzed before the main event in the same sphere for a period of 25 days (background seismicity). The main aim was to see if similar type of indicator behavior that was observed for the main analyzed event could be identified for some other comparatively large events (0.0 ≤ ML < 0.8) in the sphere. Similar analysis approach used for the main back-analyzed events was used here except that an additional behavior was identified, when indicators were observed but there was no seismic event (case c, false warning). In the end three types of behavior were assessed for background events: an expected behavior before a large event occurred (a), large event occurrence without expected behavior (b) or expected behavior with no large event occurrence (c). The analyses of indicator behavior were done into two different categories: first category is when there was an event (warning or no warning was observed) and the second category was when there was no event but false warning was observed. To quantify the performance of the indicators in each category “1” was assigned if warning or false warning behavior was observed; otherwise, “0” was assigned.
Indicator Behavior for Background Events with ML = 0.0–0.8 (Category 1)
Similar analysis approach used for the main back-analyzed events was used also here. In total twenty-two such cases were observed. The equation below was used to obtain the result (summarized in Fig. 8).
$$X_{l} = \frac{{\mathop \sum \nolimits_{k} a_{lk} }}{N } \times 100$$
(3)
$$Y_{l} = \frac{{\mathop \sum \nolimits_{k} b_{lk} }}{N } \times 100$$
(4)
where l = \(1 (SAR),\;2(SCM),\;3(EI),\;4(CAV) \;or\; 5(ASF)\), k = 1,…, N (17 analyzed events)
$$a_{lk} = \left\{ {\begin{array}{*{20}c} {0 - no \;expected\; precursor \;behaviour} \\ {1 - expected \,precursor \;behaviour } \\ \end{array} } \right\}$$
$$b_{lk} = \left\{ {\begin{array}{*{20}c} {1 - no\; expected \;precorsor \;behaviour} \\ {0 - expected\; precursor \;behaviour } \\ \end{array} } \right\}$$
N—total number of analyzed cases (17 events), Xl—total percentage of false warnings for indicator i, Yl—total percentage of no false warnings for indicator i,\(Z_{l} = 100 - (X_{l} + Y_{l} )\)—total percentage of undefined cases.
For this kind of events there is also undefined behavior (UD) as some of the events occurred at the beginning of the studied time interval and there was no information about the EI, CAV, and ASF indicators. The results showed that CSM and CAV were equally reliable with warning in 78.6% of 17 cases, followed by SAR (in 64.3%). EI and ASF were the least reliable with warning only in 50% of all cases (Fig. 8). These results are very similar to the results for the main events with ML ≥ 0.8.
False and Missed Alarms for Background Events (Category 2)
We have looked into the cases of false warnings (cases c) separately to see which of the indicators gave the highest number of false warnings and which ones the least warnings or no warnings at all. The equation below was used to obtain the result summarized in Fig. 9.
$$U_{l} = \frac{{\mathop \sum \nolimits_{k} u_{lk} }}{N } \times 100$$
(5)
where l = \(1 (SAR),\;2(SCM),\;3(EI),\;4(CAV) \;or\; 5(ASF)\), k = 1,…, N (22 observations).
$$u_{lk} = \left\{ {\begin{array}{*{20}c} {0 - no\; false\; warning \;precursor \;behaviour} \\ {1 - false\; warning\; precursor \; behaviour } \\ \end{array} } \right\}$$
N = total number of observed cases (22 observations), Ul = total percentage of false warnings for indicator i.
The results show that SAR and CAV false warnings were observed in the largest number of cases (73.7%) followed by CSM (68.4%). Even though these three indicators scored high for giving false warnings before occurrence of a seismic event, they also had the highest scores of no warning in case of an event. EI had the lowest false warnings but it should be noted that it has a large number of unranked events (47.4%) followed by ASF (36.8%) due to number of events in the sphere (Fig. 9).
Scoring of the Combined Indicator Values for the Main Analyzed Events and the Background Events
The sum of the warnings (K) or the score of combined five indicators for each main analyzed event and background events was calculated. The sum ranges between 0 and 5 since there were five indicators. The main aim for scoring based on combined indicator values was to determine the cooperation between the five indicators for all main analyzed events in terms either deformation and stress changes. The score of the combined indicators Kj, (1,2, …, 14) for each event was calculated using the following equation:
$$K_{j} = \mathop \sum \limits_{i} a_{ij}$$
(6)
where i = \(1 (SAR),\;2(SCM),\;3(EI),\;4(CAV) \;or\; 5(ASF)\), j = 1,…, N (N = 14 main analyzed events, 14 events ML 0.0–0.8 and 19 false warning cases),
$$a_{ij} = \left\{ {\begin{array}{*{20}c} {0 - no \;expected \;precursor \;behaviour} \\ {1 - expected \;precursor \;behaviour } \\ \end{array} } \right\}.$$
The summary of the results is presented in Figs. 10 and 11 for the events with ML 0.0 to 0.8 and above 0.8 (main events), and for the case of false warnings.
Out of all fourteen main events selected for back analysis, 35.7% events had a score K of 5, followed by 28.6% of events with a score 4, then 21.4% of events had a score 0. For 7.1% of the event the score was 3 or 2 (Fig. 10).
A similar trend was observed for the events with ML 0.0–0.8 where the highest score 5 was observed for 28.6% of the cases followed by score 4 and 1 for 21.4%. The lowest score 3 and 2 was observed by 14.3%. No warning or only 1 indicator was observed in 21.4% of the cases for the main event and the background seismicity, correspondingly (Fig. 10).
In overall, at least four stress and/or deformation indicators were observed for at least 50% of the cases with ML 0.0–0.8 and more than 60% of the cases with ML = 0.8–2.0 (Fig. 10).
In 26% of the cases we have 5 indicators working simultaneously and in 42% more than four indicators (Fig. 11), giving false warning for large seismic events.
Ranking of the Indicator Behavior Performance
The indicators were ranked to determine the ones with the highest performance of warning before an event occurred (Table 3), false warning and no warning (Table 4) for all events.
Table 3 Ranking of indicators’ warning performance Table 4 Ranking of indicators false and no warning performance for background seismicity For the main analyzed events SAR, CSM and CAV were the first three with the highest warning performance before the events occurred. ASF ranked the lowest preceded by EI (Table 3). For the background seismicity events (with ML 0.0–0.8), CSM and CAV were the first two with the highest warning performance before the events occurred followed by SAR. EI and ASF ranked the lowest (Table 3).
For the ‘background events’, we have also ranked the performance behavior for false indicators (Table 4).
The top three indicators (CAV, SAR, CSM) that ranked the highest with warning performance also have the highest rank of false warnings. On contrary, the indicators that were least reliable for warning (EI) showed the least false warnings (Table 4).