In this section, we compare the different allocation protocols using six different regions that differ in the number of demand points, population size, surface area, demand distribution and the potential stroke centre locations. In Section 5.1 the experimental setup is explained. In Section 5.2 a single instance is highlighted for illustration. Finally, in Section 5.3 a comparison of the different allocation protocols is given, with the computational time given in Section 5.4.
Regional structure and parameters
In this subsection, we first discuss the regional structures, followed by the choices of parameters.
We apply the models to 6 of the 24 ambulance regions (RAVs) in the Netherlands: Amsterdam-Amstelland, Holland-Midden, Haaglanden, Utrecht, Twente, and Groningen. The regions are chosen based on population density, following the classification in [38]; that is, we consider urban (Amsterdam & Haaglanden), rural (Groningen & Twente) and mixed (Holland-Midden & Utrecht) regions. As demand points, we take the four-digit postal codes.
Figure 10 in Appendix B shows the lay-out of the six regions. The surface area varies between 282 km2 (Amsterdam-Amstelland) and 2336 km2 (Groningen). Recall that the total demand in a region is equal to the model parameter P. We assume that every demand location is assigned a fraction of P proportional to the population density provided by the RIVM. For the potential PSC and CSC locations per region, we follow the categorization of [37]. In Fig. 10, the PSCs are indicated with a small circle and the CSCs with a cross.
Next to the regional structure, we use the parameters as indicated in Table 3. For each region, this provides 39 instancesFootnote 1 with a different parameter combination. The probability of IAT eligibility is based on expert opinion about the range of this probability [20]; in current clinical practice 20% is realistic, but this value is expected to increase. The minimum IVT requirement (rIV T) is set to ‘0’ to mimic current practice and avoid that the drip-and-ship protocol becomes infeasible due to the patient volume for one of the PSCs dropping below rIV T. Finally, the in-hospital delay for IVT is chosen according to the function in Fig. 3, ranging from 20 to 60 minutes, depending on patient volume. The in-hospital delay for IAT (bj, IAT) is 29 minutes.
Table 3 Parameter values for numerical experiments The allocation protocols are compared based on the total delay from scene departure to start treatment (i.e., the SDST), corresponding to the objective function Z of the MILP. The relative difference in SDST for drip-and-ship and mothership, compared to the optimal protocol, is denoted by
$${\Delta}_{p} = \frac{Z_{p} - Z_{opt}}{Z_{opt}} \times 100\%,$$
where Zp is the objective function for protocol p and Zopt is the objective function of the optimal model.
Insights from a single instance
To obtain insight in the impact of the different protocols, we first elaborate on a single instance. We focus on the Amsterdam-Amstelland region with P(IAT) = 20%, the total number of patients P = 600 per year and a minimum IAT requirement rIAT of 50 per CSC.
The results of this Amsterdam-Amstelland instance is given in Table 4. The optimal allocation is better than drip-and-ship by 7.7% and than mothership by 11.5%. Moreover, the number of PSCs differs between the protocols; the optimal protocol has one less open PSC than drip-and-ship, whereas there are by definition no open PSCs for mothership. Finally, the fraction of patients that require IAT and need to be transferred is 90.3% for the drip-and-ship protocol; only 9.7% of the IAT patients are directly allocated to a CSC. For the optimal protocol, the percentage of required IAT transfers decreases slightly to 81.0%. We note that these high number of IAT transfers can be explained by the fact that the CSC is on the outskirts of Amsterdam and at the edge of the region.
Table 4 Results for single ‘Amsterdam-Amstelland’ instance (P(IAT) = 20%, P = 600, rIAT = 50) In Figs. 4, 5 and 6 the allocation of demand to the stroke centres is indicated by black arrows. Figure 6 shows how patients are allocated to the nearest PSC, including the PSC at the top of the region, as required by the drip-and-ship protocol. Figure 4 shows that in the optimal protocol the PSC at the top of the region is no longer used for IVT patients. Also, for many locations, the optimal protocol allocates patients to the nearest PSC. An exception is the southeastern area, for which it is better to allocate patients directly to the CSC, which is similar to the allocation in the mothership protocol (as illustrated in Fig. 5).
For this single instance we observe that drip-and-ship outperforms mothership. This can be explained by the small percentage of patients that require IAT and the location of the CSC. Of course, results will strongly depend on the regional layout and health-related parameters.
Analysis of different protocols
We compare the protocols for each region using the 39 feasible parameter combinations, resulting in a total of 234 instances.
Let us first focus on the difference between drip-and-ship and mothership. Table 5 shows the fraction of instances (in %) that mothership outperforms drip-and-ship in terms of SDST for the different regions and different values of P(IAT). Not surprisingly, and in line with Section 3, we see that mothership will perform better compared to drip-and-ship as P(IAT) increases. Next to P(IAT), the trade-off between the two practical protocols strongly depends on the region and the locations of stroke centres. For instance, we see that for the region Haaglanden mothership outperforms drip-and-ship for all instances. This can be explained by the degree of urbanization and corresponding short travel times. For the rural area Twente, we observe the opposite; only in some cases and for a P(IAT) of at least 50% it holds that mothership has shorter SDST than drip-and-ship. Roughly speaking, we can see that mothership gives better performance for urban areas, whereas drip-and-ship works well for rural areas, which can be explained by the impact of travel times.
Table 5 Fraction of instances (in %) in which mothership outperforms drip-and-ship per region for different values of P(IAT) In addition, the location of the CSC(s) seem to play a crucial role. Amsterdam and Haaglanden are both urban areas, but for Amsterdam the CSC is located near the edge of the region. In Amsterdam, for smaller values of P(IAT), the longer travel times to a CSC in the mothership protocol do not outweigh the additional travel times due to transfers of IAT patients in drip-and-ship. Similar arguments apply to the other regions; the CSCs in Twente (urban) and Holland-Midden (mixed) are closer to the edge of the region compared to Groningen (urban) and Utrecht (mixed).
In Fig. 7 the relative differences (Δp) between drip-and-ship (left) and mothership (right) compared to the optimal protocol are visualized using boxplots based on the 39 instances per region. The observations above concerning Table 5 also apply to a large extent to the performance per region in Fig. 7. For instance, we see again that overall mothership performs better than drip-and-ship in the urban regions, where the reverse holds for rural areas (except for some cases with P(IAT) ≥ 50%). The variability in performance for drip-and-ship can be considerably larger than for mothership. For example, for the regions Amsterdam and Utrecht the performance of drip-and-ship is almost 40% worse than optimal for P(IAT) = 60% and P = 300. For mothership, the performance is only roughly 12% worse than optimal for the regions Amsterdam, Holland-Midden, and Twente in case P(IAT) = 20% and P ≥ 600. On average the total SDST when using the drip-and-ship protocol is 8.6% larger than the optimal model, whereas for the mothership protocol this is only 3.9%. Nevertheless, the mothership protocol can perform worse than the drip-and-ship protocol in all regions (except Haaglanden). Specifically, for the regions Holland-Midden, Twente and Groningen, the mothership protocol performs worse in 68.4% of the instances. Over all instances, the fraction of IAT patients that need to be transferred from PSC to CSC in the optimal model is 59.4% on average with a standard deviation of 25.1%. This shows that the required number of transfers will be considerable, but strongly depends on the region and health-related parameters.
Sensitivity of parameters
So far, we primarily focused on the impact of the regions on the performance. Below, we further explore the impact of P(IAT) and the total demand P; the impact of the minimum IAT requirement rIAT is related to the impact of P(IAT) and P. In Figs. 8 and 9 you may find the mean (line) and interquartile range (shaded area) of the total SDST for the two practical protocols relative to the optimal protocol against P(IAT) and P, respectively. As may be expected, the performance of the drip-and-ship protocol decreases as P(IAT) increases, whereas the performance of mothership improves. In fact, for P(IAT) = 60% we see that SDST for mothership is close to optimal. For small values of P(IAT), e.g. when P(IAT) = 20%, drip-and-ship typically performs better than mothership, but the performance is not necessarily close to optimal. Specifically, in the case with small patient volumes (P = 300), the SDST of drip-and-ship for Utrecht is still 41.9% worse than optimal.
Figure 9 shows the performance of the protocols relative to optimal as the total number of patients P varies. For P = 300, the performance of drip-and-ship varies considerably. Specifically, the performance for the regions Utrecht and Amsterdam is quite poor in that case, and are at least 37% (Utrecht) and 31% (Amsterdam) worse than optimal for all values of P(IAT). This can be explained by the in-hospital delay that becomes rather big when there are quite some stroke centres (6 and 5 for Utrecht and Amsterdam, respectively) and the total patient volume is small. These examples show that drip-and-ship is vulnerable when the number of patients per stroke centre becomes small; the order of magnitude also clearly depends on the function chosen for bIV T when patient volumes become small. For mothership, the relative performance compared to optimal decreases when P increases. Again, this follows from in-hospitals delay; as P is larger, the optimal protocol will use more PSCs for its allocation without excessive in-hospital delays for IVT.
Remark 5
Although the drip-and-ship and mothership protocols may show close to optimal performance in some instances, it seems difficult to give any reasonable performance guarantees. For instance, consider a simplified situation with P(IAT) = 0, such that we may focus on IVT. Assume that there are 3 demand locations (I = 3) and two possible PSC locations (J = 2) that are the same as demand locations 1 and 2. Moreover, let d12 = d21 = D, d31 = D − δ and d32 = δ for some δ > 0 sufficiently small and D large. Consider the following demands: w1 = rIV T − 𝜖, w2 = rIV T, and w3 = 𝜖 for some small 𝜖 > 0.
In the optimal allocation, both PSC locations are open and patients of locations 1 and 3 are assigned to PSC location 1 such that the minimum volumes of IVT are met for both PSCs. The optimal total travel time is then 𝜖(D − δ), which is only due to patients from location 3. When applying a drip-and-ship protocol it is not possible to open both locations, as PSC location 2 would be the nearest PSC to demand location 3. Hence, for drip-and-ship it is only feasible to open one location without violating the minimum volume requirements. Opening location 2 as a PSC, then provides the smallest total travel time of (rIV T − 𝜖) × D + 𝜖 × δ = rIV TD − 𝜖(D − δ). Observe that both the absolute and relative difference in total travel time between optimal and drip-and-ship explode when \(D \to \infty \) and 𝜖 ↓ 0.
Computational time
The numerical experiment is run on an Intel Core i7-4770k CPU @ 3.50GHz with 24 GB RAM. In this experiment, a single instance of the model takes approximately one minutes; with 270 instances and three models (mothership, drip-and-ship, and optimal) the total experiment takes roughly 13 hours to complete.