Event-study
To quantify the effect of the lockdown we estimate an event-study model. We use daily data and estimate coefficients for each week (7 days) starting from March 5. For each week we calculate the DiD between Denmark/Norway and Sweden for our outcome variables using the week March 12–18 as our baseline period. The regression equation is given by:
$$ y_{ct\tau}= \beta_{c\tau} +\alpha_{c}+\gamma_{\tau}+\epsilon_{ct\tau}, $$
(1)
where yctτ denotes the outcome variable in country c, day t and week τ. αc are country-fixed effects and γτ denote week-fixed effects. Our coefficient of interest is βcτ which measures the DiD in the outcome variable between Denmark/Norway and Sweden and between week τ and the baseline period.
Results are presented in Fig. 3. The estimates in panels b and c show that in the initial weeks of the pandemic, patients in ICU, and mortality follow the same trend in all three countries.Footnote 9 However, between 2 and 3 weeks into lockdown, patients in ICUs and mortalities start reducing in Denmark and Norway, relative to Sweden.
The timing of the effect is consistent with a causal effect from the lockdown. Specifically, the incubation period of COVID-19 from infection to symptoms is between 2 and 14 days with a median of 5 days (Lauer et al. 2020). Our outcome variables correspond to cases with severe symptoms which are likely to appear somewhat later than the initial symptoms. Hence, a causal effect of the lockdown is very unlikely to be measurable in the first week after lockdown which is consistent with our findings. The first measurable effect of the lockdown should instead occur 2–3 weeks after lockdown, and this effect should strengthen over time, since COVID-19 grows exponentially in the absence of lockdown. Both Denmark and Norway report negative coefficients two weeks into the lockdown (albeit initially not significantly so in Denmark), and the effect clearly grows with time.
Our results are also roughly consistent with Bonacini et al. (2020), who use machine-learning methods on Italian data to determine that NPIs start affecting COVID-19 cases between 17 and 19 days after they are introduced.
Another piece of evidence that we are really measuring a causal effect of the lockdown is how remarkably similar the pattern is in Norway and Denmark, consistent with the fact that both countries passed almost identical NPIs.
After the release of the lockdown, the DiD in ICU patients between Denmark/Norway and Sweden, begins to plateau, and subsequently reduce. It is important to note however, that this does not appear to be causally connected with the release of the lockdown. Instead, as can be seen in Fig. 2, the number of ICU patients in Denmark/Norway continues to decline (close to 0) even after restrictions are lifted, but the decline in Sweden is even larger. Deaths continue to decline in Denmark/Norway relative to Sweden, although at a less steep rate.
The phase-out of the NPIs likely did not result in an increase in COVID-19, because the release was rolled out slowly with emphasis on measures that prevent contagion.Footnote 10
Hospitalizations follow a pattern similar to ICU patients. However, for hospitalizations we cannot analyze pre-trends before March 18.
Our main analysis excludes Finland. However, in Appendix 7 we replicate our event study for deaths using Finnish data. The main finding is that the DiD in deaths for Finland falls right in the middle between Denmark and Norway. This is consistent with the fact that Finland implemented roughly the same measures as Denmark and Norway (see Hale et al. 2020).
Counterfactual analysis
To better understand the impact of the lockdown on hospital and ICU capacity, we use our model to make predictions on the peak number of COVID-19 patients in Danish and Norwegian hospitals in the counterfactual in which they would have followed Sweden’s more lenient social distancing approach. Our approach is as follows. First, we use the raw data to find the maximum number of patients in hospitals/ICUs in Denmark and Norway, and the date on which the peak occurs. Second, we find the counterfactual number of patients by predicting the number of patients in the absence of treatment, i.e., removing the treatment effect βcτ. Our counterfactual model is thus given by:
$$ y^{cf}_{ct\tau}= \hat{\alpha}_{c}+\hat{\gamma}_{\tau}, $$
(2)
where hats denote estimated values from regression Eq. (1).Footnote 11
Results are reported in Table 3. Our model predicts that in the counterfactual without lockdown, Denmark (Norway) would have seen 103 (152) percent more patients in ICUs, and 144 (257) percent more hospitalizations at the peak. The peak would have occurred between 22 and 28 days later.
Table 3 Peak and cost analysis We also calculate the overall effect of the lockdown on our outcome variables up to the end of the sample period. For patients in ICUs, and hospitalizations, we calculate ICU/hospital-patient days by summing the number of ICU/hospital-patients over the days in our sample period. Formally:
$$ Y_{c}=\sum\limits_{t=1}^{T} y_{ct\tau}. $$
(3)
To find counterfactual hospital/ICU-days we instead sum over the counterfactual outcome given by Eq. (2):
$$ Y_{c}^{cf}=\sum\limits_{t=1}^{T} y^{cf}_{ct\tau}. $$
(4)
For deaths, we simply consider the actual outcome, and the counterfactual outcome on June 30 at the end of the sample period.
Results are again reported in Table 3. We find that, without lockdown, Denmark (Norway) would have had 334 (671) percent more patient-hospital-days, 277 (379) percent more patient-ICU-days and 402 (1015) percent more deaths.
Finally, we calculate the overall benefit of a lockdown in terms of healthcare and mortality cost. We assume in our model that the cost per hospital/ICU-patient-day is fixed.Footnote 12 We follow the WHO estimates for Denmark and Norway in 2005. We take the unweighed average and inflation correct them to 2019 USD. This results in a cost of 421 USD per patient per day.Footnote 13
For the cost of a patient-day in an ICU, we follow Flaatten and Kvåle (2002) who estimate the average cost of critical care for ICU patients in a hospital in Norway. This paper provides one of the very few measures for the cost of ICU treatment in Scandinavia. They find, an ICU-patient costs 4,197 USD per day after inflation correction.
For the cost of mortality we consider a lower bound cost of 100,000 USD and an upper-bound of 400,000 USD per life-year.Footnote 14 In accordance with Hall et al. (2020), we assume that on average a COVID-19 death results in a loss of 14.5 quality life years. We multiply the estimates with the population of Denmark/Norway in millions to get to aggregate results for both countries.
Overall, we find that Denmark (Norway) saved around 96 (94) million dollars in healthcare cost by locking down. The overall benefit of the lockdown amounts to 1.0–4.0 (0.9–3.5) percent of 2019 GDP for Denmark (Norway) depending on the cost per life-year. The large majority of costs is related to mortality.