1 Introduction

A novel coronavirus, severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2, hereafter COVID-19), emerged from the city of Wuhan, Hubei, China, in early December 2019 (Chan et al. 2020). Chinese health authorities shut down the Huanan Seafood Market, the suspected source of the virus (Hui et al. 2020), and restricted travel to and from the Hubei Province (Chen et al. 2020). Closing workplaces and prohibiting community activities after school as part of the social distancing policy were first implemented in Wuhan in response to the COVID-19 outbreak (Prem et al. 2020). Afterward, social distancing became the most widely used intervention against the spread of COVID-19 in its early stage as no vaccine had been developed (Newbold et al. 2020).

Several studies have shown that social distancing effectively prevents or controls the spread of infectious diseases by reducing physical contact (Abel and McQueen 2020). According to Ahmed et al. (2018), social distancing reduces the cumulative infection rate in the workplace by about 23%. Prem et al. (2020) further argued that premature and sudden lifting of the intervention could lead to another epidemic wave.

To scientifically assess the effectiveness of the social distancing policy, epidemiologists often refer to a reproduction number (R0). It represents how fast an epidemic spreads through the population, and implementing social distancing is known to lower R0. The reproduction number changes depending on the intensity of social distancing measures, which creates different epidemic trends. The intensity of the policy varies by the level of restrictions on travel, restriction on public or private multi-use space operation, and gathering size. These different levels of social distancing measures lead to increased or decreased R0 (Wang et al. 2020).

However, social distancing policies themselves are not a cure-all solution. Because epidemics are not easily suppressed within a short period, people’s willingness to follow recommended measures can decrease as the policy lasts for a longer period of time (Blendon et al. 2004). In addition, other social problems may exist, including physical and psychological adverse effects from decreased social interaction due to restriction of common spaces (Honey-Rosés et al. 2020; Jurblum and Castle 2020). Therefore, a stepwise approach is required to minimize potential COVID-19 risks when implementing social distancing measures, considering the temporal and spatial effects.

A few studies have investigated changes in R0 depending on different intensities of social distancing policies; however, the extent to which R0 varies with policy intensity via spatial distinctions has not been sufficiently researched. The effects of social distancing policies over time have also not been adequately investigated. For instance, since the COVID-19 incubation period is acknowledged as 14 days (Ma et al. 2012), it is considered that the policy effect takes 14 days to manifest. To our knowledge, however, this time lag of the social distancing policy has not been empirically studied.

In this context, this study aims to analyze the R0 depending on different intensities of social distancing measures and spreading patterns of the virus during the initial stage of the pandemic. The study sets the following two research questions:

  • A spatial perspective how does the policy intensity regarding the use of public and private multi-use facilities affect the spread pattern of the epidemic?

  • A temporal perspective how long will it take the social distancing policy to be effective, and how does the epidemic trend differ during the pandemic?

To this end, this study attempts to investigate changes in the reproduction number in accordance with policy measures and the number of days required for the measures to be effective by analyzing the social distancing intervention and epidemic trends in South Korea.

2 Literature review

2.1 Policy interventions for infectious diseases

In response to the impact of the COVID-19 pandemic, countries implemented their anti-contagion policies and systems based on lessons from former epidemics, adopting policies from other countries, and the diffusion of ideas across governments (Anttiroiko 2021). Several studies proved that social distancing policies reduced the transmission potential of the pandemic (Prem et al. 2020) and directly affected the spread to make a flattening curve (Crokidakis 2020). Severe acute respiratory syndrome (SARS), which globally spread from November 2002 to February 2003, had been transmitted through droplets of respiratory fluids between humans in close proximity to one another. Hong Kong, one of the regions substantially affected by the disease, tracked confirmed cases and adopted home quarantine policies to minimize the transmission potential (Law et al. 2020). The Hong Kong government widely encouraged using face masks, sanitizing hands, and other simple hygiene measures and advised postponing all non-essential travel to Hong Kong and Guangdong.

Middle East Respiratory Syndrome (MERS), another viral respiratory disease, had spread significantly in South Korea. Previous studies (Ha 2020; Khan et al. 2015; Petersen et al. 2015) reported that a large number of cases in the country resulted from (1) delayed information share of confirmed cases and close contact lists, (2) lack of detailed information shared, (3) undervaluing its spread at the community level, and (4) inadequate responses to MERS. Considering the lessons from MERS, South Korea has been equipped with a systematic quarantine system and contributed to utilizing relevant information systems. For COVID-19, South Korea has adopted the 3 T (Test, Trace, and Treat) method (Her 2020; Kim 2021) and social distancing measures following the COVID-19 outbreak.

COVID-19 is known to spread easily in urban spaces with 3C conditions, i.e., crowded places, close-contact settings, and confined and enclosed spaces (WHO 2021). As such, people are advised to avoid the “three Cs” places, mandatorily wear face masks, and keep a distance of two meters from others in indoor/outdoor environments. In addition, urban spaces and public transportation were not allowed in highly populated cities and compact urban structures. These measures effectively controlled the transmission in densely populated cities and countries (Ahmed et al. 2018; Anttiroiko 2021; Tian et al. 2020). School closures, work from home, social distancing policies (including canceling public and group events and restrictions on public gatherings), stay at home, lockdown, border closure, and self-quarantine have been widely implemented for COVID-19 prevention (Anttiroiko 2021; Newbold et al. 2020).

The policies controlling SARS and MERS worked more effectively due to their characteristics (i.e., infection rate, fatality rate, and others). For example, R0 of the SARS epidemic in Hong Kong was 2.7 (Riley et al. 2003), meaning one SARS-infected person passes the virus onto an average of 2.7 people, and that of MERS was 0.8–1.3 (Cauchemez et al. 2014). The R0 of COVID-19 has been reported differently, for example, 3.1 by Wang et al. (2020) and 2.2 by Li et al. (2020). In essence, hosts infected with SARS and MERS were unable to travel great distances due to their higher fatality rate, but COVID-19 cases spread readily due to their low fatality rate (Guarner 2020). The difference is the point at which social distancing policies and travel restrictions for COVID-19 became more significant compared to that for prior respiratory diseases.

2.2 Modeling studies analyzing the spread of infectious diseases

Studies on the spread of infectious diseases have widely employed deterministic compartment models, statistical models, and deep learning models. In epidemiological studies, the deterministic compartment models, such as SIR (susceptible–infected–recovered), SEIR (susceptible–exposed–infected–removed), and SIRD (susceptible–infected–recovered–deceased) models (Ayodele et al. 2021), have been validated. The models are suitable for predicting the spread rate of infectious disease as they consider the occurrence, infection rate, incubation period, and recovery rate of individuals in an area under the same external conditions. Wu et al. (2020) used the SEIR model to predict the clinical severity of each age group in Wuhan, China, by adjusting the COVID-19 confirmation rate and time from symptom onset to death. Similarly, Wang et al. (2020) used the SEIR model to determine the transmission route within Wuhan, arguing that strong government policies such as movement control effectively prevent infectious disease transmission. As such, the deterministic compartmental model is suitable for macro-prediction of the spread of infectious diseases and aids in implementing appropriate policies.

For the statistical model (e.g., regression model and survival analysis), Kraemer et al. (2020) examined the impact of unprecedented policy interventions, such as travel restrictions, in China using a generalized linear model (GLM). The study used real-time mobility data and travel history of Wuhan and found that China’s drastic control measures effectively halted the spread of COVID-19. Thai et al. (2020) employed survival analysis to examine the median duration of hospitalization in Vietnam. The data gathered from 133 patients showed that the median day of hospitalization was 21 days. Among others, age, residential location, and sources of infection were strongly correlated with a longer hospital stay.

Deep learning models, which have become increasingly popular in recent years, are flexible models outside the constraints of the mathematical model and reflect several variables, including urban and demographic characteristics, using a large amount of observational data. These models outperform others in terms of predictive performance. Hu et al. (2020) developed a real-time deep learning model for short-term forecasting of confirmed cases in 31 Chinese provinces. This model attempted to cluster the patient characteristics using a k-means algorithm and spatially and hierarchically reported the analysis results.

Although statistical models are popular in epidemiology studies, they are limited in their use due to the potential of omitted variable bias (Canning et al. 2020) and an ambiguous start and endpoint for patients (Schober and Vetter 2018). Additionally, survival analysis is particularly irrelevant in examining various phases in relation to different intensities of the policy. Deep learning models have high predictive accuracy, but they require a large amount of data and have the disadvantage of being difficult to explain. Therefore, this study employs the SIRD model, one of the deterministic compartment models. It is suitable as a single macro-model and has been recommended for analyzing the time series effect of the policy as it predicts epidemic trends and infection rates.

3 Analysis

3.1 Data

This study obtained the daily data of South Korean COVID-19 cases from the Korea Centers for Disease Control and Prevention (KCDC) ranging from January 20, 2020, when the first confirmed case was reported, to June 30, 2020. The study analyzed the numbers of daily cases of infection, death, and recovery. The data were spatially divided into 17 major cities and provinces, and the nationwide data were created by combining them.

3.2 Social distancing policy in South Korea

South Korea implemented different levels of social distancing policy. After the first confirmed case was reported on January 20, 2020, the country’s crisis alert was raised to the highest level on February 23rd as local transmission began. Accordingly, a social distancing campaign was initiated on February 29th. The campaign adjusted the intensity levels of the policies according to the changing number of confirmed cases. Specifically, the South Korean government adopted three levels of social distancing policy until mid-June: “enhanced social distancing” (March 22nd–April 19th), “relaxed social distancing” (April 20th–May 5th), and “distancing in daily life” (May 6th–June 27th).

Figure 1 shows the number of patients who received COVID-19 treatment in South Korea, the numbers of deaths and recoveries, and five phases of the South Korean social distancing policy. A general trend and minor fluctuations are presented according to the policy intensity.

Fig. 1
figure 1

Spread of COVID-19 and adaptive social distancing policies. Note The color intensity shows policy strength (Levels 1–5) at each phase (Phases 1–5)

3.2.1 Phase 1

South Korea’s social distancing policy began on February 28, 2020, with a campaign by the Korean Medical Association called “Let’s refrain from outdoor activities and stay home like a big snow day.” The campaign officially lasted from February 29 to March 21, 2020, owing to the governmental restrictions on the use of public facilities. As shown in Table 1, professional sports were banned as they attract a large number of spectators, and national parks and public facilities were temporarily closed. Flexible working and telecommuting were generally recommended and implemented for public officials. The reopening of primary and secondary schools was officially postponed for a week, and daycare centers, kindergartens, and extracurricular programs were not allowed to operate.

Table 1 Non-pharmaceutical interventions by policy phase.

3.2.2 Phase 2

In Phase 1, the daily number of confirmed COVID-19 cases peaked on March 15, 2020, and then began a downward trend. However, the South Korean government implemented an enforced social distancing policy to prevent the transmission potential of COVID-19 in Seoul and its surrounding areas. The government announced an administrative order to ban all gatherings and events over 50 people (indoor) or 100 people (outdoor) and close social facilities like entertainment bars. Under the administrative order, the local government was forced to place an injunction against any violation of the administrative guidance. Flexible working and telecommuting were expanded to more public and private companies.

3.2.3 Phase 3

After the spread of the infectious disease was alleviated in the capital region through Phase 2, the South Korean government lifted the intensity of the policy on April 20, 2020. First, the government partially resumed operation of public facilities with a relatively low risk (e.g., professional baseball games without spectators and reopening outdoor national parks) under the conditions of disease control standards and encouraging people to keep a safe distance. In the case of the private sector, educational test centers were partially reopened with qualified disease control standards. For those facilities with a high risk of transmission, such as entertainment, sports, and religious facilities, the intensity of the administrative order was relaxed from mandatory to recommended.

3.2.4 Phase 4

The South Korean government eased the policy intensity on May 6, 2020, in consideration of the declining trend in new COVID-19 cases. A limited number of spectators were allowed to enter professional baseball stadiums, and high-risk facilities such as entertainment bars were reopened. Some students were allowed to physically attend classes, and others joined parallel online classes. For workplaces, flexible working hours and telecommuting were not as strongly recommended. However, as soon as Phase 4 measures were effectuated, infected individuals whose disease remained latent in Phase 3 began to show symptoms. The total confirmed COVID-19 cases continually increased since the mass infection and were linked to nightclubs (bars) on May 6th and reached their peak of 1,324 cases on June 23rd.

3.2.5 Phase 5

The government introduced a higher level of social distancing policy on May 29th to mitigate the increasing number of confirmed cases in the capital region. More intensive individual preventive measures were requested at Phase 5. Wearing face masks became mandatory once again on public transportation (subway, buses, and taxis), and passengers without masks were not allowed.

3.3 Method

This study employed SIRD (Susceptible, Infected, Recovered, and Deceased) modeling based on South Korean COVID-19 data to identify the S–R trend. The SIRD model was run in a Python library called CovsirPhy (CovsirPhy 2020), which allows changes to be captured in the spread of COVID-19 at major time points.

3.3.1 SIRD model

The SIRD model is a deterministic mathematical model for describing the spread of infectious diseases. The total population is divided into four groups: susceptible (S), infected (I), recovered (R), and deceased (D) cases. Susceptible cases are calculated by subtracting the infected cases from the population, implying that the remainder has the potential to become newly infected cases through contacts with the infected. The probability of contact with someone infected is determined by the value calculated through the change in the number of infected cases over time in the model. Infected cases include the asymptomatic infections that have been confirmed to be infected. Recovered cases are the number of people who have been infected and then recovered. Deceased cases refer to those who died after infection.

$$S \beta I \to I \gamma \to R$$
$$I \alpha \to D$$

where S: susceptible, I: infected, R: recovered, D: deceased, α: mortality rate [1/min], β: effective contact rate [1/min], and γ: recovery rate [1/min].

The SIRD model estimates the population growth in each stage based on the α, β, and γ parameters. The model is constructed as a function of time, and the ordinary differential equations (ODE) for the four groups are as follows.

$$\begin{aligned} \frac{{{\text{d}}S}}{{{\text{d}}T}} = & - \frac{{\beta SI}}{N} \\ \frac{{{\text{d}}I}}{{{\text{d}}T}} = & \frac{{\beta SI}}{N} - \left( {\gamma + \alpha } \right)I \\ \frac{{{\text{d}}R}}{{{\text{d}}T}} = & \gamma I \\ \frac{{dD}}{{dT}} = & \alpha I \\ \end{aligned}$$

where N (= S + I + R + D) refers to the total population and T to elapsed time from the start date.

This study utilized a non-dimensional SIRD model in which the unit of the variable is excluded to simplify the model (CovsirPhy 2020).

3.3.2 Susceptible–recovered (S-R) trend

The S–R trend detects the time point at which there are changes in the trend of the COVID-19 infection, and then assumes the parametric change of the SIRD model at that point (CovsirPhy 2020). The relationship between S and R can be summarized as follows:

$$\begin{aligned} \frac{{{\text{d}}S}}{{{\text{d}}T}} = & - \frac{{\beta SI}}{N} \\ \frac{{{\text{d}}R}}{{{\text{d}}T}}{\mkern 1mu} {\mkern 1mu} = & \,{\mkern 1mu} \gamma I{\mkern 1mu} (I{\mkern 1mu} {\text{ > }};{\mkern 1mu} 0,{\mkern 1mu} S{\mkern 1mu} \cong {\mkern 1mu} N{\mkern 1mu} {\text{when}}{\mkern 1mu} R{\mkern 1mu} = {\mkern 1mu} 0) \\ \end{aligned}$$

then,

$$\begin{aligned} \frac{{{\text{d}}S}}{{{\text{d}}R}} = & - \frac{\beta }{{N\gamma }}S \\ S\left( R \right) = & Ne^{{ - \frac{{R\beta }}{{N\gamma }}}} \\ \log S\left( R \right) = & - aR + \log N\left( {a = \frac{\beta }{{N\gamma }}} \right) \\ \end{aligned}$$

where α is the slope of the model, which is determined according to the changes of the β and γ parameters. In the bottom equation, log S is reduced as R increases when the parameters of the model are constants.

3.4 Model analysis process

In comparing the initial five phases of the social distancing policy in South Korea, this study focused on the reproduction number to evaluate the effectiveness of each phase and estimate the elapsed time for the policy to have an effect. The reproduction number is defined as the degree of transmission at time t and the average number of secondary infections caused by an infected patient. Suppose the reproduction number at time t is equal to or greater than 1.0. In that case, it implies that the disease continues to spread, and if it is less than 1.0, the transmission is expected to decrease.

The reproduction number may vary depending on whether pharmaceutical or non-pharmaceutical control measures are implemented. At a point when vaccines have yet to be developed, non-pharmaceutical measures can be viable tools to prevent the spread of infectious diseases. This study investigated time points at which the reproduction number changes and examined how each period between the points overlaps with the five phases of the social distancing policy. Figure 2 shows the analytical process of this study.

Fig. 2
figure 2

Analytical process

4 Results

4.1 Changes in the COVID-19 epidemic trend

Figure 3 shows changes in the S-R trend. It is classified into eight sections, and a linear trend line for each section is a measure of scale for the COVID-19 outbreak. A section with a sharply sloped trend line indicates that there was rapid transmission of COVID-19 in that period.

Fig. 3
figure 3

COVID-19 S-R trend

The dates on the figure are the start date of each section. With the exception of the initial stage, the trend line gently declines. This study identified the epidemic trend with the start and end dates of the period and the time-dependent reproduction number for each period in connection with the COVID-19 policy responses (Phases 1–5), as shown in Table 2.

Table 2 COVID-19 policies and epidemic trends

Rt shows time-dependent changes with the policy phases. The 0th stage has the highest reproduction number (Rt = 5.58) because the number of infected cases increased substantially in selected areas in the early stage of the COVID-19 outbreak in South Korea. However, in the 1st stage, Rt sharply dropped to 0.33 after 14 days of the implementation of Phase 1. The COVID-19 incubation period is commonly defined as 14 days (Ma et al. 2012); therefore, the sharp reduction in Rt indicates that the Phase 1 response was indeed effective in mitigating the COVID-19 spread. Accordingly, in the 4th stage, the Rt fell to 0.14 after the intensive social distancing policies were implemented at Phase 2.

As the government relaxed the social distancing policy at Phase 3, Rt in the 5th stage rose slightly from 0.14 to 0.48, but Rt still remained below 1.0. Consequently, the South Korean government soon implemented the lowest level of the social distancing policy in Phase 4.

In the 6th stage, Rt increased to 1.87, which suggests that the social distancing policy carried out at Phase 4 was insignificant in preventing the spread of COVID-19. Recognizing the severity of the pandemic crisis, the central government decided to restrengthen the social distancing policy at Phase 5. Then, infected cases began to decrease (Rt = 0.79) in the 7th stage due to a more strengthened Phase 5 distancing policy.

4.2 Effectiveness of the social distancing policy

Figure 4 presents COVID-19 cases over time with an overlap of social distancing policies and epidemic trends. The analysis of policy implementation periods and changes in epidemic trends indicates that the transmission trend changes after 13–19 days from the policy implementation; this policy lag is similar to the generally accepted COVID-19 incubation period of 14 days (Ma et al. 2012). That is, social distancing policies may not exert immediate effects, but require a time lag of two weeks. A related study that examined the COVID-19 policy responses of the US government found that 9–12 days are required for the responses to initiate meaningful effects (Badr et al. 2020).

Fig. 4
figure 4

Social distancing policy phases and epidemic trend. Note The policy strength (Levels 1–5) at each phase (Phases 1–5) and epidemic trends (0–7th) are differentiated by the color intensity

Notably, the period of time required for the policy to initiate its effect differed between the earlier and later phases. The time lag at Phases 1 and 2 was 14 and 13 days, respectively, while the lag at each of the latter three phrases was 19, 18, and 19 days. Compared with the preceding phases, the lag was extended by 5 to 6 days.

4.3 Predictive modeling

Figure 5 shows variations in the number of predicted infected cases based on Rt for 28 days at Phases 3–5: blue line for Rt of the 4th stage (0.14), orange for the 5th (0.48), green for the 6th (1.72), and red for 7th (0.79). As shown, the number of newly infected cases is moderately reduced at the 6th–7th stage and the Rt value remains under 1.0. At the 6th stage, Rt (1.72) shows a sudden increase along with the previous upward curve. These results imply that if social distancing policies of Phase 2 or 3 had been extended, the increase in the number of infected cases after Phase 4 would have been delayed. Additionally, if the transition from Phase 4 to Phase 5 had been delayed in time, the number of confirmed cases might have increased more rapidly.

Fig. 5
figure 5

COVID-19 prediction trends for infected cases. Note The policy strength (Levels 1–5) at each phase (Phases 1–5) and epidemic trends (0–7th) are differentiated by the color intensity

5 Discussion and conclusion

This study compared different intensities of social distancing measures and the epidemic trend in South Korea from January 20th to June 30th of 2020 and took a spatial and temporal approach to evaluate their effects on the early stage of the COVID-19 pandemic. Based on the findings of this study, several policy implications can be drawn from South Korea’s experience.

First, as a spatial approach, it is vital to restrict public facility operation during the initial stages of the spread of an epidemic and then consider restrictions on the use of private multi-use facilities, such as entertainment and sports facilities in densely populated areas. The vigorous public intervention effectively halted the early spread of COVID-19. In other words, minimized public intervention and advocates for individual preventive measures are ineffective at preventing the spread of infectious disease. An empirical SIRD model presented epidemic trends in association with different intensities of the social distancing policies. The policies and epidemic trends were divided into five phases and eight stages, respectively, from January 20 to June 30, 2020. Accordingly, this study found that highly restrictive social distancing measures for both public and private sectors reduced the spread of COVID-19, and the epidemic spread is facilitated when the intensity of the policies is relaxed.

Phase 1 shows that restrictions on the use of public facilities were quite effective at containing the epidemic (Rt 5.58 → 0.33). However, despite governmental efforts, regional-level infections persisted in densely populated areas like the Seoul metropolitan area (Rt 0.33 → 0.39). The transmission of infectious disease in densely populated areas began to be clearly controlled through an executive order prohibiting public and private gatherings of 50 or more people in indoor spaces and 100 or more people in outdoor spaces for any purpose. It is noteworthy that Rt surged from 0.14 to 0.48 to 1.72 as the policies were loosened.

Second, as a temporal approach, policymakers need to consider that people become unresponsive to the recurrent implementation of similar regulations. The epidemic trends showed changes in the time lag for the distancing policies to be effective. The average time lag was 13–19 days, yet it was 13–14 days in the early stages of COVID-19 and 18–19 days later. The changes in time lag duration may have been attributed to changes in public awareness, as the risk perception that is correlated with people’s willingness and motivation to follow preventive actions (Weinstein 1988) is known to decrease over time (Blendon et al. 2004). In addition, the repeated implementation of intensive social distancing policies due to several mass infections of COVID-19 (at Phases 3 and 4) may have reduced people’s willingness to follow the social distancing policy.

The longer the pandemic period, the longer the time lag for the distancing policies will be effective. This change was witnessed in the third epidemic wave of COVID-19 in South Korea in late 2020 and early 2021. The central government enforced the social distancing policy of level 2.5 (a total of 5 levels from 1 to 3 with 0.5 intervals) on December 8, 2020. Nevertheless, the number of confirmed cases continued to increase, and the daily number of confirmed cases peaked on December 25, 2020 (1241 cases). The reproduction number, which once soared to 1.52, has fallen to less than one since January 3, 2021. At that time, the time lag was recorded as 25 days. In this sense, further research is required to analyze people’s perceptions and behaviors toward social distancing policies to improve the effectiveness of non-pharmaceutical measures.

Third, more preemptive measures are required to keep the reproduction number below 1.0 in densely populated areas. This study predicted how infected cases would change if stronger social distancing measures continued for the 4th to 7th epidemic stages. The distancing policy in Phase 4 lost its effectiveness as the reproduction number exceeded 1.0 and infected cases rapidly increased. This was particularly prominent in densely populated areas. Therefore, in those areas, it is desirable to preemptively take preventive measures prior to the reproduction number exceeding 1.0 in consideration of the rapid increase in the reproduction number.

This study is not without limitations. First, it failed to consider mass infections by super-spreaders. In the early stages of the COVID-19 outbreak in South Korea, massive group infections were present in some areas. However, the epidemic model employed in this study could not reflect the regional explosion of the infections. In this context, planning and geography-specific suggestions might be drawn by conducting follow-up studies on the effect of social distancing policy considering regional-level characteristics. Second, the average value of the reproduction number was taken at each stage, but it dynamically changes at a finer grain (e.g., by day). Therefore, future studies are recommended to examine area-specific infection cases at a micro-temporal unit scale.

Despite the above limitations, this study contributes to the literature by comprehensively examining social distancing measures over six consecutive months to draw policy implications. To effectively prevent the spread of COVID-19, the intensity of the policy and its differential time lag should be carefully considered together for the expected effects of the policy to occur.