Abstract
The management of COVID19 appears to be a longterm challenge, even in countries that have managed to suppress the epidemic after their initial outbreak. In this paper, we propose a model predictive approach for the constrained control of a nonlinear compartmental model that captures the key dynamical properties of COVID19. The control design uses the discretetime version of the epidemic model, and it is able to handle complex, possibly timedependent constraints, logical relations between model variables and multiple predefined discrete levels of interventions. A state observer is also constructed for the computation of nonmeasured variables from the number of hospitalized patients. Five control scenarios with different cost functions and constraints are studied through numerical simulations, including an output feedback configuration with uncertain parameters. It is visible from the results that, depending on the cost function associated with different policy aims, the obtained controls correspond to mitigation and suppression strategies, and the constructed control inputs are similar to reallife government responses. The results also clearly show the key importance of early intervention, the continuous tracking of the susceptible population and that of future work in determining the true costs of restrictive control measures and their quantitative effects.
Introduction
On December 31, 2019, China alerted the World Health Organization (WHO) on a cluster of pneumonia cases of unknown origin in Wuhan, China. On January 7, 2020, the causative pathogen of the outbreak was identified as a novel coronavirus, later named as SARSCoV2, and the disease it causes as COVID19. SARSCoV2 infections quickly spread: the first case outside China was identified in Thailand, on 14 January, followed by reported cases from a number of countries [6, 56].
In Europe, the first cases were confirmed on January 24, 2020, in France (where, later in April, COVID19 was retrospectively confirmed for a patient hospitalized in late December 2019) [13, 50], and on January 27, in Germany, Bavaria, leading to a local outbreak [7]. The first epidemic in Europe started in the Lombardy region of Italy with the first detection on February 20, 2020 [46]. Control measures started in midMarch in most of the European countries, including social distancing measures that reflect strong effort to suppress, or at least to slow down the spreading of COVID19. Because of the differences in timing and stringency of the applied measures, the peak daily incidence varied substantially among countries, and recently a resurgence of cases has been observed [17]. By the end of July 2020, around seventeen million cases and seven hundred thousand deaths have been reported worldwide, with significant spreading in the Americas, Eastern Mediterranean and Southeast Asia [57].
In the absence of vaccine and effective treatment, the nonpharmaceutical intervention strategies can roughly be divided into two main categories. Mitigation does not aim to completely stop the transmission of the virus, only to slow down to keep the number of infected people below the capacity of the healthcare system. Sweden is an example of such strategy. On the other hand, suppression aims to reduce the incidence to a very low level by strict social distancing and then keep that number low by localized and targeted measures, such as efficient surveillance, testing, tracing and quick isolation of cases. The first outbreak was suppressed in most European and East Asian countries, Australia and New Zealand. Recently, following a relaxation of such measures, a resurgence has been observed in the Western Balkans [17].
Mathematical models have been commonly used in epidemiology to evaluate disease control strategies. However, disease control in this context usually refers to a single intervention measure that is sufficient to reduce the reproduction number below one, leading to the eradication of the disease. The most commonly used measures are vaccination and drug treatment [19], or, in the case of vector borne diseases, culling of mosquitoes and other arthropods that transmit the pathogen into other living organisms. The current COVID19 situation is unprecedented in the sense that governments are constantly tuning their control measures, trying to find balance between public health concerns and the costs of social distancing measures to the society and the economy. Thus, using feedback, which is a standard tool in control theory, is necessary to dynamically manage our response to the pandemic and tailor policies to stabilize the situation.
In a control theory framework, dynamical systems are considered as operators mapping from an input signal (function) space to an output space [48]. We distinguish between manipulable inputs which can be set (often between certain limits) by the user and disturbance inputs from the environment that cannot be directly influenced. The outputs are either directly measured quantities or they are computed from measurements. The control goals are usually prescribed using the outputs, e.g., they have to track a reference trajectory or just stay between predefined limits. Such goals are often equipped with additional constraints and optimality criteria. Possible examples for the former are (physical) bounds on the inputs and/or on the state variables, and minimal control cost or operation time for the latter. Therefore, a complex control problem can be most often expressed in the form of constrained optimization.
Even the simplest epidemic models are nonlinear which makes the corresponding control problems challenging due to complex dynamical behavior, possible singularities and the statedependent nature of fundamental properties like reachability or observability [30]. Parameter and input uncertainties, or the lack of measurements of sufficient quality often add further difficulties to the problem [42, 44].
There is a wide literature on the modelbased targeted manipulation of diseases either within the host or across an entire population [1, 4, 27, 41, 49, 53]. Nonlinear model predictive control (NMPC) is introduced in [47] as a potential tool for epidemic management. In [8] NMPC is used for the optimal allocation of vaccination resources between different risk groups and regions. A robust model predictive approach for stochastic epidemic models is proposed in [54], where quarantine policy design is shown as a possible control input. Detailed controlrelated model analysis and vaccination input design are proposed in [12] which tracks a prescribed output given in terms of susceptible and infected people. A quantitative model is presented in [52] for the COVID19 outbreak in Wuhan, China, taking into consideration the effect of different interventions. In [22] an eightcompartment ODE model is presented for describing and analyzing the COVID19 epidemic in Italy, where the authors show different scenarios for the implementation of countermeasures. The same model structure is used in [32] adapted to the data from Germany. A model predictive control approach is proposed, and it is shown that the number of fatalities can be significantly reduced even when the model and some measurements are uncertain. Vast majority of the available control approaches assume a control input with continuous range which is clearly useful for strategic planning, but not straightforward to put into practice if there are distinct levels of intervention. A notable exception is [37], where starting and stopping strict social distancing is a binary control input applied in a nonlinear model predictive framework and tested through simulations on nominal and uncertain models of the COVID19 pandemic in Brazil.
Most advanced feedback control methods need the whole state information for computing the input, but it is not realistic to assume that the number of individuals in each compartment can be continuously measured (especially latent, asymptomatic or even mildly symptomatic people). Therefore, a state estimator is needed in practice, which is known to be nontrivial to design for nonlinear systems, and most often its stability has to be proved on a case by case basis [30]. A general observer class with convergence proof is proposed for lowdimensional continuous time epidemic models in [29]. An implicit observer design approach for specially discretized SEIR models with global convergence proof is described in [28].
Temporal logic provides a powerful framework for the modeling, analysis and control of discrete time dynamical systems, which is a correctbyconstruction approach [5]. Using signal temporal logic, complex specifications and constraints can be given for the required dynamical behavior of a model in a compressed form. A particularly successful application of this computation framework is model predictive control, where the requirements can be automatically translated to a mixed integer programming problem taking into consideration the system dynamics as constraints [18]. Most often, linear dynamical models are preferred for control design with temporal logic, since those can be put into the framework of mixed integer linear programming. However, there exist really powerful solvers capable of efficiently handle nonlinear models as well [33].
Based on the above, the aim of this paper is to propose an optimizationbased control approach for compartmental epidemic models constructed for the COVID19 outbreak, which is able to take into account complex, possibly timedependent specifications including bounds, and even logical relations between model variables, and multiple predefined discrete levels of interventions. Another important goal is to study the possibilities of output feedback design by applying a dynamic state observer. As a case study, we parameterize our model to Hungary, but it can be easily generalized to other countries as well.
Transmission dynamics model
Model description
We construct a compartmental model to describe the transmission dynamics of the infection, incorporating specific characteristics of COVID19. Our population N is divided into the following classes, tracking the disease status of individuals: by S we denote the susceptibles, i.e., those who can be infected by the disease. Latent (L) are those who have already contracted the disease but do not show symptoms and are not infectious yet. Since transmission may occur in the two days before the onset of symptoms [2], we consider a presymptomatic infectious compartment P. Since a large fraction of infected show only mild or no symptoms, after the incubation period, we differentiate infected individuals into asymptomatic (A) and symptomatic infected (I) compartments. Those in A will always recover, while the more severe cases in I may require hospitalization, in which case they move to compartment H, from where they may eventually recover (R) or die (D). We note that most transmission occurs within a few days after symptom onset, and the compartment I reflects this period of effective infectivity, rather than clinical status or PCR positivity, which may continue for weeks, yet we remove them from I and place them in R as they do not participate in chains of transmission anymore. The transition diagram of our model is depicted in Fig. 1. Several studies [3, 14, 39, 40, 45, 55] have proposed somewhat similar models for of COVID19.
The compartmental model without any control terms reads as
Model parameters
From the infectivity profile of COVID19 [2], we can see that most transmissions occur between 3 days prior to and 4 days after symptom onset, with the presymptomatic infection fraction 43.7%. It is a good approximation to set the presymptomatic period \(p^{1}\) as three days, and the symptomatic infectious period \(\rho _I^{1}\) as four days, with the same infectiousness \(\beta \) during this period. The estimated mean incubation period (which is the latent and presymptomatic period together) of the coronavirus disease is 5.5 days [35]; thus, the latent period \(\alpha ^{1}\) is 2.5 days. Studies have shown similar durations of viral shedding between symptomatic and asymptomatic cases [59], so we set \(\rho _A^{1}\) as four days as well. For the probability of developing symptoms, and the relative infectiousness of asymptomatic individuals, we use the CDC best estimate \(q=0.6\) and \(\delta =0.75\) [9]. The average stay in hospital is assumed to be 10 days, in accordance with the seven days median reported in [15]. The inhospital death ratio (\(\mu \)) in the USA is 0.145 [10]. The best estimate for the infection fatality rate (IFR) is 0.0065 [9]; thus, the hospitalization probability \(\eta \) of symptomatic cases can be inferred from the relation IFR \(=q \eta \mu \) as \(\eta \approx 0.076\).
The basic reproduction number, expressing the average number of new infections generated by a single infected individual in a fully susceptible population, is given as
This formula can be derived as follows. Introducing a single infected individual into a susceptible population, then \(S(t)/N \approx 1\). A newly infected individual, after passing through the latent phase, spends \(p^{1}\) time in the presymptomatic compartment, while infecting others with rate \(\beta \). Then transits to the symptomatic infected compartment with probability q, where it spends \(\rho _I^{1}\) time infecting others again with rate \(\beta \). Asymptomatic infection occurs with probability \(1q\), in which case the individual infects with reduced rate \(\delta \beta \), for time \(\rho _A^{1}\) on average. Summing up these terms, we obtain (9). We assume that hospitalized individuals are properly isolated and do not cause significant numbers of infections.
Many studies have investigated \(R_0\) for different countries; here, we use \(R_0=2.2\) estimated from the Hungarian data [45]. From relation (9), given that all other parameters are determined, we can calculate \(\beta =1/3\). We use Hungary’s population size for N. The parameter values are summarized in Table 1.
The transmission dynamics model as a control system
To design a controller for the epidemic process, the first step is to define the manipulable parameters (control inputs) and identify the measured outputs. The latter comprises all relevant statedependent variables that are available for measurement. In the absence of vaccination, one needs to rely on a variety of nonpharmaceutical measures, which are aiming to prevent the transmission of the virus. In our model, the control input, denoted by u, reflects the effect of the measures implemented to reduce the transmission rate. This variable is introduced in the model as a scaling factor of \(\beta \), i.e., \(\beta \) is replaced by \(\beta (1u)\) in Eqs. (1) and (2) which are therefore modified to
where \(0\le u(t) \le u_{\mathrm{max}} < 1,\) \(\forall t\ge 0\). It is clear from the above equations that \(u(t)=0\) corresponds to unmitigated disease spread without any restriction, and \(u(t)=u_{\mathrm{max}}\) represents the strictest possible intervention level.
Analogously to \(R_0\), the timedependent effective control reproduction number, denoted by \(R_c(t)\), can be given by
An analysis of eleven European countries [21] revealed that the reproduction number (3.6 on average) dropped to 0.66 after the strictest lockdowns; hence, we can assume \(u_{\mathrm{max}}=0.82\).
Realization of the control input by specific control measures
Public health authorities are implementing a wide range of measures in response to the COVID19 outbreak; see Table 2. There exist recent works about the quantitative effect of different measures, usually in terms of the reduction of infection probabilities in different locations, e.g., in [51, 58]. These can be used to match input value ranges and various possible restrictions. The Oxford COVID19 Government Response Tracker [24] is a tool that systematically collects information on several different common policy responses on 17 indicators such as school closures and travel restrictions. Such indicators can be composed into indices, such as the government response stringency index. Having data from more than 160 countries, one can rigorously track the evolving policy responses around the world and compare various countries. We have plotted the stringency index of selected European countries (that are similar to Hungary in population size) in Fig. 2. Later, we will see that the government responses of countries are very similar to constructed control inputs optimizing interventions with different cost functions and constraints.
Nonpharmaceutical measures aim to reduce the number of contacts between individuals or reduce the probability of transmission when contact is made. The transmission rate can be considered as
Social distancing measures, such as school closures and banning of gatherings, reduce the average number of daily contacts made by an individual, while improved hygiene and mask wearing reduce the transmission probability. In our control system, we realize any combination of measures by changing \(\beta \) to \(\beta (1u)\), where the control input u represents the overall effect of measures in reducing transmission. For example, if the number of contacts is reduced to half by social distancing measures, then \(\beta (1u)=0.5\beta \) thus \(u=0.5\) If both the contact number and the transmission probability are reduced to half by a combination of measures, then the transmission rate is reduced to its quarter, corresponding to \(\beta (1u)=0.25\beta \), meaning that our control input is \(u=0.75\).
Discretization
The predictive control algorithm proposed in the next section requires a discretetime dynamical model given in the general form \(x_{k+1}=F(x_k,u_k)\). Therefore, the epidemic model (1) has to be discretized: function F has to be constructed s.t. \(x_k\approx x(k\cdot T_s)\) for any piecewise constant input \(u(t)=u_k\), \(t\in [k\cdot T_s,(k+1)\cdot T_s)\), where \(T_s\) is the sampling time and \(x_k\) is a state vector. From the different possible discretization methods, we found that the simple forward Euler method is suitable for our purposes. It provides sufficient accuracy and preserves the structure of the continuous time model. We used a sampling time \(T_s=0.5\) days to get the discrete time model for control synthesis. It is important to note that the discrete time model is used for control input design, but the actual trajectories of the system between the sampling instants are computed by an appropriate ODE solver using a standard explicit Runge–Kutta (4,5) method. In Sect. 5 a dynamic observer is designed for the epidemic model, which also requires a discrete time model. To increase the accuracy, that model is generated by a smaller (\(T_s=0.1\) days) sampling time.
Constrained state feedback control for mitigation
Some relevant concepts from predictive control theory
In the first control scenarios, the entire state vector is assumed to be known. This assumption is not realistic, but the corresponding simulation results will show the physical limitations for controlling the epidemic process in the ideal situation when full information is available. In Scenario 6, this assumption will be relaxed and only the number of hospitalized COVID19 patients (state H in the model) and the number of deceased (state D in the model) will be considered available.
In all scenarios, we design a feedback controller, i.e., the control input is periodically updated based on the actual measurements.
To formulate the control problem, the next step is to define the performance specifications that have to be satisfied by the controller and the controlled (closedloop) system. The most criteria we expect from a conscious epidemic management can naturally be formulated by cost functions to be minimized (e.g., healthcare costs, or the harmful effects of restrictions on economy and society) and constraints to be satisfied (e.g., upper bounds for the number of hospitalized people and/or on the number of deaths). Model predictive control (MPC) methodology is therefore a promising approach for solving this problem. In the MPC framework, the control synthesis is transformed into a constrained optimization task solved in every discrete time step, when the control input has to be updated. Since the synthesis procedure boils down to a standard optimization problem, theoretically a wide set of possible cost functions and complicated constraints can be handled.
Formally, in case of discretetime models and full state measurement, the main steps of the MPC algorithm can be summarized as follows:

1.
A suitable control horizon \(M\in {\mathbb {N}}_+\) is chosen; the time counter k is set to 0.

2.
At time \(k\cdot T_s\), state \(x_k\) is measured. MPC is based on the prediction of the future states, therefore the following notation is introduced: the \((k+i)\)th state predicted from the measurement made at time k will be denoted by \(x_{k+ik}\). By definition, \(x_{kk}=x_k\).

3.
By applying the state update equation \(x_{k+1}=F(x_k,u_k)\), the M predicted future states \(\mathbf{x}_k=\{x_{k+1k}\),\(\ldots \),\(x_{k+Mk}\}\) can be expressed as a function of the (yet unknown) future control actions \(\mathbf{u}_k=\{u_{kk},\ldots \), \(u_{k+M1k}\}\). Using this formulation, an optimization problem can be defined:
$$\begin{aligned}&~~~~~~~~~~\min _{\mathbf{u}_k} J(\mathbf{u}_k,\mathbf{x}_k) \end{aligned}$$(13a)$$\begin{aligned}&\text{ w.r.t. }~~ x_{k+i+1k}=F(x_{k+ik},u_{k+ik}) \end{aligned}$$(13b)$$\begin{aligned}&~~~~~~~~~ G_x(\mathbf{x}_k)\le h_x,~G_u(\mathbf{u}_k)\le h_u \end{aligned}$$(13c)The objective function J and constraints (13c) are constructed to encode all design specifications to be satisfied by the controller and the closedloop system. To solve (13), an appropriate numerical solver has to be used. The result is the optimal input sequence \(\mathbf{u}_k^*=\{u_{kk}^*,\ldots \), \(u_{k+N1k}^*\}\).

4.
The first element of \(\mathbf{u}_k^*\) is applied to the process, i.e., \(u_k:=u_{kk}^*\). This control input is kept constant for \(T_s\) time period. Then, k is incremented, i.e., \(k:=k+1\), and the iteration continues at step 2.
We add the following important remarks to the MPC algorithm described above:

(a)
In the description of the MPC above, we implicitly assumed that the system model is perfect: the model used for prediction is the same as that describes the true system behavior. In practical situations, this rarely holds: there are modeling uncertainties that may corrupt the prediction and thus the control input obtained. It is known that an appropriate feedback can significantly reduce the effect of uncertainties in itself [30, 48]. Moreover, there exist advanced methods for robust control synthesis and the robustness analysis of the closed loop. In the next section, no uncertainty is assumed for the model.

(b)
The numerical complexity of the optimization problem depends on the structure of the cost functions and the constraints. Since the model is nonlinear, (13) becomes a nonlinear optimization problem. In the first control scenarios, we are going to investigate, quadratic cost function and linear constraints are used. Later, to formulate more complicated requirements, temporal logic constraints are also introduced, which turn the optimization task into a mixed integer nonlinear programming (MINLP) problem.

(c)
The time horizon over which we intend to control the epidemic process is 180 days. We assume that the external conditions do not significantly change during this time period. Therefore, the behavior of the model beyond 180 days is not taken into consideration. (If further control is needed, new computations must be performed after 180 days.) Since the endpoint is fixed, the MPC is solved over shrinking horizon, i.e., M is time dependent and defined by \(M_k=180k\).

(d)
If the entire state vector cannot be measured, the standard procedure is to augment the controller with a dynamical observer providing estimation for the true state. If the system is nonlinear, there is no general procedure for estimator design. This task can therefore be challenging: different existing methods have to be combined and adapted to the specific system model. In Sect. 5 we present a possible state estimator for the epidemic model above and show how it can be applied together with the MPC control.

(e)
Although in the algorithm above the control input changes in every \(T_s\) time period, this is not necessary: the frequency of control update can be easily decreased by simple constraints on u.
Control scenarios
This section presents three control scenarios defined for the epidemic model. Each scenario addresses a different public health goal, and presents different control strategy. In all cases, full state measurement is assumed and all simulations start from the same initial condition: \(S_0=NL_0\), \(L_0=40\), \(P_0=I_0=A_0=H_0=D_0=R_0=0\), where N is the population of Hungary according to Table 1. We assume that the epidemic remains undetected until the number of hospitalized patients exceeds a small threshold \(H_{thr}\). Technically, this means that the simulation runs open loop until this threshold is reached, the controller is switched on only thereafter. In the case studies we examined, \(H_{thr}=10\) was used. As mentioned before, the sampling time is \(T_s=0.5\) days, but in each scenario the control input is updated only weekly, i.e., in every 14th time instant. The simulations were run on a Dell Vostro 5471 computer with i78550U (4 cores, 1.8–4.0 GHz) processor and 8GB RAM under MATLAB R2019b using the BARON 19.3.24 solver [31] and YALMIP version R20200116 [36]. The code for the translation of specifications containing temporal logic expressions to optimization problems was based on the BluSTL toolbox [16].
Scenario 1: Mitigation and suppression with continuous control input
In this scenario, the control input is allowed to take arbitrary (continuous) values between 0 and an a priori defined \(u_{\mathrm{max}}\). The cost function and constraints used in the MPC design are defined as follows:
So, we would like to minimize the direct harmful effects of the restrictions (measured in a 2norm), and keep the number of hospitalized patients under a predefined upper bound not to overload the healthcare system. The weighting factor \(w_D\) penalizing the number of deceased at the end of the horizon can be used to balance between mitigation and suppression, the two typical goals of COVID19 management [20]. In the first case, \(w_D=w_H=0\), so the focus is only on the direct cost of the control measures. The controller is expected to avoid strict measures and thus only mitigates the effects of the epidemic to the extent that the hospitalization remains below the given bound. In the second case, \(w_D\gg 0\), \(w_H\gg 0\) are set such that the corresponding terms in the cost function are comparable with \(\sum _{i=0}^M u_{k+ik}^2\), so the controller tries to suppress the epidemic even if the control actions are expensive (i.e., they have harmful effects). The upper bound \({\overline{H}}\) represents the limit of the healthcare capacity. Parameters \(w_\varepsilon \) and \(\varepsilon \) are the ingredients of the soft constraint formulation. Soft constraint is applied to avoid the possible numerical infeasibility that can occur in the vicinity of \({\overline{H}}\) by the slight difference between the simulated continuous and the predicted discrete trajectories.
First the mitigation scenario is investigated. For this, simulations have been performed with the following parameter values: \(\overline{H}=10{,}000\), \(u_{\mathrm{max}}=0.82\). The results obtained are shown in Fig. 3. At the beginning of the control period the control input is small. This shows that less strict measures are sufficient during this time. As the epidemic progresses the control input slowly increases, but only until the 98th day, when it reaches a higher but still moderate value that is significantly smaller than the allowed maximum \(u_{\mathrm{max}}\). After the 98th day, the epidemic can be successfully mitigated. At the end of the control period (from day 154) the controller eases the restrictions (the control input decreases) since the control specifications have to be fulfilled only up to the 180th day, and this can be achieved even if the measures are relaxed (the control cost is decreased) in the last few weeks. If the constraints have to be satisfied on a longer time period, the control horizon has to be increased. From this result, the following conclusion can be drawn: first, if we can intervene in time, there is no need to immediately implement strict measures, and second, the epidemic can be mitigated by applying only moderate restrictions. The total cost of the control strategy is \(J_{1m}^*=42.86\).
It is important to notice the increase of the state variables at the end of the horizon. Since finite time control policy is computed, it is not surprising that close to the end of the control period, the controller decreases the control input to minimize the cost. As a response, the state variables start to increase, but this does not cause feasibility problem as long as the constraints are not violated till the end of the horizon. This socalled turnpike behavior shows that easing the measures would result in an epidemic peak. With strict constraint on the healthcare capacity, this could be satisfactorily avoided only if a suitable herd immunity is reached by the end of the control horizon. It has been documented in several papers, e.g., [26, 32] that in case of COVID19 pandemic, to reach herd immunity without overwhelming the healthcare system would take years. Consequently, defining a good terminal constraint for this relatively small time period is not possible. What can be done is to directly constrain the increase of the states at the final (M and \(M1\)th) time instants [32]. We are going to show an example for this in Scenario 3.
Using the mitigation setup we have analyzed the maximal delay that the system can tolerate before implementing any measure. From a control perspective, this means that the system runs open loop (i.e., uncontrolled) in the time interval \([0,d\cdot T_s]\), where \(d\in {\mathbb {N}}_+\) and then the controller is turned on. We seek the maximal d, for which the MPC optimization problem has a feasible solution. For the maximal tolerable delay, we have obtained 74 days (i.e., \(d=144\)). For larger values of d, the MPC optimization has no feasible solution. (To detect infeasibility, a hard upper bound has been introduced for the soft constraint violation. Specifically, in this scenario, \(\varepsilon \le 0.01\) has been used.) The simulation results are plotted in Fig. 5. Considering the control input, it can be seen that as expected, the larger the delay the stricter the measures that have to be applied. The maximal control input is 0.82, which corresponds to total lockdown.
The controller for epidemic suppression has been designed by the following weights in the cost function: \(w_D = 0.0267\) and \(w_H = 0.0033\). The simulation results are plotted in Fig. 4. It is visible that the outbreak can be successfully suppressed for the price of a strict and early lockdown, followed by a slow gradual easing of the measures. However, a second wave of the epidemic appears at the end of the horizon as it has been observed in several countries, for example, the curves in Fig. 4 show a striking resemblance to the true epidemic curve of Hungary . The total cost of the control strategy is \(J_{1s}^*=101.8\) from which the cost of the control input is \(\sum _{k}u_k^2=89.27\).
Scenario 2: The effect of control input quantization
By definition, the control input u reflects the effect of different measures implemented by the government in the society. Since there is a finite number of measures that can be applied (Table 1), a control input with truly continuous range cannot be realized in practice. Motivated by this, we assume now that the control input is quantized and can take only 4 different values. Each value corresponds to a specific measure as follows: \(u^{(1)}=0,u^{(2)}=0.19,u^{(3)}=0.41,u^{(4)}=0.6\). Here, as an example, \(u^{(2)}\) may correspond to school closures, \(u^{(3)}\) to stayathome orders, and \(u^{(4)}\) can be interpreted as a combination of the two. To force \(u_k\in \{u^{(1)},u^{(2)},u^{(3)},u^{(4)}\}\) for all k, an additional constraint is added to the MPC synthesis:
where \(\square \) is a temporal logic operator called “always” and is defined as follows: if \(\phi \) is an arbitrary logical expression, then
Using this definition, constraint (15) prescribes that one of the four equations \(u=u^{(i)}\), \(i\in \{1,2,3,4\}\) has always to be true. (More details on temporal logic operators can be found, e.g., in [18]). We remark that the discrete inputs alone do not necessitate the application of temporal logic (see, e.g., [37]). However, this notation is intuitive, and using the temporal logic framework it is straightforward to add more complex (possibly timevarying) constraints as it will be shown by the next scenario.
To analyze the effect of input quantization, we have performed the mitigation scenario defined in the previous section with the additional constraint (15). The results are plotted in Fig. 6. It can be seen that the primary control goal, i.e., the mitigation of the epidemic is achieved and the input and state constraints are satisfied. It is also important to mention that the quantized control input is similar to the continuous one obtained in Scenario 1, which means that the optimal control strategy is very similar in the two cases. On the other hand, the quantization allows less freedom to the controller, so the total cost is now higher: \(J_2^*=45.88\).
Scenario 3: Refined constraint for healthcare capacity
In this scenario we allow, but only once and only for a limited time period, that the number of hospitalized patients (H) exceeds the limit \(\overline{H}\). This scenario represents the case when there is an extra, but possibly costly reserve in the healthcare system that can be activated if necessary, or resources are reallocated to COVID19 from other areas of healthcare. Formally, we introduce two new parameters: \(T_{r}\) and \(\overline{\overline{H}}\), such that \(\overline{H}<\overline{\overline{H}}\) and the MPC design is completed with the following constraint:
where the temporal logic operator \(\mathbf{U }\) (called “until”) is defined as follows:
In expression (17), \(\overline{\overline{H}}\) denotes a new upper bound that is never to be violated and \(T_r\) is the maximal time period for which \(H>\overline{H}\) is allowed. The numerical simulation for this scenario was performed with the following parameter values: \(\overline{\overline{H}}=15{,}000\) and \(T_r=21\) days. The results obtained by performing a mitigation scenario are depicted in Figs. 7 and 8, respectively. Compared to the results of Scenario 1, it can be seen that the shapes of the control inputs are similar. The main difference is that the controller in Scenario 3 applies smaller control actions over almost the entire horizon. The control input is larger only for a short period after \(T_r\) is elapsed. This is necessary to stop the increase of the constrained state variables, which would result in the violation of the constraints and the loss of feasibility. Since the control input is smaller at most times than in Scenario 1, the total cost of the control is smaller: \(J_{1m}^*=42.86\) in Scenario 1 and \(J_3^*=41.43\) in Scenario 3.
Similar to the other scenarios investigated so far, the state variables start to increase at the end of the control horizon. To avoid this behavior, we introduce the following simple terminal constraint:
i.e., the number of hospitalized individuals must decrease in the last step. This constraint prevents H and the other states from increasing: strict control measures are applied till the very end of the horizon. Though the characteristic of the state variation has been significantly improved, nothing can be guaranteed for the process behavior beyond the control horizon. A later outbreak can be avoided only if the implementation of the carefully planned, strict control policy is continued.
State estimator design and output feedback control
In this section, the assumption of full state measurement is dropped, and aligned with the common practice, only the number of the deceased (D) and the number of the hospitalized individuals (H) are monitored. There are examples in the COVID19 literature, where the global dynamics and the epidemic curve was reconstructed from the data of hospitalized or deceased individuals [23, 43]. In order to use the state feedback MPC controller, a dynamical observer is designed to estimate the remaining nonmeasured states.
LPV observer design for the epidemic model
To design the estimator, the states are normalized first and the dynamical model is divided into three parts. According to the three subsystems, the state vector is partitioned as follows: \(s:=S/N\), \({\bar{x}}=[L,P,I,A,H]/N\) and \(r=R/N\). Focusing on x, we notice that the corresponding dynamical equations can be rewritten in linear parametervarying (LPV) form:
where \(\rho _k=s_kv_k\) with \(v_k=1u_k\) is the scheduling variable and
follow from (1). By introducing \(C=[0~0~0~0~1]\), a measurement equation is added to the model: \(y_H=C{\bar{x}}\), where \(y_H={\bar{x}}_5=H/N\). Assume \(\rho \) is bounded, i.e., \(\rho \in [{\underline{\rho }},~{\overline{\rho }}]\) and \({{\underline{\rho }}}\), \({{\overline{\rho }}}\) are a priori known. If we assume that up to half of the population gets infected, then \(s\in [0.5,1]\) holds. This together with the input constraint \(u\in [0,~0.7]\) gives the bound for \(\rho \): \(\rho \in [0.15,1]\). Using these bounds, a parametervarying observer can be designed, but in order to use it, the scheduling variable (\(\rho \)) has to be known at each time instant. Since in our case \(s_k\) is not available for measurement, we can only approximate it by using its difference equation, as follows:
By scheduling the model with \({\hat{\rho }}={\hat{s}}v\), we face the problem of observer design for LPV systems with inaccurately measured scheduling variables. This problem is well identified in control literature and one possible solution is proposed in [11, 25, 38]. The papers discuss different variants, namely differently improved versions of the same approach introduced first in [38]. The method constructs a parametervarying observer, scheduled by \({\hat{\rho }}\) such that the boundedness of the estimation error is guaranteed as long as \(\rho {\hat{\rho }}\) is bounded.
Before applying this method, it is important to check the observability properties of the LPV model. The quickest analysis is to compute the observability matrix at different frozen (fixed) parameter values. This is a necessary condition for the parameterdependent observability. Taking 10 equidistant points \(\rho _1\ldots \rho _{10}\) on the interval [0.15, 1], we have found that the linear timeinvariant (LTI) models \((A(\rho _i),C)\) are all observable: the corresponding observability matrices have full rank. However, it is important to note that these matrices are badly conditioned, they are close to singular, so the model is only weakly observable. This may challenge the observer design process and has effect on the achievable performance of the state estimation. It is also important to keep in mind that while the properties of the LPV model can give information on the properties of the nonlinear system, the two systems are not the same: the epidemic model is embedded in the LPV structure, so the latter describes a much broader dynamical behavior.
Starting from the LPV model, the state estimator is defined in the following form:
where \({\hat{y}}_H=C{\hat{x}}\). This results in the following error dynamics:
where \(\gamma _k=(A(\rho _k)A({\hat{\rho }}_k)){\bar{x}}_k\). By fixing the feedback gain \(L({\hat{\rho }})\) in parameter affine form \(L_0+{\hat{\rho }} L_1\), the coefficient matrices \(L_0\) and \(L_1\) can be determined by finding positive definite \(P_i\) and general \(G_i\), \(F_i\) matrices for \(i\in \{1,2\}\) that satisfy the following linear matrix inequalities (LMI):
Then with \({\bar{L}}_i=G_i^{1}F_i\), the observer gains are computed as follows: \(L_1=1/({{\overline{\rho }}}{{\underline{\rho }}})({\bar{L}}_2\bar{L}_1)\), \(L_0={\bar{L}}_1{{\underline{\rho }}} L_1\). It is shown in [38], that the dynamics of the estimation error (24) is inputtostate stable (ISS) with respect to input \(\gamma _k\). This implies that \(e_k\rightarrow 0\) as \(k\rightarrow \infty \) if \(\gamma _k=0\) (i.e., \(\rho _k={\hat{\rho _k}}\)) and also that \(e_k\) is bounded for all k if \(\rho _k{\hat{\rho _k}}\) is bounded. Note that the observer design procedure considers the scheduling parameter independent of the state prediction. Formally this is true, as \(\rho _k\) depends on \(s_k\) which is not element of \({\bar{x}}_k\). Thinking in this way, the design is correct and the properties of the LPV observer can be independently analyzed: for example, a bound for the ISS gain can be computed for (24) by using [38]. On the other hand, in our specific setup the dynamic equation (22) couples \({\hat{\rho }}\) and \({\bar{x}}\). This makes the analysis of the observer more challenging. We therefore make the further analysis via simulations by interconnecting the observer, the dynamics of \({\hat{s}}\) and the nonlinear system model.
In the possession of \({\hat{s}}\) and \({\hat{x}}\), the remaining state variable r can be obtained by iterating its state update equation:
Note, \({\hat{r}}\) is thus constructed by integrating the linear combination of the other states. We cannot prove anything for the boundedness of \(z{\hat{z}}\), but this is not a serious issue as r does not influence the behavior of the other states and it is used only in a control objective of Scenario 4. Since a lower limit for the number of infected patients is not a strict value, some deviation from the prescribed limit is not critical. Simulations will, however, reveal that \(z{\hat{z}}\) is actually small over the control horizon, so \({\hat{z}}_k\) is a suitably precise estimate for \(z_k\). It is also important to mention that measurement D is not used in the observer. Since D does not influence the other state variables, measuring it is not relevant to the observer design (but it is very useful to precisely evaluate the cost function). It has to be admitted that the assumption of precisely knowing the model parameters is not completely realistic. Therefore, tracking the number of hospitalized people only may not be enough in practice to compute the population in other compartments with the required precision. To address this problem, the effect of parameter uncertainty for a controller–observer configuration is examined later in Sect. 5.4.
Numerical results obtained by the LPV observer
By solving (25), the following observer gains have been obtained:
However, due to the weak observability, the error dynamics is close to the boundary of stability, the matrices \(P_1\), \(P_2\) characterizing the Lyapunov function are numerically illconditioned: there are several orders of magnitude difference between their eigenvalues. Further analysis is thus necessary to reveal the performance properties of the observer, e.g., to compute an upper bound for the magnitude of the estimation error. Papers [11, 25] refine the algorithm above and derive such a performance metric. In this paper, we cannot go into the details of this analysis procedure, we examine the observer only in numerical simulations and place the focus on its application in closedloop control.
Figure 9 presents the simulation results obtained by running the system open loop with the control input depicted in the same figure. The initial state was the same as we chosen above, i.e., \(L_0=40\), \(S=NL\), and the other states are 0. In the simulation, the normalized states were estimated, but they were rescaled to plot the results. It can be seen that noticeable, but still not significant estimation error can be detected only in variables S and R and only in the neighborhood of the peak of the epidemic. This is not relevant, however, since the estimator is intended to be used together with a controller, which mitigates or suppresses the epidemic peak.
Scenario 4: Output feedback control
In this section, we examine how the state observer works together with the MPC controller. For this, we repeat the simulation of Scenario 1 (Sect. 4.2.1) with the following modification: the precise state measurement \(x_k\) is replaced by the estimated value \({\hat{x}}_k\). The simulation results are plotted in Fig. 10. The control input and state trajectories obtained in the two scenarios can hardly be distinguished. Since the epidemic peak, where the estimation error would be noticeable, is mitigated, the state estimation is almost perfect over the entire horizon. Consequently, using \({\hat{x}}_k\) in the control input computation has only negligible effect on the closedloop behavior. Compared to Scenario 1, the control costs are almost equal in the two scenarios: \(J_1^*=42.86\), \(J_4^*=42.98\). We can conclude that the lack of direct measurement of S is not crucial from the point of view of state measurement if the observer is used in closedloop control.
Scenario 5: Effect of parameter uncertainty
We have assumed so far that the dynamical model of the epidemic is precisely known, that is the model (1)–(8) with parameters in Table 1 accurately describes the dynamical behavior of the epidemic process. This is hardly the case in a real situation. Therefore, the possible parameter uncertainties have to be taken into account during the control design process. This leads to a robust synthesis, which is beyond the scope of this paper. On the other hand, to study the applicability of the proposed control method, it is important to examine how it works in the presence of model mismatch. In this subsection, we show several simulations with the output feedback scenario presented above with the following settings: the model structure used for prediction and state observation is the same, but certain parameters of the controlled system are different in each experiment. We assume that four parameters, namely \(\alpha ,q,\delta ,\eta \) are uncertain, they take values from the following intervals:
The upper and lower bounds of the parameter domains have been determined using the references in Table 1. Further, we assume that the other model parameters are more precisely known, and therefore their nominal values were used in the simulations. We remark that possible uncertainty in \(\beta \) can be handled, since due to the model structure, designing for larger \(\beta \) gives a feasible controller for smaller values as well. To analyze the robustness, 16 simulations defined by the possible combinations of the min–max values of the uncertain parameters have been performed. Table 3 collects the parameters of the experiments with the results obtained. The detailed simulation results obtained for cases 7 and 15 are plotted in Figs. 11 and 12, respectively.
It can be seen that the controller worked acceptably well with uncertain models, although the cost varied visibly for the different cases. Regarding the constraint on the healthcare capacity, it is only violated in half of the simulations and the transgression of the limit is not critical. On the other hand, there is a room for performance improvement, and thus improving the robustness of the controller is an important task in the future.
Discussion
The modelbased control of the spread of the COVID19 epidemic was proposed in this paper. The dynamical model is given in the form of a set of nonlinear ODEs containing eight compartments. The model parameters were determined from the literature and the epidemic data recorded in Hungary between March and May 2020. The assumed manipulable control input with strict upper and lower bounds is the timevarying transmission rate affected by different restrictive measures planned and implemented by the authorities to slow down disease spread.
A model predictive control approach was proposed which uses the discretetime version of the dynamical model and is able to take into consideration complex specifications and constraints containing even integer variables and logical relations in the form of temporal logic expressions. The control goals are then automatically translated to a MINLP problem, capable of handling the nonlinear system dynamics. To address the realistic situation when not all state variables are observed continuously, a state observer is proposed using the theory of LPV systems, assuming that only the number of hospitalized and deceased patients are known on a daily basis. In the numerical simulations, we found that the number of people in the other 6 compartments can be computed with sufficient precision using the observer if the model parameters are known, although the model itself is numerically only weakly observable due to the possible different orders of magnitudes of the susceptible and the infected population. This underlines the importance of regularly tracking the susceptible population (which is a scheduling parameter in the state observer), since the online estimation of the other states could be significantly improved by that. In practice, this can be achieved by large scale serological surveys.
Five control scenarios were shown and analyzed with different goals and assumptions. The scenarios cover the wellknown cases of mitigation, when the direct cost of the intervention (control) is minimized with a constraint on healthcare capacity, and also suppression, where the cost is assigned to infection, hospitalization and fatalities. It is worthwhile to note that there is a striking resemblance between the constructed control inputs and reallife government responses, measured by a stringency index, both for mitigation and suppression strategies. We have also monitored the timevarying effective reproduction number \(R_t\), which became a very popular measure of the current epidemic situation during the COVID19 pandemic. For suppression, we see that very strict measures (lockdown) are necessary initially, and they can be slowly relaxed later. This corresponds to a sharp drop in \(R_t\) to levels way below one. On the other hand, for mitigation, the stringency of the control is increased much more slowly, and maximized at a moderate level, while \(R_t\) is being kept around the critical value 1 for a long time period.
We emphasize that the proposed flexible approach is able to directly handle predefined discrete levels of restrictions. The output feedback design case (i.e., the combination of the controller and observer) was also examined through several simulations assuming uncertainties in selected parameters. It is justified by the computational results that an early intervention is of key importance in satisfying the control goals and constraints. The feasibility analysis corresponding to the model predictive control problem is also useful to assess the practical (physical, biological) limits of the planned interventions and identify late actions. Future work will be focused on the sensitivity and further robustness analysis of the approach and on the specification of even more realistic goals and constraints. Among the latter, assigning individual costs to different types of restrictions (Table 2) and putting the optimal selection between them into the framework of optimal control may add further value to the research.
References
Ames, A.D., Molnar, T.G., Singletary, A.W., Orosz, G.: Safetycritical control of active interventions for COVID19 mitigation. medRxiv (2020). https://doi.org/10.1101/2020.06.17.2013326
Ashcroft, P., Huisman, J.S., Lehtinen, S., Bouman, J.A., Althaus, C.L., Regoes, R.R., Bonhoeffer, S.: COVID19 infectivity profile correction. Preprint (2020). arXiv:2007.06602
Barbarossa, M.V. et al.: A first study on the impact of current and future control measures on the spread of COVID19 in Germany. medR\(\chi \)iv 2020.04.11.https://doi.org/10.1101/2020.04.08.20056630
Becker, N.G.: Modeling to Inform Infectious Disease Control, vol. 74. CRC Press, Berlin (2015)
Belta, C., Yordanov, B., Gol, E.A.: Formal Methods for DiscreteTime Dynamical Systems, vol. 89. Springer, Berlin (2017)
Boldog, P., Tekeli, T., Vizi, Zs, Dénes, A., Bartha, F.A., Röst, G.: Risk assessment of novel Coronavirus COVID19 outbreaks outside China. J. Clin. Med. 9(2), 571 (2020). https://doi.org/10.3390/jcm9020571
Böhmer, M.M., et al.: Investigation of a COVID19 outbreak in Germany resulting from a single travelassociated primary case: a case series. Lancet Infect. Dis. (2020). https://doi.org/10.1016/S14733099(20)303145
Bussell, E.H., Dangerfield, C.E., Gilligan, C.A., Cunniffe, N.J.: Applying optimal control theory to complex epidemiological models to inform realworld disease management. Philos. Trans. R. Soc. B 374, 20180284 (2018). https://doi.org/10.6084/m9.figshare.c.4462796
CDC COVID19 Pandemic Planning Scenarios: US CDC. https://www.cdc.gov/coronavirus/2019ncov/hcp/planningscenarios.html
COVIDNET: A weekly summary of US COVID19 Hospitalization Data. https://gis.cdc.gov/grasp/COVIDNet/COVID19_5.html
Daafouz, J., Millerioux, G., Rosier, L.: Observer design with guaranteed bound for LPV systems. In: IFAC World Congress, pp. 107–112 (2005)
de la Sen, M., AlonsoQuesada, S.: Vaccination strategies based on feedback control techniques for a general SEIRepidemic model. Appl. Math. Comput. 218, 2888–3904 (2011)
Deslandes, A.: SARSCoV2 was already spreading in France in late. Int. J. Antimicrob. Agents 2020, 106006 (2019). https://doi.org/10.1016/j.ijantimicag.2020.106006
Di Domenico, L., et al.: Expected impact of lockdown in ÎledeFrance and possible exit strategies. medR\(\chi \)iv (2020). https://doi.org/10.1101/2020.04.13.20063933
Docherty, A.B., et al.: Features of 16,749 hospitalised UK patients with COVID19 using the ISARIC WHO clinical characterisation protocol. medR\(\chi \)iv (2020). https://doi.org/10.1101/2020.04.23.20076042
Donzé, A., Raman, V.: BluSTL: controller synthesis from signal temporal logic specifications. In: 1st and 2nd International Workshop on Applied Verification for Continuous and Hybrid Systems. EPiC Series in Computer Science, vol. 34, pp. 160–168 (2015)
ECDC: Rapid Risk Assessment: Resurgence of reported cases of COVID 19 in the EU/EEA, the UK and EU candidate and potential candidate countries European Centre for Disease Prevention and Control (2020).https://www.ecdc.europa.eu/sites/default/files/documents/RRAResurgenceofreportedcasesofCOVID19intheEUEEA.pdf
Farahani, S.S., Raman, V., Murray, R.M.: Robust model predictive control for signal temporal logic synthesis. IFAC Pap. Online 48(27), 323–328 (2015)
Feng, Z.: Applications of Epidemiological Models to Public Health Policymaking: The Role of Heterogeneity in Model Predictions. World Scientific, Singapore (2014)
Ferguson N.M., et al.: Report 9—impact of nonpharmaceutical interventions (NPIs) to reduce COVID19 mortality and healthcare demand. Imperial College London (2020).https://www.imperial.ac.uk/mrcglobalinfectiousdiseaseanalysis/covid19/report9impactofnpisoncovid19
Flaxman, S., Mishra, S., Gandy, A., et al.: Estimating the effects of nonpharmaceutical interventions on COVID19 in Europe. Nature 2020, 1–5 (2020)
Giordano, G., Blanchini, F., Bruno, R., Colaneri, P., Di Filippo, A., Di Matteo, A., Colaneri, M.: Modelling the COVID19 epidemic and implementation of populationwide interventions in Italy. Nat. Med. 2020, 1–6 (2020)
Golding, N., Russell, T.W., Abbott, S., Hellewell, J., Pearson, C.A., van Zandvoort, K., Jarvis, C.I., Gibbs, H., Liu, Y., Eggo, R.M. Edmunds, J.W.: Reconstructing the global dynamics of underascertained COVID19 cases and infections. medRxiv (2020). https://doi.org/10.1101/2020.07.07.20148460
Hale, T., Angrist, N., Petherick, A., Phillips, T., Webster, S.: Variation in government responses to COVID19. Blavatnik School of Government Working paper, BSGWP2020/032 (2020). https://www.bsg.ox.ac.uk/research/researchprojects/coronavirusgovernmentresponsetracker
Heemels, W.P.M.H., Daafouz, J., Millerioux, G.: Observerbased control of discretetime LPV systems with uncertain parameters. IEEE Trans. Autom. Control 55(9), 2130–2135 (2010)
HelmholtzInitiative ‘Systemische Epidemiologische Analyse der Covid19Epidemie’, Stellungnahme der HelmholtzInitiative ‘Systemische Epidemiologische Analyse der COVID19Epidemie’ (2020)
HernandezVargas, E.A.: Modeling and Control of Infectious Diseases in the Host: With MATLAB and R. Academic Press, Berlin (2019)
Ibeas, A., de la Sen, M., AlonsoQuesada, S., Zamani, I., Shafiee, M.: Observer design for seir discretetime epidemic models. In: 2014 13th International Conference on Control Automation Robotics and Vision (ICARCV), pp. 1321–1326. IEEE, New York (2014)
Iggidr, A., Souza, M.O.: State estimators for some epidemiological systems. J. Math. Biol. 78(1–2), 225–256 (2019)
Isidori, A.: Nonlinear Control Systems. Springer, Berlin (1999)
Khajavirad, A., Sahinidis, N.V.: A hybrid LP/NLP paradigm for global optimization relaxations. Math. Program. Comput. 10, 383–421 (2018)
Köhler, J., Schwenkel, L., Koch, A., Berberich, J., Pauli, P., Allgöwer, F.: Robust and optimal predictive control of the COVID19 outbreak. Preprint (2020). arXiv:2005.03580
Kronqvist, J., Bernal, D.E., Lundell, A., Grossmann, I.E.: A review and comparison of solvers for convex MINLP. Optim. Eng. 20(2), 397–455 (2019)
KSH: Hungarian Central Statistical Office. http://www.ksh.hu/?lang=en
Lauer, S.A., Grantz, K.H., Bi, Q., Jones, F.K., Zheng, Q., Meredith, H.R., Lessler, J.: The incubation period of Coronavirus disease 2019 (COVID19) from publicly reported confirmed cases: estimation and application. Anna. Intern. Med. 172(9), 577–582 (2020)
Löfberg, J.: YALMIP: a toolbox for modeling and optimization in MATLAB. In: Proceedings of the CACSD Conference (2004)
Morato, M.M., Bastos, S.B., Cajueiro, D.O., & NormeyRico, J.E.: An optimal predictive control strategy for COVID19 (SARSCoV2) social distancing policies in Brazil. Preprint arXiv:2005.10797 [qbio.PE] (2020)
Millerioux, G., Rosier, L., Bloch, G., Daafouz, J.: Bounded state reconstruction error for LPV systems with estimated parameters. IEEE Trans. Autom. Control 49(8), 1385–1389 (2004)
Moghadas, S.M., et al.: Projecting hospital utilization during the COVID19 outbreaks in the United States. Proc. Natl. Acad. Sci. USA 117(16), 9122–9126 (2020). https://doi.org/10.1073/pnas.2004064117
Moss, R., et al.: Modelling the impact of COVID19 in Australia to inform transmission reducing measures and health system preparedness. medR\(\chi \)iv (2020). https://doi.org/10.1101/2020.04.07.20056184
Muqbel, K., Vas, G., Röst, G.: Periodic orbits and global stability for a discontinuous SIR model with delayed control. Qual. Theory Dyn. Syst. 19, 59 (2020)
Nowzari, C., Preciado, V.M., Pappas, G.J.: Analysis and control of epidemics: a survey of spreading processes on complex networks. IEEE Control Syst. Mag. 36(1), 26–46 (2016)
Pugliese, A., Sottile, S.: Inferring the COVID19 infection curve in Italy. Preprint (2020). arXiv:2004.09404
Riobello, R.N.: On some new mathematical models of infectious diseases: analysis, equilibrium, positivity and vaccination controls. Ph.D. Thesis, University of Basque Country, Spain (2015)
Röst, G., Bartha, F., Bogya, N., Boldog, P., Dénes, A., Ferenci, T., Horváth, J.K., Juhász, A., Nagy, C., Tekeli, T., Vizi, Z., Oroszi, B.: Early phase of the COVID19 outbreak in Hungary and postlockdown scenarios. Viruses 12(7), 708 (2020). https://doi.org/10.3390/v12070708
Sebastiani, G., Massa, M., Riboli, E.: COVID19 epidemic in Italy: evolution, projections and impact of government measures. Eur. J. Epidemiol. 35, 341–345 (2020). https://doi.org/10.1007/s10654020006316
Sélley, F., Besenyei, Á., Kiss, I.Z., Simon, P.L.: Dynamic control of modern, networkbased epidemic models. SIAM J. Appl. Dyn. Syst. 14(1), 168–187 (2015)
Sontag, E.D.: Mathematical Control Theory: Deterministic and Finite Dimensional Systems. Springer, Berlin (1998)
Stewart, G., Heusden, K., Dumont, G.A.: How control theory can help us control COVID19. IEEE Spectr. 57(6), 22–29 (2020)
Stoecklin, S.B., et al.: First cases of Coronavirus disease 2019 (COVID19) in France: Surveillance, investigations and control measures. Euro Surveill. (2020). https://doi.org/10.2807/15607917.es.2020.25.6.2000094
Ullah, S., Khan, M.: Modeling the impact of nonpharmaceutical interventions on the dynamics of novel Coronavirus with optimal control analysis with a case study. Chaos Solitons and Fractals (2020). https://doi.org/10.1016/j.chaos.2020.110075
Wang, H., Wang, Z., Dong, Y., et al.: Phaseadjusted estimation of the number of Coronavirus disease 2019 cases in Wuhan. China. Cell Discov. (2020). https://doi.org/10.1038/s4142102001480. (Article number 10)
Wang, Z., Röst, G., Moghadas, S.M.: Delay in booster schedule as a control parameter in vaccination dynamics. J. Math. Biol. 79(5–6), 2157–2182 (2019)
Watkins, N.J., Nowzari, C., Pappas, G.J.: Robust economic model predictive control of continuoustime epidemic processes. IEEE Trans. Autom. Control 65(3), 1116–1131 (2020). https://doi.org/10.1109/TAC.2019.2919136
Weitz, J.S.: COVID19 epidemic risk assessment for Georgia. Github (2020). https://github.com/jsweitz/covid19gasummer2020
Wiersinga, W.J., Rhodes, A., Cheng, A.C., Peacock, S.J.: Pathophysiology, transmission, diagnosis, and treatment of Coronavirus disease 2019 (COVID19): a review. JAMA (2019). https://doi.org/10.1001/jama.2020.12839
WHO Situation Report191, Coronavirus disease 2019 (COVID19) 29 July 2020. https://www.who.int/docs/defaultsource/coronaviruse/situationreports/20200729covid19sitrep191.pdf
Wu, J., Tang, B., Bragazzi, N., Nah, K., McCarthy, Z.: Quantifying the role of social distancing, personal protection and case detection in mitigating COVID19 outbreak in Ontario, Canada. J. Math. Ind. 10(1), 15 (2020)
Zou, L., Ruan, F., Huang, M., et al.: SARSCoV2 viral load in upper respiratory specimens of infected patients. N. Engl. J. Med. 382(12), 1177–1179 (2020)
Acknowledgements
This research was initiated in the framework of the Hungarian National Development, Research, and Innovation (NKFIH) Fund 20202.1.1ED202000003 and of TUDFO/471381/2019ITM. TP gratefully acknowledges the support of the research program titled “Exploring the Mathematical Foundations of Artificial Intelligence” (20181.2.1NKP00008) and the János Bolyai Research Scholarship of the Hungarian Academy of Sciences. The part of the research carried out at BME has been supported by the NRDI Fund (TKP2020 IES, Grant No. BMEIEMIFM) based on the charter of bolster issued by the NRDI Office under the auspices of the Ministry for Innovation and Technology. GSz/GR have also been supported by the European Union, cofinanced by the European Social Fund through the Grants EFOP3.6.3VEKOP16201700002/EFOP3.6.116201600008. The support of NKFIH Projects 131545, 131501/FK124016 is also gratefully acknowledged. The authors would like to thank the anonymous reviewers for their constructive comments.
Funding
Open access funding provided by University of Szeged.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Péni, T., Csutak, B., Szederkényi, G. et al. Nonlinear model predictive control with logic constraints for COVID19 management. Nonlinear Dyn 102, 1965–1986 (2020). https://doi.org/10.1007/s11071020059801
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11071020059801
Keywords
 COVID19
 Epidemic model
 Disease control
 Differential equations
 Control theory
 Model predictive control
 Temporal logic