Skip to main content
Log in

Output Feedback Stochastic Model Predictive Control for Linear Systems with Convex Optimization Approach

  • Research Paper
  • Published:
Iranian Journal of Science and Technology, Transactions of Electrical Engineering Aims and scope Submit manuscript

Abstract

In this paper, a stochastic model predictive controller is designed for discrete time linear time invariant systems, considering additive disturbance and stochastic constraints. As we know, in practical applications, measuring all state information of a system is not generally possible or affordable. So, in this work, an output feedback law is assumed as the control law. By utilizing the Chebyshev inequality and Schur complement, it is tried to convert a stochastic non-convex optimization problem into a deterministic convex optimization problem. Simulation results demonstrate the effectiveness of the proposed methodology.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  • Anderson BD (1985) Adaptive systems, lack of persistency of excitation and bursting phenomena. Automatica 21(3):247–258

    Article  Google Scholar 

  • Arellano-Garcia H, Barz T, Dorneanu B, Vassiliadis VS (2020) Real-time feasibility of nonlinear model predictive control for semi-batch reactors subject to uncertainty and disturbances. Comput Chem Eng 133:106529

    Article  Google Scholar 

  • Badrno H, Baradarannia M, Bagheri P, Badamchizadeh M (2023) Distributed predictive consensus control of uncertain linear multi-agent systems with heterogeneous dynamics. Iran J Sci Technol Trans Electr Eng 47(1):255–267

    Article  Google Scholar 

  • Bagheri P (2021) Pole-zero assignment in model predictive control, using analytical tuning approach. Opt Control Appl Methods 42(5):1253–1268

    Article  MathSciNet  Google Scholar 

  • Boyd SP, Vandenberghe L (2004) Convex optimization. Cambridge University Press

    Book  Google Scholar 

  • Brüdigam T, Olbrich M, Wollherr D, Leibold M (2021) Stochastic model predictive control with a safety guarantee for automated driving. IEEE Trans Intell Veh

  • Brunke L, Zhou S, Schoellig AP (2021) RLO-MPC: robust learning-based output feedback MPC for improving the performance of uncertain systems in iterative tasks. In: 2021 60th IEEE conference on decision and control (CDC), 2021. IEEE, pp 2183–2190

  • Buehler EA, Paulson JA, Mesbah A (2016) Lyapunov-based stochastic nonlinear model predictive control: shaping the state probability distribution functions. In: 2016 American control conference (ACC), 2016. IEEE, pp 5389–5394

  • Bujarbaruah M, Zhang X, Tanaskovic M, Borrelli F (2019) Adaptive MPC under time varying uncertainty: robust and stochastic. arXiv preprint arXiv:1909.13473

  • Chen Z, Hu H, Wu Y, Zhang Y, Li G, Liu Y (2020) Stochastic model predictive control for energy management of power-split plug-in hybrid electric vehicles based on reinforcement learning. Energy 211:118931

    Article  Google Scholar 

  • Darby ML, Nikolaou M (2012) MPC: current practice and challenges. Control Eng Pract 20(4):328–342

    Article  Google Scholar 

  • Dey A, Dhar A, Bhasin S (2022) Adaptive output feedback model predictive control. IEEE Control Syst Lett 7:1129–1134

    Article  MathSciNet  Google Scholar 

  • Dhar A, Bhasin S (2021) Indirect adaptive mpc for discrete-time lti systems with parametric uncertainties. IEEE Trans Autom Control 66(11):5498–5505

    Article  MathSciNet  Google Scholar 

  • Drgoňa J et al (2020) All you need to know about model predictive control for buildings. Annu Rev Control 50:190–232

    Article  MathSciNet  Google Scholar 

  • Farina M, Giulioni L, Magni L, Scattolini R (2015) An approach to output-feedback MPC of stochastic linear discrete-time systems. Automatica 55:140–149

    Article  MathSciNet  Google Scholar 

  • Farina M, Giulioni L, Magni L, Scattolini R (2013) A probabilistic approach to model predictive control. In: 52nd IEEE conference on decision and control, 2013. IEEE, pp 7734–7739

  • Forbes MG, Patwardhan RS, Hamadah H, Gopaluni RB (2015) Model predictive control in industry: challenges and opportunities. IFAC-PapersOnLine 48(8):531–538

    Article  Google Scholar 

  • Gholaminejad T, Khaki-Sedigh A, Bagheri P (2017) Direct adaptive model predictive control tuning based on the first-order plus dead time models. IET Control Theory Appl 11(16):2858–2869

    Article  MathSciNet  Google Scholar 

  • Gravell B, Esfahani PM, Summers T (2020) Learning optimal controllers for linear systems with multiplicative noise via policy gradient. IEEE Trans Autom Control 66(11):5283–5298

    Article  MathSciNet  Google Scholar 

  • Hewing L, Zeilinger MN (2020) Performance analysis of stochastic model predictive control with direct and indirect feedback. In: 2020 59th IEEE conference on decision and control (CDC), 2020. IEEE, pp 672–678

  • Hu B, Seiler P, Rantzer A (2017) A unified analysis of stochastic optimization methods using jump system theory and quadratic constraints. In: Conference on learning theory, 2017. PMLR, pp 1157–1189

  • Kumar R, Wenzel MJ, ElBsat MN, Risbeck MJ, Drees KH, Zavala VM (2020) Stochastic model predictive control for central HVAC plants. J Process Control 90:1–17

    Article  Google Scholar 

  • Lee JH (2011) Model predictive control: review of the three decades of development. Int J Control Autom Syst 9:415–424

    Article  Google Scholar 

  • Lofberg J, “YALMIP: a toolbox for modeling and optimization in MATLAB. In: 2004 IEEE international conference on robotics and automation (IEEE Cat. No. 04CH37508), 2004. IEEE, pp 284–289

  • Mareels I, Polderman JW, Mareels I, Polderman JW (1996) Adaptive systems. Springer

    Book  Google Scholar 

  • Mayne DQ (2014) Model predictive control: Recent developments and future promise. Automatica 50(12):2967–2986

    Article  MathSciNet  Google Scholar 

  • Mesbah A (2016) Stochastic model predictive control: an overview and perspectives for future research. IEEE Control Syst Mag 36(6):30–44

    Article  MathSciNet  Google Scholar 

  • Muñoz-Carpintero D, Hu G, Spanos CJ (2018) Stochastic model predictive control with adaptive constraint tightening for non-conservative chance constraints satisfaction. Automatica 96:32–39

    Article  MathSciNet  Google Scholar 

  • Muske KR, Rawlings JB (1993) Model predictive control with linear models. AIChE J 39(2):262–287

    Article  Google Scholar 

  • Oldewurtel F, Jones CN, Morari M (2008) A tractable approximation of chance constrained stochastic MPC based on affine disturbance feedback. In: 2008 47th IEEE conference on decision and control, 2008. IEEE, pp 4731–4736

  • Papon EA, Haque A, Mulani SB (2019) Process optimization and stochastic modeling of void contents and mechanical properties in additively manufactured composites. Compos B Eng 177:107325

    Article  Google Scholar 

  • Ren M, Chen J, Shi P, Yan G, Cheng L (2021) Statistical information based two-layer model predictive control with dynamic economy and control performance for non-Gaussian stochastic process. J Frankl Inst 358(4):2279–2300

    Article  MathSciNet  Google Scholar 

  • Saltık MB, Özkan L, Ludlage JH, Weiland S, Van den Hof PM (2018) An outlook on robust model predictive control algorithms: Reflections on performance and computational aspects. J Process Control 61:77–102

    Article  Google Scholar 

  • Shapiro A, Xin L (2020) Time inconsistency of optimal policies of distributionally robust inventory models. Oper Res 68(5):1576–1584

    Article  MathSciNet  Google Scholar 

  • Shapiro A, Dentcheva D, Ruszczynski A (2021) Lectures on stochastic programming: modeling and theory. SIAM

    Book  Google Scholar 

  • Shin M, Primbs JA (2011) A riccati based interior point algorithm for the computation in constrained stochastic mpc. IEEE Trans Autom Control 57(3):760–765

    Article  MathSciNet  Google Scholar 

  • Subramanian S, Lucia S, Paulen R, Engell S (2021) Tube-enhanced multi-stage model predictive control for flexible robust control of constrained linear systems with additive and parametric uncertainties. Int J Robust Nonlinear Control 31(9):4458–4487

    Article  MathSciNet  Google Scholar 

  • Weibel MG (2019) Fast scenario-based optimal control for stochastic portfolio optimization with application to a large-scale portfolio

  • Wieslander J, Wittenmark B (1971) An approach to adaptive control using real time identification. Automatica 7(2):211–217

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Peyman Bagheri.

Ethics declarations

Conflict of interest

The authors have no relevant financial or non-financial interests to disclose. The authors have no competing interests to declare that are relevant to the content of this article.

Appendix (Proof of Recursive Feasibility)

Appendix (Proof of Recursive Feasibility)

To characterize the properties of the proposed algorithm, we establish the feasibility set of the SMPC control problem as follows:

\(\Xi =\{\)(\({\overline{y} }_{0}, {Y}_{0}): \exists {\overline{u} }_{0,\dots ,N-1},{K}_{0,\dots ,N-1}\) such that (13a), (13b) hold for all \(k=0,\dots ,N-1\) and are verified \({\overline{y} }_{t+N}\in {Y}_{f}\) and \({Y}_{{\text{t}}+{\text{N}}}\le \overline{Y }\)}.

As \(\overline{Y }\) is a terminal condition of \(Y\), it plays the role of an invariant set for the variance. Assume that at time \(t\), a feasible solution of SMPC is available as (\({\overline{y} }_{t|t}, {Y}_{t|t})\in\Xi\) with optimal sequence {\({\overline{u} }_{t|t}, \dots ,{\overline{u} }_{t+N-1|t}\}\) and \({\{K}_{t|t}, \dots , {K}_{kt+N-1|t}\}.\) We prove that, at time \(t+1\), at least a feasible solution to SMPC exists (\({\overline{y} }_{t+1|t}, {Y}_{t+1|t})\) with feasible possibly suboptimal, sequences {\({\overline{u} }_{t+1|t}, \dots ,{\overline{u} }_{t+N-1|t}\}\) and \({\{K}_{t+1|t}, \dots , {K}_{kt+N-1|t}\}.\)

Constraint (13a) is verified for all pairs (\({\overline{y} }_{t+1+k|t}, {Y}_{t+1+k|t}) , k=0, \dots , N-2\) in view of the feasibility of SMPC at time\(t\). Furthermore, in view of \({\overline{y} }_{t+N}\in {Y}_{f}\) and \({Y}_{{\text{t}}+{\text{N}}}\le \overline{Y }\), we have

$$h_{y,j} \overline{y}_{t + N|t} \le \left( {1 - 0.5\varepsilon } \right)g_{y,j} - \frac{{h_{y,j}^{2} Y_{k} }}{{2\varepsilon g_{y,j} \beta_{j} }} \le \left( {1 - 0.5\varepsilon } \right)g_{y,j} - \frac{{h_{y,j}^{2} Y_{t + N|t} }}{{2\varepsilon g_{y,j} \beta_{j} }}$$
(29)

For all \(j=1,\dots ,P\) constraint (13a) is verified.

Analogously, constraint (13b) is verified for all pairs (\({\overline{u} }_{t+1+k|t}, {U}_{t+1+k|t})\),\(k=0, \dots , N-2,\) in view of the feasibility of SMPC at time \(t\). Furthermore, in view of \({\overline{y} }_{t+N}\in {Y}_{f}\) and \({Y}_{{\text{t}}+{\text{N}}}\le \overline{Y }\) and the condition (13b), we have that

$$h_{y,j} k\overline{y}_{t + N|t} \le \left( {1 - 0.5\varepsilon } \right)g_{y,j} - \frac{{h_{y,j}^{2} U_{k} }}{{2\varepsilon g_{y,j} \beta_{j} }} \le \left( {1 - 0.5\varepsilon } \right)g_{y,j} - \frac{{h_{y,j}^{2} YU_{t + N|t} }}{{2\varepsilon g_{y,j} \beta_{j} }}$$
(30)

For all all \(j=1,\dots ,P\) constraint (13b) is verified.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Banapour, E., Bagheri, P. & Hashemzadeh, F. Output Feedback Stochastic Model Predictive Control for Linear Systems with Convex Optimization Approach. Iran J Sci Technol Trans Electr Eng (2024). https://doi.org/10.1007/s40998-024-00703-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s40998-024-00703-3

Keywords

Navigation