## Abstract

In this paper, a stochastic model predictive controller is designed for discrete time linear time invariant systems, considering additive disturbance and stochastic constraints. As we know, in practical applications, measuring all state information of a system is not generally possible or affordable. So, in this work, an output feedback law is assumed as the control law. By utilizing the Chebyshev inequality and Schur complement, it is tried to convert a stochastic non-convex optimization problem into a deterministic convex optimization problem. Simulation results demonstrate the effectiveness of the proposed methodology.

### Similar content being viewed by others

## References

Anderson BD (1985) Adaptive systems, lack of persistency of excitation and bursting phenomena. Automatica 21(3):247–258

Arellano-Garcia H, Barz T, Dorneanu B, Vassiliadis VS (2020) Real-time feasibility of nonlinear model predictive control for semi-batch reactors subject to uncertainty and disturbances. Comput Chem Eng 133:106529

Badrno H, Baradarannia M, Bagheri P, Badamchizadeh M (2023) Distributed predictive consensus control of uncertain linear multi-agent systems with heterogeneous dynamics. Iran J Sci Technol Trans Electr Eng 47(1):255–267

Bagheri P (2021) Pole-zero assignment in model predictive control, using analytical tuning approach. Opt Control Appl Methods 42(5):1253–1268

Boyd SP, Vandenberghe L (2004) Convex optimization. Cambridge University Press

Brüdigam T, Olbrich M, Wollherr D, Leibold M (2021) Stochastic model predictive control with a safety guarantee for automated driving. IEEE Trans Intell Veh

Brunke L, Zhou S, Schoellig AP (2021) RLO-MPC: robust learning-based output feedback MPC for improving the performance of uncertain systems in iterative tasks. In: 2021 60th IEEE conference on decision and control (CDC), 2021. IEEE, pp 2183–2190

Buehler EA, Paulson JA, Mesbah A (2016) Lyapunov-based stochastic nonlinear model predictive control: shaping the state probability distribution functions. In: 2016 American control conference (ACC), 2016. IEEE, pp 5389–5394

Bujarbaruah M, Zhang X, Tanaskovic M, Borrelli F (2019) Adaptive MPC under time varying uncertainty: robust and stochastic. arXiv preprint arXiv:1909.13473

Chen Z, Hu H, Wu Y, Zhang Y, Li G, Liu Y (2020) Stochastic model predictive control for energy management of power-split plug-in hybrid electric vehicles based on reinforcement learning. Energy 211:118931

Darby ML, Nikolaou M (2012) MPC: current practice and challenges. Control Eng Pract 20(4):328–342

Dey A, Dhar A, Bhasin S (2022) Adaptive output feedback model predictive control. IEEE Control Syst Lett 7:1129–1134

Dhar A, Bhasin S (2021) Indirect adaptive mpc for discrete-time lti systems with parametric uncertainties. IEEE Trans Autom Control 66(11):5498–5505

Drgoňa J et al (2020) All you need to know about model predictive control for buildings. Annu Rev Control 50:190–232

Farina M, Giulioni L, Magni L, Scattolini R (2015) An approach to output-feedback MPC of stochastic linear discrete-time systems. Automatica 55:140–149

Farina M, Giulioni L, Magni L, Scattolini R (2013) A probabilistic approach to model predictive control. In: 52nd IEEE conference on decision and control, 2013. IEEE, pp 7734–7739

Forbes MG, Patwardhan RS, Hamadah H, Gopaluni RB (2015) Model predictive control in industry: challenges and opportunities. IFAC-PapersOnLine 48(8):531–538

Gholaminejad T, Khaki-Sedigh A, Bagheri P (2017) Direct adaptive model predictive control tuning based on the first-order plus dead time models. IET Control Theory Appl 11(16):2858–2869

Gravell B, Esfahani PM, Summers T (2020) Learning optimal controllers for linear systems with multiplicative noise via policy gradient. IEEE Trans Autom Control 66(11):5283–5298

Hewing L, Zeilinger MN (2020) Performance analysis of stochastic model predictive control with direct and indirect feedback. In: 2020 59th IEEE conference on decision and control (CDC), 2020. IEEE, pp 672–678

Hu B, Seiler P, Rantzer A (2017) A unified analysis of stochastic optimization methods using jump system theory and quadratic constraints. In: Conference on learning theory, 2017. PMLR, pp 1157–1189

Kumar R, Wenzel MJ, ElBsat MN, Risbeck MJ, Drees KH, Zavala VM (2020) Stochastic model predictive control for central HVAC plants. J Process Control 90:1–17

Lee JH (2011) Model predictive control: review of the three decades of development. Int J Control Autom Syst 9:415–424

Lofberg J, “YALMIP: a toolbox for modeling and optimization in MATLAB. In: 2004 IEEE international conference on robotics and automation (IEEE Cat. No. 04CH37508), 2004. IEEE, pp 284–289

Mareels I, Polderman JW, Mareels I, Polderman JW (1996) Adaptive systems. Springer

Mayne DQ (2014) Model predictive control: Recent developments and future promise. Automatica 50(12):2967–2986

Mesbah A (2016) Stochastic model predictive control: an overview and perspectives for future research. IEEE Control Syst Mag 36(6):30–44

Muñoz-Carpintero D, Hu G, Spanos CJ (2018) Stochastic model predictive control with adaptive constraint tightening for non-conservative chance constraints satisfaction. Automatica 96:32–39

Muske KR, Rawlings JB (1993) Model predictive control with linear models. AIChE J 39(2):262–287

Oldewurtel F, Jones CN, Morari M (2008) A tractable approximation of chance constrained stochastic MPC based on affine disturbance feedback. In: 2008 47th IEEE conference on decision and control, 2008. IEEE, pp 4731–4736

Papon EA, Haque A, Mulani SB (2019) Process optimization and stochastic modeling of void contents and mechanical properties in additively manufactured composites. Compos B Eng 177:107325

Ren M, Chen J, Shi P, Yan G, Cheng L (2021) Statistical information based two-layer model predictive control with dynamic economy and control performance for non-Gaussian stochastic process. J Frankl Inst 358(4):2279–2300

Saltık MB, Özkan L, Ludlage JH, Weiland S, Van den Hof PM (2018) An outlook on robust model predictive control algorithms: Reflections on performance and computational aspects. J Process Control 61:77–102

Shapiro A, Xin L (2020) Time inconsistency of optimal policies of distributionally robust inventory models. Oper Res 68(5):1576–1584

Shapiro A, Dentcheva D, Ruszczynski A (2021) Lectures on stochastic programming: modeling and theory. SIAM

Shin M, Primbs JA (2011) A riccati based interior point algorithm for the computation in constrained stochastic mpc. IEEE Trans Autom Control 57(3):760–765

Subramanian S, Lucia S, Paulen R, Engell S (2021) Tube-enhanced multi-stage model predictive control for flexible robust control of constrained linear systems with additive and parametric uncertainties. Int J Robust Nonlinear Control 31(9):4458–4487

Weibel MG (2019) Fast scenario-based optimal control for stochastic portfolio optimization with application to a large-scale portfolio

Wieslander J, Wittenmark B (1971) An approach to adaptive control using real time identification. Automatica 7(2):211–217

## Author information

### Authors and Affiliations

### Corresponding author

## Ethics declarations

### Conflict of interest

The authors have no relevant financial or non-financial interests to disclose. The authors have no competing interests to declare that are relevant to the content of this article.

## Appendix (Proof of Recursive Feasibility)

### Appendix (Proof of Recursive Feasibility)

To characterize the properties of the proposed algorithm, we establish the feasibility set of the SMPC control problem as follows:

\(\Xi =\{\)(\({\overline{y} }_{0}, {Y}_{0}): \exists {\overline{u} }_{0,\dots ,N-1},{K}_{0,\dots ,N-1}\) such that (13a), (13b) hold for all \(k=0,\dots ,N-1\) and are verified \({\overline{y} }_{t+N}\in {Y}_{f}\) and \({Y}_{{\text{t}}+{\text{N}}}\le \overline{Y }\)}.

As \(\overline{Y }\) is a terminal condition of \(Y\), it plays the role of an invariant set for the variance. Assume that at time \(t\), a feasible solution of SMPC is available as (\({\overline{y} }_{t|t}, {Y}_{t|t})\in\Xi\) with optimal sequence {\({\overline{u} }_{t|t}, \dots ,{\overline{u} }_{t+N-1|t}\}\) and \({\{K}_{t|t}, \dots , {K}_{kt+N-1|t}\}.\) We prove that, at time \(t+1\), at least a feasible solution to SMPC exists (\({\overline{y} }_{t+1|t}, {Y}_{t+1|t})\) with feasible possibly suboptimal, sequences {\({\overline{u} }_{t+1|t}, \dots ,{\overline{u} }_{t+N-1|t}\}\) and \({\{K}_{t+1|t}, \dots , {K}_{kt+N-1|t}\}.\)

Constraint (13a) is verified for all pairs (\({\overline{y} }_{t+1+k|t}, {Y}_{t+1+k|t}) , k=0, \dots , N-2\) in view of the feasibility of SMPC at time\(t\). Furthermore, in view of \({\overline{y} }_{t+N}\in {Y}_{f}\) and \({Y}_{{\text{t}}+{\text{N}}}\le \overline{Y }\), we have

For all \(j=1,\dots ,P\) constraint (13a) is verified.

Analogously, constraint (13b) is verified for all pairs (\({\overline{u} }_{t+1+k|t}, {U}_{t+1+k|t})\),\(k=0, \dots , N-2,\) in view of the feasibility of SMPC at time \(t\). Furthermore, in view of \({\overline{y} }_{t+N}\in {Y}_{f}\) and \({Y}_{{\text{t}}+{\text{N}}}\le \overline{Y }\) and the condition (13b), we have that

For all all \(j=1,\dots ,P\) constraint (13b) is verified.

## Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

## About this article

### Cite this article

Banapour, E., Bagheri, P. & Hashemzadeh, F. Output Feedback Stochastic Model Predictive Control for Linear Systems with Convex Optimization Approach.
*Iran J Sci Technol Trans Electr Eng* **48**, 1199–1208 (2024). https://doi.org/10.1007/s40998-024-00703-3

Received:

Accepted:

Published:

Issue Date:

DOI: https://doi.org/10.1007/s40998-024-00703-3