Abstract
In this paper, a stochastic model predictive controller is designed for discrete time linear time invariant systems, considering additive disturbance and stochastic constraints. As we know, in practical applications, measuring all state information of a system is not generally possible or affordable. So, in this work, an output feedback law is assumed as the control law. By utilizing the Chebyshev inequality and Schur complement, it is tried to convert a stochastic non-convex optimization problem into a deterministic convex optimization problem. Simulation results demonstrate the effectiveness of the proposed methodology.
Similar content being viewed by others
References
Anderson BD (1985) Adaptive systems, lack of persistency of excitation and bursting phenomena. Automatica 21(3):247–258
Arellano-Garcia H, Barz T, Dorneanu B, Vassiliadis VS (2020) Real-time feasibility of nonlinear model predictive control for semi-batch reactors subject to uncertainty and disturbances. Comput Chem Eng 133:106529
Badrno H, Baradarannia M, Bagheri P, Badamchizadeh M (2023) Distributed predictive consensus control of uncertain linear multi-agent systems with heterogeneous dynamics. Iran J Sci Technol Trans Electr Eng 47(1):255–267
Bagheri P (2021) Pole-zero assignment in model predictive control, using analytical tuning approach. Opt Control Appl Methods 42(5):1253–1268
Boyd SP, Vandenberghe L (2004) Convex optimization. Cambridge University Press
Brüdigam T, Olbrich M, Wollherr D, Leibold M (2021) Stochastic model predictive control with a safety guarantee for automated driving. IEEE Trans Intell Veh
Brunke L, Zhou S, Schoellig AP (2021) RLO-MPC: robust learning-based output feedback MPC for improving the performance of uncertain systems in iterative tasks. In: 2021 60th IEEE conference on decision and control (CDC), 2021. IEEE, pp 2183–2190
Buehler EA, Paulson JA, Mesbah A (2016) Lyapunov-based stochastic nonlinear model predictive control: shaping the state probability distribution functions. In: 2016 American control conference (ACC), 2016. IEEE, pp 5389–5394
Bujarbaruah M, Zhang X, Tanaskovic M, Borrelli F (2019) Adaptive MPC under time varying uncertainty: robust and stochastic. arXiv preprint arXiv:1909.13473
Chen Z, Hu H, Wu Y, Zhang Y, Li G, Liu Y (2020) Stochastic model predictive control for energy management of power-split plug-in hybrid electric vehicles based on reinforcement learning. Energy 211:118931
Darby ML, Nikolaou M (2012) MPC: current practice and challenges. Control Eng Pract 20(4):328–342
Dey A, Dhar A, Bhasin S (2022) Adaptive output feedback model predictive control. IEEE Control Syst Lett 7:1129–1134
Dhar A, Bhasin S (2021) Indirect adaptive mpc for discrete-time lti systems with parametric uncertainties. IEEE Trans Autom Control 66(11):5498–5505
Drgoňa J et al (2020) All you need to know about model predictive control for buildings. Annu Rev Control 50:190–232
Farina M, Giulioni L, Magni L, Scattolini R (2015) An approach to output-feedback MPC of stochastic linear discrete-time systems. Automatica 55:140–149
Farina M, Giulioni L, Magni L, Scattolini R (2013) A probabilistic approach to model predictive control. In: 52nd IEEE conference on decision and control, 2013. IEEE, pp 7734–7739
Forbes MG, Patwardhan RS, Hamadah H, Gopaluni RB (2015) Model predictive control in industry: challenges and opportunities. IFAC-PapersOnLine 48(8):531–538
Gholaminejad T, Khaki-Sedigh A, Bagheri P (2017) Direct adaptive model predictive control tuning based on the first-order plus dead time models. IET Control Theory Appl 11(16):2858–2869
Gravell B, Esfahani PM, Summers T (2020) Learning optimal controllers for linear systems with multiplicative noise via policy gradient. IEEE Trans Autom Control 66(11):5283–5298
Hewing L, Zeilinger MN (2020) Performance analysis of stochastic model predictive control with direct and indirect feedback. In: 2020 59th IEEE conference on decision and control (CDC), 2020. IEEE, pp 672–678
Hu B, Seiler P, Rantzer A (2017) A unified analysis of stochastic optimization methods using jump system theory and quadratic constraints. In: Conference on learning theory, 2017. PMLR, pp 1157–1189
Kumar R, Wenzel MJ, ElBsat MN, Risbeck MJ, Drees KH, Zavala VM (2020) Stochastic model predictive control for central HVAC plants. J Process Control 90:1–17
Lee JH (2011) Model predictive control: review of the three decades of development. Int J Control Autom Syst 9:415–424
Lofberg J, “YALMIP: a toolbox for modeling and optimization in MATLAB. In: 2004 IEEE international conference on robotics and automation (IEEE Cat. No. 04CH37508), 2004. IEEE, pp 284–289
Mareels I, Polderman JW, Mareels I, Polderman JW (1996) Adaptive systems. Springer
Mayne DQ (2014) Model predictive control: Recent developments and future promise. Automatica 50(12):2967–2986
Mesbah A (2016) Stochastic model predictive control: an overview and perspectives for future research. IEEE Control Syst Mag 36(6):30–44
Muñoz-Carpintero D, Hu G, Spanos CJ (2018) Stochastic model predictive control with adaptive constraint tightening for non-conservative chance constraints satisfaction. Automatica 96:32–39
Muske KR, Rawlings JB (1993) Model predictive control with linear models. AIChE J 39(2):262–287
Oldewurtel F, Jones CN, Morari M (2008) A tractable approximation of chance constrained stochastic MPC based on affine disturbance feedback. In: 2008 47th IEEE conference on decision and control, 2008. IEEE, pp 4731–4736
Papon EA, Haque A, Mulani SB (2019) Process optimization and stochastic modeling of void contents and mechanical properties in additively manufactured composites. Compos B Eng 177:107325
Ren M, Chen J, Shi P, Yan G, Cheng L (2021) Statistical information based two-layer model predictive control with dynamic economy and control performance for non-Gaussian stochastic process. J Frankl Inst 358(4):2279–2300
Saltık MB, Özkan L, Ludlage JH, Weiland S, Van den Hof PM (2018) An outlook on robust model predictive control algorithms: Reflections on performance and computational aspects. J Process Control 61:77–102
Shapiro A, Xin L (2020) Time inconsistency of optimal policies of distributionally robust inventory models. Oper Res 68(5):1576–1584
Shapiro A, Dentcheva D, Ruszczynski A (2021) Lectures on stochastic programming: modeling and theory. SIAM
Shin M, Primbs JA (2011) A riccati based interior point algorithm for the computation in constrained stochastic mpc. IEEE Trans Autom Control 57(3):760–765
Subramanian S, Lucia S, Paulen R, Engell S (2021) Tube-enhanced multi-stage model predictive control for flexible robust control of constrained linear systems with additive and parametric uncertainties. Int J Robust Nonlinear Control 31(9):4458–4487
Weibel MG (2019) Fast scenario-based optimal control for stochastic portfolio optimization with application to a large-scale portfolio
Wieslander J, Wittenmark B (1971) An approach to adaptive control using real time identification. Automatica 7(2):211–217
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors have no relevant financial or non-financial interests to disclose. The authors have no competing interests to declare that are relevant to the content of this article.
Appendix (Proof of Recursive Feasibility)
Appendix (Proof of Recursive Feasibility)
To characterize the properties of the proposed algorithm, we establish the feasibility set of the SMPC control problem as follows:
\(\Xi =\{\)(\({\overline{y} }_{0}, {Y}_{0}): \exists {\overline{u} }_{0,\dots ,N-1},{K}_{0,\dots ,N-1}\) such that (13a), (13b) hold for all \(k=0,\dots ,N-1\) and are verified \({\overline{y} }_{t+N}\in {Y}_{f}\) and \({Y}_{{\text{t}}+{\text{N}}}\le \overline{Y }\)}.
As \(\overline{Y }\) is a terminal condition of \(Y\), it plays the role of an invariant set for the variance. Assume that at time \(t\), a feasible solution of SMPC is available as (\({\overline{y} }_{t|t}, {Y}_{t|t})\in\Xi\) with optimal sequence {\({\overline{u} }_{t|t}, \dots ,{\overline{u} }_{t+N-1|t}\}\) and \({\{K}_{t|t}, \dots , {K}_{kt+N-1|t}\}.\) We prove that, at time \(t+1\), at least a feasible solution to SMPC exists (\({\overline{y} }_{t+1|t}, {Y}_{t+1|t})\) with feasible possibly suboptimal, sequences {\({\overline{u} }_{t+1|t}, \dots ,{\overline{u} }_{t+N-1|t}\}\) and \({\{K}_{t+1|t}, \dots , {K}_{kt+N-1|t}\}.\)
Constraint (13a) is verified for all pairs (\({\overline{y} }_{t+1+k|t}, {Y}_{t+1+k|t}) , k=0, \dots , N-2\) in view of the feasibility of SMPC at time\(t\). Furthermore, in view of \({\overline{y} }_{t+N}\in {Y}_{f}\) and \({Y}_{{\text{t}}+{\text{N}}}\le \overline{Y }\), we have
For all \(j=1,\dots ,P\) constraint (13a) is verified.
Analogously, constraint (13b) is verified for all pairs (\({\overline{u} }_{t+1+k|t}, {U}_{t+1+k|t})\),\(k=0, \dots , N-2,\) in view of the feasibility of SMPC at time \(t\). Furthermore, in view of \({\overline{y} }_{t+N}\in {Y}_{f}\) and \({Y}_{{\text{t}}+{\text{N}}}\le \overline{Y }\) and the condition (13b), we have that
For all all \(j=1,\dots ,P\) constraint (13b) is verified.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Banapour, E., Bagheri, P. & Hashemzadeh, F. Output Feedback Stochastic Model Predictive Control for Linear Systems with Convex Optimization Approach. Iran J Sci Technol Trans Electr Eng 48, 1199–1208 (2024). https://doi.org/10.1007/s40998-024-00703-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40998-024-00703-3