Potentials of modern active suspension control strategies – from model predictive control to deep learning approaches
The active suspension system has always been a topic of interest because of its ability to influence the ride quality by exerting independent forces on the suspension by the usage of separate actuators. Various strategies have been proposed over the years in order to estimate the appropriate control action. These strategies are typically feedback oriented and dependent on many factors like the control objective, the frequency of the excitation and system non-linearities that result in the formulation of a complex problem. A simulation-based study using a comprehensive quarter car model with an active suspension is beneficial to summarize the character of each of these approaches by comparing attributes like formulation, performance, robustness, tunability and requirements for implementation on real physical systems.
Since active suspensions use an on-board computer and sensor measurements to determine the control action, the enactment of a strategy is limited by the computational requirements and available measurements. This study aims to foresee such challenges when implementing modern control strategies like H∞ control or preview based approaches like Model Predictive Control (MPC) and Deep Learning methods. The latter will focus on both Supervised Learning (SL) and Reinforcement Learning (RL) approaches. These methods are firstly developed in a virtual environment and subsequently implemented on a physical quarter car setup excited by a servo-hydraulic actuator. Finally, a comparison of the performances of the different control approaches is presented.
Unable to display preview. Download preview PDF.
-  L. Eckstein, Vertical and Lateral Dynamics of Vehicles, Aachen, 2014.Google Scholar
-  S. Savaresi, C. Poussot-Vassal, C. Spelta, O. Sename and L. Dugard, Semi-Active Suspension Control Design for Vehicles, Elsevier, 2010.Google Scholar
-  G. Zames, “Feedback and Optimal Sensitivity: Model Reference Transformations, Multiplicative Seminorms, and Approximate Inverses,” IEEE Transactions on Automatic Control, pp. 301-320, April 1981.Google Scholar
-  MathWorks Inc., “Robust Control of an Active Suspension,” 2019. [Online]. Available: https://de.mathworks.com/help/robust/gs/active-suspension-controldesign.html.
-  H. Chen and K.-H. Guo, “Constrained H∞ Control of Active Suspensions: An LMI Approach,” IEEE Transactions on Control Systems Technology, pp. 412-4221, 2005.Google Scholar
-  N. M. Ghazaly, A.-N. Sharkawy, A. S. Ali and G. Abdel-Jaber, “H∞ Control of Active Suspension System for a Quarter Car Model,” International Journal of Vehicle Structures and Systems, pp. 81-87, January 2016.Google Scholar
-  M. Yamashita, K. Fujimori, K. Hayakawa and H. Kimura, “Application of H∞ control to active suspension systems,” IFAC Proceedings Volumes, pp. 87-90, 1993.Google Scholar
-  A. Alessio and A. Bemporad, “A Survey on Explicit Model Predictive Control,” in Nonlinear Model Predictive Control, Berlin, Heidelberg, Springer, 2009, pp. 345-369.Google Scholar
-  K. Kouramas, N. Faísca, C. Panos and E. Pistikopoulos, “Explicit/multiparametric model predictive control (MPC) of linear discrete-time systems by dynamic and multi-parametric programming,” Automatica 47, pp. 1638-1645, 2011.Google Scholar
-  L. H. Cseko”, M. Kvasnica and B. Lantos, “Analysis of the explicit model predictive control for the semi-active suspension,” Periodica Polytechnica, pp. 41-58, 2010.Google Scholar
-  J. Theunissen, A. Sorniotti, P. Gruber, S. Fallah, M. Dhaens, K. Reybrouck and C. Lauwerys, “Explicit model predictive control of active suspension systems,” Proceedings of the International Conference on Advanced Vehicle Powertrains, pp. 344-362, 2017.Google Scholar
-  R. Dessort and C. Chucholowski, “Explicit model predictive control of semiactive suspension systems using Artificial Neural Networks (ANN),” 8th International Munich Chassis Symposium, 2017.Google Scholar
-  V. Mnih, K. Kavukcuoglu, D. Silver, A. Graves, I. Antonoglou, D. Wierstra and M. Riedmiller, “Playing Atari with Deep Reinforcement Learning,” arXiv preprint arXiv:1312.5602, 2013.
-  R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction, London, England: The MIT Press, 2017.Google Scholar
-  G. Frost, T. J. Gordon, M. N. Howell and Q. H. Wu, “Moderated Reinforcement Learning of Active and Semi-Active Suspension Control Laws,” Proceedings of the Institution of Mechanical Engineers, Part I: Journal of Systems and Control Engineering, p. 249–257, 1 November 1992.Google Scholar
-  M. Howell, G. Frost, T. Gordon and Q. Wu, “Continuous action reinforcement learning applied to vehicle suspension control,” Mechatronics, pp. 263,276, 1997.Google Scholar
-  S. Tognetti, S. M. Savaresi, C. Spelta and M. Restelli, “Batch Reinforcement Learning for Semi-Active Suspension Control,” 18th IEEE International Conference on Control Applications, pp. 582-587, 8-10 July 2009.Google Scholar
-  I. O. Bucak and H. Oz, “Vibration control of a nonlinear quarter-car active suspension by reinforcement learning,” International Journal of Systems Science, 2011.Google Scholar
-  G. Koch, E. P. S. Spirk and B. Lohmann, “Design and Modelling of a Quarter-Vehicle Testrig for Active Suspension Control,” Technical Reports on Automatic Control, 21 July 2010.Google Scholar
-  M. F. Soong, R. Ramli and A. Saifizul, “Between simplicity and accuracy: Effect of adding modeling details on quarter car vehicle model accuracy,” PLoS ONE 12(6), 2017.Google Scholar
-  C. Zhang, O. Vinyals, R. Munos and S. Bengio, “A Study on Overfitting in Deep Reinforcement Learning,” CoRR, 2018.Google Scholar
-  J. C. Doyle, K. Glover, P. P. Khargonekar and B. A. Francis, “State-Space Solutions to Standard H2 and H∞ Control Problems,” IEEE Transactions on Automatic Control, pp. 831-847, August 1989.Google Scholar
-  M. Grant and S. Boyd, “CVX: Matlab Software for Disciplined Convex Programming, version 2.1,” March 2014. [Online]. Available: http://cvxr.com/cvx.
-  M. Grant and S. Boyd, “Graph implementations for nonsmooth convex programs,” in Recent Advances in Learning and Control, Springer-Verlag Limited, 2008, pp. 95-110.Google Scholar
-  L. Wang, Model Predictive Control System and Design Implementation using MATLAB, Springer, 2008.Google Scholar
-  MathWorks, Inc., “Optimization Toolbox,” 2019. [Online]. Available: https://de.mathworks.com/help/optim/index.html.
-  MathWorks, Inc., “Deep Learning Toolbox,” 2019. [Online]. Available: https://de.mathworks.com/help/deeplearning/.
-  A. Gosavi, Simulation-Based Optimization: Parametric Optimization Techniques and Reinforcement Leanring, New York, NY: Springer, 2014.Google Scholar
-  F. Gustafsson, Control of Inverted Double Pendulum using Reinforcement Learning, 2016.Google Scholar
-  L. Zuo and S. Nayfeh, “Low order continuous-time filters for approximation of the ISO 2631-1 human vibration sensitivity weightings,” Journal of Sound and Vibration 265, pp. 459-465, 2003.Google Scholar
-  E. Frazzolli, 6.241 Dynamic Systems and Control, Lecture 25: H∞ sysnthesis, Lecture Slides, Massachusetts Institute of Technology, 2011.Google Scholar