Abstract
Purpose of Review
We review recent advances in algorithmic development and validation for modeling and control of soft robots leveraging the Koopman operator theory.
Recent Findings
We identify the following trends in recent research efforts in this area. (1) The design of lifting functions used in the data-driven approximation of the Koopman operator is critical for soft robots. (2) Robustness considerations are emphasized. Works are proposed to reduce the effect of uncertainty and noise during the process of modeling and control. (3) The Koopman operator has been embedded into different model-based control structures to drive the soft robots.
Summary
Because of their compliance and nonlinearities, modeling and control of soft robots face key challenges. To resolve these challenges, Koopman operator-based approaches have been proposed, in an effort to express the nonlinear system in a linear manner. The Koopman operator enables global linearization to reduce nonlinearities and/or serves as model constraints in model-based control algorithms for soft robots. Various implementations in soft robotic systems are illustrated and summarized in the review.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
Introduction
Soft robots have been receiving significant attention over the years, and have grown into an important research topic. In contrast to their rigid counterparts, soft robots have bodies made out of intrinsically soft/or extensible materials, which exhibit unprecedented adaptation to complex environments and can absorb impact energy for safe interactions with the environment, other robots, and even humans [1]. Soft robots have been applied in all aspects of robotic research, including but not limited to assistive robotics [2,3,4], grasping [5, 6•, 7], ground mobility [8, 9], legged locomotion [10, 11], aerial robots [12] and underwater robots [13].
One of the prevailing challenges relates to their modeling and control [14]. To facilitate model-based control, researchers have proposed several quantitative modeling methods to parameterize soft robots (mostly continuum robots) using analytical models. For instance, piecewise constant curvature models [15, 16] with extensions to physical interactions [17, 18] have been successfully applied in modeling dynamic motion of soft robots. Further, numerical models have been utilized to discretize the geometry and achieve approximations. Cosserat rod theory [19,20,21,22] and its extension to multiple degrees [23], discrete Cosserat models [24, 25], polynomial curvature models [26, 27], and rigid body approximations [28, 29] have been proposed to model soft robots numerically. Finite element models have also been applied in modeling soft robots using industrial simulators [30], as well as reduced-order models [31,32,33]. However, the effectiveness of these methods relies on the accuracy of measurements of the actuator (e.g., length, strain, or curvature), if not relying on feedback [34]. Due to the infinite degrees of freedom of soft robots, accurate first principles-based models are hard to derive. Moreover, in most cases, system nonlinearities pose additional difficulties to controller design [4]. One way to resolve such constraints is by considering data-driven methods [35, 36].
Data-driven methods provide promising solutions to soft robot modeling, with the merits of alleviating requirements for sensory data while addressing sensor noise [34]. Data-driven modeling methods for soft robots are generally categorized in two ways: (1) iterative kinematic mappings and (2) learning methods. The former utilizes iterative optimization to refine the desired mapping relationships among actuation, configuration and task spaces, such as iterative Jacobian matrix estimation [37, 38] and adaptive Kalman filters [39,40,41,42]. Learning methods for soft robots modeling include Feed-forward Neural Networks (FNN) [43, 44], Locally Weighted Projection Regression (LWPR) [45, 46] and Gaussian Process Regression (GPR) [47]. Analytical models with learning-based extensions are also applied to improve the dynamic modeling of soft robots [48,49,50,51]. In recent years, Reinforcement Learning (RL) has also been studied to model soft robots, such as model-based methods [52,53,54] and their model-free counterparts [55,56,57,58].
Other than machine learning approaches, Koopman spectral theory [59,60,61] has emerged as a dominant perspective over the past decade, in which nonlinear dynamics are represented in terms of an infinite-dimensional linear operator acting on the space of all possible measurement functions of the system [62,63,64,65,66,67,68]. Recent research efforts have sought to use the Koopman operator in robotics. Examples include modeling and control of a tail-actuated robotic fish [69], trajectory control of micro-aerial vehicles [70], dynamics estimation for a spherical robot [71] as well as model extraction for a simulated lunar lander system [72].
Recent advances in data-driven estimation approaches of the Koopman operator enable embedding the Koopman operator theory to soft robotic systems. First, instead of linearization at a certain point (local linearization), the Koopman operator is able to evolve a nonlinear system with full fidelity throughout the state space (global linearization). This makes Koopman operators an attractive approach for obtaining linear representations of complex and/or nonlinear systems. By expressing a system’s dynamics as a linear model, the stability properties can be more readily analyzed [73], and various well-designed reliable controllers can be easily obtained [74]. Second, via mapping the original unknown system to the Koopman space and approximating the operator from measurements, the Koopman operator theory can be used as a data-driven model extraction method. Both of the two aforementioned properties make the Koopman operator well-suited for implementation in soft robotics whereby complexity in modeling as well as control and nonlinearities are key challenges.
The main goal of this review is to offer an overview of recent advances in implementing the Koopman operator in soft robotic systems. In the “Background” section, we introduce the theoretical foundations of the Koopman operator theory. In the “Model Identification with KoopmanOperator” section, we present the implementation details of using the Koopman operator to extract model descriptions of soft robots. In the “Controller Design” section, different types of Koopman-based control structures and examples are introduced. Finally, in the “Discussion and Conclusion” section, we propose several possible future directions and discuss the challenges that can be addressed when applying the Koopman operator in the modeling and control of soft robotic systems.
Background
In this section, we give an overview of key relevant results on the Koopman operator as shown in Fig. 1, the Koopman generator and related data-driven approximation approaches.
Koopman Operator
Consider a dynamical system with state vector \(q \in \mathbb {R}^{n_{q}}\),
for the discrete-time and continuous-time settings, respectively. Define a set of observables \(\gamma \in \mathcal {F}\) to be the mapped or lifted states. The evolution of observables \(\gamma \) using the infinite-dimensional Koopman operator \(\mathcal {K}:\mathcal {F} \rightarrow \mathcal {F}\) can be written as
If we further define the lifted states \(\gamma (q)\) as new states \(z = \gamma (q)\) in this linear Koopman space, the original nonlinear problem is transferred into a linear problem in this new space and various traditional linear controllers can be designed and implemented.
The Koopman operator can also be utilized to identify the dynamical system of the nonlinear form. Under the full-observability assumption that there exists one of the observables \(\gamma (q)=q\), N Koopman-based items including Koopman modes \(v_{n}\), eigenvalues \(\lambda _{n}\) and eigenfunctions \(\varphi _{n}\) can be obtained by decomposing the Koopman operator [75]. Finally, the unknown nonlinear operator f in (1) can be approximated as the combination of the Koopman-based items as
Extended Mode Decomposition (EDMD)
In practice, we typically have access to the discretely sampled measurement data of the system, which are used to obtain a finite-dimensional approximated matrix of the infinite-dimensional Koopman operator. Although approximating the Koopman operator induces errors in the system propagation, it has been shown that the linear model is able to evolve the original system with acceptable accuracy [76, 77].
Of all the approximation approaches, one of the most popular algorithms is the Extended Dynamic Mode Decomposition (EDMD) approach [75]. It describes how to learn those Koopman-based items in (2) from data. Given state history \(q = [q_{1},q_{2},\dots ,q_{M},q_{M+1}]\) (commonly referred to as “snapshots"), \(\mathcal {K}\) can be expressed as a finite-dimensional approximation \(K:\mathcal {F}_{N} \rightarrow \mathcal {F}_{N}\) of the Koopman operator \(\mathcal {K}:\mathcal {F} \rightarrow \mathcal {F}\) via EDMD. To do so, we need a dictionary of functions that lift state variables to the higher-dimensional space where observable dynamics is approximately linear. Define the dictionary \(\varvec{\Psi }(q_{m})=[\psi _{1}(q_{m}), \ldots , \psi _{N}(q_{m})]\), the Koopman operator can be approximated by minimizing the total residual between snapshots,
This can be solved by truncated singular value decomposition, yielding
with \(^{\dagger }\), T and \(^{*}\) denoting pseudoinverse, transpose and conjugate transpose, respectively. Obtained K via (3), we get
where \(\eta _{n}\) is the n-th eigenvector, \(w_{n}\) is the n-th left eigenvector of K scaled so \({w_{n}^{T}}\eta _{n} = 1\), and B is a weight matrix such that \(q=(\varvec{\Psi } B)^{T}\) [75].
The evolution of the original nonlinear system using the estimated Koopman operator is described by replacing expressions (4) into (2). Control inputs can be readily incorporated into the definition of \(\mathbf {\Psi }\) as an augmented state [78].
If the lifting dictionary is chosen as
where \(e_{i}\) is the \(i-th\) unit vector in \(\mathbb {R}^{n_{q}}\), the estimated Koopman operator generated by the previous procedure is same as that obtained by Dynamic Mode Decomposition (DMD) [75]. Theoretically, DMD tries to get a linear approximation of the original system, i.e., \(q_{t+1} = Kq_{t}\). The estimate operator K is selected as the best-fit solution for all available data. Similarly, the DMD-based method can be extended for inputs [79].
Koopman Generator
To better understand the beauty of the theory, we will give a short introduction to its associated infinitesimal generator — the Koopman generator, which is more close to the idea when the Koopman operator was first proposed in fluid dynamics theory [59].
Consider the system defined in (1), if the initial condition is defined as \(q_{0}\), the solution to the ordinary differential equation at time t can be denoted as \(\phi ^{t}(q_{0})\). It is also referred to as the flow map of the system. Define the Koopman semigroup of operators \(\{\mathcal {K}^{t}\}\) as \((\mathcal {K}^{t}g)(q) = g(\phi ^{t}(q))\), the infinitesimal generator \(\mathcal {L} \in \mathcal {F}\) of the semigroup is given by
it can be lifted to an infinite-dimensional function space \(\mathcal {F}\), which is thus also the space of observables.
The Koopman generator can be obtained by the reformulated EDMD — gEDMD [80]. Similarly, a dictionary of lifting functions is defined as \(\varvec{\Psi }(q)\) while we define additionally according to (5) that:
Collecting the matrices of \(\varvec{\Psi }(q)\) and its derivatives \(\dot{\varvec{\Psi }}(q)\) of all the measurements, the generator is estimated by solving a similar least-square problem as what we do when calculating the Koopman operator.
Comparison of the Koopman operator and its generator: The data-driven extraction approach of the Koopman operator (EDMD) is originally proposed and propagated for the discrete-time system. It can be extended to the continuous-time operator via \(\mathcal {K}_{c} = \log (\mathcal {K})/\Delta t\), where \(\Delta t\) is the sampling time of the measurements. On the other hand, the Koopman generator is analyzed in a continuous manner. The benefit of using it is that the Koopman generator might be sparse even when the operator is not. However, the data-driven approximation of the Koopman generator requires analytical precomputation of the partial derivatives, which might introduce more prediction errors. The trade-off needs to be considered when selecting between the two versions of the Koopman theory.
Model Identification with Koopman Operator
Soft robots are composed of compliant materials, instead of rigid links and joints. The compliance provides soft robots flexibility, softness as well as safety when working in close contact with environments and humans. But these properties also make it hard to obtain model representations for analysis and control. Approaches to obtain models of robots can be separated into two categories: physics-based methods (i.e., derived from first principles) and data-driven methods. The model construction from physics-based approaches can be complicated for soft robots given their infinite degrees of freedom and nonlinear behaviors. One way to solve the problem is to embed the Koopman operator theory into model extraction. A primary benefit of the Koopman-based techniques is that a description of an input–output relationship can be obtained from data without explicitly defining a system state. This is especially useful for obtaining reduced-order models of soft robots that have essentially infinite-dimensional kinematics. Various works have been implemented in this area including the modeling and control of soft grippers, soft arms, soft legs, soft swimmers, etc. A detailed description is listed in Table 1. In this section, we emphasize the essential parts that need to be considered for explicit implementation and safety considerations in the practical examples.
Design of Lifting Functions
A critical challenge inherent to all methods employing Koopman operator theory is the choice of a proper set of lifting functions (typically called the dictionary). The lifting functions are crucial because they serve as the basis to construct an infinite-dimensional linear approximation of the original (often nonlinear) system’s state evolution. Poor choice of the lifting functions can significantly impact the estimation of the Koopman operator and hence the accuracy of higher-dimensional linearized dynamics.
Various distinctive approaches have been tested and implemented in different soft robotic systems to identify their dynamics with Koopman-based methods. Existing works regarding the construction of dictionaries fall under the following main directions.
-
1.
Empirical Selection: The most frequently used lifting functions in Koopman-based soft robot modeling applications are the monomials [83, 85, 88, 89, 91] and polynomials [87•]. The maximum degree and dimensions are selected manually based on the properties of the underlying system. Fewer degrees might lead to insufficient and inaccurate estimation while more degrees can cause higher computation complexity and more possibility of overfitting. Thus, the dimension needs to be determined empirically or by comparing multiple candidates [91].
-
2.
Mechanics-inspired Selection: Inspired by various physics-based approaches, it is plausible to consider that soft robot dynamics structure may match an approximate averaged dynamical model of a similar rigid robot. For example, it has been shown possible that a soft swimmer has a similar model to a rigid robotic fish [82•]. Although it is known that the dynamics differ between the soft and the rigid systems, the overall model structure is sufficient enough to design the basis functions used to estimate the observables. However, a similar rigid robot may not always be accessible. Nonetheless, recall that robotic systems have certain characteristic properties, e.g., degrees of freedom, configuration spaces, and workspaces, that can be acquired without knowledge of their exact dynamical models. These properties reveal fundamental information about system states and dynamics and can provide intuition on how to select lifting functions required for Koopman operator approximation. In [90], the authors have shown how fundamental topological spaces and Cartesian products thereof can be mapped to a basis of Hermite polynomials and Kronecker products thereof which serve as the dictionary of lifting functions.
-
3.
Machine Learning Approaches: Another direction is to rely on machine learning methods to derive the dictionary [86] or the eigenfunctions directly [81]. The vector \(\varvec{\Psi }\) in the “Background” section is defined as a neural network, and parameters are tuned with offline training data to achieve high prediction accuracy. While such methods can have a stronger generalization capacity, they require significant tuning (e.g., in the case of neural networks the number of layers, number of units per layer, etc.), and large amounts of training data. The latter might in practice pose a challenge in robotics applications where data are in principle small.
Summary: Multiple algorithms are proposed to find the dictionary of lifting functions. Each of them has its own benefits and disadvantages to be utilized and the selection should be determined based on the system and measurements. If the offline dataset is large as well as diverse enough, in other words, the offline training data cover as various cases as possible, the machine learning-based dictionary could achieve high accuracy with sufficient time. If a similar rigid robot is available or the workspace of the system is known, the Mechanics-inspired approaches should be the best choice. Otherwise, the lifting functions can be designed based on experience or selected from multiple candidate dictionaries.
Robustness Considerations
Deriving guarantees and robustness for methods that rely on extracting dynamics from data are important as the efficiency and quality of measurements will have a significant impact on the performance of the estimated model and hence the controller design.
Different considerations are proposed to emphasize the robustness when utilizing Koopman-based approaches for model extractions. In [86], a deep stochastic Koopman operator is introduced to guarantee the stability of nonlinear stochastic systems. A probabilistic neural network is designed to estimate the distribution of the observables and the distribution is propagated by the Koopman matrices. The parameters of the probabilistic neural network as well as the Koopman operator are optimized during the training process.
Another design [88] to minimize the effect of modeling uncertainties and external disturbance is to include the usage of the Kalman filter. First, an augmented model is derived to include the disturbance model in the ordinary Koopman structure, and then a Kalman filter is adapted to estimate the observables and disturbances simultaneously.
Sparse models can be acquired from data-driven model extraction approaches for soft robots. Sparsity is desirable in terms of space complexity, which can enable the usage of a higher-dimensional dictionary. However, it can lead to an ill-conditioned matrix and even singularities. An ill-conditioned operator is sensitive to every measurement, which can carry a cost in prediction accuracy especially when the measurements are noisy. One way to deal with this problem is to add an optional projection after each approximation step to make sure the models learned are close to the lifted space [83].
There also exist some works to derive guarantees for methods employing the Koopman operator, including investigation of convergence of estimation [77, 92, 93] and global error bounds for the operator [69, 94]. Another direction is investigating the prediction error of, or providing robustness guarantees for, the perturbed systems’ performance when the data used for modeling are noisy [95]. However, such aforementioned investigations remain to be implemented and tested in soft robotic systems.
Controller Design
Soft robots differ from rigid-bodies in several ways that make them uniquely difficult to control. Soft robots exhibit nonlinear characteristics that are negligible in rigid materials, and they span such a wide range of designs which poses great challenges to the generalization ability of the designed controller. These differences render many of the standard approaches used to control rigid-bodied robots insufficient for soft robots.
A system model enables the design of model-based controllers that leverage model predictions to choose suitable control inputs for a given task. As introduced in “ModelIdentification with Koopman Operator” the Koopman operator can obtain either a linear model or a nonlinear model from data, which can be easily embedded into the design of corresponding control structures (Fig. 2). The Koopman operator is naturally formed for unforced systems. To extend it to forced cases for soft robots, the inputs can be either augmented to state and be lifted alongside the state [81, 86, 90, 6•] or be appended but not lifted to ensure that they appear linearly in the resulting model [83,84,85, 88, 89]. In this section, we give an overview of notable options for control-oriented frameworks based on the Koopman operator theory.
MPC
In particular, model-based controllers can anticipate future events, allowing them to optimally choose control inputs over a finite time horizon. A popular model-based control design technique that illustrates the beauty of prediction is model predictive control (MPC), wherein one optimizes the control input over a finite time horizon, applies that input for a single timestep and repeats the optimization process. The key component of, and the main item that affects the performance of, MPC is the “model." The Koopman operator, which takes into account new measurements and/or offline measurements, can serve as the model constraints in the MPC structure formulation.
Incorporating Koopman-based models into MPC design has been first introduced in [92]. The Koopman-based MPC is widely used in soft platforms for either linear MPC [83, 82•, 88, 84] or nonlinear MPC [83, 6•]. In [81], a soft inverted pendulum is controlled to be suspended stably in the inverted position. The Koopman-based MPC is also implemented in the soft continuum robots, the soft gripper to track desired trajectories [86, 84, 85, 88, 6•]. In these cases, the cost functions are always defined to minimize the difference between the predicted states obtained using the Koopman operator and desired trajectories or a target position.
LQR
The linear model learned from data is appropriate to be implemented in optimal control methods like the Linear Quadratic Regulator (LQR) [96]. The LQR algorithm is essentially an automated way of finding an appropriate state-feedback controller, which reduces the amount of work done by the control systems engineer to optimize the controller. In [89], a reduced-order linear model of a helically actuated, inertial soft arm is obtained by the Koopman operator and serves as the model constraints to solve the discrete-time algebraic Riccati equation. The resulting control signal drives the soft arm to achieve two desired states. However, the scenario is limited to offline training and open-loop control where the input sequences are determined in simulation and deployed to the robot. An online-updated design for the soft robot and closed-loop optimal control theory with the Koopman operator remains an open direction.
Summary: The Koopman operator has been used for model-based control of dynamical systems, including feedback stabilization [97], optimal control [71, 98], model predictive control [92, 99] and hierarchical adaptive control [70]. These works illustrate the benefits of model-based control with the Koopman operator theory while, unfortunately, those control algorithms are not fully tested in soft platforms, which indicates directions of future work in this area.
Discussion and Conclusion
The Koopman operator theory has advanced considerably in recent years. In this review, we have explored its usage to represent nonlinear dynamical systems in a linear framework. Several data-driven approaches to estimate the Koopman operator are introduced. We have also summarized the detailed implementation process of the Koopman framework in soft robots and practical considerations. Finally, various control architectures that deploy the soft robotic systems to achieve different control objectives with the Koopman operator theory are illustrated with specific examples.
Despite the incredible promise of the Koopman operator, its application in soft robotic systems is still a very open field under active exploration. As concluded in Table 1, current applications are limited to soft robots with relatively simple structures. Investigations of and implementation on more complicated systems are promising directions to be investigated in the future. The extended platform can include rigid robots with soft parts and even complete elaborate compliant robots. On the other hand, the design of the Koopman-based controllers can be extended to more than MPC and optimal control. Various linear or nonlinear control architectures have the potential to be embedded into the soft robots with the Koopman operator theory.
Along with those more general open questions, there are several problems in terms of detailed implementation in the soft platforms that can be emphasized. First, the compliance of the material makes soft robots usually react slower than the rigid body, which poses a challenge to the time efficiency of the learned model and controller. In other words, if the sampling frequency is too large, it would be hard for the learned model to capture the actual relation between inputs and states as the states will be collected before the effect of inputs reflects in the output states. If the sampling rate is too small, the controller performance will be weakened. A proper and general way to find the optimal sampling rate is required and worth to be investigated. In addition, the accuracy of measurements is significant for all the data-driven approaches. However, the sensors and observers for soft robots are limited. Other than different types of pressure sensors, researchers tend to use motion capture systems or cameras to obtain position (and orientation) information of tips or selected points of the soft robot. But the velocity and/or higher-order derivatives are hard to be obtained accurately and directly from sensors, which currently makes it difficult to achieve aggressive control objectives for soft robots with the data-driven Koopman operator methods.
The applications of the Koopman operator theory in the modeling and control of soft robots are still an open and active research direction. More works and investigations are expected in the future. We hope that this review paper can serve as a stepping stone to inspire more works in the area.
References
Korda M, Mezić I. Linear predictors for nonlinear dynamical systems: Koopman operator meets model predictive control. Automatica. 2018;93:149–60.
Peitz S, Klus S. Koopman operator-based model reduction for switched-system control of pdes. Automatica. 2019;106:184–91.
Mamakoukas G, Abraham I, Murphey TD. Learning data-driven stable koopman operators. 2020. arXiv:2005.04291.
Shi L, Karydis K. Enhancement for robustness of koopman operator-based data-driven mobile robotic systems. In: IEEE international conference on robotics and automation (ICRA). 2021. p. 2503–2510.
Anderson BD, Moore JB. Optimal control: linear quadratic methods. Courier Corporation, 2007.
Huang B, Ma X, Vaidya U. Data-driven nonlinear stabilization using koopman operator. The Koopman Operator in Systems and Control, 2020. p. 313–334.
Abraham I, Murphey TD. Active learning of dynamics for data-driven control using koopman operators. IEEE Trans Robot. 2019;35(5):1071–83.
Arbabi H, Korda M, Mezić I. A data-driven koopman model predictive control framework for nonlinear partial differential equations. In: IEEE conference on decision and control (CDC). 2018. p. 6409–6414.
Papers of particular interest, published recently, have been highlighted as: • Of importance •• Of major importance
Rus D, Tolley MT. Design, fabrication and control of soft robots. Nature. 2015;521(7553):467–75.
Polygerinos P, Lyne S, Wang Z, Nicolini LF, Mosadegh B, Whitesides GM, Walsh CJ. Towards a soft pneumatic glove for hand rehabilitation. In: IEEE/RSJ international conference on intelligent robots and systems (IROS). 2013. p. 1512–1517.
Kokkoni E, Liu Z, Karydis K. Development of a soft robotic wearable device to assist infant reaching. J Eng Sci Med Diagnostics Therapy 2020;3(2).
Mucchiani C, Liu Z, Sahin I, Dube J, Vu L, Kokkoni E, Karydis K. Closed-loop position control of a pediatric soft robotic wearable device for upper extremity assistance. In: IEEE international conference on robot and human interactive communication (RO-MAN). 2022. p. 1514–1519.
Shintake J, Cacucciolo V, Floreano D, Shea H. Soft robotic grippers. Adv Mater. 2018;30(29):1707035.
• Shi L, Mucchiani C, Karydis K. Online modeling and control of soft multi-fingered grippers via koopman operator theory. In: IEEE international conference on automation science and engineering (CASE). 2022. p. 1946–1952. This paper presents the example of utilizing Koopman operator theory to update estimated models of soft multi-fingered robotic grippers in real-time and then embed it into a Model Predictive Control (MPC) structure.
Liu Z, Mucchiani C, Ye K, Karydis K. Safely catching aerial micro-robots in mid-air using an open-source aerial robot with soft gripper. Frontiers in Robotics and AI. vol. 9. 2022.
Shepherd RF, Ilievski F, Choi W, Morin SA, Stokes AA, Mazzeo AD, Chen X, Wang M, Whitesides GM. Multigait soft robot. Proc Nat Acad Sci. 2011;108(51):20,400–20,403.
Lu H, Zhang M, Yang Y, Huang Q, Fukuda T, Wang Z, Shen Y. A bioinspired multilegged soft millirobot that functions in both dry and wet conditions. Nat Comm. 2018;9(1):1–7.
Drotman D, Jadhav S, Sharp D, Chan C, Tolley MT. Electronics-free pneumatic circuits for controlling soft-legged robots. Sci Robot 2021;6(51): eaay2627.
Liu Z, Lu Z, Karydis K. Sorx: A soft pneumatic hexapedal robot to traverse rough, steep, and unstable terrain. In: IEEE international conference on robotics and automation (ICRA). 2020. p. 420–426.
Nguyen PH, Kovač M. Adopting physical artificial intelligence in soft aerial robots. IOP Conference Series: Materials Science and Engineering. 2022;1261(1):012006. IOP Publishing.
Li G, Chen X, Zhou F, Liang Y, Xiao Y, Cao X, Zhang Z, Zhang M, Wu B, Yin S, et al. Self-powered soft robot in the mariana trench. Nature. 2021;591(7848):66–71.
Hughes J, Culha U, Giardina F, Guenther F, Rosendo A, Iida F. Soft manipulators and grippers: a review. Front Robot AI. 2016;3:69.
Jones BA, Walker ID. Kinematics for multisection continuum robots. IEEE Trans Robot. 2006;22(1):43–55.
Webster RJ III, Jones BA. Design and kinematic modeling of constant curvature continuum robots: A review. Int J Robot Res. 2010;29(13):1661–83.
Katzschmann RK, Della Santina C, Toshimitsu Y, Bicchi A, Rus D. Dynamic motion control of multi-segment soft robots using piecewise constant curvature matched with an augmented rigid body model. In: IEEE international conference on soft robotics (RoboSoft). 2019. p. 454–461.
Della Santina C, Katzschmann RK, Bicchi A, Rus D. Model-based dynamic feedback control of a planar soft robot: trajectory tracking and interaction with the environment. The Int J Robot Res. 2020;39(4):490–513.
Trivedi D, Lotfi A, Rahn CD. Geometrically exact models for soft robotic manipulators. IEEE Trans Robot. 2008;24(4):773–80.
Rucker DC, Jones BA, Webster RJ III. A geometrically exact model for externally loaded concentric-tube continuum robots. IEEE Trans Robot. 2010;26(5):769–80.
Giorelli M, Renda F, Calisti M, Arienti A, Ferri G, Laschi C. A two dimensional inverse kinetics model of a cable driven manipulator inspired by the octopus arm. In: IEEE international conference on robotics and automation (ICRA). 2012. p. 3819–3824.
Janabi-Sharifi F, Jalali A, Walker ID. Cosserat rod-based dynamic modeling of tendon-driven continuum robots: A tutorial. IEEE Access. 2021;9:68703–19.
Black CB, Till J, Rucker DC. Parallel continuum robots: Modeling, analysis, and actuation-based force sensing. IEEE Trans Robot. 2017;34(1):29–47.
Renda F, Boyer F, Dias J, Seneviratne L. Discrete cosserat approach for multisection soft manipulator dynamics. IEEE Trans Robot. 2018;34(6):1518–33.
Armanini C, Hussain I, Iqbal MZ, Gan D, Prattichizzo D, Renda F. Discrete cosserat approach for closed-chain soft robots: Application to the fin-ray finger. IEEE Trans Robot. 2021;37(6):2083--98.
Della Santina C, Rus D. Control oriented modeling of soft robots: The polynomial curvature case. IEEE Robot Autom Lett. 2019;5(2):290–8.
Della Santina C. The soft inverted pendulum with affine curvature. In: IEEE conference on decision and control (CDC). 2020. p. 4135–4142.
Roesthuis RJ, Misra S. Steering of multisegment continuum manipulators using rigid-link modeling and fbg-based shape sensing. IEEE Trans Robot. 2016;32(2):372–82.
Nuelle K, Sterneck T, Lilge S, Xiong D, Burgner-Kahrs J, Ortmaier T. Modeling, calibration, and evaluation of a tendon-actuated planar parallel continuum robot. IEEE Robot Autom Lett. 2020;5(4):5811–8.
Duriez C. Control of elastic soft robots based on real-time finite element method. In: IEEE international conference on robotics and automation (ICRA). 2013. p. 3982–3987.
Goury O, Duriez C. Fast, generic, and reliable control and simulation of soft robots using model order reduction. IEEE Trans Robot. 2018;34(6):1565–76.
Katzschmann RK, Thieffry M, Goury O, Kruszewski A, Guerra T-M, Duriez C, Rus D. Dynamically closed-loop controlled soft robotic arm using a reduced order finite element model with state observer. In: IEEE international conference on soft robotics (RoboSoft). 2019. p. 717–724.
Tonkens S, Lorenzetti J, Pavone M. Soft robot optimal control via reduced order finite element models. In: IEEE international conference on robotics and automation (ICRA). 2021. p. 12,010–12,016.
Wang X, Li Y, Kwok K-W. A survey for machine learning-based control of continuum robots. Front Robot AI. 2021. p. 280.
Karydis K, Poulakakis I, Sun J, Tanner HG. Probabilistically valid stochastic extensions of deterministic models for systems with uncertainty. Int J Robot Res. 2015;34(10):1278–95.
Karydis K, Hsieh MA. Uncertainty quantification for small robots using principal orthogonal decomposition. In: International symposium on experimental robotics. Springer. 2017. p. 33–42.
Yip MC, Camarillo DB. Model-less feedback control of continuum manipulators in constrained environments. IEEE Trans Robot. 2014;30(4):880–9.
Yip MC. Model-less hybrid position/force control: a minimalist approach for continuum manipulators in unknown, constrained environments. IEEE Robot Autom Lett. 2016;1(2):844–51.
Li M, Kang R, Branson DT, Dai JS. Model-free control for continuum robots based on an adaptive kalman filter. IEEE/ASME Trans Mechatr. 2017;23(1):286–97.
Shin J, Zhong Y, Smith J, Gu C. Adaptive unscented kalman filter for online soft tissues characterization. J Mech Med Biol. 2017;17(07):1740014.
Loo JY, Tan CP, Nurzaman SG. H-infinity based extended kalman filter for state estimation in highly non-linear soft robotic system. In: IEEE American control conference (ACC). 2019. p. 5154–5160.
Franco E, Garriga-Casanovas A, Tang J, y Baena FR, Astolfi A. Adaptive energy shaping control of a class of nonlinear soft continuum manipulators. IEEE/ASME Trans Mechatr 2021;27(1):280–291.
Giorelli M, Renda F, Ferri G, Laschi C. A feed forward neural network for solving the inverse kinetics of non-constant curvature soft manipulators driven by cables. In:ASME dynamic systems and control conference (DSCC). 2013;56147:V003T38A001.
Giorelli M, Renda F, Calisti M, Arienti A, Ferri G, Laschi C. Neural network and jacobian method for solving the inverse statics of a cable-driven soft arm with nonconstant curvature. IEEE Trans Robot. 2015;31(4):823–34.
Lee KH, Fu DK, Leong MC, Chow M, Fu H-C, Althoefer K, Sze KY, Yeung C-K, Kwok K-W. Nonparametric online learning control for soft continuum robot: An enabling technique for effective endoscopic navigation. Soft Robot. 2017;4(4):324–37.
Ho JD, Lee K-H, Tang WL, Hui K-M, Althoefer K, Lam J, Kwok K-W. Localized online learning-based control of a soft redundant manipulator under variable loading. Adv Robot. 2018;32(21):1168–83.
Fang G, Wang X, Wang K, Lee K-H, Ho JD, Fu H-C, Fu DKC, Kwok K-W. Vision-based online learning kinematic control for soft robots using local gaussian process regression. IEEE Robot Autom Lett. 2019;4(2):1194–201.
Braganza D, Dawson DM, Walker ID, Nath N. A neural network controller for continuum robots. IEEE Rrans Robot. 2007;23(6):1270–7.
Queißer JF, Neumann K, Rolf M, Reinhart RF, Steil JJ. An active compliant control mode for interaction with a pneumatic soft robot. In: IEEE/RSJ international conference on intelligent robots and systems (IROS). 2014. p. 573–579.
Reinhart RF, Steil JJ. Hybrid mechanical and data-driven modeling improves inverse kinematic control of a soft robot. Procedia Technol. 2016;26:12–9.
Tang ZQ, Heung HL, Tong KY, Li Z. A novel iterative learning model predictive control method for soft bending actuators. In: IEEE international conference on robotics and automation (ICRA). 2019. p. 4004–4010.
Polydoros AS, Nalpantidis L. Survey of model-based reinforcement learning: Applications on robotics. J Intell Robot Syst. 2017;86(2):153–73.
Thuruthel TG, Falotico E, Renda F, Laschi C. Model-based reinforcement learning for closed-loop dynamic control of soft robotic manipulators. IEEE Trans Robot. 2018;35(1):124--34.
Wu Q, Gu Y, Li Y, Zhang B, Chepinskiy SA, Wang J, Zhilenkov AA, Krasnov AY, Chernyi S. Position control of cable-driven robotic soft arm based on deep reinforcement learning. Information. 2020;11(6):310.
You X, Zhang Y, Chen X, Liu X, Wang Z, Jiang H, Chen X. Model-free control for soft manipulators based on reinforcement learning. In: IEEE/RSJ international conference on intelligent robots and systems (IROS). 2017. p. 2909–2915.
Satheeshbabu S, Uppalapati NK, Chowdhary G, Krishnan G. Open loop position control of soft continuum arm using deep reinforcement learning. In: IEEE international conference on robotics and automation (ICRA). 2019. p. 5133–5139.
Satheeshbabu S, Uppalapati NK, Fu T, Krishnan G. Continuous control of a soft continuum arm using deep reinforcement learning. In: 3rd IEEE international conference on soft robotics (RoboSoft). 2020, p. 497–503.
Jiang H, Wang Z, Jin Y, Chen X, Li P, Gan Y, Lin S, Chen X. Hierarchical control of soft manipulators towards unstructured interactions. Int J Robot Res. 2021;40(1):411–34.
Koopman BO. Hamiltonian systems and transformation in hilbert space. Proc Natl Acad Sci. 1931;17(5):315.
Mezić I. Spectral properties of dynamical systems, model reduction and decompositions. Nonlinear Dyn. 2005;41:309–325.
Mezić I, Banaszuk A. Comparison of systems with complex behavior. Physica D: Nonlinear Phenomena. 2004;197(1-2):101–133.
Salam T, Li AK, Hsieh MA. Online estimation of the koopman operator using fourier features. 2022. arXiv:2212.01503.
Taylor AT, Berrueta TA, Murphey TD. Active learning in robotics: a review of control principles. Mechatronics. 2021;77:102576.
Brunton SL, Budišić M, Kaiser E, Kutz JN. Modern koopman theory for dynamical systems. SIAM Rev. 2022; 64(2).
Bevanda P, Sosnowski S, Hirche S. Koopman operator dynamical models: learning, analysis and control. Annu Rev Control. 2021;52:197–212.
Otto SE, Rowley CW. Koopman operators for estimation and control of dynamical systems. Annual Review of Control, Robotics, and Autonomous Systems. 2021;4:59–87.
Kaiser E, Kutz JN, Brunton SL. Data-driven approximations of dynamical systems operators for control. The Koopman Operator in Systems and Control: Concepts, Methodologies, and Applications. 2020;197–234.
Brunton S, Kutz J. Machine learning, dynamical systems, and control. Data-driven science and engineering. 2019.
Mamakoukas G, Castano ML, Tan X, Murphey TD. Derivative-based koopman operators for real-time control of robotic systems. IEEE Trans Robot. 2021.
Shi L, Teng H, Kan X, Karydis K. A data-driven hierarchical control structure for systems with uncertainty. In: IEEE conference on control technology and applications (CCTA). 2020. p. 57–63.
Abraham I, De La Torre G, Murphey TD. Model-based control using koopman operators. In: Robotics: science and systems (RSS). 2017.
Broad A, Abraham I, Murphey T, Argall B. Data-driven koopman operators for model-based shared control of human-machine systems. Int J Robot Res. 2020;39(9):1178–95.
Mamakoukas G, Castano M, Tan X, Murphey T. Local koopman operators for data-driven control of robotic systems. In: Robotics: Science and Systems (RSS). 2019.
Mauroy A, Mezić I. Global stability analysis using the eigenfunctions of the koopman operator. IEEE Trans Autom Control. 2016;61(11):3356–69.
Williams MO, Kevrekidis IG, Rowley CW. A data-driven approximation of the koopman operator: Extending dynamic mode decomposition. J Nonlinear Sci. 2015;25(6):1307–46.
Klus S, Schütte C. Towards tensor-based methods for the numerical approximation of the perron-frobenius and koopman operator. Journal of Computational Dynamics. 2016.
Korda M, Mezić I. On convergence of extended dynamic mode decomposition to the koopman operator. J Nonlinear Sci. 2018;28(2):687–710.
Proctor JL, Brunton SL, Kutz JN. Generalizing koopman theory to allow for inputs and control. SIAM J Appl Dyn Syst. 2018;17(1):909–30.
Proctor JL. Dynamic mode decomposition with control. SIAM J Appl Dyn Syst. 2016;15(1):142–61.
Klus S, Nüske F, Peitz S. Niemann J-H, Clementi C, Schütte C. Data-driven approximation of the koopman generator: Model reduction, system identification, and control. Physica D: Nonlinear Phenomena 2020;406:132416.
Komeno N, Michael B, Küchler K, Anarossi E, Matsubara T. Deep koopman with control: Spectral analysis of soft robot dynamics. In: IEEE annual conference of the society of instrument and control engineers (SICE). 2022. p. 333–340.
•• Castaño ML, Hess A, Mamakoukas G, Gao T, Murphey T, Tan X. Control-oriented modeling of soft robotic swimmer with koopman operators. In: IEEE/ASME international conference on advanced intelligent mechatronics (AIM). 2020. p. 1679–1685. This work exploits Koopman operators to obtain a linear representation of the soft swimmer dynamics. Mechanics-based construction and data-based derivatives construction of the lifting functions are investigated and compared.
Bruder D, Fu X, Gillespie RB, Remy CD, Vasudevan R. Data-driven control of soft robots using koopman operator theory. IEEE Trans Robot. 2020;37(3):948–61.
Bruder D, Gillespie B, Remy CD, Vasudevan R. Modeling and control of soft robots using the koopman operator and model predictive control. 2019. arXiv:1902.02827.
Bruder D, Remy CD, Vasudevan R. Nonlinear system identification of soft robot dynamics using koopman operator theory. In: IEEE international conference on robotics and automation (ICRA). 2019. p. 6244–6250.
Han M, Euler-Rolle J, Katzschmann RK. Desko: Stability-assured robust control with a deep stochastic koopman operator. In: International conference on learning representations (ICLR). 2021.
•• Bruder D, Fu X, Gillespie RB, Remy CD, Vasudevan R. Koopman-based control of a soft continuum manipulator under variable loading conditions. IEEE Robot Autom Lett 2021;6(4):6852–6859. This paper utilizes the Koopman operator to identify soft manipulator models under variable loading conditions by incorporating loads into the Koopman operator model as states and estimating their values online in real time.
Chen J, Dang Y, Han J. Offset-free model predictive control of a soft manipulator using the koopman operator. Mechatronics. 2022;86: 102871.
Haggerty DA, Banks MJ, Curtis PC, Mezić I, Hawkes EW. Modeling, reduction, and control of a helically actuated inertial soft robotic arm via the koopman operator. 2020. arXiv:2011.07939.
Shi L, Karydis K. Acd-edmd: Analytical construction for dictionaries of lifting functions in koopman operator-based nonlinear robotic systems. IEEE Robot Autom Lett. 2021;7(2):906–13.
Kamenar E, Ćrnjarić-Žic N, Haggerty D, Zelenika S, Hawkes EW, Mezić I. Prediction of the behavior of a pneumatic soft robot based on koopman operator theory. In: IEEE international convention on information, communication and electronic technology (MIPRO). 2020. p. 1169–1173.
Funding
This work received support of NSF #IIS-1910087, NSF #CMMI-2046270, and NSF #CMMI-2133084. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare no competing interests.
Human and Animal Rights and Informed Consent
This article does not contain any studies with human or animal subjects performed by any of the authors.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Shi, L., Liu, Z. & Karydis, K. Koopman Operators for Modeling and Control of Soft Robotics. Curr Robot Rep 4, 23–31 (2023). https://doi.org/10.1007/s43154-023-00099-8
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s43154-023-00099-8