Control sets for bilinear and affine systems

For homogeneous bilinear control systems, the control sets are characterized using a Lie algebra rank condition for the induced systems on projective space. This is based on a classical Diophantine approximation result. For affine control systems, the control sets around the equilibria for constant controls are characterized with particular attention to the question when the control sets are unbounded.


Introduction
We will study controllability properties of affine control systems of the forṁ Controllability properties of bilinear and affine control systems have been intensely studied in the last 50 years. The classical monograph by Mohler [20] contains sufficient conditions for complete controllability and many applications of bilinear control B Fritz Colonius fritz.colonius@math.uni-augsburg.de 1 Institut für Mathematik, Universität Augsburg, Augsburg, Germany 2 Departamento de Matemática, Universidade Estadual de Maringá, Maringá, Brazil systems. The monograph Elliott [13] emphasizes the use of matrix Lie groups and Lie semigroups and contains a wealth of results on the control of bilinear control systems.
Motivated by the Kalman criterion for controllability of linear systems, an early goal was show that controllability of bilinear control systems (without control restrictions) has an algebraic characterization. This hope did not bear out, in spite of many partial results. The present paper is mainly concerned with the analysis of control sets, that is, maximal subsets of complete approximate controllability in R n , cf. Definition 2.1 and Colonius and Kliemann [10] for a general theory.
The main result of Do Rocio et al. [12,Theorem 1.3] concerns a connected semigroup S with nonvoid interior in an affine group G = B V , where V is a finite dimensional vector space and B is a semisimple Lie group that acts transitively on V \ {0}. If the linear action of the canonical projection π(S) on B is transitive on V \ {0}, then the affine action of S on V is transitive. This improves an earlier result in [17]. An application to an affine control system of the forṁ where A, B ∈ sl(2, R) and a, b ∈ R 2 , results in a sufficient controllability criterion in terms of these parameters. Answering a question by Sachkov [22], Do Rocio et al. [11] prove that systems of the form (1.2) with a = b = 0 and unrestricted control may not be completely controllable on R n \ {0} while there is no nontrivial proper closed convex cone in R n which is positively invariant. For the relation to the results in the present paper see Remark 3.17 and also Proposition 5.14.
Our results on control sets will also yield some results on controllability on R n . We do not restrict our attention to the situation where the system semigroup has nonvoid interior in the system group. Correspondingly, our main results are not based on methods for semigroups in Lie groups.
In the first part of this paper we discuss control sets for homogeneous bilinear systems which are a special case of (1.1) with c 1 = · · · = c m = d = 0. It is well known that, for this class of systems, one can separate controllability properties into properties concerning the angular part on the unit sphere S n−1 and the radial part. In particular, by Bacciotti and Vivalda [2, Theorem 1] the induced system on projective space P n−1 is controllable if and only if the induced system on S n−1 is controllable.
Theorem 3.2 shows that every control set S D with nonvoid interior on S n−1 induces a control set D on R n \ {0} given by the cone generated by S D provided that exponential growth and decay can be achieved. Here we use a classical result on Diophantine approximations which allows us to require only the accessibility rank condition on S n−1 in the interior of S D. This result is illustrated by two-dimensional examples. For systems satisfying the accessibility rank condition on projective space, the control sets on the unit sphere and on R n \ {0} are characterized in Theorem 3.12 and Theorem 3.15, respectively. We remark that under the accessibility rank condition in R 2 , a complete description of the control sets and of controllability is given in Ayala et al. [1]. Corollary 3.21 characterizes controllability on R n \ {0} for systems satisfying only the accessibility rank condition on P n−1 using a recent result by Cannarsa and Sigalotti [7,Theorem 1] which shows that here approximate controllability implies controllability.
In the second part we analyze control sets for general affine systems and their relation to equilibria. If the systems linearized about equilibria are controllable, Theorem 5.6 shows that any pathwise connected set of equilibria is contained in a control set. Additional assumptions on spectral properties of the matrices A(u) = A + m i=1 u i B i , u ∈ , allow us to get more detailed information. In particular, if 0 is an eigenvalue of A(u 0 ) for some u 0 ∈ , one finds an unbounded control set, cf. Theorem 5. 13. The main open problem for control sets of affine systems is, if every control set contains an equilibrium.
The contents of this paper are as follows. Section 2 describes basic properties of nonlinear control systems and control sets as well as some notation for bilinear and affine control systems. Section 3 discusses homogeneous bilinear control systems using their projection to the unit sphere. Section 4 briefly describes equilibria of affine systems and Sect. 5 presents results on control sets around such equilibria.

Preliminaries
In this section we introduce some terminology and notations for control-affine systems and discuss special cases of affine control systems.

Control sets
Control-affine systems on a smooth manifold M have the forṁ where f 0 , f 1 , . . . , f m are smooth vector fields on M and the control range ⊂ R m is compact with 0 ∈ int ( ). We assume that for every initial state x ∈ M and every control function u ∈ U there exists a unique solution ϕ(t, x, u), t ∈ R, satisfying ϕ(0, x, u) = x of (2.1) depending continuously on x. The system with u ≡ 0 given byẋ is called the uncontrolled system. It generates a continuous flow ϕ t on M. For the general theory of nonlinear control systems we refer to Sontag [24] and Jurdjevic [18].
The set of points reachable from x ∈ M and controllable to x ∈ M up to time T > 0 are defined by resp. Furthermore, the reachable set (or "positive orbit") from x and the set controllable to x (or "negative orbit" of x) are have nonvoid interior for all T > 0 and the system is called locally accessible if this holds in every point x ∈ M. This is guaranteed by the following accessibility rank condition is the subspace of the tangent space T x M corresponding to the vector fields, evaluated in x, in the Lie algebra generated by f 0 , f 1 , . . . , f m . The trajectories for the convex hull of can be uniformly approximated on bounded intervals by the trajectories for . Furthermore, trajectories for controls in U can be uniformly approximated on bounded intervals by trajectories for piecewise constant controls in U pc .
The following definition introduces subsets of complete approximate controllability which are of primary interest in the present paper. Definition 2.1 A nonvoid set D ⊂ M is called a control set of system (2.1) if it has the following properties: (i) for all x ∈ D there is a control function u ∈ U such that ϕ(t, x, u) ∈ D for all t ≥ 0, (ii) for all x ∈ D one has D ⊂ O + (x), and (iii) D is maximal with these properties, that is, if D ⊃ D satisfies conditions (i) and (ii), then D = D.
A control set D ⊂ M is called an invariant control set if D = O + (x) for all x ∈ D. All other control sets are called variant.
If the intersection of two control sets is nonvoid, the maximality property (ii) implies that they coincide. If the system is locally accessible in all . The control sets with nonvoid interior for piecewise constant controls in U pc coincide with those for controls in U. For these and further properties of control sets, we refer to Colonius and Kliemann [10,Chapters 3 and 4].
The following lemma shows that the controllable set of system (1.1) coincides with the reachable set of the time reversed system. Lemma 2.2 Consider together with system (2.1) the time reversed systeṁ .
The other inclusions follow analogously.

Affine and bilinear control systems
Frequently, we abbreviate hence the columns of C are given by the c i . Then (1.1) can be written aṡ A special case are bilinear control systems obtained for d = 0, i.e.
and homogeneous bilinear systems of the forṁ For fixed control u ∈ U (1.1) is a nonautonomous inhomogeneous linear differential equation. Denote by u (t, s) ∈ R n×n the principal matrix solution, i.e., the solution of The solutions ϕ(t, x 0 , u), t ∈ R, of (1.1) with initial condition ϕ(0, x 0 , u) = x 0 ∈ R n are given by and, in particular, the solutions of (2.7) are This readily implies for α ∈ R

Control sets for homogeneous bilinear systems
We consider homogeneous bilinear control systems of the form (2.7 ) and describe their control sets. Since for fixed control u, the corresponding differential equations are homogeneous, their controllability properties can often be split into controllability properties for the angles and the radii separately; cf., e.g., Colonius and Kliemann [10,Chapter 7]. Denote the projection of R n to the Euclidean unit sphere S n−1 by π and the projection to real projective space P n−1 (obtained by identifying opposite points on the sphere) by P. For a trajectory of (2.7) define The projected trajectories are trajectories of control-affine systems on S n−1 given bẏ The vector fields of the system on S n−1 are obtained by subtracting the radial component. The solutions will be denoted by s(t, s 0 , u), t ∈ R. One also obtains an induced control system on projective space P n−1 with vector fields Ph(u, ·) since h i (s) = −h i (−s) for all i. Since bilinear control systems as well as their projections to S n−1 and P n−1 are analytic, for these systems, local accessibility is equivalent to the corresponding accessibility rank condition (2.3); cf. Sontag [24, Theorem 12 on p. 179].
We note the following simple result showing a first relation between control sets on R n and control sets on S n−1 .

Proposition 3.1
Suppose that D ⊂ R n \ {0} is a control set of system (2.7). Then the projection P(D) to projective space P n−1 is contained in a control set P D for the induced system on P n−1 , and the projection π(D) to the unit sphere S n−1 is contained in a control set S D for the induced system (3.1) on S n−1 . If D has nonvoid interior, then also P D and S D have nonvoid interiors.
Proof The assertions immediately follow from the definitions and the fact that the projections π and P are open.
Next we will analyze when a control set on the unit sphere S n−1 generates a control set on R n . This result is based on a Diophantine approximation result used for Lemma 3.4. Theorem 3.2 Let S D be a control set with nonvoid interior for the system on the unit sphere S n−1 and suppose that Then the cone {αs ∈ R n |α > 0, s ∈ S D } is a control set in R n with nonvoid interior.
Proof First observe that (3.2) implies for the projected system on S n−1 Hence we get periodic solutions in int ( S D) ⊂ S n−1. .
Step 1: Let s 0 ∈ int ( S D). Then for every x 0 ∈ l := {αs 0 ∈ R n |α > 0 } the closure of the reachable set from x 0 contains the half-line l.
For the proof of this claim, consider arbitrary points x 0 = α 0 s 0 , x 1 = α 1 s 0 ∈ l with α 0 , α 1 > 0. The strategy is to steer the system from s 0 to s + , then to go k times through the periodic trajectory for u + , then to steer the system to s − , go times through the periodic trajectory for u − , and finally steer the system back to s 0 . The numbers k, ∈ N will be adjusted such that the corresponding trajectories in R n starting in x 0 approach x 1 . By local accessibility in int ( S D) there are times τ 1 , τ 2 , τ 3 > 0 and controls v 1 One finds for the system in R n numbers β 1 , β 2 , β 3 > 0 with The corresponding trajectory on S n−1 is periodic and satisfies s(τ 1 + iσ + , s 0 , w k, ) = s + for i = 0, 1, . . . , k, s(τ 1 + kσ + + τ 2 + iσ − , s 0 , w k, ) = s − for i = 0, 1, . . . , , and for the corresponding trajectory on R n one finds using (2.8) Recall that our goal is to reach x 1 = α 1 s 0 approximately. We apply Lemma 3.4 with a = α + , b = α − −1 , and c = α 1 (β 3 β 2 β 1 ) −1 , where we choose α + ∈ (α + 0 , α + 0 +δ 0 ) such that log b log a = − log α − log α + is irrational. Thus for every ε > 0 there are k, ∈ N with hence for all ε > 0 there are k, ∈ N with It follows that for some δ ∈ (−ε, ε) one can choose k, such that Since ε > 0 is arbitrary, it follows that x 1 = α 1 s 0 is in the closure of the reachable set of x 0 and hence l is contained the closure of the reachable set from x 0 .
Step 2: Let x 1 , x 2 ∈ {αs ∈ R n |α > 0, s ∈ S D }, hence there are α 1 , α 2 > 0 and s 1 , s 2 ∈ S D with x 1 = α 1 s 1 and x 2 = α 2 s 2 . Then there are a control u 1 and a time t 1 ≥ 0 with s(t 1 , s 1 , u 1 ) = s 0 , hence ϕ(t 1 , x 1 , u 1 ) = γ 1 s 0 ∈ l for some γ 1 > 0. Since s 0 , s 2 ∈ S D one finds, for ε > 0, a control u 2 and a time t 2 ≥ 0 such that, for The trajectory in R n satisfies ϕ(t 2 , s 0 , u 2 ) = γ 2 s 3 for some γ 2 > 0. By (2.8) it follows that Step 1 implies that one finds arbitrarily close to α 2 γ 2 s 0 ∈ l points in the reachable set from γ 1 s 0 , hence in the reachable set from x 1 . By continuous dependence on the initial value, it follows that under the control u 2 points in the reachable set from x 1 are steered into the ε-neighborhood of x 2 . Since ε > 0 is arbitrary, this shows that x 2 is in the closure of the reachable set from x 1 .
Step 3: We have shown that the cone D := {αs ∈ R n |α > 0, s ∈ S D } is a set of complete approximate controllability. It is maximal with this property, since any set of approximate controllability in R n projects to a set of approximate controllability in S n−1 , and S D is a maximal set of approximate controllability. Finally, for every point Hence the cone D is a control set and it has a nonvoid interior.
Step 1 in the proof above is based on the following lemma which uses a Diophantine approximation property.

Lemma 3.4 Let a, b, c be real numbers with a
Proof Since the logarithm is continuously invertible, it suffices to show that for every We use the following Diophantine approximation result which is due to Tchebychef [25, Théorème, p. 679]: For any irrational number α and any β ∈ R the inequality x |y − αx − β| < 2 has an infinite number of solutions in x ∈ N, y ∈ Z. Observe that here also y ∈ N if α > 0, since then sgn(y) = sgn(αx) = sgn(x) = 1. For an application to the problem above, has an infinite number of solutions k, ∈ N. Choosing large enough such that 2 log a < ε and dividing by one gets, as desired,

Remark 3.5
The Diophantine approximation result used above is closely related to a theorem due to Minkowski on inhomogeneous linear Diophantine approximation, cf. Cassels, [8, Theorem I in Chapter III]. Here the existence of integers x, y solving x |y − αx − β| < 1 4 is established, but not the existence of infinitely many pairs x, y with this property, as required for the proof above.
The following two examples illustrate Theorem 3.2. We consider problems in R 2 where the induced system on the unit circle is not locally accessible. First let A be given in Jordan normal form A = λ 1 0 0 λ 2 and let the matrices B 1 and B 2 be diagonal.
The situation is a bit more complicated than in Remark 3.6, since the intersections of the relevant eigenspaces with the unit sphere yield boundary points of the control set S D.
Example 3.7 Consider a system of the form This can be written as In order to verify condition (3.2), assume that there is ( Let τ 1 > 0, and define τ 2 := τ 1 Fix a point s + ∈ S D i . Then it follows that Since τ 1 > 0 is arbitrary, the first equality in (3.2) holds with σ + = τ 2 + τ 1 and Define, with τ 1 > 0 and τ 3 := τ 1 Then it follows that Thus also the second equality in (3.2) holds with σ − = τ 3 +τ 1 and α − = e τ 1 μ 1 (u 2 ,v 2 ) < 1. Now Theorem 3.2 implies that there are four control set in R 2 given by the interiors of the four quadrants.
Observe that conditions (3.4), (3.5), and (3.6) are satisfied in the simple example and one may choose The next example shows that the situation is quite different if A is a two-dimensional Jordan block; in particular, scalar controls suffice to verify assumption (3.2) in Theorem 3.2 for a control set S D = S 1 .

Example 3.8 Consider
with λ ∈ R and u(t) ∈ . The system can be written as For all u ∈ the eigenvalue μ(u) = λ + b 11 u has the eigenspace R × {0}. The intersection of the unit circle with the eigenspace is given by {(1, 0) , (−1, 0) }, which are fixed under any control for the projected system. Suppose that b 12 = 0 and contains the two points u 1 := 0 and u 2 := −2/b 12 , and write μ 1 = μ(u 1 ) = λ and Thus we consider the two differential equations The solutions of (3.8) are given by It follows that Similarly, we can find conditions for α − < 1: The control sets on the unit sphere do not change if we add a third control value u 3 which will be specified in a moment. Repeating the derivation above, we find with This is equivalent to We conclude that condition and u 3 satisfying (3.9). Then there are two invariant control sets with nonvoid interior in R 2 given by the open upper and lower half-planes. Observe that these conditions hold, e.g., for Next we impose stronger assumptions on the homogeneous bilinear control system (2.7). We require that the control range is a compact and convex neighborhood of the origin and that the accessibility rank condition holds on all of P n−1 , dim LA{Ph(u, ·); u ∈ }( p) = n − 1 for all p ∈ P n−1 . (3.10) Then by Colonius and Kliemann [10, Theorem 7.1.1] there are k 0 control sets with nonvoid interior in P n−1 denoted by P D 1 , . . . , P D k 0 , 1 ≤ k 0 ≤ n. Exactly one of these control sets is an invariant control set.

Remark 3.9
Braga Barros and San Martin [6] use the classification of semisimple Lie groups acting transitively on projective space P n−1 (cf. Boothby and Wilson [5]) to determine the number k 0 ∈ {1, . . . , n} of control sets P D i in projective space (it is either equal to n, n/2, or n/4).
Next we analyze the relations between the control sets for the induced systems on projective space P n−1 and on the unit sphere S n−1 . We will frequently use the following elementary facts that follow from (2.8): Let s 1 , s 2 ∈ S n−1 . If s 2 can be reached from s 1 (for system (3.1)), then −s 2 can be reached from −s 1 . If on P n−1 the point Ps 2 can be reached from Ps 1 , then on S n−1 at least one of the points s 2 or −s 2 can be reached from s 1 .
The proof of the following lemma is modeled after Bacciotti and Vivalda [2, Lemma 3], where controllable systems are analyzed. Lemma 3.10 (i) Let S D be a control set on S n−1 . Then the projection of S D to P n−1 is contained in a control set P D. (ii) Assume that the accessibility rank condition (3.10) on P n−1 holds and consider a control set P D i on P n−1 . Suppose that there is s 0 ∈ S n−1 such that Ps 0 ∈ int ( P D i ) and −s 0 can be reached from s 0 . Then there exists a control set S D on S n−1 containing A := {s ∈ S n−1 |Ps ∈ P D i }.
Proof Assertion (i) is immediate from the definitions. Concerning assertion (ii) it is clear that for all s ∈ A there is a control u such that the trajectory of system (3.1) remains in A for all t ≥ 0. Now let s 1 , s 2 ∈ A. We have to show that s 2 is in the closure of the reachable set O + (s 1 ) for system (3.1). Since Ps 1 , Ps 2 ∈ P D i it follows that s 2 ∈ O + (s 1 ) or −s 2 ∈ O + (s 1 ). In the first case we are done. In the second case it follows that s 2 ∈ O + (−s 1 ), and that, by our assumption, s 0 ∈ O + (−s 0 ). As noted in Sect. 2, P(−s 1 ) = Ps 1 ∈ P D i and Ps 0 ∈ int ( P D i ) imply that Ps 0 can be reached from P(−s 1 ), hence s 0 ∈ O + (−s 1 ) or −s 0 ∈ O + (−s 1 ). We claim that also in the second case one can reach s 0 from −s 1 and in the first case, one has The proof of the next proposition uses arguments from Bacciotti and Vivalda [2, Proposition 2].

Proposition 3.11
If accessibility rank condition (3.10) holds for the induced system on P n−1 , it also holds for the induced system on S n−1 .
Proof Recall that P n−1 = (R n \ {0})/ ∼, where ∼ is the equivalence relation x ∼ y if y = λx with some λ = 0. Furthermore, an atlas of P n−1 is given by n charts (U i , ψ i ), where U i is the set of equivalence classes [x 1 : · · · : x n ] with x i = 0 (the homogeneous coordinates) and ψ i : U i → R n−1 is defined by where the hat means that the i-th entry is missing.
For the sake of simplicity we prove the rank condition for the North Pole of S n−1 given byz 0 = (0, . . . , 0, 1). By assumption, the rank of the Lie algebra of the system on P n−1 is n − 1 on all of P n−1 . Consider the point x 0 = [0 : · · · : 0 : 1] ∈ P n−1 . Thus there exist n − 1 matrices A 1 , . . . , A n−1 in the Lie algebra generated by the system on R n \ {0} such that for the induced vector fields A 1 , . . . , A n−1 in the Lie algebra for the system on P n−1 one obtains that the rank of the family (5)] shows the following formula for the local expression of this family, which has the form A n 1 (z 0 ), . . . , A n n−1 (z 0 ) with z 0 = (0, . . . , 0); let a k 1 (z 0 ), . . . , a k n (z 0 ) denote the n components of A kz0 . Then, for k = 1, . . . , n − 1, So A n k (z 0 ) is the vector whose components are equal to the first n − 1 components of the last column of the matrix A k .
On the other hand, the projections on S n−1 of the linear vector fields for the matrices A 1 , . . . , A n−1 are the vector fields (cf. (3.1)) Thus we get, for k = 1, . . . , n − 1 We get the following result characterizing the relation between the control sets P D 1 , . . . , P D k 0 , 1 ≤ k 0 ≤ n, on projective space and the control sets on the unit sphere.
The set A + is contained in a control set S D and the set A − is contained in a control set It follows that {s ∈ S n−1 |Ps ∈ P D i } ⊂ S D ∪ S D , since P is an open map and P D i ⊂ int ( P D i ). By Lemma 3.10(i) the projections of S D and S D to P n−1 are contained in P D i , hence (3.11) follows. The same arguments with −s 0 instead of s 0 implies that S D = − S D . If S D or S D is an invariant control set, then also P D i is an invariant control set, hence there are at most two invariant control set on S n−1 .
(iii) This is a consequence of assertion (ii).
Recall the following definitions from Colonius and Kliemann [10]. For a solution ϕ(t, x, u), t ≥ 0, of (2.7) the Lyapunov exponent is Observe that the Lyapunov exponents are constant on lines through the origin.

Definition 3.13
For a control set P D in P n−1 the Floquet spectrum is given by Px ∈ int ( P D) and u is piecewise constant τ -periodic for some τ ≥ 0 with Pϕ(τ, x, u) = Px , and for a control set S D in S n−1 the Floquet spectrum is given by x ∈ int ( S D) and u is piecewise constant τ -periodic for some τ ≥ 0 with s(τ, x, u) = x .
Proposition 3.14 If S D is a control set with nonvoid interior on S n−1 that projects to a control set P D in P n−1 , then Proof The inclusion " Fl ( S D) ⊂ Fl ( P D)" is clear. For the converse, consider Px ∈ int ( P D) and a piecewise constant τ -periodic control u with Pϕ(τ, x, u) = Px.
We may suppose that x ∈ S n−1 , hence x ∈ S D or −x ∈ S D. Consider the first case. If Analogously one argues in the case −x ∈ S D.
The following result describes the control sets in R n under the accessibility rank condition on projective space.

Theorem 3.15
Assume that the homogeneous bilinear control system (2.7) satisfies the accessibility rank condition (3.10) on P n−1 . If a control set S D i , i ∈ {1, . . . , k 1 }, on S n−1 satisfies 0 ∈ int ( Fl ( S D i )), then the cone

generated by S D i is a control set with nonvoid interior in R n \ {0}. At most two of the D i are invariant control sets.
Proof By Proposition 3.11, every point in S D i is locally accessible. Hence the first assertion follows from Theorem 3.2, if we can show that assumption (ii) in that theorem holds. The Floquet spectrum over a control set in projective space is a bounded interval, cf. [10, Proposition 6.2.14]. By Proposition 3.14 the same holds true for the Floquet spectrum of Fl ( S D i ). If 0 ∈ int ( Fl ( S D i )), it follows that there are points s + , s − ∈ int ( S D i ), controls u + , u − ∈ U and times σ + , σ − > 0 such that where α + := exp(σ + λ(u + , s + )) ∈ (1, ∞) and α − := exp(σ − λ(u − , s − )) ∈ (0, 1). This verifies assumption (ii) of Theorem 3.2 if we take into account that we may vary σ + and hence α + . Furthermore, every invariant control set D projects to an invariant control set on S n−1 , and here there are at most two invariant control sets.  Not all control sets on the unit sphere generate cones that are control sets in R n \{0} as indicated by the following proposition, Proposition 3.18 Assume that the homogeneous bilinear control system (2.7) satisfies the accessibility rank condition (3.10) on S n−1 and let S D be a control set in S n−1 with nonvoid interior. Then the following assertion holds.
If the supremum of {λ(u, x) |s(t, x, u) ∈ S D for all t ≥ 0 } is less than 0 or the infimum is greater than 0, then the cone is not a control set.
Proof Exact controllability to points in the interior of S D implies that for all x, y ∈ R n \ {0} with x x ∈ S D and y y ∈ int( S D) there are α, T > 0 and u ∈ U with ϕ(T , x, u) = α y. Now consider (x, u) with s(t, x, u) ∈ S D for all t ≥ 0. Then in the first case the trajectory in R n satisfies ϕ(t, x, u → 0 and in the second case it satisfies ϕ(t, x, u → ∞. Hence the assertion follows. Remark 3. 19 We refer to Colonius and Kliemann [10] for a discussion when the supremum and the infimum of {λ(u, x) |s(t, x, u) ∈ S D for all t ≥ 0 } coincide with the supremum and the infimum of Fl ( S D), respectively. For dimension n = 2, [10, Theorem 10.1.1] shows that these equalities hold if the accessibility rank condition holds in P 1 . For general n ∈ N suppose that the control range is given by ρ · , ρ ≥ 0, and the following "ρ-inner-pair condition" for the system on S n−1 holds: Then [10,Theorem 7.3.26] implies that for all ρ ∈ (0, ∞) except for at most n − 1 ρ-values the systems with control range ρ · have the property that the equalities for the suprema and the infima hold for all control sets.

Example 3.20 Consider the damped linear oscillator
where ρ ∈ 1, 5 4 . Hence the system equation is given by The eigenvalues of A(u) satisfy det(λI − A(u)) = det λ −1 1 + u λ + 3 = λ 2 + 3λ + 1 + u = 0, and one obtains two real eigenvalues with corresponding eigenvectors (x, λ 1 (u)x) and (x, λ 2 (u)x) , x = 0. Note that λ 2 (u) > 0 if and only if u ∈ [−ρ, −1). Since for all u ∈ [−ρ, ρ] one has λ 1 (u) < λ 2 (u) the projected trajectories in P 1 go from the eigenspace for λ 1 (u) to the eigenspace for λ 2 (u). A short computation shows that there is an open control set P D 1 and a closed invariant control set P D 2 in projective space P 1 given by the projections of resp., where by [10, Theorem 10.1.1] the Floquet spectra are The control sets in P 1 induce four control sets on the unit circle S 1 . For P D 2 one obtains the two control sets S D 2 = − S D 2 . Since u = −1 ∈ (−ρ, ρ) and 0 = λ 2 (−1) ∈ int ( Fl ( P D 2 )), Theorem 3.15 implies that there are two invariant control sets in R 2 \ {0}, they are the cones Next we present a necessary and sufficient condition for controllability on R n \ {0}. The infimal and supremal Lyapunov exponents, cf. (3.12), are resp. The following result improves Colonius and Kliemann [10, Corollary 12.2.6(iii)], where the accessibility rank condition is assumed in R n \ {0}.

Corollary 3.21
Assume that the homogeneous bilinear control system (2.7) satisfies the accessibility rank condition (3.10) on P n−1 . Then it is controllable in R n \ {0} if and only if the induced system on P n−1 is controllable and κ * < 0 < κ.
Conversely, controllability on P n−1 implies by Bacciotti and Vivalda [2, Theorem 1] that S D = S n−1 is a control set. By Theorem 3.15, it follows that R n \{0} is a control set. This implies that for every initial point x = 0 the reachable set O + (x) is dense in R n \ {0}, i.e., approximate controllability holds. For homogeneous bilinear control systems, Cannarsa and Sigalotti [7,Theorem 1] shows that approximate controllability implies controllability in R n \ {0}. This completes the proof.

Remark 3.23
For control systems on semisimple Lie groups, San Martin [23, Proposition 5.6] shows the following result. Let G ⊂ Sl(n, R) be a semisimple, connected, and noncompact group acting transitively on R n \ {0} and let S be a semigroup with nonvoid interior in G. Then S is controllable on R n \ {0} if and only if S is controllable in P n−1 . In this case 0 ∈ (κ * , κ) = int Fl (P n−1 ) .

Equilibria of affine systems
In the rest of this paper we discuss control sets for affine systems of the form (1.1). We begin by analyzing the equilibria.
For each control value u ∈ , an associated equilibrium point of system (1.1) is a state x u that satisfies If for u ∈ there is a solution x u of (4.1) and det A(u) = 0, then every point in the nontrivial affine subspace x u + ker A(u) is an equilibrium. If there is u ∈ with Cu + d = 0, then equation (4.1) always has the solution x u = 0. If det A(u) = 0, then there exists a unique equilibrium of (1.1) given by (4.2) The following simple but useful result shows that for constant control u the phase portrait of the inhomogeneous equation is obtained by shifting the origin to x u .

Proposition 4.1 Consider for constant control u ∈ a solution ϕ(t, x, u), t ≥ 0, of the inhomogeneous equation (1.1) and let x u be an associated equilibrium. Then ϕ(t, x, u)− x u is a solution of the homogeneous equationẋ(t) = A(u)x(t) with initial
The following proposition shows that the affine control system (1.1) is equivalent to an inhomogeneous bilinear system, if there is u 0 ∈ with Cu 0 + d = 0.

Proposition 4.2
Suppose that there is u 0 ∈ with Cu 0 + d = 0 and consideṙ with trajectories denoted by ψ (·, x, v). Then the trajectories ϕ(·, x, u), u ∈ U, of (1.1) Proof One computes for a solution x(t) = ϕ(t, x, u), t ∈ R, of (1.1) We introduce the following notation for the set of equilibria,  Consider a sequence u k → v i for some i. If x u k remains bounded, we may assume that it converges to some y ∈ R n . For k → ∞ we find contradicting the assumption of the theorem. It follows that x u k becomes unbounded for k → ∞.
(ii) If = [u * , u * ], u * < u * , the equilibrium set E = {x u u ∈ \ {v 1 , . . . , v r } } consists of at most n + 1 smooth curves having no finite endpoints, with the possible exception of the equilibria corresponding to the minimum and maximum values of u in , i.e., u = u * , u * . If there is more than one curve constituting E, then the finite end points which are the equilibria x u * and x u * must lie on different curves. Hence the assertion also follows in this case. Similarly, the assertion follows for intervals which are unbounded to one side.
The following example is used in Rink and Mohler [21, Example 2] and Mohler [20, Example 2 on page 32] as an example for a system that is not controllable. It illustrates the result above.

Example 4.4 Consider the control system given by
. With this is the inhomogeneous bilinear control system The eigenvalues of A(u) = A + u B are given by 0 One finds λ 2 (u) > 0 for u > 1 2 and λ 1 (u) < 0 for u < − 1 2 . For u ∈ − 1 2 , 1 2 one gets λ 1 (u) > 0 and λ 2 (u) < 0, hence the matrix A + u B is hyperbolic here.
For every u ∈ R, the eigenspace for λ 1 (u) is Diag 1 := {(z, z) |z ∈ R } and the eigenspace for λ 2 (u) is Diag 2 := {(z, −z) |z ∈ R }. For |u| = 1 2 the equilibria are given by Thus we see that The assumption of Theorem 4.3 is satisfied, since for u = ± 1 2 there is no solution to For the asymptotics of the equilibria, Eq. (4.5) shows that (x u , y u ) approach the line Diag 2 for u → 1 2 and the line Diag 1 for u → − 1 2 . In both cases, the equilibria become unbounded. For u → ±∞, one obtains that the equilibria approach (0, − 1 2 ) .
This discussion shows that the set of equilibria for unbounded control u consists of the following three connected branches The equilibria in B 2 and B 3 both approach (0, − 1 2 ) for |u| → ∞; cf. also Mohler [20, Figure 2.1 on p. 33] or Rink and Mohler [21, Figure 1]. The equilibria in B 2 are stable, those in B 3 are totally unstable, and those in B 1 yield one positive and one negative eigenvalue.

Control sets and equilibria of affine systems
The controllability properties near equilibria will be analyzed assuming that the linearized control systems are controllable. This yields results on the control sets around equilibria.
In order to describe the properties of the system linearized about an equilibrium, we recall the following classical result from Lee and Markus [19, Theorem 1 on p. 366]. We apply this result to affine control systems and obtain that the reachable set and the controllable set for an equilibrium are open, if the linearized system is controllable.

Theorem 5.1 Consider the control process in
Proof First we convince ourselves that Theorem 5.1 can be applied to arbitrary equilibria (x 0 , u 0 ) with u 0 ∈ int ( ) instead of (0, 0). In fact, definef (x, u) Then (0, 0) is an equilibrium oḟ 5) and the control value u = 0 is in int( − u 0 ). The solutions ψ(t, 0, u), t ≥ 0, of (5.5) are given by ϕ(t, Hence O − (x 0 ) coincides with the controllable setÕ − (0) of (5.5). The rank condition (5.2) for (5.5) involves For system (1.1) f (x, u) = A(u)x + Cu + d and for an equilibrium x u we find By ( The following proposition shows that the controllability rank condition (5.3) holds generically for controls u ∈ R m if it holds in some u 0 .

Proposition 5.3 Assume that A(u) is invertible for all u ∈ R
, and hence continuous dependence on the initial value shows that ϕ(t, Proof By Proposition 5.5 every equilibrium x u ∈ C is contained in the interior of a control set. Consider two points x u and x v in C. Then x v ∈ O + (x u ). In fact, consider a continuous path from Observe that τ > 0, since by Proposition 5.2, the reachable set On the other hand, y is an equilibrium corresponding to a control in the interior of . Again Proposition 5.2 implies that O − (y) is a neighborhood of y, and hence This contradiction shows that τ = 1 and y = x v . Thus one can steer the system from any point x u ∈ C to any other point x v ∈ C. It follows that C is contained in a single control set D. The same arguments show that, in fact, C is contained in the interior of D.

Remark 5.7
For scalar control, Theorem 4.3 shows that there are at most n + 1 connected components of the set E of equilibria, which consists of at most n + 1 smooth curves. Thus also E 0 consists of at most n + 1 smooth curves which, naturally, are pathwise connected. Hence, under the assumptions of Theorem 5.6, there are at most n + 1 control sets containing an equilibrium in the interior.
In the rest of this section, we relate the controllability properties of system (1.1) to spectral properties of the matrices A(u), u ∈ . Lemma 5.8 Consider the affine system (1.1) and suppose that x u is an equilibrium for a control value u ∈ int( ) satisfying the rank condition (5.3). The variation-of-constants formula applied for x ∈ R n and x u shows that Thus (5.7) implies has negative real part. By (i) and time reversal, Lemma 2.2, the assertion follows.

Remark 5.9
An easy consequence of this lemma is that the system is controllable if there are u, v ∈ with equilibria x u , x v in the same pathwise connected subset of E 0 such that every eigenvalue of A(u) has negative real part and every eigenvalue of A(v) has positive real part; cf. Mohler [20,Main Result,p. 28] for the special case of inhomogeneous bilinear systems of the form (2.6).
The following corollary to Theorem 5.6 shows that there is a control set around the set of equilibria for uniformly hyperbolic matrices A(u), u ∈ . Then the set E = E 0 of equilibria is compact and connected, the set E 0 is pathwise connected, and there exists a control set D with E 0 ⊂ int(D).
Proof First observe that all matrices A(u), u ∈ , are invertible, since 0 is not an eigenvalue. Thus the set E = {x u |u ∈ } of equilibria is compact and E 0 is pathwise connected, since x u depends continuously on u. By Theorem 5.6 there exists a control set containing E 0 in the interior. Since pathwise connected sets are connected the set int ( ) is connected, which implies that also = int( ) is connected, cf. Engelking [14, Corollary 6.1.11]. It also follows that the set E = E 0 is connected.
If condition (ii) of Corollary 5.10 holds with k = 0 or k = n, i.e., if all matrices A(u) are stable or all are totally unstable, the rank condition (iii) for the linearized systems can be weakened.

Corollary 5.11
Let assumption (i) of Corollary 5.10 be satisfied and assume that there are at most finitely many points in int ( ) such that the rank condition (5.3) is violated. Proof As in Corollary 5.10(i) it follows that the set E 0 of equilibria is pathwise connected. Consider equilibria x u , x v ∈ E 0 with u, v ∈ int ( ) and suppose that x u satisfies condition (5.3). Hence there is a control set D u containing x u in the interior. We use a construction similar to the one in the proof of Theorem 5.6: There is a continuous map h : Observe that τ > 0, since x u ∈ int (D u ). If τ < 1, then y := h(τ ) ∈ ∂ D u and y = x w is an equilibrium for some w ∈ int ( ). If w satisfies (5.3), then by Proposition 5.5 x w is in the interior of a control set contradicting the choice of τ . It remains to discuss the case where w violates (5.3).
(i) Since all eigenvalues of A(u) have negative real parts, Lemma 5.8(i) implies that x w ∈ O − (x u ) = R n . Hence one can steer x w (in finite time) into the interior of D u , and by continuous dependence on the initial value, this holds for all x in a neighborhood N (x w ). Note that x w ∈ D u ∩ ∂ D u . Since there are only finitely many points violating (5.3), all points h(s ) with s ∈ (τ, τ + ε) for some ε > 0 satisfy (5.3) and hence they are in a single control set D and hence x w ∈ D . Then all points in the nonvoid intersection N (x w ) ∩ D can be steered into D u . The same arguments show that one can steer points in D u into D , hence D = D u . This contradicts the choice of τ . It follows that τ = 1 and x v ∈ D u . Using We conclude that all equilibria in E 0 are contained in the interior of a single closed control set.
(ii) Since all eigenvalues of A(u) have positive real parts, Lemma 5.8(ii) implies that x w ∈ O + (x u ) = R n . This shows that x w can be reached from x u ∈ int (D u ). Continuous dependence on the initial value shows that all points in a neighborhood N (x w ) of x w can be reached from the interior of D u . Since there are only finitely many points violating (5.3), all points h(s ) with s ∈ (τ, τ + ε) for some ε > 0 are in a single control set D and x w ∈ D . Then all points in the nonvoid intersection N (x w ) ∩ D can be reached from the interior of D u . The same arguments show that some point in int (D u ) can be reached from D , hence D = D u . This contradicts the choice of τ . It follows that τ = 1 and We conclude that all equilibria in E 0 are contained in the interior of a single control set. Remark 5.4 shows for an affine system of the form (1.1) with scalar control satisfying the assumptions of Proposition 5.3 that there are at most finitely many points u where the rank condition (5.3) is violated.

Remark 5.12
Next we provide a sufficient condition for the existence of unbounded control sets.

Theorem 5.13
Consider an affine control system of the form (1.1), let C be a pathwise connected subset of the set E 0 of equilibria of system (1.1) and define (C) = {u ∈ int( ) |x u ∈ C }. Assume that (i) there is u 0 ∈ (C) such that A(u 0 ) has the eigenvalue λ 0 = 0 and Cu 0 + d is not in the range of A(u 0 ); (ii) every u ∈ (C), u = u 0 , satisfies rank A(u) = n and the rank condition (5.3).
Then, there is an unbounded control set D ⊂ R n containing C in the interior. More precisely, for u k ∈ (C) with u k → u 0 for k → ∞, the equilibria x u k ∈ C ⊂ int(D) satisfy for k → ∞ Proof By Theorem 5.6 there is a control set D containing C in the interior. In order to show that D is unbounded, we argue similarly as in the scalar situation in Theorem 4.3. Let u k ∈ (C) converge to u 0 and assume, by way of contradiction, that x u k remains bounded, hence we may suppose that there is x 0 ∈ R n with x u k → x 0 . Then the equalities A(u k )x u k = − Cu k + d lead for k → ∞ to A(u 0 )x u 0 = − Cu 0 + d contradicting assumption (i). We have shown that x u k becomes unbounded for k → ∞. Since Cu k + d → Cu 0 + d, we get On the other hand, every cluster point y ∈ R n of the bounded sequence Theorem 5.13 sheds some light on the relation between controllability properties of affine systems and their homogeneous bilinear parts: By Theorem 3.15 assumption (i) is related to the existence of a control set of the latter system in R n .
We state the following result concerning closed invariant cones (cf. Remark 3.17). This is formulated in the context of semigroup actions. Denote by S aff and S hom the system semigroups of the affine and the homogeneous bilinear control systems given by (1.1) and (2.7), respectively. They correspond to piecewise constant controls (see Appendix A of [10]). The system group of the affine control system is given by the semidirect product G = H R n , where H is the system group of the homogenous bilinear system. The affine group operation is defined by (g, v)·(h, w) = (gh, v+gw) for all (g, v), (h, w) ∈ G, and the affine action of G on R n is given by (g, v) · w = gw + v with (g, v) ∈ G and w ∈ R n using the linear action of H on R n . A set Q ⊂ R n is invariant under S aff and S hom if and only if it is invariant for the affine control system and the homogeneous bilinear control systems, respectively. We get the following relations between invariance of a closed cone for S aff and S hom . Proposition 5.14 Consider an affine control system of the form (1.1) and its homogeneous bilinear part (2.7), and let K be a closed cone in R n .
(i) Suppose that K is invariant for the homogeneous bilinear part and Cu + d ∈ K for all u ∈ . Then K is invariant for the affine control system. (ii) If K is invariant for the affine control system, then it is invariant for the homogeneous bilinear part.
Hence for every v ∈ R n there is λ > 0 such that inf{ g(λw) + v − w w ∈ K } > 0 implying g(λw) + v / ∈ K . This means for the action of S aff that (g, v) · (λw) = g(λw) + v / ∈ K contradicting the invariance of K for S aff .
Remark 5. 15 Jurdjevic and Sallet [17,Theorem 2] shows that controllability of an affine control system without fixed points can be guaranteed if its homogeneous bilinear part is controllable. Furthermore, for Q ⊂ R n let A(Q) be its affine hull. Suppose that Q is invariant for the affine control system. Then [17,Lemma 3] implies that A(Q) is invariant for the affine control system and the set { p i=1 λ i q i | q i ∈ Q, λ i ∈ R with p i=1 λ i = 0, p ∈ N} is invariant for its homogeneous bilinear part.
Finally, we illustrate Theorem 5.6 and Theorem 5.13 by discussing the control sets for two affine systems. Recall that by Theorem 3.15, the existence of a control u 0 ∈ int( ) such that 0 is an eigenvalue of A(u 0 ) is connected with the existence of an unbounded control set of the bilinear systemẋ = A(u)x. Thus the rank condition (5.3) holds in every equilibrium (x u , y u ) with |u| = 1 2 . Next we discuss the control sets for several control ranges given by a compact interval.
-Let = [−1, 1]. Then the connected components of the set E 0 of equilibria are and there are control sets D i with C i ⊂ int (D i ) for i = 1, 2, 3. Since these sets of equilibria are unbounded also the control sets are unbounded. Based on Proposition 4.1, a lengthy argument involving the phase portraits for constant controls shows that one cannot steer the system from D 2 to D 3 or D 1 and from D 1 to D 3 , hence these control sets are pairwise different.
Next we take up the linear oscillator from Example 3.20 and consider an associated affine control system. We will show that there are two unbounded control sets.

Example 5.17
Consider the affine control system given bÿ where ρ ∈ 1, 5 4 and d ∈ R. Hence the system equation has the form For the equilibria with u = −1 we find