# Properties of a general quaternion-valued gradient operator and its applications to signal processing

- 234 Downloads
- 5 Citations

## Abstract

The gradients of a quaternion-valued function are often required for quaternionic signal processing algorithms. The HR gradient operator provides a viable framework and has found a number of applications. However, the applications so far have been limited to mainly real-valued quaternion functions and linear quaternionvalued functions. To generalize the operator to nonlinear quaternion functions, we define a restricted version of the HR operator, which comes in two versions, the left and the right ones. We then present a detailed analysis of the properties of the operators, including several different product rules and chain rules. Using the new rules, we derive explicit expressions for the derivatives of a class of regular nonlinear quaternion-valued functions, and prove that the restricted HR gradients are consistent with the gradients in the real domain. As an application, the derivation of the least mean square algorithm and a nonlinear adaptive algorithm is provided. Simulation results based on vector sensor arrays are presented as an example to demonstrate the effectiveness of the quaternion-valued signal model and the derived signal processing algorithm.

## Keywords

Quaternion Gradient operator Signal processing Least mean square (LMS) algorithm Nonlinear adaptive filtering Adaptive beamforming## CLC number

TN911.7 O29## 1 Introduction

Quaternion calculus has been introduced in signal processing with application areas involving three- or four-dimensional signals, such as color image processing (Pei and Cheng, 1999; Sangwine and Ell, 2000; Parfieniuk and Petrovsky, 2010; Ell *et al.*, 2014; Liu *et al.*, 2014), vector-sensor array systems (Le Bihan and Mars, 2004; Miron *et al.*, 2006; Le Bihan *et al.*, 2007; Tao, 2013; Tao and Chang, 2014; Zhang *et al.*, 2014; Hawes and Liu, 2015), three-phase power systems (Talebi and Mandic, 2015), quaternion-valued wireless communications (Liu, 2014), and wind profile prediction (Jiang *et al.*, 2014b). Several quaternion-valued adaptive filtering algorithms have been proposed in Barthelemy *et al.* (2014), Jiang *et al.* (2014c), Talebi *et al.* (2014), Tao and Chang (2014), and Zhang *et al.* (2014). Notwithstanding the advantages of the quaternionic algorithms, extra care has to be taken in their developments, in particular when the derivatives of quaternion-valued functions are involved, due to the fact that quaternion algebra is non-commutative. A so-called HR gradient operator was proposed in Mandic *et al.* (2011) and the interesting formulation appears to provide a general and flexible framework that could potentially have wide applications. However, it has been applied only to real-valued functions and linear quaternion-valued functions. To consider more general quaternion-valued functions, we propose a pair of restricted HR gradient operators, the left and the right restricted HR gradient operators, based on the previous work on the HR gradient operator (Mandic *et al.*, 2011) and our recent work (Jiang *et al.*, 2014b).

To summarize, we make the following main contributions. First, we give a detailed derivation of the relation between the gradients and the increment of a quaternion function, highlighting the difference between the left and the right gradients due to the non-commutativity of quaternion algebra. Second, we document several properties of the operators that have not been reported before, in particular several different versions of product rules and chain rules. Third, we derive a general formula for the restricted HR derivatives of a wide class of regular quaternion-valued nonlinear functions, among which are the exponential, logarithmic, and the hyperbolic tangent functions. Finally, we prove that the restricted HR gradients are consistent with the usual definition for the gradient of a real function of a real variable. Its application to the derivation of a quaternion-valued least mean squares (QLMS) adaptive algorithm and a nonlinear adaptive algorithm based on the hyperbolic tangent function is also briefly discussed. As an example for quaternion-valued signal processing, we consider the reference signal based adaptive beam-forming problem for vector sensor arrays consisting of multiple crossed-dipoles and provide some simulation results.

## 2 Restricted HR gradient operators

### 2.1 Introduction of quaternion

Quaternions are a non-commutative extension of complex numbers. A quaternion *q* is composed of four parts, i.e., \(q = {q_a} + {q_b}{\rm{i}} + {q_c}{\rm{j}} + {q_d}{\rm{k}}\), where *q*_{ a } is the real part, also denoted as R(*q*). The other three terms constitute the imaginary part I(*q*), where i, j, and k are the three imaginary units, satisfying the following rules: \({\rm{ij}} = {\rm{k}},\;\;{\rm{jk}} = {\rm{i}},\;\;{\rm{ki}} = {\rm{j}},\;\;{{\rm{i}}^2} = {{\rm{j}}^2} = {{\rm{k}}^2} = - 1\), and \({\rm{ij}} = - {\rm{ji}},{\rm{ki}} = - {\rm{ik}},{\rm{kj}} = - {\rm{jk}}\). As a result, in general the product of two quaternions *p* and *q* depends on the order, i.e., *qp* ≠ *pq*, and when one of the factors is real, we have *qp* = *pq*.

Let \(v = \vert {\rm{I}}(q)\vert \;{\rm{and}}\;{\bf{\hat v}} = {\rm{I}}(q)/v\). The quaternion *q* can also be written as \(q = {q_a} + v{\bf{\hat v}}\). Here, \({\bf{\hat v}}\) is a pure unit quaternion, which has the convenient property \({{\bf{\hat v}}^2}: = {\bf{\hat v\hat v}} = - 1\). The quaternionic conjugate of *q* is \({q^\ast} = {q_a} - {q_b}{\rm{i}} - {q_c}{\rm{j}} - {q_d}{\rm{k}}\), or \({q^\ast} = {q_a} - v{\bf{\hat v}}\). It is easy to show that \(q{q^\ast} = {q^\ast}q = \vert q{\vert ^2}\), and hence \({q^{ - 1}} = {q^\ast}/|q{\vert ^2}\).

### 2.2 Definition of the restricted HR gradient operators

*f*:

*H*→

*H*be a quaternion-valued function of a quaternion

*q*, where

*H*is the non-commutative algebra of quaternions. We use the notation

*f*(

*q*) =

*f*

_{ a }+

*f*

_{ b }i +

*f*

_{ c }j +

*f*

_{ d }k, where

*f*

_{ a },

*f*

_{ b },

*f*

_{ c },

*f*

_{ d }are the components of

*f*. Here,

*f*can also be viewed as a function of the four components of

*q*, i.e.,

*f*=

*f*(

*q*

_{ a },

*q*

_{ b },

*q*

_{ c },

*q*

_{ d }). In this view

*f*is a quaternion-valued function on ℝ

^{4}:

*f*: ℝ

^{4}→

*H*. To express the four real components of

*q*, it is convenient to use its involutions

*q*

^{ ν }:= −

*νqν*where

*ν*∈ {i, j, k} (Ell and Sangwine, 2007). Explicitly, we have

*f*(

*q*) was introduced in Mandic

*et al.*(2011), which has been applied to real-valued functions and linear quaternion-valued functions. To find the gradients of more general quaternion-valued functions, we follow a similar approach to propose a ‘restricted’ HR gradient operator (some of the derivation was first presented in Jiang

*et al.*(2014b)). To motivate the definitions, we consider the differential d

*f*(

*q*) with respect to differential \({\rm{d}}q: = {\rm{d}}{q_a} + {\rm{d}}{q_b}{\rm{i}} + {\rm{d}}{q_c}{\rm{j}} + {\rm{d}}{q_d}{\rm{k}}\). We observe that \({\rm{d}}f: = {\rm{d}}{f_a} + {\rm{id}}{f_b} + {\rm{jd}}{f_c} + {\rm{kd}}{f_d}\), where

*dq*

_{ b }, d

*q*

_{ c }, and d

*q*

_{ d }, we find an expression for d

*f*

_{ a }in terms of the differentials d

*q*, d

*q*

^{i}, d

*q*

^{j}, and d

*q*

^{k}. Repeating the calculation for id

*f*

_{b}, jd

*f*

_{c}, and kd

*f*

_{d}, we finally arrive at

*f*(

*q*) as follows:

**J**^{H}is the Hermitian transpose of

*(Mandic*

**J***et al.*, 2011). Using

**JJ**^{H}=

**J**^{H}

*= 1/4*

**J***where*

**I***is the identity matrix, we can also write*

**I**We call the gradient operator defined by Eq. (16) the restricted HR gradient operator. The operator is closely related to the HR operator introduced in Mandic *et al.* (2011). However, in the original definition of the HR operator, the Jacobian * J* appears on the left-hand side of ∇

_{ r }

*f*, whereas in our definition it appears on the right (as the Hermitian transpose).

*f*is related to ∇

_{ q }

*f*by

*f*by

*f*(

*q*) =

*q*

_{0}

*q*with

*q*

_{0}∈

*H*a constant, we have

## 3 Properties and rules of the operator

*ν*∈ {i, j, k}. However, to find the derivatives for more complex quaternion functions, it is useful to first establish the rules of the gradient operators. We will see that some of the usual rules do not apply due to the non-commutativity of quaternion products.

- 1.Left-linearity: For arbitrary constant quaternions
*α*and*β*, and functions*f*(*q*) and*g*(*q*), we havefor$${{\partial (\alpha f + \beta g)} \over {\partial {q^\nu}}} = \alpha {{\partial f} \over {\partial {q^\nu}}} + \beta {{\partial g} \over {\partial {q^\nu}}}$$(28)*ν*∈ {1, i, j, k} with*q*^{1}:=*q*. However, linearity does not hold for right multiplications, i.e., in generalThis is because, according to Eq. (11),$${{\partial f\alpha} \over {\partial q}} \neq {{\partial f} \over {\partial q}}\alpha{.}$$(29)where$${{\partial f\alpha} \over {\partial q}} = {1 \over 4}\left( {{{\partial f} \over {\partial {q_a}}}\alpha - {{\partial f} \over {\partial {q_b}}}\alpha {\rm{i}} - {{\partial f} \over {\partial {q_c}}}\alpha {\rm{j}} - {{\partial f} \over {\partial {q_d}}}\alpha {\rm{k}}} \right),$$(30)*α*is an arbitrary constant quaternion. However,*αν*≠*να*in general. Therefore, it is different from (*∂f*/*∂q*)*α*, which is$${1 \over 4}\left( {{{\partial f} \over {\partial {q_a}}} - {{\partial f} \over {\partial {q_b}}}{\rm{i}} - {{\partial f} \over {\partial {q_c}}}{\rm{j}} - {{\partial f} \over {\partial {q_d}}}{\rm{k}}} \right)\alpha{.}$$(31) - 2.The first product rule: The following product rule holds:For example,$${\nabla _q}(fg) = f{\nabla _q}g + [({\nabla _r}f)g]{J^{\rm{H}}}{.}$$(32)Thus, the product rule in general is different from the usual one.$${{\partial fq} \over {\partial q}} = f{{\partial g} \over {\partial q}} + {1 \over 4}\left( {{{\partial f} \over {\partial {q_a}}}g - {{\partial f} \over {\partial {q_b}}}g{\rm{i}} - {{\partial f} \over {\partial {q_c}}}g{\rm{j}} - {{\partial f} \over {\partial {q_d}}}g{\rm{k}}} \right){.}$$(33)
- 3.The second product rule: However, the usual product rule applies to differentiation with respect to real variables, i.e.,for$${{\partial fg} \over {\partial {q_\phi}}} = {{\partial f} \over {\partial {q_\phi}}}g + f{{\partial g} \over {\partial {q_\phi}}}$$(34)
*φ*=*a*,*b*, c, or*d*. - 4.The third product rule: The usual product rule also applies if at least one of the two functions
*f*(*q*) and*g*(*q*) is real-valued, i.e.,$${{\partial fq} \over {\partial q}} = f{{\partial g} \over {\partial q}} + {{\partial f} \over {\partial q}}g{.}$$(35) - 5.The first chain rule: For a composite function \(f(g(q)),\;\;g(q): = {g_a} + {g_b}{\rm{i}} + {g_c}{\rm{j}} + {g_d}{\rm{k}}\) being a quaternion-valued function, we have the following chain rule:where \(\nabla _q^g: = (\partial /\partial g,\;\partial /\partial {g^{\rm{i}}},\;\partial /\partial {g^{\rm{j}}},\;\partial /\partial {g^{\rm{k}}})\) and$${\nabla _q}f = (\nabla _q^gf)M,$$(36)
is a 4 × 4 matrix with element \({M_{\mu \nu}} = \partial {g^\mu}/\partial {q^\nu}\) for**M***¼*,*ν*∈ {1, i, j, k} and \({g^\mu} = - \mu g\mu\) (*g*^{1}is understood the same as*g*). Explicitly, we can writeThe proof is outlined in Appendix C.$${{\partial f} \over {\partial {q^\nu}}} = \sum\limits_\mu {{{\partial f} \over {\partial {g^\mu}}}} {{\partial {g^\mu}} \over {\partial {q^\nu}}}{.}$$(37) - 6.The second chain rule: The above chain rule uses
*g*and its involutions as the intermediate variables. It is sometimes convenient to use the real components of*g*for that purpose instead. In this case, the following chain rule may be used:where$${\nabla _q}f = (\nabla _r^gf)O,$$(38)is a 4 × 4 matrix with entry \({O_{\phi \nu}} = \partial {g_\phi}/\partial {q^\nu}\) with \(\phi \in \{ a,\;b,\;c,\;d\}\) and \(\nu \in \{ 1,{\rm{i}},{\rm{j}},{\rm{k}}\}\), and \(\nabla _r^g: = (\partial /\partial {g_a},\partial /\partial {g_b},\partial /\partial {g_c},\partial /\partial {g_d})\). Explicitly, we have**O**$${{\partial f} \over {\partial {q^\nu}}} = \sum\limits_\phi {{{\partial f} \over {\partial {g_\phi}}}} {{\partial {g_\phi}} \over {\partial {q^\nu}}}{.}$$(39) - 7.The third chain rule: If the intermediate function
*g*(*q*) is real-valued, i.e.,*g*=*g*_{ a }, then from the second chain rule, we obtain$${{\partial f} \over {\partial {q^\nu}}} = {{\partial f} \over {\partial g}}{{\partial g} \over {\partial {q^\nu}}}{.}$$(40) - 8.
*f*(*q*) is not independent of*q*^{i},*q*^{j}, or*q*^{k}in the sense that, in general,This can be illustrated by$${{\partial f(q)} \over {\partial {q^{\rm{i}}}}} \neq 0,\;\;{{\partial f(q)} \over {\partial {q^{\rm{j}}}}} \neq 0,\;\;{{\partial f(q)} \over {\partial {q^{\rm{k}}}}} \neq 0{.}$$(41)*f*(*q*) =*q*^{2}. Using the first product rule (Eq. (32)), we havefor \((\phi ,\nu ) \in \{ (a,1),(b,{\rm{i}}),(c, - {\rm{j}}),(d, - {\rm{k}})\}\). It can then be shown that$${{\partial {q^2}} \over {\partial {q^{\rm{i}}}}} = q{{\partial q} \over {\partial {q^{\rm{i}}}}} + {1 \over 4}\sum\limits_{(\phi ,\nu )} {{{\partial q} \over {\partial {q_\phi}}}q\nu}$$This property demonstrates the intriguing difference between the HR derivative and the usual derivatives, although we can indeed show that$${{\partial {q^2}} \over {\partial {q^{\rm{i}}}}} = {q_b}{\rm{i}},\;{{\partial {q^2}} \over {\partial {q^{\rm{j}}}}} = {q_c}{\rm{j}},\;{{\partial {q^2}} \over {\partial {q^{\rm{k}}}}} = {q_d}{\rm{k}}{.}$$(42)One implication of this observation is that, for a nonlinear algorithm involving simultaneously more than one gradient$${{\partial q} \over {\partial {q^\nu}}} = 0{.}$$(43)*∂f*/*∂qν*, we have to take care to include all the terms.

## 4 Restricted HR derivatives for a class of regular functions

Using the above operation rules, we can find explicit expressions for the derivatives for a whole range of functions. We first introduce the following lemma:

**Lemma 1**The derivative of the power function \(f(q) = {(q - {q_0})^n}\), with integer

*n*and constant quaternion

*q*

_{0}, is

**Remark 1** The division in \(({\tilde q^n} - {\tilde q^{\ast n}})/(\tilde q - {\tilde q^\ast})\) is understood as \(({\tilde q^n} - {\tilde q^{\ast n}}){(\tilde q - {\tilde q^\ast})^{ - 1}}\)or \({(\tilde q - {\tilde q^\ast})^{ - 1}}({\tilde q^n} - {\tilde q^{\ast n}})\) which are the same since the two factors commute. The division operations in what follows are understood in the same way.

**Proof**The lemma is obviously true for

*n*= 0. Letting

*n*≥ 1, we apply the first product rule, and find

*n*< 0, we use the recurrent relation

*n*> 0. More details are given in Appendix B.

**Theorem 1**Assuming

*f*:

*H*→

*H*admits a power series representation \(f(q): = g(\tilde q): = \sum\nolimits_{n = - \infty}^\infty {{a_n}} {\tilde q^n}\), with

*a*

_{ n }being a quaternion constant and \(\tilde q = q - {q_0}\), for \({R_1} \leq \vert \tilde q\vert \leq {R_2}\) with

*R*

_{1},

*R*

_{2}> 0 being some constants, then we have

*f*′(

*q*) is the derivative in the usual sense, i.e.,

**Proof**Using Lemma 1 and the restricted left-linearity of HR gradients, we have

The functions *f*(*q*) form a class of regular functions on *H*. A full discussion of such functions is beyond the scope of this paper. However, we note that a similar class of functions have been discussed in Gentili and Struppa (2007). A parallel development for the former is possible, and will be the topic of a future paper. Meanwhile, we observe that many useful elementary functions satisfy the conditions in Theorem 1. To illustrate the application of the theorem, we list below the derivatives of a number of such functions.

**Example 1**Exponential function

*f*(

*q*) = e

^{ q }has representation

*a*

_{ n }= 1/

*n*! and

*q*

_{0}=0, we have

**Example 2**The logarithmic function

*f*(

*q*) = ln

*q*has representation

*q*

_{0}= 1. Since

*q*

_{0}is a real number, \(g({\tilde q^\ast}) = f({q^\ast})\). Therefore, from Theorem 1 we have

*q*

_{ a }/|

*q*|), the expression can be simplified as

*υ*= |I(

*q*)|.

**Example 3**Hyperbolic tangent function

*f*(

*q*) = tanh

*q*is defined as

*q*:= 1/cosh

*q*is the quaternionic hyperbolic secant function.

**Remark 2** Apparently, the derivatives for these functions can also be found by direct calculations without resorting to Theorem 1.

We now turn to a question of more theoretical interests. Even though it might not be obvious from the definitions, the following theorem shows that the restricted HR derivative is consistent with the derivative in the real domain for a class of functions, including those in the above examples:

**Theorem 2**For the function

*f*(

*q*) in Theorem 1, if

*q*

_{0}is a real number, then

*q*→ R(

*q*), i.e., when

*q*approaches a real number.

**Proof**Using the polar representation, we write \(\tilde q = \vert \tilde q\vert \exp ({\bf{\hat v}}\theta )\), where \(\theta = \arcsin (v/\vert \tilde q\vert )\) is the argument of \(\tilde q\) with \(v = \vert {\rm{I}}(\tilde q)\vert\). Then \({\tilde q^n} = \vert \tilde q{\vert ^n}\exp (n{\bf{\hat v}}\theta )\), and

*q*

_{0}, \(\tilde q \rightarrow {q_a} - {q_0}\) and

*υ*→ 0 when

*q*→ R(

*q*). There are two possibilities. First, if

*q*

_{ a }−

*q*

_{0}≥ 0, then

*θ*→ 0 at the limit. Thus,

*q*

_{ a }−

*q*

_{0}< 0, then

*θ*→

*π*. Thus,

The functions in above three examples all satisfy the conditions in Theorem 2. Hence, we expect Theorem 2 applies. One can easily verify by direct calculations that the theorem indeed holds.

## 5 Right restricted HR gradients

- 1.Right-linearity: For arbitrary quaternion constants
*α*and*β*, and functions*f*(*q*) and*g*(*q*), we haveHowever, linearity does not hold for left multiplications, i.e., in general \({\partial ^{\rm{R}}}\alpha f/\partial q \neq \alpha {\partial ^{\rm{R}}}f/\partial q\).$${{{\partial ^{\rm{R}}}(f\alpha + g\beta )} \over {\partial {q^\nu}}} = {{{\partial ^{\rm{R}}}f} \over {\partial {q^\nu}}}\alpha + {{{\partial ^{\rm{R}}}g} \over {\partial {q^\nu}}}\beta{.}$$(69) - 2.The first product rule: For the right restricted HR operator, the following product rule holds:The second and third product rules are the same as those of the left restricted operator.$${[\nabla _q^{\rm{R}}(fg)]^{\rm{T}}} = {[(\nabla _q^{\rm{R}}f)g]^{\rm{T}}} + {J^\ast}[f{({\nabla _r}g)^{\rm{T}}}]{.}$$(70)
- 3.The first chain rule: For the composite function
*f*(*g*(*q*)), we have$${(\nabla _q^{\rm{R}}f)^{\rm{T}}} = {M^{\rm{T}}}{(\nabla _q^{g{\rm{R}}}f)^{\rm{T}}}{.}$$(71) - 4.
The second chain rule becomes \({(\nabla _q^{\rm{R}}f)^{\rm{T}}} = {O^{\rm{T}}}{(\nabla _r^gf)^{\rm{T}}}\).

- 5.
The third chain rule becomes \({\partial ^{\rm{R}}}f/\partial {q^\nu} = (\partial g/\partial {q^\nu})(\partial f/\partial g)\). Note that \(\partial g/\partial {q^\nu} = {\partial ^{\rm{R}}}g/\partial {q^\nu}\) since

*g*is real-valued. We thus have omitted the superscript ‘R’. Also,*∂f*/*∂g*is a real derivative, so there is no distinction between left and right derivatives.

We can also find the right restricted HR gradients for common quaternion functions. First of all, Lemma 1 is also true for right derivatives.

**Lemma 2**For

*f*(

*q*) = (

*q*−

*q*

_{0})

^{ n }with

*n*an integer and

*q*

_{0}a constant quaternion, we have

**Remark 3**To prove the lemma, we use the following recurrent relations:

**Theorem 3**Assuming

*f*:

*H*→

*H*admits a power series representation \(f(q): = g(\tilde q): = \sum\nolimits_{n = - \infty}^\infty {{{\tilde q}^n}} {a_n}\), with

*a*

_{ n }being a quaternion constant and \(\tilde q = q - {q_0}\), for \({R_1} \leq \vert \tilde q\vert \leq {R_2}\) with

*R*

_{1},

*R*

_{2}> 0 being some constants, then we have

*f*′(

*q*) is the derivative in the usual sense, i.e.,

*f*(

*q*) in Theorem 3 in general form a class of functions different from the one in Theorem 1, because in the series representation

*a*

_{ n }appears on the right-hand side of the powers. However, if

*a*

_{ n }is a real number, then the two classes of functions coincide. Therefore, we have the following result:

**Theorem 4** If *a*_{ n } is real, then the left and right restricted HR gradients of *f*(*q*) coincide.

**Remark 4** As a consequence, we can see immediately that the right derivatives for the exponential, logarithmic, and hyperbolic tangent functions are the same as the left ones.

Apparently, Theorem 2 is also true for the right derivatives. Hence, we have:

**Theorem 5** The right-restricted HR gradient is consistent with the real gradient in the sense of Theorem 2.

## 6 Increment of a quaternion function

*f*(

*q*) is a real-valued quaternion function, both left and right restricted HR gradients are coincident with the HR gradients. Besides, we have

*ν*∈ {1, i, j, k}. Thus, only

*∂f*/

*∂q*is independent. As a consequence (see also Mandic

*et al.*(2011)),

*∂f*/

*∂q*)* gives the steepest descent direction for

*f*, and the increment is determined by

*∂f*/∂

*q*.

*f*is a quaternion-valued function, the increment will depend on all four derivatives. Taking

*f*(

*q*) =

*q*

^{2}as an example, we have (see Eqs. (42) and (44))

*f*(

*q*) appears to be independent of

*q*

^{i},

*q*

^{j}, and

*q*

^{k}. It can be verified that the above expression is the same as the differential form given in terms of d

*q*

_{ a }, d

*q*

_{ b }, d

*q*

_{ c }, and d

*q*

_{ d }. Thus, it is essential to include the contributions from

*∂f*/

*∂q*

^{i}, etc.

We also note that, if the right gradient is used consistently, the same increment would be produced, since the basis of the definitions is the same, namely, the differential form in terms of d*q*_{ a }, d*q*_{ b }, d*q*_{ c }, and d*q*_{ d }.

### 6.1 Quaternion-valued LMS algorithm

As an application, we now apply the quaternion-valued restricted HR gradient operator to develop the QLMS algorithm. Different versions of the QLMS algorithm have been derived in Barthelemy *et al.* (2014), Jiang *et al.* (2014b), and Tao and Chang (2014). However, with the rules we have derived that, some of the calculations can be simplified, as we will show below.

*y*[

*n*] and error

*e*[

*n*] can be expressed as

*[*

**w***n*] is the adaptive weight coefficient vector,

*d*[

*n*] the reference signal, and

*[*

**x***n*] the input sample vector. The conjugate

*e**[

*n*] of the error signal

*e*[

*n*] is

*et al.*(2011), the conjugate gradient (∇

_{ w }

*J*[

*n*])* gives the maximum steepness direction for the optimization surface. Therefore, it is used to update the weight vector. Specifically,

*μ*is the step size. To find ∇

_{ w }

*J*, we use the first product rule:

### 6.2 Quaternion-valued nonlinear adaptive algorithm

Another application is the derivation of quaternion-valued adaptive filtering algorithms. We use the quaternion-valued hyperbolic tangent function as an example (Roberts and Jayabalan, 2015), so that the output *s*[*n*] of the adaptive filter can be given by \(s[n] = \tanh (y[n]) = \tanh ({w^{\rm{T}}}[n]x[n])\). The cost function is given by \(J[n] = e[n]{e^\ast}[n]\), with \(e[n] = d[n] - \tanh ({w^{\rm{T}}}[n]x[n])\).

*u*= |

**I**(

*y*)| and

**û**=

**I**(

*y*)/

*u*. Then the quaternion

*y*=

*y*

_{a}+

**I**(

*y*) can also be written as

*y*=

*y*

_{ a }+

*u*

**û**. Here,

**û**is a pure unit quaternion. Finally, the gradient can be expressed as follows by using Eq. (58):

*q*, we can obtain another form of the gradient function and the corresponding update equation becomes

*a*

_{ m }is the coefficient in the series representation of tanh(

*y*[

*n*]), i.e., \(\tanh (y[n])\quad = \quad \sum\nolimits_{m = 0}^\infty {{a_m}} {(y[n])^m}\). It can be shown that if the items in the gradient part of the above expression are commutative, it will be reduced to the same form as in the real or complex domain.

## 7 Application to adaptive beamforming based on vector sensor arrays

As an example for the application of quaternion-valued signal processing, we here consider the reference signal based adaptive beamforming problem for vector sensor arrays consisting of multiple crossed-dipoles, where the earlier derived QLMS algorithm can be employed for beamforming.

### 7.1 Vector sensor arrays with a quaternion model

*M*crossed-dipole pairs is shown in Fig. 1, where these pairs are located along the

*y*-axis with an adjacent distance

*d*, and at each location the two crossed components are parallel to the

*x*-axis and

*y*-axis, respectively. For a far-field incident signal with a direction of arrival (DOA) defined by the angles

*θ*and

*φ*, its spatial steering vector is given by

*A*is the wavelength of the incident signal. For a crossed-dipole the spatial-polarization coherent vector can be given by Compton (1981), Li and Compton (1991), Zhang

*et al.*(2014), and Hawes and Liu (2015):

*γ*is the auxiliary polarization angle with

*γ*∈ [0,

*π*/2], and

*η*∈ [−

*π*,

*π*] is the polarization phase difference.

*x*-axis and one to the

*y*-axis. The complex-valued steering vector of the

*x*-axis sub-array is given by

*y*-axis it is expressed as

*is the quaternion-valued weight vector.*

**w**### 7.2 Reference signal based adaptive beam-forming

*d*[

*n*] is available, adaptive beamforming can be implemented by the standard adaptive filtering structure (Fig. 2), where \({x_m}[n]\;\;(m = 1,2, \cdots ,M)\) are the received quaternion-valued input signals through the

*M*pairs of crossed dipoles, and \({w_m}[n]\;\;(m = 1,2, \cdots ,M)\) the corresponding quaternion-valued weight coefficients. The beamformer output

*y*[

*n*] and the error signal

*e*[

*n*] are

Simulations are performed based on such an array with 16 crossed dipoles and half-wavelength spacing using the QLMS algorithm in Eq. (84). The stepsize *μ* is set to 2 × 10^{−4}. A desired signal with a 20 dB signal-to-noise ratio (SNR) impinges from the broadside of the array (*θ* = 15°) and two interfering signals with a signal-to-interference ratio (SIR) of −10 dB arrive from the directions (30°, 90°) and (15°, −90°), respectively. All the signals have the same polarisation of (*γ*, *η*) = (30°, 0). The learning

*θ*indicate the value range

*θ*∈ [0°, 90°] for

*φ*= 90°, while negative values of

*θ*∈ [−90°, 0°] indicate an equivalent range of

*θ*∈ [0°, 90°] with

*φ*= − 90°. We can see that the ensemble mean square error has reached almost − 30 dB and two nulls have been formed successfully in the two interference directions, demonstrating the effectiveness of the quaternion-valued signal model and the derived QLMS algorithm.

## 8 Conclusions

We have proposed a restricted HR gradient operator and discussed its properties, in particular, several different versions of product rules and chain rules. Using the rules that we have established, we derived a general formula for the derivative of a large class of nonlinear quaternion-valued functions. The class includes the common elementary functions such as the exponential function and the logarithmic function. We also proved that, for a wide class of functions, the restricted HR gradient becomes the usual derivatives for real functions with respect to real variables, when the independent quaternion variable tends to the real axis, thus showing the consistency of the definition. Both linear and nonlinear adaptive filtering algorithms are derived to show the applications of the operator. An adaptive beamforming example based on vector sensor arrays has also been provided to demonstrate the effectiveness of the quaternion-valued signal model and the derived signal processing algorithm.

## References

- Barthelemy, Q., Larue, A., Mars, J.I., 2014. About QLMS derivations.
*IEEE Signal Process. Lett.*,**21**(2):240–243. http://dx.doi.org/10.1109/LSP.2014.2299066CrossRefGoogle Scholar - Brandwood, D.H., 1983. A complex gradient operator and its application in adaptive array theory.
*IEE Proc. F*,**130**(1):11–16. http://dx.doi.org/10.1049/ip-f-1.1983.0003MathSciNetGoogle Scholar - Compton, R.T., 1981. On the performance of a polarization sensitive adaptive array.
*IEEE Trans. Antenn. Propag.*,**29**(5):718–725. http://dx.doi.org/10.1109/TAP.1981.1142651CrossRefGoogle Scholar - Ell, T.A., Sangwine, S.J., 2007. Quaternion involutions and anti-involutions.
*Comput. Math. Appl.*,**53**(1):137–143. http://dx.doi.org/10.1016/j.camwa.2006.10.029MathSciNetCrossRefGoogle Scholar - Ell, T.A., Le Bihan, N., Sangwine, S.J., 2014. Quaternion Fourier Transforms for Signal and Image Processing. Wiley, UK.CrossRefzbMATHGoogle Scholar
- Gentili, G., Struppa, D.C., 2007. A new theory of regular functions of a quaternionic variable.
*Adv. Math.*,**216**(1):279–301. http://dx.doi.org/10.1016/j.aim.2007.05.010MathSciNetCrossRefGoogle Scholar - Hawes, M., Liu, W., 2015. Design of fixed beamformers based on vector-sensor arrays.
*Int. J. Antenn. Propag.*,**2015**:181937.1–181937.9. http://dx.doi.org/10.1155/2015/181937CrossRefGoogle Scholar - Jiang, M.D., Li, Y., Liu, W., 2014a. Properties and applications of a restricted HR gradient operator. arXiv:1407.5178.Google Scholar
- Jiang, M.D., Liu, W., Li, Y., 2014b. A general quaternionvalued gradient operator and its applications to computational fluid dynamics and adaptive beamforming. Proc. 19th Int. Conf. on Digital Signal Processing, p.821–826. http://dx.doi.org/10.1109/ICDSP.2014.6900781Google Scholar
- Jiang, M.D., Liu, W., Li, Y., 2014c. A zero-attracting quaternion-valued least mean square algorithm for sparse system identification. Proc. 9th Int. Symp. on Communication Systems, Networks and Digital Signal Processing, p.596–599. http://dx.doi.org/10.1109/CSNDSP.2014.6923898Google Scholar
- Le Bihan, N., Mars, J., 2004. Singular value decomposition of quaternion matrices: a new tool for vector-sensor signal processing.
*Signal Process.*,**84**(7):1177–1199. http://dx.doi.org/10.1016/j.sigpro.2004.04.001CrossRefGoogle Scholar - Le Bihan, N., Miron, S., Mars, J.I., 2007. MUSIC algorithm for vector-sensors array using biquaternions.
*IEEE Trans. Signal Process.*,**55**(9):4523–4533. http://dx.doi.org/10.1109/TSP.2007.896067MathSciNetCrossRefGoogle Scholar - Li, J., Compton, R.T., 1991. Angle and polarization estimation using ESPRIT with a polarization sensitive array.
*IEEE Trans. Antenn. Propag.*,**39**:1376–1376. http://dx.doi.org/10.1109/8.99047CrossRefGoogle Scholar - Liu, H., Zhou, Y.L., Gu, Z.P., 2014. Inertial measurement unit-camera calibration based on incomplete inertial sensor information.
*J. Zhejiang Univ.-Sci. C (Comput. & Electron.)*,**15**(11):999–1008. http://dx.doi.org/10.1631/jzus.C1400038CrossRefGoogle Scholar - Liu, W., 2014. Antenna array signal processing for a quaternion-valued wireless communication system. Proc. IEEE Benjamin Franklin Symp. on Microwave and Antenna Sub-systems, arXiv:1504.02921.Google Scholar
- Liu, W., Weiss, S., 2010. Wideband Beamforming: Concepts and Techniques. Wiley, UK.CrossRefGoogle Scholar
- Mandic, D.P., Jahanchahi, C., Took, C.C., 2011. A quaternion gradient operator and its applications.
*IEEE Signal Process. Lett*.,**18**(1):47–50. http://dx.doi.org/10.1109/LSP.2010.2091126CrossRefGoogle Scholar - Miron, S., Le Bihan, N., Mars, J.I., 2006. Quaternion-MUSIC for vector-sensor array processing.
*IEEE Trans. Signal Process.*,**54**(4):1218–1229. http://dx.doi.org/10.1109/TSP.2006.870630CrossRefGoogle Scholar - Parfieniuk, M., Petrovsky, A., 2010. Inherently lossless structures for eight- and six-channel linear-phase paraunitary filter banks based on quaternion multipliers.
*Signal Process.*,**90**(6):1755–1767. http://dx.doi.org/10.1016/j.sigpro.2010.01.008CrossRefGoogle Scholar - Pei, S.C., Cheng, C.M., 1999. Color image processing by using binary quaternion-moment-preserving thresholding technique.
*IEEE Trans. Image Process.*,**8**(5):614–628. http://dx.doi.org/10.1109/83.760310CrossRefGoogle Scholar - Roberts, M.K., Jayabalan, R., 2015. An improved lowcomplexity sum-product decoding algorithm for lowdensity parity-check codes.
*Front. Inform. Technol. Electron. Eng.*,**16**(6):511–518. http://dx.doi.org/10.1631/FITEE.1400269CrossRefGoogle Scholar - Sangwine, S.J., Ell, T.A., 2000. The discrete Fourier transform of a colour image. Proc. Image Processing II: Mathematical Methods, Algorithms and Applications, p.430–441.Google Scholar
- Talebi, S.P., Mandic, D.P., 2015. A quaternion frequency estimator for three-phase power systems. Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing, p.3956–3960. http://dx.doi.org/10.1109/ICASSP.2015.7178713Google Scholar
- Talebi, S.P., Xu, D.P., Kuh, A.,
*et al.*, 2014. A quaternion least mean phase adaptive estimator. Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing, p.6419–6423. http://dx.doi.org/10.1109/ICASSP.2014.6854840Google Scholar - Tao, J.W., 2013. Performance analysis for interference and noise canceller based on hypercomplex and spatiotemporal-polarisation processes.
*IET Radar Sonar Navig.*,**7**(3):277–286. http://dx.doi.org/10.1049/iet-rsn.2012.0151CrossRefGoogle Scholar - Tao, J.W., Chang, W.X., 2014. Adaptive beamforming based on complex quaternion processes.
*Math. Prob. Eng.*,**2014**:291249.1–291249.10. http://dx.doi.org/10.1155/2014/291249Google Scholar - Zhang, X.R., Liu, W., Xu, Y.G.,
*et al.*, 2014. Quaternionvalued robust adaptive beamformer for electromagnetic vector-sensor arrays with worst-case constraint.*Signal Process.*,**104**:274–274. http://dx.doi.org/10.1016/j.sigpro.2014.04.006CrossRefGoogle Scholar