1 Introduction

Space-time adaptive processing (STAP), a two-dimensional space-time adaptive filtering operation, is an effective and important technique which is widely used in airborne or spaceborne radar for detecting moving target in strong clutter background [1,2,3,4]. And in most STAP applications, the training data in the neighborhood of the range cell of interest are employed to estimate the clutter covariance matrix (CCM) which is used to compute the filter’s weights adaptively [5, 6]. Thus, to guarantee the accuracy of the estimation of CCM, two major conditions should be satisfied. One is the training data from adjacent range cells should be target-free and contain clutters with the same statistic characteristics as the cell under test (CUT), which is referred to as independent and identically distributed (i.i.d) condition [4]. The other, according to RMB rule [4], is the number of training data snapshots should be larger than twice the number of system degrees of freedom (DOFs) to achieve the output signal-to-interference-plus-noise ratio (SINR) loss is < 3 dB. Unfortunately, most of the actual scenarios, which the airborne or spaceborne radar faces onto, are non-stationary and include heterogeneous clutters or a high target density. In this case, so many i.i.d and target-free training samples are difficult to be obtained. Therefore, it results in a false estimation of CCM, which leads to a performance decrease of clutter suppression or even a self-nulling of target signal.

So many reduced-dimension or reduced-rank methods [7,8,9,10] have been proposed to overcome the aforementioned problem. However, the number of necessary training samples mentioned in such approaches may still be large when facing a severe heterogeneous environment. Moreover, several non-homogeneity detection (NHD) algorithms [11,12,13,14,15] have been applied in the heterogeneous environments, such as the power-selected training (PST) algorithm [11] and the generalized inner product (GIP) algorithm [12,13,14,15]. They all seek to select the training sample whose CCM is similar to that of the CUT data. However, the PST algorithm may result in target self-nulling and the GIP algorithm would result in an ineffective estimation of CCM if the CUT data is heterogeneous with most of the initial training samples. On the other hand, since some unqualified training samples should be removed, the GIP algorithm cannot achieve an acceptable performance of clutter suppression when the number of training samples is deficient. A knowledge-aided (KA) STAP method, which introduces the benefits of the digital terrain data into STAP applications, was proposed in [16]. Nevertheless, the reflectivity change with grazing angles and the inaccurate registering of the terrain data would degrade its performance. Additionally, the persymmetric structure of the interference covariance matrix and the symmetric property of power spectral density of the clutter can also be used as priori knowledges to improve the detection performances in training-limited scenarios [17,18,19,20]. And some STAP detection methods, which allow one to identify the degree of accuracy of the prior knowledge and combine the prior information with the secondary data in an appropriate way, were proposed in [21, 22]. To further deal with the training-limited problem, a detection scheme using a linear combination of some available a priori models to model the inverse covariance matrix was reported in [23], a newly proposed detection method using two sets of training data are not limited by the conventional constraint on the cardinality of the classic training dataset [24], and a geometric approach to covariance matrix estimation can also achieve considerable SINR improvement in training-starved regimes [25]. Some other related applications to MIMO radar can be found in [26, 27]. Recently, sparse recovery (SR) technique has also been applied to STAP processing [28,29,30,31,32]. The SR-STAP algorithm can accurately estimate CCM or the subspace of clutter with much fewer training samples than the conventional STAP algorithms. As all of the methods aforementioned above still need training samples or assume the training samples are target-free, they still have some limitations to deal with the serious non-stationary radar scenarios.

We call the STAP algorithm that needs to use training samples to estimate CCM as the two dataset STAP (TDS-STAP) algorithm. Obviously, the clutter suppression performance of TDS-STAP is largely limited by the number and statistic characteristics of the training samples. Furthermore, to lower the limit on the training sample, several single dataset STAP (SDS-STAP) algorithms have been proposed [32,33,34,35,36,37]. They only use CUT data for CCM estimation or clutter suppression. The direct data domain STAP (D3-STAP) [33,34,35] and the maximum likelihood estimation detector (MLED) algorithm [36, 37] are two typical SDS-STAP algorithms, but their benefits are available at the expense of system DOFs loss. Another direct data domain STAP approach using sparse recovery (D3SR-STAP) was proposed in [32]. It can effectively estimate CCM based on the angle-Doppler power spectrum got by sparse recovery technique only with CUT data. Though this method keeps the full system DOFs, the requirement for prior knowledge of the signal of interest (SOI) area limits its effectiveness because the prior knowledge is not easy to be got accurately.

In this paper, we propose a novel deterministic-aided (DA) single dataset (SDS) STAP method based on sparse recovery (SR) technique, which is abbreviated to DA-SDS-SRSTAP, for side-looking airborne or spaceborne radar in heterogeneous clutter environments. This method needs neither any training data nor any prior knowledge of SOI while suffering no loss of DOFs. We exploit the property that the clutter components of side-looking airborne or spaceborne radar are distributed along the clutter ridge to fulfill the estimation of CCM only with CUT data. We first calculate the high-resolution angle-Doppler power spectrum of CUT data using SR technique. Then, a new adaptive deterministic-aided GIP (DA-GIP) algorithm is presented to recognize and select the clutter components automatically in the angle-Doppler power spectrum. Subsequently, the CCM, which is employed to construct the weights of STAP filter, can be estimated by the selected clutter components to fulfill the final STAP filter processing. Simulation results verify the effectiveness of the proposed detection method.

The paper is organized as follows. Section 2 is devoted to the data model of side-looking airborne or spaceborne radar, while the detailed rationale of the new method, including the SR model and the new DA-GIP algorithm, are presented in Section 3. In Section 4, simulations are given to show the effectiveness of the proposed DA-SDS-SRSTAP method. Conclusions are finally presented in Section 5.

2 Data model

Consider a side-looking uniform linear array (ULA) radar platform that consists of N identical antenna elements with an inter-element spacing d = λ/2. It receives M pulses with pulse repetition frequency (PRF) f r in a coherent processing interval (CPI) for each range gate. λ is the radar wavelength. The simplified coordinate for the side-looking ULA radar platform is shown in Fig. 1. Without loss of generality, we neglect the elevation dimension in the coordinate [4]. The velocity of the platform and the azimuth angle are v and θ, respectively. As we only use the primary CUT data, the range gate dimension can be overlooked in the following discussions, and the processing algorithm works independently in each range gate.

Fig. 1
figure 1

Simplified side-looking ULA radar platform geometry

For the side-looking radar, N c clutter patches are assumed to be independent with one another and be of uniform distribution in each iso-range ring. Hence, the clutter data can be modeled as the summation of these N c independent clutter patches with different spatial and Doppler frequencies [4]. Assuming no antenna crabbing, the spatial frequency φc, i and normalized Doppler frequency ψc, i of the ith clutter patch can be, respectively, given by

$$ {\varphi}_{c,i}=d\cos {\theta}_{c,i}/\lambda $$
(1)
$$ {\psi}_{c,i}=2v\cos {\theta}_{c,i}/\left(\lambda {f}_r\right) $$
(2)

where θc, i indicates the angle of the ith clutter patch. The space-time steering vector of the ith clutter patch is given by

$$ {\mathbf{v}}_i=\mathbf{v}\left({\psi}_{c,i},{\varphi}_{c,i}\right)=\mathbf{b}\left({\psi}_{c,i}\right)\otimes \mathbf{a}\left({\varphi}_{c,i}\right) $$
(3)

where v(ψ, φ) = b(ψ) ⊗ a(φ) and ⊗ denote the space-time steering vector and the Kronecker product, respectively. a(φc, i) and b(ψc, i) are the spatial and temporal steering vector of the ith clutter patch, respectively, which are defined by

$$ \mathbf{a}\left({\varphi}_{c,i}\right)={\left[1,\exp \left(j2{\pi \varphi}_{c,i}\right),\cdots, \exp \left(j\left(N-1\right)2{\pi \varphi}_{c,i}\right)\right]}^T $$
(4)
$$ \mathbf{b}\left({\psi}_{c,i}\right)={\left[1,\exp \left(j2{\pi \psi}_{c,i}\right),\cdots, \exp \left(j\left(M-1\right)2{\pi \psi}_{c,i}\right)\right]}^T $$
(5)

where [g]T denotes the transpose operation. Then, ignoring the range ambiguities, the total clutter return from a given iso-range ring can be expressed by [4]

$$ \mathbf{c}=\sum \limits_{i=1}^{N_c}{\sigma}_{c,i}{\mathbf{v}}_i $$
(6)

where σc, i denotes the complex amplitude of the ith clutter patch. Moreover, considering the incoherence between each clutter patch, the clutter covariance matrix can be simplified as [4]

$$ {\mathbf{R}}_c=E\left[{\mathbf{cc}}^H\right]=\sum \limits_{i=1}^{N_c}{\left|{\sigma}_{c,i}\right|}^2{\mathbf{v}}_i{\mathbf{v}}_i^H $$
(7)

whereE[g], [g]H, and ∣ g ∣ denote expectation operation, conjugate transpose, and the modulus of a complex, respectively.

Similarly, the spatial frequency φ t and normalized Doppler frequency ψ t of the hypothetic target can be, respectively, given by

$$ {\varphi}_t=d\cos {\theta}_t/\lambda $$
(8)
$$ {\psi}_t=2\left({v}_t-v\right)\cos {\theta}_t/\left(\lambda {f}_r\right) $$
(9)

where θ t and v t denote the angle and velocity of the target, respectively. The target signal can be expressed by

$$ \mathbf{s}={\sigma}_t\mathbf{v}\left({\psi}_t,{\varphi}_t\right)={\sigma}_t{\mathbf{v}}_t $$
(10)

where v t  = v(ψ t , φ t ) = b(ψ t ) ⊗ a(φ t ) and σ t denote the space-time steering vector and the complex amplitude of the target, respectively.

As is well known, the optimal filter weights of STAP can be given by

$$ {\mathbf{w}}_{\mathrm{opt}}=\kappa {\mathbf{R}}_c^{-1}{\mathbf{v}}_t $$
(11)

where κ is an arbitrary scalar which does not alter the output SINR and \( {\mathbf{R}}_c^{-1} \)denotes the inverse matrix of R c . In order to satisfy the constant false alarm rate (CFAR) property, we usually set \( \kappa ={\left({\mathbf{v}}_t^H{\mathbf{R}}_c^{-1}{\mathbf{v}}_t\right)}^{-1/2} \) [4]. The filter output power is then compared to a threshold according to the matched filter (MF) test [2, 6]

$$ y={\left|{\mathbf{w}}_{opt}^H\mathbf{x}\right|}^2=\frac{{\left|{\mathbf{v}}_t^H{\mathbf{R}}_c^{-1}\mathbf{x}\right|}^2}{{\mathbf{v}}_t^H{\mathbf{R}}_c^{-1}{\mathbf{v}}_t}\underset{H_1}{\overset{H_0}{\lessgtr }}\eta $$
(12)

where η is the threshold, H0 and H1 mean no target and a target is present, respectively, and x is the test data snapshot.

Since R c is unknown in actual scenarios, the conventional STAP generally employs training samples, which are assumed to be i.i.d and target-free, to estimate CCM. This approach is well known as a TDS-typed algorithm. For instance, using the classical sample matrix inverse (SMI) algorithm [1], CCM can be estimated by

$$ {\widehat{\mathbf{R}}}_{c-\mathrm{SMI}}=\frac{1}{L}\sum \limits_{l=1}^L\mathbf{x}(l)\mathbf{x}{(l)}^H $$
(13)

where x(l) denotes the lth training sample snapshot and L is the number of training samples. Subsequently, R c in (11) and (12) can be replaced by \( {\widehat{\mathbf{R}}}_{c-\mathrm{SMI}} \) to compute wopt and make MF detection test in practice. Note that if the target-like signals appear in the training samples or the clutter characteristics of the training samples are non-homogeneous with those of the CUT data, expression (13) will lead to an inaccurate estimation. This would degrade the STAP performance significantly, especially in the case of fewer training samples. In the next section, a novel deterministic-aided single dataset STAP method based on sparse recovery (DA-SDS-SRSTAP) will be described in detail, which can overcome these problems in some extent to improve the detection performance in the heterogeneous radar scenario.

3 DA-SDS-SRSTAP algorithm

The proposed algorithm is composed of three primary steps. We first calculate the high-resolution angle-Doppler power spectrum using SR technique only with the CUT data. Then, a new adaptive deterministic-aided GIP (DA-GIP) algorithm, based on the property that the clutter components are distributed around the clutter ridge, is proposed to recognize and select the clutter components automatically in the CUT angle-Doppler power spectrum. Subsequently, the CCM, which is employed to form the weights of STAP filter, can be estimated by the selected clutter components to implement the final STAP filter processing. The three steps will be detailedly discussed in the following subsections.

3.1 Getting CUT angle-Doppler power spectrum using SR

The CUT data snapshot, which includes target and clutter components, can be written as

$$ {\mathbf{x}}_0=\mathbf{s}+\mathbf{c}+\mathbf{n} $$
(14)

where n is white additive noise. Note that recently developed SR algorithm, which can work on the single dataset case, provides an effective approach for STAP application without the performance degradation caused by DOFs loss, as is the conventional D3-STAP method. SR algorithm discretizes the whole angle-Doppler plane into N s  × N d bins, whereN s  = ρ s N, N d  = ρ d M (ρ s , ρ d  > 1) are the number of the quantization of spatial and Doppler frequency axis, respectively. Then, we reformulate the target and clutter components in the form of sparse representation and the received CUT data snapshot x0 in (14) can be rewritten as [28]

$$ {\mathbf{x}}_0=\boldsymbol{\Phi} \boldsymbol{\upgamma} +\mathbf{n} $$
(15)

where Φ and γ are MN × N s N d overcomplete space-time steering dictionary and N s N d  × 1 angle-Doppler profile vector, respectively, as given by

$$ \boldsymbol{\Phi} =\left[\mathbf{v}\left({\psi}_1,{\varphi}_1\right),\mathrm{L},\mathbf{v}\left({\psi}_1,{\varphi}_{N_s}\right),\mathrm{L},\mathbf{v}\left({\psi}_{N_d},{\varphi}_{N_s}\right)\right] $$
(16)
$$ \boldsymbol{\upgamma} ={\left[{\gamma}_1,{\gamma}_2,\mathrm{L},{\gamma}_{N_s{N}_d}\right]}^T $$
(17)

where the symbols φ p , (1 ≤ p ≤ N s ) and ψ q , (1 ≤ q ≤ N d ) denote the quantized spatial and Doppler frequencies respectively. As the theory of SR-STAP [28], a nonzero element from any angle-Doppler grid point, corresponding to a nonzero entry in γ, would suggest the presence of a scatter at that particular angle and Doppler frequency. Hence, a high-resolution angle-Doppler power spectrum of the CUT data, which shows the information of clutter and target, can be obtained by

$$ {\mathbf{P}}_{SR}={\left|\boldsymbol{\upgamma} \right|}^2 $$
(18)

Considering the target and clutter are sparsely distributed in the whole angle-Doppler plane [28], finding the solution of γ can be stated as a NP-hard SR problem that represents an interesting signal using the minimum number of vectors from an overcomplete dictionary (set of vectors). Much research effort has been invested in finding some feasible approaches to solve this problem [28,29,30,31,32]. In the following simulations of this work, we just employ, but not limited to, a common SR algorithm named as the focal underdetermined system solver (FOCUSS) algorithm [32] to estimate the CUT angle-Doppler power spectrum. For simplicity, the angle-Doppler power spectrum gained using SR technique is referred to as SR angle-Doppler power spectrum in the followings.

3.2 DA-GIP algorithm for CCM estimation

It is noted that, according to expression (1) and (2), there is a linear relationship between the spatial frequency and normalized Doppler frequency of the clutter, which can be rewritten as

$$ {\psi}_{c,i}={\beta \varphi}_{c,i},\beta =2v/{df}_r. $$
(19)

Theoretically, this deterministic relationship means that all the clutter components for moving radar platform should be distributed along a line that is well known as clutter ridge in the angle-Doppler domain. β denotes the slope of clutter ridge, which can be computed using the prior knowledge of platform velocity, the inter-element spacing value of antenna array, and the PRF. In other words, once these system parameters are fixed, the clutter ridge will be deterministic. Without loss of generality and to avoid Doppler aliasing, β is equivalent to 1 in the following discussions. This deterministic angle-Doppler structure of clutter is illustrated in Fig. 2. It can be observed that the clutter ridge is the diagonal of angle-Doppler plane. Ideally, the nonzero elements located in the clutter ridge can be regarded as clutter components to estimate CCM. However, in practice, because of the impact of inner clutter motion (ICM) or the inaccuracy of prior knowledge, the clutter components will extend to the area adjacent to the ideal clutter ridge, as is shown in the shadow region in Fig. 2. In this case, if we still use the clutter components just located in the ideal clutter ridge to estimate CCM and apply the result for STAP filter, the clutters cannot be suppressed completely and the residual will further deteriorate the STAP performance severely. Even more unfortunately, the extension, which may be variable for different range bins in the heterogeneous radar scenario, is hard to be predicted in the single dataset condition. Consequently, to cope with the uncertain clutter spread only with the CUT data, we propose a novel DA-GIP algorithm, based on the deterministic property that the clutter components are mainly distributed around the clutter ridge, to recognize and select the whole clutter components in the SR angle-Doppler power spectrum for effective CCM estimation.

Fig. 2
figure 2

Angle-Doppler structure of clutter for moving radar platform (β = 1)

The main idea of the DA-GIP algorithm is to find a set of candidate CCM estimation \( \left\{{\widehat{\mathbf{R}}}_{c,k},k=1,2,\mathrm{L}\right\} \) based on the deterministic knowledge of clutter ridge and then determine which one is the best approximation to the real CCM according to the new defined DA-GIP formulation. Recall that the conventional GIP algorithm, which is used for training sample selection, has the following quadratic form [12, 13].

$$ Q(l)=\mathbf{x}{(l)}^H{\mathbf{R}}_c^{-1}\mathbf{x}(l)={\left|{\mathbf{R}}_c^{-1/2}\mathbf{x}(l)\right|}^2 $$
(20)

where x(l) and R c denote the lth training sample snapshot and the true CCM, respectively. Actually, (19) measures the power of training sample whitened by \( {\mathbf{R}}_c^{-1/2} \). Inspired by the original GIP thought, the DA-GIP formulation for the CUT data is defined by

$$ {Q}_0(k)={{\mathbf{x}}_0}^H{\widehat{\mathbf{R}}}_{c,k}^{-1}{\mathbf{x}}_0={\left|{\widehat{\mathbf{R}}}_{c,k}^{-1/2}{\mathbf{x}}_0\right|}^2 $$
(21)

where \( {\widehat{\mathbf{R}}}_{c,k} \) denotes the kth candidate CCM estimation. The value of Q0(k), which is referred to as DA-GIP value, will be used to judge whether its corresponding \( {\widehat{\mathbf{R}}}_{c,k} \) is the closest approximation to the real CCM.

Assuming the number of the quantization of spatial frequency axis equals to that of the Doppler frequency axis, i.e., N s  = N d , the whole procedure can be done as follows.

Step 1: find out some particular nonzero elements of the angle-Doppler profile vector γ, whose corresponding points in the angle-Doppler plane should satisfy the condition that

$$ p=q\pm \left(k-1\right),\left(1\le p\le {N}_s,1\le q\le {N}_d\right) $$
(22)

where p and q denote the indices of the discretized spatial and Doppler frequency axis, respectively, and k is the iterative time that starts from k = 1. Then, the indices of these nonzero elements in γ are recorded as a set Γ k . Note that this step is to seek out those clutter components in the clutter ridge at the first iterative time, which can be interpreted in Fig. 3. Those points at the diagonal of the discretized angle-Doppler plane are considered from the beginning.

Fig. 3
figure 3

Illustration of the strategy for clutter component selection. p = q, p = q ± 1, p = q ± 2

Step 2: form a new set Ω k  = {Γ1, L Γ k }, which is regarded as the kth candidate set of clutter components, and calculate the kth candidate CCM estimation \( {\widehat{\mathbf{R}}}_{c,k} \) using the SR expression given by [31].

$$ {\widehat{\mathbf{R}}}_{c,k}=\sum \limits_{h=1}^{H_k}{\left|\boldsymbol{\upgamma} \left({\Omega}_k(h)\right)\right|}^2\left({\boldsymbol{\Phi} \mathbf{e}}_{\Omega_k(h)}\right){\left({\boldsymbol{\Phi} \mathbf{e}}_{\Omega_k(h)}\right)}^H $$
(23)

where H k is an integer and denotes the number of elements in set Ω k and \( {\mathbf{e}}_{\Omega_k(h)} \) is a column vector of all zeros except for a one in the position of index Ω k (h), which can be expressed as

$$ {\mathbf{e}}_{\Omega_k(h)}={\left[{0}_1,\mathrm{L},{0}_{\Omega_k(h)-1},{1}_{\Omega_k(h)},{0}_{\Omega_k(h)+1},\mathrm{L},{0}_{N_s{N}_d}\right]}^T $$
(24)

Step 3: first calculate the DA-GIP value Q0(k), which is rewritten as

$$ {Q}_0(k)={{\mathbf{x}}_0}^H{\widehat{\mathbf{R}}}_{c,k}^{-1}{\mathbf{x}}_0. $$
(25)

Then, if k = 1, set k = k + 1 and return to step 1; otherwise, continue to step 4.

Step 4: first calculate the error value between Q0(k) and Q0(k − 1), which is given by

$$ {\Delta}_k=10\times \log 10\left(\frac{Q_0\left(k-1\right)}{Q_0(k)}\right),k>1. $$
(26)

If Δ k  > ξ, set k = k + 1 and return to step 1; otherwise, stop the iteration. ξ is a very small positive real number, which is referred to as error threshold. Denoting K as the last iterative time, then the final available CCM estimation \( {\widehat{\mathbf{R}}}_{c-\mathrm{DA}-\mathrm{GIP}} \) can be given by

$$ {\widehat{\mathbf{R}}}_{c-\mathrm{DA}-\mathrm{GIP}}={\widehat{\mathbf{R}}}_{c,K} $$
(27)

The whole procedure can be summarized in Fig. 4. Though the nonzero elements at the clutter ridge can be regarded as valid clutter components with no doubt at the beginning, the set Ω1 may not include all of the clutter components and \( {\widehat{\mathbf{R}}}_{c,1} \) may not be a good estimation of CCM because the clutter components always spread out of the clutter ridge due to the effect of ICM and knowledge error. Consequently, we should extend the searching area to the outside of the clutter ridge gradually, until the clutter components have been completely selected out. Then, one more grid point on both sides of the clutter ridge in the discretized angle-Doppler plane can be added into the searching areas at each new iterative time, which can be interpreted in Fig. 3. Every extended searching process will give an extra set of clutter components and a new CCM estimation, respectively, as is described in step 2. On the other hand, the DA-GIP value Q0(k) in step 3 is used to measure the accuracy of those candidate CCM estimations. According to expression (21), the DA-GIP value is actually the power of the CUT data whitened by \( {{\widehat{\mathbf{R}}}^{-1/2}}_{c,k} \). Remarkably, the CUT data that is whitened with more clutter components should have lower power than that whitened with fewer clutter components. In other words, the DA-GIP value Q0(k) ought to decrease with the increasing of iterative time k, until the Kth iterative time when Ω K contains all of the clutter components distributed around the clutter ridge in the SR angle-Doppler power spectrum. Thus, the corresponding CCM estimation \( {\widehat{\mathbf{R}}}_{c,K} \) can be taken as the closest approximation to the real CCM. Therefore, when the error of the DA-GIP values Δ k between two adjacent iterative times becomes very little, it is reasonable to break the iteration and confirm that the CCM has been correctly estimated with full clutter components in the discretized SR angle-Doppler power spectrum, as is described in the step 4.

Fig. 4
figure 4

Flow chart of the DA-GIP algorithm for CCM estimation

Actually, on the assumption that clutter power is usually much larger than noise power, we can set the error threshold in step 4 depending on noise power. We think that if the whole clutter components have not been included in the data set Ω k and not been completely whitened, there are still some clutter residuals in the DA-GIP value Q0(k). Moreover, Q0(k − 1) should contain more clutter residuals than Q0(k). Therefore, in this case, the error value Δ k between Q0(k) and Q0(k − 1) should also contain the residual clutter components and should be larger than noise power. On the other hand, once all the clutter components have been found out and been completely whitened, the residuals in the DA-GIP value are just noise and target components. After that, considering the target components consisted in the two adjacent DA-GIP values can be mutually canceled out, only the noise component is left in the error value between the two adjacent iterative times. Consequently, it is reasonable to set the error threshold ξ depending on noise power. In practice, it is well known that the noise power can be measured in advance.

Furthermore, the convergence of the comparison in step 4 also depends on the error threshold. According to the analysis above, when the error threshold is equal to or larger than the noise power, the comparison should be convergent. However, if the error threshold is set to be much larger than the noise power, the iteration will stop when the whole clutter components have not been selected out to estimate the CCM, which will result in an inaccurate CCM estimation. Contrarily, when the error threshold is lower than the noise power, the comparison may be not convergent. It is because that although the error value Δ k may be less than the noise power, it may be still larger than the error threshold which is set to be smaller than the noise power. Consequently, we suggest that the error threshold is best to be equivalent to or slightly larger than the noise power.

3.3 STAP filter strategy

Substituting \( {\widehat{\mathbf{R}}}_{c-\mathrm{DA}-\mathrm{GIP}} \) for R c in expression (11) and (12), we can implement the final filter processing. Note that the nonzero elements of the SR angle-Doppler power spectrum indicate the angle-Doppler information of the clutter and target, and the whole clutter components have been marked out by the DA-GIP algorithm. Therefore, we just need to test the other nonzero elements, except for those selected clutter ones, for target detection. We denote the spatial and normalized Doppler frequency pairs of those non-selected nonzero elements as \( \left\{\left({\varphi}_j^{\prime },{\psi}_j^{\prime}\right),j=1,2,\mathrm{L}\right\} \). The filter output corresponding to the jth frequency pair can be given by

$$ {y}_j=\frac{{\left|\mathbf{v}{\left({\varphi}_j^{\prime },{\psi}_j^{\prime}\right)}^H{{\widehat{\mathbf{R}}}^{-1}}_{c- DA- GIP}{\mathbf{x}}_0\right|}^2}{\mathbf{v}{\left({\varphi}_j^{\prime },{\psi}_j^{\prime}\right)}^H{{\widehat{\mathbf{R}}}^{-1}}_{c- DA- GIP}\mathbf{v}\left({\varphi}_j^{\prime },{\psi}_j^{\prime}\right)}. $$
(28)

Then, we can compare y j with the threshold η to perform the final target detection.

4 Simulation results and discussion

In the simulations, the main parameters are as follows: the number of array elements is N = 6, the number of pulses in a CPI is M = 6. The carrier frequency is 10GHz, and the PRF is f r  = 600Hz. There are 180 clutter patches uniformly distributed in the forward area of antenna array. The noise power is normalized to 0 dB, and the clutter-to-noise ratio (CNR) is 40 dB. It is assumed that a target is located at angle 16.5°, and its normalized Doppler frequency is − 0.27. The power of the target is assumed to 10 dB. The resolution scales of the angle-Doppler plane are set as ρ s  = 10 and ρ t  = 10 to achieve a high-resolution power spectrum. Note that the noise power is set to 0 dB in the simulations. Without loss of generality, the error threshold for the experiment is then set to ξ = 0.1 which is slightly larger than the noise power.

4.1 Experiment without ICM and knowledge error

Firstly, we carry out the experiments without the effect of ICM and knowledge error to verify the effectiveness of the proposed DA-SDS-SRSTAP method. The SR angle-Doppler power spectrum of the CUT data without ICM and knowledge error is presented in Fig. 5. It is clear that the clutters and target are all revealed in the power spectrum, and almost all of the clutter components are located in the clutter ridge, as is analyzed in Section 3. By making the DA-GIP algorithm work on the SR angle-Doppler power spectrum, the DA-GIP values and error values corresponding to four iterative times are shown in Fig. 6. We can see that the DA-GIP values have no change from the second iterative time for the reason that the clutter components are mainly located in the clutter ridge, which is consistent with the result shown in Fig. 5. Hence, the iteration should stop at the third time when the error value is lower than the threshold, and the third candidate CCM estimation \( {\widehat{\mathbf{R}}}_{c,3} \) can be applied for the following filter processing. Furthermore, in contrast with the real CCM, the eigenvalues of the candidate CCM estimation of each iterative time are presented in Fig. 7. It is observed that the three groups of eigenvalues are overlapped completely since iteration 2, and the number of eigenvalues in any of the three groups is nearly equivalent to that of the real CCM. It further demonstrates that the selected CCM estimation can be a good approximation to the real CCM. The normalized filter output with \( {\widehat{\mathbf{R}}}_{c,3} \) is shown in Fig. 8. It is clear that the clutters are completely suppressed and the target is highlighted.

Fig. 5
figure 5

SR angle-Doppler power spectrum of CUT data without the effect of ICM and knowledge error (dB)

Fig. 6
figure 6

DA-GIP values and error values without the effect of ICM and knowledge error. a DA-GIP values. b Error values

Fig. 7
figure 7

Eigenvalues corresponding to different CCM estimations without the effect of ICM and knowledge error. real CCM, iteration 1, iteration 2, iteration 3, iteration 4

Fig. 8
figure 8

Normalized STAP filter output without the effect of ICM and knowledge error

4.2 Experiment with ICM

Next, we test the DA-SDS-SRSTAP method in the case of ICM. The SR angle-Doppler power spectrum of the CUT data with ICM is presented in Fig. 9. It is clear that the clutters spread out of the clutter ridge caused by the effect of ICM. The DA-GIP values and error values corresponding to seven iterative times are shown in Fig. 10. Since the clutter extension, the number of iterative time has risen. The iteration should stop at the sixth time when the error value is lower than the threshold, and the sixth candidate CCM estimation \( {\widehat{\mathbf{R}}}_{c,6} \) can be applied for the following filter processing. Moreover, the eigenvalues of those candidate CCM estimations are also presented in Fig. 11. The eigenvalues are overlapped together since iteration 5, and the number of eigenvalues of \( {\widehat{\mathbf{R}}}_{c,6} \) is almost the same as the real CCM. Finally, the normalized filter output in the case of ICM is shown in Fig. 12. We can still see that the clutters are completely suppressed and the target is detected.

Fig. 9
figure 9

SR angle-Doppler power spectrum of CUT data with ICM

Fig. 10
figure 10

DA-GIP values and error values with ICM. a DA-GIP values. b Error values

Fig. 11
figure 11

Eigenvalues corresponding to different CCM estimations with ICM. real CCM, iteration 1, iteration 2, iteration 3, iteration 4, iteration 5, iteration 1

Fig. 12
figure 12

Normalized STAP filter output in the case of ICM

4.3 Detection along range and output SINR

At last, the target detection along range cell is analyzed, and 100 Monte Carlo simulations are carried out to get an average performance. A number of snapshots from 100 range cells are processed by D3-STAP, D3SR-STAP, and the proposed DA-SDS-SRSTAP, respectively. The target is assumed to be in the 50th range cell. The detection results along range cell, the output SINR curves, and the probability of detection (Pd) curves versus signal to clutter ratio (SCR) are presented in Figs. 13, 14, and 15, respectively. The probability of false alarm (Pfa) is set to 10−4. As shown in Fig. 13, each of the three algorithms can effectively suppress the clutters and distinguish the target in both non-ICM and ICM case. Nevertheless, in comparison with D3-STAP, D3SR-STAP and DA-SDS-SRSTAP have a less clutter residual along the range cell and own a better target detection performance because they have a higher system DOFs to design the adaptive filter. Moreover, as shown in Fig. 14, D3SR-STAP and DA-SDS-SRSTAP can provide a higher SINR level in the pass-band area and a narrower clutter notch than D3-STAP, which means a better performance of minimum detectable velocity (MDV). This improvement is also owing to their characteristics of full system DOFs. Finally, the results shown in Fig. 15 again demonstrate that the detection performances of D3SR-STAP and DA-SDS-SRSTAP are both better than that of D3-STAP due to the loss of DOFs caused by the D3-STAP processing. Furthermore, from Fig. 13 to Fig. 15, we can see that the detection performances without ICM are obviously better than those with ICM. Meanwhile, it is noted that the detection performance of D3-STAP declines more seriously than the ones of D3SR-STAP and DA-SDS-SRSTAP, respectively. Namely, D3SR-STAP and DA-SDS-SRSTAP are more robust to ICM case. One of the main reasons for this can also be owing to the DOFs loss of D3-STAP. Significantly, though D3SR-STAP and DA-SDS-SRSTAP have a similar target detection performance, the DA-SDS-SRSTAP has no use of the prior knowledge of the SOI area that is essential for D3SR-STAP and not easy to be got exactly. Therefore, the DA-SDS-SRSTAP method is more potential to target detection in the non-stationary radar scenario.

Fig. 13
figure 13

Normalized STAP filter outputs along range cell. a Without ICM case. b With ICM case. D3SR-STAP, D3-STAP, DA-SDS-SRSTAP

Fig. 14
figure 14

Output SINR. a Without ICM case. b With ICM case. D3SR-STAP, D3-STAP, DA-SDS-SRSTAP

Fig. 15
figure 15

Probability of detection (Pd) curves versus SCR, probability of false alarm (Pfa) is set to 10-4. a Without ICM case. b With ICM case. D3SR-STAP, D3-STAP, DA-SDS-SRSTAP

5 Conclusions

Representative target-free and homogeneous training data are no longer available when facing a severe non-stationary environment (heterogeneous clutter or a high target density), and the performance of classical STAP in this case may deteriorate rapidly. For solving this problem, a novel deterministic-aided single dataset STAP method based on sparse recovery technique (SR) for side-looking airborne or spaceborne radar is proposed in this paper, which is referred to as DA-SDS-SRSTAP. The new method only works with the CUT data, such that its performance is not impacted by the non-stationarity. We exploit the property that the clutter components of side-looking airborne or spaceborne radar are distributed along the clutter ridge to perform the estimation of CCM only with the CUT data. We first calculate the high-resolution angle-Doppler power spectrum of CUT data using SR technique. Then, a new adaptive deterministic-aided GIP (DA-GIP) algorithm is presented to recognize and select the clutter components in the SR angle-Doppler power spectrum automatically. Subsequently, the CCM, which is employed to construct the weights of STAP filter, can be estimated by the selected clutter components to fulfill the final STAP filter processing. Firstly, the new method can accomplish the object of target detection without secondary training samples. Secondly, in contrast with the conventional D3-STAP method, the proposed approach can avoid system DOFs loss owing to the usage of SR technique. Thirdly, though the proposed DA-SDS-SRSTAP method and the D3SR-STAP algorithm are both based on the SR technique, the proposed method can detect target without any prior knowledge of the SOI area that is essential for D3SR-STAP and not easy to be got accurately. Consequently, the proposed method has a great potential for target detection in the heterogeneous clutter environments. Simulation results verify the effectiveness of the proposed detection method. Moreover, how to extend the proposed method to front-looking airborne radar or frequency diverse array (FDA) radar to deal with the range-dependent clutter might be further studied. Though we have just utilized the deterministic knowledge of angle-Doppler structure of the clutter to cope with the heterogeneous environments with the help of SR technique, it might be interesting to exploit some other prior knowledges to incorporate with SR technique for improving the STAP performance.