Skip to main content
Log in

A background refinement method based on local density for hyperspectral anomaly detection

一种基于局部密度的高光谱异常检测背景纯化方法

  • Published:
Journal of Central South University Aims and scope Submit manuscript

Abstract

For anomaly detection, anomalies existing in the background will affect the detection performance. Accordingly, a background refinement method based on the local density is proposed to remove the anomalies from the background. In this work, the local density is measured by its spectral neighbors through a certain radius which is obtained by calculating the mean median of the distance matrix. Further, a two-step segmentation strategy is designed. The first segmentation step divides the original background into two subsets, a large subset composed by background pixels and a small subset containing both background pixels and anomalies. The second segmentation step employing Otsu method with an aim to obtain a discrimination threshold is conducted on the small subset. Then the pixels whose local densities are lower than the threshold are removed. Finally, to validate the effectiveness of the proposed method, it combines Reed-Xiaoli detector and collaborative-representation-based detector to detect anomalies. Experiments are conducted on two real hyperspectral datasets. Results show that the proposed method achieves better detection performance.

摘要

在高光谱异常检测的基于背景的估计的研究中, 背景中存在的异常像元会对背景估计的准确性产生不利影响, 通过获得一个不包含异常目标的纯净背景可以有助于提高异常目标检测算法的检测率。 因此, 本文提出一种基于局部密度的背景纯化方法以去除背景中的异常像元。

经典的 RX 算法 (Reed-Xiaoli detector, RXD) 在背景统计信息估计时, 因初始背景中存在异常像元而产生失真现象。 这使 RX 算法的检测结果具有较高的虚警率。 在本文中, 将像元的局部密度作为该像元的异常度标签, 通过最大类间方差法去除初始背景中潜在的异常像元, 最后可以得到更纯净的背景集。 利用纯化背景得到更准确的背景统计信息, 可以有效降低 RX 算法的虚警率。

首先, 通过度量一定半径内的光谱邻域, 获得像元的局部密度, 半径选取为距离矩阵的平均中位数; 然后, 基于局部密度设计了两步分割策略: 第一步, 将原始背景分割为一个包含大部分背景像元的集合及一个混合着背景像元和异常像元的小子集。第二步, 利用最大类间方差法处理小子集, 获得一个判别阈值, 去除局部密度小于该阈值的像元, 得到纯净的背景。 最后, 利用 RX 检测算法和基于协同表示的检测算法验证所提背景纯化算法的有效性。

本文算法对于圣地亚哥海军基地数据和 SpecTIR 数据, AUC 值比 LRXD 分别提高了 0.0246 和 0.0068, 并且相比于其它算法有较高的检测率。 实验结果说明, 密度背景纯化方法有效抑制了异常点对背景数据的干扰, 使背景协方差和均值等参数更准确, 降低了虚警率。 在计算密度时, 需要人为设定半径值。 对于两幅高光谱数据, 在不同半径选择下 DBRAD 最大 AUC 差值为 0.0088 和 0.0012, 实验结果表明, 人为选择半径值可能会对最后的检测效果造成较大影响。 如何自适应选取半径将是下一步研究的重点。

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. MANOLAKIS D, SHAW G. Clutter detection algorithms for airborne pulse-Doppler radar [J]. IEEE Signal Processing Magazine, 2010, 19(1): 29–43. DOI: 10.1109/SIU.2010.5654379.

    Article  Google Scholar 

  2. BAJORSKI P. Target detection under misspecified models in hyperspectral images [J]. IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing, 2012, 5(2): 470–477. DOI: 10.1109/JSTARS.2012.2188095.

    Article  Google Scholar 

  3. ZHAO Chun-Hui, LI Jie, MEI Feng, et al. A kernel weighted RX algorithm for anomaly detection in hyperspectral imagery [J]. Journal of Infrared and Millim Waves, 2010, 29(5): 378–382. (in Chinese)

    Article  Google Scholar 

  4. STEIN D W J, BEAVEN S G, HOFF L E, et al. Anomaly detection from hyperspectral imagery [J]. IEEE Signal Processing Magazine, 2002, 19(1): 58–69. DOI: 10.1109/79.974730.

    Article  Google Scholar 

  5. ZHAO Chun-hui, WANG Yu-lei, LI Xiao-hui. A real-time anomaly detection algorithm for hyperspectral imagery based on causal processing [J]. Journal of Infrared Millim Waves, 2015, 34(1): 114–121. (in Chinese)

    Google Scholar 

  6. CHANG C I, CHIANG S S. Anomaly detection and classification for hyperspectral imagery [J]. IEEE Transactions on Geoscience & Remote Sensing, 2002, 40(6): 1314–1325. DOI: 10.1109/TGRS.2002.800280.

    Article  Google Scholar 

  7. ROBEY F C, FUHRMANN D R, KELLY E J, et al. A CFAR adaptive matched filter detector [J]. IEEE Transactions on Aerospace & Electronic Systems, 1992, 28(1): 208–216. DOI: 10.1109/7.135446.

    Article  Google Scholar 

  8. REN H, DU Q, CHANG C I, et al. Comparison between constrained energy minimization based approaches for hyperspectral imagery [C]// IEEE Workshop on Advances in Techniques for Analysis of Remotely Sensed Data (IEEE 2003). Greenbelt, USA: IEEE, 2003: 244–248. DOI: 10.1109/WARSD.2003.1295199.

    Google Scholar 

  9. CHEN Y, NASRABADI N M, TRAN T D. Simultaneous joint sparsity model for target detection in hyperspectral imagery [J]. IEEE Geoscience & Remote Sensing Letters, 2011, 8(4): 676–680. DOI: 10.1109/LGRS.2010.2099640.

    Article  Google Scholar 

  10. REED I S, YU X. Adaptive multiple-band CFAR detection of an optical pattern with unknown spectral distribution [J]. IEEE Transactions on Acoustics, Speech and Signal Processing, 1990, 38(10): 1760–1770. DOI: 10.1109/29.60107.

    Article  Google Scholar 

  11. KWON H, NASRABADI N M. Kernel RX-Algorithm: A nonlinear anomaly detector for hyper-spectral imagery [J]. IEEE Transactions on Geoscience & Remote Sensing, 2005, 43(2): 388–397. DOI: 10.1109/aero.2005.1559493.

    Article  Google Scholar 

  12. BANERJEE A, BURLINA P, DIEHL C. A support vector method for anomaly detection in hyperspectral imagery [J]. IEEE Transactions on Geoscience & Remote Sensing, 2006, 44(8): 2282–2291. DOI: 10.1109/tgrs.2006.873019.

    Article  Google Scholar 

  13. KHAZAI S, HOMAYOUNI S, SAFARI A, et al. Anomaly detection in hyperspectral images based on an adaptive support vector method [J]. IEEE Geoscience & Remote Sensing Letters, 2011, 8(4): 646–650. DOI: 10.1109/lgrs.2010.2098842.

    Article  Google Scholar 

  14. SAKLA W, CHAN A, JI J, et al. An SVDD-based algorithm for target detection in hyperspectral imagery [J]. IEEE Geoscience & Remote Sensing Letters, 2011, 8(2): 384–388. DOI: 10.1109/lgrs.2010.2078795.

    Article  Google Scholar 

  15. LI Wei, DU Q. Collaborative representation for hyperspectral anomaly detection [J]. IEEE Transactions on Geoscience & Remote Sensing, 2015, 53(3): 1463–1474. DOI: 10.1109/tgrs.2014.2343955.

    Article  Google Scholar 

  16. BILLOR N, HADI A S, VELLEMAN P F. BACON: blocked adaptive computationally efficient outlier nominators [J]. Computational Statistics & Data Analysis, 2000, 34(99): 279–298. DOI: 10.1016/s0167-9473(99)00101–2.

    Article  MATH  Google Scholar 

  17. DU Bo, ZHANG Liang-pei. Random-selection-based anomaly detector for hyperspectral imagery [J]. IEEE Transactions on Geoscience & Remote Sensing, 2011, 49(5): 1578–1589. DOI: 10.1109/tgrs.2010.2081677.

    Article  Google Scholar 

  18. GAO Lian-ru, GUO Qian-dong, PLAZA A, et al. Probabilistic anomaly detector for remotely sensed hyperspectral data [J]. Journal of Applied Remote Sensing, 2014, 8(1): 083538. DOI: 10.1117/1.jrs.8.083538.

    Article  Google Scholar 

  19. LOU Chen, ZHAO Hui-jie. Local density-based anomaly detection in hyperspectral image [J]. Journal of Applied Remote Sensing, 2015, 9(1): 095070–095070. DOI: 10.1117/1.jrs.9.095070.

    Article  Google Scholar 

  20. MOLERO A J M, GARZON E M, GARCIA I, et al. Analysis and optimizations of global and local versions of the RX algorithm for anomaly detection in hyperspectral data [J]. IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing, 2013, 6(2): 801–814. DOI: 10.1109/jstars.2013.2238609.

    Article  Google Scholar 

  21. LI Wei, DU Q. Unsupervised nearest regularized subspace for anomaly detection in hyperspectral imagery [C]// IEEE, Geoscience and Remote Sensing Symposium (IGARSS 2013). Melbourne, Australia, 2014: 1055–1058. DOI: 10.1109/igarss.2013.6721345.

    Google Scholar 

  22. LI Wei, TRAMEL E W, PRASAD S, et al. Nearest regularized subspace for hyperspectral classification [J]. IEEE Transactions on Geoscience & Remote Sensing, 2014, 52(1): 477–489. DOI: 10.1109/pic.2015.7489804.

    Article  Google Scholar 

  23. PLAZA A, MARTINEZ P, PLAZA J, et al. Dimensionality reduction and classification of hyperspectral image data using sequences of extended morphological transformations [J]. IEEE Transactions on Geoscience & Remote Sensing, 2005, 43(3): 466–479. DOI: 10.1109/tgrs.2004.841417.

    Article  Google Scholar 

  24. HERWEG J A, KEREKES J P, WEATHERBEE O, et al. Algorithms and technologies for multispectral, hyperspectral, and ultraspectral imagery XVIII (SPIE 2012) [C]// SHEN S S, ed. SPIE Proceedings: SPIE. 2012: 839028. DOI: 10.1117/12.919268.

    Google Scholar 

  25. MOLERO A J M, GARZON E M, GARCIA I, et al. Anomaly detection based on a parallel kernel RX algorithm for multicore platforms [J]. Journal of Applied Remote Sensing, 2012, 6(1): 623–632. DOI: 10.1117/1.jrs.6.061503.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Chun-hui Zhao  (赵春晖).

Additional information

Foundation item: Projects(61405041, 61571145) supported by the National Natural Science Foundation of China; Project(ZD201216) supported by the Key Program of Heilongjiang Natural Science Foundation, China; Project(RC2013XK009003) supported by Program Excellent Academic Leaders of Harbin, China; Project(HEUCF1508) supported by the Fundamental Research Funds for the Central Universities, China

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhao, Ch., Wang, Xp., Yao, Xf. et al. A background refinement method based on local density for hyperspectral anomaly detection. J. Cent. South Univ. 25, 84–94 (2018). https://doi.org/10.1007/s11771-018-3719-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11771-018-3719-6

Key words

关键词

Navigation