A dynamic selection ensemble method for target recognition based on clustering and randomized reference classifier

Original Article


In order to improve the generalization ability and recognition efficiency of the maritime surveillance radar, a novel selection ensemble technique, termed KMRRC, based on k-medoids clustering and random reference classifier (RRC) is proposed. By disturbing the training set base classifiers are generated, which are then divided into several clusters based on pairwise diversity metrics, finally the RRC model is used to select several most competent classifiers from each cluster to classify each query object. The performance of KMRRC is compared against nine ensemble learning methods using a self-built high range resolution profile (HRRP) data set and twenty UCI databases. The experimental results clearly show the KMMRRC’s feasibility and effectiveness. In addition, the influence of the selection of diversity measures is studied concurrently.


K-medoids clustering Randomized reference classifier Dynamic selection ensemble Target recognition 



This work is supported by Grant No. (61401493) from the National Natural Science Foundation of China and No.(9140A01010415JB11002) from the National Ministries Foundation of China.


  1. 1.
    Kittler J, Hatef M, Duin R P W, Matas J (1998) On combining classifiers. IEEE T Pattern Anal 20(3):226–239CrossRefGoogle Scholar
  2. 2.
    Wang XZ, Xing HJ, Li Y et al.(2015) A study on relationship between generalization abilities and fuzziness of base classifiers in ensemble learning. IEEE T Fuzzy Syst 23(5):1638–1654CrossRefGoogle Scholar
  3. 3.
    Ludmila IK (2014) Combining pattern classifiers: methods and algorithms, 2nd edn. Wiley, New York, pp 178–183MATHGoogle Scholar
  4. 4.
    Woźniak M, Graña M, Corchado E (2014) A survey of multiple classifier systems as hybrid systems. Inf Fusion 16(1):3–17CrossRefGoogle Scholar
  5. 5.
    Kuncheva LI (2002) Switching between selection and fusion in combining classifiers: an experiment. IEEE T Syst Man Cybern 32(2):146–156CrossRefGoogle Scholar
  6. 6.
    Azizi N, Farah N, Ennaji A (2012) New dynamic classifiers selection approach for handwritten recognition. In: Proceedings of international conference on artificial neural networks and machine learning, Springer, pp 189–196Google Scholar
  7. 7.
    Mousavi R, Eftekhari M (2015) A new ensemble learning methodology based on hybridization of classifier ensemble selection approaches. Appl Soft Comput 37(C):652–666CrossRefGoogle Scholar
  8. 8.
    Britto AS, Sabourin R, Oliveira L E S (2014) Dynamic selection of classifiers—a comprehensive review. Pattern Recogn 47(11):3665–3680CrossRefGoogle Scholar
  9. 9.
    Ko AH, Sabourin R, Britto AS (2008) From dynamic classifier selection to dynamic ensemble selection. Pattern Recogn 41(5):1735–1748CrossRefMATHGoogle Scholar
  10. 10.
    Cavalin PR, Sabourin R, Suen CY (2013) Dynamic selection approaches for multiple classifier systems. Neural Comput Appl 22(3–4):673–688CrossRefGoogle Scholar
  11. 11.
    Cruz R M O, Cavalcanti G D C, Ren TI (2011) A method for dynamic ensemble selection based on a filter and an adaptive distance to improve the quality of the regions of competence. In: Proceedings of International Joint Conference on Neural Networks, IEEE, pp 1126–1133Google Scholar
  12. 12.
    Azizi N, Farah N, Khadir T (2015) Multi stage dynamic ensemble selection using heterogeneous learning algorithms: application on classification problems. Int J Knowl Manag Stud 142(1):98–104Google Scholar
  13. 13.
    Santos E M D, Sabourin R, Maupin P (2008) A dynamic overproduce-and-choose strategy for the selection of classifier ensembles. Pattern Recogn 41(10):2993–3009CrossRefMATHGoogle Scholar
  14. 14.
    Giacinto G, Roli F (2001) Dynamic classifier selection based on multiple classifier behavior. Pattern Recogn 34(9):1879–1881CrossRefMATHGoogle Scholar
  15. 15.
    Krijthe JH, Ho TK, Loog M (2012) Improving cross-validation based classifier selection using meta-learning. In: Proceedings of international conference on pattern recognition, IEEE, pp 2873–2876Google Scholar
  16. 16.
    Cruz RM, Sabourin R, Cavalcanti GDC et al.(2015) META-DES: A dynamic ensemble selection framework using meta-learning. Pattern Recogn 48(5):1925–1935CrossRefGoogle Scholar
  17. 17.
    Woloszynski T, Kurzynski M (2011) A probabilistic model of classifier competence for dynamic ensemble selection. Pattern Recogn 44(10–11):2656–2668CrossRefMATHGoogle Scholar
  18. 18.
    Huang D, Lai JH, Wang CD (2016) Ensemble clustering using factor graph. Pattern Recognition Pattern Recogn 50:131–142CrossRefGoogle Scholar
  19. 19.
    Huang D, Lai JH, Wang CD (2016) Robust ensemble clustering using probability trajectories. IEEE T Knowl Data Eng 28(5):1312–1326CrossRefGoogle Scholar
  20. 20.
    Zenobi G, Cunningham P (2001) Using Diversity in Preparing Ensembles of Classifiers Based on Different Feature Subsets to Minimize Generalization Error. In: Proceedings of European conference on machine learning, Springe, pp 576–587Google Scholar
  21. 21.
    Canuto AMP, Abreu MCC, Oliveira LDM et al.(2007) Investigating the influence of the choice of the ensemble members in accuracy and diversity of selection-based and fusion-based methods for ensembles. Pattern Recogn Lett 28(4):472–486CrossRefGoogle Scholar
  22. 22.
    Woloszynski T, Kurzynski M, Podsiadlo P et al.(2012) A measure of competence based on random classification for dynamic ensemble selection. Inf Fusion 13(3):207–213CrossRefGoogle Scholar
  23. 23.
    Cameron WL, Leung LK (1990) Feature motivated polarization scattering matrix decomposition. In: Proceedings of international conference on radar, IEEE, pp 549–557Google Scholar
  24. 24.
    Chen Y, Jiang H, Li C, Jia X (2016) Deep feature extraction and classification of hyperspectral images based on convolutional neural networks. IEEE T Geosci Rem 54(10):1–20CrossRefGoogle Scholar
  25. 25.
    Pilcher CM, Khotanzad A (2011) Maritime ATR using classifier combination and high resolution range profiles. IEEE Trans Aerosp Electron Syst 47(4):2558–2573CrossRefGoogle Scholar
  26. 26.
    Cloude SR, Pottier E (1997) An entropy based classification scheme for land applications of polarimetric SAR. IEEE T Geosci Remote 35(1):68–78CrossRefGoogle Scholar
  27. 27.
    Berizzi F, Martorella M, Capria A et al.(2008) H/α polarimetric features for man-made target classification. In: Proceedings of international conference on radar conference, IEEE, pp 1–6Google Scholar
  28. 28.
    Lei L, Wang XD, Xing YQ et al.(2013) Multi-polarized HRRP classification by SVM and DS evidence theory. Control Decis 28(6):861–866 (Chinese)MATHGoogle Scholar
  29. 29.
    Guo L (2009) Wideband radar target polarimetric feature extraction and recognition method based on kernel method. Dissertation, National University of Defense Technology. (in chinese)Google Scholar
  30. 30.
    Fan XM, Hu SL, He JB (2016) Feature extraction and selection of Full Polarization HRRP in the target recognition process of maritime surveillance radar. J Electrs Inf Technol 38(12):3261–3268Google Scholar
  31. 31.
    Yeung DS, Wang XZ (2002) Improving performance of similarity-based clustering by feature weight learning. IEEE T Pattern Anal 24(4):556–561CrossRefGoogle Scholar
  32. 32.
    Tang EK, Suganthan PN, Yao X (2006) An analysis of diversity measures. Mach Learn 65(1):247–271CrossRefGoogle Scholar
  33. 33.
    Balabantaray RC, Sarma C, Jha M (2015) Document clustering using K-means and K-medoids. Int J Knowl Based Comput Syst 1:7–13Google Scholar
  34. 34.
    Azizi N, Farah N (2012) From static to dynamic ensemble of classifiers selection: application to Arabic handwritten recognition. IOS press, USA, pp 279–288Google Scholar
  35. 35.
    Demsar J (2015) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7(1):1–30MathSciNetMATHGoogle Scholar

Copyright information

© Springer-Verlag GmbH Germany 2017

Authors and Affiliations

  1. 1.Electronics Engineering CollegeNaval University of EngineeringWuhanChina

Personalised recommendations