Immune Multiobjective Optimization Algorithm for Unsupervised Feature Selection

  • Xiangrong Zhang
  • Bin Lu
  • Shuiping Gou
  • Licheng Jiao
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3907)


A feature selection method for unsupervised learning is proposed. Unsupervised feature selection is considered as a combination optimization problem to search for the suitable feature subset and the pertinent number of clusters by optimizing the efficient evaluation criterion for clustering and the number of features selected. Instead of combining these measures into one objective function, we make use of the multiobjective immune clonal algorithm with forgetting strategy to find the more discriminant features for clustering and the most pertinent number of clusters. The results of experiments on synthetic data and real datasets from UCI database show the effectiveness and potential of the method.


Feature Selection Pareto Front Feature Subset Nondominated Solution Feature Subset Selection 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Kohavi, R., John, G.H.: Wrappers for Feature Subset Selection. Artificial Intelligence Journal 97, 273–324 (1997)MATHCrossRefGoogle Scholar
  2. 2.
    Dash, M., Choi, K., Scheuermann, P., Liu, H.: Feature Selection for Clustering - A Filter Solution. In: Proceedings of 2nd IEEE International Conference on Data Mining (ICDM 2002), pp. 115–122 (2002)Google Scholar
  3. 3.
    Mitra, P., Murthy, C.A.: Unsupervised Feature Selection Using Feature Similarity. IEEE Trans. Pattern Analysis and Machine Intelligence 24, 301–312 (2002)CrossRefGoogle Scholar
  4. 4.
    Law, M.H.C., Figueiredo, M.A.T., Jain, A.K.: Simultaneous Feature Selection and Clustering Using Mixture Models. IEEE Trans Pattern Analysis and Machine Intelligence 26, 1154–1166 (2004)CrossRefGoogle Scholar
  5. 5.
    Dy, J.G., Brodley, C.E., Kak, A., Broderick, L.S., Aisen, A.M.: Unsupervised Feature Selection Applied to Content-Based Retrieval of Lung Images. IEEE Trans. Pattern Analysis and Machine Intelligence 25, 373–378 (2003)CrossRefGoogle Scholar
  6. 6.
    Morita, M., Sabourin, R., Bortolozzi, F., Suen, C.Y.: Unsupervised Feature Selection Using Multi-Objective Genetic Algorithms for Handwritten Word Recognition. In: Proceedings of the Seventh International Conference on Document Analysis and Recognition, pp. 666–670 (2003)Google Scholar
  7. 7.
    Kim, Y.S., Street, W.N., Menczer, F.: Feature Selection in Unsupervised Learning via Evolutionary Search. In: Proc. 6th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 365–369 (2000)Google Scholar
  8. 8.
    Yang, J., Honavar, V.: Feature Subset Selection Using a Genetic Algorithm. IEEE Trans. on Intelligent Systems 13, 44–49 (1998)CrossRefGoogle Scholar
  9. 9.
    Li, R., Bhanu, B., Dong, A.: Coevolutionary Feature Synthesized EM Algorithm for Image Retrieval. In: Proceedings of the Application of Computer Multimedia, pp. 696–705 (2005)Google Scholar
  10. 10.
    Lin, Y., Bhanu, B.: Evolutionary Feature Synthesis for Object Recognition. IEEE Trans. on Systems, Man, and Cybernetics–Part C 35, 156–171 (2005)CrossRefGoogle Scholar
  11. 11.
    Zhang, X.R., Shan, T., Jiao, L.C.: SAR Image Classification Based on Immune Clonal Feature Selection. In: Campilho, A.C., Kamel, M.S. (eds.) ICIAR 2004. LNCS, vol. 3212, pp. 504–511. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  12. 12.
    Lu, B., Jiao, L.C., Du, H.F., Gong, M.G.: IFMOA: Immune Forgetting Multiobjective Optimization Algorithm. In: Wang, L., Chen, K., S. Ong, Y. (eds.) ICNC 2005. LNCS, vol. 3612, pp. 399–408. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  13. 13.
    Xie, X.L., Beni, G.: A Validity Measure for Fuzzy Clustering. IEEE Trans. Pattern Analysis and Machine Intelligence 13, 841–847 (1991)CrossRefGoogle Scholar
  14. 14.
    Fraley, C., Raftery, A.E.: How Many Clusters? Which Clustering Method? Answers Via Model-Based Cluster Analysis. The Computer Journal 41, 578–588 (1998)MATHCrossRefGoogle Scholar
  15. 15.
    Du, H.F., Jiao, L.C., Wang, S.A.: Clonal Operator and Antibody Clone Algorithms. In: Proceedings of the First International Conference on Machine Learning and Cybernetics, Beijing, pp. 506–510 (2002)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Xiangrong Zhang
    • 1
  • Bin Lu
    • 1
  • Shuiping Gou
    • 1
  • Licheng Jiao
    • 1
  1. 1.National Key Lab for Radar Signal Processing, Institute of Intelligent Information ProcessingXidian UniversityXi’anChina

Personalised recommendations