Skip to main content
SpringerLink
Log in

Unsupervised Clustering Based an Adaptive Particle Swarm Optimization Algorithm

  • Published:
Neural Processing Letters Aims and scope Submit manuscript

Abstract

Clustering analysis is the major application area of data mining where particle swarm optimization (PSO) is being widely implemented due to its simplicity and efficiency. In this paper, we present a new variant of PSO algorithm well tailored to clustering analysis. The proposed algorithm encodes each particle as a bi-dimensional vector, where in the first dimension we look for the optimal number of clusters and in the second dimension, we look for the best centroid of each cluster. In this PSO clustering algorithm a new updating positions rule is proposed to deal with our clustering objective. The performance of the proposed algorithm is tested according to artificial datasets and real datasets. The achieved results present actually good performance and still promising in future perspective.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. Abraham A, Guo H, Liu H (2006) Swarm intelligence: foundations, perspectives and applications. Stud Comput Intell (SCI) 26:3–25

    Google Scholar 

  2. Moh’d Alia O, Mandava R, Aziz ME (2011) A hybrid harmony search algorithm for MRI brain segmentation. Evol Intell 4(1):31–49

    Article  Google Scholar 

  3. Bandyopadhyay S, Maulik U (2002) Genetic clustering for automatic evolution of clusters and applications to image classification. Pattern Recogn 35(6):1197–1208

    Article  MATH  Google Scholar 

  4. Berkhin P (2006) A survey of clustering data mining techniques. In: Kogan J, Nicholas C, Teboulle M (eds) Grouping multidimensional data. Springer, Heidelberg, pp 25–71

    Chapter  Google Scholar 

  5. Bong CW, Lam HY (2011) Unsupervised image segmentation with adaptive archive-based evolutionary multiobjective clustering. In: The 4th International conference on Pattern Recognition and Machine Intelligence, LNCS 6744, pp 92–97

  6. Campello RJGB, Hruschka ER, Alves VS (2009) On the efficiency of evolutionary fuzzy clustering. J Heuristics 15(1):43–75

    Article  MATH  Google Scholar 

  7. Chou CH, Su MC, Lai E (2004) A new cluster validity measure and its application to image compression. Pattern Anal Appl 7(2):205–220

    Article  MathSciNet  Google Scholar 

  8. Clerc M (1999) The swarm and the Queen: towards a deterministic and adaptive particle swarm optimization. In Proceedings of the Congress on Evolutionary Computation, vol. 3, Washington, IEEE Press, pp 1951–1957

  9. Das S, Abraham A, Konar A (2008) Automatic clustering using an improved differential evolution algorithm. IEEE Trans Syst Man Cybern Part A 38(1):218–237

    Article  Google Scholar 

  10. Das S, Abraham A, Konar A (2009) Metaheuristic pattern clustering—an overview. Stud Comput Intell 178:1–62

    Article  Google Scholar 

  11. Day WH, Edelsbrunner H (1984) Efficient algorithms for agglomerative hierarchical clustering methods. J Classif 1(1):1–24

    Article  MATH  Google Scholar 

  12. Dunn JC (1974) Well separated clusters and optimal fuzzy partitions. J Cybern 4(1):95–104

    Article  MathSciNet  MATH  Google Scholar 

  13. Eberhart R, Shi Y (2000) Comparing inertia weights and constriction factors in particle swarm optimization. In: Proceedings of the IEEE Congress on Evolutionary Computation, pp 84–88

  14. Eberhart R, Shi Y, Kennedy J (2001) Swarm intelligence. Morgan Kaufmann, San Francisco

    Google Scholar 

  15. Engelbrecht AP (2007) Computational intelligence: an introduction. John Willey & Sons Editions, New York

    Book  Google Scholar 

  16. Esmin AAA, Coelho RA, Matwin S (2015) A review on particle swarm optimization algorithm and its variants to clustering high-dimensional data. Artif Intell Rev 44(1):23–45

    Article  Google Scholar 

  17. Gupta M, Aggarwal CC, Han J, Sun Y (2011) Evolutionary clustering and analysis of bibliographic networks. In: The proceedings of the International conference on Advances in Social Networks Analysis and Mining, pp 63–70

  18. Handl J, Knowles J (2007) An evolutionary approach to multiobjective clustering. IEEE Trans Evol Comput 11(1):56–76

    Article  Google Scholar 

  19. Handl J, Meyer B (2007) Ant-based and swarm-based clustering. Swarm Intell 1:95–113

    Article  Google Scholar 

  20. Hatamlou A, Abdullah S, Nezamabadi-pour H (2012) A combined approach for clustering based on K-means and gravitational search algorithms. Swarm Evol Comput 6:47–52

    Article  Google Scholar 

  21. Hong T-P, Chen C-H, Wu Y-L, Tseng VS (2008) Fining active membership functions in fuzzy data mining. Data Min Found Pract Stud Comput Intell 118:179–196

    Article  MATH  Google Scholar 

  22. Hruschka ER, Campello RJGB, Freitas AA, de Carvalho ACPLF (2009) A survey of evolutionary algorithms for clustering. IEEE Trans Syst Man Cybern Part C 39(2):133–155

    Article  Google Scholar 

  23. Hasan MJA, Ramakrishnan S (2011) A survey: hybrid evolutionary algorithms for cluster analysis. Artif Intell Rev 36:179–204

    Article  Google Scholar 

  24. Jain AK, Dubes RC (1988) Algorithms for clustering data. Prentice Hall, New Jersey

    MATH  Google Scholar 

  25. Jain AK, Murty MN, Flynn PJ (1999) Data clustering: a review. ACM Comput Surv 31(3):264–323

    Article  Google Scholar 

  26. Jain AK (2010) Data clustering: 50 years beyond K-means. Pattern Recogn Lett 31:651–666

    Article  Google Scholar 

  27. Kennedy J, Eberhart R (1995) Particle swarm optimization. In: The Proceedings of the fourth IEEE International Conference on Neural Networks, Australia, pp 1942–1948

  28. Kriegel H-P, Kröger P, Zimek A (2009) Clustering high-dimensional data: a survey on subspace clustering, pattern-based clustering, and correlation clustering. ACM Trans Knowl Discov Data 3(1):1

    Article  Google Scholar 

  29. Krömer P, Platos J, Snasel V (2012) Genetic algorithm for clustering accelerated by the CUDA platform. In: The Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, pp 1005–1010

  30. Li Q, Shi Z, Shi J, Shi Z (2005) Swarm intelligence clustering algorithm based on attractor. In: Proceedings of the International Conference on Adaptive and Natural Computing Algorithms, pp 353–356

  31. Liu B, Pan J, McKay B (2006) Incremental clustering based on swarm intelligence. In: Proceedings of the International Conference on Simulated Evolution and Learning, vol. 4247, Lecture Notes in Computer Science, pp 189–196

  32. Ma PCH, Chan KCC, Yao X, Chiu DKY (2006) An evolutionary clustering algorithm for gene expression microarray data analysis. IEEE Trans Evol Comput 10(3):296–314

    Article  Google Scholar 

  33. Merz P, Zell A (2002) Clustering gene expression profiles with memetic algorithms. In: The Proceedings of the 7th International Conference on Parallel Problem Solving from Nature (PPSN VII), pp 811–820

  34. Merz CJ, Murphy PM (2007) UCI repository of machine learning databases. University of California, Irvine, California, USA. http://www.ics.uci.edu/~mlearn

  35. Mitra S (2004) An evolutionary rough partitive clustering. Pattern Recogn Lett 25:1439–1449

    Article  Google Scholar 

  36. Niu B, Duan Q, Tan L, Liu C, Liang P (2015) A population-based clustering technique using particle swarm optimization and K-means. Adv Swarm Comput Intell LNCS 9140:145–152

    Article  Google Scholar 

  37. Omran MGH, Engelbrecht AP, Salman A (2005) Dynamic clustering using particle swarm optimization with application in unsupervised image classification. Trans Eng Comput Technol 9:199–204

    Google Scholar 

  38. Omran MGH, Al-Sharhan A (2007) Barebones particle swarm methods for unsupervised image classification. In: The Proceedings of IEEE Congress on Evolutionary Computation (CEC), Singapore, pp 3247–3252

  39. Rokach L (2010) A survey of clustering algorithms. In: Maimon O, Rokac L (eds) Data mining and knowledge discovery handbook. Springer, New York, pp 269–298

    Google Scholar 

  40. Rui Xu, Wunsch D (2005) Survey of clustering algorithms. IEEE Trans Neural Netw 16(3):645–678

    Article  Google Scholar 

  41. Senthilnath J, Omkar SN, Mani V (2011) Clustering using firefly algorithm: performance study. Swarm Evol Comput 1:164–171

    Article  Google Scholar 

  42. Storn R, price K (1997) Differntial evolution—a simple and efficient heuristic for global optimization over continuous spaces. J Global Optim 11(4):341–359

    Article  MathSciNet  MATH  Google Scholar 

  43. Tang K-S, Man K-F, Liu Z-F, Kwong S (1998) Minimal fuzzy memberships and rules using hierarchical genetic algorithms. IEEE Trans Ind Electron 45(1):162–169

    Article  Google Scholar 

  44. Veenhuis C, Köppen M (2006) Data swarm clustering. Swarm Intell Data Min Stud Comput Intell 34:221–241

    Article  MATH  Google Scholar 

  45. Zhao Q, Bhowmick SS, Gruenwald Cleopatra L (2006) Evolutionary pattern-based clustering of web usage data. In the Proceeding of the 10th Pacific-Asia Conference, Advances in Knowledge Discovery and Data Mining, LNCS 3918, pp 323–333

Download references

Author information

Authors and Affiliations

  1. Computer Science Department, Badji Mokhtar University, BP 12, 23000, Annaba, Algeria

    Yamina Mohamed Ben Ali

Authors
  1. Yamina Mohamed Ben Ali
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yamina Mohamed Ben Ali.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ali, Y.M.B. Unsupervised Clustering Based an Adaptive Particle Swarm Optimization Algorithm. Neural Process Lett 44, 221–244 (2016). https://doi.org/10.1007/s11063-015-9477-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11063-015-9477-7

Keywords

Search

Navigation