Skip to main content
SpringerLink
Log in

A hybrid clustering algorithm based on PSO with dynamic crossover

  • Methodologies and Application
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

In order to overcome the premature convergence in particle swarm optimization (PSO), we introduce dynamical crossover, a crossover operator with variable lengths and positions, to PSO, which is briefly denoted as CPSO. To get rid of the drawbacks of only finding the convex clusters and being sensitive to the initial points in \(k\)-means algorithm, a hybrid clustering algorithm based on CPSO is proposed. The difference between the work and the existing ones lies in that CPSO is firstly introduced into \(k\)-means. Experimental results performing on several data sets illustrate that the proposed clustering algorithm can get completely rid of the shortcomings of \(k\)-means algorithms, and acquire correct clustering results. The application in image segmentation illustrates that the proposed algorithm gains good performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24
Fig. 25
Fig. 26
Fig. 27

Similar content being viewed by others

References

  • Abdel-Kader RF (2010) Genetically improved PSO algorithm for efficient data clustering. In IEEE international conference on machine learning and, computing, pp 71–75

  • Alsabti K, Ranka S, Singh V (1997) An efficient k-means clustering algorithm. In: IPPS/SPDP workshop on high performance data mining

  • Assent I et al (2008) Clustering multidimensional sequences in spatial and temporal databases. Knowl Inf Syst 16(1):29–51

    Article  Google Scholar 

  • Basit HA, Jarzabek S (2009) A data mining approach for detecting higher-level clones in software. IEEE Trans Softw Eng 35(4):497–514

    Article  Google Scholar 

  • Birant D, Kut A (2007) ST-DBSCAN: an algorithm for clustering spatial-temporal data. Data Knowl Eng 60(1):208–221

    Article  Google Scholar 

  • Chehreghani MH, Abolhassani H, Chehreghani MH (2008) Improving density-based methods for hierarchical clustering of web pages. Data Knowl Eng 67(1):30–50

    Article  MathSciNet  Google Scholar 

  • Chen S, Zhang D (2004) Robust image segmentation using FCM with spatial constraints based on new kernel-induced distance measure. IEEE Trans Syst Man Cybern Part B Cybern 34(4):1907–1916

    Article  Google Scholar 

  • Chen WCS, Zhang D (2007) Fast and robust fuzzy c-means clustering algorithms incorporating local information for image segmentation. Pattern Recogn 40(3):825–838

    Article  MATH  Google Scholar 

  • Chuang K et al (2006) Fuzzy c-means clustering with spatial information for image segmentation. Computerized medical imaging and graphics 30(1):9–15

    Article  Google Scholar 

  • Clerc M, Kennedy J (2002) The particle swarm: explosion, stability and convergence in a multi-dimensional complex space. IEEE Trans Evol Comput 6(1):58–73

    Article  Google Scholar 

  • Daqi L, Junyi S, Hongmin C (2008) A fast K-Means clustering algorithm based on grid data reduction. In: IEEE conference on, aerospace, pp 1–6

  • Datta S, Giannella CR, Kargupta H (2009) Approximate distributed K-Means clustering over a peer-to-peer network. IEEE Trans Knowl Data Eng 21(10):1372–1388

    Article  Google Scholar 

  • David A, Jean P (2002) Computer vision: a modern approach. Prentice-Hall, Englewood Cliffs

    Google Scholar 

  • Davidson I, Ravi SS (2008) Using instance-level constraints in agglomerative hierarchical clustering theoretical and empirical results. Data Mining Knowl Discov 18(2):257–282

    Article  MathSciNet  Google Scholar 

  • Dong J, Qi M (2009) A new algorithm for clustering based on particle swarm optimization and k-means. In: 2009 international conference on artificial intelligence and, computational intelligence, pp 264–268

  • Eberhart R, Kennedy J (1995) A new optimizer using particle swarm theory. In: Proceedings of sixth international symposium micro machine and human science, pp 39–43

  • Gan H et al (2013) Using clustering analysis to improve semi-supervised classification. Neurocomputing 101:290–298

    Article  Google Scholar 

  • Gou SP et al (2013) Parallel sparse spectral clustering for SAR image segmentation. IEEE J Selected Topics Appl Earth Observ Remote Sens 99:1–15

    Google Scholar 

  • Han J, Kamber M (2006) Data mining: concepts and techniques. Morgan Kaufmann, San Franciso

    Google Scholar 

  • Haralick RM, Shapiro LG (1985) Image segmentation techniques. Comput Vision Graphics Image Process 29(1):100–132

    Article  Google Scholar 

  • Huber M et al (2009) Data mining based mutation function for engineering problems with mixed continuous-discrete design variables. Struct Multidiscipl Optim 41(4):589–604

    Article  Google Scholar 

  • Jeon B, Jung Y, Hong K (2006) Image segmentation by unsupervised sparse clustering. Pattern Recogn Lett 27(14):1650–1664

    Article  Google Scholar 

  • Jiang H et al (2011) A new hybrid method based on partitioning-based DBSCAN and ant clustering. Expert Syst Appl 38(8):9373–9381

    Article  Google Scholar 

  • Karoui L, Aufaure M, Bennacer N (2006) Context-based hierarchical clustering for the ontology learning. In: Proceedings of the 2006 IEEE/WIC/ACM international conference on web, intelligence, pp 420–427

  • Karthikeyan M, Aruna P (2013) Probability based document clustering and image clustering using content-based image retrieval. Appl Soft Comput 13(2):959–966

    Article  Google Scholar 

  • Kennedy J, Eberhart R (1995) Particle swarm optimization. IEEE Int Conf Neural Netw 4:1942–1948

    Google Scholar 

  • Ladys Law Skarbek W, Koschan A (1994) Colour image segmentation a survey. In: IEEE transactions on circuits and systems for video technology, vol 14, no 7

  • Liu C et al (2013) Clustering tagged documents with labeled and unlabeled documents. Inf Process Manage 49(3):596–606

    Article  Google Scholar 

  • Mahdavi M, Abolhassani H (2008) Harmony K-means algorithm for document clustering. Data Mining Knowl Discov 18(3):370–391

    Article  MathSciNet  Google Scholar 

  • Ma W, Manjunath BS (1997) Edge flow: a framework of boundary detection and image segmentation. In: IEEE computer society conference on computer vision and, pattern recognition, pp 744–749

  • Martin D et al (2001) A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: The 8th IEEE international conference on computer vision, vol 2, pp 416–423

  • Ponce J et al (2011) Computer vision: a modern approach. Computer 16:11

    Google Scholar 

  • Qiu D (2010) A comparative study of the K-means algorithm and the normal mixture model for clustering Bivariate homoscedastic case. J Stat Plan Infer 140(7):1701–1711

    Article  MATH  Google Scholar 

  • Samma ASB, Salam RA (2009) Adaptation of k-means algorithm for image segmentation. World Acad Sci Eng Technol 50:58–62

    Google Scholar 

  • Shi J, Malik J (2000) Normalized cuts and image segmentation. IEEE Trans Pattern Anal Mach Intell 22(8):888–905

    Article  Google Scholar 

  • UCI Repository of Machine Learning Databases (1998). http://www.ics.uci.edu/~mlearn/MLRepository.html

  • Wang X, Huang D, Member S (2009) A novel density-based clustering framework by using level set method. IEEE Trans Knowl Data Eng 21(11):1515–1531

    Article  Google Scholar 

  • Wang L, Dong M (2012) Multi-level low-rank approximation-based spectral clustering for image segmentation. Pattern Recogn Lett 33(16):2206–2215

    Article  Google Scholar 

  • Xia Y et al (2007) Image segmentation by clustering of spatial patterns. Pattern Recogn Lett 28(12):1548–1555

    Article  Google Scholar 

  • Xiong H, Wu J, Chen J (2009) K-means clustering versus validation measures: a data-distribution perspective. IEEE Trans Syst Man Cybern Part B Cybern 39(2):318–331

    Article  Google Scholar 

  • Yin M et al (2011) A novel hybrid K-harmonic means and gravitational search algorithm approach for clustering. Expert Syst Appl 38(8):9319–9324

    Article  Google Scholar 

  • Yücenur GN, Demirel NÇ (2011) A new geometric shape-based genetic clustering algorithm for the multi-depot vehicle routing problem. Expert Syst Appl 38(9):11859–11865

    Article  Google Scholar 

  • Zha H et al (2001) Spectral relaxation for k-means clustering. Adv Neural Inf Process Syst 14:1057–1064

    Google Scholar 

  • Zhang J, Yang Y, Zhang Q (2009) The particle swarm optimization algorithm based on dynamic chaotic perturbations and its application to K-means. In: International conference on computational intelligence and security (CIS 2009), vol 1. Beijing, China, pp 282–286

  • Zhang J, Wang Y, Feng J (2013) Attribute index and uniform design based multiobjective association rule mining with evolutionary algorithm. Sci World J 16

  • Zhang J, Xue X, Wang Y (2012) Class assignment algorithms for performance measure of clustering algorithms. In: The 8th international conference on computational intelligence and security, CIS (2012) Guangzhou. Guangdong, China, pp 103–106

Download references

Acknowledgments

This work is supported by the National Natural Science Foundation of China (No.61272119, No.61203372), and the Fundamental Research Funds for the Central Universities (No. K50510030014).

Author information

Authors and Affiliations

  1. School of Computer Science and Technology, Xidian University, Xi’an, 710071, People’s Republic of China

    Jie Zhang & Yuping Wang

  2. Department of Computer Science and Technology, Guangzhou University Sontan College, Zengcheng, 511370, Guangzhou, People’s Republic of China

    Jie Zhang & Junhong Feng

Authors
  1. Jie Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yuping Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Junhong Feng
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Jie Zhang or Yuping Wang.

Additional information

Communicated by D. Liu.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Zhang, J., Wang, Y. & Feng, J. A hybrid clustering algorithm based on PSO with dynamic crossover. Soft Comput 18, 961–979 (2014). https://doi.org/10.1007/s00500-013-1115-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-013-1115-6

Keywords

Search

Navigation