Parallel Bat Algorithm-Based Clustering Using MapReduce
As we are going through the era of big data where the size of the data is increasing very rapidly resulting into the failure of traditional clustering methods on such a massive data sets. If the size of data exceeds the storage capacity or memory of the system, the task of clustering will become more complex and time intensive. To overcome this problem, this paper proposes a fast and efficient parallel bat algorithm (PBA) for the data clustering using the map-reduce architecture. Efficient using the evolutionary approach for clustering purpose rather than using traditional algorithm like k-means and fast by paralyzing it using the Hadoop and map-reduce architecture. The PBA algorithm works by dividing the large data set into small blocks and clustering these smaller data blocks in parallel. The proposed algorithm inherits the bat algorithm features to cluster the data set. The proposed algorithm is validated on five benchmark data sets against particle swarm optimization with different number of nodes. Experimental results show that the PBA algorithm is giving competitive results as compared to the particle swarm optimization and also providing the significant speedup with increasing number of nodes.
KeywordsBat algorithm Parallel bat algorithm Map-reduce Hadoop
- 1.D. Che, M. Safran, and Z. Peng, “From big data to big data mining: challenges, issues, and opportunities,” in Database Systems for Advanced Applications, 2013.Google Scholar
- 4.A. Elsayed, H. M. Mokhtar, and O. Ismail, “Ontology based document clustering using mapreduce,” arXiv preprint arXiv:1505.02891, 2015.
- 5.L. D. Geronimo, F. Ferrucci, A. Murolo, and F. Sarro, “A parallel genetic algorithm based on hadoop mapreduce for the automatic generation of junit test suites,” in Software Testing, Verification and Validation (ICST), 2012 IEEE Fifth International Conference on, 2012.Google Scholar
- 7.Y. He, H. Tan, W. Luo, H. Mao, D. Ma, S. Feng, and J. Fan, “Mr-dbscan: an efficient parallel density-based clustering algorithm using mapreduce,” in Parallel and Distributed Systems (ICPADS), 2011 IEEE 17th International Conference on, 2011.Google Scholar
- 8.H.-G. Li, G.-Q. Wu, X.-G. Hu, J. Zhang, L. Li, and X. Wu, “K-means clustering with bagging and mapreduce,” in System Sciences (HICSS), 2011 44th Hawaii International Conference on, 2011.Google Scholar
- 9.A. W. McNabb, C. K. Monson, and K. D. Seppi, “Parallel pso using mapreduce,” in Evolutionary Computation, 2007. CEC 2007. IEEE Congress on, 2007.Google Scholar
- 10.A. Verma, X. Llorà, D. E. Goldberg, and R. H. Campbell, “Scaling genetic algorithms using mapreduce,” in Intelligent Systems Design and Applications, 2009. ISDA’09. Ninth International Conference on, 2009.Google Scholar