Advertisement

Parallel Bat Algorithm-Based Clustering Using MapReduce

  • Tripathi AshishEmail author
  • Sharma Kapil
  • Bala Manju
Conference paper
Part of the Lecture Notes on Data Engineering and Communications Technologies book series (LNDECT, volume 4)

Abstract

As we are going through the era of big data where the size of the data is increasing very rapidly resulting into the failure of traditional clustering methods on such a massive data sets. If the size of data exceeds the storage capacity or memory of the system, the task of clustering will become more complex and time intensive. To overcome this problem, this paper proposes a fast and efficient parallel bat algorithm (PBA) for the data clustering using the map-reduce architecture. Efficient using the evolutionary approach for clustering purpose rather than using traditional algorithm like k-means and fast by paralyzing it using the Hadoop and map-reduce architecture. The PBA algorithm works by dividing the large data set into small blocks and clustering these smaller data blocks in parallel. The proposed algorithm inherits the bat algorithm features to cluster the data set. The proposed algorithm is validated on five benchmark data sets against particle swarm optimization with different number of nodes. Experimental results show that the PBA algorithm is giving competitive results as compared to the particle swarm optimization and also providing the significant speedup with increasing number of nodes.

Keywords

Bat algorithm Parallel bat algorithm Map-reduce Hadoop 

References

  1. 1.
    D. Che, M. Safran, and Z. Peng, “From big data to big data mining: challenges, issues, and opportunities,” in Database Systems for Advanced Applications, 2013.Google Scholar
  2. 2.
    X. Cui, P. Zhu, X. Yang, K. Li, and C. Ji, “Optimized big data k-means clustering using mapreduce,” The Journal of Supercomputing, vol. 70, pp. 1249–1259, 2014.CrossRefGoogle Scholar
  3. 3.
    J. Dean and S. Ghemawat, “Mapreduce: simplified data processing on large clusters,” Communications of the ACM, vol. 51, pp. 107–113, 2008.CrossRefGoogle Scholar
  4. 4.
    A. Elsayed, H. M. Mokhtar, and O. Ismail, “Ontology based document clustering using mapreduce,” arXiv preprint arXiv:1505.02891, 2015.
  5. 5.
    L. D. Geronimo, F. Ferrucci, A. Murolo, and F. Sarro, “A parallel genetic algorithm based on hadoop mapreduce for the automatic generation of junit test suites,” in Software Testing, Verification and Validation (ICST), 2012 IEEE Fifth International Conference on, 2012.Google Scholar
  6. 6.
    Y.-J. Gong, W.-N. Chen, Z.-H. Zhan, J. Zhang, Y. Li, Q. Zhang, and J.-J. Li, “Distributed evolutionary algorithms and their models: A survey of the state-of-the-art” Applied Soft Computing, vol. 34, pp. 286–300, 2015.CrossRefGoogle Scholar
  7. 7.
    Y. He, H. Tan, W. Luo, H. Mao, D. Ma, S. Feng, and J. Fan, “Mr-dbscan: an efficient parallel density-based clustering algorithm using mapreduce,” in Parallel and Distributed Systems (ICPADS), 2011 IEEE 17th International Conference on, 2011.Google Scholar
  8. 8.
    H.-G. Li, G.-Q. Wu, X.-G. Hu, J. Zhang, L. Li, and X. Wu, “K-means clustering with bagging and mapreduce,” in System Sciences (HICSS), 2011 44th Hawaii International Conference on, 2011.Google Scholar
  9. 9.
    A. W. McNabb, C. K. Monson, and K. D. Seppi, “Parallel pso using mapreduce,” in Evolutionary Computation, 2007. CEC 2007. IEEE Congress on, 2007.Google Scholar
  10. 10.
    A. Verma, X. Llorà, D. E. Goldberg, and R. H. Campbell, “Scaling genetic algorithms using mapreduce,” in Intelligent Systems Design and Applications, 2009. ISDA’09. Ninth International Conference on, 2009.Google Scholar
  11. 11.
    Y. Xu and T. You, “Minimizing thermal residual stresses in ceramic matrix composites by using iterative mapreduce guided particle swarm optimization algorithm,” Composite Structures, vol. 99, pp. 388–396, 2013.CrossRefGoogle Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2018

Authors and Affiliations

  1. 1.Jaypee Institute of Information Technology Noida, Delhi Technological University Delhi, IP College of Women DelhiNew DelhiIndia

Personalised recommendations