Advertisement

Cluster Computing

, Volume 22, Supplement 4, pp 8965–8973 | Cite as

Configuration optimization method of Hadoop system performance based on genetic simulated annealing algorithm

  • Xiaoling LuoEmail author
  • Xueliang Fu
Article
  • 109 Downloads

Abstract

The configuration optimization method of Hadoop system performance based on genetic simulated annealing algorithm is studied. In view of the performance of Hadoop on open source cloud computing platform, an optimization method is proposed. Based on the genetic simulated annealing algorithm, each configuration scheme is used as a chromosome for multiple selection, crossover and mutation. Combined with the principle of simulated annealing, the survival of the new chromosome and the number of iterations of the whole algorithm are controlled, and the optimal scheme of the system configuration is found. The experimental results show that the method can effectively improve the operation efficiency of the operation. In addition, the overall effect of the group is very good at the end of the iteration. When the job types in the system are similar, according to the characteristics that the whole simulated annealing algorithm is approaching the optimal solution, a real-time optimization configuration model is proposed on the basic of genetic simulated annealing algorithm.

Keywords

Genetic simulated annealing algorithm Hadoop System performance Configuration optimization 

Notes

Acknowledgements

This research was financially supported by Chinese Natural Science Foundations (61363016, 61063004), Key Project of Inner Mongolia Advanced Science Research (NJZZ14100), Inner Mongolia Colleges and Universities Education Department Science Research (NJZC059), Natural Science Foundation of Inner Mongolia Autonomous Region of China (No. 2015MS0605, No. 2015MS0626 and No. 2015MS0627) and Ministry of Education Scientific research foundation for Study abroad personel [2014] 1685.

References

  1. 1.
    Daneshmand, S.V., Heydari, H.: A diversified multiobjective simulated annealing and genetic algorithm for optimizing a three-phase hts transformer. IEEE Trans. Appl. Supercond. 26(2), 1–10 (2016)CrossRefGoogle Scholar
  2. 2.
    Garces, G.A., Rakotondranaivo, A., Bonjour, E.: Improving users’ product acceptability: an approach based on bayesian networks and a simulated annealing algorithm. Int. J. Prod. Res. 54(17), 1–18 (2016)Google Scholar
  3. 3.
    Jiang, C., Yang, G., Zhu, P., Nishioka, M., Yokoyama, T., Zhou, C., et al.: Reconstruction of the vertical electron density profile based on vertical tec using the simulated annealing algorithm. Adv. Space Res. 57(10), 2167–2176 (2016)CrossRefGoogle Scholar
  4. 4.
    Raghu, T.S., Rajendran, C.: Due-date setting methodologies based on simulated annealingâ an experimental study in a real-life job shop. Int. J. Prod. Res. 33(9), 2535–2554 (2016)CrossRefGoogle Scholar
  5. 5.
    Wei, W., Liu, A., Lu, C.Y., Wuest, T.: Product requirement modeling and optimization method based on product configuration design. Procedia Cirp 36(45), 1–5 (2015)CrossRefGoogle Scholar
  6. 6.
    Yiu, K.F.C., Tam, K.Y., Tsang, S.C.: Crystal indexing method using a simulated annealing algorithm with particular applications in nanocrystal research. J. Comput. Chem. 18(2), 290–299 (2015)CrossRefGoogle Scholar
  7. 7.
    Daud, S., Chaudary, K.T., Bahadoran, M., Ali, J.: Z-transform method for optimization of add-drop configuration system. Jurnal Teknologi 74(8), 101–105 (2015)CrossRefGoogle Scholar
  8. 8.
    Dauzère-Pérès, S., Paulli, J.: An integrated approach for modeling and solving the general multiprocessor job-shop scheduling problem using tabu search. Ann. Oper. Res. 70(1), 281–306 (2016)MathSciNetzbMATHGoogle Scholar
  9. 9.
    Dowling, D., Krishnamoorthy, M., Mackenzie, H., Sier, D.: Staff rostering at a large international airport. Ann. Oper. Res. 72(72), 125–147 (2016)zbMATHGoogle Scholar
  10. 10.
    Mirjalili, S.: How effective is the grey wolf optimizer in training multi-layer perceptrons. Appl. Intell. 43(1), 150–161 (2015)CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Inner Mongolia Agricultural UniversityHohhotChina

Personalised recommendations