Journal of Central South University

, Volume 24, Issue 5, pp 1050–1062 | Cite as

Multi-objective workflow scheduling in cloud system based on cooperative multi-swarm optimization algorithm

  • Guang-shun Yao (姚光顺)
  • Yong-sheng Ding (丁永生)
  • Kuang-rong Hao (郝矿荣)
Article
  • 72 Downloads

Abstract

In order to improve the performance of multi-objective workflow scheduling in cloud system, a multi-swarm multiobjective optimization algorithm (MSMOOA) is proposed to satisfy multiple conflicting objectives. Inspired by division of the same species into multiple swarms for different objectives and information sharing among these swarms in nature, each physical machine in the data center is considered a swarm and employs improved multi-objective particle swarm optimization to find out non-dominated solutions with one objective in MSMOOA. The particles in each swarm are divided into two classes and adopt different strategies to evolve cooperatively. One class of particles can communicate with several swarms simultaneously to promote the information sharing among swarms and the other class of particles can only exchange information with the particles located in the same swarm. Furthermore, in order to avoid the influence by the elastic available resources, a manager server is adopted in the cloud data center to collect the available resources for scheduling. The quality of the proposed method with other related approaches is evaluated by using hybrid and parallel workflow applications. The experiment results highlight the better performance of the MSMOOA than that of compared algorithms.

Key words

multi-objective workflow scheduling multi-swarm optimization particle swarm optimization (PSO) cloud computing system 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. [1]
    YU J, BUYYA R. Scheduling scientific workflow applications with deadline and budget constraints using genetic algorithms [J]. Scientific Programming, 2006, 14(3): 217–230.CrossRefGoogle Scholar
  2. [2]
    VISWANATHAN S, VEERAVALLI B, ROBERTAZZI T G. Resource-aware distributed scheduling strategies for large-scale computational cluster/grid systems [J]. IEEE Transactions on Parallel and Distributed Systems, 2007, 18(10): 1450–1461.CrossRefGoogle Scholar
  3. [3]
    DEELMAN E, VAHI K, JUVE G, RYNGE M, CALLAGHAN S, MAECHLING P, MAYANI R, CHEN W, SILVA R F, LIVNY M, WENGER K. PEGASUS, a workflow management system for science automation [J]. Future Generation Computer Systems, 2015, 46: 17–35.CrossRefGoogle Scholar
  4. [4]
    PINEDO M L. Scheduling: Theory, algorithms, and systems [M]. New York: Springer, 2012.CrossRefMATHGoogle Scholar
  5. [5]
    TOPCUOGLU H, HARIRI S, WU M. Performance-effective and low-complexity task scheduling for heterogeneous computing [J]. IEEE Transactions on Parallel and Distributed Systems, 2002, 13(3): 260–274.CrossRefGoogle Scholar
  6. [6]
    BRAUN T D, SIEGEL H J, BECK N, BÖLÖNI L L, MAHESWARAN M, REUTHER A I, ROBERTSON J P, THEYS M D, YAO B, HENSGEN D FRUND R F. A comparison of eleven static heuristics for mapping a class of independent tasks onto heterogeneous distributed computing systems [J]. Journal of Parallel and Distributed computing, 2001, 61(6): 810–837.CrossRefMATHGoogle Scholar
  7. [7]
    CAO Jun-wei, HWANG K, LI Ke-qin, ZOMAYA A Y. Optimal multiserver configuration for profit maximization in cloud computing [J]. IEEE Transactions on Parallel and Distributed Systems, 2013, 24(6): 1087–1096.CrossRefGoogle Scholar
  8. [8]
    TSAI C, HUANG Wei-cheng, CHIANG M H, CHIANG M C, YANG Chu-sing. A hyper-heuristic scheduling algorithm for cloud [J]. IEEE Transactions on Cloud Computing, 2014, 2(2): 236–250CrossRefGoogle Scholar
  9. [9]
    LUO Jiang-ying, RAO Lei, LIU Xue. Temporal load balancing with service delay guarantees for data center energy cost optimization [J]. IEEE Transactions on Parallel and Distributed Systems, 2014, 25(3): 775–784.CrossRefGoogle Scholar
  10. [10]
    BUYYA R, YEO C S, VENUGOPAL S, BROBERG J, BRANDIC L. Cloud computing and emerging IT platforms: Vision, hype, and reality for delivering computing as the 5th utility [J]. Future Generation Computer Systems, 2009, 25(6): 599–616.CrossRefGoogle Scholar
  11. [11]
    FU Zhang-jie, REN Kui, SHU Jian-gang, SUN Xing-ming, HUANG Feng-xiao. Enabling personalized search over encrypted outsourced data with efficiency improvement [J]. IEEE Transactions on Parallel and Distributed Systems, 2016, 27(9): 2546–2559.CrossRefGoogle Scholar
  12. [12]
    XIA Zhi-hua, WANG Xin-hui, SUN Xing-ming, WANG Qian. A secure and dynamic multi-keyword ranked search scheme over encrypted cloud data [J]. IEEE Transactions on Parallel and Distributed Systems, 2015, 27(3): 340–352.Google Scholar
  13. [13]
    FU Zhang-jie, SUN Xing-ming, LIU Qi, ZHOU Lu, SHU Jian-gang. Achieving efficient cloud search services: Multi-keyword ranked search over encrypted cloud data supporting parallel computing [J]. IEICE Transactions on Communications, 2015, E98-B(1): 190–200.Google Scholar
  14. [14]
    REN Yong-jun, SHEN Jian, WANG Jin, HAN Jin, LEE S Y. Mutual verifiable provable data auditing in public cloud storage [J] Journal of Internet Technology, 2015, 16(2): 317–323.Google Scholar
  15. [15]
    GARG S K, BUYYA R, SIEGEL H J. Scheduling parallel applications on utility grids: Time and cost trade-off management [C]// The Thirty-Second Australasian Conference on Computer Science. Australian: Australian Computer Society Inc., 2009: 151–160.Google Scholar
  16. [16]
    TENG S, HAY L L, PENG C E. Multi-objective ordinal optimization for simulation optimization problems [J]. Automatica, 2007, 43(11): 1884–1895.MathSciNetCrossRefMATHGoogle Scholar
  17. [17]
    ZHAN Fan, CAO Jun-wei, LI Ke-qin, KHAN S U, HWANG K. Multi-objective scheduling of many tasks in cloud platforms [J]. Future Generation Computer Systems, 2014, 37: 309–320.CrossRefGoogle Scholar
  18. [18]
    TAO Fei, FENG Ying, ZHANG Lin, LIAO T W. CLPS-GA: A case library and Pareto solution-based hybrid genetic algorithm for energy-aware cloud service scheduling [J]. Applied Soft Computing, 2014, 19: 264–279.CrossRefGoogle Scholar
  19. [19]
    DURILLO J J, NAE V, PRODAN R. Multi-objective energy-efficient workflow scheduling using list-based heuristics [J]. Future Generation Computer Systems, 2014, 36: 221–236.CrossRefGoogle Scholar
  20. [20]
    DURILLO J J, PRODAN R. Multi-objective workflow scheduling in Amazon EC2 [J]. Cluster Computing, 2014, 17(2): 169–189.CrossRefGoogle Scholar
  21. [21]
    FARD H M, PRODAN R, FAHRINGER T. Multi-objective list scheduling of workflow applications in distributed computing infrastructures [J]. Journal of Parallel and Distributed Computing, 2014, 74(3): 2152–2165.CrossRefMATHGoogle Scholar
  22. [22]
    YASSA S, CHELOUAH R, KADIMA H, GRANADO B. Multi-objective approach for energy-aware workflow scheduling in cloud computing environments [J]. The Scientific World Journal, 2013, doi: 10.1155/2013/350934.Google Scholar
  23. [23]
    CHENG Ji-xiang, ZHANG Ge-xiang, LI Zhi-dan, LI Yuan-quan. Multi-objective ant colony optimization based on decomposition for bi-objective traveling salesman problems[J]. Soft Computing, 2012, 16(4): 597–614.CrossRefMATHGoogle Scholar
  24. [24]
    GÓMEZ J, GIL C, BAÑOS R, MÁRQUEZ A L, MONTOYA F G, MONTOYA M G. A Pareto-based multi-objective evolutionary algorithm for automatic rule generation in network intrusion detection systems [J]. Soft Computing, 2013, 17(2): 255–263.CrossRefGoogle Scholar
  25. [25]
    KENNEDY J, EBERHART R C. Particle swarm optimization [C]// The 1995 IEEE International Conference on Neural Network. Perth: IEEE, 1995: 1942–1948.Google Scholar
  26. [26]
    COELLO C C A. Evolutionary multi-objective optimization: A historical view of the field [J]. IEEE Computational Intelligence Magazine, 2006, 1(1): 28–36.CrossRefGoogle Scholar
  27. [27]
    GAO Lei, HAILU A. Comprehensive learning particle swarm optimizer for constrained mixed-variable optimization problems [J]. International Journal of Computational Intelligence Systems, 2010, 3(6): 832–842.CrossRefGoogle Scholar
  28. [28]
    HU Yi-fan, DING Yong-sheng, HAO Kuang-rong, REN Li-hong, HAN Hua. An immune orthogonal learning particle swarm optimization algorithm for routing recovery of wireless sensor networks with mobile sink [J]. International Journal of Systems Science, 2014, 45(3): 337–350.CrossRefMATHGoogle Scholar
  29. [29]
    HU Yi-fan, DING Yong-sheng, REN Li-hong, HAO Kuang-rong, HAN Hua. An endocrine cooperative particle swarm optimization algorithm for routing recovery of wireless sensor networks with multiple mobile sinks [J]. Information Sciences, 2015, 300: 100–113.CrossRefGoogle Scholar
  30. [30]
    COELLO C A C, PULIDO G T, LECHUGA M S. Handling multiple objectives with particle swarm optimization [J]. IEEE Transactions on Evolutionary Computation, 2004, 8(3): 256–279.CrossRefGoogle Scholar
  31. [31]
    LIU Da-sheng, TAN K C, GOH C K, HO W K. A multiobjective memetic algorithm based on particle swarm optimization [J]. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 2007, 37(1): 42–50.CrossRefGoogle Scholar
  32. [32]
    GAO Hong-yuan, CAO Jin-long. Non-dominated sorting quantum particle swarm optimization and its application in cognitive radio spectrum allocation [J]. Journal of Central South University, 2013, 20(7): 1878–1888.CrossRefGoogle Scholar
  33. [33]
    YEN G G, DANESHYARI M. Diversity-based information exchange among multiple swarms in particle swarm optimization [J]. International Journal of Computational Intelligence and Applications, 2008, 7(1): 57–75.CrossRefMATHGoogle Scholar
  34. [34]
    PARSOPOULOS K E, TASOULIS D K, VRAHATIS M N. Multiobjective optimization using parallel vector evaluated particle swarm optimization [C]// The IASTED International Conference on Artificial Intelligence and Applications. America: IEEE, 2004, 2: 823–828.Google Scholar
  35. [35]
    DEB K, PRATAP A, AGARWAL S, MEYARIVAN T. A fast and elitist multiobjective genetic algorithm: NSGA-II [J]. IEEE Transactions on Evolutionary Computation, 2002, 6(2): 182–197.CrossRefGoogle Scholar
  36. [36]
    JUVE G, CHERVENAK A, DEELMAN E, BHARATHI S, MEHTA G, VAHI K. Characterizing and profiling scientific workflows [J]. Future Generation Computer Systems, 2013, 29(3): 682–692.CrossRefGoogle Scholar
  37. [37]
    CHEN Wei-wei, DEELMAN E. Workflowsim: A toolkit for simulating scientific workflows in distributed environments [C]// IEEE 8th International Conference on E-Science (e-Science). Chicago: IEEE, 2012: 1–8.Google Scholar
  38. [38]
    BROOKS D M, BOSE P, SCHUSTER S E, JACOBSON H, KUDVA P N, BUYUKTOSUNOGLU A, WELLMAN J, ZUUBAN V, GUPTA M, COOK P W. Power-aware microarchitecture: Design and modeling challenges for next-generation microprocessors [J]. IEEE Micro, 2000, 20(6): 26–44.CrossRefGoogle Scholar
  39. [39]
    ZITZLER E, THIELE L, LAUMANNS M, FONSECA C M, FONSECA V G. Performance assessment of multiobjective optimizers: An analysis and review [J]. IEEE Transactions on Evolutionary Computation, 2003, 7(2): 117–132.CrossRefGoogle Scholar

Copyright information

© Central South University Press and Springer-Verlag GmbH Germany 2017

Authors and Affiliations

  • Guang-shun Yao (姚光顺)
    • 1
    • 2
  • Yong-sheng Ding (丁永生)
    • 1
  • Kuang-rong Hao (郝矿荣)
    • 1
  1. 1.Engineering Research Center of Digitized Textile & Fashion Technology of Ministry of Education, College of Information Sciences and TechnologyDonghua UniversityShanghaiChina
  2. 2.College of Computer and Information EngineeringChuzhou UniversityChuzhouChina

Personalised recommendations