Abstract
The high-performance computing environment is a computing platform, which aggregates multiple distributed high-performance computers from indifferent organizations, providing users with unified access and usage patterns. Since the task scheduling strategy is lack of flexibility, an optimized task scheduling model in the high-performance computing environment is proposed in this paper, which introduces an improved swarm intelligence algorithm in task queues, refines the Core Scheduler for each task, and increases the configuration of task scheduling strategy. In core task scheduling, swarm intelligence algorithm is adopted to minimize the average scheduling time for completion tasks through optimal task allocation on each node. Simulation results show that the proposed scheduling algorithm is better than the traditional task scheduling algorithm. Therefore, according to the task scheduling strategy based on swarm intelligence algorithm, it can effectively reduce the task waiting, improve the system’s throughput, the task response and system resource utilization has a better effect.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Armbrust M, Fox A, Uriffith R et al (2010) A view of cloud computing. Commun ACM 53(4):50–58
Buyya R, Giddy J, Abramson D (2000) An evaluation of economy based resource trading and scheduling on computational power Grids for parameter sweep applications, in: Proceedings of the Second International Workshop on Active Middleware Services, Kluwer Academic Press, Pittsburgh, USA, 2000
Buyya R, Yeo S, Venugopal S et al (2009) Cloud computing and emerging IT platforms; vision, hype, and reality for delivering computing as the 5th utility. Future Vener Comput Syst 25(6):599–616
Casanova H, Dongarra J (1997) NetSolve: a network-enabled server for solving computational science problems. Int J Supercomput Appl High Perform Comput 11(3):212–223
Casanova H, Kim M, Plank JS, Dongarra JJ (1999) Adaptive scheduling for task farming with Grid middleware. Int J High Perform Comput Appl. 13(3):231–240
Casanova H, Legrand A, Zagorodnov D, Berman F (2000) Heuristics for scheduling parameter sweep applications in Grid environments. In: Heterogeneous Computing Workshop 2000, IEEE Computer Society Press, 2000, pp 349–363
Chai XQ, Dong Y-L (2016) Efficient k-clique mining algorithm in large-scale networks. Comput Sci 43(5):265–268
Chai X-Q, Dong Y-L, Li J-F (2016a) Profit-oriented task scheduling algorithm in Hadoop cluster. EURASIP J Embed Syst 2016:6. https://doi.org/10.1186/s13639-016-0026-x
Chai X, Dong Y, Li F (2016b) An algorithm for improved similarity and collaborative filtering in social networks. IJSSST (Int J Simul Syst Sci Technol) 17(22):12.1–12.6
Chapin SJ, Katramatos D, Karpovich J, Grimshaw A (1999) Resource management in Legion. Future Gener Comput. Syst 15(5/6):583–594
Chen M, Huanu L, Li X (2014) Disk migration timing optimization mechanism in cloud computing. Computer Eng Des 35(2):520–530
Dean J, Uhemawat S (2012) Map-reduce; simplified data processing on large clusters. Commun AC’M 51(1):107–113
Ji K (2016) Cloud computing resource scheduling optimization based on ant colony algorithm with dynamic trend prediction. Bull Sci Technol 32(1):187–190
Lee YC, Wang C, Zomaya AY, Zhou BB (2010) Profitdriven service request scheduling in clouds. In: Cluster, Cloud and Grid Computing (CCGRID), pp 15–24
Mell P, Urance T (2010) The NIST definition of cloud computing. Commun ACM 53(6):50–57
Pinheiro E, Bianchini R, Carrera EV, Heath T (2001) Load balancing and unbalancing for power and performance in cluster-based systems. In: Proceedings of the Workshop on Compilers and Operating Systems for Low Power, 2001, pp 182-195
Wei Y, Chen Y (2015) Cloud computing task scheduling model based on improved antcolony algorithm. Computer Engineering 41(2):12–16
Zha Y, Yanu J (2013) Task scheduling in cloud computing based on improved ant colony optimization. Comput Eng Des 34(5):1716–1719
Zhanu C, Liu Q, Menu K (2012) Task allocation based on ant colony optimization in cloud computing. J Comput Appl 32(5):1418–1420
Zhong S, Fu Q, Xia K et al (2020) Online model-learning algorithm from samples and trajectories J Ambient Intell Human Comput 11(2):527–537
Acknowledgements
This work was supported in part by the National Natural Science Foundation of China (Grant No. U1804164,No. 31872199, No.U1404602), Key project of science and technology of Henan provincial science and Technology Department (Grant No. 192102310020, No. 182102210363, No. 172102210332.), Science and Technology Research Key Project of Education Department of Henan Province (Grant No. 17A520009), the Research project on curriculum reform of Teacher Education in Henan Province (Grant No. 2018-JSJYYB-020), the Henan Provincial Federation of Social Sciences (Grant No. SKL-2016-1992, No. SKL-2018-771), Doctoral research start-up fees supported by Henan Normal University (Grant No. qd16120), the Education Science Research Fund of Henan Normal University (Grant No. 2018JK10), the High Performance Computing Centre of Henan Normal University, and the Supercomputing Center of University of Science and Technology of China.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Chai, X. Task scheduling based on swarm intelligence algorithms in high performance computing environment. J Ambient Intell Human Comput 14, 14807–14815 (2023). https://doi.org/10.1007/s12652-020-01994-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12652-020-01994-0