Skip to main content
SpringerLink
Log in

An efficient job management of computing service using integrated idle VM resources for high-performance computing based on OpenStack

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

In recent years, various studies on OpenStack-based high-performance computing have been conducted. OpenStack combines off-the-shelf physical computing devices and creates a resource pool of logical computing. The configuration of the logical computing resource pool provides computing infrastructure according to the user’s request and can be applied to the infrastructure as a service (laaS), which is a cloud computing service model. The OpenStack-based cloud computing can provide various computing services for users using a virtual machine (VM). However, intensive computing service requests from a large number of users during large-scale computing jobs may delay the job execution. Moreover, idle VM resources may occur and computing resources are wasted if users do not employ the cloud computing resources. To resolve the computing job delay and waste of computing resources, a variety of studies are required including computing task allocation, job scheduling, utilization of idle VM resource, and improvements in overall job’s execution speed according to the increase in computing service requests. Thus, this paper proposes an efficient job management of computing service (EJM-CS) by which idle VM resources are utilized in OpenStack and user’s computing services are processed in a distributed manner. EJM-CS logically integrates idle VM resources, which have different performances, for computing services. EJM-CS improves resource wastes by utilizing idle VM resources. EJM-CS takes multiple computing services rather than single computing service into consideration. EJM-CS determines the job execution order considering workloads and waiting time according to job priority of computing service requester and computing service type, thereby providing improved performance of overall job execution when computing service requests increase.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Liua J, Ahmeda E, Shiraza M, Gania A, Buyyab R, Qureshia A (2015) Application partitioning algorithms in mobile cloud computing: taxonomy, review and future directions. J Netw Comput Appl 48:99–117

    Article  Google Scholar 

  2. Madni SHH, Latiff MSA, Coulibaly Y, Abdulhamid SM (2016) Resource scheduling for infrastructure as a service (IaaS) in cloud computing: challenges and opportunities. J Netw Comput Appl 68:173–200

    Article  Google Scholar 

  3. Singh S, Chana I (2016) A survey on resource scheduling in cloud computing: issues and challenges. J Grid Comput 14(2):217–264

    Article  Google Scholar 

  4. Varrette S, Plugaru V, Guzek M, Besseron X, Bouvry P (2014) HPC performance and energy-efficiency of the openstack cloud middleware. In: 43rd International Conference on Parallel Processing Workshops, Minneapolis, MN, USA, pp 419–428

  5. Gangadharan GR (2017) Open source solutions for cloud computing. IEEE Comput 50(1):60–70

    Article  Google Scholar 

  6. Agrawal V, Kotia D, Moshirian K, Kim M (2018) Log-based cloud monitoring system for OpenStack. In: 2018 IEEE Fourth International Conference on Big Data Computing Service and Applications, Bamberg, Germany, pp 276–281

  7. Sefraoui O, Aissaoui M, Eleuldj M (2012) OpenStack: toward an Open-source solution for cloud computing. Int J Comput Appl 55(3):38–42

    Google Scholar 

  8. Corradi A, Fanelli M, Foschini L (2014) VM consolidation: a real case based on OpenStack cloud. Future Gener Comput Syst 32:118–127

    Article  Google Scholar 

  9. Mesbahi MR, Rahmani AM, Hosseinzadeh M (2018) Reliability and high availability in cloud computing environments: a reference roadmap. Hum Centric Comput Inf Sci 8(20):1–31

    Google Scholar 

  10. Xi S, Li C, Lu C, Gill CD, Xu M, Phan LTX, Lee I, Sokolsky O (2015) RT-OpenStack: CPU resource management for real-time cloud computing. In: 2015 IEEE 8th International Conference on Cloud Computing (IEEE CLOUD 2015), New York, USA, pp 1–10

  11. Yang G, Zhang W (2015) Research of resource allocation based on OpenStack. In: 2015 12th International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP), Chengdu, China, pp 400–403

  12. Lim J, Yu HC, Gil J-M (2018) An intelligent residual resource monitoring scheme in cloud computing environments. J Inf Process Syst 14(6):1480–1493

    Google Scholar 

  13. Bychkov I, Feoktistov A, Sidorov I, Kostromin R (2017) Job flow management for virtualized resources of heterogeneous distributed computing environment. Proc Eng 201:534–542

    Article  Google Scholar 

  14. Zhang P, Zhou M (2018) Dynamic cloud task scheduling based on a two-stage strategy. IEEE Trans Autom Sci Eng 15(2):772–783

    Article  Google Scholar 

  15. Madni SHH, Latiff MSA, Abdullahi M, Abdulhamid SM, Usman MJ (2017) Performance comparison of heuristic algorithms for task scheduling in IaaS cloud computing environment. PLOS ONE 12(5): 1–26

  16. Verma A, Kaushal S (2017) A hybrid multi-objective particle swarm optimization for scientific workflow scheduling. Parallel Comput 62:1–19

    Article  MathSciNet  Google Scholar 

  17. Han S-H, Kim H-W, Jeong Y-S (2016) Resource pooling mechanism for mobile cloud computing service. Lect Notes Electr Eng Adv Comput Sci Ubiquitous Comput 421:160–165

    Google Scholar 

  18. Moon Y, Yu HC, Gil J-M, Lim J (2017) A slave ants based ant colony optimization algorithm for task scheduling in cloud computing environments. Hum Centric Comput Inf Sci 7(28):1–10

    Google Scholar 

  19. Kimmerlin M, Hasselmeyer P, Heikkilä S, Plauth M, Parol P, Sarolahti P (2017) Network expansion in OpenStack cloud federations. In: 2017 European Conference on Networks and Communications, Oulu, Finland, pp 1–5

  20. He Y, Ni LM (2019) A novel scheme based on the diffusion to edge detection. IEEE Trans Image Process 28(4):1613–1624

    Article  MathSciNet  MATH  Google Scholar 

  21. Mendonca GSD, Guimaraes BCF, Alves PRO, Pereira FMQ, Pereira MM, Araujo G (2016) Automatic insertion of copy annotation in data-parallel programs. In: 2016 IEEE 28th International Symposium on Computer Architecture and High Performance Computing, Los Angeles, CA, USA, pp 34–41

Download references

Acknowledgements

This research was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (NRF-2017R1D1A1A09000631).

Author information

Authors and Affiliations

  1. Department of Multimedia Engineering, Dongguk University, Seoul, 04620, Republic of Korea

    Seok-Hyeon Han, Hyun-Woo Kim & Young-Sik Jeong

Authors
  1. Seok-Hyeon Han
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hyun-Woo Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Young-Sik Jeong
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Young-Sik Jeong.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Han, SH., Kim, HW. & Jeong, YS. An efficient job management of computing service using integrated idle VM resources for high-performance computing based on OpenStack. J Supercomput 75, 4388–4407 (2019). https://doi.org/10.1007/s11227-019-02769-x

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-019-02769-x

Keywords

Search

Navigation