Advertisement

Resource Provisioning Based Scheduling Framework for Execution of Heterogeneous and Clustered Workloads in Clouds: from Fundamental to Autonomic Offering

  • Sukhpal Singh Gill
  • Rajkumar Buyya
Article

Abstract

Provisioning of adequate resources to cloud workloads depends on the Quality of Service (QoS) requirements of these cloud workloads. Based on workload requirements (QoS) of cloud users, discovery and allocation of best workload-resource pair is an optimization problem. Acceptable QoS can be offered only if provisioning of resources is appropriately controlled. So, there is a need for a QoS-based resource provisioning framework for the autonomic scheduling of resources to observe the behavior of the services and adjust it dynamically in order to satisfy the QoS requirements. In this paper, framework for self-management of cloud resources for execution of clustered workloads named as SCOOTER is proposed that efficiently schedules the provisioned cloud resources and maintains the Service Level Agreement (SLA) by considering properties of self-management and the maximum possible QoS parameters are required to improve cloud based services. Finally, the performance of SCOOTER has been evaluated in a cloud environment that demonstrates the optimized QoS parameters such as execution cost, energy consumption, execution time, SLA violation rate, fault detection rate, intrusion detection rate, resource utilization, resource contention, throughput and waiting time.

Keywords

Cloud computing Cloud workloads Resource provisioning Resource scheduling Quality of service Autonomic computing Service level agreement Self-management Self-healing Self-configuring Self-optimizing Self-protecting Quality of service Resource management Autonomic cloud E-commerce as a cloud service 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Notes

Acknowledgements

One of the authors, Dr. Sukhpal Singh Gill [Post Doctorate Fellow], gratefully acknowledges the Cloud Computing and Distributed Systems (CLOUDS) Laboratory, School of Computing and Information Systems, The University of Melbourne, Australia, for awarding him the Fellowship to carry out this research work. We thank Adel Nadjaran Toosi and anonymous reviewers for their comments on improving the paper.

References

  1. 1.
    Varghese, B., Buyya, R.: Next generation cloud computing: New trends and research directions. Future Generation Comput. Syst. 79, 849–861 (2017).  https://doi.org/10.1016/j.future.2017.09.020CrossRefGoogle Scholar
  2. 2.
    Qi, Z.T.L., Cheng, Z., Li, K., Khan, S.U., Li, K.: An energy-efficient task scheduling algorithm in DVFS-enabled cloud environment. J. Grid Comput. 14(1), 55–74 (2016)CrossRefGoogle Scholar
  3. 3.
    de Carvalho, O.A. Jr, Adilson, O., Bruschi, S.M., Santana, R.H.C., Santana, M.J.: Green cloud meta-scheduling. J. Grid Comput. 14(1), 109–126 (2016)CrossRefGoogle Scholar
  4. 4.
    Jiang, J., Lin, Y., Xie, G., Fu, L., Yang, J.: Time and Energy Optimization Algorithms for the Static Scheduling of Multiple Workflows in Heterogeneous Computing System. J. Grid Comput., 1–22 (2017).  https://doi.org/10.1007/s10723-017-9391-5
  5. 5.
    Ebrahimirad, V., Goudarzi, M., Rajabi, A.: Energy-aware scheduling for precedence-constrained parallel virtual machines in virtualized data centers. J. Grid Comput. 13(2), 233–253 (2015)CrossRefGoogle Scholar
  6. 6.
    Singh, S., Chana, I.: Metrics based workload analysis technique for IaaS cloud. In: The Proceeding of International Conference on Next Generation Computing and Communication Technologies 23 - 24 April 2014, Dubai, pp. 1–6 (2014)Google Scholar
  7. 7.
    Chana, I., Singh, S.: Quality of service and service level agreements for cloud environments: Issues and challenges, cloud Computing-Challenges, limitations and R&D solutions, 51-72 springer international publishing (2014)Google Scholar
  8. 8.
    Singh, S., Chana, I.: Cloud resource provisioning: survey, Status and Future Research Directions. Knowl. Inf. Syst. 49(3), 1005–1069 (2016)CrossRefGoogle Scholar
  9. 9.
    Singh, S., Chana, I.: Q-aware: quality of service based cloud resource provisioning. Comput. Electr. Eng. 47, 138–160 (2015)CrossRefGoogle Scholar
  10. 10.
    Singh, S., Chana, I.: A survey on resource scheduling in cloud computing issues and challenges. J. Grid Comput. 14(2), 217–264 (2016)CrossRefGoogle Scholar
  11. 11.
    Singh, S., Chana, I.: QRSF Qos-aware resource scheduling framework in cloud computing. J. Supercomput. 71(1), 241–292 (2015)CrossRefGoogle Scholar
  12. 12.
    Singh, S., Chana, I.: Resource provisioning and scheduling in clouds: QoS perspective. J. Supercomput. 72(3), 926–960 (2016)CrossRefGoogle Scholar
  13. 13.
    Singh, S., Chana, I.: QoS-aware autonomic cloud computing for ICT. In: The proceeding of International Conference on Information and Communication Technology for Sustainable Development (ICT4SD - 2015), Ahmedabad, India, 3 - 4 July 2015, pp. 569–577. Springer, Singapore (2016)Google Scholar
  14. 14.
    Singh, S., Chana, I.: Qos-aware autonomic resource management in cloud computing: a systematic review. ACM Comput. Surv. 48(3), 1–46 (2015)CrossRefGoogle Scholar
  15. 15.
    Singh, S., Chana, I.: EARTH: energy-aware autonomic resource scheduling in cloud computing. J. Intell. Fuzzy Syst. 30(3), 1581–1600 (2016)CrossRefGoogle Scholar
  16. 16.
    Singh, S., Chana, I., Singh, M.: The journey of QoS-aware autonomic cloud computing. IEEE IT Professional 19(2), 42–49 (2017)CrossRefGoogle Scholar
  17. 17.
    Singh, S., Chana, I., Buyya, R.: STAR: SLA-aware autonomic management of cloud resources. In: IEEE Transactions on Cloud Computing, pp. 1–14 (2018).  https://doi.org/10.1109/TCC.2017.2648788
  18. 18.
    Sukhpal S.G., Chana, I., Singh, M., Buyya, R.: CHOPPER: an Intelligent QoS-aware autonomic resource management approach for cloud computing cluster computing, pp. 1–39 (2017).  https://doi.org/10.1007/s10586-017-1040-z/ Available Online: https://link.springer.com/article/10.1007/s10586-017-1040-z
  19. 19.
    Sukhpal S.G., Buyya, R., Chana, I., Singh, M., Abrahiam, A.: BULLET: particle swarm optimization based scheduling technique for provisioned cloud resources, Journal of Network and Management System, pp. 1–40. Springer, Berlin (2017).  https://doi.org/10.1007/s10922-017-9419-yGoogle Scholar
  20. 20.
    Singh, S., Chana, I., Singh, M., Rajkumar, B.: SOCCER self-optimization Of energy-efficient cloud resources. Clust. Comput. 19(4), 1787–1800 (2016)CrossRefGoogle Scholar
  21. 21.
    Kephart, J.O., Walsh, W.E.: An architectural blueprint for autonomic computing. Technical Report, IBM Corporation, 1-29, IBM. http://www-03.ibm.com/autonomic/pdfs/AC%20Blueprint%20White%20Paper%20V7.pdf (2003)
  22. 22.
    Quiroz, A., Kim, H., Parashar, M., Gnanasambandam, N., Sharma, N.: Towards autonomic workload provisioning for enterprise grids and clouds. In: 2009 10th IEEE/ACM International Conference on Grid Computing, pp. 50–57. IEEE (2009)Google Scholar
  23. 23.
    Vecchiola, C., Calheiros, R.N., Karunamoorthy, D., Buyya, R.: Deadline-driven provisioning of resources for scientific applications in hybrid clouds with Aneka. Futur. Gener. Comput. Syst. 28(1), 58–65 (2012)CrossRefGoogle Scholar
  24. 24.
    Herbst, N.R., Huber, N., Kounev, S., Amrehn, E.: Self-adaptive workload classification and forecasting for proactive resource provisioning. Concurrency Comput.: Pract. Exp. 26(12), 2053–2078 (2014)CrossRefGoogle Scholar
  25. 25.
    Qavami, H.R., Jamali, S., Akbari, M.K., Javadi, B.: Dynamic resource provisioning in cloud computing: a heuristic markovian approach. In: Cloud Computing, Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol. 133, pp. 102–111. Springer International Publishing (2014)Google Scholar
  26. 26.
    Varalakshmi, P., Ramaswamy, A., Balasubramanian, A., Vijaykumar, P.: An optimal workflow based scheduling and resource allocation in cloud. In: Advances in computing and communications, pp. 411–420. Springer, Berlin (2011)Google Scholar
  27. 27.
    Li, K., Gaochao, X., Zhao, G., Dong, Y., Wang, D.: Cloud task scheduling based on load balancing ant colony optimization. In: Sixth Annual Chinagrid Conference (ChinaGrid), pp. 3–9. IEEE (2011)Google Scholar
  28. 28.
    Topcuoglu, H., Hariri, S., Wu, M.-Y.: Task scheduling algorithms for heterogeneous processors. In: Proceedings of the Eighth Heterogeneous Computing Workshop (HCW’99), pp. 3–14. IEEE (1999)Google Scholar
  29. 29.
    Pandey, S., Wu, L., Guru, S., Buyya R: A particle swarm optimization-based heuristic for scheduling workflow applications in cloud computing environments. In: 24th IEEE International Conference on Advanced Information Networking and Applications (AINA), Perth, Australia (2010)Google Scholar
  30. 30.
    Cardellini, V., Casalicchio, E., Presti, F.L., Silvestri, L.: SLA-aware resource management for application service providers in the cloud. In: First International Symposium on Network Cloud Computing and Applications (NCCA), pp. 20–27. IEEE (2011)Google Scholar
  31. 31.
    Wu, L., Garg, S.K., Buyya, R.: SLA-based resource allocation for software as a service provider (SaaS) in cloud computing environments. In: 2011 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid), pp. 195–204. IEEE (2011)Google Scholar
  32. 32.
    Maurer, M., Brandic, I., Sakellariou, R.: Adaptive resource configuration for cloud infrastructure management. Futur. Gener. Comput. Syst. 29(2), 472–487 (2013)CrossRefGoogle Scholar
  33. 33.
    Konstantinou, I., Kantere, V., Tsoumakos, D., Koziris, N.: COCCUS: self-configured cost-based query services in the cloud. In: Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data, pp. 1041–1044. ACM (2013)Google Scholar
  34. 34.
    Mao, M., Li, J., Humphrey, M.: Cloud auto-scaling with deadline and budget constraints. In: 2010 11th IEEE/ACM International Conference on In Grid Computing (GRID), pp. 41–48. IEEE (2010)Google Scholar
  35. 35.
    Sah, S.K., Joshi, S.R.: Scalability of efficient and dynamic workload distribution in autonomic cloud computing. In: International Conference on Issues and Challenges in Intelligent Computing Techniques (ICICT), pp. 12–18. IEEE (2014)Google Scholar
  36. 36.
    Sheikhalishahi, M., Grandinetti, L., Wallace, R.M., Vazquez-Poletti, J.L.: Autonomic resource contention-aware scheduling. Softw.: Pract. Exp. 45(2), 161–175 (2015)Google Scholar
  37. 37.
    Yuan, E., Malek, S., Schmerl, B., Garlan, D., Gennari, J.: Architecture-based self-protecting software systems. In: Proceedings of the 9th International ACM Sigsoft Conference on Quality of Software Architectures, pp. 33–42. ACM (2013)Google Scholar
  38. 38.
    Chopra, I., Singh, M.: SHAPE—An approach for self-healing and self-protection in complex distributed networks. J. Supercomput. 67(2), 585–613 (2014)CrossRefGoogle Scholar
  39. 39.
    Caswell, B., Beale, J.: Snort 2.1 intrusion detection, Syngress (2004)Google Scholar
  40. 40.
    Boser, B.E., Guyon, I.M., Vapnik, V.N.: A training algorithm for optimal margin classifiers. In: Proceedings of the Fifth Annual Workshop on Computational Learning Theory, pp. 144–152. ACM (1992)Google Scholar
  41. 41.
    Kadav, A., Renzelmann, M.J., Swift, M.M.: Tolerating hardware device failures in software. In: Proceedings of the ACM SIGOPS 22nd Symposium on Operating Systems Principles, pp. 59–72. ACM (2009)Google Scholar
  42. 42.
    Calheiros, R.N., Ranjan, R., Beloglazov, A., De Rose, C.A.F., Buyya, R.: Cloudsim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Softw.: Pract. Exp. 41(1), 23–50 (2011)Google Scholar
  43. 43.
    Talib, A.M., Alomary, F.O.: Cloud computing based E-Commerce as a service model: impacts and recommendations. In: Proceedings of the International Conference on Internet of Things and Cloud Computing, p 27. ACM (2016)Google Scholar
  44. 44.
    Prasad, C.S.D., Rao, S.R.S.: Competition in the indian E-Commerce sector durga prasad the case of flipkart. Gavesana J. Manag. 7(2), 1–22 (2015)Google Scholar
  45. 45.
    Chauhan, P.: A Comparative study on consumer Preferences towards online retail marketers-with special reference to Flipkart, Jabong, Amazon, Snapdeal Myntra and fashion and you. IJAR 1(10), 1021–1026 (2015)Google Scholar
  46. 46.
    Sebastian, M., Jercinovic, S., Cosmina, T., Simonacarmen, D., Cosmin, S.: A study regarding online traffic analytics of websites for profit. Agricultural Management/Lucrari Stiintifice Seria I. Manag. Agricol 19(1), 81–84 (2017)Google Scholar
  47. 47.
    Luo, J., Liang, Y., Gao, W., Yang, J.: Hadoop based deep packet inspection system for traffic analysis of e-business websites. In: International Conference on Data Science and Advanced Analytics (DSAA), pp. 361–366. IEEE (2014)Google Scholar
  48. 48.
    Arora, N., Zhang, H., Rhee, J., Yoshihira, K., iProbe, G.J.: A lightweight user-level dynamic instrumentation tool. In: Proceedings of the 28th IEEE/ACM International Conference on Automated Software Engineering, pp. 742–745. IEEE Press (2013)Google Scholar
  49. 49.
    Sukhpal S.G., Buyya, R.: A taxonomy and future directions for sustainable cloud computing: 360 degree view. http://www.buyya.com/papers/SustainableClouds360.pdf
  50. 50.
    Exposito, J.A., Ametller, J., Robles, S.: Configuring the JADE HTTP MTP. http://jade.tilab.com/documentation/tutorials-guides/configuring-the-jade-http-mtp/ (2010)

Copyright information

© Springer Science+Business Media B.V., part of Springer Nature 2018

Authors and Affiliations

  1. 1.Cloud Computing and Distributed Systems (CLOUDS) Laboratory, School of Computing and Information SystemsThe University of MelbourneMelbourneAustralia

Personalised recommendations