Skip to main content
Log in

A Market-based Framework for Resource Management in Cloud Federation

  • Published:
Journal of Grid Computing Aims and scope Submit manuscript

Abstract

A federated cloud is a form of the inter-cloud environment in which cloud service providers cooperate for better scalability and service provisioning. By communicating with other cloud providers and sharing resources, federated members gain more advantages from utilizing a comprehensive resource management system. There are different setups for federated clouds, in terms of federation formation and member interactions. Consequently, difficulties arise since resource management must be dealt with as a general entity. The current paper introduces a generic resource management framework for inter-federation resource management that can be used for a wide range of cloud federation models. By considering the federated cloud as a market for trading resources, the present study proposes a market-based framework to manage the various types of federated clouds. The main components of the proposed framework are based on market management models. This generic framework is able to cover a variety of centralized cloud federation models that divide the federated cloud life cycle into time slots. Finally, the present work introduces a resource management model which is compatible with the proposed framework. The model is implemented with Java and NetBeans IDE 8.2 and evaluated using the FederatedCloudSim 2.0 toolkit. The results are discussed in order to evaluate the proposed framework and the selected market algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

Data Availability

The Grid Workloads Archive data supporting this experiment’s analysis is from the website (http://gwa.ewi.tudelft.nl/fileadmin/pds/trace-archives/grid-workloads-archive/datasets/gwa-t-12/fastStorage.zip). Section ?? discusses the data in detail.

References

  1. The grid workloads archive. http://gwa.ewi.tudelft.nl/datasets/

  2. Amazon ec2: https://aws.amazon.com/ec2/pricing/on-demand/. Last Accessed 12 Mar 2021 (2021)

  3. Assis, M.R.M., Bittencourt, L.F.: MultiCloud Tournament: A cloud federation approach to prevent Free-Riders by encouraging resource sharing. J. Netw. Comput. Appl. 166. https://doi.org/10.1016/j.jnca.2020.102694. https://www.sciencedirect.com/science/article/pii/S1084804520301685 (2020)

  4. Buyya, R., Ranjan, R., Calheiros, R.N.: Intercloud: Utility-oriented federation of cloud computing environments for scaling of application services. In: International Conference on Algorithms and Architectures for Parallel Processing, pp 13–31. Springer (2010)

  5. Di, S., Kondo, D., Cirne, W.: Google hostload prediction based on Bayesian model with optimized feature combination. J. Parallel Distrib. Comput. 74(1), 1820–1832 (2014)

    Article  Google Scholar 

  6. Gomes, E.R., Vo, Q.B., Kowalczyk, R.: Pure exchange markets for resource sharing in federated clouds. Concurr. Comput. Pract. Experience 24(9), 977–991 (2012)

    Article  Google Scholar 

  7. Guazzone, M., Anglano, C., Sereno, M.: A game-theoretic approach to coalition formation in green cloud federations. In: 2014 14th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, pp 618–625. IEEE (2014)

  8. Gura, E.Y., Maschler, M.: Insights into Game Theory: An Alternative Mathematical Experience. Cambridge University Press, Cambridge (2008)

    Book  MATH  Google Scholar 

  9. Haeringer, G.: Market Design: Auctions and Matching. MIT Press, Cambridge (2018)

    Google Scholar 

  10. Hammoud, A., Mourad, A., Otrok, H., Wahab, O.A., Harmanani, H.: Cloud federation formation using genetic and evolutionary game theoretical models. Futur. Gener. Comput. Syst. 104, 92–104 (2020)

    Article  Google Scholar 

  11. Hassan, M.M., Hossain, M.S., Sarkar, A.J., Huh, E.N.: Cooperative game-based distributed resource allocation in horizontal dynamic cloud federation platform. Inf. Syst. Front. 16(4), 523–542 (2014)

    Article  Google Scholar 

  12. Kansal, S., Kumar, H., Kaushal, S.: A request allocation model for processing data in federated cloud computing. Electron. Libr. 38(4), 745–767 (2020). https://doi.org/10.1108/EL-01-2019-0005/FULL/HTML

    Article  Google Scholar 

  13. Khandelwal, Y., Purini, S., Reddy, P.V.: Fast algorithms for optimal coalition formation in federated clouds. In: 2016 IEEE/ACM 9th International Conference on Utility and Cloud Computing (UCC), pp 156–164. IEEE (2016)

  14. Khorasani, N., Abrishami, S., Feizi, M., Esfahani, M.A., Ramezani, F.: Resource management in the federated cloud environment using cournot and bertrand competitions. Future Generation Computer Systems (2020)

  15. Kim, H., Parashar, M.: Cometcloud: An autonomic cloud engine, cloud computing: principles and paradigms. chap. 10 (2011)

  16. Kohne, A., Spohr, M., Nagel, L., Spinczyk, O.: FederatedCloudSim: a SLA-aware federated cloud simulation framework. In: Proceedings of the 2nd International Workshop on CrossCloud Systems, pp 1–5 (2014)

  17. Le, T.A.: Workload prediction for resource management in data centers (2016)

  18. Lee, Y.H., Huang, K.C., Shieh, M.R., Lai, K.C.: Distributed resource allocation in federated clouds. J. Supercomput. 73(7), 3196–3211 (2017)

    Article  Google Scholar 

  19. Li, H., Wu, C., Li, Z., Lau, F.C.: Profit-maximizing virtual machine trading in a federation of selfish clouds. In: 2013 Proceedings IEEE INFOCOM, pp 25–29. IEEE (2013)

  20. Liaqat, M., Chang, V., Gani, A., Ab Hamid, S.H., Toseef, M., Shoaib, U., Ali, R.L.: Federated cloud resource management: Review and discussion. J. Netw. Comput. Appl. 77, 87–105 (2017)

    Article  Google Scholar 

  21. Liu, B., Lin, Y., Chen, Y.: Quantitative workload analysis and prediction using google cluster traces. In: 2016 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), pp 935–940. IEEE (2016)

  22. de Lucena Falcao, E., Brasileiro, F., Brito, A., Vivas, J.L.: Incentivising resource sharing in federated clouds. In: IFIP International Conference on Distributed Applications and Interoperable Systems, pp 45–50. Springer (2015)

  23. Ma, K., Bagula, A., Mauwa, H., Celesti, A.: Modelling cloud federation: A fair profit distribution strategy using the shapley value. In: 2018 IEEE 6th International Conference on Future Internet of Things and Cloud (FiCloud), pp 393–398. IEEE (2018)

  24. Mashayekhy, L., Nejad, M.M., Grosu, D.: Cloud federations in the sky: Formation game and mechanism. IEEE Trans. Cloud Comput. 3(1), 14–27 (2014)

    Article  Google Scholar 

  25. Mashayekhy, L., Nejad, M.M., Grosu, D.: Physical machine resource management in clouds: A mechanism design approach. IEEE Trans. Cloud Comput. 3(3), 247–260 (2014)

    Article  Google Scholar 

  26. Mashayekhy, L., Nejad, M.M., Grosu, D.: A trust-aware mechanism for cloud federation formation. IEEE Trans. Cloud Comput. 9(4), 1278–1292 (2019)

    Article  Google Scholar 

  27. Mashayekhy, L., Nejad, M.M., Grosu, D., Vasilakos, A.V.: An online mechanism for resource allocation and pricing in clouds. IEEE Trans. Comput. 65(4), 1172–1184 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  28. Mihailescu, M., Teo, Y.M.: Dynamic resource pricing on federated clouds. In: 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing, pp 513–517. IEEE (2010)

  29. Nejad, M.M., Mashayekhy, L., Grosu, D.: Truthful greedy mechanisms for dynamic virtual machine provisioning and allocation in clouds. IEEE Trans. Parallel Distrib. Syst. 26(2), 594–603 (2014)

    Article  Google Scholar 

  30. Niyato, D., Vasilakos, A.V., Kun, Z.: Resource and revenue sharing with coalition formation of cloud providers: Game theoretic approach. In: 2011 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, pp 215–224. IEEE (2011)

  31. Pacheco-Sanchez, S., Casale, G., Scotney, B., McClean, S., Parr, G., Dawson, S.: Markovian workload characterization for QoS prediction in the cloud. In: 2011 IEEE 4th International Conference on Cloud Computing, pp 147–154. IEEE (2011)

  32. Petri, I., Diaz-Montes, J., Zou, M., Beach, T., Rana, O., Parashar, M.: Market models for federated clouds. IEEE Trans. Cloud Comput. 3(3), 398–410 (2015)

    Article  Google Scholar 

  33. Prasad, A.S., Rao, S.: A mechanism design approach to resource procurement in cloud computing. IEEE Trans. Comput. 63(1), 17–30 (2013)

    Article  MathSciNet  MATH  Google Scholar 

  34. Ray, B.K., Saha, A., Khatua, S., Roy, S.: Toward maximization of profit and quality of cloud federation: solution to cloud federation formation problem. J. Supercomput. 75(2), 885–929 (2019)

    Article  Google Scholar 

  35. Ray, B.K., Saha, A., Roy, S.: Migration cost and profit oriented cloud federation formation: hedonic coalition game based approach. Clust. Comput. 21(4), 1981–1999 (2018)

    Article  Google Scholar 

  36. Reddy, K.H.K., Mudali, G., Roy, D.S.: A novel coordinated resource provisioning approach for cooperative cloud market. J. Cloud Comput. 6(1), 8 (2017)

    Article  Google Scholar 

  37. Reiss, C., Wilkes, J., Hellerstein, J.L.: Google cluster-usage traces: format+ schema. Google Inc., White Paper pp 1–14 (2011)

  38. Samaan, N.: A novel economic sharing model in a federation of selfish cloud providers. IEEE Trans. Parallel Distrib. Syst. 25(1), 12–21 (2013)

    Article  Google Scholar 

  39. Shishira, S., Kandasamy, A.: BeeM-NN: An efficient workload optimization using Bee mutation neural network in federated cloud environment. J. Ambient. Intell. Humaniz. Comput. 12(2), 3151–3167 (2021)

    Article  Google Scholar 

  40. Toosi, A.N., Calheiros, R.N., Buyya, R.: Interconnected cloud computing environments: Challenges, taxonomy, and survey. ACM Comput. Surv.(CSUR) 47(1), 1–47 (2014)

    Article  Google Scholar 

  41. Toosi, A.N., Calheiros, R.N., Thulasiram, R.K., Buyya, R.: Resource provisioning policies to increase IaaS provider’s profit in a federated cloud environment. In: 2011 IEEE International Conference on High Performance Computing and Communications, pp 279–287. IEEE (2011)

  42. Toosi, A.N., Thulasiram, R.K., Buyya, R.: Financial option market model for federated cloud environments. In: 2012 IEEE 5th International Conference on Utility and Cloud Computing, pp 3–12. IEEE (2012)

  43. Varian, H.R.: Microeconomic analysis. 338.5 V299m 1992 WW Norton (1992)

  44. Wu, Q., Zhou, M., Zhu, Q., Xia, Y.: VCG auction-based dynamic pricing for multigranularity service composition. IEEE Trans. Autom. Sci. Eng. 15(2), 796–805 (2017)

    Article  Google Scholar 

  45. Zaman, S., Grosu, D.: Combinatorial auction-based allocation of virtual machine instances in clouds. J. Parallel Distrib. Comput. 73(4), 495–508 (2013)

    Article  Google Scholar 

  46. Zhang, H., Jiang, H., Li, B., Liu, F., Vasilakos, A.V., Liu, J.: A framework for truthful online auctions in cloud computing with heterogeneous user demands. IEEE Trans. Comput. 65(3), 805–818 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  47. Zhang, T.: A fairness-enhanced resource trading system in federated cloud environments. Int. J. Netw. Virtual Organ. 22(2), 183–198 (2020)

    Article  Google Scholar 

  48. Zoie, R.C., Alexandru, B., Delia Mihaela, R., Mihail, D.: A decision making framework for weighting and ranking criteria for Cloud provider selection. 2016 20th International Conference on System Theory, Control and Computing, ICSTCC 2016 - Joint Conference of SINTES 20, SACCS 16 SIMSIS 20 - Proceedings pp. 590–595. https://doi.org/10.1109/ICSTCC.2016.7790730 (2016)

Download references

Funding

The authors did not receive support from any organization for the submitted work.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Saeid Abrishami.

Ethics declarations

Conflict of Interests

There is no conflict of interest.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ramezani, F., Abrishami, S. & Feizi, M. A Market-based Framework for Resource Management in Cloud Federation. J Grid Computing 21, 3 (2023). https://doi.org/10.1007/s10723-022-09635-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10723-022-09635-w

Keywords

Navigation