Advertisement

Support for spot virtual machine purchasing simulation

  • Ao Zhou
  • Shangguang Wang
  • Qibo Sun
  • Jinglin Li
  • Qinglin Zhao
  • Fangchun Yang
Article

Abstract

With the rapid progress of cloud computing technology, a growing number of big data application providers begin to deploy applications on virtual machines rented from infrastructure as a service providers. Current infrastructure as a service provider offers diverse purchasing options for the application providers. There are mainly three types of purchasing options: reserved virtual machine, on-demand virtual machine and spot virtual machine. The spot virtual machine is a specific type of virtual machine that employs a dynamic pricing model. Because can be stopped by the infrastructure as a service providers without notice, the spot virtual machine is suitable for large-scale divisible applications, such as big data analysis. Therefore, spot virtual machine is chosen by many big data application providers for its low rental cost per hour. When spot virtual machine is chosen, a major issue faced by the big data application providers is how to minimize the virtual machine rental cost while meet service requirements. Many optimal spot virtual machine purchasing approaches have been presented by the researchers. However, there is a shortage of simulators that enable researchers to evaluate their newly proposed spot virtual machine purchasing approach. To fill this gap, in this paper, we propose SpotCloudSim to support for dynamic virtual machine pricing model simulation. SpotCloudSim provides an extensible interface to help researchers implement new spot virtual machine purchasing approach. In addition, SpotCloudSim can also study the behavior of the newly proposed spot virtual machine purchasing approaches. We demonstrate the capabilities of SpotCloudSim by using three spot virtual machine purchasing approaches. The results indicate the benefits of our proposed simulation system.

Keywords

Cloud computing Virtual machine Big data analysis Simulator Dynamic pricing model 

Notes

Acknowledgements

This work is supported by NSFC (61602054), NSFC (61472047), and Beijing Natural Science Foundation (4174100). This work is supported by Macao FDCT-MOST Grant 001/2015/AMJ and Macao FDCT Grant 104/2014/A3.

Compliance with ethical standards

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Research involving animal and human rights

This article does not contain any studies with animals performed by any of the authors.

Informed consent

Informed consent was obtained from all individual participants included in the study.

References

  1. 1.
    Shabeera, T. P., Madhu Kumar, S. D., Salam, S. M., Murali Krishnan, K.: Optimizing VM allocation and data placement for data-intensive applications in cloud using ACO metaheuristic algorithm. Engineering Science and Technology, an International Journal, published online, pp. 1-13(2016)Google Scholar
  2. 2.
    Wang, S., Zhou, A., Hsu, C.H., Xiao, X., Yang, F.: Provision of data-intensive services through energy- and QoS-aware virtual machine placement in national cloud data centers. IEEE Trans. Emerg. Top. Comput. 4(2), 290–300 (2016)CrossRefGoogle Scholar
  3. 3.
    Dastjerdi, A.V., Buyya, R.: Compatibility-aware cloud service composition under fuzzy preferences of users. IEEE Trans. Cloud Comput. 2(1), 1–13 (2014)CrossRefGoogle Scholar
  4. 4.
    Xiao, Z., Song, W., Chen, Q.: Dynamic resource allocation using virtual machines for cloud computing environment. IEEE Trans. Parallel Distrib. Syst. 24(6), 1107–1117 (2013)CrossRefGoogle Scholar
  5. 5.
    Fox, A., Griffith, R., Joseph, A., Katz, R., Konwinski, A., Lee, G., Patterson, D., Rabkin, A., Stoica, I.: Above the Clouds: A Berkeley View of Cloud Computing, vol. 28, pp. 13. Dept. Electrical Eng. and Comput. Sciences, University of California, Berkeley, Rep. UCB/EECS, (2009)Google Scholar
  6. 6.
    Li, H., Dong, M., Ota, K., Guo, M.: Pricing and repurchasing for big data processing in multi-clouds. IEEE Trans. Emerg. Top. Comput. 4(2), 266–277 (2016)CrossRefGoogle Scholar
  7. 7.
    Liu, Z., Wang, S., Sun, Q., Zou, H., Yang, F.: Cost-aware cloud service request scheduling for SaaS providers. Comput. J. 57(2), 291–301 (2014)CrossRefGoogle Scholar
  8. 8.
    Zhang, W.Z., Xie, H.C., Hsu, C.H.: Automatic memory control of multiple virtual machines on a consolidated server. IEEE Trans. Cloud Comput. 5(1), 2–14 (2017)CrossRefGoogle Scholar
  9. 9.
    Li, H., Dong, M., Ota, K.: Radio access network virtualization for the social internet of things. IEEE Cloud Comput. 2(6), 42–50 (2015)CrossRefGoogle Scholar
  10. 10.
    Dong, M., Li, H., Ota, K., Yang, L.T., Zhu, H.: Multicloud-based evacuation services for emergency management. IEEE Cloud Comput. 1(4), 50–59 (2014)CrossRefGoogle Scholar
  11. 11.
    Agmon Ben-Yehuda, O., Ben-Yehuda, M., Schuster, A., Tsafrir, D.: Deconstructing amazon EC2 spot instance pricing. ACM Trans. Econ. Comput. 1(3), 16 (2013)CrossRefGoogle Scholar
  12. 12.
    Stokely, M., Winget, J., Keyes, E., Grimes, C. and Yolken, B.: Using a market economy to provision compute resources across planet-wide clusters. Parallel and Distributed Processing, 2009. IPDPS 2009. IEEE International Symposium on, IEEE, pp. 1–8 (2009)Google Scholar
  13. 13.
    Wang, Q., Ren, K., Meng, X.: When, cloud meets eBay: Towards effective pricing for cloud computing. INFOCOM, 2012 Proceedings IEEE, IEEE, pp. 936–944, (2012)Google Scholar
  14. 14.
    Chen, J., Wang, C., Zhou, B. B., Sun, L., Lee, Y. C. and Zomaya, A. Y.: Tradeoffs between profit and customer satisfaction for service provisioning in the cloud. Proceedings of the 20th international symposium on High performance distributed computing, pp. 229–238. ACM, New York (2011)Google Scholar
  15. 15.
    Zhou, A., Sun, Q., Sun, L., Li, J. and Yang, F. ’Maximizing the profits of cloud service providers via dynamic virtual resource renting approach’, EURASIP Journal on Wireless Communications and Networking, Vol.2015, No.1, pp.71(2015)Google Scholar
  16. 16.
    Guo, W., Chen, K., Wu, Y., Zheng, W.: Bidding for highly available services with low price in spot instance market. Proceedings of the 24th International Symposium on High-Performance Parallel and Distributed Computing, pp. 191–202. ACM, New York (2015)Google Scholar
  17. 17.
    He, X., Shenoy, P., Sitaraman, R. and Irwin, D.: Cutting the cost of hosting online services using cloud spot markets. The 25th International ACM Symposium on High-Performance Parallel and Distributed Computing (HPDC), pp. 1–12 (2015)Google Scholar
  18. 18.
    Legrand, A., Marchal, L., Casanova, H.: Scheduling distributed applications: the SimGrid simulation framework. CCGrid 2003. 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid, 2003. Proceedings., pp. 138–145 (2003)Google Scholar
  19. 19.
    Buyya, R., Murshed, M.: GridSim: a toolkit for the modeling and simulation of distributed resource management and scheduling for grid computing. Concurr. Comput. Pract. Exp. 14(13–15), 1175–1220 (2002)CrossRefzbMATHGoogle Scholar
  20. 20.
    Calheiros, R. N., Ranjan, R., De Rose, C. A., Buyya, R.: Cloudsim: A novel framework for modeling and simulation of cloud computing infrastructures and services, arXiv preprint arXiv:0903.2525 (2009)
  21. 21.
    Calheiros, R.N., Ranjan, R., Beloglazov, A., De Rose, C.A., Buyya, R.: CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Softw. Pract. Exp. 41(1), 23–50 (2011)CrossRefGoogle Scholar
  22. 22.
  23. 23.
    Chen, W., Deelman, E.: WorkflowSim: a toolkit for simulating scientific workflows in distributed environments. 2012 IEEE 8th International Conference on E-Science. pp. 1–8 (2012)Google Scholar
  24. 24.
  25. 25.
    Bux, M., Leser, U.: Dynamiccloudsim: simulating heterogeneity in computational clouds’. Proceedings of the 2nd ACM SIGMOD Workshop on Scalable Workflow Execution Engines and Technologies(SWEET), pp. 1–12. ACM, New York (2013)Google Scholar
  26. 26.
    Gupta, S.K.S., Banerjee, A., Abbasi, Z., Varsamopoulos, G., Jonas, M., Ferguson, J., Gilbert, R.R., Mukherjee, T.: GDCSim: a simulator for green data center design and analysis. ACM Trans. Model. Comput. Simul. 24(1), 1–27 (2014)MathSciNetCrossRefGoogle Scholar
  27. 27.
    Tighe, M., Keller, G., Bauer, M., Lutfiyya, H.: DCSim: a data centre simulation tool for evaluating dynamic virtualized resource management. 2012 8th International Conference on Network and Service Management (cnsm) and 2012 workshop on systems virtualiztion management (svm), pp. 385–392 (2012)Google Scholar
  28. 28.
    Zafer, M., Song, Y., Lee, K.-W.: Optimal bids for spot VMs in a cloud for deadline constrained jobs. Cloud Computing (CLOUD), 2012 IEEE 5th International Conference on IEEE, pp. 75–82 (2012)Google Scholar
  29. 29.
    Javadi, B., Thulasiram, R.K., Buyya, R.: Characterizing spot price dynamics in public cloud environments. Future Gener. Comput. Syst. 29(4), 988–999 (2013)CrossRefGoogle Scholar
  30. 30.
    Yi, S., Andrzejak, A., Kondo, D.: Monetary cost-aware checkpointing and migration on amazon cloud spot instances. IEEE Trans. Serv. Comput. 5(4), 512–524 (2012)CrossRefGoogle Scholar
  31. 31.
    Jung, D., Chin, S., Chung, K., Yu, H., Gil, J.: An efficient checkpointing scheme using price history of spot instances in cloud computing environment. Network and Parallel Computing, pp. 185–200. Springer, Berlin (2011)CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2017

Authors and Affiliations

  • Ao Zhou
    • 1
  • Shangguang Wang
    • 1
  • Qibo Sun
    • 1
  • Jinglin Li
    • 1
  • Qinglin Zhao
    • 2
  • Fangchun Yang
    • 1
  1. 1.State Key Laboratory of Networking and Switching TechnologyBeijing University of Posts and TelecommunicationsBeijingChina
  2. 2.Faculty of Information TechnologyMacau University of Science and TechnologyTaipaChina

Personalised recommendations