Advertisement

Cost-Optimized Parallel Computations Using Volatile Cloud Resources

  • Jens HaussmannEmail author
  • Wolfgang BlochingerEmail author
  • Wolfgang Kuechlin
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11819)

Abstract

In recent years, the parallel computing community has shown increasing interest in leveraging cloud resources for executing parallel applications. Clouds exhibit several fundamental features of economic value, like on-demand resource provisioning and a pay-per-use model. Additionally, several cloud providers offer their resources with significant discounts; however, possessing limited availability. Such volatile resources are an auspicious opportunity to reduce the costs arising from computations, thus achieving higher cost efficiency. In this paper, we propose a cost model for quantifying the monetary costs of executing parallel applications in cloud environments, leveraging volatile resources. Using this cost model, one is able to determine a configuration of a cloud-based parallel system that minimizes the total costs of executing an application.

Keywords

Cloud computing Parallel computing Cost model 

References

  1. 1.
  2. 2.
  3. 3.
  4. 4.
  5. 5.
  6. 6.
    Amazon: Amazon EC2 Spot Instances (2014). https://aws.amazon.com/ec2/spot/
  7. 7.
    Da Rosa Righi, R., Rodrigues, V.F., Da Costa, C.A., Galante, G., De Bona, L.C.E., Ferreto, T.: AutoElastic: automatic resource elasticity for high performance applications in the cloud. IEEE Trans. Cloud Comput. 4(1), 6–19 (2016)CrossRefGoogle Scholar
  8. 8.
    Deelman, E., Singh, G., Livny, M., Berriman, B., Good, J.: The cost of doing science on the cloud: the montage example. In: Proceedings of the ACM/IEEE Conference on Supercomputing (2008)Google Scholar
  9. 9.
    Google Cloud: Preemptible VMs. https://cloud.google.com/preemptible-vms/
  10. 10.
    Grama, A., Kumar, V., Karypis, G., Gupta, A.: Introduction to Parallel Computing, 2nd edn. Addison-Wesley, Boston (2003)zbMATHGoogle Scholar
  11. 11.
    Gupta, A., Milojicic, D.: Evaluation of HPC applications on cloud. In: Proceedings of the 6th Open Cirrus Summit. IEEE (2012)Google Scholar
  12. 12.
    Haussmann, J., Blochinger, W., Kuechlin, W.: Cost-efficient parallel processing of irregularly structured problems in cloud computing environments. Cluster Comput. (2018).  https://doi.org/10.1007/s10586-018-2879-3CrossRefGoogle Scholar
  13. 13.
    Kehrer, S., Blochinger, W.: A survey on cloud migration strategies for high performance computing. In: Proceedings of the 13th Advanced Summer School on Service-Oriented Computing. IBM Research Division (2019)Google Scholar
  14. 14.
    Kehrer, S., Blochinger, W.: TASKWORK: a cloud-aware runtime system for elastic task-parallel HPC applications. In: Proceedings of 9th International Conference on Cloud Computing and Services Science (2019)Google Scholar
  15. 15.
    Rajan, D., Canino, A., Izaguirre, J.A., Thain, D.: Converting a high performance application to an elastic cloud application. In: Proceedings of the 3rd IEEE International Conference on Cloud Computing Technology and Science (2011)Google Scholar
  16. 16.
    Taifi, M.: Banking on decoupling: budget-driven sustainability for HPC applications on auction-based clouds. ACM SIGOPS Oper. Syst. Rev. 47(2), 41–50 (2013)CrossRefGoogle Scholar
  17. 17.
    Taifi, M., Shi, J.Y., Khreishah, A.: SpotMPI: a framework for auction-based HPC computing using Amazon spot instances. In: Xiang, Y., Cuzzocrea, A., Hobbs, M., Zhou, W. (eds.) ICA3PP 2011. LNCS, vol. 7017, pp. 109–120. Springer, Heidelberg (2011).  https://doi.org/10.1007/978-3-642-24669-2_11CrossRefGoogle Scholar
  18. 18.
    Viana, V., De Oliveira, D., Mattoso, M.: Towards a cost model for scheduling scientific workflows activities in cloud environments. In: Proceedings of the IEEE World Congress on Services (2011)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Parallel and Distributed Computing GroupReutlingen UniversityReutlingenGermany
  2. 2.Symbolic Computation GroupUniversity of TuebingenTuebingenGermany

Personalised recommendations