Skip to main content
SpringerLink
Log in

RAMP: reliability-aware elastic instance provisioning for profit maximization

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

IaaS cloud providers such as Amazon EC2 provide access to a diverse set of instance types and purchasing options with various pricing and performance characteristics. Two pay-as-you-go purchasing options offered by Amazon EC2 are reliable on-demand and “opportunistic” spot instances. In this paper, we address the problem of profit maximization in the cloud via elastic, reliable provisioning of a mixture of instances in these options. To this end, we develop RAMP, a reliability-aware profit-maximizing resource provisioner that acts as middleware between applications/end users and Amazon EC2. Requests are fulfilled by acquiring and allocating instances through a comparison of the expected profit and reliability dynamics among various spot markets. RAMP employs novel strategies designed to evaluate the reliability, expected cost, and expected profit of different instances, and to intelligently determine bids that meet minimum reliability guarantees. Simulations run using Amazons spot price history over a four-month period demonstrate that, while achieving early termination rates as low as 2.2 %, our approach can completely offset the total cost when charging the user just 17.5 % of on-demand price. Further, the increases in profit resulting from relatively small additional charges to users are notably high, i.e., 100 % profit compared to the baseline resource provisioning cost with 35 % of the equivalent on-demand price.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Notes

  1. It is estimated the number of physical servers deployed for Amazon EC2 is 600,000 in 2013 (https://huanliu.wordpress.com/2012/03/13/amazon-data-center-size/), although the actual number is kept secret. In addition, Amazon Web Services continues to reduce prices (https://aws.amazon.com/blogs/aws/category/price-reduction/).

  2. In our experiments, \(\varPi _0 = -\$6,003\).

References

  1. Amazon (2015) Amazon EC2 spot instances. http://aws.amazon.com/ec2/purchasing-options/spot-instances/

  2. Amazon (2015) Amazon elastic compute cloud (Amazon EC2). http://aws.amazon.com/ec2/

  3. Andrzejak A, Kondo D, Yi S (2010) Decision model for cloud computing under SLA constraints. In: Proceedings of IEEE international symposium on modeling, analysis and simulation of computer and telecommunication systems (MASCOTS), pp 257–266. IEEE

  4. Ben-Yehuda O, Ben-Yehuda M, Schuster A, Tsafrir D (2011) Deconstructing Amazon EC2 spot instance pricing. In: Proceedings of IEEE third international conference on cloud computing technology and science (CloudCom), pp 304–311. IEEE

  5. Bloomberg (2014) 5 numbers that illustrate the mind-bending size of Amazon’s cloud. http://www.bloomberg.com/news/2014-11-14/5-numbers-that-illustrate-the-mind-bending-size-of-amazon-s-cloud.html

  6. Chen C, Lee BS, Tang X (2014) Improving hadoop monetary efficiency in the cloud using spot instances. In: Proceedings of IEEE 6th international conference on cloud computing technology and science (CloudCom), pp 312–319

  7. Chen J, Wang C, Zhou B, Sun L, Lee YC, Zomaya AY (2011) Tradeoffs between profit and customer satisfaction for service provisioning in the cloud. In: Proceedings of international symposium on high performance distributed computing (HPDC), pp 229–238. ACM

  8. Farley B, Juels A, Varadarajan V, Ristenpart T, Bowers K, Swift M (2012) More for your money: exploiting performance heterogeneity in public clouds. In: Proceedings of ACM symposium on cloud computing (SOCC), pp 20–28. ACM

  9. Feitelson D Parallel workloads archive. http://www.cs.huji.acil/labs/parallel/workload

  10. Javadi B, Kondo D, Vincent JM, Anderson DP (2011) Discovering statistical models of availability in large distributed systems: an empirical study of SETI@home. IEEE Trans Parallel and Distrib Syst (TPDS) 22(11):1896–1903

    Article  Google Scholar 

  11. Javadi B, Thulasiram R, Buyya R (2011) Statistical modeling of spot instance prices in public cloud environments. In: Proceedings of IEEE/ACM international conference on utility and cloud computing (UCC), pp 219–228. IEEE

  12. Lee YC, Wang C, Zomaya AY, Zhou BB (2012) Profit-driven scheduling for cloud services with data access awareness. J Parallel Distrib Comput (JPDC) 72(4):591–602

    Article  Google Scholar 

  13. Leslie L, Lee YC, Lu P, Zomaya A (2013) Exploiting performance and cost diversity in the cloud. IEEE

  14. Liu H (2011) Cutting MapReduce cost with spot market. In: Proceedings of USENIX workshop on hot topics in cloud computing (HotCloud), pp 1–5

  15. Mazzucco M, Dumas M (2011) Achieving performance and availability guarantees with spot instances. In: Proceedings of IEEE international conference on high performance computing and communications (HPCC), pp 296–303. IEEE

  16. Poola D, Ramamohanarao K, Buyya R (2014) Fault-tolerant workflow scheduling using spot instances on clouds. In: Proceedings of international conference on computational science (ICCS), pp 523–533

  17. Popovici F, Wilkes J (2005) Profitable services in an uncertain world. In: Proceedings of IEEE/ACM conference on supercomputing (SC), p 36. IEEE

  18. Song Y, Zafer M, Lee K (2012) Optimal bidding in spot instance market. In: Proceedings of IEEE international conference on computer communications (INFOCOM), pp 190–198. IEEE

  19. Tsakalozos K, Kllapi H, Sitaridi E, Roussopoulos M, Paparas D, Delis A (2011) Flexible use of cloud resources through profit maximization and price discrimination. In: Proceedings of IEEE international conference on data engineering (ICDE), pp 75–86. IEEE

  20. University of Western Sydney (2013) Spot price srchive. http://spot.scem.uws.edu.au

  21. Voorsluys W, Buyya R (2012) Reliable provisioning of spot instances for compute-intensive applications. In: Proceedings of IEEE international conference on advanced information networking and applications (AINA), pp 542–549. IEEE

  22. Voorsluys W, Garg S, Buyya R (2011) Provisioning spot market cloud resources to create cost-effective virtual clusters. In: Proceedings of international conference on algorithms and architectures for parallel processing (ICA3PP), pp 395–408

  23. Wieder A, Bhatotia P, Post A, Rodrigues R (2012) Orchestrating the deployment of computations in the cloud with conductor. In: Proceedings of the 9th USENIX conference on networked systems design and implementation (NSDI). USENIX Association

  24. Zafer M, Song Y, Lee K (2012) Optimal bids for spot VMs in a cloud for deadline constrained jobs. In: Proceedings of IEEE international conference on cloud computing (CLOUD), pp 75–82. IEEE

  25. Zhao H, Pan M, Liu X, Li X, Fang Y (2012) Optimal resource rental planning for elastic applications in cloud market. In: Proceedings of IEEE international parallel and distributed processing symposium (IPDPS), pp 808–819. IEEE

Download references

Acknowledgments

Dr. Young Choon Lee would like to acknowledge the support of the Australian Research Council Discovery Early Career Researcher Award Grant DE140101628.

Author information

Authors and Affiliations

  1. Department of Computer Science, University of Illinois at Urbana-Champaign, Champaign, IL, USA

    Luke M. Leslie

  2. Department of Computing, Macquarie University, Sydney, Australia

    Young Choon Lee

  3. School of Information Technologies, University of Sydney, Sydney, Australia

    Albert Y. Zomaya

Authors
  1. Luke M. Leslie
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Young Choon Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Albert Y. Zomaya
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Young Choon Lee.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Leslie, L.M., Lee, Y.C. & Zomaya, A.Y. RAMP: reliability-aware elastic instance provisioning for profit maximization. J Supercomput 71, 4529–4554 (2015). https://doi.org/10.1007/s11227-015-1548-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-015-1548-z

Keywords

Search

Navigation