Abstract
In this article, an extensive survey on optimal utilization of preemptible instances in cloud is presented. Different techniques used in state-of-the-art research for efficient utilization of spot instances have been classified and categorized in the paper. To the best of our knowledge, this is the first attempt of its kind. With the continuing growths in cloud computing, researchers and business personnels are exploiting the services provided by the cloud computing to reduce their operational cost. Users can share resources in the cloud with the help of virtualization. Virtualization provides abstraction of cloud to the users by hiding the complexity of inherent software and hardware present in the cloud. It increases the likelihood of running multiple operating systems (OSs) on a single physical machine with sharing of hardware resources. Each OS can be considered as a virtual machine (VM) installed on a physical machine. Based on subscription model, VMs can be classified into three types: reserved VMs, on-demand VMs and spot VMs. Spot instances are also known as preemptible VM instances. Spot instances are used as reduced cost resources at the risk of reliability. To utilize spot instances, users have to bid for them. Users will able to get the spot instances only if the biding price is greater than the spot instance price. As soon as the bid price becomes less than the spot price, the cloud provider will revoke the VMs (SIs). This survey aims to find the ways, one can efficiently utilize spot instances for executing the tasks with optimized cost and time.
Similar content being viewed by others
Notes
The term “spot instance” and “preemptible VM instances” are used interchangeably in this article.
References
(2017) Cloud computing. https://azure.microsoft.com/en-in/overview/what-is-cloud-computing/. Accessed 25 Dec 2017
(2018) Amazon EC2 instance types. https://aws.amazon.com/ec2/instance-types/. Accessed 25 Mar 2018
Abundo M, Valerio VD, Cardellini V, Presti FL (2015) QoS-aware bidding strategies for VM spot instances: a reinforcement learning approach applied to periodic long running jobs. In: IFIP/IEEE International Symposium on Integrated Network Management, IM 2015, Ottawa, ON, Canada, 11–15 May, 2015, pp 53–61. https://doi.org/10.1109/INM.2015.7140276
Agmon Ben-Yehuda O, Ben-Yehuda M, Schuster A, Tsafrir D (2013) Deconstructing amazon EC2 spot instance pricing. ACM Trans Econ Comput 1(3):16. https://doi.org/10.1145/2509413.2509416
Ben-Yehuda OA, Ben-Yehuda M, Schuster A, Tsafrir D (2011) Deconstructing amazon EC2 spot instance pricing. In: 2011 IEEE Third International Conference on Cloud Computing Technology and Science, pp 304–311. https://doi.org/10.1109/CloudCom.2011.48
Blum A, Sandholm T, Zinkevich M (2006) Online algorithms for market clearing. J ACM 53(5):845–879. https://doi.org/10.1145/1183907.1183913
Burgess M, Wiedenbeck B (2010) Strategic bidding on amazon EC2. https://scholar.google.co.in/scholar?hl=en&as_sdt=0,5&cluster=3572391033188216107
Buyya R, Vecchiola C, Selvi ST (2013) Mastering cloud computing: foundations and applications programming. Newnes. https://doi.org/10.1016/C2012-0-06719-1
Calheiros RN, Ranjan R, Beloglazov A, Rose CAFD, Buyya R (2011) Cloudsim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Softw Pract Exper 41(1):23–50. https://doi.org/10.1002/spe.995
Chichin S, Vo QB, Kowalczyk R (2017) Towards efficient and truthful market mechanisms for double-sided cloud markets. IEEE Trans Serv Comput 10(1):37–51
Chohan N, Castillo C, Spreitzer M, Steinder M, Tantawi AN, Krintz C (2010) See spot run: using spot instances for mapreduce workflows. In: 2nd USENIX Workshop on Hot Topics in Cloud Computing, HotCloud’10, Boston, MA, USA, June 22, 2010. https://www.usenix.org/conference/hotcloud-10/see-spot-run-using-spot-instances-mapreduce-workflows
Dawoud W, Takouna I, Meinel C (2012) Increasing spot instances reliability using dynamic scalability. In: 2012 IEEE Fifth International Conference on Cloud Computing, Honolulu, HI, USA, June 24–29, 2012, pp 959–961. https://doi.org/10.1109/CLOUD.2012.58
DeCandia G, Hastorun D, Jampani M, Kakulapati G, Lakshman A, Pilchin A, subramanian SS, Vosshall P, Vogels W (2007) Dynamo: amazon’s highly available key-value store. In: Proceedings of the 21st ACM Symposium on Operating Systems Principles 2007, SOSP 2007, Stevenson, Washington, USA, October 14–17, 2007, pp 205–220. https://doi.org/10.1145/1294261.1294281
Di S, Robert Y, Vivien F, Kondo D, Wang C, Cappello F (2013) Optimization of cloud task processing with checkpoint-restart mechanism. In: International Conference for High Performance Computing, Networking, Storage and Analysis, SC’13, Denver, CO, USA—November 17–21, 2013, pp 64:1–64:12. https://doi.org/10.1145/2503210.2503217
Domanal SG, Reddy GRM (2018) An efficient cost optimized scheduling for spot instances in heterogeneous cloud environment. Future Gener Comput Syst 84:11–21
Friedman EJ, Parkes DC (2003) Pricing wifi at starbucks: issues in online mechanism design. In: Proceedings of the 4th ACM Conference on Electronic Commerce, ACM, New York, NY, USA, EC ’03, pp 240–241. https://doi.org/10.1145/779928.779978
Gong Y, He B, Zhou AC (2015) Monetary cost optimizations for MPI-based HPC applications on amazon clouds: checkpoints and replicated execution. In: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2015, Austin, TX, USA, November 15–20, 2015, pp 32:1–32:12. https://doi.org/10.1145/2807591.2807612
Guo W, Chen K, Wu Y, Zheng W (2015) Bidding for highly available services with low price in spot instance market. In: Proceedings of the 24th International Symposium on High-Performance Parallel and Distributed Computing, ACM, New York, NY, USA, HPDC ’15, pp 191–202. https://doi.org/10.1145/2749246.2749259
He X, Shenoy P, Sitaraman R, Irwin D (2015) Cutting the cost of hosting online services using cloud spot markets. In: Proceedings of the 24th International Symposium on High-Performance Parallel and Distributed Computing, ACM, New York, NY, USA, HPDC ’15, pp 207–218. https://doi.org/10.1145/2749246.2749275
Huang B, Jarrett NWD, Babu S, Mukherjee S, Yang J (2015) Cumulon: matrix-based data analytics in the cloud with spot instances. PVLDB 9(3):156–167. http://www.vldb.org/pvldb/vol9/p156-huang.pdf
Jangjaimon I, Tzeng N (2013) Adaptive incremental checkpointing via delta compression for networked multicore systems. In: 27th IEEE International Symposium on Parallel and Distributed Processing, IPDPS 2013, Cambridge, MA, USA, May 20–24, 2013, pp 7–18. https://doi.org/10.1109/IPDPS.2013.33
Jangjaimon I, Tzeng N (2015) Effective cost reduction for elastic clouds under spot instance pricing through adaptive checkpointing. IEEE Trans Comput 64(2):396–409. https://doi.org/10.1109/TC.2013.225
Javadi B, Thulasiram RK, Buyya R (2011) Statistical modeling of spot instance prices in public cloud environments. In: IEEE 4th International Conference on Utility and Cloud Computing, UCC 2011, Melbourne, Australia, December 5–8, 2011, pp 219–228. https://doi.org/10.1109/UCC.2011.37
Javadi B, Thulasiram RK, Buyya R (2013) Characterizing spot price dynamics in public cloud environments. Future Gener Comput Syst 29(4):988–999. https://doi.org/10.1016/j.future.2012.06.012
Jia Q, Shen Z, Song W, van Renesse R, Weatherspoon H (2016) Smart spot instances for the supercloud. In: Proceedings of the 3rd Workshop on CrossCloud Infrastructures and Platforms, ACM, New York, NY, USA, CrossCloud ’16, pp 5:1–5:6. https://doi.org/10.1145/2904111.2904114
Jung D, Lim J, Yu H, Suh T (2014) Estimated interval-based checkpointing (EIC) on spot instances in cloud computing. J Appl Math 2014:217,547:1–217,547:12. https://doi.org/10.1155/2014/217547
Kaminski B, Szufel P (2015) On optimization of simulation execution on amazon EC2 spot market. Simul Model Pract Theory 58:172–187. https://doi.org/10.1016/j.simpat.2015.05.008
Kaminski B, Szufel P (2015) On optimization of simulation execution on amazon EC2 spot market. Simul Modell Pract Theory 58(Part 2):172–187. doi: 10.1016/j.simpat.2015.05.008
Karunakaran S, Krishnaswamy V, Sundarraj RP (2014) Decisions models and opportunities in cloud computing economics: a review of research on pricing and markets. Springer, Cham, pp 85–99. https://doi.org/10.1007/978-3-319-07950-9_7
Khatua S, Mukherjee N (2013a) Application-centric resource provisioning for amazon EC2 spot instances. Springer, Berlin, pp 267–278. https://doi.org/10.1007/978-3-642-40047-6_29
Khatua S, Mukherjee N (2013b) A novel checkpointing scheme for amazon EC2 spot instances. In: 13th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing, CCGrid 2013, Delft, Netherlands, May 13–16, 2013, pp 180–181. https://doi.org/10.1109/CCGrid.2013.71
Marathe A, Harris R, Lowenthal DK, de Supinski BR, Rountree B, Schulz M (2014) Exploiting redundancy for cost-effective, time-constrained execution of HPC applications on amazon EC2. In: The 23rd International Symposium on High-Performance Parallel and Distributed Computing, HPDC’14, Vancouver, BC, Canada—June 23–27, 2014, pp 279–290. https://doi.org/10.1145/2600212.2600226
Mattess M, Vecchiola C, Buyya R (2010) Managing peak loads by leasing cloud infrastructure services from a spot market. In: 2010 IEEE 12th International Conference on High Performance Computing and Communications (HPCC), pp 180–188. https://doi.org/10.1109/HPCC.2010.77
Mazzucco M, Dumas M (2011) Achieving performance and availability guarantees with spot instances. In: 2011 IEEE International Conference on High Performance Computing and Communications, pp 296–303. https://doi.org/10.1109/HPCC.2011.46
Mell P, Grance T (2011) The NIST definition of cloud computing. Tech. Rep. 800-145, National Institute of Standards and Technology (NIST), Gaithersburg, MD. http://csrc.nist.gov/publications/nistpubs/800-145/SP800-145.pdf
Menache I, Shamir O, Jain N (2014) On-demand, spot, or both: dynamic resource allocation for executing batch jobs in the cloud. In: 11th International Conference on Autonomic Computing (ICAC 14), USENIX Association, Philadelphia, PA, pp 177–187. https://www.usenix.org/conference/icac14/technical-sessions/presentation/menache
Ng C, Parkes DC, Seltzer M (2003) Virtual worlds: Fast and strategyproof auctions for dynamic resource allocation. In: Proceedings of the 4th ACM Conference on Electronic Commerce, ACM, New York, NY, USA, EC ’03, pp 238–239. https://doi.org/10.1145/779928.779977
Poola D, Ramamohanarao K, Buyya R (2014) Fault-tolerant workflow scheduling using spot instances on clouds. In: Proceedings of the International Conference on Computational Science, ICCS 2014, Cairns, Queensland, Australia, 10–12 June, 2014, pp 523–533. https://doi.org/10.1016/j.procs.2014.05.047
Poola D, Ramamohanarao K, Buyya R (2016) Enhancing reliability of workflow execution using task replication and spot instances. TAAS 10(4):30:1–30:21. https://doi.org/10.1145/2815624
Porter R (2004) Mechanism design for online real-time scheduling. In: Proceedings of the 5th ACM Conference on Electronic Commerce, ACM, New York, NY, USA, EC ’04, pp 61–70. https://doi.org/10.1145/988772.988783
Qu C, Calheiros RN, Buyya R (2016) A reliable and cost-efficient auto-scaling system for web applications using heterogeneous spot instances. J Netw Comput Appl 65:167–180. https://doi.org/10.1016/j.jnca.2016.03.001
Salehan A, Deldari H, Abrishami S (2017) An online valuation-based sealed winner-bid auction game for resource allocation and pricing in clouds. J Supercomput 73(11):4868–4905
Sharma P, Lee S, Guo T, Irwin D, Shenoy P (2015) Spotcheck: designing a derivative IaaS cloud on the spot market. In: Proceedings of the Tenth European Conference on Computer Systems, ACM, New York, NY, USA, EuroSys ’15, pp 16:1–16:15. https://doi.org/10.1145/2741948.2741953
Sharma P, Irwin D, Shenoy P (2016) How not to bid the cloud. In: Proceedings of the 8th USENIX Conference on Hot Topics in Cloud Computing, USENIX Association, Berkeley, CA, USA, HotCloud’16, pp 1–6. http://dl.acm.org/citation.cfm?id=3027041.3027042
Shroff G (2010) Enterprise cloud computing: technology, architecture, applications. Cambridge University Press, Cambridge
Singh VK, Dutta K (2015) Dynamic price prediction for amazon spot instances. In: 48th Hawaii International Conference on System Sciences, HICSS 2015, Kauai, Hawaii, USA, January 5–8, 2015, pp 1513–1520. https://doi.org/10.1109/HICSS.2015.184
Sinha PK (1996) Distributed operating systems: concepts and design, 1st edn. Wiley-IEEE Press, Hoboken
Sinha PK (2012) Distributed operating systems: concepts and design. PHI Learning Pvt, Ltd, New Delhi
Song Y, Zafer M, Lee KW (2012) Optimal bidding in spot instance market. In: 2012 Proceedings IEEE INFOCOM, pp 190–198. https://doi.org/10.1109/INFCOM.2012.6195567
Subramanya S, Guo T, Sharma P, Irwin D, Shenoy P (2015) Spoton: a batch computing service for the spot market. In: Proceedings of the Sixth ACM Symposium on Cloud Computing, ACM, New York, NY, USA, SoCC ’15, pp 329–341. https://doi.org/10.1145/2806777.2806851
Taifi M (2011) ACM SRC poster: Spotmpi: auction-based high performance cloud computing. In: Conference on High Performance Computing Networking, Storage and Analysis—Companion Volume, SC 2011, Seattle, WA, USA, November 12–18, 2011, pp 115–116. https://doi.org/10.1145/2148600.2148660
Taifi M, Shi JY, Khreishah A (2011) Spotmpi: A framework for auction-based HPC computing using amazon spot instances. In: Algorithms and Architectures for Parallel Processing—11th International Conference, ICA3PP, Melbourne, Australia, October 24–26, 2011, proceedings, part II, pp 109–120. https://doi.org/10.1007/978-3-642-24669-2_11
Tang S, Yuan J, Li Xy (2012a) Amazing: An optimal bidding strategy for amazon EC2 cloud spot instance. https://scholar.google.co.in/scholar?hl=en&as_sdt=0%2C5&q=AMAZING%3A+An+Optimal+Bidding+Strategy+for+Amazon+EC2+cloud+spot+instances&btnG=
Tang S, Yuan J, Li XY (2012b) Towards optimal bidding strategy for amazon EC2 cloud spot instance. In: 2012 IEEE Fifth International Conference on Cloud Computing, pp 91–98. https://doi.org/10.1109/CLOUD.2012.134
Tang S, Yuan J, Wang C, Li X (2014) A framework for amazon EC2 bidding strategy under SLA constraints. IEEE Trans Parallel Distrib Syst 25(1):2–11. https://doi.org/10.1109/TPDS.2013.15
Toosi AN, Khodadadi F, Buyya R (2016) SipaaS: spot instance pricing as a service framework and its implementation in openstack. Concurr Comput Pract Exp 28(13):3672–3690. https://doi.org/10.1002/cpe.3749
Veena K, Anand C, Gupta CP (2016) Temporal and spatial trend analysis of cloud spot instance pricing in amazon EC2. In: 2016 IEEE 14th International Conference on Dependable, Autonomic and Secure Computing, 14th International Conference on Pervasive Intelligence and Computing, 2nd International Conference on Big Data Intelligence and Computing and Cyber Science and Technology Congress, DASC/PiCom/DataCom/CyberSciTech 2016, Auckland, New Zealand, August 8–12, 2016, pp 909–912. https://doi.org/10.1109/DASC-PICom-DataCom-CyberSciTec.2016.157
Voorsluys W, Buyya R (2012) Reliable provisioning of spot instances for compute-intensive applications. In: IEEE 26th International Conference on Advanced Information Networking and Applications, AINA, 2012, Fukuoka, Japan, March 26–29, 2012, pp 542–549. https://doi.org/10.1109/AINA.2012.106
Wallace RM, Turchenko V, Sheikhalishahi M, Turchenko I, Shults V, Vazquez-Poletti JL, Grandinetti L (2013) Applications of neural-based spot market prediction for cloud computing. In: 2013 IEEE 7th International Conference on Intelligent Data Acquisition and Advanced Computing Systems (IDAACS), vol 02, pp 710–716. https://doi.org/10.1109/IDAACS.2013.6663017
Wang P, Qi Y, Hui D, Rao L, Liu X (2013) Present or future: optimal pricing for spot instances. In: 2013 IEEE 33rd International Conference on Distributed Computing Systems, pp 410–419. https://doi.org/10.1109/ICDCS.2013.68
Xu H, Li B (2013) A study of pricing for cloud resources. SIGMETRICS Perform Eval Rev 40(4):3–12. https://doi.org/10.1145/2479942.2479944
Xu Z, Stewart C, Deng N, Wang X (2016) Blending on-demand and spot instances to lower costs for in-memory storage. In: 35th Annual IEEE International Conference on Computer Communications, INFOCOM 2016, San Francisco, CA, USA, April 10–14, 2016, pp 1–9. https://doi.org/10.1109/INFOCOM.2016.7524348
Yi S, Kondo D, Andrzejak A (2010) Reducing costs of spot instances via checkpointing in the amazon elastic compute cloud. In: IEEEE International Conference on Cloud Computing, CLOUD 2010, Miami, FL, USA, 5–10 July, 2010, pp 236–243. https://doi.org/10.1109/CLOUD.2010.35
Yi S, Andrzejak A, Kondo D (2012) Monetary cost-aware checkpointing and migration on amazon cloud spot instances. IEEE Trans Serv Comput 5(4):512–524. https://doi.org/10.1109/TSC.2011.44
Zafer M, Song Y, Lee KW (2012) Optimal bids for spot VMS in a cloud for deadline constrained jobs. In: Proceedings of the 2012 IEEE Fifth International Conference on Cloud Computing, IEEE Computer Society, Washington, DC, USA, CLOUD ’12, pp 75–82. https://doi.org/10.1109/CLOUD.2012.9
Zaman S, Grosu D (2011) Efficient bidding for virtual machine instances in clouds. In: 2011 IEEE 4th International Conference on Cloud Computing, pp 41–48. https://doi.org/10.1109/CLOUD.2011.49
Zhao H, Pan M, Liu X, Li X, Fang Y (2012) Optimal resource rental planning for elastic applications in cloud market. In: Proceedings of the 2012 IEEE 26th International Parallel and Distributed Processing Symposium, IEEE Computer Society, Washington, DC, USA, IPDPS ’12, pp 808–819. https://doi.org/10.1109/IPDPS.2012.77
Zheng L, Joe-Wong C, Tan CW, Chiang M, Wang X (2015) How to bid the cloud. In: Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication, ACM, New York, NY, USA, SIGCOMM ’15, pp 71–84. https://doi.org/10.1145/2785956.2787473
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Mishra, A.K., Umrao, B.K. & Yadav, D.K. A survey on optimal utilization of preemptible VM instances in cloud computing. J Supercomput 74, 5980–6032 (2018). https://doi.org/10.1007/s11227-018-2509-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11227-018-2509-0