Comparing AWS Deployments Using Model-Based Predictions

  • Einar Broch Johnsen
  • Jia-Chun Lin
  • Ingrid Chieh Yu
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9953)

Abstract

Cloud computing provides on-demand resource provisioning for scalable applications with a pay-as-you-go pricing model. However, the cost-efficient use of virtual resources requires the application to exploit the available resources efficiently. Will an application perform equally well on fewer or cheaper resources? Will the application successfully finish on these resources? We have previously proposed a model-centric approach, ABS-YARN, for prototyping deployment decisions to answer such questions during the design of an application. In this paper, we make model-centric predictions for applications on Amazon Web Services (AWS), which is a prominent platform for cloud deployment. To demonstrate how ABS-YARN can help users make deployment decisions with a high cost-performance ratio on AWS, we design several workload scenarios based on MapReduce benchmarks and execute these scenarios on ABS-YARN by considering different AWS resource purchasing options.

References

  1. 1.
    Amazon EC2 FAQs. Q: What is an “EC2 compute unit” and why did you introduce it? https://aws.amazon.com/ec2/faqs/#hardware-information. Accessed 27 April 2016
  2. 2.
  3. 3.
  4. 4.
    Armbrust, M., Fox, A., Griffith, R., Joseph, A.D., Katz, R., Konwinski, A., Lee, G., Patterson, D., Rabkin, A., Stoica, I., Zaharia, M.: A view of cloud computing. Commun. ACM 53(4), 50–58 (2010)CrossRefGoogle Scholar
  5. 5.
    Bjørk, J., de Boer, F.S., Johnsen, E.B., Schlatte, R., Tapia Tarifa, S.L.: User-defined schedulers for real-time concurrent objects. Innovations Syst. Softw. Eng. 9(1), 29–43 (2013)CrossRefGoogle Scholar
  6. 6.
    Bort, J.: Amazon still dominates the $16 billion cloud market. UK Business Insider, February 2015. http://uk.businessinsider.com/synergy-research-amazon-dominates-16-billion-cloud-market-2015-2
  7. 7.
    Clavel, M., Durán, F., Eker, S., Lincoln, P., Martí-Oliet, N., Meseguer, J., Talcott, C.L.: All About Maude - A High-Performance Logical Framework: How to Specify, Program and Verify Systems in Rewriting Logic. LNCS, vol. 4350. Springer, Heidelberg (2007)MATHGoogle Scholar
  8. 8.
  9. 9.
    Garfinkel, S.L.: An evaluation of Amazon’s grid computing services: EC2, S3, and SQS. Technical report TR-08-07, Center for Research on Computation and Society School for Engineering and Applied sciences, Harvard University, August 2007. https://dash.harvard.edu/handle/1/24829568
  10. 10.
    Hähnle, R., Johnsen, E.B.: Designing resource-aware cloud applications. IEEE Comput. 48(6), 72–75 (2015)CrossRefGoogle Scholar
  11. 11.
    Hazelhurst, S.: Scientific computing using virtual high-performance computing: a case study using the Amazon elastic computing cloud. In: Proceedings of the 2008 Annual Research Conference of the South African Institute of Computer Scientists and Information Technologists on IT research in Developing Countries: Riding the Wave of Technology, SAICSIT 2008, pp. 94–103. ACM (2008)Google Scholar
  12. 12.
    Jackson, K.R., Ramakrishnan, L., Muriki, K., Canon, S., Cholia, S., Shalf, J., Wasserman, H.J., Wright, N.J.: Performance analysis of high performance computing applications on the amazon web services cloud. In: 2nd IEEE International Conference on Cloud Computing Technology and Science, CloudCom 2010, pp. 159–168. IEEE (2010)Google Scholar
  13. 13.
    Johnsen, E.B., Hähnle, R., Schäfer, J., Schlatte, R., Steffen, M.: ABS: a core language for abstract behavioral specification. In: Aichernig, B.K., de Boer, F.S., Bonsangue, M.M. (eds.) FMCO 2010. LNCS, vol. 6957, pp. 142–164. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  14. 14.
    Johnsen, E.B., Schlatte, R., Tapia Tarifa, S.L.: Integrating deployment architectures and resource consumption in timed object-oriented models. J. Logical Algebraic Methods Programm. 84(1), 67–91 (2015)CrossRefMATHGoogle Scholar
  15. 15.
    Lin, J.-C., Yu, I.C., Johnsen, E.B., Lee, M.-C.: ABS-YARN: a formal framework for modeling hadoop YARN clusters. In: Stevens, P., et al. (eds.) FASE 2016. LNCS, vol. 9633, pp. 49–65. Springer, Heidelberg (2016). doi:10.1007/978-3-662-49665-7_4 CrossRefGoogle Scholar
  16. 16.
    Murthy, A., Vavilapalli, V., Eadline, D., Niemiec, J., Markham, J.: Apache Hadoop YARN: Moving Beyond MapReduce and Batch Processing with Apache Hadoop 2. Addison-Wesley Professional, Reading (2014)Google Scholar
  17. 17.
    Napper, J., Bientinesi, P.: Can cloud computing reach the top 500? In: Proceedings of the Combined Workshops on UnConventional High Performance Computing Workshop Plus Memory Access Workshop, UCHPC-MAW 2009, pp. 17–20. ACM (2009)Google Scholar
  18. 18.
    Ostermann, S., Iosup, A., Yigitbasi, N., Prodan, R., Fahringer, T., Epema, D.: An early performance analysis of cloud computing services for scientific computing. Technical report PDS-2008-006, Delft University of Technology, December 2008. http://www.ds.ewi.tudelft.nl/reports/2008/PDS-2008-006.pdf
  19. 19.
    Ramakrishnan, L., Jackson, K.R., Canon, S., Cholia, S., Shalf, J.: Defining future platform requirements for e-science clouds. In: Proceedings of the 1st ACM Symposium on Cloud Computing, SoCC 2010, pp. 101–106. ACM (2010)Google Scholar
  20. 20.
    Stantchev, V.: Performance evaluation of cloud computing offerings. In: 2009 Third International Conference on Advanced Engineering Computing and Applications in Sciences, ADVCOMP 2009, pp. 187–192. IEEE (2009)Google Scholar
  21. 21.
    Vavilapalli, V.K., Murthy, A.C., Douglas, C., Agarwal, S., Konar, M., Evans, R., Graves, T., Lowe, J., Shah, H., Seth, S., Saha, B., Curino, C., O’Malley, O., Radia, S., Reed, B., Baldeschwieler, E.: Apache hadoop YARN: yet another resource negotiator. In: Lohman, G.M. (ed.) ACM Symposium on Cloud Computing (SOCC 2013), pp. 5:1–5:16 (2013)Google Scholar

Copyright information

© Springer International Publishing AG 2016

Authors and Affiliations

  • Einar Broch Johnsen
    • 1
  • Jia-Chun Lin
    • 1
  • Ingrid Chieh Yu
    • 1
  1. 1.Department of InformaticsUniversity of OsloOsloNorway

Personalised recommendations