Abstract
The metrics presented in this chapter are applicable for use in performance benchmarks that measure the performance without requiring internal knowledge. They are preferable in situations where different request sources use the functions of a shared system with a similar call probability and demand per request but with a different load intensity. These characteristics are typical for multi-tenant applications but can also occur in other shared resource systems. This chapter introduces the metrics and provides a case study showing how they can be used in a real-life environment.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Brataas, G. (2014). CloudScale: Design support deliverable D1.2. EU FP7, Collaboration Project CloudScale. FP7-ICT-2011-8-317704.
Cooper, B., Silberstein, A., Tam, E., Ramakrishnan, R., & Sears, R. (2010). Benchmarking cloud serving systems with YCSB. In Proceedings of the 1st ACM Symposium on Cloud Computing (SoCC 2010), Indianapolis, IN (pp. 143–154). New York, NY: ACM.
Gupta, D., Cherkasova, L., Gardner, R., & Vahdat, A. (2006). Enforcing performance isolation across virtual machines in Xen. In Proceedings of the ACM/IFIP/USENIX 2006 International Conference on Middleware, Melbourne (pp. 342–362). New York, NY: Springer.
Herbst, N. R., Kounev, S., & Reussner, R. (2013). Elasticity in cloud computing: What it is, and what it is not. In Proceedings of the 10th International Conference on Autonomic Computing (ICAC 2013). San Jose, CA: USENIX.
Herbst, N. R., Krebs, R., Oikonomou, G., Kousiouris, G., Evangelinou, A., Iosup, A., et al. (2016). Ready for rain? A view from SPEC research on the future of cloud metrics. Tech. rep. SPEC-RG-2016-01. Gainsville, VA: SPEC RG—Cloud Working Group, Standard Performance Evaluation Corporation (SPEC).
Herbst, N. R., Bauer, A., Kounev, S., Oikonomou, G., van Eyk, E., Kousiouris, G., et al. (2018). Quantifying cloud performance and dependability: Taxonomy metric design, and emerging challenges. ACM Transactions on Modeling and Performance Evaluation of Computing Systems, 3(4), 19:1–19:36.
Huber, N., von Quast, M., Hauck, M., & Kounev, S. (2011). Evaluating and modeling virtualization performance overhead for cloud environments. In Proceedings of the 1st International Conference on Cloud Computing and Services Science (CLOSER 2011) (pp. 563–573). Noordwijkerhout: SciTePress.
Iosup, A., Ostermann, S., Yigitbasi, M. N., Prodan, R., Fahringer, T., & Epema, D. (2011). Performance analysis of cloud computing services for many-tasks scientific computing. IEEE Transactions on Parallel and Distributed Systems, 22(6), 931–945.
Iosup, A., Yigitbasi, N., & Epema, D. (2011). On the performance variability of production cloud services. In 2011 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid 2011), Newport Beach, CA (pp. 104–113). Piscataway, NJ: IEEE.
Islam, S., Lee, K., Fekete, A., & Liu, A. (2012). How a consumer can measure elasticity for cloud platforms. In Proceedings of the 3rd ACM/SPEC International Conference on Performance Engineering (ICPE 2012), Boston, MA (pp. 85–96). New York, NY: ACM.
Janert, P. (2013). Feedback control for computer systems. Sebastopol, CA: O’Reilly and Associates.
Krebs, R. (2015). Performance isolation in multi-tenant applications. PhD thesis. Karlsruhe: Karlsruhe Institute of Technology (KIT).
Krebs, R., Momm, C., & Kounev, S. (2012). Architectural concerns in multi-tenant SaaS applications. In Proceedings of the 2nd International Conference on Cloud Computing and Services Science (CLOSER 2012). Setubal: SciTePress.
Krebs, R., Momm, C., & Kounev, S. (2014). Metrics and techniques for quantifying performance isolation in cloud environments. Science of Computer Programming, 90, Part B, 116–134.
Krebs, R., Spinner, S., Ahmed, N., & Kounev, S. (2014). Resource usage control in multi-tenant applications. In Proceedings of the 14th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid 2014), Chicago, IL (pp. 122–131). Piscataway, NJ: IEEE.
Kupperberg, M., Herbst, N. R., Kistowski, J. von, & Reussner, R. (2011). Defining and quantifying elasticity of resources in cloud computing and scalable platforms. Tech. rep. 2011–16. Karlsruhe: Karlsruhe Institute of Technology (KIT).
Schad, J., Dittrich, J., & Quiané-Ruiz, J.-A. (2010). Runtime measurements in the cloud: Observing, analyzing, and reducing variance. Proceedings of the VLDB Endowment, 3(1–2), 460–471.
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Kounev, S., Lange, KD., Kistowski, J.v. (2020). Performance Isolation. In: Systems Benchmarking. Springer, Cham. https://doi.org/10.1007/978-3-030-41705-5_16
Download citation
DOI: https://doi.org/10.1007/978-3-030-41705-5_16
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-41704-8
Online ISBN: 978-3-030-41705-5
eBook Packages: Computer ScienceComputer Science (R0)