Skip to main content
SpringerLink
Log in

An Empirical Evaluation of the Energy and Performance Overhead of Monitoring Tools on Docker-Based Systems

  • Conference paper
  • First Online:
Service-Oriented Computing (ICSOC 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14419))

Included in the following conference series:

Abstract

Context. Energy efficiency is gaining importance in the design of software systems, but is still marginally addressed in the area of microservice-based systems. Energy-related aspects often get neglected in favor of other software quality attributes, such as performance, service composition, maintainability, and security.

Goal. The aim of this study is to identify, synthesize and empirically evaluate the energy and performance overhead of monitoring tools employed in the microservices and DevOps context.

Method. We selected four representative monitoring tools in the microservices and DevOps context. These were evaluated via a controlled experiment on an open-source Docker-based microservice benchmark system.

Results. The results highlight: i) the specific frequency and workload conditions under which energy consumption and performance metrics are impacted by the tools; ii) the differences between the tools; iii) the relation between energy and performance overhead.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 74.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    https://www.netadata.cloud.

  2. 2.

    https://prometheus.io.

  3. 3.

    https://linux.die.net/man/1/sar.

  4. 4.

    https://github.com/FudanSELab/train-ticket.

  5. 5.

    https://www.elastic.co/beats/metricbeat.

  6. 6.

    https://github.com/google/cadvisor.

  7. 7.

    https://zipkin.io/.

  8. 8.

    https://spring.io/projects/spring-cloud-sleuth.

  9. 9.

    https://github.com/S2-group/experiment-runner.

  10. 10.

    https://k6.io/.

  11. 11.

    https://powerapi-ng.github.io/smartwatts.html.

References

  1. Microservices (2023). https://martinfowler.com/articles/microservices.html

  2. Basili, V.R.: Software Modeling and Measurement: The Goal Question Metric Paradigm. Computer Science Technical Report Series, CS-TR-2956 (1992)

    Google Scholar 

  3. Cortellessa, V., Di Pompeo, D., Eramo, R., Tucci, M.: A model-driven approach for continuous performance engineering in microservice-based systems. J. Syst. Softw. 183, 111084 (2022)

    Article  Google Scholar 

  4. Di Francesco, P., Lago, P., Malavolta, I.: Architecting with microservices: a systematic mapping study. J. Syst. Softw. 150, 77–97 (2019)

    Article  Google Scholar 

  5. Ergasheva, S., Khomyakov, I., Kruglov, A., Succi, G.: Metrics of energy consumption in software systems: a systematic literature review. IOP Conf. Ser. Earth Environ. Sci. 431, 012051 (2020)

    Article  Google Scholar 

  6. Fahad, M., Shahid, A., Manumachu, R.R., Lastovetsky, A.: A comparative study of methods for measurement of energy of computing. Energies 12(11), 2204 (2019)

    Article  Google Scholar 

  7. Heward, G., Müller, I., Han, J., Schneider, J.G., Versteeg, S.: Assessing the performance impact of service monitoring. In: ASWEC 2010, pp. 192–201. IEEE (2010)

    Google Scholar 

  8. Hirst, J.M., Miller, J.R., Kaplan, B.A., Reed, D.D.: Watts up? pro ac power meter for automated energy recording (2013)

    Google Scholar 

  9. Khomh, F., Abtahizadeh, S.A.: Understanding the impact of cloud patterns on performance and energy consumption. J. Syst. Softw. 141, 151–170 (2018)

    Article  Google Scholar 

  10. Liu, M., Peter, S., Krishnamurthy, A., Phothilimthana, P.M.: E3: energy-efficient microservices on smartnic-accelerated servers. In: USENIX, pp. 363–378 (2019)

    Google Scholar 

  11. Merkel, D., et al.: Docker: lightweight linux containers for consistent development and deployment. Linux j 239(2), 2 (2014)

    Google Scholar 

  12. Pierce, C.A., Block, R.A., Aguinis, H.: Cautionary note on reporting eta-squared values from multifactor ANOVA designs. Educ. Psychol. Meas. 64(6), 916–924 (2004)

    Article  MathSciNet  Google Scholar 

  13. Romano, J., Kromrey, J.D., Coraggio, J., Skowronek, J.: Appropriate statistics for ordinal level data: Should we really be using t-test and cohen’sd for evaluating group differences on the NSSE and other surveys. In: FAIR, vol. 177, p. 34 (2006)

    Google Scholar 

  14. Santos, E.A., McLean, C., Solinas, C., Hindle, A.: How does docker affect energy consumption? evaluating workloads in and out of docker containers. J. Syst. Softw. 146, 14–25 (2018)

    Article  Google Scholar 

  15. Vegas, S., Apa, C., Juristo, N.: Crossover designs in software engineering experiments: benefits and perils. IEEE Trans. Softw. Eng. 42(2), 120–135 (2015)

    Article  Google Scholar 

  16. Verdecchia, R., Lago, P., Ebert, C., de Vries, C.: Green it and green software. IEEE Softw. 38(6), 7–15 (2021)

    Article  Google Scholar 

  17. Zhou, X., et al.: Benchmarking microservice systems for software engineering research. In: 40th ACM/IEEE International Conference on Software Engineering (ICSE) (2018)

    Google Scholar 

Download references

Acknowledgements

This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skło- dowska-Curie grant agreement No 871342 “uDEVOPS”.

Author information

Authors and Affiliations

  1. Vrije Universiteit Amsterdam, Amsterdam, The Netherlands

    Madalina Dinga & Ivano Malavolta

  2. University of Naples Federico II, Naples, Italy

    Luca Giamattei, Antonio Guerriero & Roberto Pietrantuono

Authors
  1. Madalina Dinga
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ivano Malavolta
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Luca Giamattei
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Antonio Guerriero
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Roberto Pietrantuono
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Luca Giamattei .

Editor information

Editors and Affiliations

  1. Sapienza University of Rome, Rome, Italy

    Flavia Monti

  2. Technical University of Munich, Garching, Germany

    Stefanie Rinderle-Ma

  3. University of Seville, Seville, Spain

    Antonio Ruiz Cortés

  4. Sun Yat-sen University, Guangzhou, China

    Zibin Zheng

  5. Sapienza University of Rome, Rome, Italy

    Massimo Mecella

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Dinga, M., Malavolta, I., Giamattei, L., Guerriero, A., Pietrantuono, R. (2023). An Empirical Evaluation of the Energy and Performance Overhead of Monitoring Tools on Docker-Based Systems. In: Monti, F., Rinderle-Ma, S., Ruiz Cortés, A., Zheng, Z., Mecella, M. (eds) Service-Oriented Computing. ICSOC 2023. Lecture Notes in Computer Science, vol 14419. Springer, Cham. https://doi.org/10.1007/978-3-031-48421-6_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-48421-6_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-48420-9

  • Online ISBN: 978-3-031-48421-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation