Skip to main content
SpringerLink
Log in

A Stochastic Bin Packing Approach for Server Consolidation with Conflicts

  • Conference paper
  • First Online:
Operations Research Proceedings 2019

Part of the book series: Operations Research Proceedings ((ORP))

Abstract

The energy consumption of large-scale data centers or server clusters is expected to grow significantly in the next couple of years contributing to up to 13% of the worldwide energy demand in 2030. As the involved processing units require a disproportional amount of energy when they are idle, underutilized or overloaded, balancing the supply of and the demand for computing resources is a key issue to obtain energy-efficient server consolidations. Whereas traditional concepts mostly consider deterministic predictions of the future workloads or only aim at finding approximate solutions, here we propose an exact bin packing based approach to tackle the problem of assigning jobs with (not necessarily independent) stochastic characteristics to a minimal amount of servers subject to further practical constraints. Finally, this new approach is tested against real-world instances obtained from a Google data center.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Andrae, A.S.G., Edler, T.: On global electricity usage of communication technology: trends to 2030. Challenges 6(1), 117–157 (2015)

    Article  Google Scholar 

  2. Balakrishnan, N., Nevzorov, V.B.: A Primer on Statistical Distributions, 1st edn. Wiley, New York (2003)

    Book  Google Scholar 

  3. Benson, T., Anand, A., Akella, A., Zhang, M.: Understanding data center traffic characteristics. Comput. Commun. Rev. 40(1), 92–99 (2010)

    Article  Google Scholar 

  4. Cisco: Cisco Global Cloud Index: Forecast and Methodology, 2016–2021. White Paper (2018). http://www.cisco.com/en/US/solutions/collateral/ns341/ns525/ns537/ns705/ns1175/Cloud_Index_White_Paper.html

  5. Corcoran, P.M., Andrae, A.S.G.: Emerging Trends in Electricity Consumption for Consumer ICT. Technical Report (2013). http://aran.library.nuigalway.ie/xmlui/handle/10379/3563

  6. Dargie, W.: A stochastic model for estimating the power consumption of a server. IEEE Trans. Comput. 64(5), 1311–1322 (2015)

    Article  Google Scholar 

  7. Delorme, M. Iori, M., Martello, S.: Bin packing and cutting stock problems: mathematical models and exact algorithms. Eur. J. Oper. Res. 255, 1–20 (2016)

    Article  Google Scholar 

  8. Goel, A., Indyk, P.: Stochastic Load Balancing and Related Problems. In: Proceeding of 40th Annual Symposium on Foundations of Computer Science, pp. 579–586 (1999)

    Google Scholar 

  9. Hähnel, M., Martinovic, J., Scheithauer, G., Fischer, A., Schill, A., Dargie, W.: Extending the cutting stock problem for consolidating services with stochastic workloads. IEEE Trans. Parallel Distrib. Syst. 29(11), 2478–2488 (2018)

    Article  Google Scholar 

  10. Kantorovich, L.V.: Mathematical methods of organising and planning production. Manag. Sci. 6, 366–422 (1939 Russian, 1960 English)

    Google Scholar 

  11. Kleinberg, J., Rabani, Y., Tardos, E.: Allocating bandwidth for Bursty connections. SIAM J. Comput. 30(1), 191–217 (2000)

    Article  Google Scholar 

  12. Martinovic, J., Hähnel, M., Dargie, W., Scheithauer, G.: A Stochastic Bin Packing Approach for Server Consolidation with Conflicts. Preprint MATH-NM-02-2019, Technische Universität Dresden (2019). http://www.optimization-online.org/DB_HTML/2019/07/7274.html

  13. Martinovic, J., Hähnel, M., Scheithauer, G., Dargie, W., Fischer, A.: Cutting stock problems with nondeterministic item lengths: a new approach to server consolidation. 4OR 17(2), 173–200 (2019)

    Google Scholar 

  14. Reiss, C., Wilkes, J., Hellerstein, J.L.: Google cluster-usage traces: format + schema. Technical Report, Google Inc., Mountain View (2011)

    Google Scholar 

  15. Wang, M., Meng, X., Zhang, L.: Consolidating virtual machines with dynamic bandwidth demand in data centers. Proceedings of IEEE INFOCOM, pp. 71–75 (2011)

    Google Scholar 

  16. Yu, L., Chen, L., Cai, Z., Shen, H., Liang, Y., Pan, Y.: Stochastic load balancing for virtual resource management in datacenters. IEEE Trans. Cloud Comput. 8(2), 459–472 (2020)

    Article  Google Scholar 

Download references

Acknowledgements

This work is supported in part by the German Research Foundation (DFG) within the Collaborative Research Center SFB 912 (HAEC).

Author information

Authors and Affiliations

  1. Institute of Numerical Mathematics, Technische Universität Dresden, Dresden, Germany

    John Martinovic & Guntram Scheithauer

  2. Chair for Computer Networks, Technische Universität Dresden, Dresden, Germany

    Markus Hähnel & Waltenegus Dargie

Authors
  1. John Martinovic
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Markus Hähnel
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Waltenegus Dargie
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Guntram Scheithauer
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to John Martinovic .

Editor information

Editors and Affiliations

  1. Faculty of Business and Economics, TU Dresden, Dresden, Germany

    Janis S. Neufeld

  2. Faculty of Business and Economics, TU Dresden, Dresden, Germany

    Udo Buscher

  3. Faculty of Business and Economics, TU Dresden, Dresden, Germany

    Rainer Lasch

  4. Faculty of Business and Economics, TU Dresden, Dresden, Germany

    Dominik Möst

  5. Faculty of Transportation and Traffic, TU Dresden, Dresden, Germany

    Jörn Schönberger

Rights and permissions

Reprints and permissions

Copyright information

© 2020 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Martinovic, J., Hähnel, M., Dargie, W., Scheithauer, G. (2020). A Stochastic Bin Packing Approach for Server Consolidation with Conflicts. In: Neufeld, J.S., Buscher, U., Lasch, R., Möst, D., Schönberger, J. (eds) Operations Research Proceedings 2019. Operations Research Proceedings. Springer, Cham. https://doi.org/10.1007/978-3-030-48439-2_19

Download citation

Publish with us

Policies and ethics

Search

Navigation