Skip to main content

Advertisement

SpringerLink
Log in
Menu
Find a journal Publish with us
Search
Cart
Book cover

European Conference on Parallel Processing

Euro-Par 2011: Euro-Par 2011: Parallel Processing Workshops pp 213–222Cite as

  1. Home
  2. Euro-Par 2011: Parallel Processing Workshops
  3. Conference paper
Performance Evaluation of HPC Benchmarks on VMware’s ESXi Server

Performance Evaluation of HPC Benchmarks on VMware’s ESXi Server

  • Qasim Ali30,
  • Vladimir Kiriansky30,
  • Josh Simons30 &
  • …
  • Puneet Zaroo30 
  • Conference paper
  • 1546 Accesses

  • 13 Citations

Part of the Lecture Notes in Computer Science book series (LNTCS,volume 7155)

Abstract

A major obstacle to virtualizing HPC workloads is a concern about the performance loss due to virtualization. We will demonstrate that new features significantly enhance the performance and scalability of virtualized HPC workloads on VMware’s virtualization platform. Specifically, we will discuss VMware’s ESXi Server performance for virtual machines with up to 64 virtual CPUs as well as support for exposing virtual NUMA topology to guest operating systems, enabling the operating system and applications to make intelligent NUMA aware decisions about memory allocation and process/thread placement. NUMA support is especially important for large VMs which necessarily span host NUMA nodes on all modern hardware. We will show how the virtual NUMA topology is chosen to closely match physical host topology, while preserving the now expected virtualization benefits of portability and load balancing. We show that the benefit of exposing the virtual NUMA topology can lead to performance gains of up to 167%. Overall, we will show close to native performance on applications from SPEC MPI V2.0 and SPEC OMP V3.2 benchmarks virtualized on our prototype VMware’s ESXi Server.

Keywords

  • Non Uniform Memory Architecture (NUMA)
  • ESXi
  • High Performance Computing (HPC)
  • virtual NUMA (vNUMA)
  • virtualization

Download conference paper PDF

References

  1. Advanced Configuration and Power Interface specification, rev 4.0a (2009), http://www.acpi.info/spec40.htm

  2. Agesen, O., Garthwaite, A., Sheldon, J., Subrahmanyam, P.: The evolution of an x86 virtual machine monitor. Operating Systems Review 44(4) (2010)

    Google Scholar 

  3. Scalable Infrastructure with the CPU scheduler in VMware ESX 4.1, http://www.vmware.com/files/pdf/techpaper/VMW_vSphere41_cpu_schedule_ESX.pdf

  4. Gavrilovska, A., Kumar, S., et al.: High-Performance Hypervisor Architectures: Virtualization in HPC Systems. In: HPCVirt 2007: 1st Workshop on System-level Virtualization for High Performance Computing (2007)

    Google Scholar 

  5. Huang, W., Gao, Q., Liu, J., Panda, D.K.: High performance virtual machine migration with RDMA over modern interconnects. In: Proceedings of the 2007 IEEE International Conference on Cluster Computing, CLUSTER 2007, pp. 11–20. IEEE Computer Society, Washington, DC (2007)

    CrossRef  Google Scholar 

  6. Mergen, M.F., Uhlig, V., Krieger, O., Xenidis, J.: Virtualization for high-performance computing. SIGOPS Oper. Syst. Rev. 40, 8–11 (2006)

    CrossRef  Google Scholar 

  7. Nagarajan, A.B., Mueller, F.: Proactive fault tolerance for HPC with Xen Virtualization. In: Proceedings of the 21st Annual International Conference on Supercomputing (ICS 2007), pp. 23–32. ACM Press (2007)

    Google Scholar 

  8. Open MPI: Open Source High Performance Computing (2011), http://www.open-mpi.org

  9. Ranadive, A., Kesavan, M., Gavrilovska, A., Schwan, K.: Performance implications of virtualizing multicore cluster machines. In: Proceedings of the 2nd Workshop on System-Level Virtualization for High Performance Computing, HPCVirt 2008, pp. 1–8. ACM, New York (2008)

    CrossRef  Google Scholar 

  10. Rao, D., Schwan, K.: vNUMA-mgr: Managing VM memory on NUMA platforms. In: 2010 International Conference on High Performance Computing (HiPC), pp. 1–10 (December 2010)

    Google Scholar 

  11. Simons, J.E., Buell, J.: Virtualizing high performance computing. SIGOPS Oper. Syst. Rev. 44, 136–145 (2010)

    CrossRef  Google Scholar 

  12. Valle, G., Engelmann, C., Scott, S.L., Naughton, T., Ong, H.: System-Level Virtualization for High Performance Computing, February 13-15 (2008)

    Google Scholar 

  13. Waldspurger, C.A.: Memory resource management in VMware ESX server. In: OSDI 2002: Proceedings of the 5th Symposium on Operating Systems Design and Implementation, pp. 181–194. ACM Press, New York (2002)

    CrossRef  Google Scholar 

  14. Youseff, L., Seymour, K., You, H., Dongarra, J., Wolski, R.: The impact of paravirtualized memory hierarchy on linear algebra computational kernels and software. In: Proceedings of the 17th International Symposium on High Performance Distributed Computing, HPDC 2008, pp. 141–152. ACM, New York (2008)

    CrossRef  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. VMware, USA

    Qasim Ali, Vladimir Kiriansky, Josh Simons & Puneet Zaroo

Authors
  1. Qasim Ali
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Vladimir Kiriansky
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Josh Simons
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Puneet Zaroo
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Scilytics, Koellnerhofgasse 3/15A, 1010, Vienna, Austria

    Michael Alexander

  2. ICAR-CNR, Via P. Castellino, 111, 80131, Napoli, Italy

    Pasqua D’Ambra

  3. University of Amsterdam, 1090, Amsterdam, Netherlands

    Adam Belloum

  4. Innovative Computing Laboratory, The University of Tennessee, USA

    George Bosilca

  5. Department of Experimental Medicine and Clinic, University Magna Græcia, 88100, Catanzaro, Italy

    Mario Cannataro

  6. Computer Science Department, University of Pisa, Italy

    Marco Danelutto

  7. Second University of Naples, Italy

    Beniamino Di Martino

  8. TU München, Boltzmannstr. 3, 85748, Garching, Germany

    Michael Gerndt

  9. Equipe Runtime, INRIA Bordeaux Sud-Ouest, 33405, Talence Cedex, France

    Emmanuel Jeannot & Raymond Namyst & 

  10. Equipe HIEPACS, INRIA Bordeaux Sud-Ouest, 33405, Talence Cedex, France

    Jean Roman

  11. Oak Ridge National Laboratory, Computer Science and Mathematics Division, 37831-6164, Oak Ridge, TN, USA

    Stephen L. Scott

  12. Department of Scientific Computing, University of Vienna, Nordbergstr. 15/3C, 1090, Vienna, Austrial

    Jesper Larsson Traff

  13. Computer Science and Mathematics Division, Oak Ridge National Laboratory, 37831, Oak Ridge, TN, USA

    Geoffroy Vallée

  14. Technische Universität München, Germany

    Josef Weidendorfer

Rights and permissions

Reprints and Permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Ali, Q., Kiriansky, V., Simons, J., Zaroo, P. (2012). Performance Evaluation of HPC Benchmarks on VMware’s ESXi Server. In: Alexander, M., et al. Euro-Par 2011: Parallel Processing Workshops. Euro-Par 2011. Lecture Notes in Computer Science, vol 7155. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-29737-3_25

Download citation

  • .RIS
  • .ENW
  • .BIB
  • DOI: https://doi.org/10.1007/978-3-642-29737-3_25

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-29736-6

  • Online ISBN: 978-3-642-29737-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Share this paper

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

Search

Navigation

  • Find a journal
  • Publish with us

Discover content

  • Journals A-Z
  • Books A-Z

Publish with us

  • Publish your research
  • Open access publishing

Products and services

  • Our products
  • Librarians
  • Societies
  • Partners and advertisers

Our imprints

  • Springer
  • Nature Portfolio
  • BMC
  • Palgrave Macmillan
  • Apress
  • Your US state privacy rights
  • Accessibility statement
  • Terms and conditions
  • Privacy policy
  • Help and support

167.114.118.210

Not affiliated

Springer Nature

© 2023 Springer Nature