Performance Evaluation of Containers for HPC

  • Cristian RuizEmail author
  • Emmanuel Jeanvoine
  • Lucas Nussbaum
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9523)


Container-based virtualization technologies such as LXC or Docker have gained a lot of interest recently, especially in the HPC context where they could help to address a number of long-running issues. Even if they have proven to perform better than full-fledged, hypervisor-based, virtualization solutions, there are still a lot of questions about the use of container solutions in the HPC context. This paper evaluates the performance of Linux-based container solutions that rely on cgroups and namespaces using the NAS parallel benchmarks, in various configurations. We show that containers technology has matured over the years, and that performance issues are being solved.


HPC Virtualization Containers NAS parallel benchmarks 


Experiments presented in this paper were carried out using the Grid’5000 testbed, supported by a scientific interest group hosted by Inria and including CNRS, RENATER and several Universities as well as other organizations (see


  1. 1.
  2. 2.
    Agesen, O., Garthwaite, A., Sheldon, J., Subrahmanya, P.: The evolution of an x86 virtual machine monitor. SIGOPS Oper. Syst. Rev. 44(4), 3–18 (2010). CrossRefGoogle Scholar
  3. 3.
    Balouek, D., et al.: Adding virtualization capabilities to the grid’5000 testbed. In: Ivanov, I.I., van Sinderen, M., Leymann, F., Shan, T. (eds.) CLOSER 2012. CCIS, vol. 367, pp. 3–20. Springer, Heidelberg (2013) CrossRefGoogle Scholar
  4. 4.
    Bédaride, P., et al.: Toward better simulation of MPI applications on Ethernet/TCP networks. In: Jarvis, S.A., Wright, S.A., Hammond, S.D. (eds.) PMBS 2013. LNCS, vol. 8551, pp. 157–180. Springer, Heidelberg (2014). Google Scholar
  5. 5.
    Felter, W., et al.: An updated performance comparison of virtual machines and linux containers. In: ISPASS 2015, pp. 171–172, March 2015Google Scholar
  6. 6.
    Felter, W., et al.: An updated performance comparison of virtual machines and linux containers. Tech. report, IBM (2015)Google Scholar
  7. 7.
    Hill, Z., Humphrey, M.: A quantitative analysis of high performance computing with amazon’s ec2 infrastructure: the death of the local cluster? In: Grid 2009, pp. 26–33, October 2009Google Scholar
  8. 8.
    Matthews, J.N., et al.: Quantifying the performance isolation properties of virtualization systems. In: Experimental Computer Science, p. 6 (2007)Google Scholar
  9. 9.
    Nussbaum, L., Anhalt, F., Mornard, O., Gelas, J.P.: Linux-based virtualization for HPC clusters. In: Linux Symposium, Montreal, Canada (2009)Google Scholar
  10. 10.
    Regola, N., Ducom, J.C.: Recommendations for virtualization technologies in high performance computing. In: CloudCom 2010, pp. 409–416 (2010)Google Scholar
  11. 11.
    Ruiz, C., Harrache, S., Mercier, M., Richard, O.: Reconstructable software appliances with kameleon. SIGOPS Oper. Syst. Rev. 49(1), 80–89 (2015)CrossRefGoogle Scholar
  12. 12.
    Sarzyniec, L., et al.: Design and evaluation of a virtual experimental environment for distributed systems. In: PDP 2013, pp. 172–179, Belfast, February 2013Google Scholar
  13. 13.
    Shende, S.S., Malony, A.D.: The tau parallel performance system. Int. J. High Perform. Comput. Appl. 20, 287–331 (2006)CrossRefGoogle Scholar
  14. 14.
    Subhlok, J., et al.: Characterizing NAS benchmark performance on shared heterogeneous networks. In: HCW 2002, Washington, D.C., USA, p. 91 (2002)Google Scholar
  15. 15.
    Tudoran, R., et al.: A performance evaluation of azure and nimbus clouds for scientific applications. In: CloudCP 2012, New York, NY, USA, pp. 4:1–4:6 (2012)Google Scholar
  16. 16.
    Vasudevan, V., Phanishayee, A., Shah, H., Krevat, E., Andersen, D.G., Ganger, G.R., Gibson, G.A., Mueller, B.: Safe and effective fine-grained TCP retransmissions for datacenter communication. In: Proceedings of the ACM SIGCOMM 2009 Conference on Data Communication, SIGCOMM 2009, pp. 303–314. ACM, New York (2009).
  17. 17.
    Walter, J., Chaudhary, V., Cha, M., Guercio, S., Gallo, S.: A comparison of virtualization technologies for HPC. In: AINA 2008, pp. 861–868, March 2008Google Scholar
  18. 18.
    Xavier, M., et al.: Performance evaluation of container-based virtualization for high performance computing environments. In: PDP 2013, pp. 233–240, Belfast, February 2013Google Scholar
  19. 19.
    Youseff, L., et al.: Evaluating the performance impact of xen on mpi and process execution for hpc systems. In: VTDC 2006, p. 1, Washington (2006)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Cristian Ruiz
    • 1
    • 2
    • 3
    Email author
  • Emmanuel Jeanvoine
    • 1
    • 2
    • 3
  • Lucas Nussbaum
    • 1
    • 2
    • 3
  1. 1.InriaVillers-lés-NancyFrance
  2. 2.LORIAUniversité de LorraineNancyFrance
  3. 3.CNRS, LORIA- UMR 7503NancyFrance

Personalised recommendations