Abstract
WThe Virtual Machine (VM) technology has increased considerably within the last two decades and the performance of VMs seems closest to the host machine. This has motivated the use of VM in High Performance Computing (HPC). Running a scientific computation on VMs can severely impact the performance of applications. In addition, choosing the proper VM to run a specific application while minimizing the lost of performance is not an easy task. However, several virtualization solutions have been proposed. This paper presents the result of a comparison of the performance of the most commonly used VMs solutions: OpenVz, Linux-Vserver, LXC, XEN, KVM and VMware ESXi. The performance of these VMs are evaluated with the NAS benchmark, Lmbench, IOzone and Intel ® MPI Benchmark taking into account the consumption of resources such as CPU, memory, latency, disk and network communication. The result shows that some virtualization solutions present better performance in consumption of some of the previously mentioned resources than others. This work aims at helping a scientist in selecting the VM suitable to compute a specific task without a significant overhead on applications performance.
Article PDF
Similar content being viewed by others
References
R. J. Creasy, “The origin of the vm/370 time-sharing system,” IBM Journal of Research and Development, vol. 25, no. 5, pp. 483–490, 1981.
M. Intel, “Benchmark,” 2008.
S. Thibault and T. Deegan, “Improving performance by embedding HPC applications in lightweight xen domains,” in Proceedings of the 2nd workshop on System-level virtualization for high performance computing. ACM, 2008, pp. 9–15.
W. Huang, J. Liu, B. Abali, and D. K. Panda, “A case for high performance computing with virtual machines,” in Proceedings of the 20th annual international conference on Supercomputing. ACM, 2006, pp. 125–134.
J. N. Matthews, W. Hu, M. Hapuarachchi, T. Deshane, D. Dimatos, G. Hamilton, M. McCabe, and J. Owens, “Quantifying the performance isolation properties of virtualization systems,” in Proceedings of the 2007 workshop on Experimental computer science. ACM, 2007, p. 6.
M. F. Mergen, V. Uhlig, O. Krieger, and J. Xenidis, “Virtualization for high-performance computing,” ACM SIGOPS Operating Systems Review, vol. 40, no. 2, pp. 8–11, 2006.
C. Engelmann, S. L. Scott, H. Ong, G. Vall´ ee, and T. Naughton, “Configurable virtualized system environments for high performance computing,” in 1st workshop on system-level virtualization for high performance computing, Lisbon, Portugal. Citeseer, 2007.
G. Vallee, T. Naughton, and S. L. Scott, “System management soft- ware for virtual environments,” in Proceedings of the 4th international conference on Computing frontiers. ACM, 2007, pp. 153–160.
L. Youseff, R. Wolski, B. Gorda, and C. Krintz, “Paravirtualization for HPC systems,” in Frontiers of High Performance Computing and Networking–ISPA 2006 Workshops. Springer, 2006, pp. 474–486
R. VanderWijngaart and B. A. Biegel, “Nas parallel benchmarks. 2.4,” 2002.
D. Capps and W. Norcott, “Iozone filesystem benchmark,” 2008.
L. W. McVoy, C. Staelin et al., “lmbench: Portable tools for performance analysis.” in USENIX annual technical conference. San Diego, CA, USA, 1996, pp. 279–294.
S. Thibault and T. Deegan, “Improving performance by embedding HPC applications in lightweight xen domains,” in Proceedings of the 2nd workshop on System-level virtualization for high performance computing. ACM, 2008, pp. 9–15.
R. McDougall and J. Anderson, “Virtualization performance: perspectives and challenges ahead,” ACM SIGOPS Operating Systems Review, vol. 44, no. 4, pp. 40–56, 2010.
P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neuge-bauer, I. Pratt, and A. Warfield, “Xen and the art of virtualization,” ACM SIGOPS Operating Systems Review, vol. 37, no. 5, pp. 164–177, 2003.
M. G. Xavier, M. V. Neves, F. D. Rossi, T. C. Ferreto, T. Lange, and C. A. De Rose, “Performance evaluation of container-based virtualization for high performance computing environments,” in Parallel, Distributed and Network-Based Processing (PDP), 2013 21st Euromicro International Conference on. IEEE, 2013, pp. 233–240.
C. Macdonell and P. Lu, “Pragmatics of virtual machines for high performance computing: A quantitative study of basic overheads,” in Proc. of the High Perf. Computing & Simulation Conf, 2007.
V. Chaudhary, M. Cha, J. Walters, S. Guercio, and S. Gallo, “A comparison of virtualization technologies for hpc,” in Advanced Information Networking and Applications, 2008. AINA 2008. 22nd International Conference on. IEEE, 2008, pp. 861–868.
R. Jones et al., “Netperf: a network performance benchmark,” Information Networks Division, Hewlett-Packard Company, 1996.
Q. O. Snell, A. R. Mikler, and J. L. Gustafson, “Netpipe: A network protocol independent performance evaluator,” in IASTED International Conference on Intelligent Information Management and Systems, vol. 6. Washington, DC, USA), 1996.
L. Nussbaum, F. Anhalt, O. Mornard, and J.-P. Gelas, “Linux-based virtualization for hpc clusters,” in Montreal Linux Symposium, 2009.
A. Tirumala, F. Qin, J. Dugan, J. Ferguson, and K. Gibbs, “iperf: Testing the limits of your network,” 2003.
Author information
Authors and Affiliations
Additional information
Authors’ profile
Dr. Blaise Omer YENKé is a Senior Lecturer and researcher in computer engineering. He is the Head of Department of Computer Engineering at the University Institute of Technology, University of Ngaoundéré, Cameroon. He received the Ph.D. degree in 2010 from the University of Yaoundé 1 in Cameroon and the University of Grenoble in France, in an international joint supervision. His current research interests include High Performance Computing, Distributed Systems, Fault Tolerance, Sensor Networks Design and Sensor's Architecture.
Ado Adamou ABBA ARI is an Assistant Lecturer in computer engineering at the University of Maroua, Cameroon. He received the B.Sc. degree in mathematics and computer science in 2010 and the M.Sc. degree in computer engineering in 2012 from the Faculty of Science, University of Ngaoundéré, Cameroon. He is now enrolled in an international joint supervision Ph.D. thesis program among the Université Paris-Saclay, France and the University of Ngaoundéré, Cameroon. His Ph.D. thesis research is focused on swarm intelligence based clustering and routing in wireless sensor networks.
Cyrille DIBAMOU MBEUYO received the B.Sc. degree in architecture of systems and networks in 2009 and the M.Sc. degree in computer engineering in 2012 from the Faculty of Science, University of Ngaoundéré, Cameroon. He is now enrolled in a Ph.D. thesis program in computer science at the University of Ngaoundéré. His researches are based on scheduling the checkpoint/restart of malleable tasks in virtual environments for High Performance Computing.
Donald Armel VOUNDI is a Teacher of Computer Science in a secondary school in Cameroon. He received the First Grade Secondary School Teacher Diploma in 2010 from the Higher Teacher Training College of the University of Yaoundé, the B.Sc. degree in computer science in 2011 from the Faculty of Science, University of Yaoundé 1 and the M.Sc. degree in computer engineering in 2014 from the Faculty of Science, University of Ngaoundéré, Cameroon.
This article is distributed under the terms of the Creative Commons Attribution License which permits any use, distribution, and reproduction in any medium, provided the original author(s) and the source are credited.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made.
The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.
To view a copy of this licence, visit https://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Yenké, B., Abba Ari, A., Dibamou Mbeuyo, C. et al. Virtual Machine Performance upon Intensive Computations. GSTF J Comput 4, 20 (2015). https://doi.org/10.7603/s40601-014-0020-x
Received:
Accepted:
Published:
DOI: https://doi.org/10.7603/s40601-014-0020-x