Skip to main content

Building Virtual High-Performance Computing Clusters with Docker: An Application Study at the University of Economics Ho Chi Minh City

  • Conference paper
  • First Online:
International Conference on Innovative Computing and Communications

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 1387))

  • 835 Accesses

Abstract

The need for high-performance computing in science and technology is becoming a challenging issue in recent years. Building a high-performance computing system by utilizing the existing hardware and software resources is a low-cost solution. Virtualization technology is proposed to solve this problem. It has brought convenience and efficiency as it can run on various operating systems. It can be used for implementing many computational algorithms simultaneously on the same hardware system including parallel processing and/or cluster processing systems. It can be expanded for computation and storage if the resources are still available. Virtualization also can combine the existing hardware and software resources to solve the problem of mobilizing multiple resources. Docker virtualization technology is considered a powerful virtualization technology, offering a new virtualization solution, instead of creating independent virtual machines with different virtual hardware and operating systems. Because this technology allows applications can be repackaged into individual data units and run together on the operating system kernel, sharing the resources of the mobilizing hardware platforms is the strength of Docker. The paper will focus on analyzing the superiority of using hardware virtualization technology, thereby proposing to build a high-performance virtualization system by using Docker technology with utilizing the available hardware platform at the University of Economics Ho Chi Minh City (UEH).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 189.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 249.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Lee, H. (2014). Virtualization basics: Understanding techniques and fundamentals. In: School of Informatics and Computing Indiana University 815 E 10th St. Bloomington IN 47408.

    Google Scholar 

  2. Khattar, R. K., Murphy, M. S., Tarella, G. J., & Nystrom, K. E. (1999). Introduction to Storage Area Network. SAN: IBM Corporation, International Technical Support Organization.

    Google Scholar 

  3. Bhanage, G., Seskar, I., Zhang, Y., Raychaudhuri, D., & Jain, S. (2011). Experimental evaluation of openvz from a testbed deployment perspective. Development of Networks and Communities. In volume 46 of Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering (pp. 103–112). Berlin: Springer.

    Google Scholar 

  4. Jin, Y., Wen, Y., Chen, Q. (2012). Energy efficiency and server virtualization in data centers: An empirical investigation. In 2012 Proceedings IEEE INFOCOM Workshops (pp. 133–138).

    Google Scholar 

  5. Performance Report Hyper-V (2010). White Paper: https://sp.ts.fujitsu.com/.

  6. Kusnetzky, D. (2011). Virtualization: A Manager's Guide. O'Reilly Media, Inc.

    Google Scholar 

  7. I. Habib. (2008, February). Virtualization with KVM. Linux Journal, 2008(166), 8. Article No.: 8.

    Google Scholar 

  8. Chisnall, D. (2013). The Definitive Guide to the Xen Hypervisor (1st ed.). USA: Prentice Hall Press.

    Google Scholar 

  9. Technical Papers. VMware Infrastructure Architecture Overview. White Paper. https://www.vmware.com/pdf/vi_architecture_wp.pdf.

  10. Yu, H. E., & Huang, W. (2015). Building a virtual hpc cluster with auto scaling by the docker. arXiv:1509.08231.

  11. Rad, B. B., Bhatti, H. J., & Ahmadi, M. (2017). An introduction to docker and analysis of its performance. International Journal of Computer Science and Network Security (IJCSNS), 17(3), 228.

    Google Scholar 

  12. de Bayser, M., & Cerqueira, R. (2017). Integrating MPI with docker for HPC. In 2017 IEEE International Conference on Cloud Engineering (IC2E), Vancouver, BC, 2017 (pp. 259–265). https://doi.org/10.1109/IC2E.2017.40.

  13. Abdullah, M., Iqbal, W., & Bukhari, F. (2019). Containers vs virtual machines for auto-scaling multi-tier applications under dynamically increasing workloads (pp. 153–167). https://doi.org/10.1007/978-981-13-6052-7_14.

  14. Hung, N. Q., Phung, T. K., Hien, P., & Thanh, D. N. H. (2021) AI and blockchain: Potential and challenge for building a smart E-learning system in vietnam. In IOP Conference Series: Materials Science and Engineering (In press).

    Google Scholar 

  15. Tran Thoai N., et al (2016). Research and design a 50–100 TFlops high performance computing system / University of Technology - Viet Nam National University HCMC, Project in HCM City.

    Google Scholar 

  16. Thuy, N. T., et al. (2006). Research high-performance computational systems and apply micro-material simulation. Project in Ministry of Science and Technology (MOST), 2004–2005.

    Google Scholar 

  17. Tan, G., Yeo, G. K., Turner, S. J., & Teo, Y. M. (Eds.). (2013). AsiaSim 2013: 13th International Conference on Systems Simulation, Singapore, November 6–8, 2013. Proceedings (Vol. 402).

    Google Scholar 

  18. Petitet, R. C. W. A., Dongarra, J., Cleary, A. HPL - A portable implementation of the high-performance linpack benchmark for distributed-memory computers. http://www.netlib.org/benchmark/hpl

  19. Thanh, D. N. H. & Dvoenko, S. D. (2019). A denoising of biomedical images. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XL-5/W6, 73–78.

    Google Scholar 

  20. Kumar, V., Mishra, B. K., Mazzara, M., Thanh, D. N. H., & Verma, A. (2020). Prediction of Malignant and benign breast cancer: A data mining approach in healthcare applications. In: Borah, S., Emilia Balas, V., & Polkowski, Z. (Eds.), Advances in Data Science and Management. Lecture Notes on Data Engineering and Communications Technologies (Vol. 37). Singapore: Springer.

    Google Scholar 

  21. Erkan, U. (2020). A precise and stable machine learning algorithm: eigenvalue classification (EigenClass). Neural Computing and Applications. https://doi.org/10.1007/s00521-020-05343-2(Inpress)

    Article  Google Scholar 

  22. Fowdur, T. P., Beeharry, Y., Hurbungs, V., Bassoo, V., & Ramnarain-Seetohul, V. (2018). Big data analytics with machine learning tools. In: Dey, N., Hassanien, A., Bhatt, C., Ashour, A., & Satapathy, S. (Eds.), Internet of Things and Big Data Analytics Toward Next-Generation Intelligence. Studies in Big Data (Vol. 30). Cham: Springer.

    Google Scholar 

Download references

Acknowledgements

This work was supported by the University of Economics Ho Chi Minh City under project CS-2020-14.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Quoc Hung Nguyen .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Nguyen, Q.H., Le, T., Vo, H.Q.D., Truong, V.P. (2022). Building Virtual High-Performance Computing Clusters with Docker: An Application Study at the University of Economics Ho Chi Minh City. In: Khanna, A., Gupta, D., Bhattacharyya, S., Hassanien, A.E., Anand, S., Jaiswal, A. (eds) International Conference on Innovative Computing and Communications. Advances in Intelligent Systems and Computing, vol 1387. Springer, Singapore. https://doi.org/10.1007/978-981-16-2594-7_1

Download citation

Publish with us

Policies and ethics