Personal and Ubiquitous Computing

, Volume 17, Issue 8, pp 1709–1719 | Cite as

Evaluation of messaging middleware for high-performance cloud computing

  • Roberto R. Expósito
  • Guillermo L. Taboada
  • Sabela Ramos
  • Juan Touriño
  • Ramón Doallo
Original Article


Cloud computing is posing several challenges, such as security, fault tolerance, access interface singularity, and network constraints, both in terms of latency and bandwidth. In this scenario, the performance of communications depends both on the network fabric and its efficient support in virtualized environments, which ultimately determines the overall system performance. To solve the current network constraints in cloud services, their providers are deploying high-speed networks, such as 10 Gigabit Ethernet. This paper presents an evaluation of high-performance computing message-passing middleware on a cloud computing infrastructure, Amazon EC2 cluster compute instances, equipped with 10 Gigabit Ethernet. The analysis of the experimental results, confronted with a similar testbed, has shown the significant impact that virtualized environments still have on communication performance, which demands more efficient communication middleware support to get over the current cloud network limitations.


Cloud computing High-performance computing Virtualization 10 Gigabit ethernet Message-passing middleware Performance evaluation 


  1. 1.
    A Message Passing Interface Standard (MPI) Accessed July 2012
  2. 2.
    Abramson D et al (2006) Intel virtualization technology for directed I/O. Intel Technol J 10(3):179–192MathSciNetGoogle Scholar
  3. 3.
    Advanced Micro Devices (AMD) (2009) I/O Virtualization Technology (IOMMU). Accessed July 2012
  4. 4.
    Advanced Micro Devices (AMD) Virtualization Technology (AMD-V). Accessed July 2012
  5. 5.
    Baek SJ, Park SM, Yang SH, Song EH, Jeong YS (2010) Efficient server virtualization using grid service infrastructure. J Inf Process Syst 6(4):553–562Google Scholar
  6. 6.
    Bailey DH et al (1991) The NAS parallel benchmarks. Int J High Perform Comput Appl 5(3):63–73CrossRefGoogle Scholar
  7. 7.
    Baker M, Carpenter B (2000) MPJ: a proposed Java message passing API and environment for high performance computing. In: Proceedings of 15th IPDPS workshops on parallel and distributed processing (IPDPS’00), Cancun, LNCS, vol 1800, pp 552–559Google Scholar
  8. 8.
    Barham P, Dragovic B, Fraser K, Hand S, Harris TL, Ho A, Neugebauer R, Pratt I, Warfield A (2003) Xen and the art of virtualization. In: Proceedings of 19th ACM symposium on operating systems principles (SOSP’03), Bolton Landing (Lake George), pp 164–177Google Scholar
  9. 9.
    Buntinas D, Mercier G, Gropp W (2006) Design and evaluation of nemesis, a scalable, low-latency, message-passing communication subsystem. In: Proceedings of 6th IEEE international symposium on cluster computing and the grid (CCGRID’06), Singapore, pp 521–530Google Scholar
  10. 10.
    Carpenter B, Fox G, Ko S, Lim S (2002) mpiJava 1.2: API specification. Accessed July 2012
  11. 11.
    Fraser K, Hand S, Neugebauer R, Pratt I, Warfield A, Williamson M (2004) Safe hardware access with the Xen virtual machine monitor. In: Proceedings of 1st workshop on operating system and architectural support for the on demand IT infrastructure (OASIS’04), BostonGoogle Scholar
  12. 12.
    Gabriel E et al (2004) Open MPI: goals, concept, and design of a next generation MPI implementation. In: Proceedings of 11th European PVM/MPI users’ group meeting, Budapest, pp 97–104Google Scholar
  13. 13.
    Huang B, Bauer M, Katchabaw M (2005) Hpcbench—a Linux-based network benchmark for high performance networks. In: Proceedings of 19th international symposium on high performance computing systems and applications (HPCS’05), Guelph, pp 65–71Google Scholar
  14. 14.
    Huang W, Liu J, Abali B, Panda DK (2006) A case for high performance computing with virtual machines. In: Proceedings of 20th international conference on supercomputing (ICS’06), Cairns, pp 125–134Google Scholar
  15. 15.
    Huang W, Koop MJ, Gao Q, Panda DK (2007) Virtual machine aware communication libraries for high performance computing. In: Proceedings of ACM/IEEE conference on supercomputing (SC'07), Reno, pp 1–12Google Scholar
  16. 16.
    Intel Corporation (2006) Virtualization technology (Intel VT). Accessed July 2012
  17. 17.
    Jones T (2009) Linux virtualization and PCI passthrough. Accessed July 2012
  18. 18.
    Karna AK, Zou H (2010) Cross comparison on C compilers reliability impact. J Convergence 1(1):65–74Google Scholar
  19. 19.
    Liu J, Huang W, Abali B, Panda DK (2006) High performance VMM-bypass I/O in virtual machines. In: Proceedings of USENIX’06 annual technical conference, Boston, pp 29–42Google Scholar
  20. 20.
    Liu ST, Chen YM (2011) Retrospective detection of malware attacks by cloud computing. Int J Inf Technol Commun Convergence 1(3):280–296CrossRefGoogle Scholar
  21. 21.
    Amazon Web Services LLC (AWS LLC) Amazon elastic compute cloud (Amazon EC2). Accessed July 2012
  22. 22.
    Amazon Web Services LLC (AWS LLC) High performance computing using Amazon EC2. Accessed July 2012
  23. 23.
    Mallón DA, Taboada GL, Touriño J, Doallo R (2009) NPB-MPJ: NAS parallel benchmarks implementation for message-passing in Java. In: Proceedings of 17th Euromicro international conference on parallel, distributed, and network-based processing (PDP’09), Weimar, pp 181–190Google Scholar
  24. 24.
    Mansley K, Law G, Riddoch D, Barzini G, Turton N, Pope S (2007) Getting 10 Gb/s from Xen: safe and fast device access from unprivileged domains. In: Proceedings of workshop on virtualization/Xen in high-performance cluster and grid computing (VHPC’07), Rennes, pp 224–233Google Scholar
  25. 25.
    Mateescu G, Gentzsch W, Ribbens CJ (2011) Hybrid computing-where HPC meets grid and cloud computing. Future Gener Comput Syst 27(5):440–453CrossRefGoogle Scholar
  26. 26.
    MPICH2 (2005) High-performance and widely portable MPI. Accessed July 2012
  27. 27.
    Nanos A, Koziris N (2009) MyriXen: message passing in Xen virtual machines over Myrinet and Ethernet. In: Proceedings of 4th workshop on virtualization in high-performance cloud computing (VHPC’09), Delft, pp 395–403Google Scholar
  28. 28.
    Raj H, Schwan K (2007) High performance and scalable I/O virtualization via self-virtualized devices. In: Proceedings of 16th international symposium on high performance distributed computing (HPDC'07), Monterey, pp 179–188Google Scholar
  29. 29.
    Regola N, Ducom JC (2010) Recommendations for virtualization technologies in high performance computing. In: Proceedings of 2nd international conference on cloud computing technology and science (CloudCom’10), Indianapolis, pp 409–416Google Scholar
  30. 30.
    Taboada GL, Ramos S, Touriño J, Doallo R (2011) Design of efficient java message-passing collectives on multi-core clusters. J Supercomput 55(2):126–154CrossRefGoogle Scholar
  31. 31.
    Taboada GL, Ramos S, Expósito RR, Touriño J, Doallo R (2012) Java in the high performance computing arena: research, practice and experience. Sci Comput Program (in press). doi:10.1016/j.scico.2011.06.002
  32. 32.
    Taboada GL, Touriño J, Doallo R (2012) F-MPJ: scalable Java message-passing communications on parallel systems. J Supercomput 60(1):117–140CrossRefGoogle Scholar
  33. 33.
    Walker E (2008) Benchmarking Amazon EC2 for high-performance scientific computing. LOGIN: USENIX Mag 33(5):18–23Google Scholar
  34. 34.
    Wang G, Ng TSE (2010) The impact of virtualization on network performance of Amazon EC2 data center. In: Proceedings of 29th conference on information communications (INFOCOM'10), San Diego, pp 1163–1171Google Scholar
  35. 35.
    Wang X, Sang Y, Liu Y, Luo Y (2011) Considerations on security and trust measurement for virtualized enviroment. J Convergence 2(2):19–24Google Scholar
  36. 36.
    Whitaker A, Shaw M, Gribble SD (2002) Denali: lightweight virtual machines for distributed and networked applications. Technical Report 02-02-01, University of Washington, USAGoogle Scholar
  37. 37.
    Won C, Lee B, Park K, Kim MJ (2008) Eager data transfer mechanism for reducing communication latency in user-level network protocols. J Inf Process Syst 4(4):133–144Google Scholar
  38. 38.
    Xen Org (2005) Xen PCI passthrough. Accessed July 2012
  39. 39.
    Ye Y, Li X, Wu B, Li Y (2011) A comparative study of feature weighting methods for document co-clustering. Int J Inf Technol Commun Convergence 1(2):206–220CrossRefGoogle Scholar

Copyright information

© Springer-Verlag London Limited 2012

Authors and Affiliations

  • Roberto R. Expósito
    • 1
  • Guillermo L. Taboada
    • 1
  • Sabela Ramos
    • 1
  • Juan Touriño
    • 1
  • Ramón Doallo
    • 1
  1. 1.Department of Electronics and SystemsUniversity of A CoruñaA CoruñaSpain

Personalised recommendations