Advertisement

Improving Service Performance in Cloud Computing with Network Memory Virtualization

  • Chandarasageran Natarajan
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 265)

Abstract

Resources abstractions have been very critical in securing performance improvement and higher acceptance by the end users in cloud computing. System virtualization, storage virtualization and network virtualization had been realized and has become as a part large systems abstraction in cloud computing. Memory high-availability in network environments is an added advantage in our presentation as an integral part in extending cloud computing multi various services to include network memory virtualization.

In this paper, we describe the virtualization of memory in cluster environment that could be applied universally using RDMA utility to map and access memory across the network. We suggested a combination of using the latency of remote memory and direct remote memory mapping facilities in our implementation. A low-level remote memory allocation and replacement technique is introduced to minimize page faulting and provide option to be more fault tolerance. We proposed a low level memory management technique in a network environment which would be able to support Service Oriented Architecture (SOA) and cloud computing.

Keywords

Network Memory Virtualization Cloud Computing and RDMA protocol 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Acharya, A., Setia, S.: Availability and utility of idle memory in workstation clusters. In: Proceedings of ACM SIGMETRICS Conference on Measuring and Modeling of Computer Systems, pp. 35–46 (1999)Google Scholar
  2. 2.
    Markatos, E.P., Dramitinos, G.: Implementation and Evaluation of a Remote Memory Pager. Technical Report FORTH/ICS 129 (1995)Google Scholar
  3. 3.
    Markatos, E.P., Dramitinos, G.: Implementing of reliable remote memory pager. In: Proceedings of the 1996 Usenix Technical Conference, pp. 146–164 (1996)Google Scholar
  4. 4.
    Dahlin, M., Wang, R., Anderson, T., Patterson, D.: Cooperative Caching: Using Remote Memory to Improve File System Performance. In: Proceedings of the 1st Symposium on Operating System Design and Implementation, pp. 267–280 (1994)Google Scholar
  5. 5.
    Feely, M.J., Morgan, W.E., Pighin, F.H., Karlin, A.R., Levy, H.M.: Implementing global memory management systems in a Workstation Cluster. In: Proceedings of the 15th ACM Symposium on Operating System Principles, pp. 201–212 (1995)Google Scholar
  6. 6.
    Feeley, M.J.: Global Memory Management for Workstation Networks. PhD Thesis, University of Washington (1996)Google Scholar
  7. 7.
    Zhang, X., Qu, Y., Xiao, L.: Improving Distributed Workload Performance by Sharing Both CPU and Memory Resources. In: Proceedings of 20th International Conference on Distributed Computing Systems (ICDCS), pp. 10–13 (2000)Google Scholar
  8. 8.
    Kousshi, S., Acharya, A., Setia, S.: Dodo: A User-level System for exploiting idle memory in workstation clusters. Technical Report TRCS98-35, Department of Computer Science, University of California, Santa Barbara (1998)Google Scholar
  9. 9.
    Ioannidis, S., Markatos, E.P., Sevaslidou, J.: On using Network Memory to improve the performance of transaction-based System. Technical Report 190, ICS-FORTH, http://www.ics.forth.gr/proj/avg/paging.html
  10. 10.
    Amir, Y., Awerbuch, B., Borgstrom, R.S.: A Cost-Benefit Framework for Online Management of a Metacomputing System. In: Proceedings of 1st International Conference on Information and Computational Economy (ICE 1998), pp. 25–28 (1998)Google Scholar
  11. 11.
    Flouris, M.D., Markatos, E.P.: The Network RamDisk: Using Remote Memory on Heterogeneous NOWs. In: Progress Session of the USENIX 1999 Annual Technical Conference (1999)Google Scholar
  12. 12.
    Flouris, M.D., Markatos, E.P.: Network RAM. In: Buyya, R. (ed.) High Performance Cluster Computing, pp. 383–508. Prentice Hall, New Jersey (1999)Google Scholar
  13. 13.
    Markatos, E.P., Dramitinos, G.: Adding Flexibility to a Remote Memory Pager. In: Proceedings of the 4th International Workshop on Object Orientation in Operating SystemsGoogle Scholar
  14. 14.
    Xiao, L., Zhang, X., Kubricht, S.A.: Incorporating Job Migration and Network RAM to Share Cluster Memory Resources. In: Proceedings of the 9th IEEE International Symposium on High-Performance Distributed Computing (HPDC-9), pp. 71–78 (2000)Google Scholar
  15. 15.
    Cuenca-Acuna, F.M., Nguyen, T.D.: Cooperative Caching Middleware for Cluster-Based Servers. In: Proceedings of the 10th IEEE International Symposium on High Performance Distributed Computing, HPDC-10 (2001)Google Scholar
  16. 16.
    Carrera, E.V., Bianchini, R.: Efficiency vs. Portability in Cluster-Based Network Servers. In: Proceedings of the 8th Symposium on Principle and Practice of Parallel Programming. ACM/SIGPLAN (2001)Google Scholar
  17. 17.
    Hansen, J.S.: Flexible network attached storage using remote DMA. In: Proceeding of Hot Interconnects 9, pp. 51–55. IEEE (2001)Google Scholar
  18. 18.
    Hansen, J.S., Lachaize, R.: Using Idle Disks in a Cluster as a High Performance Storage System. Technical Report, SARDES Project, SIRAC Laboratory, Grenoble, France (2002)Google Scholar
  19. 19.
    Buyya, R., Abramson, D., Giddy, J.: Grid Resource Management, Scheduling and Computational Economy. In: Proceedings of the 2nd International Workshop on Global and Cluster Computing (WGCC 2000), Tsukuba, Tokyo, Japan (2000)Google Scholar
  20. 20.
    Milenkovic, M., Robison, S.H., Knauerhase, R.C., Barkai, D., Garg, S., Tewari, V., Anderson, T.A., Bowman, M. (Intel): Toward Internet Distributed Computing, pp. 38–46. IEEE Computer Society (2003)Google Scholar
  21. 21.
    Waldspurger, C.A.: Memory Resource Management in VMware ESX Server. In: Proceedings of the 5th Symposium on Operating Systems Design and Implementation, OSDI 2002, Best paper award (2002)Google Scholar
  22. 22.
    Birman, K., Chockler, G., Renesse, R.: Towards a cloud computing research agenda. SIGACT News 40(2) (2009)CrossRefGoogle Scholar
  23. 23.
    Vouk, M.A.: Cloud Computing – Issues, Research and Implementations. Journal of Computing and Information Technology (CIT) 16(4), 235–246 (2008)CrossRefGoogle Scholar
  24. 24.
    Armbrust, M., Fox, A., Griffith, R., Joseph, A.D., Katz, R., Konwinski, A., Lee, G., Patterson, D., Rabkin, A., Stoica, I., Zaharia, M.: A view of cloud computing. Communications of the ACM 53(4), 50–58 (2009)CrossRefGoogle Scholar
  25. 25.
    Anderson, E., Neefe, J.M.: An exploration of network ram. Technical Report (CSD98-1000) Dept. of Computer Science, University of California, Berkeley (1994)Google Scholar
  26. 26.
    Islam, N.S., Rahman, M.W., Jose, J., Rajachandrasekar, R., Wang, H., Subramoni, H., Murthy, C., Panda, D.K.: High performance RDMA-based design of HDFS over InfiniBand. In: Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis, pp. 1–35. IEEE Computer Society Press (2012)Google Scholar
  27. 27.
    Chu, R., Xiao, N., Zhuang, Y., Liu, Y., Lu, X.: A Distributed Paging RAM Grid System for Wide-Area Memory Sharing. In: Proceedings of 20th International Parallel and Distributed Processing Symposium, IPDPS, pp. 1–10 (2006)Google Scholar
  28. 28.
    Gemikonakli, O., Mapp, G., Thakker, D., Ever, E.: Modelling and Performability Analysis of Network Memory Servers. In: Proceeding of the 39th Annual Simulation Symposium, ANSS 2006 (2006)Google Scholar
  29. 29.
    Balaji, P., Shah, H.V., Panda, D.K.: Sockets vs RDMA interface over 10-Gigabit networks: an in-depth analysis of the memory traffic bottleneck. In: RAIT Workshop 2004 (2004)Google Scholar
  30. 30.
    Mamidala, A.R., Vishnu, A., Panda, D.K.: Efficient shared memory and RDMA based design for mpi_allgather over InfiniBand. In: Mohr, B., Träff, J.L., Worringen, J., Dongarra, J. (eds.) PVM/MPI 2006. LNCS, vol. 4192, pp. 66–75. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  31. 31.
    Romanow, A., Bailey, S.: An Overview of RDMA over IP. In: Proceedings of the First International Workshop on Protocols for Fast Long-Distance Networks, PFLDnet 2003 (2003)Google Scholar
  32. 32.
    Pakin, S.: Receiver-initiated message passing over RDMA Networks. In: IEEE International Symposium on, Parallel and Distributed Processing, IPDPS 2008 (2008)Google Scholar
  33. 33.
    Perez-Conde, C., Diaz-Villanueva, W.: Emerging Information Tecnologies (II): Virtualization as Support for SOA and Cloud Computing. The European Journal of the Informatics Professional (CEPIS UPGRADE) 11(4), 30–35 (2010), http://cepis.org/upgrade Google Scholar
  34. 34.
    Hoff, T.: Are CloudBased Memory Architectures the Next Big Thing? Blog-Article (2009), http://highscalability.com/blog/2009/3/16/are-cloud-based-memory-architectures-the-next-big-thing.html
  35. 35.
    Ghalimi, I.C.: Cloud Computing is Memory Bound. An Intalio White Paper. Intalio, Inc., USA (2010)Google Scholar
  36. 36.
    Vallee, G., Naughton, T., Engelmann, C., Ong, H., Scott, S.L.: System-level virtualization for high performance computing. In: 16th Euromicro Conference on Parallel, Distributed and Network-Based Processing (PDP 2008), Toulouse, France (2008)Google Scholar
  37. 37.
    Subramoni, H., Lai, P., Kettimuthu, R., Panda, D.K.: High Performance Data Transfer in Grid Environment using GridFTP over Infiniband. In: 2010 10th IEEE/ACM International Conference on Proceeding of Cluster, Cloud and Grid Computing (CCGrid). IEEE (2010)Google Scholar
  38. 38.
    Woodall, T.S., Shipman, G.M., Bosilca, G., Graham, R.L., Maccabe, A.B.: High performance RDMA protocols in HPC. In: Mohr, B., Träff, J.L., Worringen, J., Dongarra, J. (eds.) PVM/MPI 2006. LNCS, vol. 4192, pp. 76–85. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  39. 39.
    Yu, W., Rao, S.V.N., Wyckoff, P., Vetter, J.S.: Performance of RDMA-capable storage protocols on wide-area network. In: Proceeding of Petascale Data Storage Workshop, PDSW 2008, 3rd edn. IEEE (2008)Google Scholar
  40. 40.
    Kissel, E., Swany, M.: Evaluating High Performance Data Transfer with RDMA Based Protocols in Wide Area Networks. In: Proceeding of 14th International Conference on High Performance Computing and Communications (HPCC 2012), Liverpool, UK (2012)Google Scholar
  41. 41.
    Yufei, R., Li, T., Yu, D., Jin, S., Robertazzi, T.G.: Middleware support for rdma-based data transfer in cloud computing. In: Parallel and Distributed Processing Symposium Workshops & PhD Forum (IPDPSW). IEEE (2012)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  1. 1.School of Science & TechnologyWawasan Open UniversityGeorge TownMalaysia

Personalised recommendations