Cluster Computing

, Volume 2, Issue 4, pp 281–293 | Cite as

The Network RamDisk: Using remote memory on heterogeneous NOWs

  • Michail D. Flouris
  • Evangelos P. Markatos

Abstract

Efficient data storage, a major concern in the modern computer industry, is mostly provided today by traditional magnetic disks. However, the cost of a disk transfer (measured in processor cycles) continues to increase with time, making disk accesses increasingly expensive. In this paper we describe the design, implementation and evaluation of a Network RamDisk device that uses main memory of remote workstations as a faster‐than‐disk storage device. In our study we propose various reliability policies, making the device tolerant to single workstation crashes. We show that the Network RamDisk is portable, flexible, and can operate under any of the existing Unix file systems. The Network RamDisk has been implemented both on the Linux and the Digital Unix operating systems, as a block device driver without any modifications to the kernel code. Using several real applications and benchmarks, we measure the performance of the Network RamDisk over an Ethernet and an ATM network, and find it to be usually four to eight times better than the magnetic disk. In one benchmark, our system was two orders of magnitude faster than the disk. We believe that a Network RamDisk can be efficiently used to provide reliable low‐latency access to files that would otherwise be stored on magnetic disks.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. [1]
    D.C. Anderson, J.S. Chase, S. Gadde, A.J. Gallatin, K.G. Yocum and M.J. Feeley, Cheating the I/O bottleneck: Network storage with Trapeze/Myrinet, in: Proceedings of the USENIX 1998 Annual Technical Conference, USENIX Association, Berkeley, USA, 15–19 June 1998, pp. 143-154.Google Scholar
  2. [2]
    T.E. Anderson, D.E. Culler and D.A. Patterson, A case for NOW (Networks Of Workstations), IEEE Micro 15(1) (February 1995) 54-64.Google Scholar
  3. [3]
    T.E. Anderson, M.D. Dahlin, J.M. Neefe, D.A. Patterson, D.S. Roselli and R.Y. Wang, Serverless network file systems. ACM Transactions on Computer Systems 14(1) (February 1996) 41-79.Google Scholar
  4. [4]
    G. Bernard and S. Hamma, Remote memory paging in networks of workstations, in: Proceedings of the SUUG International Conference on Open Systems: Solutions for Open Word (April 1994).Google Scholar
  5. [5]
    M. Blumrich, K. Li, R. Alpert, C. Dubnicki, E. Felten and J. Sandberg, Virtual memory mapped network interface for the SHRIMP multicomputer, in: Proc. 21th International Symposium on Comp. Arch., Chicago, IL (April 1994) pp. 142-153.Google Scholar
  6. [6]
    N.J. Boden, D. Cohen and W.-K. Su, Myrinet: A Gigabit-per-second Local Area Network, IEEE Micro 15(1) (February 1995) 29.Google Scholar
  7. [7]
    A. Brown and M. Seltzer, Operating system benchmarking in the wake of Lmbench: A case study of the performance of NetBSD on the Intel x86 architecture, in: Proceedings of the 1997 ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems, Seattle, AW (June 1997) pp. 214-224.Google Scholar
  8. [8]
    G. Buzzard, D. Jacobson, M. Mackey, S. Marovich and J. Wilkes, An implementation of the Hamlyn sender-managed interface architecture, in: Second Symposium on Operating System Design and Implementation (October 1996) pp. 245-259.Google Scholar
  9. [9]
    D. Comer and J. Griffioen, A new design for distributed systems: the remote memory model, in: Proceedings of the USENIX Summer Conference (1990) pp. 127-135.Google Scholar
  10. [10]
    T. Cortes, S. Girona and J. Labarta, PACA: A cooperative file system cache for parallel machines, in: 2nd International Euro-Par Conference (Euro-Par'96), Lecture Notes in Computer Science, Vol. 1123 (1996) pp. 477-486.Google Scholar
  11. [11]
    M. Dahlin, Serverless network file systems, Ph.D. thesis, UC Berkeley (December 1995).Google Scholar
  12. [12]
    M.D. Dahlin, R.Y. Wang, T.E. Anderson and D.A. Patterson, Cooperative caching: Using remote client memory to improve file system performance, in: First Symposium on Operating System Design and Implementation (1994) pp. 267-280.Google Scholar
  13. [13]
    M.J. Feeley, W.E. Morgan, F.H. Pighin, A.R. Karlin, H.M. Levy and C.A. Thekkath, Implementing global memory management in a workstation cluster, in: Proc. 15th Symposium on Operating Systems Principles (December 1995) pp. 201-212.Google Scholar
  14. [14]
    E.W. Felten and J. Zahorjan, Issues in the implementation of a remote memory paging system, Technical Report 91-03-09, Computer Science Department, University of Washington (November 1991).Google Scholar
  15. [15]
    D.P. Ghormley, D. Petrou and T.E. Anderson, SLIC: Secure loadable interposition code, URL: http://now.CS.Berkeley.EDU/Slic/.Google Scholar
  16. [16]
    R. Gillett, Memory channel network for PCI, IEEE Micro 16(1) (February 1996) 12-18.Google Scholar
  17. [17]
    J. Hartman and J. Ousterhout, The zebra striped network file system, in: Proc. 14th Symposium on Operating Systems Principles (December 1993) pp. 29-43.Google Scholar
  18. [18]
    L. Iftode, K. Li and K. Petersen, Memory servers for multicomputers, in: Proceedings of COMPCON 93 (1993) pp. 538-547.Google Scholar
  19. [19]
    D.V. James, A.T. Laundrie, S. Gjessing and G.S. Sohi, Scalable coherent interface, IEEE Computer 23(6) (June 1990) 74-77.Google Scholar
  20. [20]
    E.K. Lee and C.A. Thekkath, Petal: Distributed virtual disks, in: Seventh International Conference on Architectural Support for Programming Languages and Operating Systems, Cambridge, MA, 1–5 October 1996, pp. 84-92. ACM Press.Google Scholar
  21. [21]
    E.P. Markatos and G. Dramitinos, Implementation of a reliable remote memory pager, in: Proceedings of the 1996 Usenix Technical Conference (January 1996) pp. 177-190.Google Scholar
  22. [22]
    E.P. Markatos and M. Katevenis, Telegraphos: High-performance networking for parallel processing on workstation clusters, in: Proceedings of the Second International Symposium on High-Performance Computer Architecture (February 1996) pp. 144-153.Google Scholar
  23. [23]
    J.N. Matthews, D. Roselli, A.M. Costello, R.Y. Wang and T.E. Anderson, Improving the performance of log-structured file systems with adaptive methods, in: Proc. 16th Symposium on Operating Systems Principles (October 1997).Google Scholar
  24. [24]
    A.K. McKusick, K.J. Karels and K. Bostic, A pageable memory based filesystem, in: Proceedings of the Summer 1990 Usenix Technical Conference (June 1990) pp. 137-145.Google Scholar
  25. [25]
    M. Rosenblum and J.K. Ousterhout, The design and implementation of a log-structured file system, ACM Transactions on Computer Systems 10(1) (February 1992) 26-52.Google Scholar
  26. [26]
    C. Ruemmler and J. Wilkes, UNIX disk access patterns, in: Proceedings of the Winter'93 USENIX Conference (January 1993) pp. 405-420.Google Scholar
  27. [27]
    B.N. Schilit and D. Duchamp, Adaptive remote paging for mobile computers, Technical Report CUCS-004-91, University of Columbia (1991).Google Scholar
  28. [28]
    M. Seltzer, M.K. McKusick, K. Bostic and C. Staelin, An implementation of a log-structured file system for unix, in: Proceedings of the 1995 Winter Usenix Technical Conference, San Diego, CA (January 1993).Google Scholar
  29. [29]
    D. Stodolsky, M. Holland, W.V. Courtright II and G.A. Gibson, Parity logging disk arrays, ACM Transactions on Computer Systems 12(3) (August 1994) 206-235.Google Scholar
  30. [30]
    T. von Eicken, D.E. Culler, S.C. Goldstein and K.E. Schauser, Active Messages: a Mechanism for Integrated Communication and Computation, in: Proc. 19th International Symposium on Comp. Arch., Gold Coast, Australia (May 1992) pp. 256-266.Google Scholar

Copyright information

© Kluwer Academic Publishers 1999

Authors and Affiliations

  • Michail D. Flouris
    • 1
  • Evangelos P. Markatos
    • 1
  1. 1.Computer Architecture and VLSI Systems Division, Institute of Computer Science (ICS)Foundation for Research and Technology – Hellas (FORTH)Heraklion, CreteGreece

Personalised recommendations