Minimizing Metadata Access Latency in Wide Area Networked File Systems

  • Jian Liang
  • Aniruddha Bohra
  • Hui Zhang
  • Samrat Ganguly
  • Rauf Izmailov
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4297)


Traditional network file systems, like NFS, do not extend to wide-area due to low bandwidth and high network latency. We present WireFS, a Wide Area File System, which enables delegation of metadata management to nodes at client sites (homes). The home of a file stores the most recent copy of the file, serializes all updates, and streams updates to the central file server. WireFS uses access history to migrate the home of a file to the client site which accesses the file most frequently.

We formulate the home migration problem as an integer programming problem, and present two algorithms: a dynamic programming approach to find the optimal solution, and a non-optimal but more efficient greedy algorithm. We show through extensive simulations that even in the WAN setting, access latency over WireFS is comparable to NFS performance in the LAN setting; the migration overhead is also marginal.


Exponential Weighted Moving Average Access Latency Home Node Cooperative Cache Metadata Management 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Callaghan, B., Pawlowski, B., Staubach, P.: NFS Version 3 Protocol Specification, RFC 1813. IETF, Network Working Group (1995)Google Scholar
  2. 2.
    Microsoft Corporation: Cifs: Common internet file system (2006),
  3. 3.
    Muthitacharoen, A., Chen, B., Mazières, D.: A low-bandwidth network file system. In: Proc. of SOSP 2001 (2001)Google Scholar
  4. 4.
    Annapureddy, S., Freedman, M.J., Mazières, D.: Shark: Scaling File Servers via Cooperative Caching. In: Proc. of NSDI 2005 (2005)Google Scholar
  5. 5.
    Krishnan, P., Raz, D., Shavitt, Y.: The cache location problem. IEEE/ACM Trans. on Networking 8(5), 568–582 (2000)CrossRefGoogle Scholar
  6. 6.
    Shah, R., et al.: Efficient dissemination of personalized information using content-based multicast. IEEE Trans. on Mobile Computing 3(4), 394–408 (2004)CrossRefGoogle Scholar
  7. 7.
    Tamir, A.: An o(pn 2) algorithm for the p-median and related problems on tree graphs. Operations Research Letters 19, 59–64 (1996)MATHCrossRefMathSciNetGoogle Scholar
  8. 8.
    Mazieres, D.: A toolkit for user-level file systems. In: Proc. Usenix 2001, Boston, MA (2001)Google Scholar
  9. 9.
    Ellard, D., Seltzer, M.: New NFS Tracing Tools and Techniques for System Analysis. In: Proc. of LISA 2003, pp. 73–86 (2003)Google Scholar
  10. 10.
    Stribling, J.: All-Pairs-Pings for PlanetLab (2005),
  11. 11.
    Kistler, J., Satyanarayanan, M.: Disconnected Operation in the Coda File System. ACM Trans. on Computer Systems 10(1), 3–25 (1992)CrossRefGoogle Scholar
  12. 12.
    Birrell, A.D., et al.: The Echo Distributed File System. Technical Report 111, DEC SRC (1993)Google Scholar
  13. 13.
    Nelson, M.N., Welch, B.B., Ousterhout, J.K.: Caching in the sprite network file system. ACM Trans. Comput. Syst. 6(1), 134–154 (1988)CrossRefGoogle Scholar
  14. 14.
    Hartman, J.H., Ousterhout, J.K.: The Zebra Striped Network File System. ACM Trans. on Computer Systems 13(3), 274–310 (1995)CrossRefGoogle Scholar
  15. 15.
    Satyanarayanan, M.: A survey of distributed file systems. Technical Report CMU-CS-89-116, Carnegie Mellon University, Pittsburgh, Pennsylvania (1989)Google Scholar
  16. 16.
    Dabek, F., et al.: Wide-area cooperative storage with CFS. In: Proc. of SOSP 2001 (2001)Google Scholar
  17. 17.
    Rowstron, A., Druschel, P.: Storage management and caching in PAST, a large-scale, persistent peer-to-peer storage utility. In: Proc. of SOSP 2001 (2001)Google Scholar
  18. 18.
    Kubiatowicz, J., et al.: OceanStore: an Architecture for Global-Scale Persistent Storage. In: Proc. of ASPLOS 2000, pp. 190–201 (2000)Google Scholar
  19. 19.
    Muthitacharoen, A., et al.: Ivy: A read/write peer-to-peer file system. In: Proc. of OSDI 2002 (2002)Google Scholar
  20. 20.
    Peterson, L., et al.: A Blueprint for Introducing Disruptive Technology into the Internet. In: Proc. of HotNets 2002 (2002)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Jian Liang
    • 1
  • Aniruddha Bohra
    • 2
  • Hui Zhang
    • 2
  • Samrat Ganguly
    • 2
  • Rauf Izmailov
    • 2
  1. 1.Polytechnic UniversityBrooklynUSA
  2. 2.NEC Laboratories AmericaPrinceton

Personalised recommendations