Advertisement

Domus – An Architecture for Cluster-Oriented Distributed Hash Tables

  • José Rufino
  • António Pina
  • Albano Alves
  • José Exposto
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3911)

Abstract

This paper presents a high level description of Domus, an architecture for cluster-oriented Distributed Hash Tables.

As a data management layer, Domus supports the concurrent execution of multiple and heterogeneous DHTs, that may be simultaneously accessed by different distributed/parallel client applications. At system level, a load balancement mechanism allows for the (re)distribution of each DHT over cluster nodes, based on the monitoring of their resources, including CPUs, memory, storage and network. Two basic units of balancement are supported: vnodes, a coarse-grain unit, and partitions, a fine-grain unit. The design also takes advantage of the strict separation of object lookup and storage, at each cluster node, and for each DHT. Lookup follows a distributed strategy that benefits from the joint analysis of multiple partition-specific routing information, to shorten routing paths. Storage is accomplished through different kinds of data repositories, according to the specificity and requirements of each DHT.

Keywords

Base Service Address Space Storage Service Client Application Cluster Node 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Litwin, W., Neimat, M.A., Schneider, D.: LH*: Linear Hashing for Distributed Files. In: Procs. of ACM SIGMOD - Int. Conf. on Management of Data (1993)Google Scholar
  2. 2.
    Devine, R.: Design and implementation of DDH: a distributed dynamic hashing algorithm. In: Proceedings of the 4th Int. Conference on Foundations of Data Organization and Algorithms (1993)Google Scholar
  3. 3.
    Hilford, V., Bastani, F., Cukic, B.: EH* – Extendible Hashing in a Distributed Environment. In: Proceedings of the COMPSAC 1997 - 21st International Computer Software and Applications Conference (1997)Google Scholar
  4. 4.
    Gribble, S., Brewer, E., Hellerstein, J., Culler, D.: Scalable, Distributed Data Structures for Internet Service Construction. In: Proceedings of the Fourth Symposium on Operating Systems Design and Implementation (2000)Google Scholar
  5. 5.
    Ratnasamy, S., Francis, P., Handley, M., Karp, R., Shenker, S.: A Scalable Content–Addressable Network. In: Proceedings of the ACM SIGCOMM 2001 (2001)Google Scholar
  6. 6.
    Stoica, I., Morris, R., Karger, D., Kaashoek, M., Balkrishnan, H.: Chord: A Scalable P2P Lookup Service for Internet Applications. In: Proceedings of ACM SIGCOMM 2001 (2001)Google Scholar
  7. 7.
    Rufino, J., Pina, A., Alves, A., Exposto, J.: Toward a dynamically balanced cluster oriented DHT. In: Proceedings of the International Conference on Parallel and Distributed Computing and Networks (PDCN 2004) (2004)Google Scholar
  8. 8.
    Rufino, J., Alves, A., Pina, A., Exposto, J.: A cluster oriented model for dynamically balanced DHTs. In: Proceedings of IPDPS 2004 (2004)Google Scholar
  9. 9.
    Rufino, J., Pina, A., Alves, A., Exposto, J.: Agregated routing for a cluster oriented DHT. Technical report, Dep. of Informatics and Communications, Polytechnic Institute of Bragança, Portugal (2004)Google Scholar
  10. 10.
    Bermond, J.C., Liu, Z., Syska, M.: Mean Eccentricities of de Bruijn Networks. Technical report, Université de Nice-Sophia Antipolis (1993)Google Scholar
  11. 11.
    Alves, A., Pina, A., Rufino, J., Exposto, J.: RoCL: A Resource oriented Communication Library. In: Kosch, H., Böszörményi, L., Hellwagner, H. (eds.) Euro-Par 2003. LNCS, vol. 2790, Springer, Heidelberg (2003)CrossRefGoogle Scholar
  12. 12.
    Sacerdoti, F.D., Katz, M.J., Massie, M.L., Culler, D.E.: Wide Area Cluster Monitoring with Ganglia. In: Proceedings of the IEEE Cluster 2003 Conference (2003)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • José Rufino
    • 1
  • António Pina
    • 2
  • Albano Alves
    • 1
  • José Exposto
    • 1
  1. 1.Polytechnic Institute of BragançaBragançaPortugal
  2. 2.University of MinhoBragaPortugal

Personalised recommendations