Skip to main content
SpringerLink
Log in

A Read-Only Distributed Hash Table

  • Published:
Journal of Grid Computing Aims and scope Submit manuscript

Abstract

A distributed hash table (DHT) is an infrastructure to support resource discovery in large distributed systems. In a DHT, data items such as resources, indexes of resources or resource metadata, are distributed across an overlay network based on a hash function. However, this may not be desirable in commercial applications such as Grid and cloud computing whereby the presence of multiple administrative domains leads to the issues of data ownership and self-economic interests. In this paper, we present R-DHT (Read-only DHT), a DHT-based resource discovery scheme without distributing data items. To map each data item back onto its resource owner, a physical host, we virtualize each host into virtual nodes. Nodes are further organized as a segment-based overlay network which increases node failure resiliency without replicating data items. We demonstrate the feasibility of our proposed scheme by presenting R-Chord, an implementation of R-DHT using Chord as the underlying overlay graph, with lookup and maintenance optimizations. Through analytical and simulation analyses, we evaluate the performance of R-DHT and compare it with traditional DHTs in terms of lookup path length, resiliency to node failures, and maintenance overhead. Overall, we found that R-DHT is effective and efficient for resource indexing and discovery in large distributed systems with a strong commercial requirement.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Apache HTTP server. http://httpd.apache.org

  2. The Chord Project. http://www.pdos.lcs.mit.edu/chord

  3. Globus toolkit—Information Service. http://www.globus.org/toolkit/mds/

  4. Aberer, K., Cudr-Mauroux, P., Datta, A., Despotovic, Z., Hauswirth, M., Punceva, M., Schmidt, R.: P-Grid: a self-organizing structured P2P system. SIGMOD Rec. 32(2), 29–33 (2003)

    Article  Google Scholar 

  5. Adamic, L.A., Lukose, R.M., Puniyani, A.R., Huberman, B.A.: Local search in unstructured networks. In: Handbook of Graphs and Networks: from the Genome to the Internet, pp. 295–316 (2003)

  6. Armbrust, M., Fox, A., Griffith, R., Joseph, A. D., Katz, R. H., Konwinski, A., Lee, G., Patterson, D. A., Rabkin, A., Stoica, I., Zaharia, M.: Above the clouds: a Berkeley view of cloud computing. Technical Report UCB/EECS-2009-28, Electrical Engineering and Computer Sciences, University of California at Berkeley (2009)

  7. Aspnes, J., Shah, G.: Skip Graphs. In Proc. of the 14th Annual ACM-SIAM Symp. on Discrete Algorithms, pp. 384–393. ACM/SIAM Press, USA (2003)

    Google Scholar 

  8. Balakrishnan, H., Lakshminarayanan, K., Ratnasamy, S., Shenker, S., Stoica, I., Walfish, M.: A layered naming architecture for the internet. In Proc. of ACM SIGCOMM, pp. 343–352. ACM Press, Germany (2004)

    Google Scholar 

  9. Bhagwan, R., Savage, S., Voelker, G. M.: Understanding availability. In Proc. of the 2nd Intl. Workshop on Peer-to-Peer Systems (IPTPS’03), pp. 256–267. Springer-Verlag, USA (2003)

    Google Scholar 

  10. Butt, A. R., Zhang, R., Hu, Y. C.: A self-organizing flock of Condors. In Proc. of the ACM/IEEE SC2003 Conf. on High Performance Networking and Computing, p. 42. ACM Press, USA (2003)

    Google Scholar 

  11. Buyya, R., Yeo, C. S., Venugopal, S., Broberg, J., Brandic, I.: Cloud computing and emerging IT platforms: vision, hype, and reality for delivering computing as the 5th utility. Future Gener. Comput. Syst. 25(6):599–616 (2009)

    Article  Google Scholar 

  12. Cai, M., Frank, M., Chen, J., Szekely, P.: MAAN: a Multi-Attribute Addressable Network for Grid information services. J. Grid Computing 2(1):3–14 (2004)

    Article  MATH  Google Scholar 

  13. Castro, M., Costa, M., Rowstron, A.: Should we build Gnutella on a structured overlay? ACM SIGCOMM Comput. Commun. Rev. 34(2):131–136 (2004)

    Article  Google Scholar 

  14. Castro, M., Costa, M., Rowstron, A.: Debunking some myths about structured and unstructured overlays. In Proc. of 2nd Symp. on Networked Systems Design and Implementation (NSDI’05), pp. 85–98. USENIX Association, USA (2005)

    Google Scholar 

  15. Castro, M., Druschel, P., Ganesh, A., Rowstron, A., Wallach, D. S.: Secure routing for structured peer-to-peer overlay networks. In Proc. of the 5th USENIX Symp. on Operating Systems Design and Implementation (OSDI 2002), pp. 299–314. USENIX Association, USA (2002)

    Chapter  Google Scholar 

  16. Chang, R.-S., Hu, M.-S.: A resource discovery tree using bitmap for Grids. Future Gener. Comput. Syst. 26(1):29–37 (2010)

    Article  MathSciNet  Google Scholar 

  17. Chawathe, Y., Ratnasamy, S., Breslau, L., Lanham, N., Shenker, S.: Making Gnutella-like P2P systems scalable. In Proc. of ACM SIGCOMM, pp. 407–418. ACM Press, Germany (2003)

    Google Scholar 

  18. Cheng, A.-H., Joung, Y.-J.: Probabilistic file indexing and searching in unstructured peer-to-peer networks. In Proc. of the 4th IEEE Intl. Symp. on Cluster Computing and the Grid (CCGRID 2004), pp. 9–18. IEEE Computer Society Press, USA (2004)

    Google Scholar 

  19. Cody, E., Sharman, R., Rao, R. H., Upadhyaya, S.: Security in Grid computing: a review and synthesis. Decis Support Syst 44(4):749–764 (2008)

    Article  Google Scholar 

  20. Cooper, B. F.: Quickly routing searches without having to move content. In Proc. of the 4th Intl. Workshop on Peer-to-Peer Systems (IPTPS’05), p. 163–172. Springer-Verlag, USA (2005)

    Google Scholar 

  21. Crespo, A., Garcia-Molina, H.: Routing indices for peer-to-peer systems. In Proc. of the 22nd IEEE Intl. Conf. On Distributed Computing Systems (ICDCS 2002), pp. 23–33. IEEE Computer Society Press, Austria (2002)

    Chapter  Google Scholar 

  22. Dabek, F., Kaashoek, M. F., Karger, D., Morris, R., Stoica, I.: Wide-area cooperative storage with CFS. In Proc. of the 11th ACM Symp. on Operating Systems Principles (SOSP’01), pp. 202–215. ACM Press, Canada (2001)

    Google Scholar 

  23. Dabek, F., Zhao, B. Y., Druschel, P., Kubiatowicz, J., Stoica, I.: Towards a common API for structured peer-to-peer overlays. In Proc. of the 2nd Intl. Workshop on Peer-to-Peer Systems (IPTPS’03), pp. 33–44. Springer-Verlag, USA (2003)

    Google Scholar 

  24. Dabel, F., Cox, R., Kaashoek, F., Morris, R.: Vivaldi: a decentralized network coordinate system. In Proc. of ACM SIGCOMM, pp. 15–26 (2004)

  25. Forestiero, A., Mastroianni, C., Spezzano, G.: QoS-based dissemination of content in Grids. Future Gener. Comput. Syst. 24(3):235–244 (2008)

    Article  Google Scholar 

  26. Foster, I., Kesselman, C. (eds.): The Grid: blueprint for a New Computing Infrastructure. Morgan Kaufmann Publishers (1999)

  27. Foster, I., Zhao, Y., Raicu, I., Lu, S.: Cloud computing and Grid computing 360-degree compared. In Proc. of Grid Computing Environment Works. (GCE), pp. 1–10. IEEE Computer Society Press, USA (2008)

    Google Scholar 

  28. Ghodsi, A., Alima, L. O., Haridi, S.: Symmetric replication for structured peer-to-peer systems. In Proc. of the 3rd Intl. Workshop on Databases, Information Systems and Peer-to-Peer Computing (DBISP2P 2005), p. 12. Spinger-Verlag, Norway (2005)

    Google Scholar 

  29. Godfrey, B., Lakshminarayanan, K., Surana, S., Karp, R., Stoica, I.: Load balancing in dynamic structured P2P systems. In Proc. of INFOCOM 2004, pp. 2253– 2262. IEEE Press, China (2004)

    Google Scholar 

  30. Godfrey, P. B., Stoica, I.: Heterogeneity and load balance in distributed hash tables. In Proc. of INFOCOM 2005, pp. 596–606. IEEE Press, USA (2005)

    Google Scholar 

  31. Gummadi, K., Gummadi, R., Gribble, S., Ratnasamy, S., Shenker, S., Stoica, I.: The impact of DHT routing geometry on resilience and proximity. In Proc. of ACM SIGCOMM, pp. 381–394. ACM Press, Germany (2003)

    Google Scholar 

  32. Gummadi, P. K., Saroiu, S., Gribble, S.: Measurement study of Napster and Gnutella as examples of peer-to-peer file sharing systems. Multim. Syst. Journal 9(2):170–184 (2003)

    Article  Google Scholar 

  33. Gupta, A., Liskov, B., Rodrigues, R.: Efficient routing for peer-to-peer overlays. In Proc. of 1st Symp. on Networked Systems Design and Implementation (NSDI’04), pp. 113–126. USENIX Association, USA (2004)

    Google Scholar 

  34. Harvey, N. J. A., Jones, M. B., Saroiu, S., Theimer, M., Wolman, A.: SkipNet: a scalable overlay network with practical locality properties. In Proc. of the 4th USENIX Symp. on Internet Technologies and Systems (USITS’03), pp. 113–126. USENIX Association, USA (2003)

    Google Scholar 

  35. Hsiao, H.-C., King, C.-T.: A tree model for structured peer-to-peer protocols. In Proc. of the 3rd IEEE Intl. Symp. on Cluster Computing and the Grid (CCGRID 2003), pp. 336–343. IEEE Computer Society Press, Japan (2003)

    Chapter  Google Scholar 

  36. Iamnitchi, A., Ripeanu, M., Foster, I.: Locating data in (small-world?) peer-to-peer scientific collaborations. In Proc. of the 1st Intl. Works. on Peer-to-Peer Systems (IPTPS’02), pp. 232–241. Springer-Verlag, USA (2002)

    Google Scholar 

  37. Karger, D. R., Ruhl, M.: Simple, efficient load balancing algorithms for peer-to-peer systems. In Proc. of the 3rd Intl. Workshop on Peer-to-Peer Systems (IPTPS’04), pp. 131–140. Springer-Verlag, USA (2004)

    Google Scholar 

  38. Kashani, F. B., Shahabi, C.: Criticality-based analysis and design of unstructured peer-to-peer networks as “complex systems”. In Proc. of the 3rd IEEE Intl. Symp. on Cluster Computing and the Grid (CCGRID 2003), pp. 351–358. IEEE Computer Society Press, Japan (2003)

    Chapter  Google Scholar 

  39. Kaufman, L. M.: Data security in the world of cloud computing. IEEE Secur. Priv. 7(4):61–64 (2009)

    Article  Google Scholar 

  40. Kienle, H. M., German, D., Tilley, S., Muüller, H. A.: Intellectual property aspects of web publishing. In Proc. of the 22nd Intl. Conf. on Design of Communication: the Engineering of Quality Documentation (SIGDOC), pp. 136–194. ACM Press, USA (2004)

    Chapter  Google Scholar 

  41. Krauter, K., Buyya, R., Maheswaran, M.: A taxonomy and survey of Grid resource management systems for distributed computing. Intl. Journal of Softw., Practic. and Exper. 32(2):135–164 (2002)

    Article  MATH  Google Scholar 

  42. Kubiatowicz, J., Bindel, D., Chen, Y., Eaton, P., Geels, D., Gummadi, R., Rhea, S., Weatherspoon, H., Weimer, W., Wells, C., Zhao, B.: OceanStore: an architecture for global-scale persistent storage. In Proc. of the 9th Intl. Conf. on Architectural Support for Programming Languages and Operating Systems (ASPLOS-IX), pp. 190–201. ACM Press, USA (2000)

    Chapter  Google Scholar 

  43. Landers, M., Zhang, H., Tan, K.-L.: Peerstore: better performance by relaxing in peer-to-peer backup. In Proc. of the 4th Intl. Conf. on Peer-to-Peer Computing (P2P 2004), pp. 72–79. IEEE Computer Society Press, Switzerland (2004)

    Chapter  Google Scholar 

  44. Leslie, M., Davies, J., Huffman, T.: Replication strategies for reliable decentralised storage. In Proc. of the 1st Workshop on Dependable and Sustainable Peer-to-Peer Systems (DAS-P2P 2006), pp. 740–747. IEEE Computer Society Press, Japan (2006)

    Google Scholar 

  45. Li, J., Stribling, J., Gil, T. M., Morris, R., Kaashoek, M. F.: Comparing the performance of distributed hash tables under churn. In Proc. of the 3rd Intl. Workshop on Peer-to-Peer Systems (IPTPS’04), pp. 87–99. Springer-Verlag, USA (2004)

    Google Scholar 

  46. Li, W., Xu, Z., Dong, F., Zhang, J.: Grid resource discovery based on a routing-transferring model. In Proc. of the 3rd Intl. Workshop on Grid Computing (GRID 2002), pp. 145–156. Springer-Verlag, USA (2002)

    Google Scholar 

  47. Loo, B. T., Huebsch, R., Stoica, I., Hellerstein, J. M.: The case for a hybrid P2P search infrastructure. In Proc. of the 3rd Intl. Workshop on Peer-to-Peer Systems (IPTPS’04), pp. 141–150. Springer-Verlag, USA (2004)

    Google Scholar 

  48. Lv, Q., Cao, P., Cohen, E., Li, K., Shenker, S.: Search and replication in unstructured peer-to-peer networks. In Proc. of the 2002 Intl. Conf. on Supercomputing (ICS 2002), pp. 84–95. ACM Press, USA (2002)

    Google Scholar 

  49. March, V., Teo, Y. M.: Multi-attribute range queries on read-only DHT. In Proc. of the 15th Intl. Conf. on Computer Communications and Networks (ICCCN 2006), pp. 419–424. IEEE Communications Society Press, USA (2006)

    Chapter  Google Scholar 

  50. March, V., Teo, Y. M., Lim, H. B., Eriksson, P., Ayani, R.: Collision detection and resolution in hierarchical peer-to-peer systems. In Proc. of the 30th IEEE Conf. on Local Computer Networks (LCN 2005), pp. 2–9. IEEE Computer Society Press, Australia (2005)

    Google Scholar 

  51. March, V., Teo, Y. M., Wang, X.: DGRID: a DHT-based Grid resource indexing and discovery scheme for computational Grids. In Proc. of the 5th Australasian Symp. on Grid computing and e-Research (AusGrid 2007). Australian Computer Society Inc, Australia (2007)

    Google Scholar 

  52. Maymounkov, P., Mazières, D.: Kademlia: a peer-to-peer information system based on the XOR metric. In Proc. of the 1st Intl. Workshop on Peer-to-Peer Systems (IPTPS’02), pp. 53–65. Springer-Verlag, USA (2002)

    Google Scholar 

  53. Moreno-Vozmediano, R.: A hybrid mechanism for resource/service discovery in ad-hoc Grids. Future Gener. Comput. Syst. 25(7):717–727 (2009)

    Article  Google Scholar 

  54. Németh, Z., Sunderam, V.: Characterizing Grids: attributes, definitions, and formalisms. J. Grid Computing 1(1):9–23 (2003)

    Article  Google Scholar 

  55. Ng, T. S. E., Zhang, H.: Predicting internet network distance with coordinates-based approaches. In Proc. of the 21st Annual Joint Conf. of the IEEE Computer and Communications Societies (IEEE Infocom), pp. 170–179 (2002)

  56. Nielson, S. J., Crosby, S. A., Wallach, D. S.: A taxonomy of rational attacks. In Proc. of the 4th Intl. Workshop on Peer-to-Peer Systems (IPTPS’05), pp. 36–46. Springer-Verlag, USA (2005)

    Google Scholar 

  57. Ramaswamy, L., Gedik, B., Liu, L.: A distributed approach to node clustering in decentralized peer-to-peer networks. IEEE Trans. Parallel Distrib. Syst. 16(9):814–829 (2005)

    Article  Google Scholar 

  58. Ratnasamy, S., Francis, P., Handley, M., Karp, R., Shenker, S.: A scalable Content-Addressable Network. In Proc. of ACM SIGCOMM, pp. 161–172. ACM Press, USA (2001)

    Google Scholar 

  59. Ratnasamy, S., Stoica, I., Shenker, S.: Routing algorithms for DHTs: some open questions. In Proc. of the 1st Intl. Workshop on Peer-to-Peer Systems (IPTPS’02), pp. 45–52. Springer-Verlag, USA (2002)

    Google Scholar 

  60. Rhea, S., Godfrey, B., Karp, B., Kubiatowicz, J., Ratnasamy, S., Shenker, S., Stoica, I., Yu, H.: OpenDHT: a public DHT service and its uses. In Proc. of ACM SIGCOMM, pp. 73–84. ACM Press, USA (2005)

    Google Scholar 

  61. Rodrigues, R., Blake, C.: When multi-hop peer-to-peer lookup matters. In Proc. of the 3rd Intl. Workshop on Peer-to-Peer Systems (IPTPS’04), pp. 112–122. Springer-Verlag, USA (2004)

    Google Scholar 

  62. Rowstron, A., Druschel, P.: Pastry: scalable, distributed object location and routing for large-scale peer-to-peer systems. In Proc. of IFIP/ACM Intl. Conf. on Distributed Systems Platforms (Middleware 2001), pp. 329–350. Springer-Verlag, Germany (2001)

    Google Scholar 

  63. Shneidman, J., Parkes, D. C.: Rationality and self-interest in peer to peer networks. In Proc. of the 2nd Intl. Workshop on Peer-to-Peer Systems (IPTPS’03), pp. 139–148. Springer-Verlag, USA (2003)

    Google Scholar 

  64. Spence, D., Harris, T.: XenoSearch: distributed resource discovery in the XenoServer open platform. In Proc. of the 12th IEEE International Symp. on High Performance Distributed Computing (HPDC-12), pp. 216–225. IEEE Computer Society Press, USA (2003)

    Google Scholar 

  65. Stoica, I., Morris, R., Karger, D., Kaashoek, M. F., Balakrishnan, H.: Chord: a scalable peer-to-peer lookup service for internet applications. In Proc. of ACM SIGCOMM, pp. 149–160. ACM Press, USA (2001)

    Google Scholar 

  66. Wohlmacher, P., Pharow, P.: Applications in health care using public-key certificates and attribute certificates. In Proc. of the 16th Annual Computer Security Applications Conf. (ACSAC), pp. 128–137. IEEE Computer Society Press, USA (2000)

    Chapter  Google Scholar 

  67. Yang, B., Garcia-Molina, H.: Designing a super-peer network. In Proc. of the 19th Intl. Conf. on Data Engineering (ICDE 2003), pp. 49–61. IEEE Computer Society Press, India (2003)

    Google Scholar 

  68. Zeinalipour-Yazti, D., Kalogeraki, V.: Structuring topologically aware overlay networks using domain names. Computer Networks: Int. J. Computing and Telecomm. 50(16):3064–3082 (2006)

    MATH  Google Scholar 

  69. Zhu, C., Liu, Z., Zhang, W., Xiao, W., Xu, Z., Yang, D.: Decentralized Grid resource discovery based on resource information community. J. Grid Computing 2(3):261–277 (2004)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, National University of Singapore, Computing 1, 13 Computing Drive, Singapore, 117417, Singapore

    Verdi March & Yong Meng Teo

Authors
  1. Verdi March
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yong Meng Teo
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Verdi March.

Rights and permissions

Reprints and permissions

About this article

Cite this article

March, V., Teo, Y.M. A Read-Only Distributed Hash Table. J Grid Computing 9, 501–529 (2011). https://doi.org/10.1007/s10723-011-9189-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10723-011-9189-9

Keywords

Search

Navigation