Skip to main content
SpringerLink
Log in

Peer-to-Peer Approaches to Grid Resource Discovery

  • Chapter
Making Grids Work

Abstract

Peer-to-peer organization of Grid resource discovery services would have several desirable features, including high scalability, high reliability, self-organization and self-healing. In this paper, we describe challenges in applying P2P techniques to Grid services. These include the choice of overlay configuration and varying security requirements for Grid and P2P environments. We present the design and implementation of two peer-to-peer Grid resource discovery services: an unstructured peer-to-peer information service and a structured peer-to-peer replica location service. We discuss the design tradeoffs, performance and scalability of these two systems as well as related work and ongoing challenges for applying P2P techniques to Grid discovery services.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. I. Stoica, R. Morris, D. Karger, F. Kaashoek, and H. Balakrishnan, "Chord: A Scalable Peer-To-Peer Lookup Service for Internet Applications," presented at ACM SIGCOMM, 2001.

    Google Scholar 

  2. B. Y. Zhao, J. D. Kubiatowicz, and A. D. Joseph, "Tapestry: An infrastructure for fault-resilient wide-area location and routing," U.C. Berkeley, Berkeley Technical Report UCB-CSD-01-1141, April 2001 2001.

    Google Scholar 

  3. S. Ratnasamy, P. Francis, M. Handley, R. Karp, and S. Shenker, "A Scalable Content-Addressable Network," presented at ACM SIGCOMM, 2001.

    Google Scholar 

  4. A. Iamnitchi, I. Foster, D. Nurmi, "A Peer-to-Peer Approach to Resource Discovery in Grid Environments," presented at Eleventh IEEE Int’l Symposium High Performance Distributed Computing (HPDC-11), Edinburgh, Scotland, 2002.

    Google Scholar 

  5. I. Foster and A. Iamnitchi, "On Death, Taxes, and the Convergence of Peer-to-Peer and Grid Computing," presented at Int’l Workshop on Peer-to-Peer Systems (IPTPS’03), Berkeley, CA, USA, 2003.

    Google Scholar 

  6. M. Cai, A. Chervenak, M. Frank, "A Peer-to-Peer Replica Location Service Based on a Distributed Hash Table," presented at SC2004 Conference, Pittsburgh, PA, 2004.

    Google Scholar 

  7. S. Bharathi and A. Chervenak, "Design of a Scalable Peer-to-Peer Information System Using the GT4 Index Service," presented at Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid 2007), Rio de Janeiro, Brazil, 2007.

    Google Scholar 

  8. A. S. Cheema, M. Muhammad, and I. Gupta, "Peer-to-Peer Discovery of Computational Resources for Grid Applications," Proceedings of 6th IEEE/ACM International Workshop on Grid Computing (Grid 2005), pp. 179-185, 2005.

    Google Scholar 

  9. K. Czajkowski, S. Fitzgerald, I. Foster, C. Kesselman, "Grid Information Services for Distributed Resource Sharing," presented at Tenth IEEE International Symposium on High-Performance Distributed Computing (HPDC-10), 2001.

    Google Scholar 

  10. A. Chervenak, E. Deelman, I. Foster, L. Guy, W. Hoschek, A. Iamnitchi, C. Kesselman, P. Kunst, M. Ripeanu, B, Schwartzkopf, H, Stockinger, K. Stockinger, B. Tierney, "Giggle: A Framework for Constructing Sclable Replica Location Services," presented at SC2002 Conference, Baltimore, MD, 2002.

    Google Scholar 

  11. A. L. Chervenak, N. Palavalli, S. Bharathi, C. Kesselman, R. Schwartzkopf, "Perfor-mance and Scalability of a Replica Location Service," presented at Thirteenth IEEE Int’l Symposium High Performance Distributed Computing (HPDC-13), Honolulu, HI, 2004.

    Google Scholar 

  12. G. Singh, Shishir Bharathi, Ann Chervenak, Ewa Deelman, Carl Kesselman, Mary Manohar, Sonal Pail, Laura Pearlman, "A Metadata Catalog Service for Data Intensive Applications," presented at SC2003, 2003.

    Google Scholar 

  13. E. Deelman, Gurmeet Singh, Malcolm P. Atkinson, Ann Chervenak, Neil P. Chue Hong, Carl Kesselman, Sonal Patil, Laura Pearlman, Mei-Hui Su, "Grid-Based Metadata Services," presented at 16th International Conference on Scientific and Statistical Database Management, 2004.

    Google Scholar 

  14. SRB Project, "MCAT - A Meta Information Catalog (Version 1.1), http://www.npaci.edu/DICE/SRB/mcat.html."

  15. A. Rajasekar, M. Wan, R. Moore, W. Schroeder, G. Kremenek, A. Jagatheesan, C. Cowart, B. Zhu, S. Y. Chen, and R. Olschanowsky, "Storage Resource Broker-Managing Distributed Data in a Grid," Computer Society of India Journal, Special Issue on SAN, vol. 33(4), pp. 42-54, 2003.

    Google Scholar 

  16. A. Rowstron, P. Druschel., "Pastry: Scalable, distributed object location and routing for large-scale peer-to-peer systems," presented at International Conference on Distributed Systems Platforms (Middleware), 2001.

    Google Scholar 

  17. M. Cai, Martin Frank, "RDFPeers: A Scalable Distributed RDF Repository based on A Structured Peer-to-Peer Network," presented at 13th International World Wide Web Conference(WWW2004), New York, NY, 2004.

    Google Scholar 

  18. F. Manola and E. Miller, "Resource Description Framework (RDF) Primer, http://www.w3.org/TR/2004/REC-rdf-primer-20040210/," 2004.

  19. "Napster, http://www.napster.com."

  20. Y. Chawathe, S. Ratnasamy, L. Breslau, N. Lanham, and S. Shenker, "Making Gnutella-like P2P Systems Scalable," presented at ACM SIGCOMM 2003, Karlsruhe, Germany, 2003.

    Google Scholar 

  21. J. Liang, R. Kumar, and K. W. Ross, "The KaZaA Overlay: A Measurement Study," Computer Networks Journal (Elsevier), 2005.

    Google Scholar 

  22. A. Crespo, et al., "Routing Indices for Peer-to-peer systems," presented at ICDCS, 2002.

    Google Scholar 

  23. J. Ritter, "Why Gnutella canŠt scale, no really…, 2001," Preprint http://www. dark-ridge. com/jpr5/doc/gnutella. html.

  24. K. Czajkowski, D. F. Ferguson, I. Foster, J. Frey, S. Graham, I. Sedukhin, D. Snelling, S. Tuecke, and W. Vambenepe, "The WS-resource framework. Version 1.0., http://www-106.ibm.com/developerworks/library/ws-resource/ws-wsrf.pdf," 2004.

  25. A. L. Chervenak and M. Cai, "Applying Peer-to-Peer Techniques to Grid Replica Location Services," Journal of Grid Computing, vol. 4, pp. 49-69, 2006.

    Article  Google Scholar 

  26. M. Siddiqui, et al., "GLARE: A Grid Activity Registration, Deployment and Provi-sioning Framework," presented at SC 2005, Seattle.

    Google Scholar 

  27. M. Ripeanu, Ian Foster, "A Decentralized, Adaptive, Replica Location Mechanism," presented at 11th IEEE International Symposium on High Performance Distributed Com-puting (HPDC-11), Edinburgh, Scotland, 2002.

    Google Scholar 

  28. "MonALISA: MONitoring Agents using a Large Integrated Services Architecture, http://monalisa.cacr.caltech.edu/monalisa.htm," 2006.

  29. A. Cooke, A.Gray, L. Ma, W. Nutt, J. Magowan, P. Taylor, R. Byrom, L. Field, S. Hicks, and J. Leake, "R-GMA: An Information Integration System for Grid Monitoring," presented at Proceedings of the 11th International Conference on Cooperative Information Systems, 2003.

    Google Scholar 

  30. "Nagios, http://www.nagios.org/ ", 2006.

  31. M. L. Massie, Brent N. Chun, and David E. Culler., "The Ganglia Distributed Monitoring System: Design, Implementation, and Experience," Parallel Computing, vol. 30,2004.

    Google Scholar 

  32. Condor Project, "Hawkeye: A Monitoring and Management Tool for Distributed Systems, http://www.cs.wisc.edu/condor/hawkeye/," 2007.

  33. D. Cameron, J. Casey, L. Guy, P. Kunszt, S. Lemaitre, G. McCance, H. Stockinger, K. Stockinger, G. Andronico, and W. Bell, "Replica Management in the European DataGrid Project," Journal of Grid Computing, vol. 2, pp. 341-351, 2004.

    Article  Google Scholar 

  34. O. Tatebe, S. Sekiguchi, Y. Morita, S. Matsuoka, and N. Soda, "Worldwide Fast File Replication on Grid Datafarm," presented at Computing in High Energy and Nuclear Physics (CHEP03), La Jolla, CA, USA, 2003.

    Google Scholar 

  35. P. Kunszt, P. Badino, A. Frohner, G. McCance, K. Nienartowicz, R. Rocha, and D. Rodrigues, "Data Storage, Access and Catalogs in gLite," presented at Local to Global Data Interoperability-Challenges and Technologies, 2005.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. USC Information Sciences Institute, Marina del Rey, CA, USA

    Ann Chervenak & Shishir Bharathi

Authors
  1. Ann Chervenak
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shishir Bharathi
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer Science+Business Media, LLC

About this chapter

Cite this chapter

Chervenak, A., Bharathi, S. (2008). Peer-to-Peer Approaches to Grid Resource Discovery. In: Making Grids Work. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-78448-9_5

Download citation

  • DOI: https://doi.org/10.1007/978-0-387-78448-9_5

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-0-387-78447-2

  • Online ISBN: 978-0-387-78448-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation