Skip to main content
SpringerLink
Log in

Design and analysis of a distributed grid resource discovery protocol

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

Computational grids have been emerging as a new paradigm for solving large complex problems over the recent years. The problem space and data set are divided into smaller pieces that are processed in parallel over the grid network and reassembled upon completion. Typically, resources are logged into a resource broker that is somewhat aware of all of the participants available on the grid. The resource broker scheme can be a bottleneck because of the amount of computational power and network bandwidth needed to maintain a fresh view of the grid. In this paper, we propose to place the load of managing the network resource discovery on to the network itself: inside of the routers. In the proposed protocol, the routers contain tables for resources similar to routing tables. These resource tables map IP addresses to the available computing resource values, which are provided through a scoring mechanism. Each resource provider is scored based on the attributes they provide such as the number of processors, processor frequency, amount of memory, hard drive space, and the network bandwidth. The resources are discovered on the grid by the protocol’s discovery packets, which are encapsulated within the TCP/IP packets. The discovery packet visits the routers and look up in the resource tables until a satisfactory resource is found. The protocol is validated by simulations with five different deployment environments.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Aberer, K., Cudre-Mauroux, P., Datta, A., Despotovic, Z., Hauswirth, M., Punceva, M., Schmidt, R., Wu, J.: Advanced peer-to-peer networking: the P-grid system and its applications. PIK Journal, Special Issue on P2P Systems (2003)

  2. Andrzejak, A., Xu, Z.: Scalable, efficient range queries for grid information services. In: Proceedings of the 2nd IEEE P2P, pp. 33–40 (2002)

    Google Scholar 

  3. Angulo, D., Foster, I., Liu, C., Yang, L.: Design and evaluation of a resource selection framework for grid applications. In: Proceedings of IEEE International Symposium on High Performance Distributed Computing (HPDC-11), Edinburgh, Scotland (2002)

    Google Scholar 

  4. Aspnes, J., Shah, G.: Skip graphs. In: Proceedings of the ACM SIAM Symposium on Discrete Algorithms, pp. 384–393 (2003)

    Google Scholar 

  5. Bernatz, J.C. COL (Ret.), Shockley, J.: A funny thing happened on the way to an LVC integration: great training. SRI International. http://www.jtepforguard.com/pubs/04E-SIW-065.pdf (2004)

  6. Brooke, J., Garwood, K., Goble, C.: Interoperability of grid resource descriptions: a semantic approach. http://www.semanticgrid.org/GGF/ggf9/john/ (2007)

  7. Bucur, D.: Resource discovery in activity-based sensor networks. Mob. Netw. Appl. 12(2/3), 129–142 (2006)

    Google Scholar 

  8. Buyya, R.: Economic-based distributed resource management and scheduling for grid computing. School of Computer Science and Software Engineering of Monash University (2002)

  9. Chen, L., Candan, K.S., Tatemura, J., Agrawal, D., Cavendish, D.: On overlay schemes to support point-in-range queries for scalable grid resource discovery. In: Proc. of the 5th IEEE Int’l Conf. on Peer-to-Peer Computing (2005)

    Google Scholar 

  10. Condor High Throughput Computing. http://www.cs.wisc.edu/condor (2007)

  11. Crainiceanu, A., Linga, P., Gehrke, J., Shanmugasundaram, J.: Querying peer-to-peer networks using P-trees. In: Proceedings of the 7 th International Workshop on the Web and Databases (WebDB’2004) (2004)

    Google Scholar 

  12. Crainiceanu, A., Linga, P., Machanavajjhala, A., Gehrke, J., Shanmugasundaram, J.: P-ring: an index structure for peer-to-peer systems. Cornell University, Computer and Information Science, TR2004-1946 (2004)

  13. Czajkowski, K., Foster, I., Kesselman, C., Sander, V., Tuecke, S.: SNAP: a protocol for negotiating service level agreements and coordinating resource management in distributed systems. Lect. Notes Comput. Sci. 2537, 153–183 (2002)

    Article  Google Scholar 

  14. Ferreira, L., Berstis, V., Armstrong, J.: Introduction to grid computing with Globus. IBM, October 1, 2003

  15. Foster, I., Iamnitchi, A.: On death, taxes, and the convergence of grid and p2p computing. In: Proceedings of the International Workshop on P2P Systems (2003)

    Google Scholar 

  16. Ganesan, P., Bawa, M., Garcia-Molina, H.: Online balancing of range-partitioned data with applications to peer-to-peer systems. In: Proceedings of the 30 th International Conference on Very Large Data Bases (VLDB) (2004)

    Google Scholar 

  17. Gupta, A., Agrawal, D., El Abbadi, A.: Approximate range selection queries in peer-to-peer systems. In: Proc. of the First Biennial Conference on Innovative Data Systems Research (CIDR’03), pp. 141–151 (2003)

    Google Scholar 

  18. Iamnitchi, A., Foster, I.: On fully decentralized resource discovery in grid environments. In: International Workshop on Grid Computing, Denver, CO (2001)

    Google Scholar 

  19. Iamnitchi, A., Foster, I.: On fully decentralized resource discovery in GRIF environments. In: International Workshop on Grid Computing, Denver, CO (2001)

    Google Scholar 

  20. Joseph, J., Fellenstein, C.: Grid Computing. IBM Press, Upper Saddle (2003)

    Google Scholar 

  21. Joseph, J., Ernest, M., Fellenstein, C.: Evolution of grid computing architecture and grid adoption models. IBM Syst. J. 43 (2004)

  22. Lacks, D., Kocak, T.: A distributed grid resource discovery and management protocol and its deployment environments. In: GCA’06—The 2006 International Conference on Grid Computing and Applications, pp. 11–17 (2006)

    Google Scholar 

  23. Leong, P., Miao, C., Lee, B.-S.: Agent oriented software engineering for grid computing. In: Parallel Computing in Electrical Engineering (2006)

    Google Scholar 

  24. Li, J., Vuong, S.: A scalable semantic routing architecture for grid resource discovery. In: Proceedings of the 2005 11th International Conference on Parallel and Distributed Systems (ICPADS’05) (2005)

    Google Scholar 

  25. NIMROD: tools for distributed parametric modeling. http://www.csse.monash.edu.au/davida/nimrod/nimrodg.htm (2007)

  26. P-GRID, SRDC (Software Research and Development Center) P2P seminar presentation. http://www.srdc.metu.edu.tr/webpage/seminars/ (2007)

  27. Powers, L., Snell, M.: Microsoft Visual Studio 2005 Unleashed. Sams, Indianapolis (2007)

    Google Scholar 

  28. PUNCH portal. http://punch.purdue.edu/HubInfo/about.html (2007)

  29. Sahin, O., Gupta, A., Agrawal, D., El Abbadi, A.: A peer-to-peer framework for caching range queries. In: Proceedings of the 20 th International conference on data engineering (ICDE’2004), pp. 165–176 (2004)

    Chapter  Google Scholar 

  30. Schopf, J.M.: Ten actions when grid scheduling, the user as a grid scheduler. In: Grid Resource Management. Kluwer Academic, Dordrecht (2004), Chap. 2

    Google Scholar 

  31. Shepherd, G., Kruglinski, D.: Programming with Microsoft Visual C++ .NET. Microsoft Press, October 25, 2002

  32. The Datagrid Project. http://eu-datagrid.web.cern.ch/eu-datagrid (2007)

  33. The Globus Alliance. http://www.globus.org/ (2007)

  34. Xu, Z., Sun, N., Li, W., Liu, T.: Dawning superservers and the VEGA grid. Institute of Computing Technology Chinese Academy of Sciences

  35. Zou, H., Jin, H., Han, Z., Tie, J., Shi, X.: A virtual-service-domain based bidding algorithm for resource discovery in computational grid. In: Proceedings of the 2005 IEEE/WIC/ACM International Conference on Web Intelligence (WI’05) (2005)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Bahcesehir University, Istanbul, Turkey

    Taskin Kocak

  2. School of Electrical Engineering and Computer Science, University of Central Florida, Orlando, FL, 32816, USA

    Daniel Lacks

Authors
  1. Taskin Kocak
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Daniel Lacks
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Taskin Kocak.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kocak, T., Lacks, D. Design and analysis of a distributed grid resource discovery protocol. Cluster Comput 15, 37–52 (2012). https://doi.org/10.1007/s10586-010-0147-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-010-0147-2

Keywords

Search

Navigation