A Super-Peer Model for Multiple Job Submission on a Grid
- 237 Downloads
Submission of multiple jobs in a distributed and heterogeneous environment is required by applications that rely on the “public-resource computing” paradigm. We present here a scientific scenario for the analysis of astronomical data, where some nodes are responsible for maintaining and advertising job description files and other so called worker nodes, are dispersed over the Grid to execute the jobs. Job assignment is performed through a mechanism that matches adverts, containing job descriptions, with job queries that are sent by available workers across the Grid exploiting an underlying super-peer topology. With an analogous mechanism, a worker locates the input data file needed to run a job and downloads it from a data center node. This paper presents a super-peer protocol for the submission of a very large number of jobs on a Grid environment. The super-peer architecture enables the replication of data files on multiple data centers, which helps reduce the processing load and speed up the application. A simulation analysis has been performed to evaluate the impact of application and network parameters on performance results.
- 1.Anderson, D.: Public computing: Reconnecting people to science. In: Proc. of Conference on Shared Knowledge and the Web, Madrid, Spain, November, pp. 17–19 (2003)Google Scholar
- 2.Anderson, D.P.: BOINC: A System for Public-Resource Computing and Storage. In: 5th IEEE/ACM International Workshop on Grid Computing, November 2004, Pittsburgh, PA, pp. 365–372. ACM Press, New York (2004)Google Scholar
- 9.Yang, B., Garcia-Molina, H.: Designing a Super-Peer Network. In: 19th Int’l Conf. on Data Engineering, IEEE Computer Society Press, Los Alamitos (2003)Google Scholar