Abstract
A resource broker with a user-friendly interface for job submission developed on a platform constructed using the Globus toolkit is proposed. The broker employs a domain-based network information model and dynamic version to measure network statuses, and also monitors and collects resource statuses and network-related information as the basis of its brokerage. A network bandwidth-aware job scheduling algorithm for brokering suitable Grid resources to communication-intensive jobs based on improving and preserving the advantages of our previously developed network information model is also proposed. Using timely information, the resource broker effectively matches Grid resources and user requests, thus improving job execution efficiency.
Similar content being viewed by others
References
Aloisio G, Cafaro M (2002) Web-based access to the grid using the grid resource broker portal. Concurr Comput Pract Exp 14:1145–1160
Aloisio G, Cafaro M, Carteni G, Epicoco I, Fiore S, Lezzi D, Mirto M, Mocavero S (2007) The grid resource broker portal. Concurr Comput Pract Exp 19(12):1663–1670
Cafaro M, Epicoco I, Mirto M, Lezzi D, Aloisio G (2007) The grid resource broker workflow engine. In: Proceedings of international conference on grid and cooperative computing, 2007
Chen XL, Yang C, Lu SL, Chen GH (2004) An active resource management system for computational grid. In: Proceedings of grid and cooperative computing. Lecture notes in computer science, vol 3251. Springer, Berlin, pp 225–232
Czajkowski K, Fitzgerald S, Foster I, Kesselman C (2001) Grid information services for distributed resource sharing. In: Proceedings of the tenth IEEE international symposium on high-performance distributed computing. IEEE Press, New York
Deelman E, Singh G, Su M, Blythe J, Gil Y, Kesselman C, Mehta G, Vahi K, Berriman GB, Good J, Laity A, Jacob JC, Katz DS (2005) Pegasus: a framework for mapping complex scientific workflows onto distributed systems. J Sci Program 13(3):219–237
Ferreira L, Berstis V, Armstrong J, Kendzierski M, Neukoetter A, Takagi Ma, Bing-Wo R, Amir A, Murakawa R, Hernandez O, Magowan J, Bieberstein N (2003) Introduction to grid computing with Globus. http://www.ibm.com/redbooks
Foster I (2002) The grid: a new infrastructure for 21st century science. Phys Today 55(2):42–47
Foster I, Karonis N (1998) A grid-enabled MPI: message passing in heterogeneous distributed computing systems. In: Proceedings of supercomputing conference, 1998
Foster I, Kesselman C (1997) Globus: a metacomputing infrastructure toolkit. Int J Supercomput Appl 11(2):115–128
Foster I, Kesselman C (2003) The grid 2: blueprint for a new computing infrastructure, 2nd edn. Morgan Kaufmann, San Mateo
Gregor L, Mike H (2005) Workflow concepts of the Java CoG kit. J grid Comput 3(3–4):239–258
Ho LY, Liu PF, Wang CM, Wu JJ (2008) The development of a drug discovery virtual screening application on Taiwan unigrid. In: Proceedings of advances in grid and pervasive computing. Lecture notes in computer science, vol 5036. Springer, Berlin, pp 38–47
Karonis NT, Toonen B, Foster I (2003) MPICH-G2: A grid-enabled implementation of the message passing interface. J Parallel Distrib Comput 63(5):551–563
Krauter K, Buyya R, Maheswaran M (2002) A taxonomy and survey of grid resource management systems for distributed computing. Softw Pract Exp 32:135–164
Laszewski V, Foster I, Gawor J, Lane P (2001) A Java commodity grid kit. Concurr Comput Pract Exp 13:645–662
Le H, Coddington P, Wendelborn AL (2004) A data-aware resource broker for data grids. In: Proceedings of the IFIP international conference on network and parallel computing. Lecture notes in computer science, vol 3222. Springer, Berlin, pp 442–453
Leu FY, Li MC, Lin JC, Yang CT (2008) Detection workload in a dynamic grid-based intrusion detection environment. J Parallel Distrib Comput 68:427–442
Nabrzyski J, Schopf JM, Weglarz J (2005) grid resource management. Kluwer Academic, Dordrecht
Park SM, Kim JH (2003) Chameleon: a resource scheduler in a data grid environment. In: Proceedings of the IEEE/ACM international symposium on cluster computing and the grid, 2003, pp 258-265
Penchikala S (2008) Terracotta 2.6 supports cluster visualization tools and Tomcat 6 integration. http://www.infoq.com/news/2008/04/terracotta-2.6-release
Rodero I, Corbalán J, Badia RM, Labarta J (2005) eNANOS grid resource broker. In: Lecture notes in computer science, vol 3470. Springer, Berlin, pp 111–121
Shah SP, He DYM, Sawkins JN, Druce JC, Quon G, Lett D, Zheng GXY, Xu T, Quellette BFF (2004) Pegasys: software for executing and integrating analyses of biological sequences. BMC Bioinform 5:40
Toyama T, Yamada Y, Konishi K (2006) A resource management system for data-intensive applications in desktop grid environments. In: Parallel and distributed computing and systems. Acta Press, Calgary
Venugopal S, Buyya R, Winton L (2006) A grid service broker for scheduling e-science applications on global data grids. Concurr Comput Pract Exp 18:685–699
Yang CT, Lai CL, Shih PC, Li KC (2004) A resource broker for computing nodes selection in grid environments. In: Proceedings of grid and cooperative computing: international conference. Lecture notes in computer science, vol 3251. Springer, Berlin, pp 931–934
Yang CT, Lai CL, Li KC, Hsu CH, Chu WC (2005) On utilization of the grid computing technology for video conversion and 3D rendering. In: Proceedings of parallel and distributed processing and applications: third international symposium. Lecture notes in computer science, vol 3758. Springer, Berlin, pp 442–453
Yang CT, Shih PC, Li KC (2005) A high-performance computational resource broker for grid computing environments. In: Proceedings of the international conference on AINA, vol 2, 2005, pp 333–336
Yang CT, Li KC, Chiang WC, Shih PC (2005) Design and implementation of TIGER grid: an integrated metropolitan-scale grid environment. In: Proceedings of the 6th IEEE international conference on PDCAT, Dec 2005, pp 518–520
Yang CT, Shih PC, Chen SY, Shih WC (2005) An efficient network information modeling using NWS for grid computing environments. In: Proceedings of international conference on grid and cooperative computing. Lecture notes in computer science, vol 3795. Springer, Berlin, pp 287–299
Yang CT, Lin CF, Chen SY (2006) A workflow-based computational resource broker with information monitoring in grids. In: Proceedings of the IEEE international conference on grid and cooperative computing, 2006, pp 199–206
Yang CT, Chen TT, Chen SY (2007) Implementation of monitoring and information service using Ganglia and NWS for grid resource brokers. In: Proceedings of IEEE Asia-Pacific services computing conference, 2007, pp 356–363
Yang CT, Lai KC, Shih PC (2008) Design and implementation of a workflow-based resource broker with information system on computational grids. J Supercomput. doi:10.1007/s11227-008-0201-5
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Yang, CT., Leu, FY. & Chen, SY. Network Bandwidth-aware job scheduling with dynamic information model for Grid resource brokers. J Supercomput 52, 199–223 (2010). https://doi.org/10.1007/s11227-008-0256-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11227-008-0256-3