Multi-Grid, Multi-User Workflows in the P-GRADE Grid Portal
- 115 Downloads
Computational Grids connect resources and users in a complex way in order to deliver nontrivial qualities of services. According to the current trend various communities build their own Grids and due to the lack of generally accepted standards these Grids are usually not interoperable. As a result, large scale sharing of resources is prevented by the isolation of Grid systems. Similarly, people are isolated, because the collaborative work of Grid users is not supported by current environments. Each user accesses Grids as an individual person without having the possibility of organizing teams that could overcome the difficulties of application development and execution more easily. The paper describes a new workflow-oriented portal concept that solves both problems. It enables the interoperability of various Grids during the execution of workflow applications, and supports users to develop and run their Grid workflows in a collaborative way. The paper also introduces a classification model that can be used to identify workflow-oriented Grid portals based on two general features: Ability to access multiple Grids, and support for collaborative problem solving. Using the approach the different potential portal types are introduced, their unique features are discussed and the portals and Problem Solving Environments (PSE) of our days are classified. The P-GRADE Portal as a Globus-based implementation for the classification model is also presented.
Key wordscollaborative environment DAGMan Globus Toolkit Grid computing Grid portal Gridsphere workflow management
Unable to display preview. Download preview PDF.
- 1.I. Foster and C. Kesselman, “Computational Grids”, The Grid: Blueprint for a New Computing Infrastructure, Morgan Kaufmann, pp. 15–52, 1998.Google Scholar
- 2.I. Foster and C. Kesselman, “The Globus project: A status report”, in Proc. of the Heterogeneous Computing Workshop, IEEE Computer Society, pp. 4–18, 1998.Google Scholar
- 3.E. Korpela, D. Werthimer, D.P. Anderson, J. Cobb and M. Lebofsky, “SETI@home – Massively distributed computing for SETI”, IEEE Computational Science and Engineering, Vol. 3, No. 1, pp. 78–83, 2001.Google Scholar
- 4.A.A. Chien, “Architecture of a commercial enterprise desktop Grid: The Entropia system”, Grid Computing – Making the Global Infrastructure a Reality, Wiley, Ltd., pp. 337–350, 2003.Google Scholar
- 5.M. Snir, S.W. Otto, S. Huss-Lederman, D.W. Walker and J. Dongarra, “MPI: The Complete Reference”, MIT, 1995.Google Scholar
- 10.Matthew Addis et al., “Experiences with eScience workflow specification and enactment in bioinformatics”, in Proc. of UK e-Science All Hands Meeting, S.J. Cox, Editor. 2003.Google Scholar
- 11.R. Barbera, A. Falzone and A. Rodolico, “The GENIUS Grid portal”, Computing in High Energy and Nuclear Physics, 2003.Google Scholar
- 12.UK NGS Portal: http://portal.ngs.ac.uk.
- 13.M. Thomas, S. Mock and J. Boisseau, “Development of Web Toolkits for computational Science Portals: The NPACI HotPage”, in Proc. of the 9th IEEE International Symposium on High Performance Distributed Computing (HPDC 2000), Pittsburgh, 2000.Google Scholar
- 14.R. Barbera et al., “The GENIUS Grid portal”, Computing in High Energy and Nuclear Physics, 2003.Google Scholar
- 15.I. Taylor et al., “Grid enabling applications using Triana”, Workshop on Grid Applications and Programming Tools, Seattle, 2003.Google Scholar
- 17.J. Novotny, S. Tuecke and V. Welch, “An online credential repository for the Grid: MyProxy”, in Proc. of 10th IEEE International. Symposium on High Performance Distributed Computing, 2001.Google Scholar
- 18.R. Lovas, G. Dózsa, P. Kacsuk, N. Podhorszki and D. Drótos, “Workflow support for complex Grid applications: Integrated and portal solutions”, in Proc. of Second European AcrossGrids Conference, (AxGrids 2004), Nicosia, Cyprus, LNCS, Vol. 3165, 2004, pp. 129–138.Google Scholar
- 19.UK e-Science OGSA Testbed: http://dsg.port.ac.uk/projects/ogsa-testbed/.
- 20.Southern Eastern European GRid-enabled eInfrastructure Development (SEE-GRID): http://www.see-Grid.org/.
- 21.UK National Grid Service: http://www.ngs.ac.uk/.
- 22.D. Thain, T. Tannenbaum and M. Livny, “Distributed computing in practice: The Condor experience”, Concurrency and Computation: Practice and Experience, pp. 323–356, 2005.Google Scholar
- 23.W. Allcock et al., “Gridftp protocol specification”, GGF GridFTP Working Group Document, September 2002.Google Scholar
- 24.B. Berliner: CVS II: ParalMizing software development, in Proc. of Winter 1990 USENIX Technical Conference, 1990.Google Scholar
- 25.W. Appelt, “WWW based collaboration with the BSCW system”, in Proc. of the Conference on Current Trends in Theory and Informatics, pp. 66–78, 1999.Google Scholar
- 26.R. Butler, D. Engert, I. Foster, C. Kesselman, S. Tuecke, J. Volmer and V. Welch, A national-scale authentication infrastructure. IEEE Computer, Vol. 33, No. 12, 60–66, 2000.Google Scholar
- 27.D.W. Erwin and D.F. Snelling, “UNICORE: A Grid computing environment”, In Lecture Notes in Computer Science, volume 2150, Springer, pp. 825–834, 2001.Google Scholar
- 28.G. Allen et al., “Enabling applications on the Grid: A Gridlab overview”, International Journal of High Performance Computing Applications, Issue 17, pp. 449–466, 2003.Google Scholar
- 29.G. Singh et al., “The Pegasus portal: Web based Grid computing”, in Proc. Of 20th Annual ACM Symposium on Applied Computing, Santa Fe, New Mexico, 2005.Google Scholar
- 30.J. Cao, S.A. Jarvis, S. Saini, and G.R. Nudd, “GridFlow: Workflow management for Grid computing”, in Proc. of the 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGRID'03), pp. 198–205, 2003.Google Scholar
- 31.LHC Computing Grid: http://lcg.web.cern.ch/LCG/.
- 32.M. Ellert et al., “The NorduGrid project: Using Globus toolkit for building Grid infrastructure,” Nuclear Instruments and Methods (Section A) 502, pp. 407–410, 2003.Google Scholar
- 33.Grid2003 Team, “The Grid2003 production Grid: Principles and practice”, in Proc. of the 13th IEEE Intl. Symposium on High Performance Distributed Computing (HPDC-13), 2004.Google Scholar
- 35.B. Coghlan, J. Walsh and D. O'Callaghan, “The Grid-Ireland deployment architecture”, in Proc. Of European Grid Conference, Amsterdam, The Netherlands, pp. 354–363, 2005.Google Scholar
- 36.R. Allan et al., “Virtual research environments: Sakai demonstrator”, in Proc. Of UK e-Science All Hands Meeting, 2005.Google Scholar
- 37.L. Childers, T. Disz, R. Olson, M.E. Papka, R. Stevens and T. Udeshi, “Access Grid: Immersive group-to-group collaborative visualization,” in Proc. of the 4th International Immersive Projection Technology Workshop, 2000.Google Scholar
- 38.W. Gantzsch, “Sun Grid engine, towards creating a compute power Grid”, in Proc. Of the 1st International Symposium on Cluster Computing and the Grid (CCGrid '01), IEEE Computer Society, pp. 35–6, 2001.Google Scholar
- 39.S. Zhou, “LSF: Load sharing in large-scale Heterogeneous distributed systems”, in Proc. Of Workshop on Cluster Computing, 1992.Google Scholar
- 41.I. Foster, C. Kesselman and S. Tuecke, “The anatomy of the Grid: Enabling scalable virtual organizations”, International Journal of Supercomputer Applications, Vol. 15, No. 3, 2001.Google Scholar
- 42.The HunGrid Virtual Organisation: http://www.lcg.kfki.hu/?hunGrid and hunGridgeneral.
- 43.J, Novotny, M. Russell and O. Wehrens: Grid-sphere: A portal framework for building collaborations” in Proc. of the 1st International Workshop on Middleware in Grid Computing, Rio de Janeiro, Brazil, 2003.Google Scholar
- 44.P-GRADE Grid Portal: http://www.pds.sztaki.hu/pgportal.
- 45.D. Britton et al., “GridPP: Meeting the particle physics computing challenge”, in Proc. Of UK e-Science All Hands Meeting, 2005.Google Scholar
- 46.LCG-2 User Guide, 4 August, 2005: https://edms.cern.ch/file/454439/2/LCG-2-UserGuide.html.
- 47.J. Yu and R. Buyya, “A Taxonomy of Workflow Management Systems for Grid Computing”, Journal of Computing, Vol.3, No. 3–4, 2006.Google Scholar