Journal of Grid Computing

, Volume 3, Issue 3–4, pp 221–238 | Cite as

Multi-Grid, Multi-User Workflows in the P-GRADE Grid Portal

Article

Abstract

Computational Grids connect resources and users in a complex way in order to deliver nontrivial qualities of services. According to the current trend various communities build their own Grids and due to the lack of generally accepted standards these Grids are usually not interoperable. As a result, large scale sharing of resources is prevented by the isolation of Grid systems. Similarly, people are isolated, because the collaborative work of Grid users is not supported by current environments. Each user accesses Grids as an individual person without having the possibility of organizing teams that could overcome the difficulties of application development and execution more easily. The paper describes a new workflow-oriented portal concept that solves both problems. It enables the interoperability of various Grids during the execution of workflow applications, and supports users to develop and run their Grid workflows in a collaborative way. The paper also introduces a classification model that can be used to identify workflow-oriented Grid portals based on two general features: Ability to access multiple Grids, and support for collaborative problem solving. Using the approach the different potential portal types are introduced, their unique features are discussed and the portals and Problem Solving Environments (PSE) of our days are classified. The P-GRADE Portal as a Globus-based implementation for the classification model is also presented.

Key words

collaborative environment DAGMan Globus Toolkit Grid computing Grid portal Gridsphere workflow management 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    I. Foster and C. Kesselman, “Computational Grids”, The Grid: Blueprint for a New Computing Infrastructure, Morgan Kaufmann, pp. 15–52, 1998.Google Scholar
  2. 2.
    I. Foster and C. Kesselman, “The Globus project: A status report”, in Proc. of the Heterogeneous Computing Workshop, IEEE Computer Society, pp. 4–18, 1998.Google Scholar
  3. 3.
    E. Korpela, D. Werthimer, D.P. Anderson, J. Cobb and M. Lebofsky, “SETI@home – Massively distributed computing for SETI”, IEEE Computational Science and Engineering, Vol. 3, No. 1, pp. 78–83, 2001.Google Scholar
  4. 4.
    A.A. Chien, “Architecture of a commercial enterprise desktop Grid: The Entropia system”, Grid ComputingMaking the Global Infrastructure a Reality, Wiley, Ltd., pp. 337–350, 2003.Google Scholar
  5. 5.
    M. Snir, S.W. Otto, S. Huss-Lederman, D.W. Walker and J. Dongarra, “MPI: The Complete Reference”, MIT, 1995.Google Scholar
  6. 6.
    N. Karonis, B. Toonen, and I. Foster, “MPICH-G2: A Grid-Enabled Implementation of the Message Passing Interface”, Journal of Parallel and Distributed Computing, Vol. 63, No. 5, pp. 551–563, 2003.CrossRefMATHGoogle Scholar
  7. 7.
    I. Foster, M. Fidler, A. Roy, V. Sander and L. Winkler, “End-to-end quality of service for high-end applications”, Elsevier Computer Communications Journal, Vol. 27, No. 14, pp. 1375–1388, 2004.CrossRefGoogle Scholar
  8. 8.
    Ewa Deelman, et al. “Mapping abstract complex workflows onto Grid environments”, Journal of Grid Computing, Vol. 1, No. 1, pp. 25–39, 2003.CrossRefGoogle Scholar
  9. 9.
    I. Taylor et al., “Triana applications within Grid computing and peer to peer environments”, Journal of Grid Computing, Vol. 1, No. 2, pp. 199–217, 2003.CrossRefGoogle Scholar
  10. 10.
    Matthew Addis et al., “Experiences with eScience workflow specification and enactment in bioinformatics”, in Proc. of UK e-Science All Hands Meeting, S.J. Cox, Editor. 2003.Google Scholar
  11. 11.
    R. Barbera, A. Falzone and A. Rodolico, “The GENIUS Grid portal”, Computing in High Energy and Nuclear Physics, 2003.Google Scholar
  12. 12.
    UK NGS Portal: http://portal.ngs.ac.uk.
  13. 13.
    M. Thomas, S. Mock and J. Boisseau, “Development of Web Toolkits for computational Science Portals: The NPACI HotPage”, in Proc. of the 9th IEEE International Symposium on High Performance Distributed Computing (HPDC 2000), Pittsburgh, 2000.Google Scholar
  14. 14.
    R. Barbera et al., “The GENIUS Grid portal”, Computing in High Energy and Nuclear Physics, 2003.Google Scholar
  15. 15.
    I. Taylor et al., “Grid enabling applications using Triana”, Workshop on Grid Applications and Programming Tools, Seattle, 2003.Google Scholar
  16. 16.
    M.J. Flynn, “Some computer organizations and their effectiveness”, IEEE Transactions on Computers, C-21, 948–960, 1972.CrossRefGoogle Scholar
  17. 17.
    J. Novotny, S. Tuecke and V. Welch, “An online credential repository for the Grid: MyProxy”, in Proc. of 10th IEEE International. Symposium on High Performance Distributed Computing, 2001.Google Scholar
  18. 18.
    R. Lovas, G. Dózsa, P. Kacsuk, N. Podhorszki and D. Drótos, “Workflow support for complex Grid applications: Integrated and portal solutions”, in Proc. of Second European AcrossGrids Conference, (AxGrids 2004), Nicosia, Cyprus, LNCS, Vol. 3165, 2004, pp. 129–138.Google Scholar
  19. 19.
  20. 20.
    Southern Eastern European GRid-enabled eInfrastructure Development (SEE-GRID): http://www.see-Grid.org/.
  21. 21.
    UK National Grid Service: http://www.ngs.ac.uk/.
  22. 22.
    D. Thain, T. Tannenbaum and M. Livny, “Distributed computing in practice: The Condor experience”, Concurrency and Computation: Practice and Experience, pp. 323–356, 2005.Google Scholar
  23. 23.
    W. Allcock et al., “Gridftp protocol specification”, GGF GridFTP Working Group Document, September 2002.Google Scholar
  24. 24.
    B. Berliner: CVS II: ParalMizing software development, in Proc. of Winter 1990 USENIX Technical Conference, 1990.Google Scholar
  25. 25.
    W. Appelt, “WWW based collaboration with the BSCW system”, in Proc. of the Conference on Current Trends in Theory and Informatics, pp. 66–78, 1999.Google Scholar
  26. 26.
    R. Butler, D. Engert, I. Foster, C. Kesselman, S. Tuecke, J. Volmer and V. Welch, A national-scale authentication infrastructure. IEEE Computer, Vol. 33, No. 12, 60–66, 2000.Google Scholar
  27. 27.
    D.W. Erwin and D.F. Snelling, “UNICORE: A Grid computing environment”, In Lecture Notes in Computer Science, volume 2150, Springer, pp. 825–834, 2001.Google Scholar
  28. 28.
    G. Allen et al., “Enabling applications on the Grid: A Gridlab overview”, International Journal of High Performance Computing Applications, Issue 17, pp. 449–466, 2003.Google Scholar
  29. 29.
    G. Singh et al., “The Pegasus portal: Web based Grid computing”, in Proc. Of 20th Annual ACM Symposium on Applied Computing, Santa Fe, New Mexico, 2005.Google Scholar
  30. 30.
    J. Cao, S.A. Jarvis, S. Saini, and G.R. Nudd, “GridFlow: Workflow management for Grid computing”, in Proc. of the 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGRID'03), pp. 198–205, 2003.Google Scholar
  31. 31.
    LHC Computing Grid: http://lcg.web.cern.ch/LCG/.
  32. 32.
    M. Ellert et al., “The NorduGrid project: Using Globus toolkit for building Grid infrastructure,” Nuclear Instruments and Methods (Section A) 502, pp. 407–410, 2003.Google Scholar
  33. 33.
    Grid2003 Team, “The Grid2003 production Grid: Principles and practice”, in Proc. of the 13th IEEE Intl. Symposium on High Performance Distributed Computing (HPDC-13), 2004.Google Scholar
  34. 34.
    V. Sunderam and J. Dongarra, “PVM: A framework for parallel distributed computing”, Concurrency: Practice and Experience, Vol. 2, No. 4, pp. 315–339, 1990.CrossRefGoogle Scholar
  35. 35.
    B. Coghlan, J. Walsh and D. O'Callaghan, “The Grid-Ireland deployment architecture”, in Proc. Of European Grid Conference, Amsterdam, The Netherlands, pp. 354–363, 2005.Google Scholar
  36. 36.
    R. Allan et al., “Virtual research environments: Sakai demonstrator”, in Proc. Of UK e-Science All Hands Meeting, 2005.Google Scholar
  37. 37.
    L. Childers, T. Disz, R. Olson, M.E. Papka, R. Stevens and T. Udeshi, “Access Grid: Immersive group-to-group collaborative visualization,” in Proc. of the 4th International Immersive Projection Technology Workshop, 2000.Google Scholar
  38. 38.
    W. Gantzsch, “Sun Grid engine, towards creating a compute power Grid”, in Proc. Of the 1st International Symposium on Cluster Computing and the Grid (CCGrid '01), IEEE Computer Society, pp. 35–6, 2001.Google Scholar
  39. 39.
    S. Zhou, “LSF: Load sharing in large-scale Heterogeneous distributed systems”, in Proc. Of Workshop on Cluster Computing, 1992.Google Scholar
  40. 40.
    E. Seidel, G. Allen, A. Merzky and J. Nabrzyski, “GridLab – A Grid application toolkit and testbed”, Future Generation Computer Systems, Vol. 18, No. 8, pp. 1143–1153, 2002.CrossRefMATHGoogle Scholar
  41. 41.
    I. Foster, C. Kesselman and S. Tuecke, “The anatomy of the Grid: Enabling scalable virtual organizations”, International Journal of Supercomputer Applications, Vol. 15, No. 3, 2001.Google Scholar
  42. 42.
    The HunGrid Virtual Organisation: http://www.lcg.kfki.hu/?hunGrid and hunGridgeneral.
  43. 43.
    J, Novotny, M. Russell and O. Wehrens: Grid-sphere: A portal framework for building collaborations” in Proc. of the 1st International Workshop on Middleware in Grid Computing, Rio de Janeiro, Brazil, 2003.Google Scholar
  44. 44.
    P-GRADE Grid Portal: http://www.pds.sztaki.hu/pgportal.
  45. 45.
    D. Britton et al., “GridPP: Meeting the particle physics computing challenge”, in Proc. Of UK e-Science All Hands Meeting, 2005.Google Scholar
  46. 46.
  47. 47.
    J. Yu and R. Buyya, “A Taxonomy of Workflow Management Systems for Grid Computing”, Journal of Computing, Vol.3, No. 3–4, 2006.Google Scholar

Copyright information

© Springer Science+Business Media, Inc. 2006

Authors and Affiliations

  1. 1.MTA SZTAKI Computer and Automation Research InstituteBudapestHungary

Personalised recommendations