Advertisement

The Journal of Supercomputing

, Volume 64, Issue 3, pp 1133–1152 | Cite as

Enabling workflows in GridSolve: request sequencing and service trading

  • Yinan Li
  • Asim YarKhanEmail author
  • Jack Dongarra
  • Keith Seymour
  • Aurèlie Hurault
Article
  • 98 Downloads

Abstract

GridSolve employs a RPC-based client-agent-server model for solving computational problems. There are two deficiencies associated with GridSolve when a computational problem essentially forms a workflow consisting of a sequence of tasks with data dependencies between them. First, intermediate results are always passed through the client, resulting in unnecessary data transport. Second, since the execution of each individual task is a separate RPC session, it is difficult to enable any potential parallelism among tasks. This paper presents a request sequencing technique that addresses these deficiencies and enables workflow executions. Building on the request sequencing work, one way to generate workflows is by taking higher level service requests and decomposing them into a sequence of simpler service requests using a technique called service trading. A service trading component is added to GridSolve to take advantage of the new dynamic request sequencing. The features described here include automatic DAG construction and data dependency analysis, direct interserver data transfer, parallel task execution capabilities, and a service trading component.

Keywords

Grid computing Workflow applications Service trading 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    The 2MASS Project (2011) http://www.ipac.caltech.edu/2mass
  2. 2.
    Arnold DC, Bachmann D, Dongarra J (2001) Request sequencing: optimizing communication for the grid. In: Lecture notes in computer science, vol 1900. Springer, Berlin, pp 1213–1222 Google Scholar
  3. 3.
    Beck M, Moore T (1998) The Internet2 distributed storage infrastructure project: an architecture for Internet content channels. Comput Netw ISDN Syst 30(22–23):2141–2148 zbMATHCrossRefGoogle Scholar
  4. 4.
    Berriman GB, Deelman E, Good JC, Jacob JC, Katz DS, Kesselman C, Laity AC, Prince TA, Singh G, Su M-H (2004) Montage: a grid-enabled engine for delivering custom science-grade mosaics on demand. In: Quinn PJ, Bridger A (eds) Optimizing scientific return for astronomy through information technologies. Proceedings of the SPIE, vol 5493. SPIE Press, Bellingham, pp 221–232 CrossRefGoogle Scholar
  5. 5.
    Brady T, Guidolin M, Lastovetsky A (2008) Experiments with SmartGridSolve: achieving higher performance by improving the GridRPC model. In: GRID ’08: Proceedings of the 9th IEEE/ACM international conference on grid computing, Washington, DC, USA. IEEE Computer Society, Los Alamitos, pp 49–56 CrossRefGoogle Scholar
  6. 6.
    Cosnard M, Loi M (1995) Automatic task graph generation techniques. In: Hawaii international conference on system sciences, p 113 Google Scholar
  7. 7.
    Couvares P, Tevik Kosar AR, Weber J, Wenger K (2007) Workflow in Condor. In: Gannon D, Deelman E, Shields M, Taylor I (eds) Workflows for e-science. Springer, Berlin Google Scholar
  8. 8.
    The GridSolve Project (2011) http://icl.cs.utk.edu/gridsolve/
  9. 9.
    Hurault A, Pantel M (2006) Mathematical service trading based on equational matching. Electron Notes Theor Comput Sci 151(1):161–177 CrossRefGoogle Scholar
  10. 10.
    Hurault A, YarKhan A (2010) Intelligent service trading for distributed network services in GridSolve. In: High performance computing for computational science—VECPAR 2010: 9th international meeting Google Scholar
  11. 11.
    The Montage Project (2011) http://montage.ipac.caltech.edu/
  12. 12.
    Montage Tutorial: m101 Mosaic (2010) http://montage.ipac.caltech.edu/docs/m101tutorial.html
  13. 13.
    The NetSolve Project (2011) http://icl.cs.utk.edu/netsolve/
  14. 14.
    Oinn T, Greenwood M, Addis M, Nedim Alpdemir M, Ferris J, Glover K, Goble C, Goderis A, Hull D, Marvin D, Li P, Lord P, Pocock MR, Senger M, Stevens R, Wipat A, Wroe C (2006) Taverna: lessons in creating a workflow environment for the life sciences: research articles. Concur Comput 18(10):1067–1100 CrossRefGoogle Scholar
  15. 15.
    Seymour K, Nakada H, Matsuoka S, Dongarra J, Lee C, Casanova H (2002) Overview of GridRPC: a remote procedure call API for grid computing. In: GRID ’02: proceedings of the third international workshop on grid computing, London, UK. Springer, Berlin, pp 274–278 CrossRefGoogle Scholar
  16. 16.
    Song F, Dongarra J, Moore S (2006) Experiments with Strassen’s algorithm: from sequential to parallel. In: Parallel and distributed computing and systems 2006 (PDCS06), Dallas, Texas Google Scholar
  17. 17.
    Tanimura Y, Nakada H, Tanaka Y, Sekiguchi S (2006) Design and implementation of distributed task sequencing on GridRPC. In: CIT ’06: proceedings of the sixth IEEE international conference on computer and information technology (CIT’06), Washington, DC, USA. IEEE Computer Society, Los Alamitos, p 67 CrossRefGoogle Scholar
  18. 18.
    Yu J, Buyya R (2005) A taxonomy of scientific workflow systems for grid computing. SIGMOD Rec 34(3):44–49 CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2011

Authors and Affiliations

  • Yinan Li
    • 1
  • Asim YarKhan
    • 2
    Email author
  • Jack Dongarra
    • 2
    • 3
    • 4
  • Keith Seymour
    • 2
  • Aurèlie Hurault
    • 5
  1. 1.Virginia Polytechnic Institute and State UniversityFalls ChurchUSA
  2. 2.University of TennesseeKnoxvilleUSA
  3. 3.Oak Ridge National LaboratoryOak RidgeUSA
  4. 4.University of ManchesterManchesterUK
  5. 5.University of ToulouseToulouseFrance

Personalised recommendations