Workflow scheduling and execution belong to the most difficult problems in the Grid computing research area. Instead of using a full-ahead planning to schedule workflows, which requires precise predictions of task execution time, file transfer time and Grid site status during the workflow execution, we propose a lightweight workflow engine for the ASKALON Grid environment, which uses just in-time scheduling based on automatically generated performance predictions and task prioritization. An extensive survey of the related work is discussed. The architecture of the proposed workflow engine and some preliminary results are presented.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
The Austrian Grid Project. http://www.austriangrid.at.
A. H. Alhusaini, V. K. Prasanna, and C. S. Raghavendra. A Unified Resource Scheduling Framework for Heterogeneous Computing Environments. In Heterogeneous Computing Workshop, pages 156-165, 1999.
E. Deelman, J. Blythe, Y. Gil, C. Kesselman, G. Mehta, S. Patil, M.-H. Su, K. Vahi, and M. Livny. Pegasus: Mapping Scientific Workflows onto the Grid. In European Across Grids Conference, pages 11-20, 2004.
T. Fahringer, R. Prodan, R. Duan, F. Nerieri, S. Podlipnig, J. Qin, M. Siddiqui, H.-L. Truong, A. Villazon, and M. Wieczorek. ASKALON: A Grid Application Development and Computing Environment. In 6th International Workshop on Grid Computing (Grid 2005), Seattle, USA, November 2005. IEEE Computer Society Press.
T. Fahringer, J. Qin, and S. Hainzer. Specification of Grid Workflow Applications with AGWL: An Abstract Grid Workflow Language. In Proceedings of IEEE International Symposium on Cluster Computing and the Grid 2005 (CCGrid 2005), Cardiff, UK, May 9-12, 2005. IEEE Computer Society Press.
M. R. Garey and D. S. Johnson. Computers and Intractability: A Guide to the Theory of NP-Completeness. W. H. Freeman And Company, New York, 1979.
M. Iverson and F. Ozguner. Dynamic, Competitive Scheduling of Multiple DAGs in a Distributed Heterogeneous Environment. In HCW ’98: Proceedings of the Seventh Heterogeneous Computing Workshop, page 70, Washington, DC, USA, 1998. IEEE Computer Society.
T. Ma and R. Buyya. Critical-Path and Priority based Algorithms for Scheduling Workflows with Parameter Sweep Tasks on Global Grids. In Proceedings of the 17th International Symposium on Computer Architecture and High Performance Computing (SBACPAD 2005), Rio de Janeiro, Brazil, Oct. 24-27 2005. IEEE Computer Society Press.
A. Radulescu and A. J. C. van Gemund. On the complexity of list scheduling algorithms for distributed-memory systems. In Proceeding of the ICS 1999, pages 68-75, 1999.
K. Ranganathan and I. Foster. Decoupling Computation and Data Scheduling in Distributed Data-Intensive Applications.
F. Sch üller and J. Qin. Towards a Workflow Model for Meteorological Simulations on the AustrianGrid. In 1st Austrian Grid Symposium, Schloss Hagenberg, Austria, December 01-02, 2005. OCG Verlag.
N. T. Spring and R. Wolski. Application Level Scheduling of Gene Sequence Comparison on Metacomputers. In International Conference on Supercomputing, pages 141-148, 1998.
D. Theiner and M. Wieczorek. Reduction of Calibration Time of Distributed Hydrological Models by Use of Grid Computing and Nonlinear Optimisation Algorithms. In 7th International Conference on Hydroinformatics (HIC 2006), Nice, France, Sep. 2006.
M. Wieczorek, R. Prodan, and T. Fahringer. Scheduling of Scientific Work-flows in the ASKALON Grid Environment. ACM SIGMOD Record, 35(3), 2005. http://dps.uibk.ac.at/marek/publications/acm-sigmod-2005.pdf.
M. Wieczorek, M. Siddiqui, A. Villazon, R. Prodan, and T. Fahringer. Applying Advance Reservation to Increase Predictability of Workflow Execution on the Grid. e-science, 0:82, 2006.
R. Wolski, N. T. Spring, and J. Hayes. The network weather service: a distributed resource performance forecasting service for metacomputing. Future Generation Computer Systems, 15(5-6):757-768, 1999.
Z. Yu and W. Shi. An Adaptive Rescheduling Strategy for Grid Workflow Applications. In Proceedings of the 21st IPDPS 2007, Mar 26-30 2007. IEEE Computer Society Press.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2007 Springer Science+Business Media, LLC
About this paper
Cite this paper
Qin, J., Wieczorek, M., Plankensteiner, K., Fahringer, T. (2007). Towards a Light-weight Workflow Engine in the Asklon Grid Environment. In: Priol, T., Vanneschi, M. (eds) Towards Next Generation Grids. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-72498-0_22
Download citation
DOI: https://doi.org/10.1007/978-0-387-72498-0_22
Publisher Name: Springer, Boston, MA
Print ISBN: 978-0-387-72497-3
Online ISBN: 978-0-387-72498-0
eBook Packages: Computer ScienceComputer Science (R0)