Abstract
The paper presents a complete solution for modeling scientific and business workflow applications, static and just-in-time QoS selection of services and workflow execution in a real environment. The workflow application is modeled as an acyclic directed graph where nodes denote tasks and edges denote dependencies between the tasks. The BeesyCluster middleware is used to allow providers to publish services from sequential or parallel applications, from their servers or clusters. Optimization algorithms are proposed to select a capable service for each task so that a global criterion is optimized such as a product of workflow execution time and cost, a linear combination of those or minimization of the time with a cost constraint. The paper presents implementation details of the multithreaded workflow execution engine implemented in JEE. Several tests were performed for three different optimization goals for two business and scientific workflow applications. Finally, the overhead of the solution is presented.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Aggarwal R, Verma K, Miller J, Milnor W (2004) Constraint driven web service composition in meteors. In: Proceedings of IEEE international conference on services computing (SCC’04), pp 23–30
Ben Mokhtar S, Fournier D, Georgantas N, Issarny V (2005) Context-aware service composition in pervasive computing environments. In: Rapid integration of software engineering techniques, second international workshop: RISE, pp 129–144. Heraklion, Crete Greece. http://hal.archives-ouvertes.fr/inria-00415111/en/
Blythe J, Jain S, Deelman E, Gil Y, Vahi K, Mandal A, Kennedy K (2005) Task scheduling strategies for workflow-based applications in grids. In: CCGrid 2005, IEEE international symposium on cluster computing and the grid, vol 2, pp 759–767
Canfora G, Penta MD, Esposito R, Villani M (2004) A lightweight approach for QoS-aware service composition. ICSOC 2004 forum, IBM Tech Report Draft
Canfora G, Penta MD, Esposito R, Villani M (2005) Qos-aware replanning of composite web services. In: Proc of IEEE international conference on web services, vol 1, pp 121–129. Res Centre on Software Technol, Sannio Univ, Italy
Canfora G, Penta MD, Esposito R, Villani ML (2005) An approach for qos-aware service composition based on genetic algorithms. In: GECCO’05: proceedings of the 2005 conference on genetic and evolutionary computation. ACM, New York, pp 1069–1075. doi:10.1145/1068009.1068189
Cardoso J, Sheth A, Miller J (2002) Workflow quality of service. Tech Rep, LSDIS Lab, Department of Computer Science, University of Georgia, Athens, GA 30602, USA
Chin SH, Suh T, Yu HC (2010) Adaptive service scheduling for workflow applications in service-oriented grid. J Supercomput 52(3):253–283. doi:10.1007/s11227-009-0290-9
Czarnul P (2006) Integration of compute-intensive tasks into scientific workflows in BeesyCluster. In: Computational science—ICCS 2006. LNCS, vol 3993. Springer, Berlin, pp 944–947
Czarnul P (2010) Modelling, optimization and execution of workflow applications with data distribution, service selection and budget constraints in BeesyCluster. In: Proceedings of 6th workshop on large scale computations on grids and 1st workshop on scalable computing in distributed systems, international multiconference on computer science and information technology, IEEE catalog number CFP0964E, Wisla, Poland, pp 629–636
Czarnul P, Kurylowicz J (2010) Automatic conversion of legacy applications into services in BeesyCluster. In: Proceedings of 2nd international IEEE conference on information technology ICIT’2010, Gdansk, Poland
Czarnul P, Bajor M, Fraczak M, Banaszczyk A, Fiszer M, Ramczykowska K (2005) Remote task submission and publishing in BeesyCluster: Security and efficiency of web service interface. In: Proceedings of PPAM, Poznan, Poland. LNCS, vol 3911. Springer, Berlin
Deelman E, Blythe J, Gil Y, Kesselman C, Mehta G, Patil S, Su MH, Vahi K, Livny M (2004) Pegasus: mapping scientific workflows onto the grid. In: Across grids conference, Nicosia, Cyprus. http://pegasus.isi.edu
Hackmann G, Haitjema M, Gill C, Catalin Roman G, (2006) Sliver: A bpel workflow process execution engine for mobile devices. In: Proceedings of 4th international conference on service oriented computing (ICSOC). Springer, Berlin, pp 503–508
Han J, Kim E, Choi J (2004) Workflow language based on web services for autonomic services in ubiquitous computing. In: Proceedings of international conference on artificial reality and telexistence, ICAT, Coex, Korea
Laboratory of Parallel and Distributed Systems, MTA SZTAKI, Hungary: Parallel grid runtime and application development environment, User’s manual, ver. 8.4.2. http://www.lpds.sztaki.hu/~smith/pgrade-manual/manual.html
Li J, Bu Y, Chen S, Tao X, Lu J (2006) FollowMe: on research of pluggable infrastructure for context-awareness. In: 20th International conference on advanced information networking and applications, AINA 2006, vol 1. doi:10.1109/AINA.2006.182
Ludascher B, Altintas I, Berkley C, Higgins D, Jaeger-Frank E, Jones M, Lee E, Tao J, Zhao Y (2005) Scientific workflow management and the Kepler system. Concurrency and computation: practice & experience, special issue on scientific workflows. http://www.sdsc.edu/%7Eludaesch/Paper/kepler-swf.pdf
Majithia S, Shields MS, Taylor IJ, Wang I (2004) Triana: a graphical web service composition and execution toolkit. In: IEEE international conference on web services (ICWS’04). IEEE Computer Society, Los Alamitos, pp 512–524. http://www.trianacode.org/
Patel C, Supekar K, Lee Y (2003) A QoS oriented framework for adaptive management of web service based workflows. In: Proceedings of the 14th international database and expert systems applications conference (DEXA 2003), Prague, Czech Republic, 2003. LNCS. Springer, Berlin, pp 826–835
Rao J, Su X (2005) A survey of automated web service composition methods. In: LNCS, vol 3387/2005. Springer, Berlin, pp 43–54. http://www.springerlink.com/content/4m6w37g0jffk9bv4
Sakellariou R, Zhao H, Tsiakkouri E, Dikaiakos M (2007) Scheduling workflows with budget constraints. In: Gorlatch S, Danelutto M (eds) Integrated research in GRID computing, CoreGRID. Springer, Berlin, pp 189–202. http://www.cs.man.ac.uk/rizos/papers/coregrid2005a.pdf
Şensoy M, Yolum P (2007) On choosing an efficient service selection mechanism in dynamic environments. In: Proceedings of the 9th international workshop on agent-mediated electronic commerce (AMEC IX), vol 13, pp 105–118
Srinivasan N, Paolucci M, Sycara K (2004) Adding owl-s to uddi, implementation and throughput. In: First international workshop on semantic web services and web process composition (SWSWPC 2004), San Diego, USA
System bexee: Bpel execution engine (2004) http://bexee.sourceforge.net/index.html, Berne University of Applied Sciences
The ActiveBPEL Engine (2009) http://www.activevos.com/community-open-source.php, Active endpoints
Wilkinson B, Allen M (1999) Parallel programming: techniques and applications using networked workstations and parallel computers. Prentice Hall, New York
Yingchun, Li X, Sun C (2007) Cost-effective heuristics for workflow scheduling in grid computing economy. In: GCC’07: proceedings of the sixth international conference on grid and cooperative computing. IEEE Computer Society, Los Alamitos, pp 322–329. doi:10.1109/GCC.2007.57
Yu J, Buyya R (2005) A taxonomy of workflow management systems for grid computing. J Grid Comput 3(3–4):171–200. doi:10.1007/s10723-005-9010-8
Yu J, Buyya R (2006) A budget constrained scheduling of workflow applications on utility grids using genetic algorithms. In: Workshop on workflows in support of large-scale science, proceedings of the 15th IEEE international symposium on high performance distributed computing (HPDC), Paris, France
Yu J, Buyya R (2006) Scheduling scientific workflow applications with deadline and budget constraints using genetic algorithms. Sci Program J 14(3–4):217–230
Yu J, Buyya R, Ramamohanarao K (2008) Workflow scheduling algorithms for grid computing. http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.144.7107
Yu J, Buyya R, Tham CK (2005) Cost-based scheduling of workflow applications on utility grids. In: Proceedings of the 1st IEEE international conference on e-science and grid computing (e-Science), Melbourne, Australia. IEEE Comput Soc, Los Alamitos
Zeng L, Benatallah B, Dumas M, Kalagnanam J, Sheng Q (2003) Quality driven web services composition. In: Proceedings of WWW, Budapest, Hungary
Zeng L, Benatallah B, Ngu AH, Dumas M, Kalagnanam J, Chang H (2004) Qos-aware middleware for web services composition. IEEE Trans Softw Eng 30(5):311–327. doi:10.1109/TSE.2004.11
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This is an open access article distributed under the terms of the Creative Commons Attribution Noncommercial License (https://creativecommons.org/licenses/by-nc/2.0), which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.
About this article
Cite this article
Czarnul, P. Modeling, run-time optimization and execution of distributed workflow applications in the JEE-based BeesyCluster environment. J Supercomput 63, 46–71 (2013). https://doi.org/10.1007/s11227-010-0499-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11227-010-0499-7