Integration of Compute-Intensive Tasks into Scientific Workflows in BeesyCluster

  • Paweł Czarnul
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3993)


The paper presents design, implementation details and simulations of scientific workflows involving compute-intensive tasks on clusters and PCs. The author has incorporated support for scientific workflows into previously developed J2EE-based BeesyCluster, deployed at Academic Computer Center Gdansk Poland on large HPC resources including a large 288-processor Itanium2 cluster. BeesyCluster allows users to manage various accounts on clusters/PCs via WWW/Web Services, run shell interactively, compile, queue, run tasks, publish services for other users, work in teams. A frequent scenario in HPC computing is analyzed, in which a workflow is combined from tasks offered by different users. Steps of the workflow include data preparation and following simulations run in parallel on clusters, with and without queuing systems.


Interaction Diagram Global Grid Forum Academic Computer Frequent Scenario Open Grid Service Infrastructure 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Ludäscher, B., Altintas, I., Berkley, C., Higgins, D., Jaeger-Frank, E., Jones, M., Lee, E., Tao, J., Zhao, Y.: Scientific Workflow Management and the Kepler System. In: Concurrency and Computation: Practice & Experience, Special Issue on Scientific Workflows (2005)Google Scholar
  2. 2.
    Deelman, E., Blythe, J., Gil, Y., Kesselman, C., Mehta, G., Patil, S., Su, M.H., Vahi, K., Livny, M.: Pegasus: Mapping Scientific Workflows onto the Grid. In: Across Grids Conference, Nicosia, Cyprus (2004),
  3. 3.
    Majithia, S., Shields, M.S., Taylor, I.J., Wang, I.: Triana: A Graphical Web Service Composition and Execution Toolkit. In: IEEE International Conference on Web Services (ICWS 2004), pp. 512–524. IEEE Computer Society, Los Alamitos (2004), Google Scholar
  4. 4.
    Laboratory of Parallel and Distributed Systems, MTA SZTAKI, Hungary (Parallel Grid Runtime and Application Development Environment, User’s Manual, ver. 8.4.2)Google Scholar
  5. 5.
    Foster, I., Kesselman, C., Nick, J., Tuecke, S.: The Physiology of the Grid: An Open Grid Services Architecture for Distributed Systems Integration. In: Open Grid Service Infrastructure WG (2002) Global Grid ForumGoogle Scholar
  6. 6.
    Czarnul, P., Bajor, M., Fraczak, M., Banaszczyk, A., Fiszer, M., Ramczykowska, K.: Remote task submission and publishing in beesycluster: Security and efficiency of web service interface. In: Wyrzykowski, R., Dongarra, J., Meyer, N., Waśniewski, J. (eds.) PPAM 2005. LNCS, vol. 3911. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  7. 7.
    Czarnul, P., Fraczak, M.: New user-guided and ckpt-based checkpointing libraries for parallel mpi applications. In: Di Martino, B., Kranzlmüller, D., Dongarra, J. (eds.) EuroPVM/MPI 2005. LNCS, vol. 3666, pp. 351–358. Springer, Heidelberg (2005)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Paweł Czarnul
    • 1
  1. 1.Faculty of Electronics, Telecommunications and InformaticsGdansk University of TechnologyPoland

Personalised recommendations