A P2P Approach to Many Tasks Computing for Scientific Workflows

  • Eduardo Ogasawara
  • Jonas Dias
  • Daniel Oliveira
  • Carla Rodrigues
  • Carlos Pivotto
  • Rafael Antas
  • Vanessa Braganholo
  • Patrick Valduriez
  • Marta Mattoso
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6449)

Abstract

Scientific Workflow Management Systems (SWfMS) are being used intensively to support large scale in silico experiments. In order to reduce execution time, current SWfMS have exploited workflow parallelization under the arising Many Tasks Computing (MTC) paradigm in homogeneous computing environments, such as multiprocessors, clusters and grids with centralized control. Although successful, this solution no longer applies to heterogeneous computing environments, such as hybrid clouds, which may combine users’ own computing resources with multiple edge clouds. A promising approach to address this challenge is Peer-to-Peer (P2P) which relies on decentralized control to deal with scalability and dynamic behavior of resources. In this paper, we propose a new P2P approach to apply MTC in scientific workflows. Through the results of simulation experiments, we show that our approach is promising.

Keywords

Scientific experiments scientific workflows Scientific Workflow Management Systems (SWfMS) many tasks computing (MTC) peer-to-peer (P2P) 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Deelman, E., Gannon, D., Shields, M., Taylor, I.: Workflows and e-Science: An overview of workflow system features and capabilities. Future Generation Computer Systems 25, 528–540 (2009)CrossRefGoogle Scholar
  2. 2.
    Jarrard, R.D.: Scientific Methods (2001), http://emotionalcompetency.com/sci/booktoc.html
  3. 3.
    Raicu, I., Foster, I., Zhao, Y.: Many-task computing for grids and supercomputers. In: Workshop on Many-Task Computing on Grids and Supercomputers, pp. 1–11. Austin, Texas (2008)CrossRefGoogle Scholar
  4. 4.
    Anderson, D.: BOINC: a system for public-resource computing and storage. In: Proceedings. Fifth IEEE/ACM International Workshop on Grid Computing, Pittsburgh, USA, pp. 4–10 (2004)Google Scholar
  5. 5.
    WCG, World Community Grid (2009), http://www.worldcommunitygrid.org
  6. 6.
    Grid4All Consortium, Towards Hybrid Clouds - A Grid4All perspective on cloud computing, White paper (2009), www.grid4all.eu
  7. 7.
    Freire, J., Koop, D., Santos, E., Silva, C.T.: Provenance for Computational Tasks: A Survey. Computing in Science and Engineering 10, 11–21 (2008)CrossRefGoogle Scholar
  8. 8.
    Pacitti, E., Valduriez, P., Mattoso, M.: Grid Data Management: Open Problems and New Issues. Journal of Grid Computing 5, 273–281 (2007)CrossRefGoogle Scholar
  9. 9.
    Lua, E.K., Crowcroft, J., Pias, M., Sharma, R., Lim, S.: A Survey and Comparison of Peer-to-Peer Overlay Network Schemes. IEEE Communications Surveys and Tutorials 7, 72–93 (2005)CrossRefGoogle Scholar
  10. 10.
    Ganesan, P., Gummadi, K., Garcia-Molina, H.: Canon in G Major: Designing DHTs with Hierarchical Structure. In: Proceedings of the 24th International Conference on Distributed Computing Systems (ICDCS 2004), Tokyo, Japan, pp. 263–272 (2004)Google Scholar
  11. 11.
    Garcés-Erice, L., Biersack, E.W., Felber, P.A., Ross, K.W., Urvoy-Keller, G.: Hierarchical Peer-to-peer Systems. In: Proceedings of ACM/IFIP International Conference on Parallel and Distributed Computing, Klagenfurt, Austria, pp. 643–657 (2003)Google Scholar
  12. 12.
    Mastroianni, C., Talia, D., Verta, O.: A super-peer model for building resource discovery services in grids: Design and simulation analysis. In: Sloot, P.M.A., Hoekstra, A.G., Priol, T., Reinefeld, A., Bubak, M. (eds.) EGC 2005. LNCS, vol. 3470, pp. 132–143. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  13. 13.
    Martinez-Yelmo, I., Cuevas, R., Guerrero, C., Mauthe, A.: Routing Performance in a Hierarchical DHT-based Overlay Network. In: Euromicro Conference on Parallel, Distributed, and Network-Based Processing, pp. 508–515. IEEE Computer Society Press, Los Alamitos (2008)CrossRefGoogle Scholar
  14. 14.
    Ogasawara, E., Oliveira, D., Chirigati, F., Barbosa, C.E., Elias, R., Braganholo, V., Coutinho, A., Mattoso, M.: Exploring many task computing in scientific workflows. In: MTAGS 2009, pp. 1–10. ACM Press, Portland (2009)Google Scholar
  15. 15.
    Dick, M.E., Pacitti, E., Kemme, B.: Flower-CDN: a hybrid P2P overlay for efficient query processing in CDN. In: Proceedings of the 12th International Conference on Extending Database Technology: Advances in Database Technology, pp. 427–438. ACM, Saint Petersburg (2009)CrossRefGoogle Scholar
  16. 16.
    Akbarinia, R., Pacitti, E., Valduriez, P.: Data currency in replicated DHTs. In: Proceedings of the 2007 ACM SIGMOD International Conference on Management of Data, pp. 211–222. ACM, Beijing (2007)CrossRefGoogle Scholar
  17. 17.
    Karakaya, M., Körpeoğlu, İ., Ulusoy, Ö.: A connection management protocol for promoting cooperation in Peer-to-Peer networks. Comput. Commun. 31, 240–256 (2008)CrossRefMATHGoogle Scholar
  18. 18.
    Almeida, E.C.D., Sunyé, G., Traon, Y.L., Valduriez, P.: A Framework for Testing Peer-to-Peer Systems. In: Proceedings of the 2008 19th International Symposium on Software Reliability Engineering, Los Alamitos, CA, USA, pp. 167–176 (2008)Google Scholar
  19. 19.
    Jelasity, M., Montresor, A., Jesi, G.P., Voulgaris, S.: The PeerSim simulator (2010), http://peersim.sourceforge.net
  20. 20.
    Freedman, D., Pisani, R., Purves, R.: Statistics, 4th edn. W. W. Norton, New York (2007)MATHGoogle Scholar
  21. 21.
    Law, A.M.: Statistical analysis of simulation output data: the practical state of the art. In: Proceedings of the 39th Conference on Winter Simulation, pp. 77–83. IEEE Press, Washington D.C (2007)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Eduardo Ogasawara
    • 1
    • 2
  • Jonas Dias
    • 1
  • Daniel Oliveira
    • 1
  • Carla Rodrigues
    • 1
  • Carlos Pivotto
    • 1
  • Rafael Antas
    • 1
  • Vanessa Braganholo
    • 3
  • Patrick Valduriez
    • 4
  • Marta Mattoso
    • 1
  1. 1.Cidade Universitária, Centro de TecnologiaCOPPE/Federal University of Rio de JaneiroRio de JaneiroBrazil
  2. 2.Federal Center of Technological EducationRio de JaneiroBrazil
  3. 3.Fluminense Federal UniversityBrazil
  4. 4.LIRMMINRIAMontpellierFrance

Personalised recommendations