Efficient Workload Distribution Bridging HTC and HPC in Scientific Computing

  • Carlo Manuali
  • Alessandro Costantini
  • Antonio Laganà
  • Marco Cecchi
  • Antonia Ghiselli
  • Michele Carpené
  • Elda Rossi
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7333)

Abstract

GriF is a Workflow Management System designed to support users of the Molecular and Materials Sciences and Technologies COMPCHEM Virtual Organization. In particular, GriF manages the results of the parameter sweeping studies submitted to the Grid. This service has been recently extended to implement seamless access to both High Performance and High Throughput Computing architectures. To this end, the Workflow execution is splitted into single blocks whose execution is most suited to one or the other platform. This has been obtained by implementing a communication channel allowing interoperability between the gLite middleware operating on the Italian Grid Initiative segment accessible to COMPCHEM and the software stack operating on the CINECA machines. As a prototype application a high level ab initio calculation of the potential energy surface of few atom system has been implemented.

Keywords

Message Passing Interface High Performance Computing Service Orient Architecture Simple Object Access Protocol Workload Distribution 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    PRACE Research Infrastructure, http://www.prace-project.eu (cited February 13, 2012)
  2. 2.
    TeraGrid Archives, https://www.xsede.org/tg-archives (cited February 13, 2012)
  3. 3.
    The Message Passing Interface (MPI) standard, http://www.mcs.anl.gov/research/projects/mpi (cited February 13, 2012)
  4. 4.
    European Grid Infrastructure, http://www.egi.eu (cited February 13, 2012)
  5. 5.
    ICT research in FP7, http://cordis.europa.eu/fp7/ict/e-infrastructure/calls_en.html (cited February 13, 2012)
  6. 6.
    Manuali, C., Rampino, S., Laganà, A.: GriF: A Grid Framework for a Web Service Approach to Reactive Scattering. Comp. Phys. Comm. 181, 1179–1185 (2010)MATHCrossRefGoogle Scholar
  7. 7.
    Manuali, C., Laganà, A.: GriF: A New Collaborative Framework for a Web Service Approach to Grid Empowered Calculations. Future Generation Computer Systems 27, 315–318 (2011)CrossRefGoogle Scholar
  8. 8.
    CompChem Virtual Organization, http://www3.compchem.unipg.it (cited February 13, 2012)
  9. 9.
    Italian Grid Infrastructure, http://grid.infn.it (cited February 13, 2012)
  10. 10.
    CINECA, http://www.cineca.it (cited February 13, 2012)
  11. 11.
    Costantini, A., Gervasi, O., Manuali, C., Faginas Lago, N., Rampino, S., Laganà, A.: COMPCHEM: progress towards GEMS a Grid Empowered Molecular Simulator and beyond. Journal of Grid Computing 8(4), 571–586 (2010)CrossRefGoogle Scholar
  12. 12.
    The General Atomic and Molecular Electronic Structure System (GAMESS) ab initio quantum chemistry package, http://www.msg.ameslab.gov/gamess (cited February 13, 2012)
  13. 13.
    European Middleware Initiative, http://www.eu-emi.eu (cited February 13, 2012)
  14. 14.
    EMI Execution Service page, https://twiki.cern.ch/twiki/bin/view/EMI/EmiExecutionService (cited February 13, 2012)
  15. 15.
    Costantini, A., Faginas Lago, N., Laganà, A., Huarte Larranaga, F.: A Grid Implementation of MCTDH Rate Coefficients. In: Gervasi, O., Taniar, D., Murgante, B., Laganà, A., Mun, Y., Gavrilova, M.L. (eds.) ICCSA 2009. LNCS, vol. 5593, pp. 104–114. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  16. 16.
    Manuali, C.: A Grid Knowledge Management System aimed at Virtual Research Communities Sustainability based on Quality Evaluation. Ph.D. Thesis, Department of Mathematics and Informatics, University of Perugia (IT), February 14 (2011), http://www.unipg.it/carlo/PhD_Thesis.pdf (cited February 13, 2012)
  17. 17.
    SOA and Web Services, http://www.oracle.com/technetwork/articles/javase/index-142519.html (cited February 13, 2012)
  18. 18.
    Web Service Description Language (WSDL) 1.1, http://www.w3.org/TR/wsdl (cited February 13, 2012)
  19. 19.
    Simple Object Access Protocol (SOAP) 1.2, http://www.w3.org/TR/soap (cited February 13, 2012)
  20. 20.
    Universal Description, Discovery and Integration (UDDI) 3.0.2, http://www.oasis-open.org/standards#uddiv3.0.2 (cited February 13, 2012)
  21. 21.
    Apache Tomcat, http://tomcat.apache.org (cited February 13, 2012)
  22. 22.
    Web Services Activity, http://www.w3.org/2002/ws (cited February 13, 2012)
  23. 23.
    Foster, I., Kesselman, C., Nick, J.M., Tuecke, S.: The Physiology of the Grid: An Open Grid Services Architecture for Distributed Systems Integration, Open Grid Service Infrastructure WG, Global Grid Forum (GGF), http://www.globus.org/alliance/publications/papers/ogsa.pdf (cited February 13, 2012)
  24. 24.
    The Open Grid Forum (OGF), http://www.ogf.org (cited February 13, 2012)
  25. 25.
    What is a Grid Service?, http://gdp.globus.org/gt3-tutorial/multiplehtml/ch01s03.html (cited February 13, 2012)
  26. 26.
    OASIS Web Service Resource Framework (WSRF) TC, http://www.oasis-open.org/committees/tc_home.php?wg_abbrev=wsrf (cited February 13, 2012)
  27. 27.
    OASIS: Advancing Open Standards for the Global Information Society, http://www.oasis-open.org (cited February 13, 2012)
  28. 28.
    Manuali, C., Garcia, E., Laganà, A.: On the Enhancing of GriF a Workflow-oriented Grid Framework combining High-level Services. Journal of Grid Computing (submitted)Google Scholar
  29. 29.
    Job Collection - EGEE SEE ROC Wiki, http://wiki.egee-see.org/index.php/Job_Collection (cited February 13, 2012)
  30. 30.
    Gervasi, O., Dittamo, C., Laganá, A.: A Grid Molecular Simulator for E-Science. In: Sloot, P.M.A., Hoekstra, A.G., Priol, T., Reinefeld, A., Bubak, M. (eds.) EGC 2005. LNCS, vol. 3470, pp. 16–22. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  31. 31.
    Laganà, A., Gervasi, O.: A Priori Molecular Virtual Reality on EGEE Grid. International Journal of Quantum Chemistry 110, 446–453 (2009)CrossRefGoogle Scholar
  32. 32.
    Marco, C., Fabio, C., Alvise, D., Antonia, G., Francesco, G., Alessandro, M., Moreno, M., Salvatore, M., Fabrizio, P., Luca, P., Francesco, P.: The gLite Workload Management System. In: Abdennadher, N., Petcu, D. (eds.) GPC 2009. LNCS, vol. 5529, pp. 256–268. Springer, Heidelberg (2009)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Carlo Manuali
    • 1
  • Alessandro Costantini
    • 2
    • 3
  • Antonio Laganà
    • 1
  • Marco Cecchi
    • 3
  • Antonia Ghiselli
    • 3
  • Michele Carpené
    • 4
  • Elda Rossi
    • 4
  1. 1.Department of ChemistryUniversity of PerugiaPerugiaItaly
  2. 2.Department of Mathematics and InformaticsUniversity of PerugiaPerugiaItaly
  3. 3.INFN-CNAFBolognaItaly
  4. 4.CINECACasalecchio di RenoItaly

Personalised recommendations