Advertisement

Quasi-opportunistic Supercomputing in Grid Environments

  • Valentin Kravtsov
  • David Carmeli
  • Werner Dubitzky
  • Ariel Orda
  • Assaf Schuster
  • Mark Silberstein
  • Benny Yoshpa
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5022)

Abstract

The ultimate vision of grid computing are virtual supercomputers of unprecedented power, through utilization of geographically dispersed distributively owned resources. Despite the overwhelming success of grids there still exist many demanding applications considered the exclusive prerogative of real supercomputers (i.e. tightly coupled parallel applications like complex systems simulations). These rely on a static execution environment with predictable performance, provided through efficient co-allocation of a large number of reliable interconnected resources. In this paper, we describe a novel quasi-opportunistic supercomputer system that enables execution of demanding parallel applications in grids through identification and implementation of the set of key technologies required to realize the vision of grids as (virtual) supercomputers. These technologies include an incentive-based framework basic on ideas from economics; a co-allocation subsystem that is enhanced by communication topology-aware allocation mechanisms; a fault tolerant message passing library that hides the failures of the underlying resources; and data pre-staging orchestration.

Keywords

Grid Resource Grid Environment Resource Provider Virtual Organization Grid Level 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    University of California: SETI@Home. The Search for Extra-Terrestrial Inteligence (SETI) (2007), http://setiathome.ssl.berkeley.edu
  2. 2.
    Gagliardiand, F., Jones, B., Grey, F., Bgin, M.-E., Heikkurinen, M.: Building an infrastructure for scientific grid computing: Status and goals of the EGEE project. Philosophical Transactions A of the Royal Society: Mathematical, Physical and Engineering Sciences 363(833), 1729–1742 (2005)CrossRefGoogle Scholar
  3. 3.
    Kuo, D., Mckeown, M.: Advance reservation and co-Allocation protocol for grid computing. In: 1st Int’l Conference e-Science and Grid Computing, p. 8 (2005)Google Scholar
  4. 4.
    Aridor, Y., Domany, T., Goldshmidt, O., Moreira, J.W., Shmueli, E.: Resource Allocation and Utilization in the Blue GeneL Supercomputer. IBM Journal of Research and Development 49(2-3), 425–436 (2005)CrossRefGoogle Scholar
  5. 5.
    Buyya, R., Abramson, D., Giddy, J., Stockinger, H.: Economic models for resource management and scheduling in grid computing. Concurrency and Computation: Practice and Experience 14, 1507–1542 (2002)zbMATHCrossRefGoogle Scholar
  6. 6.
    Reed, A.D., Lu, C.-d., Mendes, C.L.: Reliability challenges in large systems. Future Generation Computer Systems 22(3), 293–302 (2006)CrossRefGoogle Scholar
  7. 7.
    Karonis, N.T., Toonen, B., Foster, I.: MPICH-G2: A Grid-enabled implementation of the Message Passing Interface. Journal of Parallel and Distributed Computing 63(5), 551–563 (2003)zbMATHCrossRefGoogle Scholar
  8. 8.
    Dail, H., Berman, F., Casanova, H.: A decoupled scheduling approach for grid application development environments. Journal of Parallel and Distributed Computing 63(5), 505–524 (2003)zbMATHCrossRefGoogle Scholar
  9. 9.
    Venugopal, S., Buyya, R., Winton, L.: A grid service broker for scheduling e-science applications on global data grids. Journal of Concurrency and Computation: Practice and Experience 18(6), 685–699 (2005)CrossRefGoogle Scholar
  10. 10.
    Raman, R., Livny, M., Solomon, M.: Policy driven heterogeneous resource co-allocation with gangmatching. In: Proc. of the 12th IEEE Int’l Symposium on High Performance Distributed Computing (HPDC-12), pp. 80–89 (2002)Google Scholar
  11. 11.
    Irwin, I., Chase, J., Grit, L., Yumerefendi, A.: Self-recharging virtual currency. In: Proc. of the 2005 ACM SIGCOMM Workshop on Economics of Peer-to-Peer System, pp. 93–98 (2005)Google Scholar
  12. 12.
    Snir, M., Otto, S., Huss-Lederman, S., Walker, D., Dongarra, J.: MPI: The Complete Reference. MIT Press, Cambridge (1996)Google Scholar
  13. 13.
    Andreozzi, S., Sgaravatto, M., Vistoli, C.: Sharing a conceptual model of gridresources and services. Computing in High Energy and Nuclear Physics, 24–28 (2003)Google Scholar
  14. 14.
    Lacour, S., Perez, C., Priol, T.: A network topology description model for grid application deployment. In: Proc. 5th IEEE/ACM Int’l Workshop on Grid Computing, pp. 61–68 (2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Valentin Kravtsov
    • 1
  • David Carmeli
    • 1
  • Werner Dubitzky
    • 2
  • Ariel Orda
    • 1
  • Assaf Schuster
    • 1
  • Mark Silberstein
    • 1
  • Benny Yoshpa
    • 1
  1. 1.Technion - Israel Institute of TechnologyHaifaIsrael
  2. 2.University of UlsterColeraineNorthern Ireland

Personalised recommendations