Quasi-opportunistic Supercomputing in Grid Environments
The ultimate vision of grid computing are virtual supercomputers of unprecedented power, through utilization of geographically dispersed distributively owned resources. Despite the overwhelming success of grids there still exist many demanding applications considered the exclusive prerogative of real supercomputers (i.e. tightly coupled parallel applications like complex systems simulations). These rely on a static execution environment with predictable performance, provided through efficient co-allocation of a large number of reliable interconnected resources. In this paper, we describe a novel quasi-opportunistic supercomputer system that enables execution of demanding parallel applications in grids through identification and implementation of the set of key technologies required to realize the vision of grids as (virtual) supercomputers. These technologies include an incentive-based framework basic on ideas from economics; a co-allocation subsystem that is enhanced by communication topology-aware allocation mechanisms; a fault tolerant message passing library that hides the failures of the underlying resources; and data pre-staging orchestration.
KeywordsGrid Resource Grid Environment Resource Provider Virtual Organization Grid Level
Unable to display preview. Download preview PDF.
- 1.University of California: SETI@Home. The Search for Extra-Terrestrial Inteligence (SETI) (2007), http://setiathome.ssl.berkeley.edu
- 2.Gagliardiand, F., Jones, B., Grey, F., Bgin, M.-E., Heikkurinen, M.: Building an infrastructure for scientific grid computing: Status and goals of the EGEE project. Philosophical Transactions A of the Royal Society: Mathematical, Physical and Engineering Sciences 363(833), 1729–1742 (2005)CrossRefGoogle Scholar
- 3.Kuo, D., Mckeown, M.: Advance reservation and co-Allocation protocol for grid computing. In: 1st Int’l Conference e-Science and Grid Computing, p. 8 (2005)Google Scholar
- 10.Raman, R., Livny, M., Solomon, M.: Policy driven heterogeneous resource co-allocation with gangmatching. In: Proc. of the 12th IEEE Int’l Symposium on High Performance Distributed Computing (HPDC-12), pp. 80–89 (2002)Google Scholar
- 11.Irwin, I., Chase, J., Grit, L., Yumerefendi, A.: Self-recharging virtual currency. In: Proc. of the 2005 ACM SIGCOMM Workshop on Economics of Peer-to-Peer System, pp. 93–98 (2005)Google Scholar
- 12.Snir, M., Otto, S., Huss-Lederman, S., Walker, D., Dongarra, J.: MPI: The Complete Reference. MIT Press, Cambridge (1996)Google Scholar
- 13.Andreozzi, S., Sgaravatto, M., Vistoli, C.: Sharing a conceptual model of gridresources and services. Computing in High Energy and Nuclear Physics, 24–28 (2003)Google Scholar
- 14.Lacour, S., Perez, C., Priol, T.: A network topology description model for grid application deployment. In: Proc. 5th IEEE/ACM Int’l Workshop on Grid Computing, pp. 61–68 (2004)Google Scholar