Abstract
Jobs submitted to a grid may require more resources than those available at any time in any single subsystem making up a grid. Therefore, grid schedulers may employ co-allocation, that is, the simultaneous allocation of possibly multiple resources in multiple subsystems to a single job. Over the last few years we have done extensive simulations of processor co-allocation, and we have built a grid scheduler called KOALA that employs data and processor co-allocation. In this paper we summarize our experiences with co-allocation, and we review some the main issues that still remain before co-allocation can be considered an accepted solution in future-generation grids.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
The Advanced School for Computing and Imaging. www.asci.tudelft.nl.
H.E. Bal and D.H.J. Epema et al. The Distributed ASCI Supercomputer Project. ACM Operating Systems Review, 34(4):76–96, 2000.
S. Banen, A.I.D. Bucur, and D.H.J. Epema. A Measurement-Based Simulation Study of Processor Co-Allocation in Multicluster Systems. In D.G. Feitelson, L. Rudolph, and U. Schwiegelshohn, editors, Proc. of the 9th Workshop on Job Scheduling Strategies for Parallel Processing, volume 2862 of LNCS, pages 105–128. Springer-Verlag, 2003.
R. Baxter and N. Chue Hong. Bringing the Grid to the Biomedical Workbench. In Proc. of the 11th IEEE Int’l Symp. on High Performance Distributed Computing (HPDC-11), 2002.
R.G. Belleman and R. Shulakov. High Performance Distributed Simulation for Interactive Simulated Vascular Reconstruction. In P.M.A. Sloot, C.J. Kenneth Tan, Jack J. Dongarra, and Alfons G. Hoekstra, editors, International Conference on Computational Science (ICCS), Amsterdam, the Netherlands, volume 2331 of LNCS, pages 265–274, Berlin, April 2002. Springer-Verlag.
A.I.D. Bucur and D.H.J. Epema. Priorities among Multiple Queues for Processor Co-Allocation in Multicluster Systems. In Proc. of the 36th Annual Simulation Symp., pages 15–27. IEEE Computer Society Press, 2003.
A.I.D. Bucur and D.H.J. Epema. The Performance of Processor Co-Allocation in Multicluster Systems. In Proc. of the 3rd IEEE/ACM Int’l Symp. on Cluster Computing and the GRID (CCGrid2003), pages 302–309. IEEE Computer Society Press, 2003.
A.I.D. Bucur and D.H.J. Epema. Trace-Based Simulations of Processor Co-Allocation Policies in Multiclusters. In Proc. of the 12th IEEE Int’l Symp. on High Performance Distributed Computing (HPDC-12), pages 70–79. IEEE Computer Society Press, 2003.
A.I.D. Bucur, R. Kootstra, and R.G. Belleman. A Grid Architecture for Medical Applications. In To appear in Proc. of the 3rd HealthGrid Conference, pages 241–252, 2005.
K. Czajkowski, I. Foster, and C. Kesselman. Resource Co-Allocation in Computational Grids. In Proc. of the 8th IEEE Int’l Symp. on High Performance Distributed Computing (HPDC-8), pages 219–228, 1999.
The Distributed ASCI Supercomputer (DAS). www.cs.vu.nl/das2.
C. Ernemann, V. Hamscher, U. Schwiegelshohn, R. Yahyapour, and A. Streit. On Advantages of Grid Computing for Parallel Job Scheduling. In Proc. of the 2nd IEEE/ACM Int’ I Symp. on Cluster Computing and the GRID (CCGrid2002), pages 39–46, 2002.
F. van Hees, A.J. van der Steen, and P.J. van Leeuwen. A Parallel Data Assimilation Model for Oceanographic Observations. Concurrency and Computation: Practice and Experience, 15:1191–1204, 2003.
The Globus Toolkit, www.globus.org.
GridLab. www.gridlab.org.
H.H. Mohamed and D.H.J. Epema. The Design and Implementation of the KOALA Co-Allocating Scheduler. In European Grid Conference, 2005.
H.H. Mohamed and D.H.J. Epema. Experiences with the KOALA Co-Allocating Scheduler in Multiclusters. In 5th IEEE/ACM Int’l Symp. on Cluster Computing and the GRID (CCGrid2005), 2005.
Iperf Version 1.7.0. http://dast.nlanr.net/Projects/Iperf/.
N. Kang, J. Zhang, and E.S. Carlson. Parallel Computation in Simulating Diffusion and Deformation in Human Brain. Technical Report 418-04, Dept. of Comp. Science, Univ. of Kentucky, 2004.
Joy P. Ku, Mary T. Draney, Frank R. Arko, W. Anthony Lee, Frandics P. Chan, Norbert J. Pelc, Christopher K. Zarins, and Charles A. Taylor. In Vivo Validation of Numerical Prediction of Blood Flow in Arterial Bypass Grafts. Annals of Biomedical Engineering, 30:743–752, 2002.
H.H. Mohamed and D.H.J. Epema. An Evaluation of the Close-to-Files Processor and Data Co-Allocation Policy in Multiclusters. In CLUSTER 2004, IEEE Int’l Conf. on Cluster Computing, pages 287–298, 2004.
S. Mori and P.C. van Zijl. Fiber Tracking: Principles and Strategies—a Technical Review. NMR Biomed, 15(7–8):468–480, 2002.
Novartis Institute for BioMedical Research. www.nibr.novartis.com.
Seti@home. www.setiathome.ssl.berkeley.edu.
The Sun Grid Engine. http://gridengine.sunsource.net.
T. Röblitz, F. Schintke, and J. Wendler. Elastic Grid Reservations with User-Defined Optimization Policies. In Workshop on Adaptive Grid Middleware (AGridM’04), 2004.
R. V. van Nieuwpoort, J. Maassen, H.E. Bal, T. Kielmann, and R. Veldema. Wide-Area Parallel Programming Using the Remote Method Invocation Method. Concurrency: Practice and Experience, 12(8):643–666, 2000.
R.V. van Nieuwpoort, J. Mason, G. Wrzesinska, R. Hofman, C. Jacobs, T. Kielmann, and H.E. Bal. Ibis: A Flexible and Efficient Java-based Grid Programming Environment. Concurrency and Computation: Practice and Experience, 17:1079–1107, 2005.
F.M. Vos, R.E. van Gelder, I.W.O. Serlie, J. Florie, C.Y. Nio, A.S. Glas, F.H. Post, R. Truyen, F.A. Gerritsen, and J. Stoker. Three-dimensional Display Modes for CT Colonography: Conventional 3D Virtual Colonoscopy versus Unfolded Cube Projection. Radiology, 228:878–885, 2003.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer Science+Business Media, Inc.
About this chapter
Cite this chapter
Bucur, A., Epema, D., Mohamed, H. (2006). Co-Allocation in Grids: Experiences and Issues. In: Getov, V., Laforenza, D., Reinefeld, A. (eds) Future Generation Grids. Springer, Boston, MA . https://doi.org/10.1007/978-0-387-29445-2_11
Download citation
DOI: https://doi.org/10.1007/978-0-387-29445-2_11
Publisher Name: Springer, Boston, MA
Print ISBN: 978-0-387-27935-0
Online ISBN: 978-0-387-29445-2
eBook Packages: Computer ScienceComputer Science (R0)