Abstract
We are interested in making use of Multiclusters to execute parallel applications. The present work is developed within the M-CISNE project. M-CISNE is a non-dedicated and heterogeneous Multicluster environment which includes MetaLoRaS, a two-level MetaScheduler that manages the appropriate job allocation to available resources.
In this paper, we present a new resource-matching model for MetaLoRaS, which is aimed at mitigating the degraded turnaround time of co-allocated jobs, caused by the contention on shared inter-cluster links. The model is linear programming based and considers the availability of computational resources and the contention of shared inter and intra-cluster links. Its goal is to minimize the average turnaround time of the parallel applications without disturbing the local applications excessively and maximize the prediction accuracy.
We also present a parallel job model that takes both computation and communication characterizations into account. By doing this, greater accuracy is obtained than in other models only focused on one of these characteristics.
Our preliminary performance results indicate that the linear programming model for on-line resource matching is efficient in speed and accuracy and can be successfully applied to co-allocate jobs across different clusters.
This work was supported by the MEyC-Spain under contract TIN2007-64974.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Cplex (June 30, 2007), http://www.ilog.com
Bailey, D.H., Dagum, L., Barszcz, E., Simon, H.D.: NAS parallel benchmark results. In: Supercomputing, pp. 386–393 (1992)
Banino, C., Beaumont, O., Carter, L., Ferrante, J., Legrand, A., Robert, Y.: Scheduling strategies for master-slave tasking on heterogeneous processor platforms. IEEE Transactions on Parallel and Distributed Systems 15(4), 319–330 (2004)
Bucur, A.I., Epema, D.H.: The performance of processor co-allocation in multicluster systems. In: CCGRID 2003: Proceedings of the 3st International Symposium on Cluster Computing and the Grid, Washington, DC, USA, p. 302. IEEE Computer Society, Los Alamitos (2003)
Du, X., Zhang, X.: Coordinating parallel processes on networks of workstations. Journal of Parallel and Distributed Computing 46(2), 125–135 (1997)
Ernemann, C., Hamscher, V., Streit, A., Yahyapour, R.: Enhanced algorithms for multi-site scheduling (2002)
Hanzich, M., Giné, F., Hernández, P., Solsona, F., Luque, E.: Cisne: A new integral approach for scheduling parallel applications on non-dedicated clusters. In: Cunha, J.C., Medeiros, P.D. (eds.) Euro-Par 2005. LNCS, vol. 3648, pp. 220–230. Springer, Heidelberg (2005)
Hanzich, M., Giné, F., Hernández, P., Solsona, F., Luque, E.: Using on-the-fly simulation for estimating the turnaround time on non-dedicated clusters. In: Nagel, W.E., Walter, W.V., Lehner, W. (eds.) Euro-Par 2006. LNCS, vol. 4128, pp. 177–187. Springer, Heidelberg (2006)
Javadi, B., Abawajy, J.: Performance analysis of heterogeneous multi-cluster systems. In: ICPPW 2005: Proceedings of the 2005 International Conference on Parallel Processing Workshops (ICPPW 2005), Washington, DC, USA, pp. 493–500. IEEE Computer Society, Los Alamitos (2005)
Jones, W.M., Ligon, W.B., Pang, L.W., Stanzione, D.: Characterization of bandwidth-aware meta-schedulers for co-allocating jobs across multiple clusters. The Journal of Supercomputing V34(2), 135–163 (2005)
Lérida, J.L., Solsona, F., Giné, F., Hanzich, M., García, J.R., Hernández, P.: Metaloras: A re-scheduling and prediction metascheduler for non-dedicated multiclusters. In: Cappello, F., Herault, T., Dongarra, J. (eds.) PVM/MPI 2007. LNCS, vol. 4757, pp. 195–203. Springer, Heidelberg (2007)
Lérida, J.L., Solsona, F., Giné, F., Hanzich, M., Hernández, P., Luque, E.: Metaloras: A predictable metascheduler for non-dedicated multiclusters. In: Guo, M., Yang, L.T., Di Martino, B., Zima, H.P., Dongarra, J., Tang, F. (eds.) ISPA 2006. LNCS, vol. 4330, pp. 630–641. Springer, Heidelberg (2006)
Naik, V.K., Liu, C., Yang, L., Wagner, J.: Online resource matching for heterogeneous grid environments. Ccgrid 2, 607–614 (2005)
Wolski, R., Spring, N., Hayes, J.: Predicting the CPU availability of time-shared unix systems on the computational grid. Cluster Computing 3(4), 293–301 (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lérida, J.L., Solsona, F., Giné, F., García, J.R., Hernández, P. (2008). Resource Matching in Non-dedicated Multicluster Environments. In: Palma, J.M.L.M., Amestoy, P.R., Daydé, M., Mattoso, M., Lopes, J.C. (eds) High Performance Computing for Computational Science - VECPAR 2008. VECPAR 2008. Lecture Notes in Computer Science, vol 5336. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-92859-1_16
Download citation
DOI: https://doi.org/10.1007/978-3-540-92859-1_16
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-92858-4
Online ISBN: 978-3-540-92859-1
eBook Packages: Computer ScienceComputer Science (R0)