Abstract
Algorithmic skeletons abstract commonly used patterns of parallel computation, communication, and interaction. By demonstrating a predictable communication and computation structure, they provide a foundation for performance modelling and estimation. Grids pose a challenge to known distributed systems techniques as a result of their dynamism. One of the most prominent research areas concerns the availability of proved programming paradigms with special emphasis on the performance side. Thus, adaptable performance improvement techniques have been the subject of intense scrutiny. Scant research has been conducted on using the skeletal predicting information to enhance performance in heterogeneous environments. We propose the use of these predicting properties to adaptively enhance the performance of skeletons, in particular of a task farm, within a computational grid.
Hence, the problem addressed in this paper is: given a skeletal task farm, find an effective way to improve its performance on a heterogeneous distributed environment by incorporating information at compile time that helps it to adapt at execution time. This work provides a grid-enabled, adaptive task farm model, using the NWS statistical predictions on bandwidth, latency and processor availability. The central case study implements an ad-hoc task farm based on C/MPI and employs PACX-MPI for inter-node communication. We present initial promising results of parallel executions of an artificially-generated numerical code in a grid.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Foster, I., Kesselman, C. (eds.): The Grid: Blueprint for a new computing infrastructure, 2nd edn. Morgan Kaufmann, San Francisco (2003)
Laforenza, D.: Grid programming: some indications where we are headed. Parallel Comput. 28, 1733–1752 (2002)
Vetter, J.S., Reed, D.A.: Real-time performance monitoring, adaptive control, and interactive steering of computational grids. Int. J. High Perf. Comput. Appl. 14, 357–366 (2000)
Cheng, S.W., Garlan, D., Schmerl, B., Steenkiste, P., Hu, N.: Software architecturebased adaptation for grid computing. In: HPDC 2002: 11th IEEE Int Symp on High Performance Distributed Computing, Edinburgh, UK, pp. 389–398. IEEE CS, Los Alamitos (2002)
Berman, F., Wolski, R., Casanova, H., Cirne, W., Dail, H., Faerman, M., Figueira, S., Hayes, J., Obertelli, G., Schopf, J., Shao, G., Smallen, S., Spring, N., Su, A., Zagorodnov, D.: Adaptive computing on the grid using AppLeS. IEEE Trans. Parall. Distrib. Sys. 14, 369–382 (2003)
Vadhiyar, S.S., Dongarra, J.J.: Self adaptivity in grid computing. Concurrency Computat. Pract. Exper. 17, 235–257 (2005)
Cole, M.: Algorithmic Skeletons: Structured Management of Parallel Computation. MIT Press, London (1989)
Cole, M.: Bringing skeletons out of the closet: a pragmatic manifesto for skeletal parallel programming. Parallel Comput. 30, 389–406 (2004)
Rabhi, F.A., Gorlatch, S. (eds.): Patterns and skeletons for parallel and distributed computing. Springer, London (2003)
Cole, M.: eSkel: The Edinburgh Skeleton library API reference manual. University of Edinburgh, UK. First edn. (2002), Available on-line at http://homepages.inf.ed.ac.uk/mic/eSkel
Keller, R., Gabriel, E., Krammer, B., Muller, M.S., Resch, M.M.: Towards efficient execution of MPI applications on the Grid: Porting and optimization issues. J. Grid Comput. 1, 133–149 (2003)
Wolski, R., Spring, N., Hayes, J.: The Network Weather Service: A distributed resource performance forecasting service for metacomputing. Future Gener. Comput. Syst. 15, 757–768 (1999)
Hey, A.J.G., Papay, J., Surridge, M.: The role of performance engineering techniques in the context of the grid. Concurrency Computat. Pract. Exper. 17, 297–316 (2005)
Lian, C.C., Tang, F., Isaac, P., Krishnan, A.: GEL: Grid execution language. J. Parallel Distrib. Comput. 65, 857–869 (2005)
Casanova, H., Kim, M.H., Plank, J.S., Dongarra, J.J.: Adaptive scheduling for task farming with grid middleware. Int. J. High Perf. Comput. Appl. 13, 231–240 (1999)
Shao, G., Berman, F., Wolski, R.: Master/slave computing on the grid. In: Raghavendra, C. (ed.) HCW 2000: 9th Heterogeneous Computing Wksp., Cancun, Mexico, pp. 3–16. IEEE CS, Los Alamitos (2000)
Benoit, A., Cole, M., Gilmore, S., Hillston, J.: Scheduling skeleton-based grid applications using PEPA and NWS. Comput. J. 48, 369–378 (2005)
Aldinucci, M., Danelutto, M., Dünnweber, J., Gorlatch, S.: Optimization techniques for skeletons on grid. In: Grandinetti, L. (ed.) Grid Computing and New Frontiers of High Performance Processing, Elsevier Science, Amsterdam (2005) (to appear)
Hey, A.J.G.: Experiments in MIMD parallelism. Future Gener. Comput. Syst. 6, 185–196 (1990)
Wolski, R.: Experiences with predicting resource performance on-line in computational grid settings. Sigmetrics Perform. Eval. Rev. 30, 41–49 (2003)
Gonzalez-Velez, V., Gonzalez-Velez, H.: A grid-based stochastic simulation of unitary and membrane Ca2+ currents in spherical cells. In: 18th IEEE Int Symp on Computer-Based Medical Syst., Dublin, Ireland, IEEE CS, Los Alamitos (2005) (to appear)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
González-Vélez, H. (2005). An Adaptive Skeletal Task Farm for Grids. In: Cunha, J.C., Medeiros, P.D. (eds) Euro-Par 2005 Parallel Processing. Euro-Par 2005. Lecture Notes in Computer Science, vol 3648. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11549468_47
Download citation
DOI: https://doi.org/10.1007/11549468_47
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-28700-1
Online ISBN: 978-3-540-31925-2
eBook Packages: Computer ScienceComputer Science (R0)