Skip to main content
SpringerLink
Log in
Book cover

International Symposium on Parallel and Distributed Processing and Applications

ISPA 2006: Parallel and Distributed Processing and Applications pp 916–926Cite as

Towards Fully Adaptive Pipeline Parallelism for Heterogeneous Distributed Environments

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 4330))

Abstract

This work describes an adaptive parallel pipeline skeleton which maps pipeline stages to the best processors available in the system and clears dynamically emerging performance bottlenecks at run-time by re-mapping affected stages to other processors. It is implemented in C and MPI and evaluated on a non-dedicated heterogeneous Linux cluster. We report upon the skeleton’s ability to respond to an artificially generated variation in the background load across the cluster.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Pancake, C.M.: Is parallelism for you? IEEE Computat. Sci. Eng. 3, 18–37 (1996)

    Article  Google Scholar 

  2. Heller, D.: A survey of parallel algorithms in numerical linear algebra. SIAM Review 20, 740–777 (1978)

    Article  MATH  MathSciNet  Google Scholar 

  3. Fleury, M., Downton, A.: Pipelined Processor Farms: Structured Design for Embedded Parallel Systems. Wiley-Interscience, New York (2001)

    Google Scholar 

  4. Foster, I., Kesselman, C.: The Grid: Blueprint for a new computing infrastructure, 2nd edn. Morgan Kaufmann, San Francisco (2003)

    Google Scholar 

  5. Laforenza, D.: Grid programming: some indications where we are headed. Parallel Comput. 28, 1733–1752 (2002)

    Article  MATH  Google Scholar 

  6. Cole, M.: Algorithmic Skeletons: Structured Management of Parallel Computation. MIT Press, London (1989)

    MATH  Google Scholar 

  7. González-Vélez, H.: An adaptive skeletal task farm for grids. In: Cunha, J.C., Medeiros, P.D. (eds.) Euro-Par 2005. LNCS, vol. 3648, pp. 401–410. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  8. Vadhiyar, S.S., Dongarra, J.: SRS: A framework for developing malleable and migratable parallel applications for distributed systems. Parallel Process. Lett. 13, 291–312 (2003)

    Article  MathSciNet  Google Scholar 

  9. Sievert, O., Casanova, H.: A simple MPI process swapping architecture for iterative applications. Int. J. High Perform. Comput. Appl. 18, 341–352 (2004)

    Article  Google Scholar 

  10. Longbottom, R.: C/C++ Whetstone benchmark single or double precision (1997) (Official version approved by H. J. Curnow on 21/November/1997) ftp.nosc.mil/pub/aburto

  11. Gunther, N.J.: Analyzing Computer System Performance with Perl: PDQ. Springer, Berlin (2004)

    Google Scholar 

  12. González, D., Almeida, F., Moreno, L.M., Rodríguez, C.: Towards the automatic optimal mapping of pipeline algorithms. Parallel Comput. 29, 241–254 (2003)

    Article  Google Scholar 

  13. Banerjee, S., Hamada, T., Chau, P.M., Fellman, R.D.: Macro pipelining based scheduling on high performance heterogeneous multiprocessor systems. IEEE Trans. Acoust. Speech Signal Process 43, 1468–1484 (1995)

    Google Scholar 

  14. Chatterjee, S., Strosnider, J.K.: Distributed Pipeline Scheduling: A framework for distributed, heterogeneous real-time system design. Comput. J. 38, 271–285 (1995)

    Google Scholar 

  15. Vadhiyar, S.S., Dongarra, J.J.: Self adaptivity in grid computing. Concurrency Computat. Pract. Exper. 17, 235–257 (2005)

    Article  Google Scholar 

  16. Kelly, P.H.J., Beckmann, O.: Generative and adaptive methods in performance programming. Parallel Process. Lett. 15, 239–255 (2005)

    Article  MathSciNet  Google Scholar 

  17. Aldinucci, M., Danelutto, M., Teti, P.: An advanced environment supporting structured parallel programming in Java. Future Gener. Comput. Syst. 19, 611–626 (2003)

    Article  Google Scholar 

  18. Cole, M.: Bringing skeletons out of the closet: a pragmatic manifesto for skeletal parallel programming. Parallel Comput. 30, 389–406 (2004)

    Article  Google Scholar 

  19. Yaikhom, G., Cole, M., Gilmore, S.: Combining Measurement and Stochastic Modelling to Enhance Scheduling Decisions for a Parallel Mean Value Analysis Algorithm. In: Alexandrov, V.N., van Albada, G.D., Sloot, P.M.A., Dongarra, J. (eds.) ICCS 2006. LNCS, vol. 3992, pp. 929–936. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  20. González-Vélez, H.: Self-adaptive skeletal task farm for computational grids. Parallel Comput. (in press, 2006) doi:10.1016/j.parco.2006.07.002

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute for Computing Systems Architecture, School of Informatics, University of Edinburgh, Edinburgh, EH9 3JZ, UK

    Horacio González-Vélez & Murray Cole

Authors
  1. Horacio González-Vélez
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Murray Cole
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Computer Science and Engineering, Shanghai Jiao Tong University, 200030, Shanghai, China

    Minyi Guo

  2. Department of Computer Science, St. Francis Xavier University, Antigonish, Canada

    Laurence T. Yang

  3. Dipartimento di Ingegneria dell’ Informazione - Second, University of Naples - Italy, Real Casa dell’Annunziata, via Roma, 29 81031, Aversa (CE), Italy

    Beniamino Di Martino

  4. Institute of Scientific Computing, University of Vienna, Nordbergstr. 15/C/3, A-1090, Vienna, Austria/JPL, Caltech, USA

    Hans P. Zima

  5. Computer Science Department, University of Tennessee, TN 37996-3450, Knoxville, USA

    Jack Dongarra

  6. Grid Computing Center, Shanghai Jiao Tong University, 800 Dongchuan Road, 200240, Shanghai, China

    Feilong Tang

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

González-Vélez, H., Cole, M. (2006). Towards Fully Adaptive Pipeline Parallelism for Heterogeneous Distributed Environments. In: Guo, M., Yang, L.T., Di Martino, B., Zima, H.P., Dongarra, J., Tang, F. (eds) Parallel and Distributed Processing and Applications. ISPA 2006. Lecture Notes in Computer Science, vol 4330. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11946441_82

Download citation

  • DOI: https://doi.org/10.1007/11946441_82

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-68067-3

  • Online ISBN: 978-3-540-68070-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation