Skip to main content

Fast Tuning of Intra-cluster Collective Communications

  • Conference paper
Recent Advances in Parallel Virtual Machine and Message Passing Interface (EuroPVM/MPI 2004)

Abstract

Recent works try to optimise collective communication in grid systems focusing mostly on the optimisation of communications among different clusters. We believe that intra-cluster collective communications should also be optimised, as a way to improve the overall efficiency and to allow the construction of multi-level collective operations. Indeed, inside homogeneous clusters, a simple optimisation approach rely on the comparison from different implementation strategies, through their communication models. In this paper we evaluate this approach, comparing different implementation strategies with their predicted performances. As a result, we are able to choose the communication strategy that better adapts to each network environment.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Barnett, R., Payne, D., van de Geijn, R., Watts, J.: Broadcasting on meshes with wormhole routing. Journal of Parallel and Distributed Computing 35(2), 111–122 (1996)

    Article  Google Scholar 

  2. Bhat, P., Raharendra, C., Prasanna, V.: Efficient Collective Communication in Distributed Heterogeneous Systems. Journal of Parallel and Distributed Computing 63, 251–263 (2003)

    Article  MATH  Google Scholar 

  3. Karonis, N.T., Foster, I., Supinski, B., Gropp, W., Lusk, E., Lacour, S.: A Multilevel Approach to Topology-Aware Collective Operations in Computational Grids. Technical report ANL/MCS-P948-0402, Mathematics and Computer Science Division, Argonne National Laboratory (2002)

    Google Scholar 

  4. Kielmann, T., Hofman, R., Bal, H., Plaat, A., Bhoedjang, R.: MagPIe: MPI’s Collective Communication Operations for Clustered Wide Area Systems. In: Proceeding Seventh ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, Atlanta, GA, pp. 131–140. ACM Press, New York (1999)

    Chapter  Google Scholar 

  5. Kielmann, T., Bal, H., Verstoep, K.: Fast Measurement of LogP Parameters for Message Passing Platforms. In: Rolim, J.D.P. (ed.) IPDPS-WS 2000. LNCS, vol. 1800, pp. 1176–1183. Springer, Heidelberg (2000), http://www.cs.vu.nl/albatross/

    Chapter  Google Scholar 

  6. Kielman, T., Bal, E., Gorlatch, S., Verstoep, K., Hofman, R.: Network Performanceaware Collective Communication for Clustered Wide Area Systems. Parallel Computing 27(11), 1431–1456 (2001)

    Article  Google Scholar 

  7. LAM-MPI Team, LAM/MPI Version 6.5.9 (2003), http://www.lam-mpi.org/

  8. LAM-MPI Team, LAM/MPI Version 7 (2004), http://www.lam-mpi.org/

  9. LAM-MPI Team, Performance Issues with LAM/MPI on Linux 2.2.x (2001), http://www.lam-mpi.org/linux/

  10. Loncaric, J.: Linux TCP Patches to improve acknowledgement policy (2000), http://research.nianet.org/~josip/LinuxTCP-patches.html

  11. Lowekamp, B.: Discovery and Application of Network Information. PhD Thesis, Carnegie Mellon University (2000)

    Google Scholar 

  12. Thakur, R., Gropp, W.: Improving the Performance of Collective Operations in MPICH. In: Dongarra, J., Laforenza, D., Orlando, S. (eds.) EuroPVM/MPI 2003. LNCS, vol. 2840, pp. 257–267. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  13. Vadhiyar, S., Fagg, G., Dongarra, J.: Automatically Tuned Collective Communications. In: Proceedings of Supercomputing 2000, Dallas TX, IEEE Computer Society, Los Alamitos (2000)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Barchet-Estefanel, L.A., Mounié, G. (2004). Fast Tuning of Intra-cluster Collective Communications. In: Kranzlmüller, D., Kacsuk, P., Dongarra, J. (eds) Recent Advances in Parallel Virtual Machine and Message Passing Interface. EuroPVM/MPI 2004. Lecture Notes in Computer Science, vol 3241. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30218-6_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-30218-6_12

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-23163-9

  • Online ISBN: 978-3-540-30218-6

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics