Skip to main content

A uGNI-Based MPICH2 Nemesis Network Module for the Cray XE

  • Conference paper
Recent Advances in the Message Passing Interface (EuroMPI 2011)

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 6960))

Included in the following conference series:

Abstract

Recent versions of MPICH2 have featured Nemesis – a scalable, high-performance, multi-network communication subsystem. Nemesis provides a framework for developing Network Modules (Netmods) for interfacing the Nemesis subsystem to various high speed network protocols. Cray has developed a user-level Generic Network Interface (uGNI) for interfacing MPI implementations to the internal high speed network of Cray XE and follow-on computer systems. This paper describes the design of a uGNI Netmod for the MPICH2 nemesis subsystem. MPICH2 performance data on the Cray XE are presented.

This material is based upon work supported by the Defense Advanced Research Projects Agency under its Agreement No. HR0011-07-9-0001. Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the Defense Advanced Research Projects Agency. This work was supported in part by the Office of Advanced Scientific Computing Research, Office of Science, U.S. Department of Energy, under Contract DE-AC02-06CH11357.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Alverson, R., Roweth, D., Kaplan, L.: The Gemini System Interconnect. In: Symposium on High-Performance Interconnects, vol. 0, pp. 83–87 (2010)

    Google Scholar 

  2. Buntinas, D., Mercier, G., Gropp, W.: Design and Evaluation of Nemesis, a Scalable, Low-Latency, Message-Passing Communication Subsystem. In: CCGRID 2006, pp. 521–530 (2006)

    Google Scholar 

  3. Cray, Inc.: Cray Software Document S-2446-3103: Using the GNI and DMAPP APIs (March 2011)

    Google Scholar 

  4. Fault Tolerance Working Group: Run-though Stabilization Interfaces and Semantics, svn.mpi-forum.org/trac/mpi-forum-web/wiki/ft/run_through_stabilization

  5. Lai, P., Balaji, P., Thakur, R., Panda, D.K.: ProOnE: a General-purpose Protocol Onload Engine for Multi- and Many-core Architectures. Computer Science - R&D, 133–142 (2009)

    Google Scholar 

  6. MPICH2: www.mcs.anl.gov/research/projects/mpich2/

  7. MPICH2–Nemesis: Nemesis Network Module API, wiki.mcs.anl.gov/mpich2/index.php/Nemesis_Network_Module_API

  8. Network–Based Computing Laboratory: MVAPICH: MPI over Infiniband, 10GigE/iWARP and RoCE, mvapich.cse.ohio-state.edu/overview/mvapich2

  9. Wyckoff, P., Wu, J.: Memory Registration Caching Correctness. In: Proceedings of CCGrid 2005. IEEE Computer Society, Los Alamitos (2005)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Pritchard, H., Gorodetsky, I., Buntinas, D. (2011). A uGNI-Based MPICH2 Nemesis Network Module for the Cray XE. In: Cotronis, Y., Danalis, A., Nikolopoulos, D.S., Dongarra, J. (eds) Recent Advances in the Message Passing Interface. EuroMPI 2011. Lecture Notes in Computer Science, vol 6960. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24449-0_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-24449-0_14

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-24448-3

  • Online ISBN: 978-3-642-24449-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics