Skip to main content
SpringerLink
Log in
Book cover

Introduction to HPC with MPI for Data Science pp 21–62Cite as

Introduction to MPI: The Message Passing Interface

  • Chapter
  • First Online:

Part of the book series: Undergraduate Topics in Computer Science ((UTICS))

Abstract

MPI is a standardized Application Programming Interface (API) that allows one to provide unambiguously the interface (that is, the declaration of functions, procedures, data-types, constants, etc.) with the precise semantic of communication protocols and global calculation routines, among others. Thus a parallel program using distributed memory can be implemented using various implementations of the MPI interface provided by several vendors (like the prominent OpenMPI, MPICH2, etc.). Communications can either be synchronous or asynchronous, bufferized or not bufferized, and one can define synchronization barriers where all processes have to wait for each other before further carrying computations.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   49.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    Hypertext Markup Language .

  2. 2.

    An example of binary operator that is not commutative is the division since \(p/q \not = q/p\).

  3. 3.

    See the manual online: https://www.open-mpi.org/doc/v1.4/man3/MPI_Send.3.php.

  4. 4.

    In that case, either a time-out signal can be emitted externally to kill all the processes, or we need to manually kill the processes using their process identity number using Shell command line instructions.

  5. 5.

    https://www.open-mpi.org/doc/v1.8/man3/MPI_Sendrecv.3.php.

  6. 6.

    See manual online at https://www.open-mpi.org/doc/v1.5/man3/MPI_Reduce.3.php.

  7. 7.

    http://bsponmpi.sourceforge.net/.

  8. 8.

    http://mpi4py.scipy.org/docs/usrman/.

  9. 9.

    http://www.boost.org/.

  10. 10.

    http://openmp.org/wp/.

  11. 11.

    https://computing.llnl.gov/linux/slurm/.

  12. 12.

    https://www.python.org/.

  13. 13.

    https://www.open-mpi.org/doc/v1.5/man3/MPI_Bcast.3.php.

  14. 14.

    https://www.open-mpi.org/doc/v1.5/man3/MPI_Scatter.3.php.

  15. 15.

    https://www.open-mpi.org/doc/v1.5/man3/MPI_Gather.3.php.

  16. 16.

    https://www.open-mpi.org/doc/v1.5/man3/MPI_Reduce.3.php.

  17. 17.

    https://www.open-mpi.org/doc/v1.5/man3/MPI_Allreduce.3.php.

  18. 18.

    http://www.csm.ornl.gov/pvm/.

  19. 19.

    http://www.mpich.org/.

References

  1. Kernighan, B.W., Ritchie, D.M.: The C Programming Language, 2nd edn. Prentice Hall Professional Technical Reference, Englewood Cliffs (1988)

    Google Scholar 

  2. Stroustrup, Bjarne: The C++ Programming Language, 3rd edn. Addison-Wesley Longman Publishing Co. Inc, Boston (2000)

    Google Scholar 

  3. Kumar, V., Grama, A., Gupta, A., Karypis, G.: Introduction to Parallel Computing: Design and Analysis of Algorithms. Benjamin-Cummings Publishing Co. Inc, Redwood City (1994)

    Google Scholar 

  4. Casanova, H., Legrand, A., Robert, Y.: Parallel Algorithms. Chapman and Hall/CRC numerical analysis and scientific computing. CRC Press (2009)

    Google Scholar 

  5. Snir, M., Otto, S., Huss-Lederman, S., Walker, D., Dongarra, J.: MPI-The Complete Reference, Vol. 1: The MPI Core, 2nd edn. MIT Press, Cambridge (1998). (revised)

    Google Scholar 

  6. Gropp, W.D., Huss-Lederman, S., Lumsdaine, A., Inc netLibrary, : MPI : The Complete Reference. Vol. 2, The MPI-2 Extensions. Scientific and engineering computation series. MIT Press, Cambridge (1998)

    Google Scholar 

  7. Gropp, W., Hoefler, T., Thakur, R., Lusk, E.: Using Advanced MPI: Modern Features of the Message-Passing Interface. MIT Press (2014)

    Google Scholar 

  8. Sanders, p., Larsson Träff, J.: Parallel prefix (scan) algorithms for MPI. In: Recent Advances in Parallel Virtual Machine and Message Passing Interface, pp. 49–57. Springer (2006)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. École Polytechnique, Palaiseau, France

    Frank Nielsen

  2. Sony Computer Science Laboratories, Inc., Tokyo, Japan

    Frank Nielsen

Authors
  1. Frank Nielsen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Frank Nielsen .

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Nielsen, F. (2016). Introduction to MPI: The Message Passing Interface. In: Introduction to HPC with MPI for Data Science. Undergraduate Topics in Computer Science. Springer, Cham. https://doi.org/10.1007/978-3-319-21903-5_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-21903-5_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-21902-8

  • Online ISBN: 978-3-319-21903-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation