Skip to main content
SpringerLink
Log in

Flexible Message Passing Interface for A Heterogenous Computing Environment

  • Chapter
New Horizons of Parallel and Distributed Computing

Abstract

A flexible MPI library, Stampi, has been developed to enable MPI operations on a heterogeneous computing environment. APIs are based on the MPI-1 and the MPI-2 standards. Users can call these functions without awareness of underlying communication mechanism. In message transfer, a vendor-supplied MPI library and TCP/IP socket are used selectively among MPI processes. Introducing its own router process mechanism hides a complex network configuration in inter-machine data transfer. In addition, the MPI-2 extensions, functionalities of dynamic process creation and MPI-I/O, are also implemented. MPI-I/O on the Stampi library realizes both local and remote I/O operations due to the request of user applications. We have evaluated performance of primitive MPI functions in Stampi and sufficient performance has been achieved and effectiveness of our flexible implementation has been confirmed.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Message Passing Interface Forum. (1995). MPI: A Message-Passing Interface Standard.

    Google Scholar 

  2. Message Passing Interface Forum. (1997). MPI-2: Extensions to the Message-Passing Interface Standard.

    Google Scholar 

  3. T. Imamura, Y. Tsujita, H. Koide, and H. Takemiya. (2000). An Architecture of Stampi: MPI Library on a Cluster of Parallel Computers. LNCS 1908, Recent Advances in Parallel Virtual Machine and Message Passing Interface, Springer, pp. 200–207.

    Google Scholar 

  4. Y. Tsujita, T. Imamura, H. Takemiya, and N. Yamagishi (2002). Stampi-I/O: Flexible Distributed Parallel-I/O Library for Heterogeneous Computing Environment. LNCS 2474, Recent Advances in Parallel Virtual Machine and Message Passing Interface, Springer, pp. 288–295.

    Google Scholar 

  5. J. M. Squyres, A. Lumsdaine, W. L. George, J. G. Hagedorn, and J. E. Devaney (2000). The Interoperable Message Passing Interface (IMPI) Extensions to LAM/MPI. MPI Developer’s Conference, Ithica, NY, USA.

    Google Scholar 

  6. G. Burns, R. Daund, and J. Vaigl (1994). LAM: An open cluster environment for MPI. In Proceedings of Supercomputing Symposium’ 94, University of Toronto, pp. 379–386.

    Google Scholar 

  7. PC Cluster Consortium, http://www.pccluster.org/.

    Google Scholar 

  8. Y. Tsujita, T. Imamura, N. Yamagishi, and H. Takemiya (2003). MPI-2 Support in Heterogeneous Computing Environment Using an SCore Cluster System. LNCS 2745, Parallel and Distributed Processing and Applications, Springer, pp. 139–144.

    Google Scholar 

  9. http://primepower.fujitsu.com/hpc/en/vpp5000e/.

    Google Scholar 

  10. B. Tierney. (2001). TCP Tuning Guide for Distributed Application on Wide Area Networks. Usenix; login, February 2001.

    Google Scholar 

  11. Fujitsu UXP/V MPI User’s Manual V20.

    Google Scholar 

  12. W. Gropp, E. Lusk, N. Doss, and A. Skjellum. (1996). A high-performance, portable implementation of the MPI message passing interface standard. Parallel Computing, 22(6), pp. 789–828.

    Article  Google Scholar 

  13. N. Karonis, B. Toonen, and I. Foster. (2003). MPICH-G2: A Grid-Enabled Implementation of the Message Passing Interface. Journal of Parallel and Distributed Computing 63(5), pp. 551–563.

    Article  Google Scholar 

  14. E. Gabiriel, M. Resch, T. Beisel, and R. Keller. (1998). Distributed Computing in a Heterogeneous Computing Environment. LNCS 1497, Recent Advances in Parallel Virtual Machine and Message Passing Interface, Springer, pp. 180–188.

    Google Scholar 

  15. I. Foster and C. Kesselman (1998). The Globus project: A status report. In Proceedings of the Heterogeneous Computing Workshop, IEEE Computer Society Press, pp. 4–18.

    Google Scholar 

  16. R. Thakur, W. Gropp, and E. Lusk. (1999). On Implementing MPI-IO Portably and with High Performance. In Proceedings of the 6 th Workshop on I/O in Parallel and Distributed Systems, pp. 23–32.

    Google Scholar 

  17. R. Thakur, W. Gropp, and E. Lusk. (1996). An Abstract-Device Interface for Implementing Portable Parallel-I/O Interfaces. In Proceedings of the 6 th Symposium on the Frontiers of Massively Parallel Computation, pp. 180–187.

    Google Scholar 

  18. Myricom, Inc. http://www.myri.com/.

    Google Scholar 

  19. M. Matsuda, T. Kudoh, and Y. Ishikawa. (2003). Evaluation of MPI Implementations on Grid-connected Clusters using an Emulated WAN Environment. In Proceedings of the 3 rd IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGrid 2003), pp. 10–17.

    Google Scholar 

  20. T. Takahashi, S. Sumimoto, A. Hori, H. Harada, and Y. Ishikawa. (2000). PM2: High Performance Communication Middleware for Heterogeneous Network Environments. In SC2000: High Performance Networking and Computing Conference, IEEE.

    Google Scholar 

Download references

Author information

Author notes

  1. Yuichi Tsujita

    Present address: Department of Electric Engineering and Computer Science, Faculty of Engineering, Kinki University, 1 Umenobe, Takaya, HigashiHiroshima, Hiroshima, 7392116, Japan

  2. Toshiyuki Imamura

    Present address: Department of Computer Science, The University of ElectroCommunications, 151 Chofugaoka, Chofu, Tokyo, 1828585, Japan

Authors and Affiliations

  1. Center for Promotion of Computational Science and Engineering, Japan Atomic Energy Research Institute, 693 HigashiUeno, Taitoku, Tokyo, 1100015, Japan

    Yuichi Tsujita, Toshiyuki Imamura & Nobuhiro Yamagishi

  2. Hitachi East Japan Solutions, Ltd., 21610 Honcho, Aobaku, Sendai, Miyagi, 9800014, Japan

    Hiroshi Takemiya

Authors
  1. Yuichi Tsujita
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Toshiyuki Imamura
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Nobuhiro Yamagishi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Hiroshi Takemiya
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yuichi Tsujita .

Editor information

Editors and Affiliations

  1. Dept. of Computer Software, The University of Aizu, Aizu-Wakamatsu City, FUKUSHIMA, 65-8580, JAPAN

    Minyi Guo

  2. Department of Computer Science, St. Francis Xavier University, Antigonish, NS, B2G 2W5, Canada

    Laurence Tianruo Yang

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer Science+Business Media, Inc.

About this chapter

Cite this chapter

Tsujita, Y., Imamura, T., Yamagishi, N., Takemiya, H. (2005). Flexible Message Passing Interface for A Heterogenous Computing Environment. In: Guo, M., Yang, L.T. (eds) New Horizons of Parallel and Distributed Computing. Springer, Boston, MA. https://doi.org/10.1007/0-387-28967-4_1

Download citation

  • DOI: https://doi.org/10.1007/0-387-28967-4_1

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-0-387-24434-1

  • Online ISBN: 978-0-387-28967-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation