Skip to main content
SpringerLink
Log in
Book cover

International Symposium on High Performance Computing

ISHPC 2002: High Performance Computing pp 437–448Cite as

Parallel Iterative Solvers for Unstructured Grids Using an OpenMP/MPI Hybrid Programming Model for the GeoFEM Platform on SMP Cluster Architectures

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2327))

Abstract

An efficient parallel iterative method for unstructured grids developed by the authors for SMP cluster architectures on the GeoFEM platform is presented. The method is based on a 3-level hybrid parallel programming model, including message passing for inter-SMP node communication, loop directives by OpenMP for intra-SMP node parallelization and vectorization for each processing element (PE). Simple 3D elastic linear problems with more than 8×108 DOF have been solved by 3x3 block ICCG(0) with additive Schwarz domain decomposition and PDJDS/CM-RCM reordering on 128 SMP nodes of Hitachi SR8000/MPP parallel computer, achieving performance of 335.2 GFLOPS. The PDJDS/CM-RCM reordering method provides excellent vector and parallel performance in SMP nodes.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Accelerated Strategic Computing Initiative (ASCI) Web Site: http://www.llnl.gov/asci/

  2. Earth Simulator Research and Development Center Web Site: http://www.es.jamstec.go.jp/

  3. GeoFEM Web Site: http://geofem.tokyo.rist.or.jp/

  4. MPI Web Site: http://www.mpi.org/

  5. OpenMP Web Site: http://www.openmp.org/

  6. Falgout, R. and Jones, J.: “Multigrid on Massively Parallel Architectures”, Sixth European Multigrid Conference, Ghent, Belgium, September 27–30, 1999.

    Google Scholar 

  7. Cappelo, F. and Etiemble, D.:“MPI versus MPI+OpenMP on the IBM SP for the NAS Benchmarks”, SC2000 Technical Paper, Dallas, Texas, 2000.

    Google Scholar 

  8. NPB (NAS Parallel Benchmarks) Web Site: http://www.nas.nasa.gov/Research/Software/swdescription.html#NPB/

  9. Hitachi SR8000 Web Site: http://www.hitachi.co.jp/Prod/comp/hpc/foruser/sr8000/

  10. Information Technology Center, The University of Tokyo Web Site: http://www.cc.u-tokyo.ac.jp/

  11. Washio, T., Maruyama, K., Osoda, T., Shimizu, F. and Doi, S.: “Blocking and reordering to achieve highly parallel robust ILU preconditioners”, RIKEN Symposium on Linear Algebra and its Applications, The Institute of Physical and Chemical Research, 1999, pp. 42–49.

    Google Scholar 

  12. Washio, T., Maruyama, K., Osoda, T., Shimizu, F. and Doi, S.: “Efficient implementations of block sparse matrix operations on shared memory vector machines”, SNA2000: The Fourth International Conference on Supercomputing in Nuclear Applications, 2000.

    Google Scholar 

  13. Barrett, R., Bery, M., Chan, T.F., Donato, J., Dongarra, J.J., Eijkhout, V., Pozo, R., Romine, C. and van der Vorst, H.: Templates for the Solution of Linear Systems: Building Blocks for Iterative Methods, SIAM, 1994.

    Google Scholar 

  14. Nakajima, K., Okuda, H.: “Parallel Iterative Solvers with Localized ILU Preconditioning for Unstructured Grids on Workstation Clusters”, International Journal for Computational Fluid Dynamics 12 (1999) pp. 315–322

    Article  MATH  Google Scholar 

  15. Garatani, K., Nakamura, H., Okuda, H., Yagawa, G.: “GeoFEM: High Performance Parallel FEM for Solid Earth”, HPCN Europe 1999, Amsterdam, The Netherlands, Lecture Notes in Computer Science 1593 (1999) pp. 133–140

    Google Scholar 

  16. Smith, B., Bjørstad, P. and Gropp, W.: Domain Decomposition, Parallel Multilevel Methods for Elliptic Partial Differential Equations, Cambridge Press, 1996.

    Google Scholar 

  17. Saad, Y.: Iterative Methods for Sparse Linear Systems, PWS Publishing Company, 1996.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Research Organization for Information Science and Technology (RIST), 2-2-54 Naka-Meguro, Meguro-ku, Tokyo, 153-0061, Japan

    Kengo Nakajima

  2. Department of Quantum Engineering and System Sciences, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-8656, Japan

    Hiroshi Okuda

Authors
  1. Kengo Nakajima
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hiroshi Okuda
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Institute of Software Science, University of Vienna, Liechtensteinstr. 22, 1090, Vienna, Austria

    Hans P. Zima

  2. Department of Information and Computer Science, Nara Women’s University, Kitauoyanishimachi, Nara City, 630-8506, Japan

    Kazuki Joe

  3. Institute of Information Science and Electronics, University of Tsukuba, Tenno-dai 1-1-1, Tsukuba, Ibaraki, 305-8577, Japan

    Mitsuhisa Sato

  4. Internet Systems Research Laboratories, NEC Corporation, 4-1-1, Miyazaki, Miyamae, Kawasaki, Kanagawa, 216-8555, Japan

    Yoshiki Seo

  5. Kyoto University, Yoshidahonmachi, Sakyo-ku, Kyoto, 606-8501, Japan

    Masaaki Shimasaki

Rights and permissions

Reprints and permissions

Copyright information

© 2002 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Nakajima, K., Okuda, H. (2002). Parallel Iterative Solvers for Unstructured Grids Using an OpenMP/MPI Hybrid Programming Model for the GeoFEM Platform on SMP Cluster Architectures. In: Zima, H.P., Joe, K., Sato, M., Seo, Y., Shimasaki, M. (eds) High Performance Computing. ISHPC 2002. Lecture Notes in Computer Science, vol 2327. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-47847-7_40

Download citation

  • DOI: https://doi.org/10.1007/3-540-47847-7_40

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-43674-4

  • Online ISBN: 978-3-540-47847-8

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation