Skip to main content
SpringerLink
Log in

Benchmarking Parallel I/O Performance for a Large Scale Scientific Application on the TeraGrid

  • Conference paper
High Performance Computing and Applications

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 5938))

  • 2310 Accesses

Abstract

This paper is a report on experiences in benchmarking I/O performance on leading computational facilities on the NSF TeraGrid network with a large scale scientific application. Instead of focusing only on the raw file I/O bandwidth provided by different machine architectures, the I/O performance and scalability of the computational tools and libraries that are used in current production simulations are tested as a whole, however with focus mostly on bulk transfers. It is seen that the I/O performance of our production code scales very well, but is limited by the I/O system itself at some point. This limitation occurs at a low percentage of the computational size of the machines, which shows that at least for the application used for this paper the I/O system can be an important limiting factor in scaling up to the full size of the machine.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. XiRel: Next Generation Infrastructure for Numerical Relativity, http://www.cct.lsu.edu/xirel/

  2. The Lustre file system, http://www.lustre.org

  3. SimFactory, http://www.cct.lsu.edu/~eschnett/SimFactory/

  4. Alcubierre, M., Brügmann, B., Diener, P., Koppitz, M., Pollney, D., Seidel, E., Takahashi, R.: Gauge conditions for long-term numerical black hole evolutions without excision. Phys. Rev. D 67, 084023 (2003); eprint gr-qc/0206072

    Article  Google Scholar 

  5. Alcubierre, M., Brügmann, B., Dramlitsch, T., Font, J.A., Papadopoulos, P., Seidel, E., Stergioulas, N., Takahashi, R.: Towards a stable numerical evolution of strongly gravitating systems in general relativity: The conformal treatments. Phys. Rev. D 62, 44034 (2000); eprint gr-qc/0003071

    Article  Google Scholar 

  6. Baiotti, L., Hawke, I., Montero, P.J., Löffler, F., Rezzolla, L., Stergioulas, N., Font, J.A., Seidel, E.: Three-dimensional relativistic simulations of rotating neutron star collapse to a Kerr black hole. Phys. Rev. D 71, 024035 (2005); eprint gr-qc/0403029

    Article  Google Scholar 

  7. Berger, M.J., Oliger, J.: Adaptive mesh refinement for hyperbolic partial differential equations. J. Comput. Phys. 53, 484–512 (1984)

    Article  MATH  MathSciNet  Google Scholar 

  8. Cactus Computational Toolkit home page, http://www.cactuscode.org/

  9. Mesh Refinement with Carpet, http://www.carpetcode.org/

  10. Dongarra, J., Bunch, J., Moler, C., Stewart, P.: Linpack, http://www.netlib.org/linpack/index.html

  11. Goodale, T., Allen, G., Lanfermann, G., Massó, J., Radke, T., Seidel, E., Shalf, J.: The Cactus framework and toolkit: Design and applications. In: Palma, J.M.L.M., Sousa, A.A., Dongarra, J., Hernández, V. (eds.) VECPAR 2002. LNCS, vol. 2565. Springer, Heidelberg (2003)

    Google Scholar 

  12. Hierarchical Data Format Version 5 (HDF5) Home Page, http://hdf.ncsa.uiuc.edu/HDF5

  13. HPC challenge benchmark, http://icl.cs.utk.edu/hpcc/

  14. Ott, C.D., Schnetter, E., Allen, G., Seidel, E., Tao, J., Zink, B.: A case study for petascale applications in astrophysics: simulating gamma-ray bursts. In: Ott, C.D., Schnetter, E., Allen, G., Seidel, E., Tao, J., Zink, B. (eds.) MG 2008: Proceedings of the 15th ACM Mardi Gras conference, pp. 1–9. ACM, New York (2008)

    Google Scholar 

  15. Schnetter, E., Hawley, S.H., Hawke, I.: Evolutions in 3D numerical relativity using fixed mesh refinement. Class. Quantum Grav. 21(6), 1465–1488 (2004); eprint gr-qc/0310042

    Article  MATH  MathSciNet  Google Scholar 

  16. Tao, J., Allen, G., Hinder, I., Schnetter, E., Zlochower, Y.: XiRel: Standard Benchmarks for Numerical Relativity Codes Using Cactus and Carpet, Tech. report, Louisiana State University, Baton Rouge, LA 70803 (May 2008)

    Google Scholar 

  17. Whisky, EU Network GR Hydrodynamics Code, http://www.whiskycode.org/

Download references

Author information

Authors and Affiliations

  1. Center for Computation and Technology, Louisiana State University, Baton Rouge, LA, USA

    Frank Löffler, Jian Tao, Gabrielle Allen & Erik Schnetter

  2. Department of Computer Science, Louisiana State University, Baton Rouge, LA, USA

    Gabrielle Allen

  3. Department of Physics and Astronomy, Louisiana State University, Baton Rouge, LA, USA

    Erik Schnetter

Authors
  1. Frank Löffler
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jian Tao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Gabrielle Allen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Erik Schnetter
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. School of Computer Engineering and Science, Shanghai University, 200072, Shanghai, P.R. China

    Wu Zhang  & Weiqin Tong  & 

  2. Schulich School of Engineering, University of Calgary, T2N 1N4, Calgary, AB, Canada

    Zhangxin Chen

  3. Department of Mathematics, University of Wyoming, 1000 University Avenue, 82071-3036, Laramie, WY, USA

    Craig C. Douglas

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Löffler, F., Tao, J., Allen, G., Schnetter, E. (2010). Benchmarking Parallel I/O Performance for a Large Scale Scientific Application on the TeraGrid. In: Zhang, W., Chen, Z., Douglas, C.C., Tong, W. (eds) High Performance Computing and Applications. Lecture Notes in Computer Science, vol 5938. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-11842-5_37

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-11842-5_37

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-11841-8

  • Online ISBN: 978-3-642-11842-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation