Advertisement

CFIO2: Overlapping Communications and I/O with Computations Using RDMA Technology

  • Cheng Zhang
  • Xiaomeng Huang
  • Yong Hu
  • Shizhen Xu
  • Haohuan Fu
  • Guangwen Yang
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8707)

Abstract

The output data produced by numerical climate model simulations have increased greatly in complexity and size. The exploding volume of climate data is becoming a challenge for climate scientists. Our previous work, Climate Fast Input/Output (CFIO) library, implemented a two-phase I/O method to overlap I/O with computations, and achieved high throughput. In this paper, we present CFIO2, which can overlap communications with computations using Remote Direct Memory Access(RDMA) technology. We design a simple communication interactions model to implement asynchronous and concurrent data transfer. The experimental results show that CFIO2 can provide higher throughput than CFIO and can shorten the overall simulation time for climate model significantly.

References

  1. 1.
    Wang, W., Huang, X., Fu, H., et al.: CFIO: A Fast I/O Library for Climate Models. In: 2013 12th IEEE International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom), pp. 911–918. IEEE (2013)Google Scholar
  2. 2.
    Huang, X., et al.: A fast input/output library for high resolution climate models. Geoscientific Model Development 7(1), 93–103 (2014)CrossRefGoogle Scholar

Copyright information

© IFIP International Federation for Information Processing 2014

Authors and Affiliations

  • Cheng Zhang
    • 1
    • 2
  • Xiaomeng Huang
    • 1
    • 2
  • Yong Hu
    • 1
    • 2
  • Shizhen Xu
    • 1
    • 2
  • Haohuan Fu
    • 1
    • 2
  • Guangwen Yang
    • 1
    • 2
  1. 1.Ministry of Education Key Laboratory for Earth System Modeling, Center for Earth System ScienceTsinghua UniversityChina
  2. 2.Joint Center for Global Change StudiesBeijingChina

Personalised recommendations