Specification and Performance Evaluation of Parallel I/O Interfaces for OpenMP
One of the most severe performance limitations of parallel applications today stems from the performance of I/O operations. Numerous projects have shown, that parallel I/O in combination with parallel file systems can significantly improve the performance of I/O operations. However, as of today there is no support for parallel I/O operations for applications using shared-memory programming models such as OpenMP. This paper introduces parallel I/O interfaces for OpenMP. We discuss the rationale of our design decisions, present the interface specification and a prototype implementation with the OpenUH compiler. We evaluate the performance of our implementation for various benchmarks on different file systems and demonstrate the benefits of the new interfaces.
Unable to display preview. Download preview PDF.
- 2.OpenMP Application Review Board: OpenMP Application Program Interface, Draft 3.0 (October 2007)Google Scholar
- 3.Message Passing Interface Forum: MPI-2.2: Extensions to the Message Passing Interface (September 2009), http://www.mpi-forum.org
- 4.El-Ghazawi, T., Cantonnet, F., Saha, P., Thakur, R., Ross, R., Bonachea, D.: UPC-IO: A Parallel I/O API for UPC. V1.0 (2004)Google Scholar
- 5.Group, H.D.F.: HDF5 Reference Manual. Release 1.6.3, National Center for Supercomputing Application (NCSA), University of Illinois at Urbana-Champaign (September 2004)Google Scholar
- 6.Li, J., Liao, W.K., Choudhary, A., Ross, R., Thakur, R., Gropp, W., Latham, R., Siegel, A., Gallagher, B., Zingale, M.: Parallel netcdf: A high-performance scientific i/o interface. In: Proceedings of the 2003 ACM/IEEE Conference on Supercomputing, SC 2003, pp. 39–49. ACM, New York (2003)CrossRefGoogle Scholar
- 8.Liao, C., Hernandez, O., Chapman, B., Chen, W., Zheng, W.: OpenUH: An optimizing, portable OpenMP compiler. In: 12th Workshop on Compilers for Parallel Computers (January 2006)Google Scholar
- 9.PVFS2 webpage: Parallel Virtual File System, http://www.pvfs.org
- 10.Wong, P., der Wijngaart, R.F.V.: NAS Parallel Benchmarks I/O Version 3.0. Technical Report NAS-03-002, Computer Sciences Corporation, NASA Advanced Supercomputing (NAS) DivisionGoogle Scholar