Parallel Access Optimization Technique for Geographic Raster Data
In the field of geographic raster data processing, the performance of data access determines the overall performance of the parallel geographic program, especially when data are massive. Currently, the research on parallel optimizations for geographic raster data I/O is quite limited. By combining the data access paradigms in parallel geographic programs with the characteristics of the geographic raster logical and physical models, a parallel access architecture for geographic raster data is proposed in this paper, and four parallel access algorithms for geographic raster data is implemented on message passing model. Contrast tests are carried out, it is verified that the parallel access methods outperform not only the conventional sequential access method but also the time-sharing multi-processes data access method. This new architecture can be used to promote the access efficiency of the parallel raster processing algorithm and thus improve the parallel performance of the program.
KeywordsGeographic raster data Parallel data access Parallel raster processing Message passing model
Unable to display preview. Download preview PDF.
- Guan, Q.: pRPL: an open-source general-purpose parallel Raster Processing programming Library, pp. 57–62. ACM (2009)Google Scholar
- The MPI-IO Committee. MPI-IO: A Parallel File I/O Interface for MPI, Version 0.5 (April 1996), World-Wide Web at http://lovelace.nas.nasa.gov/MPI-IO
- Nitzberg, B., Lo, V.: Collective Buffering: Improving Parallel I/O Performance. In: Proceedings of the Sixth IEEE International Symposium on High Performance Distributed Computing, vol. 8, pp. 148–157 (1997)Google Scholar
- Thakur, R., et al.: A case for using MPI’s derived datatypes to improve I/O performance, pp. 1–10. Computer Society (1998)Google Scholar