Advertisement

Parallel Access Optimization Technique for Geographic Raster Data

  • Liu Ouyang
  • Jinli Huang
  • Xiaohe Wu
  • Bohu Yu
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 398)

Abstract

In the field of geographic raster data processing, the performance of data access determines the overall performance of the parallel geographic program, especially when data are massive. Currently, the research on parallel optimizations for geographic raster data I/O is quite limited. By combining the data access paradigms in parallel geographic programs with the characteristics of the geographic raster logical and physical models, a parallel access architecture for geographic raster data is proposed in this paper, and four parallel access algorithms for geographic raster data is implemented on message passing model. Contrast tests are carried out, it is verified that the parallel access methods outperform not only the conventional sequential access method but also the time-sharing multi-processes data access method. This new architecture can be used to promote the access efficiency of the parallel raster processing algorithm and thus improve the parallel performance of the program.

Keywords

Geographic raster data Parallel data access Parallel raster processing Message passing model 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Guan, Q.: pRPL: an open-source general-purpose parallel Raster Processing programming Library, pp. 57–62. ACM (2009)Google Scholar
  2. The MPI-IO Committee. MPI-IO: A Parallel File I/O Interface for MPI, Version 0.5 (April 1996), World-Wide Web at http://lovelace.nas.nasa.gov/MPI-IO
  3. Nitzberg, B., Lo, V.: Collective Buffering: Improving Parallel I/O Performance. In: Proceedings of the Sixth IEEE International Symposium on High Performance Distributed Computing, vol. 8, pp. 148–157 (1997)Google Scholar
  4. Thakur, R., et al.: A case for using MPI’s derived datatypes to improve I/O performance, pp. 1–10. Computer Society (1998)Google Scholar
  5. Warmerdam, F.: The geospatial data abstraction library open source approaches in spatial data handling. In: Hall, G.B., Leahy, M.G. (eds.) Open Source Approaches in Spatial Data Handling, pp. 87–104. Springer, Heidelberg (2008)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Liu Ouyang
    • 1
  • Jinli Huang
    • 1
  • Xiaohe Wu
    • 1
  • Bohu Yu
    • 1
  1. 1.Northwest Institute of Nuclear TechnologyXi’anChina

Personalised recommendations