Skip to main content

Technology for designing tools for the process and analysis of data from very large scale distributed satellite archives

Abstract

The rapid increase in the volume of Earth satellite observation data over recent years makes more necessary the problem of developing new technologies for effective data search, selection, and processing within very large constantly updated distributed archives. The paper describes the features of such technologies developed at the Space Research Institute, Russian Academy of Sciences (IKI RAS). These techniques provide the design of various data processing tools for satellite data analysis with the use of distributed computing resources of remote sensing data processing and archiving centers. Advantages and capabilities of the approaches suggested are described, as well as examples of implemented tools for distributed processing of data from various satellite remote sensing systems. The examples given show the capabilities of using the tools for the analysis of various atmospheric and ocean surface phenomena.

This is a preview of subscription content, access via your institution.

References

  1. 1.

    E. A. Loupian, V. P. Savorsky, Yu. I. Shokin, A. I. Aleksanin, R. R. Nazirov, I. V. Nedolugko, and O. Yu. Panova, “Up-to-date approaches and technology arrangement of Earth observation data application aimed to solve scientific tasks,” Sovrem. Probl. Distantsionnogo Zondirovaniya Zemli Kosmosa 9 (5), 21–44 (2012).

    Google Scholar 

  2. 2.

    E. A. Loupian, I. V. Balashov, M. A. Burtsev, V. Yu. Efremov, A. V. Kashnitskiy, D. A. Kobets, Yu. S. Krasheninnikova, A. A. Mazurov, R. R. Nazirov, A. A. Proshin, I. G. Sychugov, V. A. Tolpin, I. A. Uvarov, and E. V. Flitman, “Development of information systems design technologies,” Sovrem. Probl. Distantsionnogo Zondirovaniya Zemli Kosmosa 12 (5), 53–75 (2015).

    Google Scholar 

  3. 3.

    A. V. Kashnitskiy, I. V. Balashov, E. A. Loupian, V. A. Tolpin, and I. A. Uvarov, “Development of software tools for the satellite data remote processing in contemporary information systems,” Sovrem. Probl. Distantsionnogo Zondirovaniya Zemli Kosmosa 12 (1), 156–170 (2015).

    Google Scholar 

  4. 4.

    Yu. I. Shokin, N. N. Dobretsov, E. A. Mamash, V. A. Kikhtenko, P. V. Voronina, V. V. Smirnov, and D. L. Chubarov, “An information system for acquisition, processing, and access to satellite data and its applications in environmental monitoring,” Vychis. Tekhnol. 20 (5), 157–174 (2015).

    Google Scholar 

  5. 5.

    I. V. Nedoluzhko, P. V. Babyak, G. V. Tarasov, and V. S. Eremenko, “Infrastructure for receive, distributed processing and delivery of satellite data of Multiple Access Center of Region Satellite Monitoring FEB RAS,” Sovrem. Probl. Distantsionnogo Zondirovaniya Zemli Kosmosa 9 (3), 324–331 (2012).

    Google Scholar 

  6. 6.

    H. K. Ramapriyan, J. Behnke, E. Sofinowski, D. Lowe, and M. A. Esfandiari, “Evolution of the earth observing system (EOS) data and information system (EOSDIS),” in Standard-Based Data and Information Systems for Earth Observation, Ed. by Di Liping and H.K. Ramapriyan (Springer, Berlin; Heidelberg, 2010), pp. 63–92.

    Chapter  Google Scholar 

  7. 7.

    J. G. Acker and G. Leptoukh, “Online analysis enhances use of NASA Earth science data,” Eos. Tran., Am. Geophys. Union 88 (2), 14–17 (2007).

    ADS  Article  Google Scholar 

  8. 8.

    N. Gorelick, “Google Earth Engine,” in EGU General Assembly Conference Abstracts (2013), vol. 15, p. 11997.

    Google Scholar 

  9. 9.

    I. V. Balashov, M. A. Burtsev, V. Yu. Efremov, E. A. Lupyan, A. A. Proshin, and V. A. Tolpin, “Archiving of satellite data processing results for systems of dynamic formation of derivative information products,” Sovrem. Probl. Distantsionnogo Zondirovaniya Zemli Kosmosa 5 (1), 26–32 (2008).

    Google Scholar 

  10. 10.

    V. Yu. Efremov, Yu. S. Krasheninnikova, E. A. Lupyan, A. A. Mazurov, A. A. Proshin, and E. V. Flitman, “Optimized system for storage and representation of geographically references satellite data,” Sovrem. Probl. Distantsionnogo Zondirovaniya Zemli Kosmosa 4 (1), 125–132 (2007).

    Google Scholar 

  11. 11.

    V. A. Tolpin, I. V. Balashov, V. Yu. Efremov, E. A. Lupyan, A. A. Proshin, I. A. Uvarov, and E. V. Flitman, “The GEOSMIS System: Developing interfaces to operate data in modern remote monitoring systems,” Sovrem. Probl. Distantsionnogo Zondirovaniya Zemli Kosmosa 8 (3), 93–108 (2011).

    Google Scholar 

  12. 12.

    M. Neteler, M. H. Bowman, M. Landa, and M. Metz, “GRASS GIS: A Multi-purpose open source GIS,” Environ. Model. Software 31, 124–130 (2012).

    Article  Google Scholar 

  13. 13.

    J. He, Y. Zha, J. Zhang, and J. Gao, “Aerosol indices derived from MODIS data for indicating aerosolinduced air pollution,” Remote Sens. 6 (2), 1587–1604 (2014).

    ADS  Article  Google Scholar 

  14. 14.

    A. Marshak, Y. Knyazikhin, A. B. Davis, W. Wiscombe, and P. Pilewskie, “Cloud–vegetation interaction: Use of normalized difference cloud index for estimation of cloud optical thickness,” Geophys. Rev. Lett. 27 (12), 1695–1698 (2000).

    ADS  Article  Google Scholar 

  15. 15.

    E. Loupian, I. Savin, S. Bartalev, V. Tolpin, I. Balashov, and D. Plotnikov, “Satellite Service for Vegetation Monitoring VEGA,” Sovrem. Probl. Distantsionnogo Zondirovaniya Zemli Kosmosa 8 (1), 190–198 (2011).

    Google Scholar 

  16. 16.

    S. A. Bartalev, D. V. Ershov, G. N. Korovin, R. V. Kotelnikov, E. A. Lupyan, and V. E. Tshetinskii, “The main functionalities and structure of the Forest Fire Satellite Monitoring Information System of Russian Federal Forestry Agency (SMIS-Rosleshoz),” Sovrem. Probl. Distantsionnogo Zondirovaniya Zemli Kosmosa 7 (2), 97–105 (2010).

    Google Scholar 

  17. 17.

    E. A. Loupian, S. A. Bartalev, D. V. Ershov, R. V. Kotel’nikov, I. V. Balashov, M. A. Bourtsev, V. A. Egorov, V. Yu. Efremov, V. O. Zharko, K. A. Kovganko, P. A. Kolbudaev, Yu. S. Krasheninnikova, A. A. Proshin, A. A. Mazurov, I. A. Uvarov, F. V. Stytsenko, I.G. Sychugov, E. V. Flitman, S. A. Khvostikov, and P. P. Shulyak, “Satellite data processing management in Forest Fires Remote Monitoring Information System (ISDM-Rosleskhoz) of the Federal Agency for Forestry,” Sovrem. Probl. Distantsionnogo Zondirovaniya Zemli Kosmosa 12 (5), 222–250 (2015).

    Google Scholar 

  18. 18.

    E. A. Lupyan, O. E. Milekhin, V. N. Antonov, L. S. Kramareva, M. A. Burtsev, I. V. Balashov, V. A. Tolpin, and V. I. Solov’ev, “System of operation of joint information resources based on satellite data in the Planeta Research Centers for Space Hydrometeorology,” Rus. Meteorol. Hydrol. 39 (12), 847–853 (2014).

    Article  Google Scholar 

  19. 19.

    E. A. Loupian, A. A. Matveev, I. A. Uvarov, T. Yu. Bocharova, O. Yu. Lavrova, and M. I. Mityagina, “The Satellite Service See the Sea—a tool for the study of oceanic phenomena and processes,” Sovrem. Probl. Distantsionnogo Zondirovaniya Zemli Kosmosa 9 (2), 251–262 (2012).

    Google Scholar 

  20. 20.

    V. Yu. Efremov, O. A. Girina, L. S. Kramareva, E. A. Loupian, A. G. Manevich, D. V. Melnikov, A.M.Matveev, A. A. Proshin, A. A. Sorokin, and E. V. Flitman, “Creating an Information Service "Remote Monitoring of Active Volcanoes of Kamchatka and the Kuril Islands”,” Sovrem. Probl. Distantsionnogo Zondirovaniya Zemli Kosmosa 9 (5), 155–170 (2012).

    Google Scholar 

  21. 21.

    E. A. Loupian, A. A. Proshin, M. A. Bourtsev, I. V. Balashov, S. A. Bartalev, V. Yu. Efremov, A. V. Kashnitskiy, A. A. Mazurov, A. M. Matveev, O. A. Sydneva, I. G. Sychugov, V. A. Tolpin, and I. A. Uvarov, “IKI center for collective use of satellite data archiving, processing and analysis systems aimed at solving the problems of environmental study and monitoring,” Sovrem. Probl. Distantsionnogo Zondirovaniya Zemli Kosmosa 12 (5), 263–284 (2015).

    Google Scholar 

Download references

Author information

Affiliations

Authors

Corresponding author

Correspondence to A. V. Kashnitskii.

Additional information

Original Russian Text © A.V. Kashnitskii, E.A. Lupyan, I.V. Balashov, A.M. Konstantinova, 2017, published in Optika Atmosfery i Okeana.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Kashnitskii, A.V., Lupyan, E.A., Balashov, I.V. et al. Technology for designing tools for the process and analysis of data from very large scale distributed satellite archives. Atmos Ocean Opt 30, 84–88 (2017). https://doi.org/10.1134/S1024856017010080

Download citation

Keywords

  • remote sensing
  • information systems
  • distributed data processing
  • satellite data processing
  • very large data archives
  • data management technologies
  • ocean and atmosphere remote observation approaches