Advertisement

Optimized Data Layout for Spatio-temporal Data in Time Domain Astronomy

  • Jie Yan
  • Ce YuEmail author
  • Chao Sun
  • Zhaohui Shang
  • Yi Hu
  • Jinghua Feng
  • Jizhou Sun
  • Jian Xiao
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10393)

Abstract

Spatio-temporal data is a common data-type in astronomy, and layouts for this data are generally to improve the performance. However, restricted by Antarctic environmental conditions, the energy consumption of the storage system is the most pivotal problem. Traditional storage layout consumes a lot of energy for request execution. In this paper, a new storage layout for the astronomical observation data on Antarctic Dome A is designed, which divides the disk array by the observant sky coverage, stores data according to the space while the traditional storage method stores data chronologically. Then we use the tree-like structure to store the popular data and use the redundant mode to store the cold data. In simulated experiments, this storage layout is applied on the Antarctic storage system, and the average number of disks that needs to be opened at request can be reduced from 23.88 to 2.74, greatly reducing the energy consumption of the request.

Keywords

Data layout Storage Disk array Energy efficient Time domain astronomy Spatio-temporal data 

Notes

Acknowledgments

This work is supported by the National Natural Science Foundation of China (11573019, 61602336), the Joint Research Fund in Astronomy (U1531111) under cooperative agreement between the National Natural Science Foundation of China (NSFC) and Chinese Academy of Sciences (CAS).

References

  1. 1.
    Basak, J., Basak, J., Basak, J., Katz, R.: Data layout for power efficient archival storage systems. In: The Workshop on Power-Aware Computing and Systems, pp. 16–20 (2015)Google Scholar
  2. 2.
    Gong, Z., Lakshminarasimhan, S., Jenkins, J., Kolla, H., Ethier, S., Chen, J., Ross, R., Klasky, S., Samatova, N.F.: Multi-level layout optimization for efficient spatio-temporal queries on isabela-compressed data. In: Parallel & Distributed Processing Symposium, pp. 873–884 (2012)Google Scholar
  3. 3.
    Gurumurthi, S., Sivasubramaniam, A., Kandemir, M., Franke, H.: DRPM: dynamic speed control for power management in server class disks. ACM SIGARCH Comput. Archit. News 31(2), 169–181 (2003)CrossRefGoogle Scholar
  4. 4.
    Huang, H., Hung, W., Kang, G.S.: Fs2: dynamic data replication in free disk space for improving disk performance and energy consumption. In: Twentieth ACM Symposium on Operating Systems Principles, pp. 263–276 (2005)Google Scholar
  5. 5.
    Liu, J., Zheng, J., Li, Y., Sun, Z., Wang, W., Yuan, T.: Hybrid s-raid: an energy-efficient data layout for sequential data storage. J. Comput. Res. Dev. 50(1), 37–48 (2013)Google Scholar
  6. 6.
    Lu, L., Varman, P., Wang, J.: Diskgroup: energy efficient disk layout for raid1 systems. In: International Conference on Networking, Architecture, and Storage, pp. 233–242 (2007)Google Scholar
  7. 7.
  8. 8.
    Shang, Z., Hu, K., Hu, Y., Li, J., Li, J., Liu, Q., Ma, B., Quinn, J.L., Sun, J., Wang, L.: Operation, control, and data system for Antarctic survey telescope (ast3). In: Observatory Operations Strategies Processes & Systems IV. Proceedings of the SPIE, vol. 8448(8), p. 26 (2012)Google Scholar
  9. 9.
    Son, S.W., Chen, G., Kandemir, M.: Disk layout optimization for reducing energy consumption. In: International Conference on Supercomputing, pp. 274–283 (2005)Google Scholar
  10. 10.
    Son, S.W., Kandemir, M.: Energy-aware data prefetching for multi-speed disks. In: Conference on Computing Frontiers, Ischia, Italy, pp. 105–114, May 2006Google Scholar
  11. 11.
  12. 12.
    Yuan, Z., Yu, C., Sun, J., Xiao, J., Wang, J., Shang, Z., Hu, Y.: An energy efficient storage system for astronomical observation data on dome A. In: Wang, G., Zomaya, A., Perez, G.M., Li, K. (eds.) ICA3PP 2015. LNCS, vol. 9531, pp. 33–46. Springer, Cham (2015). doi: 10.1007/978-3-319-27140-8_3 CrossRefGoogle Scholar
  13. 13.
    Zhu, Q., David, F.M., Devaraj, C.F., Li, Z., Zhou, Y., Cao, P.: Reducing energy consumption of disk storage using power-aware cache management. In: International Symposium on High PERFORMANCE Computer Architecture, p. 118 (2004)Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Jie Yan
    • 1
  • Ce Yu
    • 1
    Email author
  • Chao Sun
    • 1
  • Zhaohui Shang
    • 2
  • Yi Hu
    • 2
  • Jinghua Feng
    • 3
  • Jizhou Sun
    • 1
  • Jian Xiao
    • 1
  1. 1.School of Computer Science and TechnologyTianjin UniversityTianjinChina
  2. 2.National Astronomical ObservatoriesCASBeijingChina
  3. 3.National Supercomputer Center in TianjinTianjinChina

Personalised recommendations