Advertisement

Motivation and Implementation of a Dynamic Remote Storage System for I/O Demanding HPC Applications

  • Matthias Neuer
  • Jürgen Salk
  • Holger Berger
  • Erich Focht
  • Christian Mosch
  • Karsten Siegmund
  • Volodymyr Kushnarenko
  • Stefan Kombrink
  • Stefan Wesner
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9945)

Abstract

I/O subsystem performance is becoming increasingly important for a wide range of applications. The demand can be met with a large memory capacity or fast local SSDs, but such solutions cause very high investment costs and are rather inflexible. Here, we investigate a multi-tiered approach, combining memory, local SSDs and InfiniBand-attached block storage connected via SRP (SCSI RDMA protocol). Different variants of this hybrid storage system are evaluated, and we present a method to analyze the I/O patterns of applications for choosing the best approach. We also demonstrate the integration of the dynamic remote storage facility into the scheduling system Moab. Our method allows for an on-demand provisioning of multi-tiered file systems of varying sizes, managing storage resources automatically with a broker software.

Keywords

Multi-tiered storage I/O access patterns Block-device cache Logical volume concatenation Job scheduling 

References

  1. 1.
    Zhang, G., Chiu, L., Liu, L.: Adaptive data migration in Multi-tiered storage based cloud environment. In: Proceedings of the IEEE 3rd International Conference on Cloud Computing. IEEE Computer Society (2010)Google Scholar
  2. 2.
    Werner, H.-J., Knowles, P.J., Knizia, G., Manby, F.R., Schütz, M.: Molpro: a general-purpose quantum chemistry program package. Wiley Interdisc. Rev. Comput. Mol. Sci. 2(2), 242–253 (2012)CrossRefGoogle Scholar
  3. 3.
    Byna, S., Chen, Y., Sun, X.-H., Thakur, R., Gropp, W.: Parallel I/O prefetching using MPI file caching and I/O signatures. In: Proceedings of the ACM/IEEE Conference on Supercomputing. IEEE Press, Article 44 (2008)Google Scholar
  4. 4.
  5. 5.
    strace, system call tracer. http://sourceforge.net/projects/strace
  6. 6.
  7. 7.
    FIO: Flexible I/O Tester. https://github.com/axboe/fio
  8. 8.
    Neuer, M., Mosch, C., Salk, J., Siegmund, K., Kushnarenko, V., Kombrink, S., Nau, T., Wesner, S.: Storage systems for I/O-intensive applications in computational chemistry. In: Resch, M.M., Bez, W., Focht, E., Kobayashi, H., Qi, J., Roller, S. (eds.) Sustained Simulation Performance, pp. 51–60. Springer, Heidelberg (2015)Google Scholar
  9. 9.
    Hollowell, C., Hogue, R., Smith, J., Strecker-Kellogg, W., Wong, A., Zaytsev, A.: The effect of flashcache and bcache on I/O performance. J. Phys. Conf. Ser. 513, 2023 (2014)CrossRefGoogle Scholar
  10. 10.
    Sweeney, A., Doucette, D., Hu, W., Anderson, C., Nishimoto, M., Peck, G.: Scalability in the XFS file system. In: Proceedings of the USENIX 1996 Technical Conference, San Diego, CA, USA, pp. 1–14 (1996)Google Scholar
  11. 11.
    Mathur, A., Cao, M., Bhattacharya, S., Dilger, A., Tomas, A., Vivier, L.: The new ext4 filesystem: current status and future plans. In: Proceedings of the Linux Symposium (2007)Google Scholar
  12. 12.
    Schütz, M., Werner, H.-J.: Low-order scaling local electron correlation methods. IV. linear scaling local coupled-cluster (LCCSD). J. Chem. Phys. 114(2), 661–681 (2001)CrossRefGoogle Scholar
  13. 13.
    Holland, M., Gibson, G.A.: Parity declustering for continuous operation in redundant disk arrays. In: Proceeding of the 5th Conference on Architectural Support for Programming Languages and Operating Systems (1992)Google Scholar
  14. 14.
    The Go Programming Language. http://golang.org

Copyright information

© Springer International Publishing AG 2016

Authors and Affiliations

  • Matthias Neuer
    • 1
  • Jürgen Salk
    • 1
  • Holger Berger
    • 2
  • Erich Focht
    • 2
  • Christian Mosch
    • 1
  • Karsten Siegmund
    • 1
  • Volodymyr Kushnarenko
    • 1
  • Stefan Kombrink
    • 1
  • Stefan Wesner
    • 1
  1. 1.Ulm UniversityUlmGermany
  2. 2.NECMunichGermany

Personalised recommendations