Skip to main content
SpringerLink
Log in

Simulation of Hierarchical Storage Systems for TCO and QoS

  • Conference paper
  • First Online:
High Performance Computing (ISC High Performance 2017)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 10524))

Included in the following conference series:

Abstract

Due to the variety of storage technologies deep storage hierarchies turn out to be the most feasible choice to meet performance and cost requirements when handling vast amounts of data. Long-term archives employed by scientific users are mainly reliant on tape storage, as it remains the most cost-efficient option. Archival systems are often loosely integrated into the HPC storage infrastructure. In expectation of exascale systems and in situ analysis also burst buffers will require integration with the archive. Exploring new strategies and developing open software for tape systems is a hurdle due to the lack of affordable storage silos and availability outside of large organizations and due to increased wariness requirements when dealing with ultra-durable data. Lessening these problems by providing virtual storage silos should enable community-driven innovation and enable site operators to add features where they see fit while being able to verify strategies before deploying on production systems. Different models for the individual components in tape systems are developed. The models are then implemented in a prototype simulation using discrete event simulation. The work shows that the simulations can be used to approximate the behavior of tape systems deployed in the real world and to conduct experiments without requiring a physical tape system.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

References

  1. Dashti, A., Shahabi, C.: Data placement techniques for serpentine tapes. In: Proceedings of the 33rd Hawaii International Conference on System Sciences, pp. 1–10 (2000). http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=927005

  2. Dee, R.H.: Magnetic tape for data storage: an enduring technology. Proc. IEEE 96(11), 1775–1785 (2008)

    Article  Google Scholar 

  3. Fontana, R.E., Decad, G.M., Hetzler, S.R.: The impact of areal density and millions of square inches (MSI) of produced memory on petabyte shipments of TAPE, NAND flash, and HDD storage class memories. In: 2013 IEEE 29th Symposium on Mass Storage Systems and Technologies (MSST), pp. 1–8. IEEE (2013). http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=6558421

  4. Hughes, J., Fisher, D., Dehart, K., Wilbanks, B., Alt, J.: HPSS RAIT Architecture. White paper of the HPSS collaboration (2009). http://www.hpss-collaboration.org/documents/HPSS_RAIT_Architecture.pdf

  5. Koltsidas, I., Sarafijanovic, S., Petermann, M., Haustein, N., Seipp, H.: Seamlessly Integrating Disk and Tape in a Multi-tiered Distributed File System, pp. 1328–1339 (2015)

    Google Scholar 

  6. Lingfang Zeng, D.F.: Hybrid RAID-Tape-Library Storage System for Backup. In: Second International Conference on Embedded Software and Systems (ICESS 2005), pp. 31–36 (2005). http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=1609854

  7. Mäsker, M., Nagel, L., Süß, T., Brinkmann, A., Sorth, L.: Simulation and Performance Analysis of the ECMWF Tape Library System. In: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, pp. 22: 1–22: 12. SC 2016, IEEE Press, Piscataway (2016). http://dl.acm.org/citation.cfm?id=3014904.3014934

  8. Pantazi, A., Furrer, S., Rothuizen, H.E., Cherubini, G., Jelitto, J., Lantz, M.A.: Nanoscale track-following for tape storage, pp. 2837–2843 (2015)

    Google Scholar 

  9. Pease, D., Amir, A., Villa Real, L., Biskeborn, B., Richmond, M., Abek, A.: The linear tape file system. In: 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies, MSST2010 4 (2010)

    Google Scholar 

  10. Zhang, X., He, D., Du, D., Lu, Y.: Object placement in parallel tape storage systems. In: Proceedings of the 2006 International Conference on Parallel Processing (ICPP 2006), pp. 0–7 (2006). http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=1690610

Download references

Acknowledgments

This work is part of the ESiWACE project which received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 675191.

Author information

Authors and Affiliations

  1. Deutsches Klimarechenzentrum GmbH, Bundesstraße 45a, 20146, Hamburg, Germany

    Jakob Luettgau & Julian Kunkel

Authors
  1. Jakob Luettgau
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Julian Kunkel
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jakob Luettgau .

Editor information

Editors and Affiliations

  1. Deutsches Klimarechenzentrum (DKRZ), Hamburg, Hamburg, Germany

    Julian M. Kunkel

  2. TITECH, Tokyo, Japan

    Rio Yokota

  3. Department of Computer Science, University of Delaware, Newark, Delaware, USA

    Michela Taufer

  4. Lawrence Berkeley National Laboratory, Berkeley, California, USA

    John Shalf

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Luettgau, J., Kunkel, J. (2017). Simulation of Hierarchical Storage Systems for TCO and QoS. In: Kunkel, J., Yokota, R., Taufer, M., Shalf, J. (eds) High Performance Computing. ISC High Performance 2017. Lecture Notes in Computer Science(), vol 10524. Springer, Cham. https://doi.org/10.1007/978-3-319-67630-2_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-67630-2_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-67629-6

  • Online ISBN: 978-3-319-67630-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation