Springer Nature is making SARS-CoV-2 and COVID-19 research free. View research | View latest news | Sign up for updates

Network and device-level impacts: performance and reliability of active I/O storage systems

Abstract

Distributed active storage architectures are designed to offload user-level processing to the peripheral from the host servers. In this paper, we report preliminary investigation on performance and fault recovery designs, as impacted by emerging storage interconnect protocols and state-of-the-art storage devices. Empirical results obtained using validated device-level and interconnect data demonstrate the significance of the said parameters on the overall system performance and reliability.

This is a preview of subscription content, log in to check access.

References

  1. 1.

    Braam P et al (2002) Lustre: A scalable, high- performance file system. Lustre Whitepaper Version 1.0, Cluster File Systems Inc, USA, November 2002

  2. 2.

    Bucy J, Ganger G et al (2003) The DiskSim Simulation Environment Version 3.0 Reference Manual, Technical Report No. CMU-CS-03-102: Carnegie Mellon University, USA, January 2003

  3. 3.

    Chiu S, Choudhary A, Kandemir M (2005) Fault recovery designs for processor-embedded distributed storage architectures with I/O-intensive DB workloads. In: Proceedings of the 22nd IEEE and 13th NASA goddard conference on mass storage systems and technologies (MSST), IEEE, USA, April 2005

  4. 4.

    Chiu S, Liao W, Choudhary A, Kandemir M (2004) Processor-embedded distributed smart disks for I/O-intensive workloads: architectures, performance models and evaluation. J Parallel Distrib Comput (JPDC) 64(3):427–446. Elsevier Inc, USA, March 2004

  5. 5.

    Chiu S, Liao W, Choudhary A (2004) Processor-embedded distributed MEMS-based storage systems for high-performance I/O. In: Proceedings of the 18th international parallel and distributed processing symposium (IPDPS), IEEE, USA, April 2004

  6. 6.

    InfiniBand Trade Association (IBTA) (2001) InfiniBand Architecture Specification Volume 1 Release 1.0.a. IBTA, USA, June 2001

  7. 7.

    Memik G, Kandemir M, Choudhary A (2000) Design and evaluation of smart disk architecture for DSS commercial workloads. In: Proceedings of the international conference on parallel processing (ICPP). IEEE, Taiwan, September 2000

  8. 8.

    Transaction Processing Performance Council (1998) TPC benchmark suites and the TPC soft appendices for TPC-H and TPC-R benchmarks, USA, 1998

  9. 9.

    Compaq Corp, Intel Corp and Microsoft Corp (1997) Virtual interface architecture specification version 1.0, USA, December 1997

Download references

Author information

Correspondence to Steve C. Chiu.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Chiu, S.C., Choudhary, A.N. & Wang, D. Network and device-level impacts: performance and reliability of active I/O storage systems. J Supercomput 41, 163–178 (2007). https://doi.org/10.1007/s11227-006-0028-x

Download citation

Keywords

  • Parallel I/O
  • Distributed storage
  • MEMS
  • Performance analysis
  • InfiniBand