A framework for adaptive storage input/output on computational grids

  • Huseyin Simitci
  • Daniel A. Reed
  • Ryan Fox
  • Mario Medina
  • James Oly
  • Nancy Tran
  • Guoyi Wang
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1586)

Abstract

Emerging computational grids consist of distributed collections of heterogeneous sequential and parallel systems and irregular applications with complex, data dependent execution behavior and time varying resource demands. To provide adaptive input/output resource management for these systems, we are developing PPFS II, a portable parallel file system. PPFS II supports rule-based, closed loop and interactive control of input/output subsystems on both parallel and wide area distributed systems.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Abraham, B., and Ledolter, J.Statistical Method for Forecasting. John Wiley and Sons, 1983.Google Scholar
  2. 2.
    Box, G. E., and Jenkins, G. M.Time Series Analysis Forecasting and Control, 2nd ed. San Francisco: Holden-day, 1976.Google Scholar
  3. 3.
    Chen, P. M., and Patterson, D. A. Maximizing Performance in a Striped Disk Array. In Proceedings of the 17th Annual International Symposium on Computer Architecture (1990), pp. 322–331.Google Scholar
  4. 4.
    Corbett, P. F., Prost, J.-P., Demetriou, C., Gibson, G., Riedel, E., Zelenka, J., Chen, Y., Felten, E., Li, K., Hartman, J., Peterson, L., Bershad, B., Wolman, A., and Aydt, R. Proposal for a Common Parallel File System Programming Interface Version 1.0. http://www.cs.arizona.edu/sio/api1.0.ps, Nov. 1996.Google Scholar
  5. 5.
    Crandall, P. E., Aydt, R. A., Chien, A. A., and Reed, D. A. Characterization of a Suite of Input/Output Intensive Applications. In Proceedings of Supercomputing ’95 (Dec. 1995).Google Scholar
  6. 6.
    Dibble, P. C., Scott, M. L., and Ellis, C. S. Bridge: A High-Performance File System for Parallel Processors. In Proc. 8th Int’l. Conf. on Distr. Computing Sys. (San Jose, CA, jun 1988), pp. 154–161.Google Scholar
  7. 7.
    Foster, I., and Kesselman, C. Globus: A Metacomputing Infrastructure Toolkit. International Journal of Supercomputing Applications and High Performance Computing 11, 2 (Summer 1997), 115–128.Google Scholar
  8. 8.
    Hartman, J. H., and Ousterhout, J. K. The Zebra Striped Network File System. ACM Transactions on Computer Systems 13, 3 (Aug. 1995), 274–310.CrossRefGoogle Scholar
  9. 9.
    Henderson, R. D., and Karniadakis, G. E. Unstructured Spectral Element Methods for Simulation of Turbulent Flows. Journal of Computational Physics 122(2) (1995), 191–217.MATHCrossRefGoogle Scholar
  10. 10.
    Kimbrel, T., Tomkins, A., Patterson, R. H., Bershad, B., Cao, P., Felten, E., Gibson, G., and Karlin, A. R. A Trace-Driven Comparison of Algorithms for Parallel Prefetching and Caching. In Proceedings of the 1996 Symposium on Operating Systems Design and Implementation (1996), pp. 19–34.Google Scholar
  11. 11.
    Madhyastha, T. M., Elford, C. L., and Reed, D. A. Optimizing Input/Output Using Adaptive File System Policies. In Proceedings of the Fifth Goddard Conference on Mass Storage Systems and Technologies (Sept. 1996), pp. II:493–514.Google Scholar
  12. 12.
    Madhyastha, T. M., and Reed, D. A. Intelligent, Adaptive File System Policy Selection. In Proceedings of the Sixth Symposium on the Frontiers of Massively Parallel Computation (Oct 1996), IEEE Computer Society Press, pp. 172–179.Google Scholar
  13. 13.
    Madhyastha, T. M., and Reed, D. A. Exploiting Global Input/Output Access Pattern Classification. In Proceedings of SC ’97: High Performance Computing and Networking (San Jose, Nov. 1997), IEEE Computer Society Press.Google Scholar
  14. 14.
    Madhyastha, T. M., and Reed, D. A. Input/Output Access Pattern Classification Using Hidden Markov Models. In Proceedings of the Fifth Workshop on Input/Output in Parallel and Distributed Systems (San Jose, CA, Nov. 1997), ACM Press, pp. 57–67.Google Scholar
  15. 15.
    Patterson, D., Chen, P., Gibson, G., and Katz, R. H. Introduction to Redundant Arrays of Inexpensive Disks (RAID). In Proceedings of IEEE Compcon (Spring 1989), pp. 112–117.Google Scholar
  16. 16.
    Patterson, R., Gibson, G., Ginting, E., Stodolsky, D., and Zelenka, J. Informed Prefetching and Caching. In Proceedings of the 15th ACM Symposium on Operating Systems Principles, Copper Mountain, CO. (December 1995), pp. 79–95.Google Scholar
  17. 17.
    Reed, D., Aydt, R., Noe, R., Roth, P. C., Shields, K. A., Schwartz, B., and Tavera, L. Scalable Performance Analysis: The Pablo Performance Analysis Environment. In Proceedings of the Scalable Parallel Libraries Conference. IEEE Computer Society (1993), pp. 104–113.Google Scholar
  18. 18.
    Ribler, R. L., Vetter, J. S., Simitci, H., and Reed, D. A. Autopilot: Adaptive Control of Distributed Applications. In Proceedings of HPDC 7 (July 1998).Google Scholar
  19. 19.
    Salem, K., and Garcia-Molina, H. Disk Striping. In Proceedings of the 2ndInternational Conference on Data Engineering (Feb, 1986), ACM, pp. 336–342.Google Scholar
  20. 20.
    Scheuermann, P., Weikum, G., and Zabback, P. Data Partitioning and Load Balancing in Parallel Disk Systems. The VLDB Journal 7, 1 (Feb. 1998), 48–66.CrossRefGoogle Scholar
  21. 21.
    Simitci, H., and Reed, D. A. Adaptive Disk Striping for Parallel Input/Output. In submitted for publication (1999).Google Scholar
  22. 22.
    Smirni, E., and Reed, D. Workload Characterization of Input Output Intensive Parallel Applications. In Proceedings of the Conference on Modelling Techniques and Tools for Computer Performance Evaluation, Springer-Verlag Lecture Notes in Computer Science (June 1997), vol. 1245, pp. 169–180.Google Scholar
  23. 23.
    The MPI-IO Committee. MPI-IO: A Parallel File I/O Interface for MPI, April 1996. Version 0.5.Google Scholar
  24. 24.
    Wei, W. S.Time Series Analysis Univariate and Multivariate Methods. Addison-Wesley, 1990.Google Scholar

Copyright information

© Springer-Verlag 1999

Authors and Affiliations

  • Huseyin Simitci
    • 1
  • Daniel A. Reed
    • 1
  • Ryan Fox
    • 1
  • Mario Medina
    • 1
  • James Oly
    • 1
  • Nancy Tran
    • 1
  • Guoyi Wang
    • 1
  1. 1.Department of Computer ScienceUniversity of IllinoisUrbanaUSA

Personalised recommendations