Abstract
In this paper, we address the problem of dynamic allocation of storage bandwidth to application classes so as to meet their response time requirements. We present an approach based on reinforcement learning to address this problem. We argue that a simple learning-based approach may not be practical since it incurs significant memory and search space overheads. To address this issue, we use application-specific knowledge to design an efficient, practical learning-based technique for dynamic storage bandwidth allocation. Our approach can react to dynamically changing workloads, provide isolation to application classes and is stable under overload. We implement our techniques into the Linux kernel and evaluate it using prototype experimentation and trace-driven simulations. Our results show that (i) the use of learning enables the storage system to reduce the number of QoS violations by a factor of 2.1 and (ii) the implementation overheads of employing such techniques in operating system kernels is small.
This research was supported in part by NSF grants CCR-9984030, ANI-9977635 and EIA- 0080119.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
T. Abdelzaher, K.G Shin and N. Bhatti. Performance Guarantees for Web server End-Systems: AControl Theoretic Approach. IEEE Transactions on Parallel and Distributed Systems. 13(1), January 2002.
G. A. Alvarez et al. Minerva: An Automated Resource Provisioning Tool for Large-scale Storage Systems. ACM Transactions on Computer Systems (to appear). Technical report HPL-2001-139, Hewlett-Packard Labs, June 2001.
E. Anderson et al. Hippodrome: Running Circles Around Storage Administration. In FAST’02, Monterey, CA, pp. 175–188, Jan. 2002.
E. Anderson et al. Ergastulum: An Approach to Solving the Workload and Device Configuration Problem. HP Laboratories SSP technical memo HPL-SSP-2001-05, May 2001.
E. Anderson, R. Swaminathan, A. Veitch, G. A. Alvarez and J. Wilkes. Selecting RAID levels for Disk Arrays. In FAST’02, Monterey, CA, pp. 189–201, January 2002.
M. Aron et al. Scalable Content-aware Request Distribution in Cluster-based Network Servers. Proceedings of the USENIX 2000 Annual Technical Conference, San Diego, CA, June 2000.
P. Barham. A Fresh Approach to File System Quality of Service. In Proceedings of NOSSDAV’ 97, St. Louis, Missouri, pages 119–128, May 1997.
E. Borowsky et al. Capacity planning with phased workloads. In Proceedings of the Workshop on Software and Performance (WOSP’98), Santa Fe, NM, October 1998.
A. Brown, D. Oppenheimer, K. Keeton, R. Thomas, J. Kubiatowicz, and D.A. Patterson. ISTORE: Introspective Storage for Data-Intensive Network Services. In Proceedings of the 7th Workshop on Hot Topics in Operating Systems (HotOS-VII), Rio Rico, Arizona, March 1999.
J. Carlström and E. Nordström. Reinforcement learning for Control of Self-Similar Call Traffic in Broadband Networks. Proceedings of the 16th International Teletraffic Congress, ITC’16, P. Key., D. Smith (eds.), Elsevier Science, Edinburgh, Scotland, 1999.
J. Chase et al. Managing Energy and Server Resources in Hosting Centers. Proceedings of the Eighteenth ACM Symposium on Operating Systems Principles (SOSP), Oct. 2001.
M. Dahlin et al. A Qualitative Analysis of Cache Policies for Scalable Network File Systems. In Proceedings of the ACM SIGMETRICS’ 94, May 1994.
C. Lu, G. A. Alvarez, and J. Wilkes. Aqueduct: Online Data Migration with Performance Guarantees. In FAST’02, Monterey, CA, pp. 219–230, January 2002.
E. Nordström and J. Carlström. A Reinforcement Learning Scheme for Adaptive Link Allocation in ATM Networks. IWANNT’ 95, J. Alspector, T.X. Brown, pp. 88–95, Lawrence Erlbaum, Stockholm, Sweden, 1995.
D.A. Patterson et al. Recovery-Oriented Computing (ROC): Motivation, Definition, Techniques, and Case Studies. UC Berkeley Computer Science Technical Report UCB//CSD-02-1175, March 15, 2002.
P. Pradhan, R. Tewari, S. Sahu, A. Chandra and P. Shenoy. An Observation-based Approach Towards Self-managing Web Servers. In Proceedings of ACM/IEEE Intl Workshop on Quality of Service (IWQoS), Miami Beach, FL, May 2002.
D. Revel, D. McNamee, C. Pu, D. Steere and J. Walpole. Feedback Based Dynamic Proportion Allocation for Disk I/O. Technical Report CSE-99-001, OGI CSE, January 1999.
P. Shenoy and H. Vin. Cello: A Disk Scheduling Framework for Next Generation Operating Systems. In Proceedings of ACM SIGMETRICS’ 98, Madison, WI, pp. 44–55, June, 1998.
S. Singh and D. Bertsekas. Reinforcement Learning for Dynamic Channel Allocation in Cellular Telephone Systems. With D. Bertsekas. In NIPS 10, 1997.
V. Sundaram and P. Shenoy. Bandwidth Allocation in a Self-Managing Multimedia File Server. Proceedings of the Ninth ACM Conference on Multimedia, Ottawa, Canada, Oct. 2001.
R. S. Sutton and AG. Barto. Reinforcement Learning: An Introduction. MITPress, Cambridge, MA.
J. Ward, M. O’Sullivan, T. Shahoumian, and J. Wilkes. Appia: Automatic Storage Area Network Design. In FAST’02, Monterey, CA, pp. 203–217, January 2002.
R. Wijayaratne and A. L. N. Reddy. Providing QoS Guarantees for Disk I/O. Technical Report TAMU-ECE97-02, Department of Electrical Engineering, Texas A&M University, 1997.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Sundaram, V., Shenoy, P. (2003). A Practical Learning-Based Approach for Dynamic Storage Bandwidth Allocation. In: Jeffay, K., Stoica, I., Wehrle, K. (eds) Quality of Service — IWQoS 2003. IWQoS 2003. Lecture Notes in Computer Science, vol 2707. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44884-5_26
Download citation
DOI: https://doi.org/10.1007/3-540-44884-5_26
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40281-7
Online ISBN: 978-3-540-44884-6
eBook Packages: Springer Book Archive