Abstract
This paper introduces agent-based methodology to build a distributed autonomic storage system infrastructure, and an effectively negotiation mechanism based on agent is applied for data location. We present Availability-based Data Allocation (ADA) algorithm as a data placement strategy to achieve high efficient utilization of storage resources by employing multiple distributed storage resources. We use Bloom filter in each storage device to track the location of data. We present the data lookup strategy that small size of read request is handled directly, and large size of read request is handled by cooperation with storage devices. The performance evaluation shows that the data location mechanism is high available and can work well for heterogeneous autonomic storage systems.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Stoica I, Morris R, Karger D, et al. A Scalable Peer-to-Peer Lookup Service for Internet Applications[C]// Proceedings of the 2001 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications. San Diego: ACM Press, 2001: 149–160.
Hildrum K, Kubiatowicz J, Rao S. Distributed Object Location in a Dynamic Network[C]// Proceedings of the 14th ACM Symposium on Parallel Algorithms and Architectures. Winnipeg: ACM Press, 2002: 41–52.
Castro M, Druschel P, Ganesh A, et al.Security for Structured Peer-to-Peer Overlay Networks[C]// Proceedings of the 5th Symposium on Operating Systems Design and Implementation. Boston: ACM Press, 2002: 299–314.
Bloom B. Space/time Trade-Offs in Hash Coding with Allowable Errors[J]. Communications of the ACM, 1970, 13: 422–426.
Rhea S, Eaton P, Geels D, et al. The OceanStore prototype[C]// Proceedings of the 2nd Conference on File and Storage Technologies. San Francisco: USENIX Association, 2003: 59–72.
Carns P, Ligon III W, Ross R, et al. A Parallel File System for Linux Clusters[C]// Proceedings of the 4th Annual Linux Showcase and Conference. Atlanta: USENIX Association, 2000: 317–327.
Corbett P F, Feltelson D G, Prost J P, et al. Parallel File Systems for the IBM SP Computers[J]. IBM Systems Journal, 1995, 34(2): 222–248.
Frey A, Tannenbaum T, Livny M, et al. Condor-G: A Computation Management Agent for Multi-Institutional Grids [C]// Pro of the 10th IEEE Symposium on High Performance Distributed Computing (HPDC10). San Francisco: IEEE Press, 2001: 7–9.
Brandt S A, Xue L, Miller E L, et al. Efficient Metadata Management in Large Distributed File Systems [C]// Proceedings of the 20th IEEE/11th NASA Goddard Conference on Mass Storage Systems and Technologies. San Diego: IEEE Press, 2003: 290–298.
Schmuck F, Haskin R. A Shared-Disk File System for Large Computing Clusters[C]// Proceedings of the First Conference on File and Storage Technologies. Monterey: USENIX Association, 2002: 231–244.
Author information
Authors and Affiliations
Corresponding author
Additional information
Foundation item: Supported by the National Natural Science Foundation of China (60373088) and the National Key Laboratory Foundation (51484040504 JW0518)
Biography: SU Yong(1975-), male, Ph.D. candidate, Lecturer of Wuhan University of Science and Engineering, research direction: network storage.
Rights and permissions
About this article
Cite this article
Su, Y., Zhou, J., Yu, S. et al. Data location mechanism in agent-based autonomic storage systems. Wuhan Univ. J. of Nat. Sci. 12, 249–254 (2007). https://doi.org/10.1007/s11859-006-0026-0
Received:
Issue Date:
DOI: https://doi.org/10.1007/s11859-006-0026-0