Advertisement

An Experimental Study of Data Migration Algorithms

  • Eric Anderson
  • Joe Hall
  • Jason Hartline
  • Michael Hobbs
  • Anna R. Karlin
  • Jared Saia
  • Ram Swaminathan
  • John Wilkes
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2141)

Abstract

The data migration problem is the problem of computing a plan for moving data objects stored on devices in a network from one configuration to another. Load balancing or changing usage patterns might necessitate such a rearrangement of data. In this paper, we consider the case where the objects are fixed-size and the network is complete. We introduce two new data migration algorithms, one of which has provably good bounds. We empirically compare the performance of these new algorithms against similar algorithms from Hall et al. [7] which have better theoretical guarantees and find that in almost all cases, the new algorithms perform better. We also find that both the new algorithms and the ones from Hall et al. perform much better in practice than the theoretical bounds suggest.

Keywords

Random Graph Regular Graph Space Constraint Edge Density Data Migration 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    E. Anderson, J. Hall, J. Hartline, M. Hobbs, A. Karlin, J. Saia, R. Swaminathan, and J. Wilkes. An Experimental Study of Data Migration Algorithms. Technical report, University of Washington, 2001.Google Scholar
  2. 2.
    E. Anderson, M. Hobbs, K. Keeton, S. Spence, M. Uysal, and A. Veitch. Hippodrome: running circles around storage administration. Submitted to Symposium on Operating System Principles, 2001.Google Scholar
  3. 3.
    E. Borowsky, R. Golding, A. Merchant, L. Schreier, E. Shriver, M. Spasojevic, and J. Wilkes. Using attribute-managed storage to achieve QoS. In 5th Intl. Workshop on Quality of Service, Columbia Univ., New York, June 1997.Google Scholar
  4. 4.
    Transaction Processing Performance Council. TPC Benchmark D (Decision Support) Standard Specification Revision 2.1. 1996.Google Scholar
  5. 5.
    B. Gavish and O. R. Liu Sheng. Dynamic file migration in distributed computer systems. Communications of the ACM, 33:177–189, 1990.CrossRefGoogle Scholar
  6. 6.
    I. Golubchik, S. Khuller S. Khanna, R. Thurimella, and A. Zhu. Approximation Algorithms for Data Placement on Parallel Disks. In Proceedings of the Eleventh Annual ACM-SIAM Symposium on Discrete ALgorithms, pages 223–232, 2000.Google Scholar
  7. 7.
    J. Hall, J. Hartline, A. Karlin, J. Saia, and J. Wilkes. On algorithms for efficient data migration. In 12th annual ACM-SIAM Symposium on Discrete Algorithms, 2001.Google Scholar
  8. 8.
    S. Micali and V. Vazirani. V E ) algorithm for finding a maximum matching in general graphs. In 21st Annual Symposium on Foundations of Computer Science, 1980.Google Scholar
  9. 9.
    T. Nishizeki and K. Kashiwagi. On the 1.1 edge-coloring of multigraphs. In SIAM Journal on Discrete Mathematics, volume 3, pages 391–410, 1990.zbMATHCrossRefMathSciNetGoogle Scholar
  10. 10.
    J. Saia. Data Migration with Edge Capacities and Machine Speeds. Technical report, University of Washington, 2001.Google Scholar
  11. 11.
    J. Wolf. The Placement Optimization Problem: a practical solution to the disk file assignment problem. In Proceedings of the ACM SIGMETRICS international conference on Measurement and modeling of computer systems, pages 1–10, 1989.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2001

Authors and Affiliations

  • Eric Anderson
    • 1
  • Joe Hall
    • 2
  • Jason Hartline
    • 2
  • Michael Hobbs
    • 1
  • Anna R. Karlin
    • 2
  • Jared Saia
    • 2
  • Ram Swaminathan
    • 1
  • John Wilkes
    • 1
  1. 1.Storage Systems ProgramHewlett-Packard LaboratoriesPalo Alto
  2. 2.Department of Computer Science and EngineeringUniversity of WashingtonSeattle

Personalised recommendations