Simple Load Balancing for Distributed Hash Tables

  • John Byers
  • Jeffrey Considine
  • Michael Mitzenmacher
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2735)

Abstract

Distributed hash tables have recently become a useful building block for a variety of distributed applications. However, current schemes based upon consistent hashing require both considerable implementation complexity and substantial storage overhead to achieve desired load balancing goals. We argue in this paper that these goals can be achieved more simply and more cost-effectively. First, we suggest the direct application of the “power of two choices” paradigm, whereby an item is stored at the less loaded of two (or more) random alternatives. We then consider how associating a small constant number of hash values with a key can naturally be extended to support other load balancing strategies, including load-stealing or load-shedding, as well as providing natural fault-tolerance mechanisms.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • John Byers
    • 1
  • Jeffrey Considine
    • 1
  • Michael Mitzenmacher
    • 2
  1. 1.Department of Computer ScienceBoston UniversityBostonUSA
  2. 2.EECSHarvard UniversityCambridgeUSA

Personalised recommendations