Succinct Data Structures for Retrieval and Approximate Membership (Extended Abstract)

  • Martin Dietzfelbinger
  • Rasmus Pagh
Conference paper

DOI: 10.1007/978-3-540-70575-8_32

Volume 5125 of the book series Lecture Notes in Computer Science (LNCS)
Cite this paper as:
Dietzfelbinger M., Pagh R. (2008) Succinct Data Structures for Retrieval and Approximate Membership (Extended Abstract). In: Aceto L., Damgård I., Goldberg L.A., Halldórsson M.M., Ingólfsdóttir A., Walukiewicz I. (eds) Automata, Languages and Programming. ICALP 2008. Lecture Notes in Computer Science, vol 5125. Springer, Berlin, Heidelberg

Abstract

The retrieval problem is the problem of associating data with keys in a set. Formally, the data structure must store a function \(f\colon U\to \{0,1\}^r\) that has specified values on the elements of a given set S ⊆ U, |S| = n, but may have any value on elements outside S. All known methods (e. g. those based on perfect hash functions), induce a space overhead of Θ(n) bits over the optimum, regardless of the evaluation time. We show that for any k, query time O(k) can be achieved using space that is within a factor 1 + e− k of optimal, asymptotically for large n. The time to construct the data structure is O(n), expected. If we allow logarithmic evaluation time, the additive overhead can be reduced to O(loglogn) bits whp. A general reduction transfers the results on retrieval into analogous results on approximate membership, a problem traditionally addressed using Bloom filters. Thus we obtain space bounds arbitrarily close to the lower bound for this problem as well. The evaluation procedures of our data structures are extremely simple. For the results stated above we assume free access to fully random hash functions. This assumption can be justified using space o(n) to simulate full randomness on a RAM.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Martin Dietzfelbinger
    • 1
  • Rasmus Pagh
    • 2
  1. 1.Technische Universität IlmenauIlmenauGermany
  2. 2.IT University of CopenhagenKøbenhavn SDenmark