Advertisement

The VLDB Journal

, Volume 6, Issue 1, pp 26–39 | Cite as

Dictionary-based order-preserving string compression

  • Gennady Antoshenkov

Abstract.

As no database exists without indexes, no index implementation exists without order-preserving key compression, in particular, without prefix and tail compression. However, despite the great potentials of making indexes smaller and faster, application of general compression methods to ordered data sets has advanced very little. This paper demonstrates that the fast dictionary-based methods can be applied to order-preserving compression almost with the same freedom as in the general case. The proposed new technology has the same speed and a compression rate only marginally lower than the traditional order-indifferent dictionary encoding. Procedures for encoding and generating the encode tables are described covering such order-related features as ordered data set restrictions, sensitivity and insensitivity to a character position, and one-symbol encoding of each frequent trailing character sequence. The experimental results presented demonstrate five-folded compression on real-life data sets and twelve-folded compression on Wisconsin benchmark text fields.

Key words:Indexing – Order-preserving key compression 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 1997

Authors and Affiliations

  • Gennady Antoshenkov
    • 1
  1. 1.Oracle Corporation, New England Development Center, 110 Spitbrook Road, Nashua, NH 03062, USA; e-mail: gantoshe@us.oracle.comUS

Personalised recommendations