The Sliding-Window Lempel-Ziv Algorithm is Asymptotically Optimal

  • A. D. Wyner
  • J. Ziv
Part of the The Springer International Series in Engineering and Computer Science book series (SECS, volume 276)

Abstract

The sliding-window version of the Lempel-Ziv data-compression algorithm (sometimes called LZ ‘77) has been thrust into prominence recently. This is the algorithm used in the highly successful “Stacker” program for personal computers. It is also incorporated into Microsoft’s new MS-DOS-6. Although other versions of the Lempel-Ziv algorithm are known to be optimal in the sense that they compress a data-source to its entropy, optimality in this sense has never been demonstrated for this version.

In this paper, we will describe the algorithm, and show that as the “window-size”, a quantity which is related to the memory and complexity of the procedure, goes to infinity, the compression rate approaches the source entropy. The proof is surprisingly general, applying to all finite alphabet stationary ergodic sources.

Keywords

Entropy Prefix 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Referecnes

  1. [1]
    Cover, T. and J. ThomasElements of Information TheoryWiley, New York, 1991.MATHCrossRefGoogle Scholar
  2. [2]
    Gallager, R.Information Theory and Reliable CommunicationWiley, New York, 1968.MATHGoogle Scholar
  3. [3]
    Whiting, D., G. George and G. Ivey, “Data Compression Apparatus and Method”, US Patent No. 5016009, 1991 (Assigned to Stac, Inc.).Google Scholar
  4. [4]
    Wyner, A. D. and J. Ziv, “Some asymptotic properties of the entropy of a stationary ergodic data source with applications to data compression”IEEE Transactions on Information TheoryVol. IT-36, pp. 1250–1258, 1989.MathSciNetCrossRefGoogle Scholar
  5. [5]
    Wyner, A. D. and J. Ziv, “Fixed data base version of the Lempel-Ziv data compression algorithm”IEEE Transactions on Information TheoryVol. IT-37, pp. 878–880, 1991.CrossRefGoogle Scholar
  6. [6]
    Ziv, J. and A. Lempel, “A universal algorithm for sequential data compression”IEEE Transactions on Information TheoryVol. IT-24, pp. 337–343, 1977.MathSciNetCrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 1994

Authors and Affiliations

  • A. D. Wyner
    • 1
  • J. Ziv
    • 2
  1. 1.AT&T Bell LaboratoriesMurray HillUSA
  2. 2.Faculty of Electrical EngineeringTechnion-Israil Institute of TechnologyHaifaIsrael

Personalised recommendations