Skip to main content
SpringerLink
Log in

Word-Based Compression Methods and Indexing for Text Retrieval Systems

  • Conference paper
  • First Online:
Advances in Databases and Information Systems (ADBIS 1999)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 1691))

Abstarct

In this article we present a new compression method, called WLZW, which is a word-based modication of classic LZW. The modication is similar to the approach used in the HuffWord compression algorithm. The algorithm is two-phase, the compression ratio achieved is fairly good, on average 22%-20% (see [2],[3]). Moreover, the table of words, which is side product of compression, can be used to create full-text index, especially for dynamic text databases. Overhead of the index is good.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • 1. T. C. Bell. et al.: Data Compression in Full-Text Retrieval Systems, Journal of the American Society for Information Science. 44(9), 1993, pp.508–531.

    Article  Google Scholar 

  • 2. J. Dvorský, V. Snášel, J. Pokorný: Word-based Compression Methods for Text Retrieval Systems. Proc. DATASEM'98, Brno 1998

    Google Scholar 

  • 3. J. Dvorský, V. Snášel, J. Pokorný. Word-based Compression Methods for Large Text Documents. Data Compression Conferencs-DCC '99, Snowbird, Utah USA.

    Google Scholar 

  • 4. W. F. Frakes, R. B. Yates Ed.: Information Retrieval, Data Structures & Algorithms. Prentice Hall 1992

    Google Scholar 

  • 5. G. H. Gonnet, R. Beaza-Yates: Handbook of Algorithms and Data Structures. Addison-Wesley Publishing, 1991

    Google Scholar 

  • 6. R. N. Horspool, G. V. Cormack: Construction Word-based Text Compression Algorithms, Proc. 2nd IEEE Data Compression Conference, Snowbird, 1992

    Google Scholar 

  • 7. D. Húsek, M. Krejčí, V. Snášel: Compress methods for Text Databases. Cofax 96, Bratislava. (in Czech)

    Google Scholar 

  • 8. B. Melichar, J. Pokorný: Data Compression. Survey Rep. DC-94-07. Czech Technical University, Praha 1994

    Google Scholar 

  • 9. K. Sayood: Introduction to data compression. Morgan Kaufmann Publishing, 1996

    Google Scholar 

  • 10. D. Salomon: Data Compression, Springer Verlag, 1998

    Google Scholar 

  • 11. T. A. Welch: A Technique for High-Performance Data Compression. IEEE Computer 17, 6, 1984, pp. 8–19

    Article  Google Scholar 

  • 12. I. H. Witten, A. Moffat, T. C. Bell: Managing Gigabytes: Compressing and Indexing Documents and Images. Van Nostrand Reinhold, 1994.

    Google Scholar 

  • 13. J. Ziv, A. Lempel: An universal algorithm for sequential data compression, IEEE transac. on Information Theory, Vol. IT-23,No.3., 1977, pp.337–343

    Article  MathSciNet  Google Scholar 

  • 14. J. Ziv, A. Lempel: Compression of individual sequences via variable-rate coding, IEEE transac. on Information Theory, Vol. IT-24,No.5., 1978, pp.530–536

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Computer Science Department, Palacky University of Olomouc, Tomkova 40, 779 00, Olomouc, Czech Republic

    Jiří Dvorský & Václav Snášel

  2. Department of Software Engineering, Charles University, Malostranske namesti 25, 118 00, Prague, Czech Republic

    Jaroslav Pokorný

Authors
  1. Jiří Dvorský
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jaroslav Pokorný
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Václav Snášel
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Faculty of Economics, Business Administration and Informatics, University of Klagenfurt, Uiversitätsstr. 65-67, 9020, Klagenfurt, Austria

    Johann Eder

  2. Faculty of Electrical Engineering and Computer Science, University of Maribor, Smetanova 17, 2000, Maribor, Slovenia

    Ivan Rozman  & Tatjana Welzer  & 

Rights and permissions

Reprints and permissions

Copyright information

© 1999 Springer-Verlag Heidelberg Berlin

About this paper

Cite this paper

Dvorský, J., Pokorný, J., Snášel, V. (1999). Word-Based Compression Methods and Indexing for Text Retrieval Systems. In: Eder, J., Rozman, I., Welzer, T. (eds) Advances in Databases and Information Systems. ADBIS 1999. Lecture Notes in Computer Science, vol 1691. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-48252-0_6

Download citation

  • DOI: https://doi.org/10.1007/3-540-48252-0_6

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-66485-7

  • Online ISBN: 978-3-540-48252-9

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation