Skip to main content
SpringerLink
Log in

Data Coding and Image Compression

  • Chapter
  • First Online:
Mixed Raster Content

Part of the book series: Signals and Communication Technology ((SCT))

Abstract

The need for compression of images becomes apparent when one counts the number of bits needed to represent the information content within each image. This Chapter provides an introduction to the realm of data compression and to approaches for image compression.

—The fundamental problem of communication is that of reproducing at one point either exactly or approximately a message selected at another point.

Shannon, Claude

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Shannon used the older spelling ‘Markoff’ for the famous Russian mathematician Andrei Andreyevich Markov.

  2. 2.

    Each new pixel (to the right of the first) represents the difference of its original value and the value of the previous pixel.

  3. 3.

    The prefix condition, which represents a necessary and sufficient condition for the creation of variable length codes, states that no code can be the beginning of another code for the same alphabet.

  4. 4.

    This is a typical symbolism for digital images. Every image consists of a sequence of two-dimensional samples. The parameters x and y represent these two dimensions: \(0 \le x< N_1, 0 \le y < N_2\), \(N_1\) and \(N_2\) being the image dimensions in the horizontal and vertical directions respectively.

  5. 5.

    It should be noted that in this example the transform has been applied once on the total image area, which is not the usual case. Usually, these transforms are being applied in a block-by-block basis, typically of \(8\times 8\) pixels.

  6. 6.

    The green channel was selected because it is easy to follow; the upper left triangular region of the image, which is yelowish is expected to exhibit higher values in this channel than those in the rest of the block, which shows up redish.

  7. 7.

    Again, as in the case of the example given for DCT, the transform has been applied once on the total image area, which is not the usual case; in the usual case the transform is being applied in a block-by-block basis, typically of \(8\times 8\) pixels.

  8. 8.

    A family of special piecewise constant functions assuming only the two values, \(\pm 1\).

  9. 9.

    ‘Famous’ due to its acceptance and usage in image compression applications, like in the Joint Photographic Experts Group 2000 (JPEG2000) image compression standard.

  10. 10.

    It should be noted that the definition of what is ‘favorable’ purely depends on the context.

  11. 11.

    For simplicity, geometric is a distribution sharply concentrated around the mean value with only small values around it being probable (small variance).

  12. 12.

    This MATLAB function can be executed either for a scalar (single) or for a vector input and will respond with the appropriate results.

  13. 13.

    This MATLAB function can be executed either for a scalar (single) or for a vector input and will respond with the appropriate results.

  14. 14.

    This MATLAB function can be executed only for scalar inputs.

  15. 15.

    The term is used metaphorically to denote the ability of a method to adapt to the input data and the exploitation of statistical, spectral or any other inherent redundancies.

  16. 16.

    There is a misunderstanding on this case, as JPEG does not support lossless compression. This mode does not have anything in common with the classical JPEG algorithm and can only support compression rates of about 2:1, using prediction in a causal neighborhood of pixels. It is essentially an entirely different method.

  17. 17.

    The Wang database is accessible at http://wang.ist.psu.edu/docs/related/.

  18. 18.

    These are Tables K.3 and K.4 in the JPEG standard.

  19. 19.

    It should be stressed that the negative values are represented in the twos-complement format. Twos complement representation requires to flip all bits of the absolute value binary representation and then add 1.

  20. 20.

    It is worth noting that there are cases in which it is possible high RMSE values to correspond to visually acceptable quality.

  21. 21.

    In the context of signal processing, a filter bank is a set of band-pass filters, each of which separates an input signal into one single frequency sub-band of the overall spectrum of the original signal. A graphic equalizer is usually referenced as one illustrative example of a filter bank, in which various components of the input signal are being attenuated separately and all components are recombined to form the modified signal at the output. Apparently this process includes two steps, a decomposition or an analysis and a reconstruction or a synthesis step.

  22. 22.

    It is reminded that an adaptive binary arithmetic coder accepts the binary symbols of an input sequence, along with a corresponding probabilistic model, and outputs a codestream with a length of at most two bits greater than the combined ideal lengths of the code of the input symbols. By updating the probability estimate of symbols adaptivity is enabled (Pennebaker et al. 1988).

  23. 23.

    It is noted that this section is provided here purely to illustrate the potential in adopting the JPEG2000 coding strategy and to highlight an example of successful engineering. The system that is described was implemented in a pre-HTML5 era, so the need for all those complementing technologies for client-server communication was imperative. The value of this section is purely illustrative and educative.

  24. 24.

    Remember this was an implementation in an early pre-HTML5 era.

  25. 25.

    Transmission times are reported for a noiseless transmission channel in a guaranteed constant 1 Mbps bandwidth.

References

  • Abramson, N. (1963). Information theory and coding. New York: McGraw-Hill.

    Google Scholar 

  • Albanesi, M., & Bertoluzza, S. (1995). Human vision model and wavelets for high-quality image compression. In Proceedings of the 5th International Conference in Image Processing and its Applications (Vol. 410, pp. 311–315).

    Google Scholar 

  • Bracewell, R. M. (1983). Discrete Hartley transform. Journal of the Optical Society of America, 73(12), 1832–1835.

    Article  Google Scholar 

  • Christopoulos, C., Ebrahimi, T., & Lee, S. U. (2002). JPEG2000 Special Issue. Elsevier Signal Processing: Image Communication 17.

    Google Scholar 

  • Christopoulos, C., Askelof, J., & Larsson, M. (2000a). Efficient methods for encoding regions of interest in the upcoming JPEG2000 still image compression standard. IEEE Signal Processing Letters, 7(9), 247–249.

    Google Scholar 

  • Christopoulos, C., Skodras, A., & Ebrahimi, T. (2000b). The JPEG 2000 still image coding system: An overview. IEEE Transactions on Consumer Electronics, 46(4), 1103–1127.

    Google Scholar 

  • Comer, D. E., & Stevens, D. L. (2000). Internetworking with TCP/IP: Client-Server programming and applications. Prentice Hall. ASIN: B00LKKVXQ4.

    Google Scholar 

  • Cover, T. M., & Thomas, J. A. (2006). Elements of information theory (2nd edn). John Wiley & Sons, ISBN: 978-0-471-24195-9.

    Google Scholar 

  • Cultural & Educational Technology Institute, Greece. (2000a). Ark of Refugee Heirloom—A cultural heritage database—Online.

    Google Scholar 

  • Cultural & Educational Technology Institute, Greece. (2000b). Ark of Refugee Heirloom JPEG2000 prototype.

    Google Scholar 

  • Democritus University of Thrace, Greece. (2000). Thracian Electronic Thesaurus.

    Google Scholar 

  • Deshpande, S., & Zeng, W. (2001). Scalable streaming of JPEG2000 images using hypertext transfer protocol. In Proceedings of ACM (pp. 72–281).

    Google Scholar 

  • Elias, P. (1975). Universal codeword sets and representations of the integers. IEEE Transactions on Information Theory, 21(2), 194–203.

    Article  MathSciNet  MATH  Google Scholar 

  • Fano, R. M. (1949). The transmission of information. Technical report. 65. Research Laboratory of Electronics at MIT.

    Google Scholar 

  • Fano, R. M. (1952). Class notes for Transmission of Information, course 6.574. Technical report. Cambridge, MA: MIT

    Google Scholar 

  • Fisher, R. A. (1922). On the mathematical foundations of theoretical statistics. Philosophical Transactions of the Royal Society, London A, 222, 309–368.

    Article  MATH  Google Scholar 

  • Golomb, S. (1966). Run-length encodings. IEEE Transactions on Information Theory, 12, 399–401.

    Article  MathSciNet  MATH  Google Scholar 

  • Gonzalez, R. C., & Woods, R. E. (1992). Digital image processing (3rd edn). Prentice Hall, ISBN: 978-0201508031.

    Google Scholar 

  • Gray, R., & Neuhoff, D. (1998). Quantization. IEEE Transactions on Information Theory, 44(6).

    Google Scholar 

  • Haar, A. (1910). Zur Theorie der orthogonalen Funktionensysteme. Mathematische Annalen, 69(3), 331–371.

    Article  MathSciNet  MATH  Google Scholar 

  • Hartley, R. V. L. (1928). Transmission of information. Bell System Technical Journal, 7(3), 535–563.

    Article  Google Scholar 

  • Hartley, R. V. L. (1942). A more symmetrical Fourier analysis applied to transmission problems. Proceeding IRE, 30, 144–150.

    Article  MathSciNet  MATH  Google Scholar 

  • Huffman, D. (1952). A method for the construction of minimum redundancy codes. Proceedings IRE, 40, 1098–1101.

    Article  MATH  Google Scholar 

  • Independent JPEG Group, IJG. (2000). JPEG reference software.

    Google Scholar 

  • ISO-IEC. (2000a). Information technology— JPEG 2000 image coding system—Part 1: Core coding system, ISO/IEC International Standard 15444–1. ISO/IEC: Technical report.

    Google Scholar 

  • ISO-IEC-CCITT. (1993b). JPEG: Information Technology—Digital compression and coding of continuous-tone still images—requirements and guidelines, ISO/IEC International Standard, CCITT Recommendation T.81. Technical report. ISO/IEC/CCITT.

    Google Scholar 

  • ISO-IEC-ITU. (2000). JBIG2, ISO/CEI International Standard 14492 and ITU-T Recommendation T.88. Technical report. ISO/IEC/ITU.

    Google Scholar 

  • Jain, K. A. (1988). Fundamentals of digital image processing. New Jersey: Prentice-Hall.

    MATH  Google Scholar 

  • Jones, P., Daly, S., Gaborski, R., & Rabbani, M. (1995). Comparative study of wavelet and DCT decompositions with equivalent quantization and encoding strategies for medical images. In Proceedings of SPIE (Vol. 2431, pp. 571–582).

    Google Scholar 

  • Kang, L. W., & Leou, J. J. (2003). A new error resilient coding scheme for JPEG image transmission based on data embedding and vector quantization. Proceedings of IEEE International Symposium on Circuits and Systems—ISCAS2003 (Vol. 2, pp. 532–535).

    Google Scholar 

  • Kullback, S., & Leibler, R. A. (1951). On information and sufficiency. Annals of Mathematical Statistics, 22, 79–86.

    Article  MathSciNet  MATH  Google Scholar 

  • Lehmann, E. L., & Scheffe, H. (1950). Completeness, similar regions and unbiased estimation. Sankhya, 10, 305–340.

    MathSciNet  MATH  Google Scholar 

  • Liang, J., & Talluri, R. (1999). Tools for robust image and video coding in JPEG2000 and MPEG-4 standards. In Proceedings of the SPIE Visual Communications and Image Processing Conference (Vol. 3653, pp. 40–51).

    Google Scholar 

  • Linde, Y., Buzo, A., & Gray, R. M. (1980). An algorithm for vector quantizer design. IEEE Transactions on Communications, 28(1), 84–95.

    Article  Google Scholar 

  • Lloyd, S. (1982). Least squares quantization in PCM. IEEE Transactions on Information Theory, 28(2), 129–137.

    Article  MathSciNet  MATH  Google Scholar 

  • McMillan, B. (1956). Two inequalities implied by unique decipherability. IEEE Transaction of Information Theory, IT-2, 115–116.

    Google Scholar 

  • Moccagata, I., Sodagar, S., Liang, J., & Chen, H. (2000). Error resilient coding in JPEG2000 and MPEG-4. IEEE Journal of Selected Areas in Communications (JSAC), 18(6), 899–914.

    Article  Google Scholar 

  • Netscape. (1997). Plug-in guide.

    Google Scholar 

  • Ono, F., Kino, S., Yoshida, M., & Kimura, T. (1989). Bi-level image coding with MELCODE—comparison of block type code and arithmetic type code. In Proceedings of IEEE Global Telecommunications Conference (GLOBECOM) (pp. 255–260).

    Google Scholar 

  • O’Rourke, T., & Stevenson, R. (1995). Human visual system based wavelet decomposition for image compression. Journal of Visual Communication and Image Representation, 6, 109–131.

    Article  Google Scholar 

  • Pasco, R. C. (1976). Source coding algorithms for fast data compression. Ph.D. thesis, Stanford University.

    Google Scholar 

  • Pennebaker, W. B., & Mitchell, J. L. (1993). JPEG still image compression standard. New York: Springer.

    Google Scholar 

  • Pennebaker, W. B., Mitchell, J. L., Langdon, G., & Arps, R. B. (1988). An overview of the basic principles of the Q-coder adaptive binary arithmetic coder. IBM Journal of Research and Development, 32(6), 717–726.

    Article  Google Scholar 

  • Politou, E., Tsevremes, I., Tsompanopoulos, A., Pavlidis, G., Kazakis, A., & Chamzas, C. (2002). Ark of refugee heirloom—A cultural heritage database. In EVA 2002: Conference of Electronic Imaging and the Visual Arts (pp. 25–29).

    Google Scholar 

  • Politou, E. A., Pavlidis, G. P., & Chamzas, C. (2004). JPEG2000 and the dissemination of cultural heritage databases over the Internet. IEEE Transactions on Image Processing, 13(3), 293–301.

    Article  Google Scholar 

  • Pratt, W. (1991). Digital image processing (2nd edn). Wiley-Interscience Publication. ISBN: 0-471-85766-1.

    Google Scholar 

  • Rabbani, M., & Cruz, D. Santa. (2001). The JPEG2000 still-image compression standard, tutorial session. In IEEE International Conference on Image Processing—ICIP 2001.

    Google Scholar 

  • Rabbani, M., & Jones, P. W. (1991a). Digital image compression techniques (Vol. TT7). SPIE-Tutorial Texts in Optical Engineering. ISBN: 978-0819406484.

    Google Scholar 

  • Rabbani, M., & Joshi, R. (2002). An overview of the JPEG2000 still image compression standard. Signal Processing: Image Communication, 17(1).

    Google Scholar 

  • Rao, R. M., & Bopardikar, A. S. (1998). Wavelet transforms: Introduction to theory and applications. Prentice Hall. ASIN: B01A65JU7W.

    Google Scholar 

  • Rissanen, J. (1976). Generalized kraft inequality and arithmetic coding of strings. IBM Journal of Research and Development.

    Google Scholar 

  • Rissanen, J. J., & Langdon, G. G. (1979). Arithmetic coding. IBM Journal of Resources and Development, 23(2), 146–162.

    MathSciNet  MATH  Google Scholar 

  • Rubin, F. (1979). Arithmetic stream coding using fixed precision registers. IEEE Transactions on Information Theory, 25(6), 672–675.

    Article  MathSciNet  MATH  Google Scholar 

  • Said, A. (2004). Introduction to arithmetic coding theory and practice. Technical report. Hewlett-Packard Laboratories Report, HPL-2004-76.

    Google Scholar 

  • Said, A., & Pearlman, W. A. (1996). A new fast and efficient image codec based on set partitioning in hierarchical trees. IEEE Transaction on Circuits Systems and Video Technology, 6(3), 243–250.

    Article  Google Scholar 

  • Santa-Cruz, D., & Ebrahimi, T. (2000a). An analytical study of JPEG 2000 functionalities. In Proceedings of IEEE International Conference on Image Processing—ICIP 2000.

    Google Scholar 

  • Santa-Cruz, D., & Ebrahimi, T. (2000b). A study of JPEG 2000 still image coding versus other standards. In Proceedings of X European Signal Processing Conference (Vol. 2, pp. 673–676).

    Google Scholar 

  • Santa-Cruz, D., Ebrahimi, T., Askelof, J., Karsson, M., & Christopoulos, C. A. (2000). JPEG2000 still image coding versus other standards. In Proceedings of SPIE, 45th annual meeting, Applications of Digital Image Processing XXIII (Vol. 4115, pp. 446–454).

    Google Scholar 

  • Sayood, K. (1996). Introduction to data compression. Morgan Kaufmann. ISBN: 978-1558603462.

    Google Scholar 

  • Shannon, C. E. (1948). A mathematical theory of communication. Bell Systems Technology Journal, 27(379–423), 623–656.

    Article  MathSciNet  MATH  Google Scholar 

  • Shapiro, J. M. (1993). Embedded image coding using zero trees of wavelet coefficients. IEEE Transactions on Signal Processing, 41(12), 3445–3462.

    Article  MATH  Google Scholar 

  • Skodras, A., Christopoulos, C., & Ebrahimi, T. (2001). The JPEG 2000 still image compression standard. IEEE Signal Processing Magazine, 36–58.

    Google Scholar 

  • Sullivan, G. (1996). Efficient scalar quantization of exponential and Laplacian variables. IEEE Transactions of Information Theory, 42(5), 1365–1374.

    Article  MATH  Google Scholar 

  • Tanaka, H., & Leon-Garcia, A. (1982). Efficient run-length encodings. IEEE Transactions on Information Theory, 28(November), 880–890.

    Article  MATH  Google Scholar 

  • Taubman, D. S. (2000a). Kakadu Software—A comprehensive framework for JPEG2000.

    Google Scholar 

  • Taubman, D. S. (2000b). High performance scalable image compression with EBCOT. IEEE Transaction on Image Processing, 9(7), 1158–1170.

    Google Scholar 

  • Taubman, D. S. (2002a). Remote browsing of JPEG2000 images. In IEEE International conference on Image Processing—ICIP2002 (pp. 22–25).

    Google Scholar 

  • Taubman, D. S., & Marcellin, M. W. (2002b). JPEG2000 image compression fundamentals, standards and practice. Kluwer Academic Publishers. ASIN: B011DB6NGY.

    Google Scholar 

  • Taubman, D. S., Ordentlich, E., Weinberger, M. J., & Seroussi, G. (2002c). Embedded block coding in JPEG2000. Elsevier Signal Processing: Image Communication, 17(1), 49–72.

    Google Scholar 

  • Wallace, G. (1991). The JPEG still picture compression standard. Communications of the ACM, 34(4), 30–44.

    Article  Google Scholar 

  • Watson, A. B., & Poirson, A. (1986). Separable two-dimensional discrete Hartley transform. Journal of the Optical Society of America A, 3(12), 2001–2004.

    Article  MathSciNet  Google Scholar 

  • Watson, A. B., Yang, G. Y., Solomon, J. A., & Villasenor, J. (1997). Visibility of wavelet quantization noise. IEEE Transactions on Image Processing, 6(8), 1164–1175.

    Article  Google Scholar 

  • Witten, I. H., Neal, R. M., & Cleary, K. G. (1987). Arithmetic coding for data compression. Communications of the ACM, 30(6), 520–540.

    Article  Google Scholar 

  • Ziv, J., & Lempel, A. (1978). Compression of individual sequences via variable-rate coding. IEEE Transactions on Information Theory, 24, 530–536.

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Athena Research Center, University Campus at Kimmeria, GR-67100, Xanthi, Greece

    George Pavlidis

Authors
  1. George Pavlidis
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to George Pavlidis .

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer Nature Singapore Pte Ltd.

About this chapter

Cite this chapter

Pavlidis, G. (2017). Data Coding and Image Compression. In: Mixed Raster Content. Signals and Communication Technology. Springer, Singapore. https://doi.org/10.1007/978-981-10-2830-4_2

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-2830-4_2

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-2829-8

  • Online ISBN: 978-981-10-2830-4

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation