• William F. Schreiber
Part of the Springer Series in Information Sciences book series (SSINF, volume 15)


In this chapter we deal with data compression using methods beyond the optimized sampling and quantization techniques discussed in Chap. 4. After a brief introduction to statistical methods orginally due to Shannon, the special but important case of graphical (two-level) images is presented in some detail, culminating with a treatment of the international standard CCITT system. Continuous-tone coding methods, with emphasis on still monochrome images, are then presented. Emphasis is placed on the importance of using perceptual ideas in the design and analysis of these methods.


Compression Ratio Channel Capacity Block Code Edge Point Entropy Code 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 5.1
    P.A. Wintz: “Transform Picture Coding,” Proc. IEEE 60 (7), 809–820 (1972); see also A.G. Tescher’s article on transform coding in W.K. Pratt (ed.): Image Transmission Techniques (McGraw-Hill, New York 1979CrossRefGoogle Scholar
  2. 5.2
    J.O. Limb, C.R. Rubinstein, J.E. Thompson: “Digital Coding of Color Video Signals — A Review,” IEEE Trans. COM-25 (11), 1349–1385 (1977)CrossRefGoogle Scholar
  3. 5.2a
    R.R. Buckley: “Digital Color Image Coding and the Geometry of Color Space,” Ph.D. Thesis, Massachusetts Institute of Technology, Electrical Engineering and Computer Science Department (1982)Google Scholar
  4. 5.3
    A.N. Netravali, J.D. Robbins: “Motion-Compensated TV Coding”, Bell System Tech. J. 58 (3), 631–670 (1979)zbMATHGoogle Scholar
  5. 5.4
    W.F. Schreiben “Color Reproduction System,” US Patent No. 4,500,919 (1985)Google Scholar
  6. 5.5
    W.-H. Chen, W.K. Pratt: “Scene Adaptive Coder,” IEEE Trans. COM-32 (3), 225–232 (1984)CrossRefGoogle Scholar
  7. 5.6
    C.E. Shannon, W. Weaver The Mathematical Theory of Communication (University of Illinois Press, Urbana 1949). Everyone interested in statistical coding should read Shannon’s landmark paper.zbMATHGoogle Scholar
  8. 5.7
    D.A. Huffman: “A Method for the Construction of Minimum Redundancy Codes,” Proc. IRE 40 (9), 1098–1101 (1952)CrossRefGoogle Scholar
  9. 5.8
    W.F. Schreiben “The Measurement of Third Order Probability Distribution of TV Signals,” IRE Trans. IT-2 (9), 94–105 (1956)Google Scholar
  10. 5.9
    S. Ericsson, E. Dubois: “Digital Coding of High Quality TV,” Paper 3.5, High Definition Television Colloquium, Canadian Dept. of Communications, Ottawa (1985)Google Scholar
  11. 5.10
    D. Bodson, S. Urban, A. Deutermann, C. Clarke: “Measurement of Data Compression in Advanced Group IV Facsimile Systems,” Proc. IEEE 73 (4), 731–739 (1985)CrossRefGoogle Scholar
  12. 5.11
    W.F. Schreiber. “Reproduction of Graphical Data by Facsimile,” Quarterly Progress Report, Research Laboratory of Electronics, Massachusetts Institute of Technology, No. 84 (1967); R.B. Arps, R.L. Erdmann, A.S. Neal, CE. Schlaepfer: “CharacterLegibility Versus Resolution in Image Processing of Printed Matter,” IEEE Trans. MMS-10 (3), 66–71 (1969)Google Scholar
  13. 5.12
    R.N. Ascher, G. Nagy: “A Means for Achieving a High Degree of Compaction on Scan Digitized Printed Test,” IEEE Trans. C-23 (11), 1174–1179 (1974)Google Scholar
  14. 5.12a
    W.K. Pratt, P. Capitani, W. Chen, E. Hamilton, R. Wallis: “Combined Symbol Matching Facsimile Data Compression System,” Proc. IEEE 68 (7), 786–795 (1980)CrossRefGoogle Scholar
  15. 5.13
    D.R. Knudson: US Patent No. 4,281,312 (1981)Google Scholar
  16. 5.14
    S.W. Golomb: “Run Length Encodings,” IEEE Trans. IT-15 (7), 399–400 (1969)Google Scholar
  17. 5.14a
    J. Capon: “A Probabilistic Model for Run-Length Coding of Pictures,” IRE Trans. IT-5 (12), 157–163 (1959)MathSciNetGoogle Scholar
  18. 5.14b
    C.G. Beaudette: “An Efficient Facsimile System for Weather Graphics,” in Proceedings of Symposium on Picture Bandwidth Compression, MIT, ed. by T.S. Huang, O.J. Tretiak (MIT Press, Cambridge, MA 1969) pp. 217–229Google Scholar
  19. 5.14c
    H.G. Mussman, D. Preuss: “Comparison of Redundancy Reducing Codes for Facsimile Transmission of Documents,” IEEE Trans. COM-25 (11), 1425–1433 (1977)CrossRefGoogle Scholar
  20. 5.14d
    T.S. Huang, A.B.S. Hussain: “Facsimile Coding by Skipping White,” IEEE Trans. COM-23 (12), 1452–1460 (1975)CrossRefGoogle Scholar
  21. 5.14e
    T.S. Huang: “Bounds on the Bit Rate of Linear Run-Length Codes,” IEEE Trans. IT-21 (11), 707–708 (1975)Google Scholar
  22. 5.14f
    R.B. Arps: “An Introduction and Digital Facsimile Review,” in Proc. Int. Conf. on Communications Vol. 1 (San Francisco 1975) p. 7. A number of other interesting papers are included in this issueGoogle Scholar
  23. 5.14g
    Kalle Infotec U.K. Ltd.: “Redundancy Reduction Technique for Fast Black and White Facsimile Apparatus,” CCITT Study Group XTV, Temp. Document No. 15 (1975)Google Scholar
  24. 5.14h
    R.B. Arps: “Bibliography of Digital Graphic Image Compression and Quality,” IEEE Trans. IT-20 (1), 120–122 (1974)Google Scholar
  25. 5.15
    M.W. Baldwin: “The Subjective Sharpness of Simulated TV Pictures,” Proc. IRE 28 (10), 458–468 (1940)CrossRefGoogle Scholar
  26. 5.16
    T.S. Huang: “Run Length Coding and its Extensions,” Proceedings of Symposium on Picture Bandwidth Compression, MIT, ed. by T.S. Huang, O.J. Tretiak (MIT Press, Cambridge, MA 1969) pp. 231–264Google Scholar
  27. 5.17
    F. DeCoulon, M. Kunt: “An Alternative to Run Length Coding for Black and White Fascimile,” in Proceedings of TREE InternationalZurich Seminar on Digital Communication, Paper C-4 (1974)Google Scholar
  28. 5.17a
    F. DeCoulon, O. Johnsen: “Adaptive Block Scheme for Source Coding of Black and White Facsimile,” Electron. Lett. 12 (3), 61 (1976)CrossRefGoogle Scholar
  29. 5.18
    R.M. Gray: “Vector Quantization,” IEEE ASSP Mag. 4–29 (April 1984)Google Scholar
  30. 5.19
    W.F. Schreiber, T.S. Huang, O.J. Tretiak: “Contour Coding of Images,” Wescon Technical Papers, paper 8/3, IEEE (1968); also in Picture Bandwidth Compression (Gordon Breach, New York 1972); and in N.S. Jayant (ed.): Waveform Quantization and Coding (IEEE, New York 1976)Google Scholar
  31. 5.19a
    D. Gabor, P.C.J. Hill: “Television Band Compression by Contour Interpolation,” Proc. IEE (England) 108, Part B, 303–315 (1961)Google Scholar
  32. 5.19b
    T.H. Motrin: “Recursive Contour Coding of Nested Objects in Black/White Images,” in Proc. Int. Conf. on Communications, Vol. 1 (San Francisco, 1975) pp. 7–17Google Scholar
  33. 5.20
    P.M J. Coueignoux: “Compression of Type Faces by Contour Coding,” M.S. Thesis, Massachusetts Institute of Technology, Electrical Engineering and Computer Science Department (1973)Google Scholar
  34. 5.21
    D.N. Graham: “Image Transmission by Two-Dimensional Contour Coding,” Ph.D. Thesis, Massachusetts Institute of Technology, ElectricalEngineeringDepartment (1966); also Proc. IEEE 55 (3), 336–346 (1967)Google Scholar
  35. 5.22
    J.W. Pan: “Reduction of Information Redundancy,” Sc.D. Thesis, Massachusetts Institute of Technology, Electrical Engineering Department (1963)Google Scholar
  36. 5.23
    H.S. Hou, H.C. Andrews: “Cubic Splines for Image Interpolation and Digital Filtering,” IEEE Trans. ASSP-26 (4), 508 (1978)Google Scholar
  37. 5.24
    R. Hunter, A.H. Robinson: “International Digital Facsimile Coding Standards,” Proc. IEEE 68 (7), 854–867 (1980)CrossRefGoogle Scholar
  38. 5.25
    J.R. Ellis: Ph.D. Thesis, Massachusetts Institute of Technology, Electrical Engineering and Computer Science Department (1977)Google Scholar
  39. 5.25a
    D. Spencer: M.S. Thesis, Massachusetts Institute of Technology, Electrical Engineering and Computer Science Department (1968)Google Scholar
  40. 5.26
    H. Freeman: “On the Encoding of Arbitrary Geometrical Figures,” IRE Trans. EC-10, 260–268 (1961)MathSciNetGoogle Scholar
  41. 5.26a
    I.T. Young: “TV Bandwidth Compression Using Area Properties,” MS Thesis, Massachusetts Institute of Technology, Electrical Engineering Department (1966)Google Scholar
  42. 5.27
    P. Elias: “Predictive Coding,” IRE Trans. IT-1 (3), 16–32 (1955)Google Scholar
  43. 5.27a
    R.E. Graham: “Predictive Quantization of TV Signals,” Wescon Conv. Record 2 (4), 147–157, IRE (1958)Google Scholar
  44. 5.27b
    W. Zschunke: “DPCM Picture Coding with Adaptive Prediction,” IEEE Trans. COM-25 (11), 1295–1302 (1977)CrossRefGoogle Scholar
  45. 5.27c
    C.M. Harrison: “Experiments with Linear Prediction in TV,” Bell System Tech. J. 31, 764–783 (1952)Google Scholar
  46. 5.28
    L.D. Davisson: “Data Compression Using Straight-Line Interpolation,” IEEE Trans. IT-14 (3), 390–394 (1968)Google Scholar
  47. 5.28a
    A.N. Netravali: “Interpolative Picture Coding Using a Subjective Criterion,” IEEE Trans. COM-25 (5), 503–508 (1977)CrossRefGoogle Scholar
  48. 5.29
    C.C. Cutler: US Patent No.2,605,361 (1952)Google Scholar
  49. 5.29a
    J.B. O’Neal: “Predictive Quantizing System (DPCM) for the Transmission of TV Signals,” Bell System Tech. J. 45, 689–721 (1966)Google Scholar
  50. 5.30
    J. de Jaeger: “Deltamodulation, a Method of PCM Transmission Using a 1-bit Code,” Philips Res. Rep. 7 (6), 442–466 (1952)Google Scholar
  51. 5.31
    J. Max: “Quantizing for Minimum Distortion,” IRE Trans. IT-6 (3), 7–12 (1960)MathSciNetGoogle Scholar
  52. 5.31a
    A.N. Netravali: “On Quantizers for DPCM Coding of TV Signals,” IEEE Trans. IT-23 (3), 360–370 (1977)Google Scholar
  53. 5.31b
    T. Bergen “Optimum Quantizers and Permutation Codes,” IEEE Trans. IT-18 (11), 759–776 (1972)Google Scholar
  54. 5.32
    H.G. Mussman: “Predictive Coding of TV Signals,” in Image Transmission Techniques, ed. by W. Pratt (Academic, New York 1979)Google Scholar
  55. 5.33
    D.K. Sharma, A.N. Netravali: “Design of Quantizers for DPCM Coding of Picture Signals,” IEEE Trans. COM-25 (11), 1267–1274 (1978)Google Scholar
  56. 5.34
    B. Prasada: Private communicationGoogle Scholar
  57. 5.35
    A. Habibi: “Comparison of nth Order DPCM Encoder with Linear Transformations and Block Quantization Techniques,” IEEE Trans. COM-19 (6), 948–956 (1971)CrossRefGoogle Scholar
  58. 5.35a
    D.J. Connor, R.F.W. Pease, W.G. Scholes: “TV Coding Using Two-Dimensional SpatialPrediction,” Bell System Tech. J. 50, 1049–1061 (1971)Google Scholar
  59. 5.36
    P.A. Ratliff: “Digital Coding of the Composite PAL Colour Television System for Transmission at 34 Mbits/sec,” BBC Eng. No. 115, 24–35 (1980)Google Scholar
  60. 5.37
    A. Habibi: “Survey of Adaptive Image Coding Techniques,” IEEE Trans. COM-25 (11), 1257–1284 (1977)Google Scholar
  61. 5.37a
    B. Prasada, A. Netravali: “Adaptive Companding of Picture Signals in a Predictive Coder,” IEEE Trans. COM-26 (1), 161–164 (1978)CrossRefGoogle Scholar
  62. 5.38
    N.S. Jayant: “Adaptive Quantization with a One-Word Memory,” Bell System Tech. J. 52, 1119–1143 (1973)Google Scholar
  63. 5.39
    A.P. Zarembowitch: “Forward Estimation Adaptive DPCM for Image Data Compression,” M.S. Thesis, Massachusetts Institute of Technology, Electrical Engineering and Computer Science Department (1981)Google Scholar
  64. 5.40
    C.C. Cutler: “Delayed Encoding: Stabilizer for Adaptive Coders,” IEEE Trans. COM-19 (6), 898–907 (1971)CrossRefGoogle Scholar
  65. 5.41
    A.N. Netravali, B. Prasada: “Adaptive Quantization of Picture Signals Using Spatial Masking,” Proc. IEEE 65 (4), 536–548 (1977)CrossRefGoogle Scholar
  66. 5.42
    S.K. Goyal, J.B. O’Neal: “Entropy Coded DPCM systems for TV,” IEEE Trans. COM-23 (6), 660–666 (1975)CrossRefGoogle Scholar
  67. 5.43
    E.G. Kimme, F.F. Kuo: “Synthesisof Optimum Filters for a FeedbackQuantizationScheme,” IEEE Trans. CT-10 (9), 405–413 (1963)Google Scholar
  68. 5.44
    W.F. Schreiber, D.E. Troxel: US Patent No. 4,268,861 (1981)Google Scholar
  69. 5.45
    D.E. Troxel: “Application of Pseudorandom Noise to DPCM,” IEEE Trans. COM-29 (12), 1763–1167 (1981)CrossRefGoogle Scholar
  70. 5.46
    E.R. Kretzmer: “Reduced Alphabet Representation of Television Signals,” IRE Nat. Conv. Ree. 4 (4), 140–153 (1956)Google Scholar
  71. 5.47
    W.F. Schreiber, C.F. Knapp, N.D. Kay: “Synthetic Highs, An Experimental TV Bandwidth Reduction System,” J. Soc. Motion Picture Television Eng. 68 (8), 525–537 (1959)Google Scholar
  72. 5.47a
    D.N. Graham, “Image Transmission by Two Dimensional Contour Coding,” Proc. IEEE 55 (3), 336–346 (1967)CrossRefGoogle Scholar
  73. 5.48
    D.E. Troxel, W. Schreiber, P. Curlander, A. Gilkes, R. Grass, G. Hoover: “Image Enhancement/Coding Systems Using Pseudorandom Noise Processing,” Proc. IEEE 67, 972–973 (1979)ADSCrossRefGoogle Scholar
  74. 5.48a
    D.E. Troxel, W.F. Schreiber, R. Grass, G. Hoover, R. Sharpe: “Bandwidth Compression of High Quality Images,” International Conference on Communications, 31.9.1–5, Seattle (1980); also “A Two-Channel Picture Coding System: I — Real-Time Implementation,” IEEE Trans. COM-29 (12), 1841–1848 (1981)Google Scholar
  75. 5.49
    W.F. Schreiber, R.R. Buckley: “A Two-Channel Picture Coding System: II — Adaptive Companding and Color Coding,” IEEE Trans. COM-29 (12), 1849–1858 (1981)CrossRefGoogle Scholar
  76. 5.50
    R.B. Sharpe: “StatisticalCoding of the Highs Channel of a Two-Channel Facsimile System,” M.S. Thesis, Massachusetts Institute of Technology, Electrical Engineering and Computer Science Department (1979)Google Scholar
  77. 5.51
    M. Kocher, M. Kunt: “A Contour-Texture Approach to Picture Coding,” in Proc. ICASSP-2, Paris (IEEE, New York 1982) pp. 436–440Google Scholar
  78. 5.52
    P.J. Burt, E.H. Adelson: “The Laplacian Pyramid as a Compact Image Code,” IEEE Trans. COM-31 (4), 532–540 (1983)CrossRefGoogle Scholar
  79. 5.53
    J. Alnatt: Transmitted-picture Assessment (Wiley, New York 1983)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1993

Authors and Affiliations

  • William F. Schreiber
    • 1
  1. 1.Department of Electrical Engineering and Computer ScienceMassachusetts Institute of TechnologyCambridgeUSA

Personalised recommendations