Specification, synchronisation, a verage length

  • Anne Bertrand
Variable Length Coding
Part of the Lecture Notes in Computer Science book series (LNCS, volume 311)


Consider a source providing finite sequences of symbols, zeros and ones in general, into a constrained format dictated by the data processor ; constraints are supposed to be time independant (of particular importance are those specified by a finite list of forbidden blocks of symbols, e.g. upper and lower bounds on runs length of zeros and ones). Factorial extendables languages are an appropriate mathematical model for strings of symbols, and for strings long enough to seem infinite we have to deal with entropy (Shannon) if we want to measure the quantities of information dispatched by the source : the greatest the entropy is, the greatest the information will be ; roughly speaking, the entropy is the exponential growth of the number of strings of n letters enclosed in the strings provided by the source.

A particular case is that of a source sending successive blocks m1, m2, ... randomly chosen in a set X of words on an alphabet A ; we obtain messages of the type m1 m2 ... mn ; we call X a variable length code if a word on X has only one decomposition on X ; if an is the number of words of n letters in X then the entropy of the associated phenomen is equal to log(1/r) where r is the positive real number so that : 1=a1/r+a2/r2+a3/r3+...; if you pick up a block m in the sequence dispatched by the source, the average of its length is (Berstel-Perrin) a=a1/r+2a2/r2+3a3/r3+... who is called the average length of the code ; for a given entropy, the smaller the average length is, the more economic the transmission will be and so we investigate the problem : how to minimize the average length of a code for a given entropy ?


Finite List Small Average Length 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    Blanchard F. and Hansel G.: Systèmes codés. Th. Comp. Sci. 1986.Google Scholar
  2. [2]
    Berstel J. and Perrin D.: Theory of codes, Orlando Academic press 1985.Google Scholar
  3. [3]
    Denker M., Grillenberger C. and Sigmund K.: Ergodic Theory on Compact Spaces; Lectures Notes in Mathematics, Vol. 527 1976.Google Scholar
  4. [4]
    Bertrand-Mathis A. Développements en base θ, répartition modulo un, systèmes codés. Bulletin de la S.M.F. 1968.Google Scholar
  5. [5]
    Shannon C. A Mathematical Theory of Communication, Bell System Tech. 1946.Google Scholar
  6. [6]
    Parry W. On the β-expansions of reals numbers, Acta Math Sci. Hungar. 11, 1960.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1988

Authors and Affiliations

  • Anne Bertrand
    • 1
  1. 1.Université de Bordeaux ITalenceFrance

Personalised recommendations