Skip to main content

Weighted decoding of linear block codes by solving a system of implicit equations

  • Section II Information Theory, Decoding And Cryptography
  • Conference paper
  • First Online:
Book cover Coding Theory and Applications (Coding Theory 1988)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 388))

Included in the following conference series:

Abstract

Decoding a redundant code, when redefined as a means for estimating a posterior probability distribution given a prior one, has a simple output if one looks for the posterior distribution in a form separable with respect to the information symbols. The optimal distribution of this form results from minimizing its cross-entropy with respect to the prior distribution, which for a linear code leads to a system of implicit analog equations to be solved. This can be done by iteration, but the system has multiple solutions so that determining proper initial values becomes the main difficulty. We interpret any linear code as a kind of product of its parity checks whose successive decodings provide adequate initial values for solving the system, provided the received symbols are reordered by decreasing reliability (except for few inversions in order to keep the generator matrix in systematic form). Simulation results are presented.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. G. BATTAIL, Le Décodage Pondéré en tant que Procédé de Réévaluation d'une Distribution de Probabilité, Colloque "3 journées sur le codage", Cachan, 24–26 nov. 1986; Annales Télécommunic., 42 no 9–10, sep.–oct. 1987, pp. 499–509

    Google Scholar 

  2. S. KULLBACK, Information Theory and Statistics, Wiley, 1959

    Google Scholar 

  3. J.E. SHORE and R.W. JOHNSON, Axiomatic Derivation of the Principle of Maximum Entropy and the Principle of Minimum Cross-Entropy, IEEE Trans. Inf. Th., 26 no 1, jan. 1980, pp. 26–37

    Google Scholar 

  4. G. BATTAIL, J.C. BELFIORE and R. SFEZ, Decoding as a Means of Reestimating a Probability Distribution; Application to an Iterated Product of Parity-Check Codes, IEEE International Symposium on Information Theory, Kobe, Japan, 19–24 june 1988

    Google Scholar 

  5. G. BATTAIL and R. SFEZ, Suboptimum Decoding Using Kullback Principle, Conference IPMU, Urbino, Italy, 4–7 july 1988; Lecture Notes in Computer Science no 313, Springer, 1988, pp. 93–101

    Google Scholar 

  6. G. BATTAIL, Construction explicite de bons codes longs, submitted to the Annales Télécommunic.

    Google Scholar 

  7. P. ELIAS, Error-Free Coding, IRE Trans. on Inf. Th., jan. 1954, pp. 29–37

    Google Scholar 

  8. R.A. SILVERMAN and M. BALSER, Coding for Constant Data Rate Systems — Part I. A New Error-Correcting Code, Proc. IRE, sept. 1954, pp. 1428–1435

    Google Scholar 

  9. G. BATTAIL, Décodage Pondéré Optimal des Codes Linéaires en Blocs I.-Emploi Simplifié du Diagramme du Treillis, Annales Télécommunic., 38 no 11–12, nov.–dec. 1983, pp. 443–459

    Google Scholar 

  10. G. BATTAIL and M. DECOUVELAERE, Décodage par Répliques, Annales Télécommunic., 31 no 11–12, nov.–dec. 1976, pp. 387–404

    Google Scholar 

  11. G. BATTAIL and P. GODLEWSKI, Emploi de Représentations Polynomiales à Plusieurs Indéterminées pour le Décodage des Codes Redondants Linéaires, Annales Télécommunic., 33 no 3–4, mar.–apr. 1978, pp. 74–86

    Google Scholar 

  12. G. BATTAIL, M. DECOUVELAERE and P. GODLEWSKI, Replication Decoding, IEEE Trans. Inf. Th., 25 no 3, may 1979, pp. 332–345

    Article  Google Scholar 

  13. G. BATTAIL and J. FANG, Décodage Pondéré Optimal des Codes Linéaires en Blocs II.-Analyse et Résultats de Simulation, Annales Télécommunic., 41 no 11–12, nov.–dec. 1986, pp. 580–604

    Google Scholar 

  14. J. FANG, G. COHEN, P. GODLEWSKI and G. BATTAIL, Le Décodage Pondéré des Codes Linéaires est NP-complet, Colloque "3 journées sur le codage", Cachan, 24–26 nov. 1986; Lecture Notes in Computer Science no 311, Springer, 1988, pp. 141–149

    Google Scholar 

  15. G. BATTAIL, Décodage par Résolution d'un Système d'Équations Implicites Analogiques, submitted to the Annales Télécommunic.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Gérard Cohen Jacques Wolfmann

Rights and permissions

Reprints and permissions

Copyright information

© 1989 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Battail, G. (1989). Weighted decoding of linear block codes by solving a system of implicit equations. In: Cohen, G., Wolfmann, J. (eds) Coding Theory and Applications. Coding Theory 1988. Lecture Notes in Computer Science, vol 388. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0019852

Download citation

  • DOI: https://doi.org/10.1007/BFb0019852

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-51643-9

  • Online ISBN: 978-3-540-46726-7

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics