Information Nonanticipative Rate Distortion Function and Its Applications

  • Photios A. Stavrou
  • Christos K. Kourtellaris
  • Charalambos D. Charalambous
Part of the Lecture Notes in Control and Information Sciences book series (LNCIS, volume 456)


In this chapter, we introduce the information nonanticipative rate distortion function (RDF), and we compare it with the classical information RDF, identifying certain limitations of the later, with respect to nonanticipative or real-time transmission for delay-sensitive applications. Then, we proceed further to describe applications of nonanticipative RDF in (1) joint source-channel coding (JSCC) using nonanticipative (delayless) transmission, and in (2) bounding the optimal performance theoretically attainable (OPTA) by noncausal and causal codes for general sources. Finally, to facilitate the application of the information nonanticipative RDF in computing the aforementioned bounds and in applying it to JSCC based on nonanticipative transmission, we proceed further to present the expression of the optimal reproduction distribution for nonstationary sources.


Source Symbol Average Fidelity Fidelity Constraint Reproduction Sequence Error Exponent 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Berger T (1971) Rate distortion theory: a mathematical basis for data compression. Prentice-Hall, Englewood CliffsGoogle Scholar
  2. 2.
    Neuhoff DL, Gilbert RK (1982) Causal source codes. IEEE Trans Inf Theor 28(5):701–713MathSciNetCrossRefzbMATHGoogle Scholar
  3. 3.
    Charalambous CD, Farhadi A (2008) LQG optimality and separation principle for general discrete time partially observed stochastic systems over finite capacity communication channels. Automatica 44(12):3181–3188Google Scholar
  4. 4.
    Charalambous CD, Kourtellaris CK, Hadjicostis C (2011) Optimal encoder and control strategies in stochastic control subject to rate constraints for channels with memory and feedback. In: 50th IEEE CDC/ECC, 12–15 Dec 2011, pp 4522-â4527Google Scholar
  5. 5.
    Charalambous CD, Stavrou PA (2012) Directed information on abstract spaces: properties and extremum problems. In: IEEE international symposium on information theory (ISIT), Cambridge, MA, USA, 1-â6 Jul 2012, pp 518–522Google Scholar
  6. 6.
    Stavrou PA, Kourtellaris CK, Charalambous CD (2014) Information nonanticipative rate distortion function and its applications. IEEE Trans Inf Theor (submitted) [Online]. Available:
  7. 7.
    Berger T (1977) Explicit bounds to R(D) for a binary symmetric Markov source. IEEE Trans Inf Theor 23(1):52–59Google Scholar
  8. 8.
    Berger T (2003) Living information theory. IEEE Inf Theor Soc Newslett 53(1):6–19Google Scholar
  9. 9.
    Charalambous CD, Stavrou PA, Ahmed NU (2014) Nonanticipative rate distortion function and relations to filtering theory. IEEE Trans Autom Control 59(4):357–352Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Photios A. Stavrou
    • 1
  • Christos K. Kourtellaris
    • 1
  • Charalambos D. Charalambous
    • 1
  1. 1.Department of Electrical and Computer Engineering (ECE)University of CyprusNicosiaCyprus

Personalised recommendations