Skip to main content

Part of the book series: Systems and Control: Foundations & Applications ((SCFA))

Summary

Varaiya and Walrand found an elegant insight regarding the use of feedback in a causal coding context: While generally useful, feedback becomes useless when the channel is sufficiently symmetric. The goal of this note is to extend this insight to scenarios inspired by sensor networks. Specifically, two such scenarios are considered: a situation with a single sensor but where the source is observed through a noisy channel, and a genuine network scenario where all source and noise distributions are assumed to be Gaussian. For the latter, it is shown that feedback is useless if source and channel bandwidth are equal, but that, if the latter is larger, feedback is strictly useful. Varaiya and Walrand establish their results via dynamic programming arguments. It is unclear to date whether such arguments can be extended to the distributed scenario considered in the present chapter. Instead, our results are established via information-theoretic bounds.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. R. Bansal and T. Başar, Simultaneous design of measurement and control strategies for stochastic systems with feedback, Automatica, 25(5):679–694, 1989.

    Article  MATH  MathSciNet  Google Scholar 

  2. T. Berger, Rate Distortion Theory: A Mathematical Basis for Data Compression, Prentice-Hall, Englewood Cliffs, NJ, 1971.

    Google Scholar 

  3. M.V. Burnashev, Data transmission over a discrete channel with feedback, random transmission time, Problemy Peredachi Informatsii, 12(4):10–30, 1976.

    MATH  MathSciNet  Google Scholar 

  4. T.M. Cover and J.A. Thomas, Elements of Information Theory, Wiley, New York, 1991.

    MATH  Google Scholar 

  5. T.J. Cruise, Achievement of rate-distortion bound over additive white noise channel utilizing a noiseless feedback link, Proc. IEEE (Letters), 55:1102–1103, April 1967.

    Google Scholar 

  6. I. Csiszár and J. Körner, Information Theory: Coding Theory for Discrete Memoryless Systems, Academic Press, New York, 1981.

    Google Scholar 

  7. R.L. Dobrushin and B.S. Tsybakov, Information transmission with additional noise, IRE Transactions on Information Theory, IT-18:S293–S304, 1962.

    Article  Google Scholar 

  8. M. Gastpar, Gaussian multiple access channels under received-power constraints, In Proc. IEEE Information Theory Workshop, San Antonio, TX, October 2004.

    Google Scholar 

  9. M. Gastpar, On capacity under received-signal constraints, In Proc. 42nd Annual Allerton Conference on Communication, Control, and Computing, Monticello, IL, October 2004.

    Google Scholar 

  10. M. Gastpar, On the role of feedback in large sensor networks, In Proc. International Zurich Seminar, Zurich, Switzerland, February 2004.

    Google Scholar 

  11. M. Gastpar and B. Rimoldi, Source-channel communication with feedback, In Proc. 2002 IEEE Information Theory Workshop, Paris, France, April 2003, invited paper.

    Google Scholar 

  12. M. Gastpar, B. Rimoldi, and M. Vetterli, To code, or not to code: Lossy sourcechannel communication revisited, IEEE Transactions on Information Theory, 49(5):1147–1158, May 2003.

    Article  MATH  MathSciNet  Google Scholar 

  13. M. Gastpar and M. Vetterli, Power, spatio-temporal bandwidth, and distortion in large sensor networks, IEEE Journal on Selected Areas in Communications (Special Issue on Self-Organizing Distributive Collaborative Sensor Networks), 2005, in press.

    Google Scholar 

  14. T.J. Goblick, Theoretical limitations on the transmission of data from analog sources, IEEE Transactions on Information Theory, IT-11(4):558–567, October 1965.

    Article  Google Scholar 

  15. T. Kailath, An applications of Shannon’s rate-distortion theory to analog communication over feedback channels, In Proc. Princeton Symposium on System Science, Princeton, NJ, March 1967.

    Google Scholar 

  16. Y. Oohama, The rate-distortion function for the quadratic Gaussian CEO problem, IEEE Transactions on Information Theory, IT-44(3):1057–1070, May 1998.

    Article  MathSciNet  Google Scholar 

  17. L.H. Ozarow, The capacity of the white Gaussian multiple access channel with feedback, IEEE Transactions on Information Theory, IT-30(4):623–629, July 1984.

    Article  MathSciNet  Google Scholar 

  18. J.P.M. Schalkwijk and L.I. Bluestein, Transmission of analog waveforms through channels with feedback, IEEE Transactions on Information Theory, IT-13:617–619, October 1967.

    Article  Google Scholar 

  19. C.E. Shannon, A mathematical theory of communication, Bell Sys. Tech. Journal, 27:379–423, 623–656, 1948.

    MathSciNet  Google Scholar 

  20. P. Varaiya and J.C. Walrand, Optimal causal coding-decoding problems, Systems and Control Letters, 3:189–192, September 1983.

    Article  MATH  MathSciNet  Google Scholar 

  21. J.C. Walrand and P. Varaiya, Optimal causal coding-decoding problems, IEEE Transactions on Information Theory, IT-29(6):814–820, November 1983.

    Article  MathSciNet  Google Scholar 

  22. J. Ziv and M. Zakai, On functionals satisfying a data-processing theorem, IEEE Transactions on Information Theory, IT-19(3):275–283, May 1973.

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Birkhäuser Boston

About this chapter

Cite this chapter

Gastpar, M. (2005). Causal Coding and Feedback in Gaussian Sensor Networks. In: Abed, E.H. (eds) Advances in Control, Communication Networks, and Transportation Systems. Systems and Control: Foundations & Applications. Birkhäuser Boston. https://doi.org/10.1007/0-8176-4409-1_7

Download citation

Publish with us

Policies and ethics