Summary
Varaiya and Walrand found an elegant insight regarding the use of feedback in a causal coding context: While generally useful, feedback becomes useless when the channel is sufficiently symmetric. The goal of this note is to extend this insight to scenarios inspired by sensor networks. Specifically, two such scenarios are considered: a situation with a single sensor but where the source is observed through a noisy channel, and a genuine network scenario where all source and noise distributions are assumed to be Gaussian. For the latter, it is shown that feedback is useless if source and channel bandwidth are equal, but that, if the latter is larger, feedback is strictly useful. Varaiya and Walrand establish their results via dynamic programming arguments. It is unclear to date whether such arguments can be extended to the distributed scenario considered in the present chapter. Instead, our results are established via information-theoretic bounds.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
R. Bansal and T. Başar, Simultaneous design of measurement and control strategies for stochastic systems with feedback, Automatica, 25(5):679–694, 1989.
T. Berger, Rate Distortion Theory: A Mathematical Basis for Data Compression, Prentice-Hall, Englewood Cliffs, NJ, 1971.
M.V. Burnashev, Data transmission over a discrete channel with feedback, random transmission time, Problemy Peredachi Informatsii, 12(4):10–30, 1976.
T.M. Cover and J.A. Thomas, Elements of Information Theory, Wiley, New York, 1991.
T.J. Cruise, Achievement of rate-distortion bound over additive white noise channel utilizing a noiseless feedback link, Proc. IEEE (Letters), 55:1102–1103, April 1967.
I. Csiszár and J. Körner, Information Theory: Coding Theory for Discrete Memoryless Systems, Academic Press, New York, 1981.
R.L. Dobrushin and B.S. Tsybakov, Information transmission with additional noise, IRE Transactions on Information Theory, IT-18:S293–S304, 1962.
M. Gastpar, Gaussian multiple access channels under received-power constraints, In Proc. IEEE Information Theory Workshop, San Antonio, TX, October 2004.
M. Gastpar, On capacity under received-signal constraints, In Proc. 42nd Annual Allerton Conference on Communication, Control, and Computing, Monticello, IL, October 2004.
M. Gastpar, On the role of feedback in large sensor networks, In Proc. International Zurich Seminar, Zurich, Switzerland, February 2004.
M. Gastpar and B. Rimoldi, Source-channel communication with feedback, In Proc. 2002 IEEE Information Theory Workshop, Paris, France, April 2003, invited paper.
M. Gastpar, B. Rimoldi, and M. Vetterli, To code, or not to code: Lossy sourcechannel communication revisited, IEEE Transactions on Information Theory, 49(5):1147–1158, May 2003.
M. Gastpar and M. Vetterli, Power, spatio-temporal bandwidth, and distortion in large sensor networks, IEEE Journal on Selected Areas in Communications (Special Issue on Self-Organizing Distributive Collaborative Sensor Networks), 2005, in press.
T.J. Goblick, Theoretical limitations on the transmission of data from analog sources, IEEE Transactions on Information Theory, IT-11(4):558–567, October 1965.
T. Kailath, An applications of Shannon’s rate-distortion theory to analog communication over feedback channels, In Proc. Princeton Symposium on System Science, Princeton, NJ, March 1967.
Y. Oohama, The rate-distortion function for the quadratic Gaussian CEO problem, IEEE Transactions on Information Theory, IT-44(3):1057–1070, May 1998.
L.H. Ozarow, The capacity of the white Gaussian multiple access channel with feedback, IEEE Transactions on Information Theory, IT-30(4):623–629, July 1984.
J.P.M. Schalkwijk and L.I. Bluestein, Transmission of analog waveforms through channels with feedback, IEEE Transactions on Information Theory, IT-13:617–619, October 1967.
C.E. Shannon, A mathematical theory of communication, Bell Sys. Tech. Journal, 27:379–423, 623–656, 1948.
P. Varaiya and J.C. Walrand, Optimal causal coding-decoding problems, Systems and Control Letters, 3:189–192, September 1983.
J.C. Walrand and P. Varaiya, Optimal causal coding-decoding problems, IEEE Transactions on Information Theory, IT-29(6):814–820, November 1983.
J. Ziv and M. Zakai, On functionals satisfying a data-processing theorem, IEEE Transactions on Information Theory, IT-19(3):275–283, May 1973.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Birkhäuser Boston
About this chapter
Cite this chapter
Gastpar, M. (2005). Causal Coding and Feedback in Gaussian Sensor Networks. In: Abed, E.H. (eds) Advances in Control, Communication Networks, and Transportation Systems. Systems and Control: Foundations & Applications. Birkhäuser Boston. https://doi.org/10.1007/0-8176-4409-1_7
Download citation
DOI: https://doi.org/10.1007/0-8176-4409-1_7
Publisher Name: Birkhäuser Boston
Print ISBN: 978-0-8176-4385-0
Online ISBN: 978-0-8176-4409-3
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)