Skip to main content
SpringerLink
Log in

Optimization of Real-Time Coding and Control Policies: Structural and Existence Results

  • Chapter
  • First Online:
Stochastic Networked Control Systems

Part of the book series: Systems & Control: Foundations & Applications ((SCFA))

  • 2329 Accesses

Abstract

This chapter establishes the structure of optimal quantization policies under various information structures for general cost functions. The coverage includes both single decision maker and multiple decision maker formulations, with partial as well as full observation. A dynamic programming approach is presented building on classical results by Witsenhausen, and Walrand and Varaiya. Existence results are established for optimal encoding policies. The chapter also presents optimal solutions for encoders and controllers under quadratic performance measure for linear Gaussian systems controlled over discrete noiseless channels.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Abaya, E.F., Wise, G.L.: Convergence of vector quantizers with applications to optimal quantization. SIAM J. Appl. Math. 44, 183–189 (1984)

    Article  MathSciNet  MATH  Google Scholar 

  2. Anastasopoulos, A.: A sequential transmission scheme for the multiple access channel with noiseless feedback. In: Proceedings of the Annual Allerton Conference on Communications, Control and Computing, Monticello, IL, 2009

    Google Scholar 

  3. Ayanoğlu, E., Gray, R.M.: The design of joint source and channel trellis waveform coders. IEEE Trans. Inf. Theor. 33(6), 855–865 (1987)

    Article  Google Scholar 

  4. Bansal, R., Başar, T.: Solutions to a class of linear-quadratic-Gaussian (LQG) stochastic team problems with nonclassical information. Syst. Control Lett. 9, 125–130 (1987)

    Article  MATH  Google Scholar 

  5. Bao, L., Skoglund, M., Johansson, K.H.: Iterative encoder-controller design for feedback control over noisy channels. IEEE Trans. Autom. Control 57, 265–278 (2011)

    Article  MathSciNet  Google Scholar 

  6. Berger, T.: Multiterminal source coding. In: Lecture Notes presented at the CISM Summer School, Udine, Italy, July 1977

    Google Scholar 

  7. Borkar, V.S.: Probability Theory: An Advanced Course. Springer, New York (1995)

    MATH  Google Scholar 

  8. Borkar, V.S., Mitter, S.K.: LQG control with communication constraints. In: Kailath Festschrift. Kluwer Academic Publishers, Boston (1997)

    Google Scholar 

  9. Borkar, V.S., Mitter, S.K., Tatikonda, S.: Optimal sequential vector quantization of Markov sources. SIAM J. Control Optim. 40, 135–148 (2001)

    Article  MathSciNet  MATH  Google Scholar 

  10. Bross, S., Lapidoth, A.: An improved achievable region for the discrete memoryless two-user multiple-access channel with noiseless feedback. IEEE Trans. Inf. Theor. 51, 811–833 (2005)

    Article  MathSciNet  Google Scholar 

  11. Como, G., Yüksel, S.: On the capacity of memoryless finite state multiple access channels with asymmetric state information at the encoders. IEEE Trans. Inf. Theor. 56, 1267–1273 (2011)

    Article  Google Scholar 

  12. Cover, T.M., Leung, C.S.K.: An achievable rate region for the multiple-access channel with feedback. IEEE Trans. Inf. Theor. 27, 292–298 (1981)

    Article  MathSciNet  MATH  Google Scholar 

  13. Curry, R.E.: Estimation and Control with Quantized Measurements. MIT Press, Cambridge (1969)

    Google Scholar 

  14. Dobrushin, R.L., Tsybakov, B.S.: Information transmission with additional noise. IRE Trans. Inf. Theor. 18, 293–304 (1962)

    Article  Google Scholar 

  15. Ebeid, H., Coleman, T.P.: Source coding with feedforward using the posterior matching scheme. In: Proceedings of the IEEE International Symposium on Information Theory (ISIT), Austin, Texas, USA, 2010

    Google Scholar 

  16. Fine, T.: Optimum mean-square quantization of a noisy input. IEEE Trans. Inf. Theor. 11, 293–294 (1965)

    Article  MATH  Google Scholar 

  17. Fischer, T.R.: Optimal quantized control. IEEE Trans. Autom. Control 27, 996–998 (1982)

    Article  MATH  Google Scholar 

  18. Flynn, T.J., Gray, R.M.: Encoding of correlated observations. IEEE Trans. Inf. Theor. 33, 773–787 (1987)

    Article  MathSciNet  Google Scholar 

  19. Fu, M.: Lack of separation principle for quantized linear quadratic Gaussian control. IEEE Trans. Autom. Control 57, 2385–2390 (2012)

    Article  Google Scholar 

  20. Gabor, G., Szekeres, G., Györfi, Z.: On the Gaarder-Slepian tracking system conjecture. IEEE Trans. Inf. Theor. 37, 1165–1168 (1991)

    Article  MATH  Google Scholar 

  21. Graf, S., Luschgy, H.: Foundations of Quantization for Probability Distributions. Springer, Berlin (2000)

    Book  MATH  Google Scholar 

  22. Graf, S., Luschgy, H.: Quantization for probability measures in the Prokhorov metric. Theor. Probab. Appl. 53, 216–241 (2009)

    Article  MATH  Google Scholar 

  23. Gray, R.M., Boyd, S., Lookabaugh, T.: Low rate distributed quantization of noisy observations. In: Proceedings of the Allerton Conference Communication, Control and Computing, pp. 354–358, 1985

    Google Scholar 

  24. György, A., Linder, T.: Optimal entropy-constrained scalar quantization of a uniform source. IEEE Trans. Inf. Theor. 46, 2704–2711 (2000)

    Article  MATH  Google Scholar 

  25. György, A., Linder, T., Lugosi, G.: Tracking the best quantizer. IEEE Trans. Inf. Theor. 54, 1604–1625 (2008)

    Article  Google Scholar 

  26. Hernandez-Lerma, O., Lasserre, J.: Discrete-Time Markov Control Processes. Springer, New York (1996)

    Book  Google Scholar 

  27. Huang, M., Dey, S.: Dynamic quantizer design for hidden Markov state estimation via multiple sensors with fusion center feedback. IEEE Trans. Signal Process. 54, 2887–2896 (2006)

    Article  Google Scholar 

  28. Kushner, H.J.: Introduction to Stochastic Control Theory. Holt, Rinehart and Winston, New York (1972)

    Google Scholar 

  29. Lewis, J.B., Tou, J.T.: Optimum sampled-data systems with quantized control signals. IEEE Trans. Appl. Ind. 82, 229–233 (1965)

    Article  Google Scholar 

  30. Linder, T., Lugosi, G.: A zero-delay sequential scheme for lossy coding of individual sequences. IEEE Trans. Inf. Theor. 47, 2533–2538 (2001)

    Article  MathSciNet  MATH  Google Scholar 

  31. Linder, T., Zamir, R.: Causal coding of stationary sources and individual sequences with high resolution. IEEE Trans. Inf. Theor. 52, 662–680 (2006)

    Article  MathSciNet  Google Scholar 

  32. Mahajan, A., Teneketzis, D.: On the design of globally optimal communication strategies for real-time noisy communication with noisy feedback. IEEE J. Sel. Areas Commun. 26, 580–595 (2008)

    Article  Google Scholar 

  33. Mahajan, A., Teneketzis, D.: Optimal design of sequential real-time communication systems. IEEE Trans. Inf. Theor. 55, 5317–5338 (2009)

    Article  MathSciNet  Google Scholar 

  34. Mahajan, A., Teneketzis, D.: Optimal performance of networked control systems with non-classical information structures. SIAM J. Control Optim. 48, 1377–1404 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  35. Matveev, A.S., Savkin, A.V.: The problem of LQG optimal control via a limited capacity communication channel. Syst. Control Lett. 53, 51–64 (2004)

    Article  MathSciNet  MATH  Google Scholar 

  36. Nair, G.N., Fagnani, F., Zampieri, S., Evans, J.R.: Feedback control under data constraints: an overview. Proc. IEEE 95, 108–137 (2007)

    Article  Google Scholar 

  37. Nayyar, A., Teneketzis, D.: On the structure of real-time encoders and decoders in a multi-terminal communication system. IEEE Trans. Inf. Theor. 57, 6196–6214 (2011)

    Article  MathSciNet  Google Scholar 

  38. Neuhoff, D.L., Gilbert, R.K.: Causal source codes. IEEE Trans. Inf. Theor. 28, 701–713 (1982)

    Article  MathSciNet  MATH  Google Scholar 

  39. Pollard, D.: Quantization and the method of k-means. IEEE Trans. Inf. Theor. 28, 199–205 (1982)

    Article  MathSciNet  MATH  Google Scholar 

  40. Stettner, L.: Ergodic control of partially observed Markov control processes with equivalent transition probabilities. Applicationes Mathematicae 22, 25–38 (1993)

    MathSciNet  MATH  Google Scholar 

  41. Tatikonda, S., Sahai, A., Mitter, S.: Stochastic linear control over a communication channels. IEEE Trans. Autom. Control 49, 1549–1561 (2004)

    Article  MathSciNet  Google Scholar 

  42. Teneketzis, D.: On the structure of optimal real-time encoders and decoders in noisy communication. IEEE Trans. Inf. Theor. 52, 4017–4035 (2006)

    Article  MathSciNet  Google Scholar 

  43. Veeravalli, V.V., Başar, T., Poor, H.V.: Decentralized sequential detection with a fusion center performing the sequential test. IEEE Trans. Inf. Theor. 39, 433–442 (1993)

    Article  MATH  Google Scholar 

  44. Venkataramanan, R., Pradhan, S.S.: Source coding with feed-forward: Rate-distortion theorems and error exponents for a general source. IEEE Trans. Inf. Theor. 53, 2154–2179 (2007)

    Article  MathSciNet  Google Scholar 

  45. Venkataramanan, R., Pradhan, S.S.: A new achievable rate region for the discrete memoryless multiple-access channel with feedback. In: Proceedings of the IEEE International Symposium on Information Theory (ISIT), Seoul, South Korea, 2009

    Google Scholar 

  46. Walrand, J.C., Varaiya, P.: Causal coding and control of markov chains. Syst. Control Lett. 3, 189–192 (1983)

    Article  MathSciNet  MATH  Google Scholar 

  47. Walrand, J.C., Varaiya, P.: Optimal causal coding-decoding problems. IEEE Trans. Inf. Theor. 19, 814–820 (1983)

    Article  MathSciNet  Google Scholar 

  48. Weissman, T., Merhav, N.: On causal source codes with side information. IEEE Trans. Inf. Theor. 51, 4003–4013 (2005)

    Article  MathSciNet  Google Scholar 

  49. Wernersson, N., Karlsson, J., Skoglund, M.: Distributed quantization over noisy channels. IEEE Trans. Commun. 57, 1693–1700 (2009)

    Article  Google Scholar 

  50. Witsenhausen, H.S.: On the structure of real-time source coders. Bell Syst. Tech. J. 58, 1437–1451 (1979)

    MATH  Google Scholar 

  51. Witsenhausen, H.S.: Indirect rate-distortion problems. IEEE Trans. Inf. Theor. 26, 518–521 (1980)

    Article  MathSciNet  Google Scholar 

  52. Yüksel, S.: On optimal causal coding of partially observed Markov sources under classical and non-classical information structures. In: Proceedings of the IEEE International Symposium on Information Theory, pp. 81–85, Austin, TX, 2010

    Google Scholar 

  53. Yüksel, S.: Jointly optimal LQG quantization and control policies for multi-dimensional linear Gaussian sources. In: Proceedings of the Annual Allerton Conference on Communications, Control and Computing, Monticello, IL, 2012

    Google Scholar 

  54. Yüksel, S.: On optimal causal coding of partially observed Markov sources in single and multi-terminal settings. IEEE Trans. Inf. Theor. 59, 424–437 (2013)

    Article  Google Scholar 

  55. Yüksel, S., Başar, T.: Minimum rate coding for LTI systems over noiseless channels. IEEE Trans. Autom. Control 51(12), 1878–1887 (2006)

    Article  Google Scholar 

  56. Yüksel, S., Başar, T., Meyn, S.P.: Optimal causal quantization of Markov sources with distortion constraints. In: Proceedings of the Information Theory and Applications (ITA) Workshop, UCSD, 2008

    Google Scholar 

  57. Yüksel, S., Linder, T.: On optimal zero-delay quantization of vector Markov sources. Technical Report, Queen’s University

    Google Scholar 

  58. Yüksel, S., Linder, T.: On optimal zero-delay quantization of vector Markov sources. In: Proceedings of the IEEE Conference on Decision and Control, Hawaii, Dec 2012

    Google Scholar 

  59. Yüksel, S., Linder, T.: Optimization and convergence of observation channels in stochastic control. SIAM J. Control Optim. 50, 864–887 (2012)

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Mathematics and Statistics, Queen’s University, Kingston, Ontario, Canada

    Serdar Yüksel

  2. Department of Electrical and Computer Engineering, Coordinated Science Laboratory, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA

    Tamer Başar

Authors
  1. Serdar Yüksel
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tamer Başar
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer Science+Business Media New York

About this chapter

Cite this chapter

Yüksel, S., Başar, T. (2013). Optimization of Real-Time Coding and Control Policies: Structural and Existence Results. In: Stochastic Networked Control Systems. Systems & Control: Foundations & Applications. Birkhäuser, New York, NY. https://doi.org/10.1007/978-1-4614-7085-4_10

Download citation

Publish with us

Policies and ethics

Search

Navigation