Skip to main content

A Framework for Coordination in Distributed Stochastic Systems: Output Feedback and Performance Risk Aversion

  • Conference paper
  • First Online:
Dynamics of Information Systems: Algorithmic Approaches

Part of the book series: Springer Proceedings in Mathematics & Statistics ((PROMS,volume 51))

Abstract

This research article considers a class of distributed stochastic systems where interconnected systems closely keep track of reference signals issued by a coordinator. Much of the existing literature concentrates on conducting decisions and control synthesis based solely on expected utilities and averaged performance. However, research in psychology and behavioral decision theory suggests that performance risk plays an important role in shaping preferences in decisions under uncertainty. Thus motivated, a new equilibrium concept, called “person-by-person equilibrium” for local best responses is proposed for analyzing signaling effects and mutual influences between an incumbent system, its coordinator, and immediate neighbors. Individual member objectives are defined by the multi-attribute utility functions that capture both performance expectation and risk measures to model the satisfaction associated with local best responses with risk-averse attitudes. The problem class and approach of coordination control of distributed stochastic systems proposed here are applicable to and exemplified in military organizations and flexibly autonomous systems.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Friedman JW (1990) Game theory with applications to economics. 2nd edn. New York: Oxford University Press

    Google Scholar 

  2. Fudenberg D and Levine DK (1998) The theory of learning in games. Cambridge, MA: MIT Press

    MATH  Google Scholar 

  3. Huang M (2010) Large-population LQG games involving a major player: the Nash certainty equivalence principle. SIAM Journal of Control Optimization, 48(5):3318–3353

    Article  MATH  Google Scholar 

  4. Pham KD (2008) Non-cooperative outcomes for stochastic nash games: decision strategies towards multi-attribute performance robustness. The 17th World Congress International Federation on Automatic Control, pp. 11750–11756

    Google Scholar 

  5. Pham KD (2008) New results in stochastic cooperative games: strategic coordination for multi-resolution performance robustness. In: Hirsch MJ, Pardalos PM, Murphey R, Grundel D (eds.) Optimization and Cooperative Control Strategies. Series Lecture Notes in Control and Information Sciences, Vol. 381, pp. 257–285, Springer Berlin, Heidelberg

    Google Scholar 

  6. Pham KD, Liberty SR and Jin G (2008) Multi-cumulant and Pareto solutions for tactics change prediction and performance analysis in stochastic multi-team non-cooperative games. In: Won C-H, Schrader C and Michel AN (eds.) Advances in statistical control, algebraic systems theory and dynamic systems characteristics. Systems & Control: Foundations and Applications, pp. 65–97. Birkhauser, Boston

    Google Scholar 

  7. Pham KD (2011) Performance-reliability aided decision making in multiperson quadratic decision games against jamming and estimation confrontations. Journal of Optimization Theory and Applications, 149(3):559–629

    Article  MathSciNet  Google Scholar 

  8. Brockett RW (1970) Finite dimensional linear systems. Wiley, New York

    MATH  Google Scholar 

  9. Jacobson DH (1973) Optimal stochastic linear systems with exponential performance criteria and their relation to deterministic games. IEEE Transactions on Automatic Control, 18: 124–131

    Article  MATH  Google Scholar 

  10. Whittle P (1990) Risk sensitive optimal control. John Wiley & Sons, New York

    MATH  Google Scholar 

  11. Fleming WH and Rishel RW (1975) Deterministic and stochastic optimal control. New York: Springer-Verlag

    Book  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Khanh D. Pham .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer Science+Business Media New York

About this paper

Cite this paper

Pham, K.D. (2013). A Framework for Coordination in Distributed Stochastic Systems: Output Feedback and Performance Risk Aversion. In: Sorokin, A., Pardalos, P. (eds) Dynamics of Information Systems: Algorithmic Approaches. Springer Proceedings in Mathematics & Statistics, vol 51. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-7582-8_6

Download citation

Publish with us

Policies and ethics