Skip to main content
SpringerLink
Log in
SpringerLink
Log in

Principles of Coordination

  • Chapter
Learning and Coordination

Part of the book series: Microprocessor-Based and Intelligent Systems Engineering ((ISCA,volume 13))

  • 109 Accesses

Abstract

The effectiveness of a system relates to its ability to fulfill its functional requirements. When a system consists of a set of collaborating agents, the overall performance may depend more on their ability to work together than on optimizing individual behavior. In fact, the goal of an agent is often at odds with the interest of the collective. The limitations of centralized control for complex systems suggest the need for decentralized coordination. This can be achieved by having each agent take explicit account of the cost of engaging in an activity as well as a measure of reward for competent behavior. The consideration of payoffs and penalties leads to an economic perspective of multiagent systems. In consequence, it is possible to draw on previous work in diverse fields, ranging from game theory to welfare economics and social policy. The promise and limitations of the explicit valuation approach are examined. To illustrate, the behavior of collaborative systems can be interpreted in terms of games of strategy; this approach permits a better understanding of the conditions for globally optimal behavior, as well as strategies for their attainment. The notions of agents and explicit valuation of action are versatile concepts. One indication of the versatility lies in the fact that these concepts cover as a special case the idea of genetic algorithms as a mechanism for learning systems.1

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Arrow, K. “Control in Large Organizations.” Management Science, v. 10(3), 1964: 397–408.

    Article  Google Scholar 

  • Arrow, K.J. Social Choice and Individual Values. NY: Wiley, 1951.

    MATH  Google Scholar 

  • Arrow, K.J. and L. Hurwicz. “An Optimality Criterion for Decision Making under Ignorance.” In K.J. Arrow and L. Hurwicz, eds., Studies in Resource Allocation Processes. London: Cambridge Univ. Press, 1977, pp. 463–471.

    Chapter  Google Scholar 

  • Arrow, K.J. and R. Radner. “Allocation of Resources in Large Teams.” Econometrica, v. 47(2), 1979: 361–385.

    Article  MathSciNet  MATH  Google Scholar 

  • Aubin, J.-P. Mathematical Methods of Game and Economic Theory. NY: North-Holland, 1979.

    MATH  Google Scholar 

  • Boettcher, K.L. and A.H. Levis. “Modeling the Interacting Decisionmaker with Bounded Rationality.” IEEE Trans. on Systems, Man and Cybernetics, v. SMC-12(3), May 1982: pp. 334–344.

    Article  Google Scholar 

  • Chang, T.S. and Y.-C. Ho. “Stochastic Stackelberg Games: Nonnested Multistage, Multiagent Incentive Problems.” IEEE Trans. Automatic Control, v. AC-28(4), 1983: 477–488.

    Article  MathSciNet  MATH  Google Scholar 

  • Chow, G.C. Analysis and Control of Dynamic Economic Systems. NY: Wiley, 1975.

    MATH  Google Scholar 

  • Condon, Anne. Computational Models of Games. Cambridge, MA: MIT Press, 1989.

    Google Scholar 

  • DeGroot, M.H. Optimal Statistical Decisions. New York: McGraw-Hill, 1970.

    MATH  Google Scholar 

  • Farley, Arthur M. “A Probabilistic Model for Uncertain Problem Solving.” IEEE Transactions on Systems, Man, and Cybernetics,v. 13(4), 1983, pp. 568–579.

    Article  MathSciNet  Google Scholar 

  • Feldman, A. Welfare Economics and Social Choice Theory. Boston: Martinus Nijhof, 1980.

    Book  Google Scholar 

  • Ferguson, T.S. Mathematical Statistics: A Decision Theoretic Approach. NY: Academic, 1967.

    MATH  Google Scholar 

  • Friedman, J. W. Game Theory with Applications to Economics. NY: Oxford U. Press, 1986.

    Google Scholar 

  • Groves, T. and J. Ledyard. “Optimal Allocation of Public Goods: A Solution to the ‘Free-Rider’ Problem.” Econometrica, v. 45(4), 1977: 783–809.

    Article  MathSciNet  MATH  Google Scholar 

  • Groves T. and M. Loeb. “Incentives in a Divisionalized Firm.” Management Science, v. 25(3), 1979: 221–230.

    Article  MATH  Google Scholar 

  • Holland, J.H. Adaptation in Natural and Artificial Systems. Ann Arbor, MI: Univ. Michigan Press, 1975.

    Google Scholar 

  • Holland, J.H. Escaping brittleness: the possibilities of general-purpose learning algorithms applied to parallel rule-based systems. In R.S. Michalski et al., eds., Machine Learning: An Artificial Intelligence Approach, v. II Los Altos, CA: M. Kaufmann, 1986: 593–624.

    Google Scholar 

  • Holland, J.H. and J.S. Reitman. Cognitive systems based on adaptive algorithms. In D.A. Waterman and F. Hayes-Roth, eds., Pattern-Directed Inference Systems,NY: Academic, 1978: pp. 313–329.

    Google Scholar 

  • Ichiishi, Tatsuro. Game Theory for Economic Analysis. NY: Academic, 1983.

    MATH  Google Scholar 

  • Karlin, S. Mathematical Methods and Theory in Games, Programming,and Economics, Vols. 1 and 2. Reading, MA: Addison - Wesley, 1959.

    Google Scholar 

  • Kim, S.H. Mathematical foundations of manufacturing science: theory and implications. Ph.D. thesis, M.I.T., May 1985.

    Google Scholar 

  • Kim, S.H. A mathematical framework for intelligent manufacturing systems. Proc. of Symposium on Integrated and Intelligent Manufacturing Systems, ASME, Anaheim, CA, Dec., 1986, pp. 1–8.

    Google Scholar 

  • Kim, S.H., “Difficult Problems and Creative Solutions”, International J. of Computer Applications in Technology, v. 2(3), 1989: 171–185.

    Google Scholar 

  • Kim, S.H. Designing Intelligence: A Framework for Smart Systems. NY: Oxford University Press, 1990.

    Google Scholar 

  • Kim, S.H. “Coordination of Multiagent Systems through Explicit Valuation of Action.” Robotics and Computer-Integrated Manufacturing,v. 8(4), 1991, pp. 265–291.

    Article  Google Scholar 

  • Kim, S.H. and N.P. Suh. Mathematical foundations for manufacturing. J. Engineering for Industry, v. 109(3), 1987: 213–218.

    Article  Google Scholar 

  • Kohonen, T. Self-Organization and Associative Memory. NY: Springer-Verlag, 1984.

    MATH  Google Scholar 

  • Kompass, E.J. and T.J. Williams, eds. Learning Systems and Pattern Recognition. Barrington, IL: Technical Pub., 1983.

    Google Scholar 

  • Lasdon, L.S. Optimization Theory for Large Systems. NY: Macmillan, 1970.

    MATH  Google Scholar 

  • Marschak, J. “Elements for a Theory of Teams.” Management Science, v. 1(2), 1955: 127–137.

    Article  MathSciNet  MATH  Google Scholar 

  • Marschak, J. and R. Radner. Economic Theory of Teams. New Haven, CN: Yale Univ. Press, 1972.

    Google Scholar 

  • McKinsey, J. Introduction to the Theory of Games. NY: McGraw-Hill, 1952.

    MATH  Google Scholar 

  • Mendel, J.M. and K.S. Fu, eds. Adaptive, Learning and Pattern Recognition Systems. NY: Academic Press, 1970.

    Google Scholar 

  • Minsky, M.L. Computation: Finite and Infinite Machines. Englewood Cliffs, NJ: Prentice-Hall, 1967.

    MATH  Google Scholar 

  • Narendra, K.S. and M.A.L. Thathachar. Learning automata--a surveyIEEE Trans. SMC, v. SMC- (4), July 1974: 323–334.

    MathSciNet  MATH  Google Scholar 

  • Nof, S.Y. “Game Theoristic Models for Planning Cooperative Robotic Work.” Proc. NSF Design and Manufacturing Systems Conf., Austin, TX, Jan. 1991.

    Google Scholar 

  • Owen, Guillermo. Game Theory, 2nd ed. NY: Academic, 1982.

    MATH  Google Scholar 

  • Pearl, Judea. Probabilistic Reasoning in Intelligent Systems. San Mateo, CA: M. Kaufmann, 1988.

    Google Scholar 

  • Radner, R. “Team Decision Problems.” Annals of Mathematical Statistics, v. 33(3), 1962: 857–881.

    Article  MathSciNet  MATH  Google Scholar 

  • Rajan, V.N. and S.Y. Nof. “A Game-Theoristic Approach for Co-operation Control in Multi-Machine Workstations.” Int. J. Computer Integrated Manufacturing v. 3(1), 1990: 47–59.

    Article  Google Scholar 

  • Rasmusen, E. Games and Information. NY: Basil Blackwell, 1989.

    MATH  Google Scholar 

  • Sen, A.K. “Social Choice Theory.” In K.J. Arrow and M.D. Intrilligator, eds., Handbook of Mathematical Economics,NY: Elsevier, 1986: 1073–1181.

    Google Scholar 

  • Sen, A. and P.K. Pattanaik. “Necessary and Sufficient Conditions for Rational Choice under Majority Decision.” J. of Economic Theory,v. 1, 1969: 178–202.

    Article  MathSciNet  Google Scholar 

  • Shannon C.E. ‘The Mathematical Theory of Communication,“ Bell System Tech. J., vol.27, 1948, pp. 379–423, 623–656.

    Google Scholar 

  • Shannon C.E. and W. Weaver. The Mathematical Theory of Communication. Urbana, IL: U.of Illinois, 1949.

    MATH  Google Scholar 

  • Shapiro, I. J. and K. S. Narendra. Use of stochastic automata for parameter self-optimization with multimodal performance criteria. IEEE Trans. Systems Science and Cybernetics, v. SSC-5 (4), Oct. 1969: 352–360.

    Article  MATH  Google Scholar 

  • Shubik, M. Game Theory in the Social Sciences. Cambridge, MA: MIT Press, 1982.

    MATH  Google Scholar 

  • Tan, K.C. and R.J. Bennett. Optimal Control of Spatial Systems. London: George Allen & Unwin, 1984.

    Google Scholar 

  • Tsypkin, Y.Z. Adaptation and Learning in Automatic Systems, trans. by Z.J. Nikolic. NY: Academic, 1971.

    Google Scholar 

  • Valiant, L.G. “A Theory of the Learnable.” Communications of ACM, v. 27(11), 1984: 1134–1142.

    Article  MATH  Google Scholar 

  • von Neumann, J.Theory of Self-Reproducing Automata, ed. by A.W. Burks. Urbana, IL: U. Illinois, 1966.

    Google Scholar 

  • von Neumann, J. and O. Mergenstern. Theory of Games and Economic Behavior, 2nd ed. Princeton, NJ: Princeton Univ. Press, 1947.

    MATH  Google Scholar 

  • Vorob’ev, N.N. xxx Game Theory. Trans. by S. Kotz, NY: Springer-Verlag, 1977.

    Chapter  Google Scholar 

  • Young, T.Y. and K.-S. Fu, eds. Handbook of Pattern Recognition and Image Processing. NY: Academic, 1986.

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Lightwell Inc., Charlottesville, Virginia, USA

    Steven H. Kim

Authors
  1. Steven H. Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

Copyright information

© 1994 Springer Science+Business Media Dordrecht

About this chapter

Cite this chapter

Kim, S.H. (1994). Principles of Coordination. In: Learning and Coordination. Microprocessor-Based and Intelligent Systems Engineering, vol 13. Springer, Dordrecht. https://doi.org/10.1007/978-94-011-1016-7_3

Download citation

  • DOI: https://doi.org/10.1007/978-94-011-1016-7_3

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-94-010-4442-4

  • Online ISBN: 978-94-011-1016-7

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation