Discrete Event Dynamic Systems

, Volume 6, Issue 4, pp 379–427 | Cite as

Centralized and distributed algorithms for on-line synthesis of maximal control policies under partial observation

  • Nejib Ben Hadj-Alouane
  • Stéphane Lafortune
  • Feng Lin
Article
Received:
Revised:

Abstract

This paper deals with the on-line control of partially observed discrete event systems (DES). The goal is to restrict the behavior of the system within a prefix-closed legal language while accounting for the presence ofuncontrollable andunobservable events. In the spirit of recent work on the on-line control of partially observed DES (Heymann and Lin 1994) and on variable lookahead control of fully observed DES (Ben Hadj-Alouane et al. 1994c), we propose an approach where, following each observable event, a control action is computed on-line using an algorithm oflinear worst-case complexity. This algorithm, calledVLP-PO, has the following additional properties: (i) the resulting behavior is guaranteed to be amaximal controllable and observable sublanguage of the legal language; (ii) different maximals may be generated by varying the priorities assigned to the controllable events, a parameter ofVLP-PO; (iii) a maximal containing the supremal controllable and normal sublanguage of the legal language can be generated by a proper selection of controllable event priorities; and (iv) no off-line calculations are necessary. We also present a parallel/distributed version of theVLP-PO algorithm calledDI-VLP-PO. This version uses several communicating agents that simultaneously run (on-line) identical versions of the algorithm but on possibly different parts of the system model and the legal language, according to the structural properties of the system and the specifications. While achieving the same behavior asVLO-PO, DI-VLP-PO runs at a total complexity (for computation and communication) that is significantly lower than its sequential counterpart.

Keywords

supervisory control partial observation variable lookahead policies on-line control parallel/distributed algorithms modular control 
This is a preview of subscription content, log in to check access.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Barbeau, M., Custeau, G. and St-Denis, R. 1995. An algorithm for computing the mask value of the supremal normal sublanguage of a legal language.IEEE Trans. Automatic Control 40(4): 699–703.Google Scholar
  2. Ben Hadj-Alouane, N., Lafortune, S. and Lin, F. 1993. Control of partially obseved discrete event systems with maximal variable lookahead policies.Proceedings of the Thirty-first Annual Allerton Conference on Communications, Control, and Computing pp. 898–907.Google Scholar
  3. Ben Hadj-Alouane, N., Lafortune, S. and Lin, F. 1994a. A distributed on-line algorithm for supervisory control under partial observation.Proc. 1994 Conf. Information Sciences and Systems Princeton, NJ, March.Google Scholar
  4. Ben Hadj-Alouane, N., Lafortune, S. and Lin, F. 1994b. Think globally, communicate, act locally: On-line parallel/distribued supervisory control.Proc. 33rd IEEE Conf. on Decision and Control Orlando, FL, pp. 3661–3666. December.Google Scholar
  5. Ben Hadj-Alouane, N., Lafortune, S. and Lin, F. 1994c. Variable lookahead supervisory control with state information.IEEE Trans. Automatic Control 39(12): 2398–2410.Google Scholar
  6. Brandt, R. D., Garg, V., Kumar, R., Lin, F., Marcus, S. I. and Wonham, W. M. 1990. Formulas for calculating supremal controllable and normal sublanguages.Systems and Control Letters 15(2): 111–117.Google Scholar
  7. Cho, H. and Marcus, S. I. 1989a. On supremal languages of classes of sublanguages that arise in supervisor synthesis problems with partial observation.Math. Control Signals Systems 2: 47–69.Google Scholar
  8. Cho, H. and Marcus, S. I. 1989b. Supremal and maximal sublanguages arising in superior synthesis problems with partial observations.Math. Systems Theory 22: 177–211.Google Scholar
  9. Chung, S. L., Lafortune, S. and Lin, F. 1992. Limited lookahead policies in supervisory control of discrete event systems.IEEE Trans. Automatic Control 37(12): 1921–1935.Google Scholar
  10. Chung, S. L., Lafortune, S. and Lin, F. 1994. Supervisory control using variable lookahead policies.Discrete Event Dynamic Systems: Theory and Applications 4(3): 237–268.Google Scholar
  11. Cieslak, R., Desclaux, C., Fawaz, A. and Varaiya, P. 1988. Supervisory control of discrete-event processes with partial observations.IEEE Trans. Automatic Control 33(3): 249–260.Google Scholar
  12. Garg, V. K. 1993. Parallel and distributed algorithms for supervisory control of discrete event systems.Proc. 32th IEEE Conf. on Decision and Control San Antonio, TX, pp. 2236–2241.Google Scholar
  13. Heymann, M. and Lin, F. 1994. On-line control of partially observed discrete event systems.Discrete Event Dynamic Systems: Theory and Applications 4(3): 221–236.Google Scholar
  14. Inan, K. 1994. Nondeterministic supervision under partial observations.Proc. 11th International Conference on Analysis and Optimization of Systems 1994, pp. 39–48, Springer-Verlag, Lecture Notes in Contol and Information Sciences, vol. 199.Google Scholar
  15. Lin, F. and Wonham, W. M. 1988. On observability of discrete-event systems.Information Sciences 44: 173–198.Google Scholar
  16. Ramadge, P. J. 1989. Some tractable supervisory control problems for discrete-event systems modeled by Buchi automata.IEEE Trans. Automatic Control 34(1): 10–19.Google Scholar
  17. Ramadge, P. J. and Wonham, W. M. 1987. Supervisory control of a class of discrete event processes.SIAM J. Control and Optimization 25(1): 206–230.Google Scholar
  18. Ramadge, P. J. and Wonham, W. M. 1989. The control of discrete event systems.Proc. IEEE 77(1): 81–98.Google Scholar
  19. Rudie, K. and Wonham, W. M. 1990. The infimal prefix-closed and observable superlanguage of a given language. Systems and Control Letters 15: 361–371.Google Scholar
  20. Rudie, K. and Wonham, W. M. 1992. Think globally, act locally: Decentralized supervisory control.IEEE Trans. Automatic Control 37(11): 1692–1708.Google Scholar
  21. Wonham, W. M. and Ramadge, P. J. 1987. On the supremeal controllable sublanguage of a given language.SIAM J. Control and Optimization 25(3): 637–659.Google Scholar
  22. Wonham, W. M. and Ramadge, P. J. 1988. Modular supervisory control of discrete event systems.Math. Control Signals Systems 1(1): 13–30.Google Scholar

Copyright information

© Kluwer Academic Publishers 1996

Authors and Affiliations

  • Nejib Ben Hadj-Alouane
    • 1
  • Stéphane Lafortune
    • 2
  • Feng Lin
    • 3
  1. 1.Department of Electrical Engineering and Computer ScienceUniversity of MichiganAnn Arbor
  2. 2.Department of Electrical Engineering and Computer ScienceUniversity of MichiganAnn Arbor
  3. 3.Department of Electrical and Computer EngineeringWayne State UniversityDetroit

Personalised recommendations