Discrete Event Dynamic Systems

, Volume 24, Issue 4, pp 447–471 | Cite as

Exact and approximate approaches to the identification of stochastic max-plus-linear systems

  • Samira S. Farahani
  • Ton van den Boom
  • Bart De Schutter


Stochastic max-plus linear systems, i.e., perturbed systems that are linear in the max-plus algebra, belong to a special class of discrete-event systems that consists of systems with synchronization but no choice. In this paper, we study the identification problem for such systems, considering two different approaches. One approach is based on exact computation of the expected values and consists in recasting the identification problem as an optimization problem that can be solved using gradient-based algorithms. However, due to the structure of stochastic max-plus linear systems, this method results in a complex optimization problem. The alternative approach discussed in this paper, is an approximation method based on the higher-order moments of a random variable. This approach decreases the required computation time significantly while still guaranteeing a performance that is comparable to the one of the exact solution.


Stochastic discrete event systems System identification Stochastic max-plus-linear systems Analytic integration Approximation Moments 



The authors would like to thank Dr. Ioan Landau for his useful comments and suggestions and Dr. Hans van der Weide for his help in the derivation of the approximation method presented in Farahani et al. (2010). This research is partially funded by the Dutch Technology Foundation STW project “Model-predictive railway traffic management” (11025), and by the European Union Seventh Framework Programme [FP7/2007-2013] under grant agreement no. 257462 HYCON2 Network of Excellence.


  1. Abramowitz MA, Stegun I (1964) Handbook of mathematical functions. National Bureau of Standards, US Government Printing Office, Washington DCzbMATHGoogle Scholar
  2. Akian M (2007) Representation of stationary solutions of Hamilton-Jacobi-Bellman equations: a max-plus point of view. In: Proceedings of the international workshop “Idempotent and Tropical Mathematics and Problems of Mathematical Physics”. Moscow, RussiaGoogle Scholar
  3. Baccelli F, Cohen G, Olsder GJ, Quadrat JP (1992) Synchronization and linearity. Wiley, New YorkzbMATHGoogle Scholar
  4. Başar T, Bernhard P (1995) H-optimal control and related minimax design problems, 2nd edn. Birkhauser, Boston, MassachusettsGoogle Scholar
  5. Bemporad A, Borrelli F, Morari M (2003) Min-max control of constrained uncertain discrete-time linear systems. IEEE Trans Automat Contr 48(9):1600–1606MathSciNetCrossRefGoogle Scholar
  6. Boimond JL, Hardouin L, Chiron P (1995) A modeling method of SISO discrete-event systems in max-algebra. In: Proceedings of the 3rd European control conference. Rome, Italy, pp 2023–2026Google Scholar
  7. Boyd S, Vandenberghe L (2004) Convex optimization. Cambridge University Press, London, UKCrossRefzbMATHGoogle Scholar
  8. Büeler B, Enge A, Fukuda K (2000) Exact volume computation for convex polytopes: a practical study. In: Kalai G, Ziegler G (eds) Polytopes–combinatorics and computation. Birkäuser Verlag, Basel, Switzerland, pp 131–154Google Scholar
  9. Cassandras CG, Lafortune S (1999) Introduction to discrete event systems. Kluwer Academic Publishers, Boston, MassachusettsCrossRefzbMATHGoogle Scholar
  10. Cuninghame-Green RA (1979) Minimax algebra. Springer-Verlag, Berlin, GermanyCrossRefzbMATHGoogle Scholar
  11. Davis PJ, Rabinowitz P (1984) Methods of numerical integration, 2nd edn. Academic Press, New YorkzbMATHGoogle Scholar
  12. De Schutter B, van den Boom T, Verdult V (2002) State space identification of max-plus-linear discrete event systems from input-output data. In: Proceedings of the 41st IEEE conference on decision and control. Las Vegas, Nevada, pp 4024–4029Google Scholar
  13. Dekking FM, Kraaikamp C, Lopuhaä HP, Meester LE (2005) A modern introduction to probability and statistics. Springer, London, UKzbMATHGoogle Scholar
  14. Farahani SS, van den Boom T, van der Weide H, De Schutter B (2010) An approximation approach for model predictive control of stochastic max-plus linear systems. In: Proceedings of the 10th international workshop on discrete event systems (WODES’10). Berlin, Germany, pp 386–391Google Scholar
  15. Gallot F, Boimond JL, Hardouin L (1997) Identification of simple elements in max-algebra: application to SISO discrete event systems modelisation. In: Proceedings of the European control conference (ECC’97). Brussels, Belgium, paper 488Google Scholar
  16. Golub GH, Van Loan CF (1996) Matrix computations, 3rd edn. The John Hopkins University Press, Baltimore, MarylandzbMATHGoogle Scholar
  17. Goodwin GC, Payne RL (1977) Dynamic system identification: experiment design and data analysis. Academic Press, New YorkzbMATHGoogle Scholar
  18. Graham R, Knuth D, Patashnik O (1994) Concrete mathematics: a foundation for computer science, 2nd edn. Addison-Wesley, Boston, MassachusettszbMATHGoogle Scholar
  19. Heidergott B, Olsder GJ, van der Woude J (2006) Max plus at work. Princeton University Press, Princeton, New JerseyGoogle Scholar
  20. Ho YC (ed) (1992) Discrete event dynamic systems: analyzing complexity and performance in the modern world. IEEE Press, Piscataway, New JerseyGoogle Scholar
  21. Ivelić S, Pečarić JE (2011) Remarks on “on a converse of Jensen’s discrete inequality” of S. Simić. Hindawi Publishing Corporation, Journal of Inequalities and Applications Article ID 309565Google Scholar
  22. Kalos MH, Whitlock PA (2008) Monte Carlo methods. Wiley-VCH, Weinheim, GermanyCrossRefzbMATHGoogle Scholar
  23. Lasserre JB (1998) Integration on a convex polytope. Proc Am Math Soc 126(8):2433–2441MathSciNetCrossRefzbMATHGoogle Scholar
  24. Ljung L (1999) System identification: theory for the user, 2nd edn. Prentice-Hall, Upper Saddle River, New JerseyGoogle Scholar
  25. Mairesse J (1994) Stochastic linear systems in the (max,+) algebra. In: 11th international conference on analysis and optimization of systems discrete event systems. Lecture notes in control and information sciences, vol 199. Springer-Verlag, London, UK, pp 257–265CrossRefGoogle Scholar
  26. Mattheiss TH, Rubin DS (1980) A survey and comparison of methods for finding all vertices of convex polyhedral sets. Math Oper Res 5(2):167–185MathSciNetCrossRefGoogle Scholar
  27. McEneaney WM (2004) Max-plus eigenvector methods for nonlinear H-infinity problems: error analysis. SIAM J Control Optim 43:379–412MathSciNetCrossRefzbMATHGoogle Scholar
  28. Menguy E, Boimond JL, Hardouin L, Ferrier JL (2000) A first step towards adaptive control for linear systems in max algebra. Discret Event Dyn Syst: Theory Appl 10(4):347–367MathSciNetCrossRefzbMATHGoogle Scholar
  29. Olsder GJ, Resing JAC, de Vries RE, Keane MS, Hooghiemstra G (1990) Discrete event systems with stochastic processing times. IEEE Trans Automat Contr 35(3):299–302CrossRefzbMATHGoogle Scholar
  30. Papoulis A (1991) Probability, random variables, and stochastic processes. McGraw-Hill, SingaporeGoogle Scholar
  31. Pardalos PM, Resende MGC (eds) (2002) Handbook of applied optimization. Oxford University Press, Oxford, UKzbMATHGoogle Scholar
  32. Peterson JL (1981) Petri net theory and the modeling of systems. Prentice-Hall, Englewood Cliffs, New JerseyGoogle Scholar
  33. Pečarić JE, Beesack PR (1987) On knopp’s inequality for convex functions. Can Math Bull 30(3):267–272CrossRefzbMATHGoogle Scholar
  34. Resing JAC, de Vries RE, Hooghiemstra G, Keane MS, Olsder GJ (1990) Asymptotic behavior of random discrete event systems. Stoch Process Their Appl 36(2):195–216CrossRefzbMATHGoogle Scholar
  35. Rudin W (1987) Real and complex analysis, 3rd edn. McGraw-Hill Series in Higher Mathematics, McGraw-Hill, New YorkzbMATHGoogle Scholar
  36. Schullerus G, Krebs V (2001a) Diagnosis of batch processes based on parameter estimation of discrete event models. In: Proceedings of the European control conference 2001 (ECC’01). Porto, Portugal, pp 1612–1617Google Scholar
  37. Schullerus G, Krebs V (2001b) Input signal design for discrete event model based batch process diagnosis. In: Proceedings of the 4th IFAC workshop on on-line fault detection and supervision in the chemical process industries. Seoul, KoreaGoogle Scholar
  38. Schullerus G, Krebs V, De Schutter B, van den Boom T (2003) Optimal input signal design for identification of max-plus-linear systems. In: Proceedings of the 2003 European control conference (ECC’03). Cambridge, UK, paper 026Google Scholar
  39. Simić S (2009a) On a converse of Jensen’s discrete inequality. J Inequal Appl 2009(1):153080CrossRefGoogle Scholar
  40. Simić S (2009b) On an upper bound for Jensen’s inequality. Journal of Inequalities in Pure and Applied Mathematics 10(2), Article 60Google Scholar
  41. Somasundaram KK, Baras JS (2011) Solving multi-metric network problems an interplay between idempotent semiring rules. Linear Algebra Appl 435(7):1494–1512MathSciNetCrossRefzbMATHGoogle Scholar
  42. van den Boom T, De Schutter B (2004) Model predictive control for perturbed max-plus-linear systems: a stochastic approach. Int J Control 77(3):302–309CrossRefzbMATHGoogle Scholar
  43. van den Boom TJJ, De Schutter B, Verdult V (2003) Identification of stochastic max-plus-linear systems. In: Proceedings of the 2003 European control conference (ECC’03). Cambridge, UK, paper 104Google Scholar
  44. Willink R (2005) Normal moments and Hermite polynomials. Stat Probab Lett 73(3):271–275MathSciNetCrossRefzbMATHGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2013

Authors and Affiliations

  • Samira S. Farahani
    • 1
  • Ton van den Boom
    • 1
  • Bart De Schutter
    • 1
  1. 1.Delft Center for Systems and ControlDelft University of TechnologyDelftThe Netherlands

Personalised recommendations