On the Internal Structure of Finite-State Stochastic Processes

  • Giorgio Picci
Part of the Lecture Notes in Economics and Mathematical Systems book series (LNE, volume 162)


The “Identifiabi1ity problem for functions of finite Markov chains”, which we might now rather call “the finite-state stochastic realization problem”, was stated by BLACKWELL and KOOPMANS [1] in 1957. Even if there exists now a rather abundant literature on this subject, yet, it can safely be asserted that very little progress has been made. This is especially true as for an algorithmic solution is concerned. This actually shows that the problem is a very hard one (though an important one).


Stochastic System Stochastic Matrix Polyhedral Convex Hankel Matrix Stationary Stochastic Process 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    Blackwell, D. and Koopmans, L. “On the identifiability problem for functions of finite Markov chains”. Ann. Math. Stat., 28 (1957), 1011–1015.CrossRefGoogle Scholar
  2. [2]
    Gilbert, E.J. “On the identifiability problem for functions of finite Markov chains”. Ann. Math. Stat., 30 (1959), 688–697.CrossRefGoogle Scholar
  3. [3]
    Heller, A. “On stochastic processes derived from Markov chains”, Ann. Math. Stat., 36 (1965), 1286–1291.CrossRefGoogle Scholar
  4. [4]
    — “Probabilistic automata and stochastic transformations”. Math. Syst. Th., 1, (1967), 197–208.CrossRefGoogle Scholar
  5. [5]
    Carlyle, J.W. “Stochastic finite-state system theory”. In System Theory (L.A. Zadeh, and E. Polak eds.), chapter 10. McGraw-Hill, New York (1969).Google Scholar
  6. [6]
    Fox, M. and Rubin, H. “Functions of processes with Markovian states” Ann. Math. Stat., 39 (1968) 1020–1029.CrossRefGoogle Scholar
  7. [7]
    Dharmadhikari, S.W., “Some nonregular functions of finite Markov chains”. Rep. No. RM.-202, SD-2 (1967) Michigan State University.Google Scholar
  8. [8]
    Paz, A., Introduction to probabilistic automata. Ac. Press, New York (1971).Google Scholar
  9. [9]
    Fliess, M. “Series rationelles positives et processus stochastiques” Ann. Inst. Henri Poincaré, XI, 1, (1975) 1–21.Google Scholar
  10. [10]
    Kalman, R.E., Falb, P.L., Arbib, M., Topics in mathematical system theory. Mc Graw-Hill, New York (1969).Google Scholar
  11. [11]
    Astrom, K., “Optimal control of Markov processes with incomplete state information”. J. Math. Anal. Appl. 10, (1965), 174–205.CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1978

Authors and Affiliations

  • Giorgio Picci
    • 1
  1. 1.Laboratorio per Ricerche di Dinamica dei Sistemi e di Elettronica Biomedica (LADSEB)C.N.R.PadovaItaly

Personalised recommendations