Skip to main content

Parameter Identification for Markov Models of Biochemical Reactions

  • Conference paper

Part of the Lecture Notes in Computer Science book series (LNTCS,volume 6806)


We propose a numerical technique for parameter inference in Markov models of biological processes. Based on time-series data of a process we estimate the kinetic rate constants by maximizing the likelihood of the data. The computation of the likelihood relies on a dynamic abstraction of the discrete state space of the Markov model which successfully mitigates the problem of state space largeness. We compare two variants of our method to state-of-the-art, recently published methods and demonstrate their usefulness and efficiency on several case studies from systems biology.


  • State Space
  • Reaction Network
  • Observation Interval
  • Observation Sequence
  • Chemical Master Equation

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. Banga, J.R., Balsa-Canto, E.: Parameter estimation and optimal experimental design. Essays Biochem. 45, 195–209 (2008)

    CrossRef  Google Scholar 

  2. Boys, R., Wilkinson, D., Kirkwood, T.: Bayesian inference for a discretely observed stochastic kinetic model. Statistics and Computing 18, 125–135 (2008)

    MathSciNet  CrossRef  Google Scholar 

  3. Burrage, K., Hegland, M., Macnamara, F.: A Krylov-based finite state projection algorithm for solving the chemical master equation arising in the discrete modelling of biological systems. In: Proceedings of the Markov 150th Anniversary Conference, Boson Books, pp. 21–38 (2006)

    Google Scholar 

  4. Chou, I., Voit, E.: Recent developments in parameter estimation and structure identification of biochemical and genomic systems. Mathematical Biosciences 219(2), 57–83 (2009)

    MathSciNet  CrossRef  MATH  Google Scholar 

  5. Fernández Slezak, D., Suárez, C., Cecchi, G., Marshall, G., Stolovitzky, G.: When the optimal is not the best: Parameter estimation in complex biological models. PLoS ONE 5(10), e13283 (2010)

    CrossRef  Google Scholar 

  6. Gillespie, D.T.: Exact stochastic simulation of coupled chemical reactions. J. Phys. Chem. 81(25), 2340–2361 (1977)

    CrossRef  Google Scholar 

  7. Golding, I., Paulsson, J., Zawilski, S., Cox, E.: Real-time kinetics of gene activity in individual bacteria. Cell 123(6), 1025–1036 (2005)

    CrossRef  Google Scholar 

  8. Hahn, E.M., Han, T., Zhang, L.: Synthesis for PCTL in parametric markov decision processes. In: Bobaru, M., Havelund, K., Holzmann, G.J., Joshi, R. (eds.) NFM 2011. LNCS, vol. 6617, pp. 146–161. Springer, Heidelberg (2011)

    CrossRef  Google Scholar 

  9. Henzinger, T., Mateescu, M., Mikeev, L., Wolf, V.: Hybrid numerical solution of the chemical master equation. In: Proc. of CMSB 2010. ACM Press, New York (2010)

    Google Scholar 

  10. Henzinger, T.A., Mateescu, M., Wolf, V.: Sliding window abstraction for infinite markov chains. In: Bouajjani, A., Maler, O. (eds.) CAV 2009. LNCS, vol. 5643, pp. 337–352. Springer, Heidelberg (2009)

    CrossRef  Google Scholar 

  11. Higgins, J.J.: Bayesian inference and the optimality of maximum likelihood estimation. Int. Stat. Rev. 45(1), 9–11 (1977)

    MathSciNet  CrossRef  MATH  Google Scholar 

  12. Ljung, L.: System Identification: Theory for the User, 2nd edn. Prentice Hall PTR, Upper Saddle River (1998)

    MATH  Google Scholar 

  13. Loinger, A., Lipshtat, A., Balaban, N.Q., Biham, O.: Stochastic simulations of genetic switch systems. Physical Review E 75, 21904 (2007)

    CrossRef  Google Scholar 

  14. Mateescu, M., Wolf, V., Didier, F., Henzinger, T.A.: Fast adaptive uniformisation of the chemical master equation. IET Systems Biology 4(6), 441–452 (2010)

    CrossRef  Google Scholar 

  15. Munsky, B., Khammash, M.: The finite state projection algorithm for the solution of the chemical master equation. J. Chem. Phys. 124, 44144 (2006)

    CrossRef  MATH  Google Scholar 

  16. Reinker, S., Altman, R.M., Timmer, J.: Parameter estimation in stochastic biochemical reactions. IEEE Proc. Syst. Biol. 153, 168–178 (2006)

    CrossRef  Google Scholar 

  17. Sidje, R., Burrage, K., MacNamara, S.: Inexact uniformization method for computing transient distributions of Markov chains. SIAM J. Sci. Comput. 29(6), 2562–2580 (2007)

    MathSciNet  CrossRef  MATH  Google Scholar 

  18. Tian, T., Xu, S., Gao, J., Burrage, K.: Simulated maximum likelihood method for estimating kinetic rates in gene expression. Bioinformatics 23, 84–91 (2007)

    CrossRef  Google Scholar 

  19. Toni, T., Welch, D., Strelkowa, N., Ipsen, A., Stumpf, M.: Approximate Bayesian computation scheme for parameter inference and model selection in dynamical systems. J. R. Soc. Interface 6(31), 187–202 (2009)

    CrossRef  Google Scholar 

  20. Uz, B., Arslan, E., Laurenzi, I.: Maximum likelihood estimation of the kinetics of receptor-mediated adhesion. J. Theor. Biol. 262(3), 478–487 (2010)

    CrossRef  Google Scholar 

  21. Wilkinson, D.J.: Stochastic Modelling for Systems Biology. Chapman & Hall, Boca Raton (2006)

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations


Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Andreychenko, A., Mikeev, L., Spieler, D., Wolf, V. (2011). Parameter Identification for Markov Models of Biochemical Reactions. In: Gopalakrishnan, G., Qadeer, S. (eds) Computer Aided Verification. CAV 2011. Lecture Notes in Computer Science, vol 6806. Springer, Berlin, Heidelberg.

Download citation

  • DOI:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-22109-5

  • Online ISBN: 978-3-642-22110-1

  • eBook Packages: Computer ScienceComputer Science (R0)