Evaluating the Path Integral

  • Henry D. I. Abarbanel
Chapter
First Online:
Part of the Understanding Complex Systems book series (UCS)

Abstract

The path integral giving the integral representation of any physical question encountered in statistical data assimilation is addressed in this chapter. We first outline the three methods for evaluating the path integral. The first two are variants on a stationary path approximation to the integral and its corrections presented as an infinite series. The series is identical to perturbation theory corrections to statistical physics and field theory estimations of path integrals encountered in those analyses. We work solely in discrete time and discrete space, so the infinities of field theory do not appear.

Keywords

Model Error Graphic Processing Unit Data Assimilation Observation Window Chaotic Orbit 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in to check access.

Bibliography

  1. Abarbanel, H.D.I.: Effective actions for statistical data assimilation. Phys. Lett. A 373, 4044–4048 (2009). doi: 10.1016/j.physleta.2009.08.072ADSMATHCrossRefGoogle Scholar
  2. Abarbanel, H.D.I., Kostuk, M., Whartenby, W.: Data assimilation with regularized nonlinear instabilities. Quart. J. R. Meteorol. Soc. 136, 769–783 (2010)Google Scholar
  3. Abarbanel, H.D.I., Bryant, P., Gill, P.E., Kostuk, M., Rofeh, J., Singer, Z., Toth, B., Wong, E.: Dynamical parameter and state estimation in neuron models, Chapter 8. In: Ding, M., Glanzman, D.L. (eds.) The Dynamic Brain, pp. 139–180. Oxford University Press, Oxford (2011)CrossRefGoogle Scholar
  4. Barclay, A., Gill, P.E., Rosen, J.B.: SQP methods in optimal control. In: Bulirsch, R., Bittner, L., Schmidt, W.H., Heier, K. (eds.) Variational Calculus, Optimal Control and Applications. International Series of Numerical Mathematics, vol. 124, pp. 207–222. Birkhaeuser, Basel (1998)CrossRefGoogle Scholar
  5. Bazley, N.W., Fox, D.W.: Error bounds for expectation values. Rev. Mod. Phys. 35, 712–715 (1963)MathSciNetADSMATHCrossRefGoogle Scholar
  6. Beard, D.A.: A biophysical model of the mitochondrial respiratory system and oxidative phosphorylation. PLoS Comput. Biol. 1, 252–264 (2005). doi: 10.1371/journal.pcbi.0010036CrossRefGoogle Scholar
  7. Burrage, P.M.: Numerical methods for stochastic differential equations. Ph.D. thesis, University of Queensland (1999)Google Scholar
  8. Burrage, P.M., Burrage, K.: A variable stepsize implementation for stochastic differential equations. SIAM J. Sci. Comput. 24, 848–864 (2002)MathSciNetMATHCrossRefGoogle Scholar
  9. Curtis, F.E., Schenk, O., Wächter, A.: An interior-point algorithm for large scale nonlinear optimization with inexact step computations. SIAM J. Sci. Comput. 32, 3447–3475 (2010)MathSciNetMATHCrossRefGoogle Scholar
  10. Debye, P.: Näherungsformeln für die zylinderfunktionen für grosse werte des arguments und unbeschränkt veränderliche werte des index. Math. Ann. 67(4), 535–558 (1909). doi:10.1007/BF01450097 (English translation in Debye, P.J.W.: The collected papers of P.J.W. Debye. Interscience Publishers Inc., New York (1954). ISBN 978-0-918024-58-9, MR0063975)Google Scholar
  11. Dochain, D.: State and parameter estimation in chemical and biochemical processes: a tutorial. J. Process Contr. 13, 801–818 (2003). doi: 10.1016/S0959-1524(03)00026-XMathSciNetCrossRefGoogle Scholar
  12. Evensen, G.: Data Assimilation: The Ensemble Kalman Filter, 2nd edn. Springer, Berlin (2009). ISBN: 978-3-642-03710-8CrossRefGoogle Scholar
  13. Feller, W.: An Introduction to Probability Theory and Its Applications. Wiley, New York (1971). ISBN 10: 0471257095 / 0-471-25709-5; ISBN 13: 9780471257097Google Scholar
  14. Gamerman, D., Lopes, H.F.: Markov Chain Monte Carlo: Stochastic Simulation for Bayesian Inference. Texts in Statistical Science. Chapman and Hall, Boca Raton (2006)Google Scholar
  15. Gill, P.E., Wright, M.H.: Practical Optimization. Academic, London (1982). ISBN-10: 0122839528, ISBN-13: 9780122839528Google Scholar
  16. Gill, P.E., Murray, W., Saunders, M.A.: User’s Guide for SNOPT 5.3: A Fortran Package for Large-Scale Nonlinear Programming, p. 67. Stanford Optimization Laboratory, Stanford (1998)Google Scholar
  17. Gill, P.E., Murray, W., Saunders, M.A.: SNOPT: An SQP algorithm for large-scale constrained optimization. SIAM J. Optim. 12, 979–1006 (2002)MathSciNetMATHCrossRefGoogle Scholar
  18. Gill, P.E., Murray, W., Saunders, M.A.: SNOPT: An SQP algorithm for large-scale constrained optimization. SIAM Rev. 47, 99–131 (2005)MathSciNetADSMATHCrossRefGoogle Scholar
  19. Hamill, T.M.: Ensemble-based atmospheric data assimilation: A tutorial. In: Palmer, T., Hagedorn, R. (eds.) Predictability of Weather and Climate, pp. 124–156. Cambridge University Press, Cambridge (2006)CrossRefGoogle Scholar
  20. Hastings, W.K.: Monte Carlo sampling methods using Markov chains and their applications. Biometrika 57, 97–109 (1970). http://www.jstor.org/stable/2334940
  21. Horva’th, A., Manini, D.: Parameter estimation of kinetic rates in stochastic reaction networks by the EM method. In: International Conference on BioMedical Engineering and Informatics (2008). doi.ieeecomputersociety.org/10.1109/BMEI.2008.237Google Scholar
  22. Huys, Q.J., Paninski, L.: Smoothing of, and parameter estimation from, noisy biophysical recordings. PLoS Comput. Biol. 5, e1000379 (2009). doi: 10.1371/journal.pcbi.1000379MathSciNetCrossRefGoogle Scholar
  23. Huys, Q.J., Ahrens, M.B., Paninski, L.: Efficient estimation of detailed single-neuron models. J. Neurophysiol. 96, 872–90 (2006)CrossRefGoogle Scholar
  24. Kalnay, E.: Atmospheric Modeling, Data Assimilation and Predictability. Cambridge University Press, Cambridge (2003)Google Scholar
  25. Kirk, D.E.: Optimal Control Theory: An Introduction. Dover Publications Inc., Mineola (1998) (original published by Prentice-Hall in 1970)Google Scholar
  26. Klauder, J.R., Petersen, W.P.: Spectrum of certain non-self-adjoint operators and solutions of Langevin equations with complex drift. J. Stat. Phys. 39, 53–72 (1985)MathSciNetADSMATHCrossRefGoogle Scholar
  27. Kloeden, P.E., Platen, E.: Numerical Solution of Stochastic Differential Equations. Springer, Berlin (1992)MATHCrossRefGoogle Scholar
  28. Laplace, P.S.: Memoir on the probability of causes of events. Mém. Math. Phys. 16, (1774) [English translation by Stigler, S.M.: Stat. Sci. 1, 364–378 (1986)]Google Scholar
  29. Lorenc, A.C., Payne, T.: 4D-Var and the butterfly effect: Statistical four-dimensional data assimilation for a wide range of scales. Q. J. R. Meteorol. Soc. 133, 607–14 (2007) (There are numerous references to 4DVar, and we selected this one as it critically examines the method after a pedagogical introduction to it)Google Scholar
  30. Lorenz, E.N.: Predictability: A problem partly solved. In: Proceedings of the Seminar on Predictability, vol. 1, pp. 1–18. ECMWF, Reading (1996)Google Scholar
  31. Lyons, M.A., Yang, R.S.H., Mayeno, A.N., Reisfeld, B.: Computational toxicology of chloroform: reverse dosimetry using Bayesian inference, Markov chain Monte Carlo simulation, and human biomonitoring data. Environ. Health Perspect. 116, 1040–1046 (2008). doi: 10.1289/ehp.11079CrossRefGoogle Scholar
  32. Mackenzie, P.B.: An improved hybrid Monte Carlo method. Fermilab preprint-89/100-T, March 1989Google Scholar
  33. Marcinkiewicz, J.: Sur une propriété de la loi de Gauss (On a property of Gauss’s law). Math. Z. 44, 612–618 (1939)MathSciNetCrossRefGoogle Scholar
  34. Metropolis, N., Rosenbluth, A., Rosenbluth, M., Teller, A., Teller, E.: Equations of state calculations by fast computing machines. J. Chem. Phys. 21, 1087 (1953)ADSCrossRefGoogle Scholar
  35. Mueller, T.G., Noykova, N., Gyllenberg, M., Timmer, J.: Parameter identification in dynamical models of anaerobic waste water treatment. Math. Biosci. 177/178, 147–60 (2002). doi: 10.1016/S0025-5564(01)00098-0Google Scholar
  36. Neal, R.M.: Probabilistic inference using Markov chain Monte Carlo methods. Technical Report CRG-TR-93-1, Department of Computer Science, University of Toronto, 25 Sept 1993Google Scholar
  37. Panning, T.D., Watson, L.T., Allen, N.A., Chen, K.C., Shaffer, C.A., Tyson, J.J.: Deterministic parallelglobal parameter estimation for a model of the budding yeast cell cycle. J. Glob. Optim. 40, 719–738 (2008). doi: 10.1007/s10898-007-9273-7MathSciNetMATHCrossRefGoogle Scholar
  38. Pawula, R.F.: Approximation of the linear Boltzmann equation by the Fokker-Planck equation. Phys. Rev. 162, 186–188 (1967)ADSCrossRefGoogle Scholar
  39. Pawula, R.F.: Generalizations and extensions of the Fokker-Planck-Kolmogorov equations. IEEE Trans. Inf. Theor. 13, 33–41 (1967)MathSciNetMATHCrossRefGoogle Scholar
  40. Press, W.H., Teukolsky, S.A., Vetterling, W.T., Flannery, B.P.: Numerical Recipes: The Art of Scientific Computing, 3rd edn. Cambridge University Press, Cambridge (2007). ISBN: 9780521880688Google Scholar
  41. Quinn, J.C., Abarbanel, H.D.I.: State and parameter estimation using Monte Carlo evaluation of path integrals. Quart. J. R. Meteorol. Soc. 136, 1855–1867 doi: 10.1002/qj.690 (2010)Google Scholar
  42. Quinn, J.C., Abarbanel, H.D.I.: Data assimilation using a GPU accelerated path integral Monte Carlo approach. J. Comp. Phys. 230, 8168–8178, (2011)MathSciNetADSMATHCrossRefGoogle Scholar
  43. Rodriguez-Fernandez, M., Egea, J.A., Banga, J.R.: Novel metaheuristic for parameter estimation in nonlinear dynamic biological systems. BMC Bioinformatics 7, 483–501 (2006). doi: 10.1186/1471-2105-7-483CrossRefGoogle Scholar
  44. Rubinstein, R.Y., Kroese, D.P.: Simulation and the Monte Carlo method, 2nd edn. Wiley, New York (2008)MATHGoogle Scholar
  45. Sugar, R., Blankenbecler, R.: Variational upper and lower bounds for multichannel scattering. Phys. Rev. 136, B472–B491 (1964)MathSciNetADSCrossRefGoogle Scholar
  46. Swameye, I., Müller, T.G., Timmer, J., Sandra, U., Klingmüller U.: Identification of nucleocytoplasmic cycling as a remote sensor in cellular signaling by databased modeling. Proc. of the Nat. Acad. of Sci. USA 100, 1028–33 (2003). doi: 10.1073/pnas.0237333100ADSCrossRefGoogle Scholar
  47. Toth, B.A.: Dynamical estimation of neuron and network properties. SIAG/OPT Views-and-News 21, 1–8 (2010)Google Scholar
  48. Wächter, A., Biegler, L.T.: On the implementation of a primal-dual interior point filter line search algorithm for large-scale nonlinear programming. Math. Program. 106(1), 25–57 (2006)MathSciNetMATHCrossRefGoogle Scholar
  49. Xiong, R., Wissmann, P.J., Gallivan, M.A.: An extended Kalman filter for in situ sensing of yttria-stabilized zirconia in chemical vapor deposition. Comput. Chem. Eng. 30, 1657–1669 (2006). doi: 10.1016/j.compchemeng.2006.05.032CrossRefGoogle Scholar
  50. Yang, Z., Hamrick, J.M.: Optimal control of salinity boundary condition in a tidal model using a variational inverse method. Estuarine, Coastal Shelf Sci. 62, 13–24 (2005). doi: 10.1016/j.ecss.2004.08.003Google Scholar
  51. Zinn-Justin, J.: Quantum Field Theory and Critical Phenomena, 4th edn. Oxford University Press, Oxford (2002)CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2013

Authors and Affiliations

  • Henry D. I. Abarbanel
    • 1
  1. 1.Department of Physics and Marine Physical Laboratory (Scripps Institution of Oceanography)University of California, San DiegoLa JollaUSA

Personalised recommendations