Skip to main content
SpringerLink
Log in

Quantum quasi-Markov processes in eventum mechanics dynamics, observation, filtering and control

  • Published:
Quantum Information Processing Aims and scope Submit manuscript

Abstract

Quantum mechanical systems exhibit an inherently probabilistic behavior upon measurement which excludes in principle the singular case of direct observability. The theory of quantum stochastic time continuous measurements and quantum filtering was earlier developed by the author on the basis of non-Markov conditionally-independent increment models for quantum noise and quantum nondemolition observability. Here this theory is generalized to the case of demolition indirect measurements of quantum unstable systems satisfying the microcausality principle. The exposition of the theory is given in the most general algebraic setting unifying quantum and classical theories as particular cases. The reduced quantum feedback-controlled dynamics is described equivalently by linear quasi-Markov and nonlinear conditionally-Markov stochastic master equations. Using this scheme for diffusive and counting measurements to describe the stochastic evolution of the open quantum system under the continuous indirect observation and working in parallel with classical indeterministic control theory, we derive the Bellman equations for optimal feedback control of the a posteriori stochastic quantum states conditioned upon these measurements. The resulting Bellman equation for the diffusive observation is then applied to the explicitly solvable quantum linear-quadratic-Gaussian problem which emphasizes many similarities with the corresponding classical control problem.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Ahn, C., Doherty, A., Landahl, A.: Continuous quantum error correction via quantum feedback control. Phys. Rev. A 65, 042,301 (2002)

    Article  Google Scholar 

  2. Armen M., Au J., Stockton J., Doherty A., Mabuchi H.: Adaptive homodyne measurement of optical phase. Phys. Rev. Lett. 89, 133,602 (2002)

    Article  Google Scholar 

  3. Barchielli A., Belavkin V.P.: Measurements continuous in time and posteriori states in quantum mechanics. J. Phys. A. Math. Gen. 24, 1495–1514 (1991)

    Article  MathSciNet  ADS  Google Scholar 

  4. Belavkin V., Melsheimer O.: A stochastic Hamiltonian approach for quantum jumps, spontaneous localizations, and continuous trajectories. Quantum Semiclass Opt. 8, 167–187 (1996)

    Article  MathSciNet  ADS  Google Scholar 

  5. Belavkin V., Staszewski P.: A quantum particle undergoing continuous observation. Phys. Lett. A 140, 359–362 (1989)

    Article  MathSciNet  ADS  Google Scholar 

  6. Belavkin V.P.: Optimal quantum filtration of markovian signals. Probl. Control Inf. Theory 7(5), 345–360 (1978)

    MathSciNet  Google Scholar 

  7. Belavkin, V.P.: Optimal Measurement and Control in Quantum Dynamical Systems. Technical Report 411, Instytut Fizyki, Copernicus University, Torun’ (1979)

  8. Belavkin V.P.: Optimal filtering of markov signals with quantum white noise. Radio Eng. Electron Phys. 25, 1445–1453 (1980)

    MathSciNet  Google Scholar 

  9. Belavkin V.P.: On the theory of controlling observable quantum systems. Autom. Remote Control 44(2), 178–188 (1983)

    MathSciNet  MATH  Google Scholar 

  10. Belavkin V.P.: Reconstruction theorem for quantum stochastic processes. Theor. Math. Phys. 3, 409–431 (1985)

    Google Scholar 

  11. Belavkin, V.P.: Non-demolition measurement and control in quantum dynamical systems. In: Blaquiere, A. (ed.) Proceedings of CISM Seminar on Information Complexity and Control in Quantum Physics, Udine 1985, pp. 311–329. Springer, Wien (1987)

  12. Belavkin V.P.: Ordered*-semirings and generating functionals of quantum statistics. Soviet Math. Dokl. 35(2), 246–249 (1987)

    MATH  Google Scholar 

  13. Belavkin, V.P.: A new form and *-algebraic structure of quantum stochastic integrals in fock space. In: Rendiconti del Seminario Matematico e Fisico di Milano LVIII, pp. 177–193 (1988)

  14. Belavkin, V.P.: Non-demolition measurements, nonlinear filtering and dynamic programming of quantum stochastic processes. In: Blaquiere, A. (ed.) Proceedings of Bellmann Continuum Workshop Modelling and Control of Systems, Sophia–Antipolis 1988, Lecture notes in Control and Inform Sciences, vol. 121, pp. 245–265. Springer, Berlin (1988)

  15. Belavkin V.P.: A continuous counting observation and posterior quantum dynamics. J. Phys. A. Math. Gen. 22, L1109–L1114 (1989)

    Article  MathSciNet  ADS  Google Scholar 

  16. Belavkin V.P.: A new wave equation for a continuous non-demolition measurement. Phys. Lett. A 140, 355–358 (1989)

    Article  MathSciNet  ADS  Google Scholar 

  17. Belavkin, V.P.: Non-demolition stochastic calculus in fock space and nonlinear filtering and control in quantum systems. In: Proceedings of Fourteenth Winter School in Theoretical Physics, Karpacz 1988, Stochastic Methods in Mathematics and Physics, pp. 310–324. World Scientific, Singapore (1989)

  18. Belavkin V.P.: A posterior Schrödinger equation for continuous non-demolition measurement. J. Math. Phys. 31(12), 2930–2934 (1990)

    Article  MathSciNet  ADS  MATH  Google Scholar 

  19. Belavkin, V.P.: A posterior stochastic equations for quantum brownian motion. In: Proceedings of the 1989 Conference on Stochastic Methods in Experimental Sciences, pp. 26–42. World Scientific, Singapore (1990)

  20. Belavkin, V.P.: Stochastic equations of quantum filtering. In: Grigelionis, B. et al. (eds.) Probability Theory and Mathematical Statistics, vol. 1, pp. 91–109. Mokslas, Vilnius (1990)

  21. Belavkin V.P.: A stochastic posterior Schrödinger equation for counting non-demolition measurement. Lett. Math. Phys. 20, 85–89 (1990)

    Article  MathSciNet  ADS  MATH  Google Scholar 

  22. Belavkin, V.P.: Continuous non-demolition observation, quantum filtering and optimal estimation. In: Proceedings of the Quantum Aspects of Optical Communication, Paris 1990, Lecture Notes in Physics, vol. 379, pp. 151–163. Springer, Berlin (1991)

  23. Belavkin V.P.: A quantum nonadapted Ito formula and stochastic analysis in Fock scale. J. Funct. Anal. 102(2), 414–447 (1991)

    Article  MathSciNet  Google Scholar 

  24. Belavkin, V.P.: Chaotic states and stochastic integrations in quantum systems. Usp. Mat. Nauk 47, 47–106 (1992). (Translation in: Russian Math. Surveys, No. 1, pp. 53–116 (1992))

  25. Belavkin, V.P.: Kernel representations of *-semigroups associated with infinitely divisible states. In: Quantum Probability and Related Topics, vol. 7, pp. 31–50. World Scientific, Singapore (1992)

  26. Belavkin V.P.: Quantum continual measurements and a posteriori collapse on CCR. Commun. Math. Phys. 146, 611–635 (1992)

    Article  MathSciNet  ADS  MATH  Google Scholar 

  27. Belavkin V.P.: Quantum stochastic calculus and quantum nonlinear filtering. J. Multivar. Anal. 42(2), 171–201 (1992)

    Article  MathSciNet  ADS  MATH  Google Scholar 

  28. Belavkin V.P.: Quantum diffustion, measurement and filtering. Probab. Theory Appl. 38(4), 742–757 (1993)

    MathSciNet  Google Scholar 

  29. Belavkin V.P.: The unified ito formula has pseudo-poisson structure. J. Math. Phys. 34(4), 1508–1518 (1993)

    Article  MathSciNet  ADS  MATH  Google Scholar 

  30. Belavkin V.P.: Nondemolition principle of quantum measurement theory. Found. Phys. 24(5), 685–714 (1994)

    Article  MathSciNet  ADS  Google Scholar 

  31. Belavkin, V.P.: A stochastic model of quantum observation. In: P.B. et al (ed.) Proceeding of Symposium on the Foundations of Modern Physics, pp. 38–54. World Scientific, Singapore (1994)

  32. Belavkin V.P.: A dynamical theory of quantum continuous measurement and spontaneous localization. Russ. J. Math. Phys. 3(1), 3–24 (1995)

    MathSciNet  MATH  Google Scholar 

  33. Belavkin, V.P.: The interplay of classical and quantum stochastics: diffusion, measurement and filtering. In: Chaos—The Interplay Between Stochastic and Deterministic Behaviour, Lecture Notes in Physics, pp. 21–41. Springer, Berlin (1995)

  34. Belavkin V.P.: On stochastic generators of completely positive cocycles. Russ. J. Math. Phys. 3(4), 523–528 (1995)

    MathSciNet  MATH  Google Scholar 

  35. Belavkin, V.P.: On the general form of quantum stochastic evolution equation. In: Davies, I.M., Truman, A., Elworthy, K.D. (eds.) Stochastic Analysis and Applications, pp. 91–106. World Scientific, Singapore (1996)

  36. Belavkin V.P.: Positive definite germs of quantum stochastic processes. CR Acad. Sci. Paris 322(1), 385–390 (1996)

    MathSciNet  MATH  Google Scholar 

  37. Belavkin V.P.: Quantum stochastic positive evolutions: characterization, construction, dilation. Commun. Math. Phys. 184, 533–566 (1997)

    Article  MathSciNet  ADS  MATH  Google Scholar 

  38. Belavkin V.P.: Measurement, filtering and control in quantum open dynamical systems. Rep. Math. Phys. 43(3), 405–425 (1999)

    Article  MathSciNet  ADS  MATH  Google Scholar 

  39. Belavkin V.P., Staszewski P.: A continuous observation of photon emission. Rep. Math. Phys. 29, 213–225 (1990)

    Article  MathSciNet  Google Scholar 

  40. Belavkin V.P., Staszewski P.: Nondemolition observation of a free quantum particle. Phys. Rev. A 45(3), 1347–1357 (1992)

    Article  ADS  Google Scholar 

  41. Belavkin V.P., Bouten L., Edwards S.: Bellman equations for optimal feedback control of qubit states. J.Phys. B At. Mol. Opt. Phys. 38, 151–160 (2005)

    Article  ADS  Google Scholar 

  42. Bensoussan A.: Stochastic Control of Partially Observable Systems. Cambridge University Press, Cambridge (1992)

    Book  MATH  Google Scholar 

  43. Bouten L., Guţă M., Maassen H.: Stochastic Schrödinger equations. J. Phys. A 37, 3189–3209 (2004)

    Article  MathSciNet  ADS  MATH  Google Scholar 

  44. Bouten, L.M., van Handel, R.: On the separation principle of quantum control. In: Quantum Stochastics and Information, pp. 206–238, World Scientific, Singapore (2008)

  45. Bouten, L.M., van Handel, R.: Quantum Filtering: A Reference Probability Approach. arXiv:math-ph/0508006 (2005)

  46. Bouten L.M., van Handel R., James M.: An introduction to quantum filtering. SIAM J. Control Opt. 46(6), 2199–2241 (2007)

    Article  MATH  Google Scholar 

  47. Doherty A., Habib S., Jacobs K., Mabuchi H., Tan S.: Quantum feedback and classical control theory. Phys. Rev. A 62, 012,105 (2000)

    Article  Google Scholar 

  48. Doherty A.C., Jacobs K.: Feedback-control of quantum systems using continuous state-estimation. Phys. Rev. A 129, 419 (1999)

    Google Scholar 

  49. Doherty A.C., Jacobs K., Jungman G.: Information, disturbance and Hamiltonian quantum feedback control. Phys. Rev. A 63, 062,306 (2001)

    Article  Google Scholar 

  50. Gardiner C., Zoller P.: Quantum Noise. Springer, Berlin (2000)

    MATH  Google Scholar 

  51. Geremia J., Stockton J., Doherty A., Mabuchi H.: Quantum Kalman filtering and the Heisenberg limit in atomic magnetometry. Phys. Rev. Lett. 91, 250,801 (2003)

    Article  Google Scholar 

  52. Gorini V., Kossakowski A., Sudarshan E.: Completely positive dynamical semigroups of N-level systems. J. Math. Phys. 17(5), 821–825 (1976)

    Article  MathSciNet  ADS  Google Scholar 

  53. Gough J., Smolyanov O.G., Belavkin V.P.: Hamilton-Jacobi-Bellman equation for quantum feedback control. J. Opt. B Quantum Semiclass. Opt. 7, S237–S244 (2005)

    Article  MathSciNet  ADS  Google Scholar 

  54. Gregoratti M., Werner R.F.: On quantum error-correction by classical feedback in discrete time. J. Math. Phys. 45, 2600–2612 (2004)

    Article  MathSciNet  ADS  MATH  Google Scholar 

  55. Hudson R., Parthasarathy K.: Quantum Itô’s formula and stochastic evolutions. Commun. Math. Phys. 93, 301–323 (1984)

    Article  MathSciNet  ADS  MATH  Google Scholar 

  56. Hudson R.L., Parthasarathy K.R.: Quantum Itôs formula and stochastic evolutions. Commun. Math. Phys. 93(3), 301–323 (1984)

    Article  MathSciNet  ADS  MATH  Google Scholar 

  57. Jacobs, K.: How to project qubits faster using quantum feedback. Phys. Rev. A. 67, 030,301(R) (2003)

  58. Jacobs, K.: Optimal feedback control for the rapid preparation of a single qubit. In: Proceedings of the SPIE, vol. 5468, pp. 355–364 (2004)

  59. James M.R.: Risk sensitive optimal control of quantum systems. Phys. Rev. A. 69, 032,108 (2004)

    Google Scholar 

  60. James, M.R.: A quantum Langevin formulation of risk sensitive optimal contol. J. Opt. B Quantum Semiclass. Opt. 7, S198–S207 (2005). Special issue on quantum control

    Google Scholar 

  61. Kumar P.R., Varaiya P.: Stochastic Systems: Estimation, Identification and Adaptive Control. Prentice-Hall, Englewood Cliffs (1986)

    MATH  Google Scholar 

  62. Lindblad G.: On the generators of quantum dynamical semigroups. Commun. Math. Phys. 48, 119–130 (1976)

    Article  MathSciNet  ADS  MATH  Google Scholar 

  63. Maassen, H.: Quantum Markov processes on Fock space described by integral kernels. In: Accardi, L., von Waldenfels, W. (eds.) QP and Applications II, Lecture Notes in Mathematics, vol. 1136, pp. 361–374. Springer, Berlin (1985)

  64. Mortensen R.E.: Stochastic optimal control with noisy observations. Int. J. Control 4, 455–464 (1966)

    Article  MathSciNet  MATH  Google Scholar 

  65. Parthasarathy K.: An Introduction to Quantum Stochastic Calculus. Birkhäuser, Basel (1992)

    Book  MATH  Google Scholar 

  66. Stratonovich R.L.: Conditional Markov processes and their application to the theory of optimal control. American Elsevier Publishing Company Inc, New-York (1968)

    MATH  Google Scholar 

  67. Stratonovich R.L.: On the theory of optimal control. Sufficient coordinates. Autom. Remote Control 23(7), 910–917 (1962)

    MathSciNet  Google Scholar 

  68. Stratonovich R.L.: Conditional Markovian Processes and their Application to the Theory of Optimal Control. MGU, Moscow (1966)

    Google Scholar 

  69. van Handel R., Stockton J.K., Mabuchi H.: Feedback control of quantum state reduction. IEEE Trans. Autom. Control 50(6), 768–780 (2005)

    Article  Google Scholar 

  70. von Neumann J.: Mathematische Grundlagen der Quantenmechanik. Springer, Berlin (1932)

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Mathematical Sciences, University of Nottingham, Nottingham, UK

    Viacheslav P. Belavkin

Authors
  1. Viacheslav P. Belavkin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Viacheslav P. Belavkin.

Additional information

The author acknowledges the support under the programme ATESIT (contract no IST-2000-29681) from the EC and also QBIC programme of Tokyo Science University where it was completed.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Belavkin, V.P. Quantum quasi-Markov processes in eventum mechanics dynamics, observation, filtering and control. Quantum Inf Process 12, 1539–1626 (2013). https://doi.org/10.1007/s11128-012-0462-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11128-012-0462-z

Keywords

Search

Navigation