Abstract
This paper is concerned with risk-sensitive performance analysis for linear quantum stochastic systems interacting with external bosonic fields. We consider a cost functional in the form of the exponential moment of the integral of a quadratic polynomial of the system variables over a bounded time interval. Such functionals are related to more conservative behaviour and robustness of systems with respect to statistical uncertainty, which makes the challenging problems of their computation and minimization practically important. To this end, we obtain an integro-differential equation for the time evolution of the quadratic–exponential functional, which is different from the original quantum risk-sensitive performance criterion employed previously for measurement-based quantum control and filtering problems. Using multi-point Gaussian quantum states for the past history of the system variables and their first four moments, we discuss a quartic approximation of the cost functional and its infinite-horizon asymptotic behaviour. The computation of the asymptotic growth rate of this approximation is reduced to solving two algebraic Lyapunov equations. Further approximations of the cost functional, based on higher-order cumulants and their growth rates, are applied to large deviations estimates in the form of upper bounds for tail distributions. We discuss an auxiliary classical Gaussian–Markov diffusion process in a complex Euclidean space which reproduces the quantum system variables at the level of covariances but has different fourth-order cumulants, thus showing that the risk-sensitive criteria are not reducible to quadratic–exponential moments of classical Gaussian processes. The results of the paper are illustrated by a numerical example and may find applications to coherent quantum risk-sensitive control problems, where the plant and controller form a fully quantum closed-loop system, and other settings with nonquadratic cost functionals.
Similar content being viewed by others
Notes
\(\rho \) is a positive semi-definite self-adjoint operator with unit trace \(\mathrm {Tr}\rho =1\) on the system-field space \({\mathfrak {H}}\) in (12) which, together with a suitable \(^*\)-algebra \({\mathfrak {A}}\) of linear operators on \({\mathfrak {H}}\), forms a quantum probability space \(({\mathfrak {H}},{\mathfrak {A}},\rho )\). Since \({\mathfrak {H}}\) no longer plays the role of a sample space and can be omitted, this yields the general quantum probability space as the pair \(({\mathfrak {A}},{\mathbf {E}})\) of a \(^*\)-algebra \({\mathfrak {A}}\) and a positive linear functional \({\mathbf {E}}\) normalised to \({\mathbf {E}}{\mathscr {I}}= 1\) [26, 48].
This distribution is related by \(E_t(A):= {\mathbf {E}}{\mathsf {P}}_t(A)\) to the spectral measure \({\mathsf {P}}_t\) of \(\varphi (t)\), which is a projection-valued measure on the \(\sigma \)-algebra \({\mathfrak {B}}\) of Borel subsets of the real line satisfying \({\mathsf {P}}_t(A){\mathsf {P}}_t(B) = {\mathsf {P}}_t(A\bigcap B)\) for all \(A,B\in {\mathfrak {B}}\) and the resolution of the identity property \({\mathsf {P}}_t({\mathbb {R}}) = {\mathscr {I}}\); see, for example, [24].
It is also used in Appendix B.
Such estimates are physically meaningful in the case \(\varPi \succcurlyeq 0\) when the self-adjoint quantum variable \(\varphi (t)\) is a positive semi-definite operator.
Which is the negative of the Legendre transform of \(\frac{1}{t} \ln \varXi _{\theta }(t)\) as a function of \(\theta \geqslant 0\).
References
Adler, S.L.: Derivation of the Lindblad operator structure by use of the Ito stochastic calculus. Phys. Lett. A 26, 58–61 (2000)
Anderson, B.D.O., Moore, J.B.: Optimal Filtering. Prentice Hall, New York (1979)
Anderson, B.D.O., Moore, J.B.: Optimal Control: Linear Quadratic Methods. Prentice Hall, London (1989)
Belavkin, V.P.: On the theory of controlling observable quantum systems. Autom. Remote Control 44(2), 178–188 (1983)
Belavkin, V.P.: Noncommutative dynamics and generalized master equations. Math. Notes 87(5), 636–653 (2010)
Bensoussan, A., Schuppen, J.H.: Optimal control of partially observable stochastic systems with an exponential-of-integral performance index. SIAM J. Control Optim. 23, 599–613 (1985)
Billingsley, P.: Convergence of Probability Measures. Wiley, New York (1968)
Bouten, L., van Handel, R.: On the separation principle of quantum control (2006). arXiv:math-ph/0511021v2
Bouten, L., Handel, R., James, M.R.: An introduction to quantum filtering. SIAM J. Control Optim. 46(6), 2199–2241 (2007)
Cross, D.J., Gilmore, R.: A Schwinger disentangling theorem. J. Math. Phys. 51, 103515-1–5 (2010)
Cushen, C.D., Hudson, R.L.: A quantum-mechanical central limit theorem. J. Appl. Prob. 8(3), 454–469 (1971)
D’Helon, C., Doherty, A.C., James, M.R., Wilson, S.D.: Quantum risk-sensitive control. In: Proc. 45th IEEE CDC, San Diego, CA, USA, 13–15 December, pp. 3132–3137 (2006)
Dupuis, P., Ellis, R.S.: A Weak Convergence Approach to the Theory of Large Deviations. Wiley, New York (1997)
Dupuis, P., James, M.R., Petersen, I.R.: Robust properties of risk-sensitive control. Math. Control Signals Syst. 13, 318–332 (2000)
Edwards, S.C., Belavkin, V.P.: Optimal quantum filtering and quantum feedback control (2005). arXiv:quant-ph/0506018v2
Folland, G.B.: Harmonic Analysis in Phase Space. Princeton University Press, Princeton (1989)
Gardiner, C.W., Zoller, P.: Quantum Noise. Springer, Berlin (2004)
Gikhman, I.I., Skorokhod, A.V.: The Theory of Stochastic Processes. Springer, Berlin (2004)
Gorini, V., Kossakowski, A., Sudarshan, E.C.G.: Completely positive dynamical semigroups of N-level systems. J. Math. Phys. 17(5), 821–825 (1976)
Gough, J., James, M.R.: Quantum feedback networks: Hamiltonian formulation. Commun. Math. Phys. 287, 1109–1132 (2009)
Hartman, P.: Ordinary Differential Equations, 2nd edn. Birkhäuser, Boston (1982)
Holevo, A.S.: Quantum stochastic calculus. J. Sov. Math. 56(5), 2609–2624 (1991)
Holevo, A.S.: Exponential formulae in quantum stochastic calculus. Proc. R. Soc. Edinburgh 126A, 375–389 (1996)
Holevo, A.S.: Statistical Structure of Quantum Theory. Springer, Berlin (2001)
Horn, R.A., Johnson, C.R.: Matrix Anal. Cambridge University Press, New York (2007)
Hudson, R.L.: A short walk in quantum probability. Philos. Trans. R. Soc. A 376, 1–13 (2018)
Hudson, R.L., Parthasarathy, K.R.: Quantum Ito’s formula and stochastic evolutions. Commun. Math. Phys. 93, 301–323 (1984)
Isserlis, L.: On a formula for the product-moment coefficient of any order of a normal frequency distribution in any number of variables. Biometrika 12, 134–139 (1918)
Jacobs, K., Knight, P.L.: Linear quantum trajectories: applications to continuous projection measurements. Phys. Rev. A 57(4), 2301–2310 (1998)
Jacobson, D.H.: Optimal stochastic linear systems with exponential performance criteria and their relation to deterministic differential games. IEEE Trans. Autom. Control 18, 124–31 (1973)
James, M.R.: Risk-sensitive optimal control of quantum systems. Phys. Rev. A 69, 032108-1–14 (2004)
James, M.R.: A quantum Langevin formulation of risk-sensitive optimal control. J. Opt. B 7, S198–S207 (2005)
James, M.R., Gough, J.E.: Quantum dissipative systems and feedback control design by interconnection. IEEE Trans. Autom. Control 55(8), 1806–1821 (2008)
James, M.R., Nurdin, H.I., Petersen, I.R.: $H^{\infty }$ control of linear quantum stochastic systems. IEEE Trans. Autom. Control 53(8), 1787–1803 (2008)
Janson, S.: Gaussian Hilbert Spaces. Cambridge University Press, Cambridge (1997)
Janson, S.: Large deviations for sums of partly dependent random variables. Rand. Struct. Algorithm 24, 234–248 (2004)
Karatzas, I., Shreve, S.E.: Brownian Motion and Stochastic Calculus, 2nd edn. Springer, New York (1991)
Kato, T.: Perturbation Theory for Linear Operators, 2nd edn. Springer, Berlin (1976)
Kwakernaak, H., Sivan, R.: Linear Optimal Control Systems. Wiley, New York (1972)
Landau, L.D., Lifshitz, E.M.: Quantum Mechanics: Non-relativistic Theory, 3rd edn. Pergamon Press, Oxford (1991)
Lindblad, G.: On the generators of quantum dynamical semigroups. Commun. Math. Phys. 48, 119–130 (1976)
Lutzky, M.: Parameter differentiation of exponential operators and the Baker-Campbell-Hausdorff formula. J. Math. Phys. 9(7), 1125–1128 (1968)
Maalouf, A.I., Petersen, I.R.: Coherent LQG control for a class of linear complex quantum systems. In: IEEE European Control Conference, Budapest, Hungary 23–26 August 2009, pp. 2271–2276
Maggiore, M.: A Modern Introduction to Quantum Field Theory. Oxford University Press, New York (2005)
Magnus, W.: On the exponential solution of differential equations for a linear operator. Commun. Pure Appl. Math. 7(4), 649–673 (1954)
Magnus, J.R.: The moments of products of quadratic forms in normal variables. Stat. Neerland. 32, 201–210 (1978)
Merzbacher, E.: Quantum Mechanics, 3rd edn. Wiley, New York (1998)
Meyer, P.-A.: Quantum Probability for Probabilists. Springer, Berlin (1995)
Mustafa, D., Glover, K.: Minimum Entropy $H^{\infty }$-Control. Springer, Berlin (1990)
Nielsen, M.A., Chuang, I.L.: Quantum Computation and Quantum Information. Cambridge University Press, Cambridge (2000)
Nurdin, H.I., James, M.R., Petersen, I.R.: Coherent quantum LQG control. Automatica 45, 1837–1846 (2009)
Ohya, M., Petz, D.: Quantum Entropy and Its Use. Springer, Berlin (1993)
Parthasarathy, K.R.: An Introduction to Quantum Stochastic Calculus. Birkhäuser, Basel (1992)
Parthasarathy, K.R.: What is a Gaussian state? Commun. Stoch. Anal. 4(2), 143–160 (2010)
Parthasarathy, K.R.: Quantum stochastic calculus and quantum Gaussian processes. Indian J. Pure Appl. Math. 46(6), 781–807 (2015)
Parthasarathy, K.R., Schmidt, K.: Positive Definite Kernels, Continuous Tensor Products, and Central Limit Theorems of Probability Theory. Springer, Berlin (1972)
Parthasarathy, K.R., Sengupta, R.: From particle counting to Gaussian tomography. Inf. Dim. Anal. Quant. Prob. Rel. Top. 18(4), 1550023 (2015)
Petersen, I.R.: Guaranteed non-quadratic performance for quantum systems with nonlinear uncertainties. In: American Control Conference (ACC), 4–6 June (2014). arXiv:1402.2086 [quant-ph]
Petersen, I.R.: Quantum linear systems theory. Open Autom. Control Syst. J. 8, 67–93 (2017)
Petersen, I.R., James, M.R., Dupuis, P.: Minimax optimal control of stochastic uncertain systems with relative entropy constraints. IEEE Trans. Autom. Control 45, 398–412 (2000)
Petersen, I.R., Ugrinovskii, V.A., James, M.R.: Robust stability of uncertain linear quantum systems. Philos. Trans. R. Soc. A 370, 5354–5363 (2012)
Sakurai, J.J.: Modern Quantum Mechanics. Addison-Wesley, Reading, MA (1994)
Shaiju, A.J., Petersen, I.R.: A frequency domain condition for the physical realizability of linear quantum systems. IEEE Trans. Autom. Control 57(8), 2033–2044 (2012)
Shiryaev, A.N.: Probability, 2nd edn. Springer, New York (1996)
Varadhan, S.R.S.: Large deviations. Ann. Prob. 36(2), 397–419 (2008)
Vladimirov, V.S.: Methods of the Theory of Generalized Functions. Taylor & Francis, London (2002)
Vladimirov, I.G., Petersen, I.R.: Hardy-Schatten norms of systems, output energy cumulants and linear quadro-quartic Gaussian control. In: Proc. 19th Int. Symp. Math. Theor. Networks Syst., Budapest, Hungary, 5–9 July, pp. 2383–2390 (2010)
Vladimirov, I.G., Petersen, I.R.: A dynamic programming approach to finite-horizon coherent quantum LQG control. In: Australian Control Conference, Melbourne, 10–11 Nov 2011, pp. 357–362 (2011). arXiv:1105.1574v1 [quant-ph]
Vladimirov, I.G., Petersen, I.R.: A quasi-separation principle and Newton-like scheme for coherent quantum LQG control. Syst. Control Lett. 62(7), 550–559 (2013)
Vladimirov, I.G., Petersen, I.R.: Coherent quantum filtering for physically realizable linear quantum plants. In: Proc. European Control Conference, IEEE, Zurich, Switzerland, pp. 2717–2723, 17–19 July 2013
Vladimirov, I.G., Petersen, I.R., James, M.R.: Risk-sensitive performance criteria and robustness of quantum systems with a relative entropy description of state uncertainty. In: 23rd International Symposium on Mathematical Theory of Networks and Systems (MTNS 2018), Hong Kong University of Science and Technology, 16–20 July 2018 (2018). arXiv:1802.00250 [quant-ph]
Walls, D.F., Milburn, G.J.: Quantum Optics, 2nd edn. Springer, Berlin (2008)
Whittle, P.: Risk-sensitive linear/quadratic/Gaussian control. Adv. Appl. Probab. 13, 764–77 (1981)
Wilcox, R.M.: Exponential operators and parameter differentiation in quantum physics. J. Math. Phys. 8(4), 962–982 (1967)
Wiseman, H.M., Milburn, G.J.: Quantum Measurement and Control. Cambridge University Press, Cambridge (2009)
Yamamoto, N., Bouten, L.: Quantum risk-sensitive estimation and robustness. IEEE Trans. Autom. Control 54(1), 92–107 (2009)
Yosida, K.: Functional Analysis, 6th edn. Springer, Berlin (1980)
Zhang, G., James, M.R.: Quantum feedback networks and control: a brief survey. Chin. Sci. Bull. 57(18), 2200–2214 (2012)
Acknowledgements
The authors thank the anonymous reviewers for useful comments.
Author information
Authors and Affiliations
Corresponding author
Additional information
This work is supported by the Air Force Office of Scientific Research (AFOSR) and Office of Naval Research Global (ONRG) under Agreement Number FA2386-16-1-4065 and the Australian Research Council (ARC) under Grant DP180101805.
Appendices
Appendix A: Commutator of Quadratic Polynomials of Quantum Variables Satisfying CCRs
Since the commutator \(\mathrm {ad}_{\xi }\), associated with a given operator \(\xi \), is a derivation, then repeated application of this property leads to
for any operators a, b, c, d. Hence, if these operators satisfy CCRs (that is, their pairwise commutators are identity operators up to scalar factors), then the right-hand side of (A1) is a quadratic polynomial of a, b, c, d. Therefore, quadratic polynomials of such operators form a Lie algebra with respect to the commutator. For the purposes of Sect. 4, we will provide a version of (A1) for quadratic polynomials of operators satisfying the CCRs.
Lemma 4
Suppose \(a:=(a_j)\), \(b:=(b_k)\), \(c:=(c_{\ell })\), \(d:=(d_r)\) are vectors of self-adjoint operators which satisfy the CCRs
where \(\varTheta _{jk}\) are real matrices. Also, let \(F:= (f_{jk})\) and \(G:=(g_{\ell r})\) be appropriately dimensioned complex matrices which specify the bilinear forms
Then their commutator is also a quadratic polynomial of the operators which is computed as
In the case \(a=b\) (when the vectors a and b are identical), (A4) takes the form
where \({\mathbf {S}}(F):= \frac{1}{2}(F+F^{\mathrm{T}})\) denotes the symmetrizer of square matrices. \(\square \)
Proof
By recalling the bilinearity of the commutator, applying (A1) to the operators \(a_j\), \(b_k\), \(c_{\ell }\), \(d_r\) in (A3) and using the CCRs (A2), it follows that
The right-hand side of (A6) is a quadratic function of the operators whose vector-matrix form is given by (A4). If \(a=b\), then F in (A3) is a square matrix, and the matrices in (A2) satisfy \(\varTheta _{1k}=\varTheta _{2k}\) for every \(k=1,2\). In this case, (A6) reduces to
which establishes (A5). \(\square \)
Similar commutation relations hold for bilinear forms of annihilation and creation operators (see, for example, [29, Appendix B] and [61, Lemma 4.2]) and are used in the context of Schwinger’s theorems on exponentials of such forms [10].
Appendix B: Covariance of Quadratic Functions of Gaussian Quantum Variables
For the purposes of Sect. 5, we will need the following lemma on the covariance of bilinear forms of Gaussian quantum variables.
Lemma 5
Suppose the self-adjoint quantum variables, constituting the vectors a, b, c, d in Lemma 4, are in a zero-mean Gaussian state. Then the covariance of the bilinear forms in (A3), specified by complex matrices F and G, can be computed as
In the case when \(a=b\) and \(c=d\), the relation (B1) reduces to
where \({\mathbf {S}}\) is the symmetrizer. \(\square \)
Proof
The mean value of the first bilinear form in (A3) is computed as
where \({\mathbf {E}}(ab^{\mathrm{T}}) = \mathbf {cov}(a,b)\) since the underlying quantum variables are assumed to have zero mean values. By a similar reasoning, the second bilinear form in (A3) has the mean value
Application of the Wick–Isserlis theorem [35, Theorem 1.28 on pp. 11–12] (see also [28] and [44, p. 122]) to the fourth-order mixed moment of the zero-mean Gaussian quantum variables \(a_j\), \(b_k\), \(c_{\ell }\), \(d_r\) leads to
The covariance of the bilinear forms (A3) can now be computed by combining (B3)–(B5) as
which establishes (B1). Application of (B1) to the particular case \(a=b\) and \(c=d\) leads to
thus proving (B2). In (B6) use has also been made of the symmetry of the matrix \( \mathbf {cov}(a,c) {\mathbf {S}}(G) \mathbf {cov}(a,c)^{\mathrm{T}} \), the orthogonality of the subspaces of symmetric and antisymmetric matrices, and the fact that the symmetrizer commutes with the complex conjugation: \({\mathbf {S}}({\overline{F}} ) = \overline{{\mathbf {S}}(F)}\). \(\square \)
Appendix C: An Averaging Lemma with Multifactor Convolutions
For the purposes of the cumulant growth rate results of Theorem 4 in Sect. 6, we provide an averaging lemma which involves multifactor convolutions (145).
Lemma 6
Suppose \(f_1, \ldots , f_r\) are appropriately dimensioned complex matrix-valued functions on the real line which are bounded and absolutely integrable, with \(r\geqslant 2\). Then
where \(t_{r+1} := t_1\), and \(F_k(\lambda ):= \int _{-\infty }^{+\infty } f_k(t)\mathrm {e}^{-i\lambda t} \mathrm {d}t\) denotes the Fourier transform of \(f_k\). \(\square \)
Proof
Since the integrand on the left-hand side of (C1) depends on the integration variables \(t_1, \ldots , t_r\) only through their differences, they can be translated so as to represent the integral in the form
where
Here, use is made of the new integration variables \( \tau _k := t_k-t_1 \) for all \( k=2, \ldots , r \) together with the corresponding convention \(\tau _1 = \tau _{r+1}=0\). The right-hand side of (C3) is organized as the convolution \((f_1* \cdots *f_r)(0)\) (evaluated at 0) except that the integration is restricted to the cube \([-t_1, t-t_1]^{r-1}\). Now, the fulfillment of the inclusions \(t_1 \in [0, t]\) and \((\tau _2, \ldots , \tau _r) \in [-t_1, t-t_1]^{r-1}\) is equivalent to \(t_1\) belonging to the (possibly empty) interval
of length
Here,
inherits from the function \(\chi _t\) in (105) the properties of being bounded by and convergent to 1 as \(t\rightarrow +\infty \) for any given \(\tau _2, \ldots , \tau _r \in {\mathbb {R}}\). By combining (C2)–(C6), it follows that
where Lebesgue’s dominated convergence theorem is applicable since the functions \(f_1, \ldots , f_r\) are bounded and absolutely integrable (and hence, so are their convolutions). The limit in (C7) is \((f_1* \cdots *f_r)(0)\), which establishes the first of the equalities (C1), with the second of them following from the convolution theorem. \(\square \)
Rights and permissions
About this article
Cite this article
Vladimirov, I.G., Petersen, I.R. & James, M.R. Multi-point Gaussian States, Quadratic–Exponential Cost Functionals, and Large Deviations Estimates for Linear Quantum Stochastic Systems. Appl Math Optim 83, 83–137 (2021). https://doi.org/10.1007/s00245-018-9512-y
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00245-018-9512-y