Abstract
Certain applications produce initial value ODEs whose solutions, regarded as time-dependent matrices, preserve orthonormality. Such systems arise in the computation of Lyapunov exponents and the construction of smooth singular value decompositions of parametrized matrices. For some special problem classes, there exist time-stepping methods that automatically inherit the orthonormality preservation. However, a more widely applicable approach is to apply a standard integrator and regularly replace the approximate solution by an orthonormal matrix. Typically, the approximate solution is replaced by the factorQ from its QR decomposition (computed, for example, by the modified Gram-Schmidt method). However, the optimal replacement—the one that is closest in the Frobenius norm—is given by the orthonormal polar factor. Quadratically convergent iteration schemes can be used to compute this factor. In particular, there is a matrix multiplication based iteration that is ideally suited to modern computer architectures. Hence, we argue that perturbing towards the orthonormal polar factor is an attractive choice, and we consider performing a fixed number of iterations. Using the optimality property we show that the perturbations improve the departure from orthonormality without significantly degrading the finite-time global error bound for the ODE solution. Our analysis allows for adaptive time-stepping, where a local error control process is driven by a user-supplied tolerance. Finally, using a recent result of Sun, we show how the global error bound carries through to the case where the orthonormal QR factor is used instead of the orthonormal polar factor.
Similar content being viewed by others
References
Angelika Bunse-Gerstner, Ralph Byers, Volker Mehrmann, and Nancy K. Nichols,Numerical computation of an analytic singular value decomposition of a matrix valued function, Numer. Math., 60 (1991), pp. 1–39.
Luca Dieci, Robert D. Russell, and Erik S. van Vleck,Unitary integrators and applications to continuous orthonormalization techniques, SIAM J. Numer. Anal., 31 (1994), pp. 261–281.
Luca Dieci, Robert D. Russell, and Erik S. Van Vleck,On the computation of Lyapunov exponents for continuous dynamical systems, SIAM J. Numer. Anal., to appear.
Luca Dieci and Erik S. Van Vleck,Computation of a few Lyapunov exponents for continuous and discrete dynamical systems, Appl. Numer. Math., to appear.
Gene H. Golub and Charles F. Van Loan,Matrix Computations, Johns Hopkins University Press, Baltimore, Maryland, second edition, 1989. ISBN 0-8018-3739-1.
E. Hairer, S. P. Nørsett, and G. Wanner,Solving Ordinary Differential Equations I, Nonstiff Problems, Springer Verlag, second edition, 1993.
P. Henrici,Discrete Variable Methods in Ordinary Differential Equations, John Wiley and Sons, New York, 1962.
Desmond J. Higham. Runge-Kutta type methods for orthogonal integration. Technical Report NA/168, University of Dundee, 1996, Appl. Numer. Math., to appear.
Desmond J. Higham and Andrew M. Stuart,Analysis of the dynamics of local error control via a piecewise continuous residual, Technical Report SCCM-95-03, Stanford University, 1995.
Nicholas J. Higham,Computing the polar decomposition—with applications, SIAM J. Sci. Stat. Comput., 7:4 (1986), pp. 1160–1174.
Nicholas J. Higham,Matrix nearness problems and applications, in M. J. C. Gover and S. Barnett, editors, Applications of Matrix Theory, pp. 1–27. Oxford University Press, 1989.
Nicholas J. Higham and Pythagoras Papadimitriou,A parallel algorithm for computing the polar decomposition, Parallel Computing, 20 (1994), pp. 1161–1173.
Nicholas J. Higham and Robert S. Schreiber,Fast polar decomposition of an arbitrary matrix, SIAM J. Sci. Stat. Comput., 11:4 (1990), pp. 648–655.
G. J. Lord,Analysis of numerical methods suitable for computing Lyapunov exponents, Technical Report 95/02, University of Bath, 1995.
The MathWorks, Inc.MATLAB User's Guide. Natick, Massachusetts, 1992.
Volker Mehrmann and Werner Rath,Numerical methods for the computation of analytic singular value decompositions, Electronic Transactions on Numerical Analysis, 1 (1993), pp. 72–88.
L. F. Shampine,Conservation laws and the numerical solution of ODEs, Comp. Maths. Applics., 12B (1986), pp. 1287–1296.
Ji-guang Sun,A note on backward perturbations for the Hermitian eigenvalue problem, BIT, 35 (1995), pp. 385–393.
Author information
Authors and Affiliations
Additional information
This work was supported by Engineering and Physical Sciences Research Council grants GR/H94634 and GR/K80228.
Rights and permissions
About this article
Cite this article
Higham, D.J. Time-stepping and preserving orthonormality. Bit Numer Math 37, 24–36 (1997). https://doi.org/10.1007/BF02510170
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF02510170