Abstract
This work introduces a new one-step method with three intermediate points for solving stiff differential systems. These types of problems appear in different disciplines and, in particular, in problems derived from chemical reactions. In fact, the term “stiff”’ was coined by Curtiss and Hirschfelder in an article on problems of chemical kinetics (Hirschfelder, Proc Natl Acad Sci USA 38:235–243, 1952). The techniques of interpolation and collocation are used in the construction of the scheme. We consider a suitable polynomial to approximate the theoretical solution of the problem under consideration. The basic properties of the new scheme are analyzed. An embedded strategy is adopted to formulate the proposed scheme in a variable stepsize mode to get better performance. Finally, some models of initial-value problems, including ordinary and time-dependent partial differential equations, are solved numerically to assess the performance and efficiency of the proposed technique, with applications to real-world problems.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction
In this article, we are concerned with constructing a strategy to obtain an approximate solution to the following first-order IVP:
where \( t_{0} \) and \( t_{N} \) denote the initial and final points of the integration interval, and the function w(t, u) fulfils the Lipchitz’s condition that guarantees the existence and uniqueness theorem given in [2].
Many physical phenomena in which a quantity varies in time and at the same time relies upon its past values could be modelled by (1). For example, equation (1) has been used to model many real-world application problems in different disciplines, including physics, electrical and mechanical engineering, economics, mathematical chemistry, or mathematical biology.
Numerical treatments of a type of problem (1) have received a lot of consideration because most of the differential equations arising from the modelling of physical phenomena do not have known theoretical solutions. Thus, it is of practical interest to consider numerical solutions for such model problems.
We remark that to choose the most efficient and stable numerical technique for computing (1), it is preferable to have qualitative information about the solution. The primary information is the stiffness of the problem. The explicit Runge–Kutta methods (ERKMs) are generally unsuitable for the solution of stiff problems because ERKMs may fail to provide the solution or give wrong results. The instability of ERKM methods motivated researchers in this field to consider implicit Runge–Kutta methods (IRKMs). Several IRKMs have been proposed and applied by different scholars to solve stiff IVPs of the form in (1). Among the various IRKMs you can consult [3,4,5,6,7,8,9,10].
Another numerical strategy for integrating (1) is the implicit multistep-methods (IMMs); IMMs utilize the estimation of the approximation at more than one mesh point to calculate approximate solutions at the next point. The IMMs need another strategy to start them, leading to an increase in the total number of function evaluations and CPU time. Numerous outstanding researchers in Numerical Analysis have used different IMMs for solving (1). Some interesting monographs that have employed IMMs to provide approximate solutions to stiff and non-stiff problems are those in [11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28].
Several approximate techniques have been proposed recently for the numerical treatment of (1). Among those techniques, we can mention a higher-order embedded method proposed by Kim et al. [29], the Chebyshev collocation technique by Piao et al. [30], the highly stable implicit–explicit schemes presented by Izzo and Jackiewicz [31], the general linear methods developed by Abdi and Jackiewicz [32], the new hybrid symmetric technique by Kovalnogov et al. [33], a fitted finite difference approach by Chen and Simos [34], or the Numerov-type methods proposed by Medvedeva et al. [35].
This article presents and applies a suitable error estimation and stepsize controller for a newly developed one-step A-stable method (OSASM) for solving (1). Although the development of the method and its theoretical analysis has been carried out for a scalar problem, we must point out that it can also be applied for solving initial-value differential systems, as shown in Sect. 5.
2 Mathematical formulation of the OSASM
Consider a partition \(t_0<t_1<\cdots < t_N\) with \(h= t_{j+1}-t_j\) and suppose that the theoretical solution of the IVP in (1) on a generic subinterval \([t_n, t_{n+1}]\), is approximated by the following polynomial
whose first derivative can be approximated by
where \(a_j\in \mathbb {R}\) are unknown coefficients that would be obtained imposing some collocation and interpolation conditions at specified nodes.
The OSASM is formulated by considering three off-step points \(t_{n+c_1}=t_n+ c_1 h\), \(t_{n+c_2}=t_n+ c_2 h\), and \(t_{n+c_3}=t_n+ c_3 h\) with \(0<c_1<c_2<c_3<1\), on \([t_n, t_{n+1}]\).
Equation (2) is evaluated at \(t_n\), and the one in (3) is also evaluated at \(t_n,t_{n+c_1},t_{n+c_2},t_{n+c_3},t_{n+1}\) to get a system of equations
with six unknowns \(a_n,n=0(1)5\), where \(u_{n+j}\) and \(w_{n+j}\) denote respectively approximations of \(u(t_{n+j})\) and \(u'(t_{n+j})=w(t_{n+j},u(t_{n+j}))\).
After getting the values of \(a_n,n=0(1)5\), and substituting them into the Eq. (2), and replacing the variable \(t=t_n+xh,\) then, the polynomial in (2) may be written as
where \( \alpha _0(x)=1\), and the coefficients \(\left\{ \beta _i(x)\right\} _{i=0,c_1, c_2,c_3,1}\) depend on \(c_1,c_2,c_3\).
Taking \(x=1\) in (4), which corresponds to the point \(t_{n+1}=x_n+h\), after inserting \(c_1=\frac{1}{2}-\frac{2}{\sqrt{21}},\, c_2=\frac{1}{2},\,c_3=\frac{1}{2}+\frac{2}{\sqrt{21}}\), we obtain the following formula, which is the main scheme of the proposed OSASM:
We note that the values of the \(c_i\) are not taken arbitrarily, but after optimizing the local truncation error (LTE) of the formula in (4). In order to provide numerical solutions to problem (1) simultaneously at the points \(t_{n+c_1},t_{n+c_2},t_{n+c_3},t_{n+1}\), we also take \(x=c_1,x=c_2,x=c_3\). Doing this, we obtain a total of four formulas that form the OSASM. The remaining formulas are
3 Theoretical analysis of the OSASM technique
This section gives the theoretical analysis of the OSASM technique, concerning the order of accuracy, convergence and linear stability analysis.
3.1 Order of accuracy, consistency, and convergence of the OSASM
We rewrite the scheme in (5)–(6) as
where \(\bar{R}, \bar{S}\) denote constant matrices containing the coefficients of the Formulas (5)–(6), and
We define the operator \({\gamma }\) related to the OSASM in (5)–(6) as
where \(\Theta _j\) and \(\Psi _j \) are respectively vector columns of \(\bar{R}\) and \(\bar{S}\), and \(I=\{0,c_1,c_2,c_3,1\}\). Expanding \(u\left( t_{n}+jh\right) \) and \(u'\left( t_{n}+jh\right) \) in Taylor series about \(t_n\), we get
where
and \(q=0,1,2,\dots \)
Considering the Formulas (5)–(6), we get \(\theta _{0}=0, \theta _{1}=0,\dots , \theta _{5}=0\) and
which is the vector of LTEs of the OSASM formulas. The method in (5)–(6) may be reformulated as a Runge–Kutta method, and thus the theory for these methods can be applied here. The vector of stage values is given by \(c=\left( 0,c_1,c_2,c_3,1\right) \) and the coefficients of the Butcher array can be obtained readily from the Formulas (5)–(6). It is a routine task to check that the order conditions are verified up to order 6, which ultimately is the order of the method.
It is worth remarking that the scheme is zero-stable since the OSASM is a one-step method. Since the order is greater than one, then OSASM is consistent with the differential problems under consideration. It is also important to note that the OSASM is convergent because OSASM is zero-stable and consistent.
3.2 Linear stability analysis of the OSASM
The concept of linear stability analysis (LSA) plays an essential role in the solution of IVPs in ODEs. This LSA is frequently referred to as absolute stability, and is crucial when solving stiff differential equations. Owing to this, we study the linear stability of the newly developed technique by applying the method in (7) to the following standard test equation
where \(\eta \) stands for a complex parameter and the above equation has a bounded solution that will be zero as t tends to infinity. Applying the scheme in (5)–(6) to (11) to have
where \(\eta \) is a complex parameter and S(z) denotes the following stability matrix
with
The obtained eigenvalues for S(z) are \(\left\{ 0,0,0,\frac{5 z^4+198 z^3+2076 z^2+10,080 z+20,160}{5 z^4-198 z^3+2076 z^2-10,080 z+20,160}\right\} \).
It is observed that the numerical solution relies upon the reported eigenvalues, and the stability properties of the new scheme will be characterized by the spectral radius, \( \rho ( S(z))\). The region of absolute stability \(\mathbb {S}\) for the proposed method is represented as \(\mathbb {S}= \left\{ z\in \mathbb {C}: \left| \rho ( S(z)) \right| < 1 \right\} \) and its domain is displayed in Fig. 1. The proposed OSASM is A-stable because the left half complex plane is contained in \(\mathbb {S}\).
4 Error estimation and control strategy of the proposed method
In order to obtain an efficient implementation of any numerical technique and solve challenging problems like the stiff differential equations, estimating and controlling some measure of errors by varying the step size is required. The proposed method given in (5)–(6) may be formulated and computed in variable step-size mode (VSS) by using a lower order technique to estimate the local error (LE) at the final point on each iteration. To achieve a robust estimation of the LTE, we adopt a similar approach as in the book by Ascher and Petzold [27]. The following multi-step formula of order \(p =4\)
and local truncation error \((LTE)=-\frac{17 h^5 u^{(5)}\left( t_n\right) }{120,960} +O\left( h^6\right) \) has been used to estimate the LE at the end-point. This error estimate provides the basis for determining the step-size for the next step. The estimation of the LE is obtained through the quotient
where we have taken \(\Vert \cdot \Vert \) as the maximum norm, and ATOL and RTOL are predefined absolute and relative tolerances, respectively. If \(EST \le \) ATOL, then we accept the results and take the next step as \(h_{new} = 2 \times h_{old}\). If \(EST > \) ATOL, then we reject the obtained results by decreasing the step-size and repeat the calculations with the following new step
where \(0< \mu < 1\) is a suitable adjustment factor whose purpose is to avoid failed steps during implementation.
5 Implementation details of the OSASM
The proposed A-stable technique is implemented in a step by step mode. We rewrite the system in (5)–(6) as \(\varvec{W(u)=0}\) where the unknowns are
Since the OSASM is an implicit scheme, we use modified Newton’s method (MNM) to solve the obtained system of non-linear equations. The MNM is given by
where \({\textbf {J}}\) represents the Jacobian matrix of \({\textbf {W}}\). The starting values to use MNM for solving the systems on each iteration are taken as
The developed method can also be applied using a componentwise implementation to solve systems of first-order IVPs with m equations of the form:
where \({\textbf {u}}=(u_1,\dots ,u_m)^T\),
and \({\textbf {u}}_0=(u_{1,0},\dots ,u_{m,0} )^T\). In the case of m-dimensional IVPs, we get on each step an algebraic system of 4m non-linear equations, which we also solve utilizing MNM, as in the scalar one-dimensional IVPs. The stopping criterion and the maximum number of iterations used while executing the MNM are \( \Vert \tilde{{\textbf {U}}}^{i+1}-\tilde{{\textbf {U}}}^{i}\Vert \le 2 \times ATOL\) and 100, respectively.
6 Numerical experiments
Here, we illustrate the numerical performance of the proposed OSASM on some real-life model first-order IVPs. We note that the effectiveness and efficiency of the method in (5)–(6) and the strategy in (14) will rely on the VSS approach given in (15). To measure the accuracy of the proposed OSASM with other existing numerical strategies, the following error formulas have been considered
where \(u(t_j)\) is the exact solution, and \({u_j}\) is the computed result at each point \(t_j\) of the discrete grid.
The following methods have been considered for comparisons:
-
BBDM: The block backward differentiation method in [36].
-
SDGLM: The second derivative general linear method in [37].
-
ode15s: A multistep solver reported in [37].
-
RADAU-IIA: The implicit Runge–Kutta method of order five in [22].
-
CCM: The Chebyshev Collocation Method of order eight in [30].
-
NDSolve : The built-in package solver in Mathematica.
6.1 Test Problem 1
In the first problem, we solve a scalar stiff problem [36], given by
The true solution of this problem is
In Table 1, we can observe the data for this problem. Not only the proposed method is the one that provides the best maximum absolute error (MAXAE), but it presents the lowest number of steps (NS), being the most efficient of the methods considered. Figure 2 shows the absolute errors along the integration interval and the exact and the discrete solutions for the proposed method for ATOL = RTOL \( = 10^{-6}, h_{ini} = 10^{-2}\).
6.2 Test Problem 2
Consider a non-linear stiff first-order system of ODEs [37] given by
The exact solution to this system is
The results in Table 2 show again the good performance of the proposed method.
6.3 Test Problem 3
We also consider the non-linear well-known Robertson’s chemical problem which has been studied earlier by Mazzia and Iavernaro [38]
To compare the maximum absolute errors, the following reference solution at the final point \(t_N = 40\) given in [38] has been used,
The data in Table 3 indicates the outstanding performance of the proposed method for this problem, where the total number of function evaluations (NFEVAL) is considerably reduced compared with the methods used for comparison.
6.4 Test Problem 4
We consider the Chapman model problem that describes how ozone is generated and destroyed with conditions useful for the lower to the middle stratosphere. In this case, the atmosphere consists of the chemistry of \(O_{2}, O\) and \(O_{3}\). In this situation, there are four chemical reactions [39]
where \(k_{1}, k_{2},k_{3},k_{4}\) stand for the reaction rates, M stands for an additional molecule required to carry off excess energy, and hv represents the absorption of light, a photochemical process. The first reaction produces ozone, but the second and third reactions produce ozone destruction. The amount of molecular oxygen, \(\textrm{O}_{2}\), is kept constant for this problem (a reasonable assumption in the atmosphere). The first two reaction rates are constant (only functions of temperature), whereas the subsequent two, which are determined by light absorption, change during the day. The resulting system has the following form if we set \(u_{1}, u_{2}, u_{3} \) to be the concentrations of \(\textrm{O}, \textrm{O}_{2}, \textrm{O}_{3}\), respectively:
with the constant values
and
being
Figure 3 shows the numerical results from the OSASM with ATOL = RTOL \( = 10^{-6}, h_{ini} = 10^{-3}\). This figure shows that the solutions provided by the proposed method are in good agreement with the numerical results in [40].
6.5 Test Problem 5
We also consider the Belousov–Zhabotinskii chemical reaction Oregonator problem originated from chemistry, given as follows: [37]
The numerical results in Table 4 show again the good efficiency of the OSASM method.
6.6 Test Problem 6
Consider the following one-dimensional stiff Burgers’ equation model problem given in [30]
whose exact solution is unknown. Burgers’ equation is a mathematical model of the motion of a viscous compressible gas, where u is the speed of the gas, v is the kinematic viscosity, x is the spatial coordinate, and t is the time.
Test Problem 4 is solved by discretizing the first-order and second-order spatial derivatives, and then applying the proposed method, following a similar procedure as in the method of lines. The \(u_x\) and \(u_{xx}\) in Problem 4 are discretized by the classical approximations
where \(\delta x = \dfrac{(x_{M+1}-x_{0})}{M+1}\), and M is the internal number of spatial nodes. The data in Table 5 indicates the good performance of the proposed method for the Burgers’ problem. The approximate solutions provided by NDSolve and the OSASM method for Problem 6 are displayed in Fig. 4.
7 Conclusion
This article introduced a VSS formulation of a new OSASM. The proposed OSASM is sixth-order convergent with the favorable characteristic of A-stability. The proposed OSASM has been successfully used to integrate problem (1), and the obtained numerical results confirmed that the OSASM is a suitable solver for solving stiff differential systems. The procedure of controlling the step size using a reasonable error estimation and an adaptive strategy to get better accuracy is also described. The efficiency of the OSASM, when compared with some existing techniques, is remarkable.
References
C.F. Curtiss, J.O. Hirschfelder, Integration of stiff equations. Proc. Natl Acad. Sci. USA 38, 235–243 (1952)
P. Henrici, Discrete Variable Methods in ODEs (Wiley, Nef York, 1962)
J.C. Butcher, Implicit Runge–Kutta processes. Math. Comput. 18, 50–64 (1964)
J.R. Cash, S. Considine, An MEBDF code for stiff initial value problems. ACM Trans. Math. Softw. 18, 142–155 (1992)
G.J. Cooper, R. Vignesvaran, Some schemes for the implementation of implicit Runge–Kutta methods. J. Comput. Appl. Math. 45, 213–225 (1993)
K. Gustafsson, Control-theoretic techniques for stepsize selection in implicit Runge–Kutta methods. ACM Trans. Math. Softw. 20(4), 496–517 (1994)
G.J. Cooper, J.C. Butcher, An iteration scheme for implicit Runge–Kutta methods. IMA J. Numer. Anal. 3, 127–140 (1983)
J.C. Butcher, G. Wanner, Runge–Kutta methods: some historical notes. Appl. Numer. Math. 22, 113–151 (1996)
J. Vigo-Aguiar, H. Ramos, A new eighth-order A-stable method for solving differential systems arising in chemical reactions. J. Math. Chem. 40(1), 71–83 (2006)
Z. Wang, B. Guo, Legendre–Gauss–Radau collocation method for solving initial value problems of first order ordinary differential equations. J. Sci. Comput. 52(1), 226–255 (2012)
W.B. Gragg, H.J. Stetter, Generalized multistep predictor–corrector methods. J. ACM 11(2), 188–209 (1964)
M.A. Rufai, H. Ramos, Numerical integration of third-order singular boundary-value problems of Emden–Fowler type using hybrid block techniques. Commun. Nonlinear Sci. Numer. Simul. 105, 106069 (2022)
M.A. Rufai, H. Ramos, Solving third-order Lane–Emden–Fowler equations using a variable step-size formulation of a pair of block methods. J. Comput. Appl. Math. 420, 114776 (2023)
M.A. Rufai, H. Ramos, Numerical solution of third-order boundary value problems by using a two-step hybrid block method with a fourth derivative. Comput. Math. Methods 3(6), e1166 (2021). https://doi.org/10.1002/cmm4.1166
M.A. Rufai, H. Ramos, Numerical solution for singular boundary value problems using a pair of hybrid Nyström techniques. Axioms 10, 202 (2021)
M.A. Rufai, H. Ramos, Numerical solution of Bratu’s and related problems using a third derivative hybrid block method. Comput. Appl. Math. 39, 322 (2020)
H. Ramos, M.A. Rufai, An adaptive pair of one-step hybrid block Nyström methods for singular initial-value problems of Lane–Emden–Fowler type. Math. Comput. Simul. 193, 497–508 (2022)
J.D. Lambert, Numerical Methods for Ordinary Differential Systems (Wiley, New York, 1991)
M.A. Rufai, H. Ramos, A variable step-size fourth-derivative hybrid block strategy for integrating third-order IVPs, with applications. Int. J. Comput. Math. 99(2), 292–308 (2022)
H. Ramos, M.A. Rufai, An adaptive one-point second-derivative Lobatto-type method for solving efficiently differential systems. Int. J. Comput. Math. 99(8), 1687–1705 (2022)
E. Hairer, G. Wanner, Solving Ordinary Differential Equations. II. Springer Series in Computational Mathematics, Stiff and Differential-Algebraic Problems, vol 14, 2nd revised edition (Springer, Berlin, 2010), paperback
J.C. Butcher, Numerical Methods for Ordinary Differential Equations (Wiley, New York, 2008)
L. Brugnano, D. Trigiante, Solving Differential Problems by Multistep Initial and Boundary Value Methods (Gordon and Breach Science Publishers, New York, 1998)
L.F. Shampine, M.W. Reichelt, The MATLAB ODE suite. SIAM J. Sci. Comput. 18, 1–22 (1997)
C. Fredebeul, A-BDF, a generalization of the backward differentiation formulae. SIAM J. Numer. Anal. 35, 1917–1938 (1998)
M. Jankowska, A. Marciniak, On two families of implicit interval methods of Adams–Moulton type. Comput. Methods Sci. Technol. 12(2), 109–113 (2006)
U.M. Ascher, L.R. Petzold, Computer Methods for Ordinary Differential Equations and Differential-Algebraic Equations (Society for Industrial and Applied Mathematics (SIAM), Philadelphia, 1998)
A. Marciniak, M.A. Jankowska, T. Hoffmann, On interval predictor–corrector methods. Numer. Algorithms 75(3), 777–808 (2017)
P. Kim, J. Kim, W. Jung, S. Bu, A higher order error embedded method based on generalized Chebyshev polynomials. J. Comput. Phys. 306, 55–72 (2016)
X. Piao, S. Bu, D. Kim, P. Kim, An embedded formula of the Chebyshev collocation method for stiff problems. J. Comput. Phys. 351, 376–391 (2017)
G. Izzo, Z. Jackiewicz, Highly stable implicit–explicit Runge–Kutta methods. Appl. Numer. Math. 113, 71–92 (2017)
A. Abdi, Z. Jackiewicz, Towards a code for nonstiff differential systems based on general linear methods with inherent Runge–Kutta stability. Appl. Numer. Math. 136, 103–121 (2019)
V.N. Kovalnogov, R.V. Fedorov, T.E. Simos, New hybrid symmetric two step scheme with optimized characteristics for second order problems. J. Math. Chem. 20, 1–29 (2018)
X. Chen, T.E. Simos, A phase fitted FiniteDiffr process for DiffrntEqutns in chemistry. J. Math. Chem. (2020). https://doi.org/10.1007/s10910-020-01104-7
M.A. Medvedeva, T.E. Simos, Ch. Tsitouras, Variable step-size implementation of sixth-order Numerov-type methods. Math. Methods Appl. Sci. 43(3), 1204–1215 (2020)
M.B. Suleiman, H. Musa, F. Ismail, N. Senu, A new variable step size block backward differentiation formula for solving stiff initial value problems. Int. J. Comput. Math. 90(11), 2391–2408 (2013)
A. Abdi, D. Conte, Implementation of second derivative general linear methods. Calcolo 57, 20 (2020). https://doi.org/10.1007/s10092-020-00370-w4
F. Mazzia, F. Iavernaro, Test Set for Initial Value Problems Solvers (University of Bari, Department of Mathematics, Bari, 2003)
C.J. Aro, CHEMSODE: a stiff ODE solver for the equations of chemical kinetics. Comput. Phys. Commun. 97, 304 (1996)
M. Falati, G. Hojjati, Integration of chemical stiff ODEs using exponential propagation method. J. Math. Chem. 49, 2210 (2011)
Funding
Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Ramos, H., Rufai, M.A. A new one-step method with three intermediate points in a variable step-size mode for stiff differential systems. J Math Chem 61, 673–688 (2023). https://doi.org/10.1007/s10910-022-01427-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10910-022-01427-7
Keywords
- Ordinary differential equations
- Stiff problems
- Variable step-size formulation
- Error estimation and control
- Collocation and interpolation techniques