Abstract
Determination of the distribution function of relaxation times (DFRT) is an approach that gives us more detailed insight into system processes, which are not observable by simple electrochemical impedance spectroscopy (EIS) measurements. DFRT maps EIS data into a function containing the timescale characteristics of the system under consideration. The extraction of such characteristics from noisy EIS measurements can be described by Fredholm integral equation of the first kind that is known to be ill-posed and can be treated only with regularization techniques. Moreover, since only a finite number of EIS data may actually be obtained, the above-mentioned equation appears as after application of a collocation method that needs to be combined with the regularization. In the present study, we discuss how a regularized collocation of DFRT problem can be implemented such that all appearing quantities allow symbolic computations as sums of table integrals. The proposed implementation of the regularized collocation is treated as a multi-parameter regularization. Another contribution of the present work is the adjustment of the previously proposed multiple parameter choice strategy to the context of DFRT problem. The resulting strategy is based on the aggregation of all computed regularized approximants, and can be in principle used in synergy with other methods for solving DFRT problem. We also report the results from the experiments that apply the synthetic data showing that the proposed technique successfully reproduced known exact DFRT. The data obtained by our techniques is also compared to data obtained by well-known DFRT software (DRTtools).
1 Introduction
In electrochemical impedance spectroscopy (EIS), the experiments are usually interpreted by fitting complex-valued impedance measurements \( Z\left( {\omega_{j} } \right) = Z^{\prime } \left( {\omega_{j} } \right) + iZ^{\prime \prime } \left( {\omega_{j} } \right), j = 0,1, \ldots ,N - 1, \) against chosen equivalent electrical circuit (EEC) models. One of such EEC model is known as the Voight circuit (Barsoukov and Macdonald 2005) which is composed of a series of parallel capacitors \( C_{m} \) and resistors \( R_{m} , m = 0,1, \ldots ,M - 1 \), for which the impedance can be written as:
where \( \tau_{m} = R_{m} C_{m} \). The high-frequency cut-off resistance (R∞) can be also added to (1), but herein it is omitted for simplicity. This R∞ can be estimated from EIS measurements at large angular frequencies (ω).
Moreover, EIS experiments cannot often be described by a finite number of simple resistor–capacitor (RC) elements, because they involve distributed time constants. Then a Voigt circuit with an infinite number of RC elements can also be used to fit the impedance data \( \left( {Z\left( {\omega_{j} } \right)} \right) \). However, instead of discrete values \( R_{m} = \tau_{m} C_{m}^{ - 1} \) [see (1)], one should use \( R = g\left( \tau \right) \) to obtain a continuous version of (1):
where \( g\left( \tau \right) \) describes the time relaxation characteristic of the electrochemical system under study.
Up to a certain extent \( g\left( \tau \right) \) provides a circuit model-free representation of essential relaxation times, which are directly connected to the charge transfer process (see, e.g., Song and Bazant 2018). One should bear in mind that not only Voigt circuit, but also other known circuit models, such as a Cole–Cole (Cole and Cole 1941) model, Davidson–Cole (Davidson and Cole 1951) model, Warburg element (Barsoukov and Macdonald 2005), etc., can also be discussed in terms of the Eq. (2).
Furthermore, since we are interested in a real-valued solution \( g\left( \tau \right) \) of (2), the Eq. (2) can be reformulated into the system of integral equations with operators \( A_{1} ,A_{2} \):
where \( Z^{\prime } \left( \omega \right), Z^{\prime \prime } \left( \omega \right) \) are real and imaginary parts of \( Z\left( \omega \right) \).
If we observe that instead of the whole function \( Z\left( \omega \right) \), only the impedance measurements \( Z\left( {\omega_{j} } \right) = Z^{\prime } \left( {\omega_{j} } \right) + iZ^{\prime \prime } \left( {\omega_{j} } \right), j = 0,1, \ldots ,N - 1 \) are available, then the system (3) is reduced to a collocation and can be abstractly written as:
where TN is the so-called sampling operator, which assigns to each function F(ω) a vector of its values at the collocation points \( \omega_{j} \), i.e., \( T_{N} F = (F\left( {\omega_{0} } \right), F\left( {\omega_{1} } \right), \ldots ,F\left( {\omega_{N - 1} } \right). \)
Recall that the collocation is a special form of discretization that arises when we replace the original problem, such as (3), by one in a finite dimensional space. In case of collocation this space is just the Euclidean space \( R^{N} \) of vectors \( u = \left( {u_{0} ,u_{1} , \ldots ,u_{N - 1} } \right) \), \( v = \left( {v_{0} ,v_{1} , \ldots ,v_{N - 1} } \right) \) equipped with a scalar product
and the corresponding norm \( \left\| \cdot \right\|_{{R^{N} }} \); here the weights \( \gamma_{j} ,j = 0,1, \ldots .,N - 1 \), are some positive numbers.
Note that if operators \( A_{1} ,A_{2} \) are considered to be acting from the space \( L_{2} \left( {0,\infty } \right) \) of real-valued square summable functions on \( \left( {0,\infty } \right) \) then the Eq. (4), due to their finite dimension, are always solvable at least in the sense of least squares. Moreover, least square solutions of (4) can be reduced to the corresponding systems of N linear algebraic equations, such that no additional discretization is required and, as a result, no additional discretization error is introduced. Therefore, the impedance measurements considered as collocation data already hint at a way to approximate the solution of (2).
At the same time, in the EIS literature, one mainly finds two other different approaches for approximate solving of (2). In the first approach, which has been studied in Dion and Lasia (1999), Gavrilyuk et al. (2017) and Renaut et al. (2013), the integral operators \( A_{1} ,A_{2} \) in (4) are additionally discretized by means of quadrature formulas. This approach can also subsume the methods (Boukamp 2015; Boukamp and Rolle 2017; Schichlein et al. 2002) in which the Eq. (2) is reduced to a deconvolution problem by a suitable change of variables, after which a numerical Fourier transform is employed. This procedure is usually conducted by using diverse approximation techniques such as quadrature formula (Boukamp 2015). The second approach, advocated in Saccoccio et al. (2014) and Wan et al. (2015), discretizes the operators \( A_{1} ,A_{2} \) in (4) by projection onto the subspaces of piecewise linear or radial basis functions (RBFs).
In both previously mentioned approaches the level of additional discretization, governed by the number of knots of a quadrature formula or by the number of basis functions, should be properly tuned. Such tuning is especially crucial in the case of noisy impedance measurements when the application of regularization techniques avoids numerical instabilities in solving (4). Then, according to the Regularization theory (see, e.g., Mathe and Pereverzev 2003) the level of additional discretization of \( A_{1} ,A_{2} \) in (4) should be coordinated with the amount of regularization. However, such coordination has not been discussed in the aforementioned literature yet. At the same time, this discretization issue does not even appear in (4) as no additional discretization of the operators \( A_{1} ,A_{2} \) is introduced. Therefore, in the present paper, we study a new approach to obtain \( g\left( \tau \right) \) that avoids any additional discretization of the operators in (4).
Furthermore, it is known that the imaginary and real components \( Z^{\prime \prime } \left( {\omega_{j} } \right), Z^{\prime } \left( {\omega_{j} } \right) \) of the impedance have different importance. A more thorough analysis of Eq. (3) indicates that \( g\left( \tau \right) \) has a greater impact on \( \text{Im} \left( {Z\left( \omega \right)} \right) \) then on \( \text{Re} \left( {Z\left( \omega \right)} \right) \) (see, e.g., Dion and Lasia 1999). In that case it seems reasonable to treat the Eq. (4) with different amount of regularization (i.e., by applying two regularization parameters). At the same time, in the aforesaid literature, regularization of the Eq. (4) is governed by only one regularization parameter that does not allow a desired flexibility in exercising the regularization. There is one exception though, namely the paper (Zhang et al. 2016) that proposes to minimize a multi-parameter version of the Tikhonov regularization functional also over the values of regularization parameters. However, the above minimization problem may have several local minima, and one of them corresponds to zero values of the regularization parameters that leads to unregularized least-squares.
Herein, we propose a new approach that applies a multi-parameter regularization scheme without unnecessary additional discretization. We have also added to this approach an ability to automatically choose regularization parameter values. Note that this kind of endeavor has not been reported in the aforementioned literature. In addition, in order to enable an automatic regularization in the present study, we use the idea (Chen et al. 2015) of an aggregation of regularized solutions corresponding to different values of multiple regularization parameters.
2 Multi-parameter regularization of the collocated impedance equations
In this section we analyze a methodology for joint regularization of the collocation Eq. (4) that leads to a multi-parameter regularization. The joint regularization can be formulated as the minimization of the objective functional:
Here, the first two terms are the measures of data misfit that are weighed with the regularization parameters \( \lambda_{1} ,\lambda_{2} \subseteq \left( {0,\infty } \right) \). These misfits measures are combined in (5) with a regularization measure. According to, e.g., Chen et al. (2015), the minimizer \( g = g_{{\lambda_{1} ,\lambda_{2} }} \left( \tau \right) \) of (5), can be found from the operator equation:
where \( \left( {T_{N} A_{1} } \right)^{*} \) and \( \left( {T_{N} A_{2} } \right)^{*} \) are the adjoins of \( T_{N} A_{1} \) and \( T_{N} A_{2} \) respectably, and they are defined by the relations:
that should be satisfied for any \( f \subseteq L_{2} \left( {0,\infty } \right) \) and \( u = \left( {u_{0} ,u_{1} , \ldots ,u_{N - 1} } \right) \subseteq R^{N} . \)
In view of the definition of \( T_{N} ,A_{1} {\mkern 1mu} {\text{and}}{\mkern 1mu} \left\langle {u,v} \right\rangle_{{R^{N} }} = \sum\nolimits_{j = 0}^{N - 1} {\gamma_{j} } u_{j} v_{j} ,\gamma_{j} > 0 \) we have
Now from (7) we can conclude that for any \( u = \left( {u_{0} ,u_{1} , \ldots ,u_{N - 1} } \right) \subseteq R^{N} \) it holds:
On the other hand, the definition of the adjoint operator \( \left( {T_{N} A_{1} } \right)^{*} \) indicates that it should be N-dimensional operator from \( R^{N} \) to \( L_{2} \left( {0,\infty } \right) \) and, as such, it should allow the representation:
where \( l_{j} \subseteq L_{2} \left( {0,\infty } \right),e^{j} \subseteq R^{N} . \) Comparing this with (8) we arrive at the formulas
where \( \delta_{kj} \) is the Kronecker delta, i.e., \( \delta_{kj} = 0\,{\text{for}}\,k \ne j,\,{\text{and}}\,\delta_{jj} = 1 \).
By a similar argument, we can also obtain the following representation:
where
Next, from (9)–(12) one can deduce that the solution of (6) admits the representation:
The unknown coefficients \( g_{i} = 0,1, \ldots ,2N - 1, \) can be found from the following system of linear algebraic equations:
where \( a_{1,k,N + k} = \frac{{\gamma_{k} }}{{2\omega_{k} }},\, k = 0,1, \ldots ,N - 1, \).
and following (Zoltowski 1984) we use the following weights
in the definition of the data misfits norm \( \left\| \cdot \right\|_{{R^{N} }} \).
From (13), (14) it is clear that for given \( \lambda_{1} ,\lambda_{2} \) the regularized approximate solution \( g_{{\lambda_{1} ,\lambda_{2} }} \) of (4) can be constructed without additional discretization of the integral operators \( A_{1} , A_{2} \).
3 Aggregation of the regularized approximants in weighted norms
Note that in the EIS literature, the weighted solutions \( \tau^{\nu } g\left( \tau \right), \nu = 1, \) of the impedance Eq. (2) are of interest by themselves (see, e.g., Dion and Lasia 1999; Wan et al. 2015) and they are often called distribution functions of relaxation time (DFRT). Moreover, researchers are often interested in the behavior of DFRT only within a specific time window \( \tau \subseteq \left[ {W_{min} , W_{max} } \right] \subset \left[ {0,\infty } \right) \). Therefore, for example, if \( \tilde{g}\left( \tau \right) \) is an approximate solution of the impedance Eq. (2), such as \( \tilde{g} \left( \tau \right) = g_{{\lambda_{1} ,\lambda_{2} }} \left( \tau \right) \), then it seems to be reasonable to measure approximation error in the weighted norm:
It is clear that this norm is a Hilbert space norm which is generated by the scalar product:
While we have described the explicit procedure (13), (14) for approximating the solutions of (2) directly from the impedance measurements without the application of discretization, there is still a question about the choice of the regularization parameters \( \lambda_{1} ,\lambda_{2} \) that determines suitable relative weighting between these measurements. By setting \( \lambda_{1} = 0\,{\text{or}}\,\lambda_{2} = 0 \), one may reduce this question to the case discussed in Gavrilyuk et al. (2017). In another particular case \( \lambda_{1} = \lambda_{2} = \lambda \), one may choose a suitable value of \( \alpha = \lambda^{ - 1} \) by a cross-validation technique, as it was suggested in Wan et al. (2015). In both particular situations, one in fact deals with a single-parameter regularization which is applied in, e.g., Weese (1992) FTIKREG and DRTtools (Wan et al. 2015) software. However, a multi-parameter regularization is much less studied in EIS topic, especially when multiple regularization parameters are employed to construct a common misfit measure as in (5). Herein, we use new findings developed originally for inverse problems of satellite geodesy (Chen et al. 2015) and recently adjusted in the context of EIS (Zic and Pereverzyev 2018).
Note that known regularization parameter choice strategies usually consist of using some criteria for selecting only one particular candidate from a family of approximate solutions calculated for different values of regularization parameters from a sufficiently wide range. In contrast, in Chen et al. (2015) it is proposed to construct a new approximate solution in the form of a linear combination of all calculated approximants. In the present context this means, for example, that at first we calculate \( g_{{\lambda_{1} ,\lambda_{2} }} \left( \tau \right) \) for some values \( \lambda_{1} = \lambda_{1,p} , p = 0,1,2, \ldots ,P - 1, \lambda_{2} = \lambda_{2,q} ,q = 0,1,2, \ldots ,Q - 1, \) deserving consideration, and then consider a new approximate solution:
where
and \( c_{m} \) are coefficients to be determined.
In view of the previously mentioned discussion, it is natural to choose the coefficients cm such that \( \tilde{g} \) provides the best approximation of the exact solution \( g \) in the norm \( \left\| \cdot \right\|_{{L_{2,\nu } \left( {W_{min} W_{max} } \right)}} \) among all linear combinations (16). Since \( \left\| \cdot \right\|_{{L_{2,\nu } \left( {W_{min} W_{max} } \right)}} \) is a Hilbert space norm, then the coefficients vector \( \vec{c} = \left( {c_{0} ,c_{1} , \ldots ,c_{PQ - 1} } \right) \) corresponding to the best approximation (16) should solve the following matrix vector equation:
where
If the regularized approximants
are already calculated from (13), (14), then the elements of the matrix \( G \) can be exactly calculated as well. Indeed, from (18) it follows that
where
and \( l_{i} \left( \tau \right),l_{j} \left( \tau \right) \) are given by (10), (12). The above integrals can be explicitlyFootnote 1 calculated. For example, for \( \nu = 1\,{\text{and}}\,i,j = N + 1, \ldots ,2N - 1 \) we have
On the other hand, the components \( F_{m} \) of the vector \( \vec{F} \) in (17) depend on the unknown solution \( g \) of (2), and therefore are inaccessible.
At the same time, in Chen et al. (2015) and Kindermann et al. (2018) we can find an approach to estimate the components of the vector \( \vec{F} \) by using the so-called quasi-optimality criterion in the linear functional strategy. The advantage of this approach is that the values of the scalar products \( F_{m} = \left\langle {g,g^{m} } \right\rangle_{{L_{{2,\nu \left( {W_{min} , W_{max} } \right)}} }} \) of the solution \( g \) can be estimated much more accurately than the solution \( g \) in the norm \( \left\| \cdot \right\|_{{L_{2,\nu } \left( {W_{min} W_{max} } \right)}} \). According to Chen et al. (2015) and Kindermann et al. (2018) we estimate the scalar product \( \left\langle {g,g^{m} } \right\rangle \) by \( \left\langle {f_{\alpha } ,g^{m} } \right\rangle_{{L_{{2,\nu \left( {W_{min} , W_{max} } \right)}} }} \), where \( f_{\alpha } \left( \tau \right) \) is the regularized approximate solutions \( g_{{\lambda_{1} ,\lambda_{2} }} \left( \tau \right) \) given by (13) and constructed for \( \lambda_{1} = 0, \lambda_{2} = \alpha \), with the use of only imaginary part of the impedance data. The reason for this is that the imaginary part may allow better accuracy than the real part of the impedance (see, e.g., Dion and Lasia 1999).
In principle, the values of \( \lambda_{2} = \alpha \) may be taken from the same set \( \left\{ {\lambda_{2,q} } \right\}_{q = 0}^{Q - 1} \) as the one above. However, in Chen et al. (2015) and Kindermann et al. (2018) it is suggested to take \( \alpha = \alpha_{s} \) from a geometric sequence \( \alpha_{s} = \alpha_{0} \beta^{s} , s = 0,1, \ldots ,S - 1, S > Q \). Therefore, we consider
where \( g_{j} = g_{j}^{0,s} \) are the solutions of the linear system (14) with \( \lambda_{1} = 0, \lambda_{2} = \alpha_{s} , s = 0,1, \ldots ,S - 1 \), and
Then, according to the quasi-optimality criterion in the linear functional strategy (Kindermann et al. 2018) we select such \( s = s_{m} \) that
The theoretical analysis of Kindermann et al. (2018) guarantees that the values of \( F_{m} = \left\langle {g,g^{m} } \right\rangle \) are well approximated by the values of \( \tilde{F}_{m} = \left\langle {f_{{\alpha_{sm} }} ,g^{m} } \right\rangle \).
Recall that vector \( \vec{c} \) of the coefficients of the best linear combination of (16) approximating the solution \( g \) of (2) in the norm \( \left\| \cdot \right\|_{{L_{2,\nu } \left( {W_{min} W_{max} } \right)}} \) should solve the matrix vector Eq. (17).
According to the aggregation strategy (Chen et al. 2015) we approximate this ideal vector by the vector \( \tilde{c} = \left( {\tilde{c}_{0} ,\tilde{c}_{1, \ldots ,} \tilde{c}_{PQ - 1} } \right) \) solving in the least squares sense the approximate matrix vector equation
Then the theoretical analysis of Chen et al. (2015) guarantees that the approximate solution
is almost as good as the best linear approximation (16) of the calculated regularized solutions \( g_{{\lambda_{1,p} ,\lambda_{2,q} }} \left( \tau \right) \).
We have described an adaptive procedure that automatically constructs an approximate solution of (2). This procedure should theoretically perform at the level of the best regularized approximant \( g_{{\lambda_{1} ,\lambda_{2} }} \left( \tau \right) \) calculated according to (13), (14) for a given range of \( \lambda_{1} , \lambda_{2} \). The input of the procedure consists of the impedance data \( Z\left( {\omega_{j} } \right), j = 0,1, \ldots ,N - 1 \), the weights \( \gamma_{j} , j = 0,1, \ldots ,N - 1 \) determining the misfits measures, the endpoints \( W_{min} , W_{max} \) of the time window of interest, and the numbers \( \lambda_{0,1} ,\lambda_{0,2} ,\alpha_{0} ,P,Q,S \) defining the range of the regularization parameters under consideration.
4 Experimental
4.1 Synthetic and polluted ZARC2 and FRAC2 impedance data
The synthetic data in this work were prepared by using both Cole–Cole (i.e., ZARC) and Davidson–Cole (i.e., FRAC) relations. According to the literature (Barsoukov and Macdonald 2005), ZARC is widely used in Distribution Function of Relaxation Times (DFRT) study (see, e.g., Wan et al. 2015); and thus, a model of two ZARC elements was used to compute the synthetic ZARC2 data in this work:
where \( \omega \) is angular frequency, \( R_{\infty } , R_{j} , j = 1, 2 \) are resistances and \( \tau_{0,j} \) is a time constant.
On the other hand, FRAC element is not often seen in the real experiments although it has been commonly applied when testing different DFRT approaches (Boukamp and Rolle 2017; Dion and Lasia 1999). This element is of a special interest in our paper as it is very hard to reconstruct DFRT data due to discontinuities at some time points \( \tau \). Hence, to provide a more complete study, a model of two FRAC elements was used to prepare the synthetic FRAC2 data:
Herein, we are interested in the comparison of performances of different regularization techniques, and we consider the synthetic ZARC2 and FRAC2 data polluted by noise:
where NF = 0.001 and \( \eta^{\prime } ,\eta^{\prime \prime } \) are independent normally distributed random variables with zero mean and the variance one. This approach to simulate noisy data is similar to one reported in Wan et al. (2015).
As the majority of regularization techniques in EIS study employs discretization, the applied frequency values were equally spaced in the logarithmic scale from 0.01 Hz to 100 kHz, taking 10 points per decade. Parameters used to compute the synthetic ZARC2 and FRAC2 data are given in Table 1.
4.2 Analytical DFRT for ZARC2 and FRAC2
Since we applied synthetic ZARC2 and FRAC2 data, it is natural to compare their reconstructed DFRT with the analytical ones. This is a usual approach which enables fast and consistent evaluation of new DFRT methods (see, e.g., Dion and Lasia 1999; Wan et al. 2015). This approach is especially relevant as our reconstruction method (i.e., DFRT-Py) utilizes automatic choice of parameters. Herein, we applied the following analytical form to compute DFRT (abbreviated here as DFRTZARC2) of the synthetic ZACR2 data:
whilst for synthetic FRAC2 the corresponding DFRT (i.e., DFRTFRAC2) is given by:
4.3 Measured impedance data
For the purpose of this study experimental measurements were performed on solid oxide fuel cells (Fig. 11). The cells were of industrial-size with a chemically active surface of 80 cm2, whereby the operating temperature was set to be 800 °C. The fuel electrode was fed with humidified hydrogen, and the air electrode was supplied with air. For the purpose of this study impedance measurements were performed starting with the open circuit conditions, further loading the cell and decreasing the voltage down to 0.7 V. The EIS measurements were carried out using a galvanostatic technique. The AC amplitude was set to be 4% of the DC values, whereby the voltage was measured. The measurements were performed in a frequency range between 10 kHz and 100 mHz. For more detailed information about the experimental setup, the authors refer to Subotić et al. (2018).
4.4 DFRT software used in this work
Although there are several DFRT software that can be used in EIS study (see Sect. 5.1), we decided to apply (and commentFootnote 2) only those listed in Table 2. The first one is FTIKREG developed by Weese (1992), which is a well-known FORTRAN library that has been continuously used to construct DFRT from impedance data. The second one is DRTtools produced by Wan et al. (2015) that applies radial basis functions (RBFs) to discretize DFRT. And the last one, DFRT-Py by Zic and Pereverzyev (2018), which does not apply discretization. Note that programs given in Table 2 are rather different as they apply diverse strategies (e.g., single- and multi-parameter regularization) to reconstruct DFRT data (see details in Sect. 5.1).
In order to extract DFRT from impedance data by using the listed software (Table 2), one needs to adjust several parameters (Table 3). Specifically, in DRTtools both regularization and RBF shape parameters need to be a priori chosen. However, when chosen they were not modified in this work (unless otherwise specified). Furthermore, the regularization parameter in FTIKREG can be manually given or it can be obtained by using the self-consistent (SC) method (Honerkamp and Weese 1990) (Table 3). And finally, in the case of DFRT-Py, there are two sets of parameters. The first set of parameters (Fig. 1a) was applied in Sects. 5.2–5.4, whilst in Sect. 5.5 we used parameters shown in Fig. 1b.
Screenshot of the DFRT-Py regularization parameters that were used in a synthetic data study, b measured data study. Note that only in the case of measured data study (see b inset) the weights (15) were equal to ones
As listed programs (Table 2) apply single- and multi-parameter regularization, it is important to emphasize that DFRT data were constructed from combined \( \text{Re} \left( {Z\left( \omega \right)} \right) \) and \( \text{Im} \left( {Z\left( \omega \right)} \right) \) parts (see Table 3). Interestingly, some researchers prefer the application of only \( \text{Re} \left( {Z\left( \omega \right)} \right) \) part because it is less affected by noise and errors (Ivers-Tiffee and Weber 2017). This approach is a common one, especially when dealing with noisy data. On the other hand, there are papers (Dion and Lasia 1999) that claim that better DFRT results are obtained by the usage of only \( \text{Im} \left( {Z\left( \omega \right)} \right) \). The choice to use only \( \text{Im} \left( {Z\left( \omega \right)} \right) \) can be explained by the fact that DFRT has greater impact on this part of impedance data (see (3)).
5 Results and discussion
5.1 Existing DFRT approaches
According to DFRT literature (Ivers-Tiffee and Weber 2017; Kobayashi and Suzuki 2018), there are numerous approaches to extract the Distribution Function of Relaxation Times (DFRT) data from electrochemical impedance spectroscopy (EIS) data. The majority of reported approaches is based on evolutionary programming (Hershkovitz et al. 2011; Tesler et al. 2010) and Monte Carlo techniques (Tuncer and Macdonald 2006), maximum entropy model (Horlin 1998), Fourier filtering (Boukamp 2015; Schichlein et al. 2002), and regularization techniques (Dion and Lasia 1999; Kobayashi et al. 2016; Kobayashi and Suzuki 2018; Wan et al. 2015; Zic and Pereverzyev 2018). Additionally, the first software to extract DFRT from EIS data is based on Fourier transform technique (Kobayashi and Suzuki 2018). However, in this work we are focused on the regularization techniques that are embedded in FTIKREG, DRTtools and DFRT-Py software (Table 2); and thus, there are several facts that should be discussed.
First, the approaches in FTIKREG and DRTtools are based on discretization methods (Table 2). To be precise, in FTIKREG, all functions and operators are approximated by finite-dimensional vectors and matrices (Weese 1992) whereas, in DRTtools the approximation error is somewhat reduced due to the application of radial basis functions (RBFs) (Wan et al. 2015) as discretization basis. On the other hand, DFRT-Py applies table integrals; and thus, any additional discretization errors are avoided (Zic and Pereverzyev 2018). Second, in DRTtools the regularization parameter should be given a priori, whilst in FTIKREG this parameter can be given manually or it can be obtained by a self-consistent (SC) method (Honerkamp and Weese 1990). However, this method is heavily based on the assumption that the noise is independent standard Gaussian random variable (Honerkamp and Weese 1990), which is frequently not the case when dealing with measured EIS data. Oppositely to DRTtools and FTIKREG, in DFRT-Py, the regularized solutions are aggregated, which allows an automatic regularization (Zic and Pereverzyev 2018). Third, the discretization procedure in DRTtools requires a priori choice of RBF shape parameter (Wan et al. 2015), which indicates that both regularization and the shape parameters have to be properly chosen. Interestingly, this action is avoided when operating with FTIKREG and DFRT-Py, as they do not apply any parameterized basis functions. And finally, DRTtools and FTIKREG apply a single-parameter regularization even when using combined real and imaginary impedance parts, whereas DFRT-Py applies a multi-parameters regularization.
To sum up, the aforementioned software (Table 2) apply different approaches to extract DFRT data from the EIS data; and thus, to properly probe different approaches they were tested by a series of the synthetic and measured data.
5.2 DFRT study of noisy ZARC2 and FRAC2 impedance data
To illustrate the impact of the measurements noise, the polluted (NF = 0.001) synthetic ZARC2 and FRAC2 data were analyzed (Fig. 2a, b). Nowadays, it is common practice to apply the noisy data in DFRT study and readers are encouraged to review the following papers, e.g., Dion and Lasia (1999) and Wan et al. (2015). Although the application of NF = 0.001 offers at least 0.1% of noise (see Eq. (23)), it should be mentioned that normally distributed noise can take arbitrary large values. In this work, the impact of noise can be observed at f > 0.4 Hz and f > 2.00 Hz (see insets in Fig. 2a, b).
Next, DFRT of ZARC2 and FRAC2 data (Fig. 2a, b) obtained by DFRT-Py software are displayed in Fig. 3. Note that the impact of noise on DFRTZARC2 and DFRTFRAC2 data is presented in Fig. 3a, b, whilst insets in Fig. 3a, b represent data obtained from non-polluted synthetic data. The constructed DFRTZARC2 data perfectly match the analytical ones (see Fig. 3a inset), whereas the height of the right (vs. left) DFRTFRAC2 peak is somewhat higher. According to Fig. 3a and inset in Fig. 3a, it follows that the noise induced DFRTZARC2 oscillations at τ > 0.05 s (Fig. 3a). On the other hand, it is obvious that discontinuities induced DFRTFRAC2 oscillations in Fig. 3b inset, whereas these oscillations are additionally amplified due to the presence of noise (Fig. 3b).
Analytical and aggregated DFRT data of polluted (NF = 0.001), a ZARC2, b FRAC2 data (Fig. 2a, b) obtained by DFRT-Py. Insets in a, b show DFRT data of unpolluted ZARC2 and FRAC2
At the same time, DFRTZARC2 and DFRTFRAC2 obtained by DRTtools show no oscillations (Fig. 4a, b). Furthermore, the lack of oscillations can be attributed to the application of RBF (Wan et al. 2015) as a basis for discretization. However, it appears that application of RBF smooths DFRT data that can result in a possible loss of DFRT-related information. Furthermore, the application of DRTtools (Fig. 4a, b) leads to the occurrence of additional border peaks between τ = 10−6 and 10−4 s. The origin of the border peaks in DFRT data (obtained by using FTIKREG) was also discussed in Ivers-Tiffee and Weber (2017). It was concluded that these peaks contain no additional information and that they could be attributed to the presence of the noise. As DFRT-Py yielded data without the border peaks (Fig. 3), it is fair to say that discretization errors in DRTtools might be responsible for the formation of the border peaks in Fig. 4.
DFRT data of noisy (NF = 0.001), a ZARC2, b FRAC2 data (Fig. 2a, b) obtained by the DRTtools. Insets in a, b show DFRT data of unpolluted ZARC2 and FRAC2 data
5.3 Effect of missing data points on DFRT study
To investigate further the difference between single- and multi-parameters regularization approaches (Table 2), they have been probed by analyzing noisy ZARC2 and FRAC2 data from which two impedance data points at 15.85 and 158.49 Hz are removed (Fig. 5a, b). This frequency values are chosen (Fig. 5) as they correspond to the positions of DFRTZARC2 and DFRTFRAC2 peaks maxima (see Fig. 6).
Analytical and aggregated DFRT data of noisy (NF = 0.001), a ZARC2, b FRAC2 data (Fig. 5a, b) obtained by DFRT-Py
The idea to study the missing data effect originates from the literature (Boukamp and Rolle 2017; Ivers-Tiffee and Weber 2017) as some authors (Boukamp and Rolle 2017) reported that this effect induces changes in DFRT spectra. On the other hand, one group of authors concluded (Ivers-Tiffee and Weber 2017) that this effect has no impact on DFRT study. However, the conclusions presented in Boukamp and Rolle (2017) and Ivers-Tiffee and Weber (2017) are obtained by using two different software (FTIGREG and DRTtools) that apply single-parameter regularization. Thus, it would be intriguing to see the effect of missing data onto both single- and multi-parameter regularizations techniques.
Our experiment shows that when using ZARC2 data (Fig. 5a), DFRT-Py produced two DFRTZARC2 peaks of the same height that perfectly match the analytical ones (Fig. 6a). On the other hand, DRTtools produced two unexpected features in Fig. 7a. The first feature is that DFRTZARC2 peaks are separated by a large depression, which presents a problem because such two peaks configuration can be easily misinterpreted as the one corresponding to DFRTFRAC2 peaks (Fig. 7b) i.e., to Davidson–Cole (Davidson and Cole 1951) model but not to Cole and Cole (1941) Cole–Cole model. The second unexpected feature is the fact that there are two additional erroneous peaks at ≈ 10−4 and ≈ 10−1 s (Fig. 7a), which further hinder DFRT interpretation.
DFRT data of noisy (NF = 0.001), a ZARC2, b FRAC2 data (Fig. 5a, b) obtained by the DRTtools. Left insets in both a, b are obtained by using only Re(Z(ω)) parts, whereas right insets in both a, b are obtained by using only Im(Z(ω)) parts
Furthermore, supplementary calculations with DRTtools indicate that when using only real impedance part (left inset in Fig. 7a), both the depression and the peaks turn out to be more pronounced. At the same time, when using only imaginary impedance part (right inset in Fig. 7a), the depression disappears as two DFRTZARC2 peaks are merged into one. This clearly indicates that the same regularization parameter value (e.g., 10−3) cannot be applied when using single or combined impedance parts in the regularization. To rephrase it, for a proper regularization of combined real and imaginary impedance parts, the multi-parameter regularization (as in DFRT-Py) seems to be unavoidable.
Next, a computation of FRAC2 impedance data shows that both DFRT-Py (Fig. 6b) and DRTtools (Fig. 7b) are not drastically affected by the missing data effect. To be specific, this effect increased oscillation at τ > 0.01 s in Fig. 6b, but there are no additional peaks in Fig. 7b. Moreover, it appears that DRTtools yielded almost identical data in Fig. 7b and in Fig. 7b insets, which suggests that the missing data effect is not observed because RBF cannot properly mimic discontinuities in DFRTFRAC2 anyway.
To summarize, it appears that both the missing data effect and the application of additional discretization basis (i.e., RBFs) yield similar DFRTZARC2 and DFRTFRAC2 pictures and hinder their distinguishment. At the same time, this kind of problems can be avoided when using DFRT-Py as this software does not apply any unnecessary discretization techniques. However, the full benefit of the application of the regularization without unnecessary discretization will become obvious in the next section when using impedance data corresponding to randomly spaced (in logarithmic scale) frequency values.
5.4 Effect of unequally spaced frequency data on DFRTZARC2 and DFRTFRAC2 study
In order to further inspect advantages of avoiding unnecessary discretization (see Table 2), the noisy ZARC2 and FRAC2 data (Fig. 8a, b) are prepared by using unequally (i.e., randomly) spaced frequency values from 0.01 Hz to 100 kHz interval. The data points are also randomly spaced around points at 15.85 and 158.49 Hz that can be related to DFRT peaks. Although such kind of spacing is not so usual in practice, these data (Fig. 8a, b) can be used as, e.g., a dataset for testing newly developed DFRT methods.
Figure 9a, b display DFRTZARC2 and DFRTFRAC2 data approximated by DFRT-Py. The oscillations in Fig. 9a, b are increased, which is attributed to the “higher” level of data corruption (i.e., application of unequally spaced frequency data). The positions of reconstructed (vs. analytical) DFRTZARC2 peaks show insignificant offset towards right, but the peaks are of the same height. Furthermore, the height of the right (vs. left) DFRTFRAC2 peak is slightly increased, which can be attributed to the vicinity of two discontinuities. Overall, DFRT-Py yielded DFRTZARC2 and DFRTFRAC2 peaks with positions that match well to the positions of the analytical ones.
Analytical and aggregated DFRT data of noisy (NF = 0.001), a ZARC2, b FRAC2 data (Fig. 8a, b) obtained by DFRT-Py
On the other hand, it appears that DFRTZARC2 and DFRTFRAC2 peaks obtained by DRTtools are shifted to the left (Fig. 10a, b). Additionally, DFRTZARC2 peaks are separated by depression, whilst DFRTFRAC2 peaks are merged. To be exact, Fig. 10b suggests that the right DFRTFRAC2 peak is moved to the left and merged with the left one. The same observation can be obtained by analyzing data in Fig. 10b insets. This indicates that the considered level of data corruption is so “high” that RBF discretization fails in reconstruction.
DFRT data of noisy (NF = 0.001), a ZARC2, b FRAC2 data (Fig. 8a, b) obtained by the DRTtools. Left insets in a, b are obtained by using only Re(Z(ω)) parts, whereas right insets in a, b are obtained by using only Im(Z(ω)) parts
In contrast, DFRT-Py yielded DFRT peaks with no positions offset, but with higher level of oscillation.
5.5 Real experiment data in DFRTZARC2 and DFRTFRAC2 study
The next experiments uses measurements of Nyquist spectra of industrial-size oxide fuel cell displayed in Fig. 11. By comparing this figure with Fig. 8, one may conclude that the level of data perturbation in Fig. 11 is similar to that in Fig. 8. Moreover, Fig. 11 hints that the data are characterized by two time constants that should yield two DFRT peaks. Furthermore, the number of frequency data points is 19, which is much less (< 71) than in the case of synthetic data experiments (Sects. 5.2–5.4). However, a low number of data points is desirable as it reduces total measurement time, which enables fast insight in DFRT data.
Figure 12 represents DFRT curves obtained by DRTtools and DFRT-Py. DRTtools data were obtained by the application of two different values of FWHM coefficients (see Table 3), namely 0.2 and 0.35, whilst DFRT-Py parameters are shown in the screenshot b) of Fig. 1. DFRT curves in Fig. 12 are characterized by two peaks, i.e., by one modest and one prominent. It appears that the positions of the reconstructed prominent DFRT peaks are rather similar (i.e., − 0.35, − 0.37, and − 0.46). At the same time, the positions of the modest DFRT peaks exhibit an excessive offset (− 2.87, − 2.49, and − 1.86). Recall that similar offset in the peaks’ positions was detected in Fig. 10, which was attributed to high level of impedance data perturbation (Fig. 8). Therefore, according to Fig. 12, it is fair to conclude that when data quality and number of data points are low both software should be used side by side in DFRT study.
DFRT data of measured impedance experimental data obtained by DFRT-Py and by DRTtools. Symbol reference: black (–) and red (–) curves were collected when DRTtools applied two different shape factors (0.2 and 0.35; see Table 3), whilst blue (–) curve was obtained by DFRT-Py (color figure online)
6 Conclusions
We have tested and analyzed some of the available DFRT programs based on different regularization strategies i.e., FTIKREG and DRTtools apply single-parameter regularization and diverse discretization techniques whereas, DFRT-Py applies the multi-parameter regularization without any additional discretization.
Our tests show that a single-parameter regularization is suitable for moderately corrupted impedance data. On the other hand, a multi-parameter regularization approach is able to handle the cases where the level of data corruption is higher.
In this work, the positions of reconstructed DFRTZARC2 and DFRTFRAC2 peaks were always equal to the analytical ones only in the case of DFRT-Py. This clearly supports our belief that a full regularization effect can only be obtained when using multi-parameters regularization and directly applying it to impedance data without any additional discretization.
However, when low quality measured experimental data were analyzed by methods under comparison, the positions of DFRT peaks were not the same. This indicates that both software should be used when dealing with low quality data.
Notes
This step allows us to avoid additional discretization; and thus, no numerical integration error will occur.
FTIKREG was not used herein, but its results from literature were commented on.
References
Barsoukov, E., Macdonald, J.R.: Impedance spectroscopy: theory, experiment, and applications. Wiley, New Jersey (2005)
Boukamp, B.A.: Fourier transform distribution function of relaxation times; application and limitations. Electrochim. Acta 154, 35–46 (2015). https://doi.org/10.1016/j.electacta.2014.12.059
Boukamp, B.A., Rolle, A.: Analysis and application of distribution of relaxation times in solid state ionics. Solid State Ion. 302, 12–18 (2017). https://doi.org/10.1016/j.ssi.2016.10.009
Chen, J.Y., Pereverzyev Jr., S., Xu, Y.S.: Aggregation of regularized solutions from multiple observation models. Inverse Prob. 31, 075005 (2015). https://doi.org/10.1088/0266-5611/31/7/075005
Cole, K.S., Cole, R.H.: Dispersion and absorption in dielectrics I. Alternating current characteristics. J. Chem. Phys. 9, 341–351 (1941). https://doi.org/10.1063/1.1750906
Davidson, D.W., Cole, R.H.: Dielectric relaxation in glycerol, propylene glycol, and n-propanol. J. Chem. Phys. 19, 1484–1490 (1951). https://doi.org/10.1063/1.1748105
Dion, F., Lasia, A.: The use of regularization methods in the deconvolution of underlying distributions in electrochemical processes. J. Electroanal. Chem. 475, 28–37 (1999). https://doi.org/10.1016/s0022-0728(99)00334-4
Gavrilyuk, A.L., Osinkin, D.A., Bronin, D.I.: The use of Tikhonov regularization method for calculating the distribution function of relaxation times in impedance spectroscopy. Russ. J. Electrochem. 53, 575–588 (2017). https://doi.org/10.1134/s1023193517060040
Hershkovitz, S., Tomer, S., Baltianski, S., Tsur, Y.: ISGP: Impedance spectroscopy analysis using evolutionary programming procedure. Presented at the ECS Transactions (2011)
Honerkamp, J., Weese, J.: Tikhonovs regularization method for ill-posed problems—a comparison of different methods for the determination of the regularization parameter. Continuum Mech. Thermodyn. 2, 17–30 (1990). https://doi.org/10.1007/bf01170953
Horlin, T.: Deconvolution and maximum entropy in impedance spectroscopy of noninductive systems. Solid State Ion. 107, 241–253 (1998). https://doi.org/10.1016/s0167-2738(98)00008-3
Ivers-Tiffee, E., Weber, A.: Evaluation of electrochemical impedance spectra by the distribution of relaxation times. J. Ceram. Soc. Jpn. 125, 193–201 (2017). https://doi.org/10.2109/jcersj2.16267
Kindermann, S., Pereverzyev, S., Pilipenko, A.: The quasi-optimality criterion in the linear functional strategy. Inverse Prob. (2018). https://doi.org/10.1088/1361-6420/aabe4f
Kobayashi, K., Sakka, Y., Suzuki, T.S.: Development of an electrochemical impedance analysis program based on the expanded measurement model. J. Ceram. Soc. Jpn. 124, 943–949 (2016). https://doi.org/10.2109/jcersj2.16120
Kobayashi, K., Suzuki, T.S.: Distribution of relaxation time analysis for non-ideal Immittance spectrum: discussion and progress. J. Phys. Soc. Jpn. (2018). https://doi.org/10.7566/jpsj.87.094002
Mathe, P., Pereverzev, S.V.: Discretization strategy for linear ill-posed problems in variable Hilbert scales. Inverse Prob. 19, 1263–1277 (2003). https://doi.org/10.1088/0266-5611/19/6/003
Renaut, R.A., Baker, R., Horst, M., Johnson, C., Nasir, D.: Stability and error analysis of the polarization estimation inverse problem for microbial fuel cells. Inverse Prob. (2013). https://doi.org/10.1088/0266-5611/29/4/045006
Saccoccio, M., Wan, T.H., Chen, C., Ciucci, F.: Optimal regularization in distribution of relaxation times applied to electrochemical impedance spectroscopy: ridge and lasso regression methods—a theoretical and experimental study. Electrochim. Acta 147, 470–482 (2014). https://doi.org/10.1016/j.electacta.2014.09.058
Schichlein, H., Muller, A.C., Voigts, M., Krugel, A., Ivers-Tiffee, E.: Deconvolution of electrochemical impedance spectra for the identification of electrode reaction mechanisms in solid oxide fuel cells. J. Appl. Electrochem. 32, 875–882 (2002). https://doi.org/10.1023/a:1020599525160
Song, J., Bazant, M.Z.: Electrochemical impedance imaging via the distribution of diffusion times. Phys. Rev. Lett. 120, 116001 (2018). https://doi.org/10.1103/physrevlett.120.116001
Subotić, V., Stoeckl, B., Lawlor, V., Strasser, J., Schroettner, H., Hochenauer, C.: Towards a practical tool for online monitoring of solid oxide fuel cell operation: an experimental study and application of advanced data analysis approaches. Appl. Energy 222, 748–761 (2018). https://doi.org/10.1016/j.apenergy.2018.03.182
Tesler, A.B., Lewin, D.R., Baltianski, S., Tsur, Y.: Analyzing results of impedance spectroscopy using novel evolutionary programming techniques. J. Electroceram. 24, 245–260 (2010). https://doi.org/10.1007/s10832-009-9565-z
Tuncer, E., Macdonald, J.R.: Comparison of methods for estimating continuous distributions of relaxation times. J. Appl. Phys. (2006). https://doi.org/10.1063/1.2188053
Wan, T.H., Saccoccio, M., Chen, C., Ciucci, F.: Influence of the discretization methods on the distribution of relaxation times deconvolution: implementing radial basis functions with DRTtools. Electrochim. Acta 184, 483–499 (2015). https://doi.org/10.1016/j.electacta.2015.09.097
Weese, J.: A reliable and fast method for the solution of Fredholm integral-equations of the 1st kind based on Tikhonov regularization. Comput. Phys. Commun. 69, 99–111 (1992). https://doi.org/10.1016/0010-4655(92)90132-i
Zhang, Y.X., Chen, Y., Li, M., Yan, M.F., Ni, M., Xia, C.R.: A high-precision approach to reconstruct distribution of relaxation times from electrochemical impedance spectroscopy. J. Power Sources 308, 1–6 (2016). https://doi.org/10.1016/j.jpowsour.2016.01.067
Zic, M., Pereverzyev, Jr., S.: Adaptive multi-parameter regularization in electrochemical impedance spectroscopy. https://www.ricam.oeaw.ac.at/files/reports/18/rep18-16.pdf
Zoltowski, P.: The error function for fitting of models to immittance data. J. Electroanal. Chem. 178, 11–19 (1984). https://doi.org/10.1016/s0022-0728(84)80019-4
Acknowledgements
Open access funding provided by Austrian Science Fund (FWF). M. Žic gratefully acknowledges the stimulation program “Joint Excellence in Science and Humanities” (JESH) of the Austrian Academy of Sciences for providing supporting funds. S. Pereverzyev Jr. gratefully acknowledges the support of the Austrian Science Fund (FWF): Project P 29514-N32.
Author information
Authors and Affiliations
Corresponding authors
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Žic, M., Pereverzyev, S., Subotić, V. et al. Adaptive multi-parameter regularization approach to construct the distribution function of relaxation times. Int J Geomath 11, 2 (2020). https://doi.org/10.1007/s13137-019-0138-2
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s13137-019-0138-2