Abstract
Nuclear Magnetic Resonance (NMR) T2 inversion is the basis of NMR logging interpretation. The regularization parameter selection of the penalty term directly influences the NMR T2 inversion result. We implemented both norm smoothing and curvature smoothing methods for NMR T2 inversion, and compared the inversion results with respect to the optimal regularization parameters (α opt) which were selected by the discrepancy principle (DP), generalized cross-validation (GCV), S-curve, L-curve, and the slope of L-curve methods, respectively. The numerical results indicate that the DP method can lead to an oscillating or oversmoothed solution which is caused by an inaccurately estimated noise level. The α opt selected by the L-curve method is occasionally small or large which causes an undersmoothed or oversmoothed T2 distribution. The inversion results from GCV, S-curve and the slope of L-curve methods show satisfying inversion results. The slope of the L-curve method with less computation is more suitable for NMR T2 inversion. The inverted T2 distribution from norm smoothing is better than that from curvature smoothing when the noise level is high.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction
NMR logging directly measures the signal from protons in the fluid in formation of pores. Its applications include fluid typing, porosity calculation, permeability estimation, fluid saturation determination, and bound water estimation. NMR logging interpretation is based on the inverted T2 distributions from acquired echo trains. NMR T2 inversion is an ill-posed problem, so it is critical to choose a robust and efficient inversion method to obtain credible NMR spectra. For NMR T2 inversion, scholars have proposed many kinds of inversion methods. Butler, Reeds, and Dawson (BRD) proposed a method to solve norm smoothing with a non-negative constraint of solution (Butler et al. 1981). Dunn et al. (1994) proposed another method for solving norm smoothing with a non-negative constraint of solution. Prammer (1994) used the singular value decomposition (SVD) method for NMR T2 inversion, and adopted a series of measures to improve the inversion speed for the purpose of real-time processing. Borgia et al. (1998) put forward a complex curvature smoothing method which is called uniform-penalty (UPEN) method, and then made further modifications to the method which allows the regularization parameter to be a variable in the iterative process (Borgia et al. 2000). The SVD method implements the non-negative constraint of solution by singular value truncation which decreases the accuracy of the solution (Prammer 1994; Ge et al. 2016). For the SVD method, the low signal-to-noise ratio of NMR logging data leads to a large cutoff of singular value, which seriously decreases the accuracy of the solution. Norm smoothing and curvature smoothing can usually obtain more satisfactory solutions than the SVD method.
The critical issue of norm smoothing and curvature smoothing methods (Dunn et al. 1994) is to determine the optimal regularization parameter. The different optimal regularization parameters selected by different regularization parameter selection methods will cause slightly different inversion results. The published literature mainly used the BRD (Butler et al. 1981) and S-curve (Sezginer 1994; Song et al. 2002) methods to select the regularization parameter for NMR T2 inversion. Compared with BRD method, the S-curve method does not need to know the noise level. Except for the above two methods, the generalized cross-validation (GCV) (Golub et al. 1979) and L-curve (Hansen 1992) methods are often widely used to select the regularization parameter for data inversion in many fields. But every regularization parameter selection method has its own advantages and disadvantages. For different inversion problems, we need to comprehensively account for both the amount of calculation and the accuracy of inversion result to determine the most satisfactory parameter selection method for the studied inverse problem. For NMR logging T2 inversion, we implement the inversion procedure at each well-logging depth point, so inversion speed should also be an important consideration. This paper implemented norm smoothing and curvature smoothing methods for NMR T2 inversion, and compared the inversion results with respect to the optimal regularization parameters which were selected by the DP, GCV, S-curve, L-curve, and the slope of L-curve methods, respectively.
2 NMR T2 inversion
The measured echo amplitude of NMR logging using a Carr–Purcell–Meiboom–Gill (CPMG) pulse sequence with sufficient polarization time has the following equation:
where b(t) is the echo amplitude at time t, T2 is the transverse relaxation time, exp(−t/T2) is the kernel function, f(T2) is the amplitude of T2 distribution, and ε is noise.
The discrete form of Eq. (1) is
where A m×n is kernel matrix, f n×1 = [f(T2,1), …, f(T2,n )]T, b m×1 = [b(t 1), …, b(t m )]T.
As is known, NMR T2 inversion is an ill-posed problem, so regularization terms are needed to be added. The most common form of regularization is the Tikhonov regularization, which has the following objective function:
where ||·|| means Euclidean norm and W is a weighted matrix whose diagonal elements equal to the reciprocal of the noise level. If the noise level of data is a constant, W can be an identity matrix. L is the regularization matrix, can be a zero-, or first-, or second-derivative operator which corresponds to norm smoothing, slope smoothing, and curvature smoothing (Dunn et al. 1994). α is the regularization parameter.
To obtain the non-negative constraint of solution, the iterative solution is commonly made by eliminating the columns of kernel matrix corresponding to the negative components in the solution or replacing them with large constants. Unlike the above-mentioned methods, we use a variable substitution method to obtain a non-negative constraint of solution, in which the solution is substituted by a non-negative expression. For example, set f = exp(x) or x 2, the above objective function of Eq. (3) can be rewritten as
or
The objective functions of Eqs. (4a) and (4b) without constraint conditions can be solved by the Levenberg–Marquardt method, an iterative method. The new solution x new is updated by the following equations (Madsen and Nielsen 2010):
where I is an identity matrix, \(\phi^{{\prime }}\) is the gradient of objective function, \(\phi^{{\prime \prime }}\) is the Hessian matrix of objective function, μ is a parameter that can be updated in every iteration by the updating strategy of Madsen and Nielsen (Madsen and Nielsen 2010).
By calculating the partial derivatives of the objective functions of Eqs. (4a) and (4b) with respect to x, we can obtain the gradients \(\phi^{{\prime }}\) and approximate symmetric positive definite Hessian matrices \(\phi^{{\prime \prime }}\) of the objective functions of Eqs. (4a) and (4b), respectively.
For f = exp(x),
For f = x 2,
where diag(exp(x)) and diag(x) are diagonal matrices which are generated by vectors exp(x) and x, respectively.
3 Regularization parameter selection
Since a too small or too large regularization parameter can result in an undersmoothed or oversmoothed solution, it is critical to choose an optimal regularization parameter (α opt). The commonly used regularization parameter selection methods include the DP, GCV, S-curve, and L-curve methods (Morozov 1966; Golub et al. 1979; Sezginer 1994; Hansen 1992).
3.1 Discrepancy principle (DP)
If the noise level σ is known, the DP (Morozov 1966) suggests that the α opt should be chosen to satisfy the following equation:
where m is the number of the echoes of the echo train b. τ ≥ 1 is a predetermined real number, typically τ = 1.
Figure 1 shows the typical “S” shape curves of the variation of regularization parameter (α) with residual norm (ζ(α)) for norm smoothing and curvature smoothing. This method needs to know the noise level σ, but sometimes it is difficult to estimate an accurate σ.
3.2 Generalized cross-validation (GCV)
The GCV method was proposed by Golub et al. (1979) to find the α opt that minimizes the GCV function. For Tikhonov regularization, the GCV function is
where I is an identity matrix, A # denotes the regularized pseudo-inverse of A, f α = A # b. For Tikhonov regularization, \(A^{\# } = (A^{\text{T}} A + \alpha L^{\text{T}} L)^{ - 1} A^{\text{T}} .\)
Figure 2 shows the variation of the GCV function value with a regularization parameter (α) for norm smoothing and curvature smoothing. As shown in Fig. 2, as α increases, the GCV function value first decreases and then increases.
3.3 S-curve
The S-curve method (Sezginer 1994; Song et al. 2002) finds the minimum α as α opt that satisfies
where 0 < tol < 1 is a predetermined constant, typically tol = 0.1.
This method uses the slope of the S-curve as the criterion of α opt selection. Eq. (21) in Appendix shows the specific formula of the slope of S-curve. The heel of the S-curve is selected as α opt, which balances the residual and known noise variance (Song et al. 2002).
Figure 3 shows the variation of slope of S-curve with regularization parameter (α). Typically, the slope of the S-curve gradually increases at first, then remains at a large value, and finally gradually decreases. We choose the smallest α that satisfies the Eq. (11) as α opt.
3.4 L-curve
As α increases, solution norm η(α) = ||Lf||2 decreases, while residual norm ζ(α) increases. In the log–log scale, the curve formed by η(α) versus ζ(α) for each of a set of α has an “L” shape, so it is called the L-curve. The method was proposed by Lawson and popularized by Hansen (Hansen 1992).
Figure 4 shows the typical L-curves of norm smoothing and curvature smoothing. Intuitively, α opt should lie on the “corner” of the L-curve, for values higher than this “corner”, ζ(α) increases without reducing η(α) too much, while for values smaller than this “corner”, ζ(α) decreases little but with a rapid increase of η(α).
People have proposed many kinds of methods to locate the “corner” (the point of maximum curvature) of the L-curve. Castellanos et al. (2002) analyzed the drawbacks of three methods for finding the corner of L-curve (Kaufman and Neumaier 1996; Hansen 1998; Guerra and Hernandez 2001), and proposed a robust triangle method. Hansen et al. (2007) proposed an adaptive pruning algorithm, which first calculates the corner candidates at different scales or resolutions and then selects the overall optimal corner from the candidates. The above-mentioned methods are indirect methods to calculate the corner of L-curve. However, indirect methods cannot guarantee correct results in all cases. This article gives an Eq. (27) for directly calculating the curvature of the L-curve of single-parameter Tikhonov regularization, and the specific derivation is shown in Appendix. Figure 5 shows the variation of the curvature of L-curve with regularization parameter (α).
3.5 The slope of the L-curve
Comparing the S-curve (Fig. 1) with the L-curve (Fig. 4), we can see that the two types of curves have similar shapes. If we exchange the horizontal and vertical coordinates of the L-curve, the resulting curve is the mirror image of the S-curve. It naturally refers us to the S-curve method, so we can use the slope of the L-curve to select the regularization parameter. According to Eq. (24), the slope of the L-curve has a simple formula and can avoid the matrix inversion of the S-curve method (see Eq. (21)). Figure 6 shows the variation of the reciprocal of the absolute value of the slope of the L-curve with regularization parameter (α). Comparing Fig. 6 with Fig. 3, it can be found that the two types of curves have striking similarities. So, we attempt to use the slope of the L-curve criterion to select the regularization parameter, and compare its results with those of the other methods. The threshold of the reciprocal of the absolute value of the slope of the L-curve can be selected in the interval [0.1, 10]. Here we choose the threshold values of 5 and 0.25 for norm smoothing and curvature smoothing methods, respectively.
4 Numerical results
A bimodal T2 distribution model is constructed as shown in Fig. 7, where 64 T2 components are preselected between 0.1 and 10,000 ms. Using this T2 distribution model, we generated echo trains with 500 echoes, where echo spacing is 0.9 ms. Different level Gaussian random noise was applied, as shown in Fig. 8. The red line represents the echo train without noise, and the green, blue, magenta, and black lines show the echo trains with noise levels of 0.25, 0.5, 1.0, and 2.0 porosity unit (pu), respectively.
To improve the inversion speed of NMR echo data, the echo trains are usually compressed before inversion (Sezginer 1994; Dunn and LaTorraca 1999; Venkataramanan et al. 2002; Zou and Xie 2015). Here, we compress the NMR echo data with the SVD method (Sezginer 1994; Zou and Xie 2015). After compression, echoes in each echo train shown in Fig. 8 are all compressed to 20 data points for NMR T2 inversion.
We select optimal regularization parameters (α opt) by the DP, GCV, S-curve, L-curve, and the slope of L-curve methods, respectively, and compare the NMR T2 inversion results from different regularization parameter selection methods. Figure 9 shows the NMR T2 inversion results of norm smoothing and curvature smoothing methods with respect to noise levels of 0.25, 0.5, 1.0, and 2.0 pu. The black line is the T2 distribution model, and the green, blue, magenta, red, and cyan lines are the T2 distribution inversion results according to the DP, GCV, S-curve, L-curve, and the slope of L-curve methods, respectively. As shown in Fig. 9, the selected α opt from the DP method is sometimes small or large (because of the underestimated or overestimated echo data noise level) that leads to an undersmoothed or oversmoothed solution. The α opt selected by L-curve method is occasionally small or large which leads to an undersmoothed or oversmoothed T2 distribution. The inversion results from the GCV, S-curve, and the slope of L-curve methods are close and satisfactory. Curvature smoothing can better suppress the oscillation caused by noise than norm smoothing, and can obtain a smoother solution than norm smoothing. The curvature smoothing makes the inverted T2 distribution prone to show single peak shape than norm smoothing when the noise level is high. Table 1 shows the porosity errors of different regularization parameter selection methods, and finds that the DP method occasionally obtains a large porosity error, and the porosity errors of the GCV, S-curve, L-curve, and slope of L-curve methods are close.
5 Well data processing results
Well A is in a tight sandstone reservoir with low porosity. The signal-to-noise ratio (SNR) of the NMR logging data is low. Figure 10 shows the inverted T2 distributions of norm smoothing, where the fourth track represents the inverted T2 distributions of the SVD method, the fifth to ninth tracks represent the inversion results of the DP, GCV, S-curve, L-curve, and slope of L-curve methods, respectively. As shown in Fig. 10, the inverted T2 distributions of the SVD method, usually with single peak shapes, are oversmoothed. The inverted T2 distributions of norm smoothing are satisfactory. The inverted T2 distributions from the DP and L-curve methods are slightly oversmoothed. However, the inverted T2 distributions from the GCV and S-curve methods are slightly undersmoothed. The inverted T2 distributions from the slope of L-curve method are relatively more satisfactory than those from other methods.
6 Conclusions
This paper uses the Tikhonov regularization with a non-negative constraint of solution for NMR T2 inversion. The non-negative constraint of solution is implemented by variable substitution, and then the modified objective function is solved by the Levenberg–Marquardt method. The optimal regularization parameters (α opt) from norm smoothing and curvature smoothing methods are selected by the DP, GCV, S-curve, L-curve, and the slope of L-curve methods, respectively. The following conclusions are obtained.
-
(1)
The inverted NMR T2 distributions from the DP method depend on the estimated noise level which is difficult to estimate accurately. The inversion results from the GCV, S-curve, and the slope of L-curve methods are satisfactory. The small or large α opt selected by the L-curve method leads to an oscillation or oversmoothed T2 distribution. When the noise level is high, norm smoothing can more effectively than curvature smoothing avoid the bimodal T2 distribution being converted to a single peak distribution. The inverted T2 distribution of norm smoothing is better than that of curvature smoothing.
-
(2)
The GCV and L-curve methods need to calculate the solution of the regularization parameter over a wide range, which needs a large amount of calculation. The S-curve and the slope of L-curve methods can quickly find the α opt by iteration, suitable for norm smoothing and curvature smoothing. The slope of L-curve method needs less calculation than the S-curve method does, but the T2 inversion results from these two methods are close. So, the slope of the L-curve method can be an efficient alternative to the S-curve method.
References
Borgia GC, Brown RJS, Fantazzini P. Uniform-penalty inversion of multiexponential decay data. J Magn Reson. 1998;132(1):65–77.
Borgia GC, Brown RJS, Fantazzini P. Uniform-penalty inversion of multiexponential decay data II. Data spacing, T2 data, systematic data errors, and diagnostics. J Magn Reson. 2000;147(2):273–85.
Butler JP, Reeds JA, Dawson SV. Estimating solutions of first kind integral equations with nonnegative constraints and optimal smoothing. SIAM J Numer Anal. 1981;18(3):381–97.
Castellanos JL, Gómez S, Guerra V. The triangle method for finding the corner of the L-curve. Appl Numer Math. 2002;43(4):359–73.
Dunn KJ, LaTorraca GA. The inversion of NMR log data sets with different measurement errors. J Magn Reson. 1999;140(1):153–61.
Dunn KJ, LaTorraca GA, Warner JL, et al. On the calculation and interpretation of NMR relaxation time distributions. In: SPE annual technical conference and exhibition. Society of Petroleum Engineers. 1994.
Ge X, Wang H, Fan Y, et al. Joint inversion of T1–T2 spectrum combining the iterative truncated singular value decomposition and the parallel particle swarm optimization algorithms. Comput Phys Commun. 2016;198:59–70.
Golub GH, Heath M, Wahba G. Generalized cross-validation as a method for choosing a good ridge parameter. Technometrics. 1979;21(2):215–23.
Guerra V, Hernandez V. Numerical aspects in locating the corner of the L-curve. In: Approximation, optimization and mathematical economics. Heidelberg: Physica-Verlag; 2001. p. 121–31.
Hansen PC. Analysis of discrete ill-posed problems by means of the L-curve. SIAM Rev. 1992;34(4):561–80.
Hansen PC. Rank-deficient and discrete ill-posed problems: numerical aspects of linear inversion. Philadelphia: SIAM; 1998.
Hansen PC, Jensen TK, Rodriguez G. An adaptive pruning algorithm for the discrete L-curve criterion. J Comput Appl Math. 2007;198(2):483–92.
Kaufman L, Neumaier A. PET regularization by envelope guided conjugate gradients. IEEE Trans Med Imaging. 1996;15(3):385–9.
Madsen K, Nielsen HB. Introduction to optimization and data fitting. Lyngby: Technical University of Denmark; 2010.
Morozov VA. On the solution of functional equations by the method of regularization. Sov Math Dokl. 1966;7(1):414–7.
Prammer MG. NMR pore size distributions and permeability at the well site. In: SPE annual technical conference and exhibition. 1994.
Sezginer A. Determining bound and unbound fluid volumes using nuclear magnetic resonance pulse sequences. US Patent 5,363,041, 1994.
Song YQ, Venkataramanan L, Hürlimann MD, et al. T1–T2 correlation spectra obtained using a fast two-dimensional Laplace inversion. J Magn Reson. 2002;154(2):261–8.
Venkataramanan L, Song YQ, Hürlimann MD. Solving Fredholm integrals of the first kind with tensor product structure in 2 and 2.5 dimensions. IEEE Trans Signal Process. 2002;50(5):1017–26.
Zou YL, Xie RH. A novel method for NMR data compression. Comput Geosci. 2015;19(2):389–401.
Acknowledgments
This work was funded by Shell International Exploration and Production Inc. (PT45371), the National Natural Science Foundation of China—China National Petroleum Corporation Petrochemical Engineering United Fund (U1262114), and the National Natural Science Foundation of China (41272163).
Author information
Authors and Affiliations
Corresponding authors
Additional information
Edited by Jie Hao
Appendix
Appendix
The objective function of single-parameter Tikhonov regularization is given by
The derivative of the above equation with respect to f is written as
Let ζ = ||W(Af − b)||2, η = ||Lf||2. The curvature κ of L-curve (logζ, logη) is
To calculate the κ, we need to compute \(\frac{{{\text{d}}^{2} \log \eta }}{{{\text{d}}\left( {\log \zeta } \right)^{2} }}\) and \(\frac{{{\text{d}}\log \eta }}{{{\text{d}}\log \zeta }}.\) Since
the computation of Eq. (14) is converted to compute \(\frac{{{\text{d}}\eta }}{{{\text{d}}\zeta }}\) and \(\frac{{{\text{d}}^{2} \eta }}{{{\text{d}}\zeta^{2} }}.\)
The derivative of Eq. (13) with respect to α is
So,
We should note that according to the non-negative constraint, only the rows and columns of the matrices (WA)T(WA) and L T L corresponding to f > 0 will be involved in the calculation.
So, the derivative of η with respect to α is
The derivative of ζ with respect to α is
So,
And,
Substituting Eqs. (22) and (23) into Eqs. (15) and (16), then
Substituting Eqs. (21) and (24) into Eq. (25), then
Substituting Eq. (26) into Eq. (14), then
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Zou, YL., Xie, RH. & Arad, A. Numerical estimation of choice of the regularization parameter for NMR T2 inversion. Pet. Sci. 13, 237–246 (2016). https://doi.org/10.1007/s12182-016-0093-6
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12182-016-0093-6