Numerical investigation of an inverse problem based on regularization method

In this study, a numerical approach of the spectral collocation method coupled with a regularization technique is applied for solving an inverse parabolic problem of the heat equation in a quarter plane. The problem includes the estimation of an unknown boundary condition from an overspecified condition. The stable solution of the problem exists and is proved by Tikhonov regularization technique. The algorithm works without any mesh points or elements, and accurate results can be obtained efficiently. By employing the numerical algorithm on the problem, the resultant matrix equation is ill-condition. To regularize this matrix equation, we apply regularization technique, with the L-curve and general cross-validation criteria for choosing the regularization parameter. For demonstrating the performance and ability of the proposed algorithm, a test example is presented. The numerical results showed that the solution obtained with the algorithm designed in this paper is stable with the noisy data and the unknown boundary condition was recovered very well.

The heat conduction problems include two categories: direct and inverse problems. The direct problems are related to the determination of unknown temperature distribution at the domain in the presence of the known initial and boundary conditions and other physical properties. The inverse problems consist of not only determination of temperature distribution, but also an estimation of the diffusion coefficient or temperature/heat flux on the surface or other unknown parameters from the extra condition which is given usually by temperature measurements taken within the body.
The major difficulty of IHCPs is their instability, that is, the small error in input data causes the large change in output data according to Hadamard definition [1][2][3].
Due to the instability of the inverse problem, the computational treatment of such problems needs applying more accurate numerical methods to obtain a stable approximate solution. In recent years, IHCPs have been investigated from the analytical and numerical point of view, in the literature, e.g., [3][4][5][6][8][9][10].
We present in this paper a numerical algorithm based on collocation method for an IHCP, which does not require domain discretization. The solution is constructed from the linear combination of basis functions which are chosen in an appropriate way.
By using the solution of the direct problem, a numerical approach based on the collocation method is introduced. An ill-conditioned system is derived from discretization. The condition number of the resultant matrix increases with respect to the number of collocation points, and so by using standard algorithms, we cannot achieve good accuracy. Some kind of regularization is necessary for finding a stable solution.
The outline of this paper is organized as follows: In Sect. 2, a mathematical model of our interest problem is introduced. In Sect. 3, the Tikhonov regularization method is applied to construct a stable solution of the illposed integral equation. Section 4 contains a numerical procedure based on the collocation method for solving the inverse problem. In Sect. 5, the regularization method for discrete ill-posed problem is applied to find a stable solution and introduced GCV and L-curve criteria for determining regularization parameter. In Sect. 6, a test problem is considered to investigate the validity and efficiency of the method. Section 7 contains the conclusions.

Problem formulation
Here, we consider an inverse problem of the heat conduction in a quarter plane and the unknown boundary condition has to be determined from temperature measurements at a fixed point of the domain. Consider the following problem: where T represents the final time and f (x) and g(t) are piecewise known continuous functions in direct problem and M is a positive constant.
The inverse problem consists of determining u(x, t) and boundary condition g(t) subject to the condition (2.2), and overspecified condition p(t) , which is given by For the forward problem (2.1)-(2.4), the unique solution is given by [15], By setting x = 1 and using (2.5), we obtain When we set f (x) = 0 , Eq. (2.7) has the form Equation (2.7) can be rewritten in terms of an integral operator equation as follows: where the operator A for 0 < t < T is defined by and and the operator A is represented by The above first-kind integral Eq. (2.8) cannot be reduced into an integral equation of the second kind by differentiation, and so the problem is ill-posed. We can uniquely determine g(t) subject to G(t) belong to the range of A −1 . Since the A −1 is unbounded, the noisy data of p(t) lead to large errors in g(t) . In the next section, we show the existence stable solution of the operator integral Eq. (2.9) by Tikhonov regularization technique in continuous form.

The regularization method for ill-posed integral equation
It this section, a popular regularization method is applied for solving an ill-posed integral equation of the form (2.9). Since in practical applications, the input data p(t) are affected by noise, we apply Tikhonov regularization technique to an approximate solution in a stable way. Based on the main idea of the Tikhonov regularization approach, by introducing the smoothing functional M g, G which is called Tikhonov functional and stabilizing functional Ω(g) , an ill-posed problem is replaced by the following problem: where is the regularization parameter and Ω(g) is a stabilizer of the first-order constant coefficient which is defined on a Sobolev space W 1 2 as: The regularized solution g for Eq. (2.9) is constructed by using the following minimization problem, which is stated by the following theorem: Theorem 1 For every function G ∈ L 2 [0, T] and any positive , there exists an element g ∈ W 1 2 [0, T] such that the functional M g, G attains its greatest lower bound.

Proof We have
A condition for a minimum of this functional is vanishing of its first variation; this is written in the form by calculating the left-hand side of the above equation and setting = 0 , we have By using integration by part for the second term and by setting we have: where (s) is an arbitrary variation of the function g(s) such that both g(s) and g(s) + (s) belong to the class of admissible functions. Condition

The collocation method
In this section, we only consider the discrete form of Eq. (2.7) with f (x) = 0 . Since in practical applications, the overspecified condition p(t) is given only at mesh points t i for i = 0, 1, … , n, the time interval [0, T] is divided into n time intervals by choosing t 0 = 0 , t n = T , and t i = iΔt, where Δt = T n represents the step size. Now, the overspecified condition (2.5) will be replaced by The type of discretization of Eq. (2.9) is based on the collocation method. That is an approximate solution g(t) to the IHCP (2.1)-(2.5) is expressed as a linear combination of piecewise constant basis functions i (t) . The approximate solution g * (t) of g(t) is represented regarding finitely many unknown as follows: where the basis orthogonal functions i (t) are given by and c i are unknown coefficients.

3
Collocating Eq. (4.1) in Eq. (2.9), we obtain or Let i (t) denote A i (t). The equality is specified for many values of t; by using the collocation method at discrete points t j , we have or By the definition of operator integral A and the basis functions i (t) and simple calculations, it is easy to show that where and the error function erf(x) is defined by 2 √ ∫ x 0 e −u 2 du and H(t) is Heaviside function. The ill-conditioned linear system for the determination of the unknown coefficients c i in Eq. (4.1) is produced by discretization as follows: where A is a n × n matrix, A = a ij with entries a ij = j t i for i, j = 1, 2, … , n and G , C are n-dimensional vectors which are defined by: By the definition of i (t) , the matrix A is lower triangular, because and so the linear system (4.2) can be solved directly. Since the matrix A is ill-conditioned, regularization approach needs to be employed. In Sect. 5, we apply regularization technique and the L-curve and GCV criteria to obtain a stable solution of the system (4.2). By substituting the unknown coefficients into Eq. (4.1), the solution of IHCP can be obtained.

Regularization method for discrete ill-conditioned system
The ill-posedness of the operator integral Eq. (2.9) results in the ill-conditioned system (4.2) from the discretization by the proposed algorithm. Because of the ill-conditionary of matrix A in Eq. (4.2), some type of regularization must then be applied to get stable and accurate results [16][17][18]. For the linear system (4.2), we are faced with the same issues of Hadamard definition, and so we must investigate the sensitivity analysis of solution with respect to random noise in input data p(t) . In our computation, the zero-order Tikhonov regularization technique is applied to solve the matrix Eq. (4.2). The regularization method for the discrete ill-posed problem of the form (4.2) is an extension of the least square method (LSM) to find a stable solution for AC = G . The definition of the regularization method is as the following: Assume > 0 be a given constant. The Tikhonov regularized solution C is the minimizer of the following functional: provided that a minimizer exists, where ‖.‖ denotes the Euclidean norm and is called regularization parameter. (We discussed the existence of minimizer in Sect. 3.) The choice of suitable value for is crucial in this technique since it defined the amount of regularization. Many techniques have been investigated by many scientific researchers to determine a suitable regularization parameter . In this work, the most well-established techniques for the estimation of in Eq. (6.1) are the L-curve and GCV criteria.
The L-curve criterion is defined by the log-log plot regularized solution versus the norm of residual and is sketched in the following: The graph of the curve is as the L-shape and so is called L-curve, and the corner of curve is selected as a suitable regularization parameter [18].

(II) GCV
The GCV criterion is an approach for choosing the regularization parameter [18,19]. The GCV criterion leads to minimization of the following GCV function with respect to : produces the regularized solution C of Eq. (6.1) from the normal equation

Numerical results and discussion
In this section, to investigate the applicability of the method, a test example is considered. The root-mean-square error (RMSE) is introduced to measure the accuracy as follows: while n + 1 is the number of collocation points.

Test problem
We consider the problem (2.1)-(2.5) with the following exact solution: with data and which is given by [14]. They have applied a Fourier regularization method for finding the surface heat flux distribution.
The obtained numerical results obtained for both exact and noisy data are reported.
The best regularization parameter by L-curve criteria is represented in Fig. 1. In Fig. 2, the exact solution and the solution obtained using the regularization method with L-curve criteria are plotted when data are exact. The absolute value of error for g(t) without regularization is plotted in Fig. 3. Results of RMSE value and condition number of matrix A in Eq. (4.2) are reported in Table 1 as the collocation points increase.
The value of the regularization parameter by GCV criteria is shown in Fig. 4. Results of RMSE value and condition number of matrix A in Eq. (4.2) are given in Table 2 as the collocation points increase.
We compare the values of regularization parameters which are obtained by L-curve and GCV and the RMSE value in Table 3 as well. The stability of the numerical solution with respect to the noisy data p (t) is considered by: where the random('Normal', 0, , 1, N ) command in MAT-LAB software generates the random variable from the normal distribution with zero mean and standard deviation as the following: and represents the percentage of noise. Table 4 represents the RMSE values of approximation solution in the presence and absence of the regularization method for different values of . Figure 5 shows the numerical solution of g(t) by regularization procedure when the input data (2.5) are contaminated by different values of . p (t) = p(t) + random('Normal', 0, , 1, N),

Conclusions
In this paper, the spectral collocation method along with Tikhonov regularization technique was successfully applied to the solution of IHCP to determine the unknown heat temperature on the boundary by employing temperature reading at a fixed point. A test example involving different collocation point and measurement errors with noise was considered.
The results show that the approximate solution obtained by the proposed algorithm and using regularization techniques remain stable as the collocation points are increased even when noise is included in the input data.
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creat iveco mmons .org/licen ses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
Publisher's Note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.