Abstract
Fourier concentration method is a well-established method for finding edges given a set of truncated Fourier data. However, it is hard to distinguish weak jumps from the Gibbs oscillations with the method unless the concentration is highly refined locally. In this note, we show that it is possible to find all edges whether strong or weak by using the method iteratively. The iterative method first finds strong edges followed by an iterative procedure in which previously found edges are smoothed by local adaptive mollifier. The iterative method is advantageous when the ratio of the largest to smallest jump magnitudes is significantly large.
You have full access to this open access chapter, Download conference paper PDF
Similar content being viewed by others
1 Introduction
Detection of edges is a fundamental problem in a variety of applications, including image processing and the numerical solution of differential equations. In applications such as magnetic resonance imaging (MRI), it is required to construct images from Fourier data. Let \(\{ {\hat f}_k \vert k = 0, \pm 1, \pm 2, \cdots \}\) be the set of Fourier coefficients of f(x) ∈ L 2[−π, π] given by
and let f N be the Fourier partial sum \( f_N = \sum _{k = -N}^N {\hat f}_k e^{ik x}. \) When the underlying function is smooth and periodic, the Fourier reconstruction f N is accurate to spectral accuracy, but when edges are present, the reconstruction is plagued by the Gibbs phenomenon, also known as the Gibbs ringing in MRI applications.
Various methods have been proposed to address these issues and those methods consist of edge detection followed by reconstruction. Thus, the determination of edge locations is critical. Fourier concentration method has emerged over the past decade as a robust method for edge detection in a variety of circumstances and applications [5, 6]. Essentially, a certain Fourier partial sum converges to the jump function as the number of Fourier coefficients increases and this convergence can be accelerated by what is known as concentration factors (functions). Use of different types of concentration factors tends to impart trade-offs between oscillations near jump discontinuities and significant non-zero concentration away from them [2]. Several methods have been devised to address this issue, as well as to treat special circumstances such as incomplete Fourier data and the presence of noise [1, 4, 13, 15].
Thanks to the convergence property of the Fourier concentration to the jump function, the concentration method detects edges with large concentrations. Where the function is smooth, the concentration vanishes as the jump function vanishes as N →∞. In practice, the concentration method is designed to detect edges with magnitudes larger than some given threshold, with the value of the used threshold being problem dependent. The value of the threshold cannot be arbitrarily small; otherwise, too many false edges can be detected. If the magnitude of weak edges is much smaller than other edges, those edges are considered insignificant, but for some cases weak edges are more important than strong edges. For example, it was shown that in the segmentation of MRI of the knee, the cartilage is better characterized by weak edges rather than strong edges for the separation from the tibia and femur [11].
This note shows that an iterative approach based on the successive conjugation and adaptive mollification can detect all edges without any prior threshold. This approach is similar to the iterative method in the context of the radial basis function method [3, 9, 10]. The iterative method is as follows: at each iteration step, all previously found edges are smoothed by a local mollification and new corresponding Fourier coefficients are computed. By applying conjugation and mollification successively, one can distinguish real edges from fake edges. This approach is useful and effective particularly for problems where the weak jump can significantly affect the global solution of differential equations or images where the interesting structure is represented by the weak edges [11].
In Sect. 2, a brief explanation of the Fourier concentration method is given. In Sect. 3, the proposed iterative method is explained based on the adaptive filtering method. The stopping criteria is also explained. Numerical examples with remarks are given. In Sect. 4, a brief concluding remark is provided.
2 Edge Detection Using Fourier Concentration Method
Let [f](x) = f(x +) − f(x −) denote the jump function of f(x) ∈ L 2[−π, π], where the superscripts + and − denote the limits taken from the right and left, respectively. Given a finite set of Fourier coefficients, \(\{ {\hat f}_k\}_{|k|\le N}\), the Fourier concentration method, developed in [5, 6], computes the concentration as a sum of the form
where the σ(⋅) are known as concentration factors and sgn(k) is the sign function. Given certain admissibility conditions [6], the sum converges to the jump function:
where d(x) denotes the distance to the nearest edge and s depends on the concentration factor. Here we note that Eq. (2) shows that the concentration function \(S_{N}^{\sigma }[f](x)\) recovers the jump function of f(x) as N →∞ and the convergence may be slow. Equation (2) also implies that the absolute maximum value of the concentration function \(S_{N}^{\sigma }[f](x)\) converges to the maximum jump. Accordingly we observe that strong jumps are relatively easier to detect than weak jumps. The common types of concentration factors satisfying the admissibility conditions are polynomial concentrations
where p is a positive integer and η = |k|∕N and exponential concentration functions
where α > 0 is an order and C is a normalization constant. Cutoffs for edge detection, τ ∈ (0, 1], are with respect to the normalized concentration
and the edge set, E, is defined as
Several approaches have been developed for improving the concentration method. We refer readers some to [1, 2, 4, 6, 7, 12, 13, 15, 16]. All these methods are basically utilizing the edge map. Figure 1 is by the Fourier concentration method for f 1(x)
where m w = 0.1. That is, the magnitude of the strong jump is 30 times the weakest. As clearly shown in the figure, it is hard to detect the weak edge by looking at the normalized Fourier concentration \({\hat S}(y)\), (a) and (c) in Fig. 1, although the weak edges are clearly visible in (b) and (d) in Fig. 1.
Edge detection for f 1(x) with τ = 0.4. (a and b) with the polynomial concentration with p = 5. (c and d) with the exponential concentration with p = 12 for \({\sigma = \exp \left [-\epsilon _M \left ( 1- \left |{k\over N} \right | \right )^p \right ]}\) and 𝜖 M = 64. (a and c) \({{\hat S}(y)}\). (b and d) the detected edges marked by red cross symbols. N = 128
3 Iterative Concentration Method
As clearly seen in Fig. 1, the Fourier concentration method may fail to detect the weak edge when the concentration of the weak edge is too small compared to the strong edge. To find all edges, we propose to apply the Fourier concentration method iteratively based on the local mollification using the local adaptive filtering method.
3.1 Local Adaptive Mollification
The local adaptive mollification is a key step for the iterative algorithm. Consider a smooth function \(\phi \in C^\infty _0 [0,2\pi ]\) which is compactly supported such that
where \(\lim _{\epsilon \rightarrow 0^+} \phi _\epsilon (x) = \delta (x)\). Here δ(x) is the Dirac delta function. And further \( \int _{-\infty }^\infty \phi (x) dx = 1. \) With these properties, the limit property is given by
where (∗) operation denotes convolution. The parameter 𝜖 is free and it localizes the convolution and is known as the localization factor. The parameter 𝜖 is a fixed value for every x. Thus a global smoothing occurs everywhere including both the nonsmooth and smooth areas. However, we only want to apply the mollification locally to minimize the Gibbs oscillations near the jump. In order to achieve this, we use a two-parameter family of the spectral mollifier introduced by Gottlieb and Tadmor [8]. Consider the convolution of the Fourier partial sum f N(x) and the mollifier ϕ. Then by the definition of f N(x) and ϕ we have
where D N is the Dirichlet kernel of degree N. The idea proposed in [8] is that one changes the degree of the Dirichlet kernel with the localization parameter 𝜖 so that the two-parameter family of the new mollifier is defined by
where D p is the Dirichlet kernel of degree p. Then for all s, the error is given by [8]
where\(|| \cdot ||{ }_{L^\infty _{loc}} = \sup _{(x-{\epsilon } \pi , x+ {\epsilon }\pi )}|\cdot |\). The first term in the right hand side of the above inequality is the truncation error and the second term is the regularization error. As we see, the optimization of the error is determined by how the localization parameter 𝜖 and the degree p are balanced. In [8] those parameters were chosen such that \( {\epsilon } = {{d}\over \pi }\), where d is the distance to the nearest jump from the current position. The order of the Dirichlet kernel is chosen such that spectral convergence is achieved, say, \({p} \approx \sqrt {N}\). Here we note that a modification of the two-parameter mollifier for the enhancement of the convergence was proposed in [14], which was designed to reduce the Gibbs oscillations while it provides a sharp reconstruction up to the edge. Note that the adaptive mollifier was used to sharpen the concentration map \({\hat S}\) in [2].
Our proposed iterative method is that once the edge is identified, the edge region is first localized using the value of 𝜖 so that f N in the region away from the detected edge is not affected by the mollification. This helps the next available edge to be preserved through the mollification of f N if existent. Thus as in [8], the localization factor is a function of the distance from the edge, d, i.e. 𝜖 = 𝜖(d). Then we adaptively mollify f N so that a heavy mollification using p is applied to reduce the Gibbs oscillations near the edge. The limit property of p is given as p → 0 if d → 0 and p →∞ if d → 2π. In this work, we use the local adaptive filtering for the mollification.
3.2 Almost Automatic Stopping of the Iteration
To see the proposed method stops almost automatically, consider f(x) = x, x ∈ [−π, π] with the Fourier coefficients
and \(\hat {f}_{0} = 0\). There are two edges (x = ±π) and conjugation and local adaptive filtering have the most effect at ± π. Therefore, by considering the local behavior near ± π, we assume a constant order of filtering p and of conjugation q, with functional forms of \(\exp (-\epsilon _{M}(1-|k/N|)^{p})\) and \(\exp (-\epsilon _{M}|k/N|{ }^{q})\), respectively. By letting ϕ p,𝜖 and \(C^{\sigma }_{N}\) be the corresponding kernels and letting S and F denote conjugation and filtering,
and after some simplification, we have
This has Fourier coefficients
From the sharp localization and heavy filtering near ± π, we choose p, q→0. Then setting y = |k∕N| yields
which approaches 0 exponentially. Thus after all the edges are found through iteration, the concentration decays exponentially small. Thus if the stopping criteria η below is chosen small enough, e.g. η ∼ 10−10, the stopping of the iteration is guaranteed
3.3 Numerical Examples
We consider the case that the magnitude of the weak edge is highly small for the function f 1(x) in Eq. (6)
Figure 2 shows how the iteration method finds edges. The order of the finding the edges is from left to right (see red arrows). As shown in the figure, the iterative method finds all edges even with m w = 0.01. It is interesting to observe that the weakest edges are found in the 3rd and 7th iteration steps before all the strong edges are found. Now we consider even smaller value of m w
Figure 3 shows how the iteration method finds all edges. Figure 3 shows similar result as in Fig. 2. As shown in the figure, the method is highly accurate and finds all edges including the highly weak edges.
As an application to the solution of PDEs, namely the shock-density wave interaction equation, we consider finding shocks in the density profile at t = 2 with the total number of grid points N = 300 computed with the WENO-Z method used in [9]. The left two figures of Fig. 4 show the edges (shocks) found by the Fourier concentration method while the right figure shows the edges (shocks) found by the iterative method. As shown in the figure, the iterative method find all the physical shocks accurately while the Fourier concentration method misses some of shocks.
For two-dimensional examples, we consider a Shepp-Logan image with a faint box added to comprise additional weak edges, and a brain image. To detect edges in two dimensions, edges are detected slicewise in the x and y directions. The x and y coordinates have a range of [−π, π]. For a 2N x + 1 × 2N y + 1 image, slices of f(x, y) are taken at evenly spaced x and y with Δx = 2π∕(2N x + 1) and Δy = 2π∕(2N y + 1), with − π included and π excluded. Within each slice, Fourier coefficients are computed by partial Fourier expansion and the iterative method is applied to find strong and weak edges. Calculation parameters for the two-dimensional calculations were similar to those for the one-dimensional calculations. An edge with a concentration magnitude at or above a fraction τ = 0.1 of the maximum magnitude concentration was considered strong. To detect strong edges, trigonometric concentration factors with α = π were used. Figure 5 shows the edges found by the proposed method for the Shepp-Logan image. As in the figure, the weak edges (square box with magnitude of 0.01) are successfully found by the method.
Remarks
First, the proposed method is affected by noise as the original Fourier concentration. Consider Eq. (6). Let \({\hat f}_k(m_w = 0)\) be the Fourier coefficients with m w = 0. Then \({\hat f}_k(m_w) = m_w/8\) for k = 0 and \({\hat f}_k(m_w ) = {{m_w}\over {2\pi k}}\left [ \sin {}(7k\pi /4) - \sin {}(3k\pi /2)\right ]\) for k≠0. The weak edge translates \({\hat f}_k\). Thus we expect that unless SNR is high enough, \(|{\hat f}_k(m_w = 0 ) - {\hat f}_k(m_w )|\) becomes easily smaller than the noise as m w decays. Figure 6 shows the concentration with m w = 0 (left), the concentration with SNR = 20 (middle) and with SNR = 10. As in the figure, the weak edges are easily indistinguishable as SNR decreases. As the main objective of this research is finding the weak edges, a proper noise reduction suitable for the proposed method should be investigated in our future research.
Second, the proposed method is to find the edges by \({\hat f}_k\). Figure 7 shows the edge detection in the physical domain, with the forward difference, generated from the Fourier data (the left figure). The right figure shows the plot in \(x \in {{3\pi }\over 2} \le x \le {{7\pi }\over 4}\) where the weak edges exist. As in the figures, the weak edges are still hard to distinguish in the physical domain. Once the strong edges are removed in the Fourier domain and switching back and forth from the Fourier to physical domains, the weak edges are eventually found with the proposed method.
Summary
The following is the summary of the proposed iterative concentration method. The procedure stops eventually with a non-zero value of η > 0 in Eq. (10).
-
Step 1: Find edge locations x o using the Fourier concentration method.
-
Step 2: Apply the local filter near x o and find the new set of Fourier coefficients.
-
Step 3: Find a new edge location y o where the normalized concentration \({\hat S}\) by \(\{ {\hat f}_k\}\) from Step 2 has the maximum.
-
Step 4: Repeat Steps 2 and 3 until all the edges are found (the iteration stops once all edges are found.)
4 Conclusion
We showed that the iterative approach of the Fourier concentration method can detect all edges, which is not the case if the weak edges are too small. We showed that the proposed method is able to detect weak edges 3000 times weaker than the strongest edge, as long as the weak edges are well-separated from the stronger edges without noise and that the proposed method find all weak edges in a PDE application, namely the WENO calculation for the shock-density wave interaction. The iterative method also shows that it stops almost automatically after all the edges are found. Thus the proposed method is accurate and efficient.
References
Archibald, R., Gelb, A.: Reducing the effects of noise in image reconstruction. J. Sci. Comput. 17, 167–179 (2002)
Cochran, D., Gelb, A., Wang, Y.: Edge detection from truncated Fourier data using spectral mollifiers. Adv. Comput. Math. 38, 737–762 (2013)
Don, W.-S., Wang, B.-S., Gao, Z.: Fast iterative adaptive multi-quadric radial basis function method for edges detection of piecewise functions–I: uniform mesh. J. Sci. Comput. 75, 1016–1039 (2018)
Engelberg, S., Tadmor, E.: Recovery of edges from spectral data with noise—a new perspective. SIAM J. Numer. Anal. 46, 2620–2635 (2008)
Gelb, A., Tadmor, E.: Detection of edges in spectral data. Appl. Comput. Harmon. Anal. 7, 101–135 (1999)
Gelb, A., Tadmor, E.: Detection of edges in spectral data II: nonlinear enhancement. SIAM J. Numer. Anal. 38, 1389–1408 (2000)
Gelb, A., Tadmor, E.: Adaptive edge detectors for piecewise smooth data based on the minmod limiter. J. Sci. Comput. 28, 279–306 (2006)
Gottlieb, D., Tadmor, E.: Recovering pointwise values of discontinuous data within spectral accuracy. In: Murman, E.M., Abarbanel, S.S. (eds.). Progress and Supercomputing in Computational Fluid Dynamics. Proceedings of a 1984 U.S.-Israel Workshop, Progress in Scientific Computing, vol. 6, pp. 357–375. Birkhauser, Boston (1985)
Jung, J.-H., Durante, V.R.: An iterative adaptive multi quadric radial basis function method for the detection of local jump discontinuities. Appl. Numer. Math. 59, 1449–1466 (2009)
Jung, J.-H., Gottlieb, S., Kim, S.: Iterative adaptive RBF methods for detection of edges in two dimensional functions. Appl. Numer. Math. 61, 77–91 (2011)
Pang, J., Miller, E., Driban, J., Tassinari, A., McAlindon, T.: A curve evolution method for identifying weak edges with applications to the segmentation of magnetic resonance images of the knee. In: 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro, pp. 1410–1415 (2011)
Petersen, A., Gelb, A., Eubank, R.: Hypothesis testing for Fourier based edge detection methods. J. Sci. Comput. 51, 608–630 (2012)
Stefan, W., Viswanathan, A., Gelb, A., Renaut, R.: Sparsity enforcing edge detection method for blurred and noisy Fourier data. J. Sci. Comput. 50, 536–556 (2012)
Tadmor, E., Tanner, J.: Adaptive mollifiers for high resolution recovery of piecewise smooth data from its spectral information. Found. Comput. Math. 2(2), 155–189 (2002)
Tadmor, E., Zou, J.: Three novel edge detection methods for incomplete and noisy spectral data. J. Fourier Anal. Appl. 14, 744–763 (2008)
Viswanathan, A., Gelb, A., Cochran, D.: Iterative design of concentration factors for jump detection. J. Sci. Comput. 51, 631–649 (2012)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Open Access This chapter is licensed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.
The images or other third party material in this chapter are included in the chapter's Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the chapter's Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.
Copyright information
© 2020 The Author(s)
About this paper
Cite this paper
Tuzun, R.E., Jung, JH. (2020). Iterative Spectral Mollification and Conjugation for Successive Edge Detection. In: Sherwin, S.J., Moxey, D., Peiró, J., Vincent, P.E., Schwab, C. (eds) Spectral and High Order Methods for Partial Differential Equations ICOSAHOM 2018. Lecture Notes in Computational Science and Engineering, vol 134. Springer, Cham. https://doi.org/10.1007/978-3-030-39647-3_46
Download citation
DOI: https://doi.org/10.1007/978-3-030-39647-3_46
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-39646-6
Online ISBN: 978-3-030-39647-3
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)