Abstract
In this paper we study inverse problems where observations are corrupted by uniform noise. By using maximum a posteriori approach, an \(L_\infty \)-norm constrained minimization problem can be formulated for uniform noise removal. The main difficulty of solving such minimization problem is how to deal with non-differentiability of the \(L_\infty \)-norm constraint and how to estimate the level of uniform noise. The main contribution of this paper is to develop an efficient semi-smooth Newton method for solving this minimization problem. Here the \(L_\infty \)-norm constraint can be handled by active set constraints arising from the optimality conditions. In the proposed method, linear systems based on active set constraints are required to solve in each Newton step. We also employ the method of moments (MoM) to estimate the level of uniform noise for the minimization problem. The combination of the proposed method and MoM is quite effective for solving inverse problems with uniform noise. Numerical examples are given to demonstrate that our proposed method outperforms the other testing methods.
Similar content being viewed by others
Notes
The relative difference is defined by \(\mathrm {RD} = \frac{\left\| \mathbf{u}^{(k+1)}-\mathbf{u}^{(k)}\right\| _2^2}{\left\| \mathbf{u}^{(k+1)}\right\| _2^2}.\)
References
Alter, F., Durand, S., Froment, J.: Adapted total variation for artifact free decompression of JPEG images. J. Math. Imaging Vis. 23(2), 199–211 (2005)
Andrew, H., Hunt, B.: Digital Image Restoration. Prentice-Hall, Englewood Cliffs (1977)
Avriel, M.: Nonlinear Programming: Analysis and Methods. Dover Publications, Mineola (2003)
Bar, L., Brook, A., Schen, N., Kiryati, N.: Deblurring of color images corrupted by salt-and-pepper noise. IEEE Trans. Image Process. 16, 1101–1111 (2007)
Bar, L., Schen, N., Kiryati, N.: Image deblurring in the presence of impulsive noise. Int. J. Comput. Vis. 70, 279–298 (2006)
Bertero, M., De Mol, C., Pike, E.R.: Linear inverse problems with discrete data. I. General formulation and singular system analysis. Inverse Prob. 1(4), 301 (1985)
Bjorck, A.: Numerical methods for least squares problems. Number 51, Society for Industrial Mathematics (1996)
Bovik, A.: Handbook of Image and Video Processing. Academic Press, Cambridge (2010)
Bredies, K., Holler, M.: A total variation-based JPEG decompression model. SIAM J. Imaging Sci. 5(1), 366–393 (2012)
Chambolle, A., Pock, T.: A first-order primal-dual algorithm for convex problems with applications to imaging. J. Math. Imaging Vis. 40(1), 120–145 (2011)
Chen, X., Nashed, Z., Qi, L.: Smoothing methods and semismooth methods for nondifferentiable operator equations. SIAM J. Numer. Anal. 38(4), 1200–1216 (2000)
Clarke, F.: Optimization and Nonsmooth Analysis. Wiley, Hoboken (1983)
Clason, C.: \(l^\infty \) fitting for inverse problems with uniform noise. Inverse Prob. 28(10), 104007 (2012)
Clason, C., Ito, K., Kunisch, K.: Minimal invasion: an optimal \(l_\infty \) state constraint problem. ESAIM Math. Model. Numer. Anal. 45(03), 505–522 (2011)
Fletcher, R.: Practical Methods of Optimization. Wiley, Hoboken (2013)
Griesse, R., Lorenz, D.: A semismooth newton method for tikhonov functionals with sparsity constraints. Inverse Prob. 24(3), 035007 (2008)
Hans, E., Raasch, T.: Global convergence of damped semismooth newton methods for \(l_1\) Tikhonov regularization. Inverse Prob. 31(2), 025005 (2015)
Ito, K., Kunisch, K.: Semi-smooth newton methods for variational inequalities of the first kind. ESAIM. Math. Model. Numer. Anal. 37(01), 41–62 (2003)
Jung, C., Jiao, L., Qi, H., Sun, T.: Image deblocking via sparse representation. Signal Process. Image Commun. 27(6), 663–677 (2012)
Kotz, S., Van Dorp, J.: Other Continuous Families of Distributions with Bounded Support and Applications. World Scientific, Singapore (2004)
Mifflin, R.: Semismooth and semiconvex functions in constrained optimization. SIAM J. Control Optim. 15(6), 959–972 (1977)
Ng, M., Qi, L., Yang, Y., Huang, Y.: On semismooth Newton’s methods for total variation minimization. J. Math. Imaging Vis. 27, 265–276 (2007)
Nikolova, M.: A variational approach to remove outliers and impulse noise. J. Math. Imaging Vis. 20(1–2), 99–120 (2004)
Pang, J., Qi, L.: Nonsmooth equations: motivation and algorithms. SIAM J. Optim. 3(3), 443–465 (1993)
Qi, L., Sun, J.: A nonsmooth version of Newton’s method. Math. Program. 58(1–3), 353–367 (1993)
Schay, G.: Introduction to Probability with Statistical Applications. Springer, Berlin (2007)
Sun, D., Cham, W.: Postprocessing of low bit-rate block dct coded images based on a fields of experts prior. IEEE Trans. Image Process. 16(11), 2743–2751 (2007)
Ulbrich, M.: Nonsmooth Newton-like methods for variational inequalities and constrained optimization problems in function spaces. PhD thesis, Habilitation thesis, Fakultät für Mathematik, Technische Universität München (2002)
Williams, J., Kalogiratou, Z.: Least squares and chebyshev fitting for parameter estimation in ODEs. Adv. Comput. Math. 1(3), 357–366 (1993)
Wu, X., Bao, P.: \(l_\infty \); constrained high-fidelity image compression via adaptive context modeling. IEEE Trans. Image Process. 9(4), 536–542 (2000)
Yang, Y., Galatsanos, N., Katsaggelos, A.: Regularized reconstruction to reduce blocking artifacts of block discrete cosine transform compressed images. IEEE Trans. Circuits Syst. Video Technol. 3(6), 421–432 (1993)
Yang, Y., Galatsanos, N.P., Katsaggelos, A.K.: Projection-based spatially adaptive reconstruction of block-transform compressed images. IEEE Trans. Image Process. 4(7), 896–908 (1995)
Zhang, Z., Wen, Y.: Primal-dual approach for uniform noise removal. In: First International Conference on Information Science and Electronic Technology (ISET 2015), pp. 103–106 (2015)
Zhen, L., Delp, E.: Block artifact reduction using a transform-domain Markov random field model. IEEE Trans. Circuits Syst. Video Technol. 15(12), 1583–1593 (2005)
Zhou, J., Wu, X., Zhang, L.: \(l_2\) restoration of \(l_\infty \)-decoded images via soft-decision estimation. IEEE Trans. Image Process. 21(12), 4797–4807 (2012)
Acknowledgements
The authors would like to thank the two anonymous referees and the editor for their helpful comments and suggestions.
Author information
Authors and Affiliations
Corresponding author
Additional information
Y.-W. Wen: Research supported in part by the Construct Program of the Key Discipline in Hunan Province and NSFC Grant No. 11361030. W.-K. Ching: Research supported in part by Research Grants Council of Hong Kong under Grant No. 17301214, HKU Strategic Research Theme on Computation and Information, and National Natural Science Foundation of China under Grant No. 11671158. M. Ng: Research supported in part by HKRGC GRF 12306616 and 12203317.
Rights and permissions
About this article
Cite this article
Wen, YW., Ching, WK. & Ng, M. A Semi-smooth Newton Method for Inverse Problem with Uniform Noise. J Sci Comput 75, 713–732 (2018). https://doi.org/10.1007/s10915-017-0557-x
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10915-017-0557-x