Fast and Accurate Image Denoising via a Deep Convolutional-Pairs Network

  • Lulu SunEmail author
  • Yongbing Zhang
  • Wangpeng An
  • Jingtao Fan
  • Jian Zhang
  • Haoqian Wang
  • Qionghai Dai
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9916)


Most of popular image denoising approaches exploit either the internal priors or the priors learned from external clean images to reconstruct the latent image. However, it is hard for those algorithms to construct the perfect connections between the clean images and the noisy ones. To tackle this problem, we present a deep convolutional-pairs network (DCPN) for image denoising in this paper. With the observation that deeper networks improve denoising performance, we propose to use deeper networks than those employed previously for low-level image processing tasks. In our method, we attempt to build end-to-end mappings directly from a noisy image to its corresponding noise-free image by using deep convolutional layers in pair applied to image patches. Because of those mappings trained from large data, the process of denoising is much faster than other methods. DCPN is composed of three convolutional-pairs layers and one transitional layer. Two convolutional-pairs layers are used for encoding and the other one is used for decoding. Numerical experiments show that the proposed method outperforms many state-of-the-art denoising algorithms in both speed and performance.


Convolutional Neural Networks Deep Convolutional-Pairs Network End-to-end Image denoising 



This work was partially supported by the National Natural Science Foundation of China under Grant 61571254, U1201255, U1301257, and Guangdong Natural Science Foundation 2014A030313751.


  1. 1.
    Arias-Castro, E., Donoho, D.L.: Does median filtering truly preserve edges better than linear filtering? Ann. Statist. 37(3), 1172–1206 (2009)MathSciNetCrossRefzbMATHGoogle Scholar
  2. 2.
    Buades, A., Coll, B., Morel, J.M.: A non-local algorithm for image denoising. In: CVPR, pp. 60–65 (2005)Google Scholar
  3. 3.
    Burger, H.C., Schuler, C.J., Harmeling, S.: Image denoising: can plain neural networks compete with BM3D?. In: CVPR, pp. 2392–2399 (2012)Google Scholar
  4. 4.
    Chen, F., Zhang, L., Yu, H.: External patch prior guided internal clustering for image denoising. In: ICCV, pp. 603–611 (2015)Google Scholar
  5. 5.
    Dabov, K., Foi, A., Katkovnik, V., Egiazarian, K.: Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Trans. Image Process. 16(8), 2080–2095 (2007)MathSciNetCrossRefGoogle Scholar
  6. 6.
    Dong, C., Loy, C.C., He, K., Tang, X.: Learning a deep convolutional network for image super-resolution. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8693, pp. 184–199. Springer, Heidelberg (2014). doi: 10.1007/978-3-319-10593-2_13 Google Scholar
  7. 7.
    Dong, W., Zhang, L., Shi, G., Li, X.: Nonlocally centralized sparse representation for image restoration. IEEE Trans. Image Process. 22(4), 1620–1630 (2013)MathSciNetCrossRefGoogle Scholar
  8. 8.
    Elad, M., Aharon, M.: Image denoising via sparse and redundant representations over learned dictionaries. IEEE Trans. Image Process. 15(12), 3736–3745 (2006)MathSciNetCrossRefGoogle Scholar
  9. 9.
    Girshick, R., Donahue, J., Darrell, T., Malik, J.: Rich feature hierarchies for accurate object detection and semantic segmentation. In: CVPR, pp. 580–587 (2014)Google Scholar
  10. 10.
    Gu, S., Zhang, L., Zuo, W., Feng, X.: Weighted nuclear norm minimization with application to image denoising. In: CVPR, pp. 2862–2869 (2014)Google Scholar
  11. 11.
    Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: NIPS, pp. 1097–1105 (2012)Google Scholar
  12. 12.
    Lin, M., Chen, Q., Yan, S.: Network in network. arXiv preprint arXiv:1312.4400 (2013)
  13. 13.
    Liu, H., Xiong, R., Zhang, J., Gao, W.: Image denoising via adaptive soft-thresholding based on non-local samples. In: CVPR, pp. 484–492 (2015)Google Scholar
  14. 14.
    Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: CVPR, pp. 3431–3440 (2015)Google Scholar
  15. 15.
    Rudin, L.I., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. Phys. D Nonlinear Phenom. 60(1), 259–268 (1992)MathSciNetCrossRefzbMATHGoogle Scholar
  16. 16.
    Tomasi, C., Manduchi, R.: Bilateral filtering for gray and color images. In: ICCV, pp. 839–846 (1998)Google Scholar
  17. 17.
    Vincent, P., Larochelle, H., Bengio, Y., Manzagol, P.A.: Extracting and composing robust features with denoising autoencoders. In: ICML, pp. 1096–1103 (2008)Google Scholar
  18. 18.
    Wiener, N.: Extrapolation, Interpolation, and Smoothing of Stationary Time Series, vol. 2. MIT Press, Cambridge (1949)zbMATHGoogle Scholar
  19. 19.
    Xie, J., Xu, L., Chen, E.: Image denoising and inpainting with deep neural networks. In: NIPS, pp. 341–349 (2012)Google Scholar
  20. 20.
    Xu, J., Zhang, L., Zuo, W., Zhang, D., Feng, X.: Patch group based nonlocal self-similarity prior learning for image denoising. In: ICCV, pp. 244–252 (2015)Google Scholar
  21. 21.
    Yang, J., Wright, J., Huang, T.S., Ma, Y.: Image super-resolution via sparse representation. IEEE Trans. Image Process. 19(11), 2861–2873 (2010)MathSciNetCrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2016

Authors and Affiliations

  • Lulu Sun
    • 1
    • 3
    Email author
  • Yongbing Zhang
    • 1
  • Wangpeng An
    • 1
    • 3
  • Jingtao Fan
    • 3
  • Jian Zhang
    • 2
  • Haoqian Wang
    • 1
  • Qionghai Dai
    • 1
    • 3
  1. 1.Graduate School at ShenzhenTsinghua UniversityBeijingChina
  2. 2.Institute of Digital MediaPeking UniversityBeijingChina
  3. 3.Department of AutomationTsinghua UniversityBeijingChina

Personalised recommendations