Advertisement

I3D: a new dataset for testing denoising and demosaicing algorithms

  • Cristian Bonanomi
  • Simone Balletti
  • Michela Lecca
  • Marco Anisetti
  • Alessandro Rizzi
  • Ernesto Damiani
Article

Abstract

In this paper we present a dataset of images to test the performance of image processing algorithms, in particular demosaicing and denoising methods. Despite the plethora of demosaicing and denoising algorithms present in the literature, only few benchmarks are available to test their performance, and most of them are quite old, thus inadequate to represent the images captured by modern devices. The proposed dataset is composed by twenty 16 bit-depth images that can be used to test full-reference image quality metrics. More specifically, twelve pictures have been synthetically created by means of 2D or 3D softwares, while eight images have been captured by a high-end digital camera.

Keywords

Image dataset Demosaicing Denoising Image quality 

Notes

Acknowledgments

We would like to thank John McCann, Prof. Bradley Lucier and Prof. Michael Kriss, that answered to our questions about the Kodak Photo CD.

References

  1. 1.
    Adams JE Jr (1995) Interactions between color plane interpolation and other image processing functions in electronic photography. In: IS&T/SPIE’s Symposium on electronic imaging: science & technology. International Society for Optics and Photonics, pp 144–151Google Scholar
  2. 2.
  3. 3.
  4. 4.
    Akiyama H, Tanaka M, Okutomi M (2015) Pseudo four-channel image denoising for noisy cfa raw data. In: 2015 IEEE International Conference on image processing (ICIP). IEEE, pp 4778–4782Google Scholar
  5. 5.
    Assembly IR (2003) Methodology for the subjective assessment of the quality of television pictures. International Telecommunication UnionGoogle Scholar
  6. 6.
    Baek M, Jeong J (2014) Demosaicing algorithm using high-order interpolation with sobel operators. In: Proc. of the World Congress on engineering and computer scienceGoogle Scholar
  7. 7.
    Baraniuk R (1999) Optimal tree approximation with wavelets. In: SPIE’s International symposium on optical science, engineering, and instrumentation. International Society for Optics and Photonics, pp 196–207Google Scholar
  8. 8.
    Blender (2017) https://www.blender.org/
  9. 9.
    Buades A, Coll B, Morel JM (2005) A review of image denoising algorithms, with a new one. Multiscale Model Simul 4(2):490–530MathSciNetCrossRefzbMATHGoogle Scholar
  10. 10.
    Buccigrossi RW, Simoncelli EP (1999) Image compression via joint statistical characterization in the wavelet domain. IEEE Trans Image Process 8(12):1688–1701CrossRefGoogle Scholar
  11. 11.
    Bui TD, Chen G (1998) Translation-invariant denoising using multiwavelets. IEEE Trans Signal Process 46(12):3414–3420CrossRefGoogle Scholar
  12. 12.
    Choi H, Baraniuk R (1998) Analysis of wavelet-domain wiener filters. In: Proceedings of the IEEE-SP International symposium on time-frequency and time-scale analysis, 1998. IEEE, pp 613–616Google Scholar
  13. 13.
    Chung KH, Chan YH (2006) Color demosaicing using variance of color differences. IEEE Trans Image Process 15(10):2944–2955CrossRefGoogle Scholar
  14. 14.
    Chung KH, Chan YH (2010) Low-complexity color demosaicing algorithm based on integrated gradients. J Electr Imaging 19(2):021104–021104CrossRefGoogle Scholar
  15. 15.
  16. 16.
    Cohen I, Raz S, Malah D (1999) Translation-invariant denoising using the minimum description length criterion. Signal Process 75(3):201–223CrossRefzbMATHGoogle Scholar
  17. 17.
    Condat L, Mosaddegh S (2012) Joint demosaicking and denoising by total variation minimization. In: 2012 19th IEEE International conference on image processing. IEEE, pp 2781–2784Google Scholar
  18. 18.
  19. 19.
    Donoho DL (1995) De-noising by soft-thresholding. IEEE Trans Inf Theory 41 (3):613–627MathSciNetCrossRefzbMATHGoogle Scholar
  20. 20.
    Donoho DL, Johnstone JM (1994) Ideal spatial adaptation by wavelet shrinkage. Biometrika 81(3):425–455MathSciNetCrossRefzbMATHGoogle Scholar
  21. 21.
  22. 22.
    Duran J, Buades A (2015) A demosaicking algorithm with adaptive inter-channel correlation. Image Process Line 5:311–327.  https://doi.org/10.5201/ipol.2015.145. http://demo.ipol.im/demo/145/ MathSciNetCrossRefGoogle Scholar
  23. 23.
    Eskicioglu AM, Fisher PS (1995) Image quality measures and their performance. IEEE Trans Commun 43(12):2959–2965CrossRefGoogle Scholar
  24. 24.
    Fodor IK, Kamath C (2003) Denoising through wavelet shrinkage: an empirical study. J Electr Imag 12(1):151–160CrossRefGoogle Scholar
  25. 25.
    Froment J (2014) Parameter-free fast pixelwise non-local means denoising. Image Process Line 4:300–326.  https://doi.org/10.5201/ipol.2014.120. http://www.ipol.im/pub/art/2014/120/ CrossRefGoogle Scholar
  26. 26.
    Gao D, Wu X, Shi G, Zhang L (2012) Color demosaicking with an image formation model and adaptive pca. J Vis Commun Image Represent 23(7):1019–1030CrossRefGoogle Scholar
  27. 27.
    Gharbi M, Chaurasia G, Paris S, Durand F (2016) Deep joint demosaicking and denoising. ACM Trans Graph (TOG) 35(6):191CrossRefGoogle Scholar
  28. 28.
    Go J, Sohn K, Lee C (2000) Interpolation using neural networks for digital still cameras. IEEE Trans Consum Electron 46(3):610–616CrossRefGoogle Scholar
  29. 29.
    Gonzalez RC, Richard E (2008) Woods, digital image processing. Prentice Hall Press, PearsonGoogle Scholar
  30. 30.
    Goossens B, Aelterman J, Luong H, Pižurica A, Philips W (2013) Complex wavelet joint denoising and demosaicing using gaussian scale mixtures. In: 2013 IEEE International conference on image processing. IEEE, pp 445–448Google Scholar
  31. 31.
    Hamza AB, Luque-Escamilla PL, Martínez-Aroza J, Román-Roldán R. (1999) Removing noise and preserving details with relaxed median filters. J. Math. Imaging Vis. 11(2):161–177MathSciNetCrossRefGoogle Scholar
  32. 32.
    Hibbard RH (1995) Apparatus and method for adaptively interpolating a full color image utilizing luminance gradients. US Patent 5,382,976Google Scholar
  33. 33.
    Hirakawa K, Parks TW (2006) Joint demosaicing and denoising. IEEE Trans Image Process 15(8):2146–2157CrossRefGoogle Scholar
  34. 34.
    Hyvarinen A, Oja E, Hoyer P, Hurri J (1998) Image feature extraction by sparse coding and independent component analysis. In: Fourteenth International conference on pattern recognition, 1998. Proceedings, vol 2. IEEE, pp 1268–1273Google Scholar
  35. 35.
    Jain P, Tyagi V (2016) A survey of edge-preserving image denoising methods. Inf Syst Front 18(1):159–170CrossRefGoogle Scholar
  36. 36.
    John DM, Thomas A (2015) Combined denoising and demosaicing of cfa images. In: 2015 IEEE International Conference on signal processing, informatics, communication and energy systems (SPICES). IEEE, pp 1–6Google Scholar
  37. 37.
    Jung A (2001) An introduction to a new data analysis tool: independent component analysis. In: Proceedings of Workshop GK “Nonlinearity”. RegensburgGoogle Scholar
  38. 38.
    Kakarala R, Baharav Z (2002) Adaptive demosaicing with the principal vector method. IEEE Trans Consum Electron 48(4):932–937CrossRefGoogle Scholar
  39. 39.
    Khashabi D, Nowozin S, Jancsary J, Fitzgibbon AW (2014) Joint demosaicing and denoising via learned nonparametric random fields. IEEE Trans Image Process 23 (12):4968–4981MathSciNetCrossRefzbMATHGoogle Scholar
  40. 40.
    Kimmel R (1999) Demosaicing: image reconstruction from color ccd samples. IEEE Trans Image Process 8(9):1221–1228CrossRefGoogle Scholar
  41. 41.
    Klatzer T, Hammernik K, Knobelreiter P, Pock T (2016) Learning joint demosaicing and denoising based on sequential energy minimization. In: 2016 IEEE International Conference on computational photography (ICCP). IEEE, pp 1–11Google Scholar
  42. 42.
    Kodac - Bradley J. (2016) Lucier webpage: https://www.math.purdue.edu/~lucier/PHOTO_CD/RIGHTS/RIGHTS.USE
  43. 43.
    Kodac - Rich Franzen webpage: (2016) http://r0k.us/graphics/kodak/
  44. 44.
    Lang M, Guo H, Odegard JE, Burrus CS, Wells RO Jr (1995) Nonlinear processing of a shift-invariant discrete wavelet transform (dwt) for noise reduction. In: SPIE’s 1995 Symposium on OE/aerospace sensing and dual use photonics. International Society for Optics and Photonics, pp 640–651Google Scholar
  45. 45.
    Laroche CA, Prescott MA (1994) Apparatus and method for adaptively interpolating a full color image utilizing chrominance gradients. US Patent 5,373,322Google Scholar
  46. 46.
    Lebrun M, Buades A, Morel JM (2013) Implementation of the “Non-Local Bayes” (NL-Bayes) image denoising algorithm. Image Process Line 3:1–42.  https://doi.org/10.5201/ipol.2013.16 CrossRefGoogle Scholar
  47. 47.
    Lebrun M, Colom M, Morel JM (2015) The noise clinic: a blind image denoising algorithm. Image Process Line 5:1–54.  https://doi.org/10.5201/ipol.2015.125. http://demo.ipol.im/demo/125/ CrossRefGoogle Scholar
  48. 48.
    Lee K, Jeong S, Choi Js, Lee S (2014) Multiscale edge-guided demosaicking algorithm. In: The 18th IEEE International symposium on consumer electronics (ISCE 2014). IEEE, pp 1–3Google Scholar
  49. 49.
    Lian NX, Chang L, Tan YP, Zagorodnov V (2007) Adaptive filtering for color filter array demosaicking. IEEE Trans Image Process 16(10):2515–2525MathSciNetCrossRefGoogle Scholar
  50. 50.
    Lu J, Weaver JB, Healy DM, Xu Y (1992) Noise reduction with a multiscale edge representation and perceptual criteria. In: Proceedings of the IEEE-SP international symposium on time-frequency and time-scale analysis, 1992. IEEE, pp 555–558Google Scholar
  51. 51.
    Menon D, Calvagno G (2007) Demosaicing based onwavelet analysis of the luminance component. In: 2007 IEEE International conference on image processing, vol 2. IEEE, pp II–181Google Scholar
  52. 52.
    Menon D, Calvagno G (2009) Joint demosaicking and denoisingwith space-varying filters. In: 2009 16th IEEE International conference on image processing (ICIP). IEEE, pp 477–480Google Scholar
  53. 53.
    Motwani MC, Gadiya MC, Motwani RC, Harris FC (2004) Survey of image denoising techniques. In: Proceedings of GSPX, pp 27–30Google Scholar
  54. 54.
    Nuno-Maganda MA, Arias-Estrada MO (2005) Real-time fpga-based architecture for bicubic interpolation: an application for digital image scaling. In: 2005 International Conference on reconfigurable computing and FPGAs (ReConFig’05). IEEE, pp 8–ppGoogle Scholar
  55. 55.
    Online IP (2018) http://www.ipol.im/
  56. 56.
    Paliy D, Foi A, Bilcu R, Katkovnik V (2008) Denoising and interpolation of noisy bayer data with adaptive cross-color filters. In: Electronic Imaging 2008. International Society for Optics and Photonics, pp 68221K–68221KGoogle Scholar
  57. 57.
    Park J, Jang ES, Chong JW (2016) Demosaicing method for digital cameras with white-rgb color filter array. ETRI J 38(1):164–173CrossRefGoogle Scholar
  58. 58.
    Pei SC, Tam IK (2003) Effective color interpolation in ccd color filter arrays using signal correlation. IEEE Trans Circ Syst Vid Technol 13(6):503–513CrossRefGoogle Scholar
  59. 59.
    Pekkucuksen I, Altunbasak Y (2013) Multiscale gradients-based color filter array interpolation. IEEE Trans Image Process 22(1):157–165MathSciNetCrossRefzbMATHGoogle Scholar
  60. 60.
    Pierazzo N, Facciolo G (2017) Data adaptive dual domain denoising: a method to boost state of the art denoising algorithms. Image Process Line 7:93–114.  https://doi.org/10.5201/ipol.2017.203. http://www.ipol.im/pub/art/2017/203/ CrossRefGoogle Scholar
  61. 61.
    Planetside (2017) http://planetside.co.uk/
  62. 62.
    Portilla J, Strela V, Wainwright MJ, Simoncelli EP (2003) Image denoising using scale mixtures of gaussians in the wavelet domain. IEEE Trans Image Process 12 (11):1338–1351MathSciNetCrossRefzbMATHGoogle Scholar
  63. 63.
    Prakash VS, Prasad KS, Prasad TJC (2016) Color image demosaicing using sparse based radial basis function network. Alexandria Eng JGoogle Scholar
  64. 64.
    Preethi S, Narmadha D (2012) A survey on image denoising techniques. Int J Comput Appl, 58(6)Google Scholar
  65. 65.
    Rajaei B (2014) An analysis and improvement of the BLS-GSM denoising method. Image Process Line 4:44–70.  https://doi.org/10.5201/ipol.2014.86. http://www.ipol.im/pub/art/2014/86/ CrossRefGoogle Scholar
  66. 66.
    Rizzi A, Algeri T, Medeghini G, Marini D (2004) A proposal for contrast measure in digital images. In: CGIV 2004 - Second European conference on color in graphics, imaging, and vision and sixth international symposium on multispectral color science. Aachen, pp 187–192Google Scholar
  67. 67.
    Romberg JK, Choi H, Baraniuk R (2001) Bayesian tree-structured image modeling using wavelet-domain hidden Markov models. IEEE Trans Image Process 10 (7):1056–1068CrossRefGoogle Scholar
  68. 68.
    Shao L, Rehman AU (2014) Image demosaicing using content and colour-correlation analysis. Signal Process 103:84–91CrossRefGoogle Scholar
  69. 69.
    Strela V (2001) Denoising via block wiener filtering in wavelet domain. In: European Congress of mathematics. Springer, pp 619–625Google Scholar
  70. 70.
    Su CY (2006) Highly effective iterative demosaicing using weighted-edge and color-difference interpolations. IEEE Trans Consum Electron 52(2):639–645MathSciNetCrossRefGoogle Scholar
  71. 71.
  72. 72.
    Sung DC, Tsao HW (2015) Demosaicing using subband-based classifiers. Electron Lett 51(3):228–230CrossRefGoogle Scholar
  73. 73.
    Tao B, Tastl I, Cooper T, Blasgen M, Edwards E (1999) Demosaicing using human visual properties and wavelet interpolation filtering. In: Color and imaging conference, vol 1999. Society for Imaging Science and Technology, pp 252–256Google Scholar
  74. 74.
    Thung KH, Raveendran P (2009) A survey of image quality measures. In: 2009 International Conference for technical postgraduates (TECHPOS). IEEE, pp 1–4Google Scholar
  75. 75.
    Wang Z, Simoncelli EP (2005) Reduced-reference image quality assessment using a wavelet-domain natural image statistic model. In: Human Vision and electronic imaging, vol 5666, pp 149–159Google Scholar
  76. 76.
    Wang YQ, Limare N (2015) A fast C++ implementation of neural network backpropagation training algorithm: application to Bayesian optimal image demosaicing. Image Process Line 5:257–266.  https://doi.org/10.5201/ipol.2015.137. http://demo.ipol.im/demo/137/ CrossRefGoogle Scholar
  77. 77.
    Wang J, Wu J, Wu Z, Jeon G (2017) Filter-based bayer pattern cfa demosaicking. Circ, Syst, Signal Process, 1–24Google Scholar
  78. 78.
    Wiener N (1949) Extrapolation, interpolation, and smoothing of stationary time series, vol 2. MIT Press, CambridgezbMATHGoogle Scholar
  79. 79.
    Wu J, Anisetti M, Wu W, Damiani E, Jeon G (2016) Bayer demosaicking with polynomial interpolation. IEEE Trans Image Process 25(11):5369–5382MathSciNetCrossRefGoogle Scholar
  80. 80.
    Wu J, Timofte R, Van Gool L (2016) Demosaicing based on directional difference regression and efficient regression priors IEEE transactions on image processing: a publication of the IEEE signal processing societyGoogle Scholar
  81. 81.
    Yang R, Yin L, Gabbouj M, Astola J, Neuvo Y (1995) Optimal weighted median filtering under structural constraints. IEEE Trans Signal Process 43(3):591–604CrossRefGoogle Scholar
  82. 82.
    Yang B, Luo J, Guo L, Cheng F (2016) Simultaneous image fusion and demosaicing via compressive sensing. Inf Process Lett 116(7):447–454MathSciNetCrossRefzbMATHGoogle Scholar
  83. 83.
  84. 84.
    Zhang L, Wu X (2005) Color demosaicking via directional linear minimum mean square-error estimation. IEEE Trans Image Process 14(12):2167–2178CrossRefGoogle Scholar
  85. 85.
  86. 86.
    Zhang H, Nosratinia A, Wells R (2000) Image denoising via wavelet-domain spatially adaptive fir wiener filtering. In: 2000 IEEE International Conference on acoustics, speech, and signal processing, 2000. ICASSP’00. Proceedings, vol 6. IEEE, pp 2179–2182Google Scholar
  87. 87.
    Zhang L, Lukac R, Wu X, Zhang D (2009) Pca-based spatially adaptive denoising of cfa images for single-sensor digital cameras. IEEE Trans Image Process 18 (4):797–812MathSciNetCrossRefzbMATHGoogle Scholar
  88. 88.
    Zhang L, Wu X, Buades A, Li X (2011) Color demosaicking by local directional interpolation and nonlocal adaptive thresholding. J Electron Imaging 20 (2):023016–023016CrossRefGoogle Scholar
  89. 89.
    Zhang C, Li Y, Wang J, Hao P (2016) Universal demosaicking of color filter arrays. IEEE Trans Image Process 25(11):5173–5186MathSciNetCrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Department of Computer ScienceUniversity of MilanMilanItaly
  2. 2.Fondazione Bruno KesslerCenter for Information and Communication TechnologyTrentoItaly
  3. 3.ETISALAT BT Innovation Center Khalifa UniversityAbu DhabiUnited Arab Emirates

Personalised recommendations