Real-Time Noise Reduction Algorithm for Video with Non-linear FIR Filter
Abstract
Noise is an essential issue for images and videos. Recently, a range of high-sensitivity imaging devices have become available. Cameras are often used under poor lighting conditions for security purposes or night time news gathering. Videos shot under poor lighting conditions are afflicted by significant noise which degrades the image quality. The process of noise removal from videos is called noise reduction (NR). Although many NR methods are proposed, they are complex and are proposed as computer simulations. In practical applications, NR processing of videos occurs in real-time. The practical real-time methods are limited and the complex NR methods cannot cope with real-time processing. Video has three dimensions: horizontal, vertical and temporal. Since the temporal relation is stronger than that of horizontal and vertical, the conventional real-time NR methods use the temporal infinite impulse response (IIR) filter to reduce noise. This approach is known as the inter-frame relation, and the noise reducer comprises a temporal recursive filter. Temporal recursive filters are widely used in digital TV sets to reduce the noise affecting images. Although the temporal recursive filter is a simple algorithm, moving objects leave trails when it reduces the high-level noise. In this paper, a novel NR algorithm is introduced. The proposed method uses finite impulse response (FIR) filter. The FIR filter does not suffer from this trail issue and shows better performance than NR using temporal recursive filters is proposed.
Keywords
Video noise reducer 4KTV 8KTV Real time Non-linear signal processing Image qualityReferences
- 1.Brailean, J.C., Kleihorst, R.P., Efstratiadis, S., Katsaggelos, A.K., Lagenfdijk, R.L.: Noise reduction filter for dynamic image sequeces : review. Proc. IEEE 83, 1272–1292 (1995)CrossRefGoogle Scholar
- 2.Dabov, K., Foi, A., Katkovnik, V., Egiazarian, K.: Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Trans. Image Process. 16(8), 2080–2095 (2007)MathSciNetCrossRefGoogle Scholar
- 3.David, H.A.: Method of Paired Comparisons (Statistical Monograph). Virginia Polytechnic Institute, Blacksburg (1969)Google Scholar
- 4.Elad, M., Aharon, M.: Image denoising via sparse and redundant representations over learned dictionaries. IEEE Trans. Image Process. 15(12), 3736–3745 (2006)MathSciNetCrossRefGoogle Scholar
- 5.Gupta, N., Swamy, M.N., Plotkin, E.: Low-complexity video noise reduction in wavelet domain. In: IEEE 6th Workshop on Multimedia Signal Processing, pp. 239–242 (2004)Google Scholar
- 6.ITU-R-SG6 (2012). https://www.itu.int/rec/r-rec-bt.500/en
- 7.ITU-T (2008). https://www.itu.int/rec/t-rec-p.910/en
- 8.Jovanov, L., et al.: Combined wavelet domain and motion compensated video denoiding based on video codec motion estimation method. IEEE Trans. Circuits Syst. Video Technol. 19(3), 417–421 (2009)CrossRefGoogle Scholar
- 9.Kaur, L., Gupta, S., Chauhan, R.: Image denoising using wavelet thresholding. In: Indian Conference on Computer Vision. Graphics and Image Processing (2002)Google Scholar
- 10.Kazubek, M.: Wavelet domain image denoising by thresholding and wiener filtering. IEEE Sig. Process. 10(11), 324–326 (2003)CrossRefGoogle Scholar
- 11.Kondo, T., Fujimori, Y., Horishi, T., Nishikata, T.: Patent: noise reduction in image signals: Pct, ep0640908 a1, ep19940306328 (1994)Google Scholar
- 12.Lebrun, M., Buades, A., Morel, J.M.: A nonlocal Bayesian image denoising algorithm. SIAM J. Imaging Sci. 6(3), 1665–1688 (2013)MathSciNetCrossRefGoogle Scholar
- 13.Luisier, F., Blue, T., Unser, M.: Surelet for orthonormal wavelet domain video denoising. IEEE Trans. Circuits Syst. Video Technol. 20(6), 913–919 (2010)CrossRefGoogle Scholar
- 14.Mahmoud, R.O., Faheem, M.T.: Comparison between DWT and dual tree complex wavelet transform in video sequences using wavelet domain. In: INFOS (2008)Google Scholar
- 15.Malfait, M., Roose, D.: Wavelet based image denoising using a markov random field a priori model. IEEE Trans. Image Process. 6(4), 549–565 (1997)CrossRefGoogle Scholar
- 16.Mori, C., Gohshi, S.: Real-time non-linear noise reduction algorithm for video. In: SIGAMP 2013, pp. 321–327, August 2018Google Scholar
- 17.Mori, C., Gohshi, S.: Real-time non-linear noise reduction algorithm for video. In: SIGMAP, ICETE, pp. 321–327 (2018)Google Scholar
- 18.Lian, N.X., Zagorodnov, V., Tan, Y.P.: Video denoising using vector estimation of wavelet coefficients. In: ISPACS (2006)Google Scholar
- 19.Piurica, A., Zlokolica, V., Philips, W.: Noise reduction in video sequences using wavelet-domain and temporal filtering. In: Truchetet, F. (ed.) Wavelet Applications in Industrial Processing, Proceedings of the SPIE, vol. 5266, pp. 48–49 (2004)Google Scholar
- 20.Pizurica, A., Zlokolica, V., Philips, W.: Combined wavelet domain and temporal video denoising. In: IEEE Conference on Advanced Video and Signal Based Surveillance, AVSS 2003, pp. 334–341 (2003)Google Scholar
- 21.Portilla, J., Strela, V., Wainwright, M.J., Simoncelli, E.P.: Image denoising using scale mixtures of gaussians in the wavelet domain. IEEE Trans. Image Process. 12(11), 1338–1351 (2003) MathSciNetCrossRefGoogle Scholar
- 22.Rudin, L., Osher, S.: Nonlinear total variation based noise removal algorithms. Physica D 60(1–4), 259–268 (1992)MathSciNetCrossRefGoogle Scholar
- 23.Selesnick, I.W., Li, K.Y.: Video denoising using 2D and 3D dual-tree complex wavelet transforms. In: Wavelet Applications in Signal and Image Processing, SPIE 2003, vol. 5207, pp. 607–618 (2003)Google Scholar
- 24.TI: TVP5160 3D Noise Reduction Calibration Procedure Application Report: SLEA110 May, Texas Instrument Manual (2011)Google Scholar
- 25.Yagi, S., Inoue, S., Hayashi, M., Okui, S., Gohshi, S.: Practical Video Signal Processing, Ohmusha, pp. 143–145 (2004). (in Japanese). ISBN 4-274-94637-1Google Scholar
- 26.Yang, Q.X., Tan, K.I., Ahuja, N.: Real time O(1) bilateral filtering. In: Computer Vision and Pattern Recognition (CVPR) (2009)Google Scholar