Skip to main content
SpringerLink
Log in

Regional mutual information-based identification and reduction of flicker artifacts during video encoding

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Present manuscript discusses a novel technique to identify flicker-prone regions in video and reduce its effects. The flicker-prone regions are identified with the help of regional mutual information which takes into account the geometrical properties of the frames while requiring no prior information about the data under consideration, which makes it suitable for video-processing applications. The flicker-prone regions are passed through a temporal filter before standard compliant encoding of the video sequence. Accurate measurement of the flicker-prone regions and independence of the encoding methodology makes the proposed method suitable for wide variety of encoders.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Notes

  1. Joint and marginal entropy is given by Shannon [13]

    figure a

    which represents the entropy of a normally distributed set of points in \(\mathfrak {R}^{d}\) with covariance matrix \({\varSigma }_{d}\).

  2. See Footnote 1.

  3. \(\exists x_1 \approx x_2\) because of negligible change between co-located MBs.

  4. From experiments we conclude that normalized RMI above 0.8 are flicker prone.

  5. More sequence results with different MB sizes are available at https://goo.gl/CWVjZX.

  6. We may use more number of neighborhood pixels but that will not be able to retain fine oscillations.

  7. SSIM for more sequences can be found at https://goo.gl/9PO2QY.

  8. A detailed SSIM improvement value table with analysis diagrams for every frame is available at https://goo.gl/0Piz4l for various video sequences.

  9. PSNR loss for more sequences can be found at https://goo.gl/wCwNyR.

References

  1. Akram, M., Izquierdo, E.: Fast motion estimation for surveillance video compression. SIViP 7(6), 1103–1112 (2013). doi:10.1007/s11760-012-0355-8

    Article  Google Scholar 

  2. Becker, A., Chan, W., Poulouin, D.: Flicker reduction in intraframe codecs. In: Data Compression Conference, 2004. Proceedings. DCC 2004, pp. 252–261 (2004). doi:10.1109/DCC.2004.1281470

  3. Chang, H.C., Yang, C.K.: Fast content-aware video length reduction. SIViP 8(7), 1383–1397 (2014). doi:10.1007/s11760-012-0367-4

    Article  Google Scholar 

  4. Chono, K., Senda, Y., Miyamoto, Y.: Detented quantization to suppress flicker artifacts in periodically inserted intra-coded pictures in H. 264 video coding. In: 2006 IEEE International Conference on Image Processing, IEEE, pp. 1713–1716 (2006)

  5. Cover, T., Thomas, J.: Elements of Information Theory. Wiley, London (2006)

    MATH  Google Scholar 

  6. Fan, X., Gao, W., Lu, Y., Zhao, D.: Flicking reduction in all intra frame coding. JVT-E070, Joint Video Team of ISO/IEC MPEG and ITU-T VCEG Meeting (2002)

  7. Itani, Y., Watanabe, H.: A study on flicker reduction based on distinction between static and moving region in motion JPEG 2000. In: IEICE Technical Reports, vol. 105, pp. 77–82 (2005)

  8. Kanumuri, S., Guleryuz, O.G., Civanlar, M.R., Fujibayashi, A., Boon, C.S.: Temporal flicker reduction and denoising in video using sparse directional transforms. In: Proceedings of SPIE, vol. 7073 (2008)

  9. Kanumuri, S., Guleryuz, O.G., Civanlar, M.R., Fujibayashi, A., Boon, C.S.: Noise and/or flicker reduction in video sequences using spatial and temporal processing. US Patent 8,731,062 (2014)

  10. Kuge, T.: Wavelet picture coding and its several problems of the application to the interlace HDTV and the ultra-high definition images. In: Proceedings. 2002 International Conference on Image Processing, vol. 3, pp. III-217–III-220 (2002). doi:10.1109/ICIP.2002.1038944

  11. Maes, F., Collignon, A., Vandermeulen, D., Marchal, G., Suetens, P.: Multimodality image registration by maximization of mutual information. IEEE Trans. Med. Imaging 16(2), 187–198 (1997)

    Article  Google Scholar 

  12. Russakoff, D., Tomasi, C., Rohlfing, T., Maurer, C.: Image similarity using mutual information of regions. Comput. Vis. ECCV 2004, 596–607 (2004)

    MATH  Google Scholar 

  13. Shannon, C.: A mathematical theory of communication. ACM SIGMOBILE Mob. Comput. Commun. Rev. 5(1), 3–55 (2001)

    Article  MathSciNet  Google Scholar 

  14. Subr, K., Soler, C., Durand, F.: Edge-preserving multiscale image decomposition based on local extrema. ACM Trans. Graph. (TOG) 28(5), 147 (2009)

    Article  Google Scholar 

  15. Tian, X., Jiao, L., Duan, Y., Zhang, X.: Video denoising via spatially adaptive coefficient shrinkage and threshold adjustment in surfacelet transform domain. SIViP 8(5), 901–912 (2014). doi:10.1007/s11760-012-0338-9

    Article  Google Scholar 

  16. Viola, P., Wells III, W.: Alignment by maximization of mutual information. Int. J. Comput. Vis. 24(2), 137–154 (1997)

    Article  Google Scholar 

  17. Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)

    Article  Google Scholar 

  18. Wu, H., Rao, K.: Digital Video Image Quality and Perceptual Coding. CRC, Boca Raton (2005)

    Book  Google Scholar 

  19. Yang, H., Boyce, J., Stein, A.: Effective flicker removal from periodic intra frames and accurate flicker measurement. In: ICIP 2008. 15th IEEE International Conference on Image Processing, pp. 2868–871 (2008). doi:10.1109/ICIP.2008.4712393

  20. Yang, J., Park, J.B., Jeon, B.: Flickering effect reduction for H.264/AVC intra frames. In: Multimedia Systems and Applications IX (2006). doi:10.1117/12.689901

Download references

Author information

Authors and Affiliations

  1. Department of Electronics and Communication Engineering, Thapar University, Patiala, Punjab, India

    Vinay Kumar

Authors
  1. Vinay Kumar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Vinay Kumar.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kumar, V. Regional mutual information-based identification and reduction of flicker artifacts during video encoding. SIViP 11, 621–628 (2017). https://doi.org/10.1007/s11760-016-1002-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-016-1002-6

Keywords

Search

Navigation