Advertisement

Multimedia Tools and Applications

, Volume 78, Issue 16, pp 22959–22975 | Cite as

A novel error detection & concealment technique for videos streamed over error prone channels

  • Muhammad Arslan UsmanEmail author
  • Chi-Hyeok Seong
  • Man Hee Lee
  • Soo Young Shin
Article
  • 42 Downloads

Abstract

In video streaming services and applications, impulse noise occurs due to transmission errors or sometimes it is introduced during signal acquisition. The work presented in this paper proposes a novel impulse noise detection and mitigation (INDAM) method that can significantly recover video frames heavily impaired by impulse noise. The proposed technique uses cyclic redundancy check (CRC) method to create an error mask of the received impaired video frames. This error mask contains pixel-by-pixel error information of the video frames and is exploited further to mitigate the error from the impaired video frame. Each impaired pixel in the video frame is replaced by the average of its corresponding error-free neighboring pixels’ values, hence removing the impaired pixels and replacing them with the newly calculated average. The proposed technique uses the error mask created from the CRC method and uses only those pixels which do not contain error for calculating the averages. Results show that INDAM outperforms other contemporary methods in terms of peak signal to noise ratio (PSNR) and structural similarity index metric (SSIM).

Keywords

Cyclic redundancy check Error concealment Median filter Noise mitigation Video quality 

Notes

Acknowledgements

This research was supported by the MSIT (Ministry of Science, ICT), Korea, under the ITRC (Information Technology Research Center) support program (IITP-2019-2014-1-00639) supervised by the IITP (Institute for Information & communications Technology Planning & Evaluation).

References

  1. 1.
    Abreu E, Lightstone M, Mitra SK, Arakawa K (1996) A new efficient approach for the removal of impulse noise from highly corrupted images. IEEE Trans Image Process 5(6):1012–1025CrossRefGoogle Scholar
  2. 2.
    Aiswarya K, Jayaraj V, Ebenezer D (2010) A new and efficient algorithm for the removal of high density salt and pepper noise in images and videos,” in Second Int. Conf. Computer Modeling and Simulation, pp. 409–413Google Scholar
  3. 3.
    Boyce JM, Stein AJ Video error detection technique using a CRC parity code, US9204167B2, US patentGoogle Scholar
  4. 4.
    Chen T, Wu HR (2001) Adaptive impulse detection using center-weighted median filters. IEEE Signal Process. Lett. 8(1):1–3CrossRefGoogle Scholar
  5. 5.
    Esakkirajan S et al (2011) Removal of high density salt and pepper noise through modified decision based unsymmetric trimmed median filter. IEEE Signal processing letters 18(5):287–290CrossRefGoogle Scholar
  6. 6.
    Hwang H, Haddad RA (1995) Adaptive median filters: new algorithms and results. IEEE Trans Signal Process 4(4):499–502Google Scholar
  7. 7.
    Ko SJ, Lee YH (1991) Center weighted median filters and their applications to image enhancement. IEEE Trans Circuits Syst 38(9):984–993CrossRefGoogle Scholar
  8. 8.
    Lin H, Willson AN (1988) Median filter with adaptive length. IEEE Trans. Circuits Syst. 35(6):675–690MathSciNetCrossRefGoogle Scholar
  9. 9.
    Liu, Y, Nie L, Han L, Zhang L, Rosenblum DS (2015) Action2Activity: recognizing complex activities from sensor data. In IJCAI (Vol. 2015, pp. 1617–1623)Google Scholar
  10. 10.
    Liu Y, Zhang L, Nie L, Yan Y, Rosenblum DS (2016) Fortune Teller: Predicting Your Career Path. In AAAI (Vol. 2016, pp. 201–207)Google Scholar
  11. 11.
    Liu Y, Nie L, Liu L, Rosenblum DS (2016) From action to activity: sensor-based activity recognition. Neurocomputing 181:108–115CrossRefGoogle Scholar
  12. 12.
    Liu L, Cheng L, Liu Y, Jia Y, Rosenblum DS (2016) Recognizing complex activities by a probabilistic interval-based model. In AAAI 30:1266–1272Google Scholar
  13. 13.
    Moorthy AK, Choi LK, Bovik AC, de Veciana G (Oct. 2012) Video quality assessment on mobile devices: subjective, behavioral and objective studies. IEEE J Sel Topics Signal Process 6(6):652–671CrossRefGoogle Scholar
  14. 14.
    Pyun JY (2008) Error concealment aware streaming video system over packet-based mobile networks. IEEE Trans Consum Electron 54(4):1705–1713CrossRefGoogle Scholar
  15. 15.
    Sobolewski JS (2003) Cyclic redundancy check, pp: 476–479Google Scholar
  16. 16.
    Srinivasan KS, Ebenezer D (2007) A new fast and efficient decision based algorithm for removal of high density impulse noise. IEEE Signal Process Lett 14(3):189–192CrossRefGoogle Scholar
  17. 17.
    Sun T, Neuvo Y (1994) Detail-preserving median based filters in image processing. Pattern Recogn Lett 15:341–347CrossRefGoogle Scholar
  18. 18.
    Takahashi A et al (2010) Report on the validation of video quality models for high definition video content. In: Video Qual. Experts group. Tech. Rep, BoulderGoogle Scholar
  19. 19.
    Usman MA, Shin SY, Shahid M, Lövström B (2017) A no reference video quality metric based on jerkiness estimation focusing on multiple frame freezing in video streaming. IETE Tech Rev 34(3):309–320CrossRefGoogle Scholar
  20. 20.
    Usman MA, Usman MR, Shin SY (2018) A Novel No-Reference Metric for Estimating the Impact of Frame Freezing Artifacts on Perceptual Quality of Streamed Videos. IEEE Transactions on Multimedia Google Scholar
  21. 21.
    Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  1. 1.Department of IT Convergence EngKumoh National Institute of TechnologyGumiRepublic of Korea
  2. 2.Union Community co. ltd.SeoulSouth Korea
  3. 3.EM-Tech co., ltd.SeoulSouth Korea

Personalised recommendations