Advertisement

Multimedia Systems

, Volume 18, Issue 3, pp 251–262 | Cite as

Eliminating the effect of freezing frames on user perceptive by using a time interleaving technique

  • Hussein Muzahim AzizEmail author
  • Markus Fiedler
  • Håkan Grahn
  • Lars Lundberg
Regular Paper

Abstract

Streaming video over a wireless network faces several challenges such as high packet error rates, bandwidth variations, and delays, which could have negative effects on the video streaming and the viewer will perceive a frozen picture for certain durations due to loss of frames. In this study, we propose a Time Interleaving Robust Streaming (TIRS) technique to significantly reduce the frozen video problem and provide a satisfactory quality for the mobile viewer. This is done by reordering the streaming video frames as groups of even and odd frames. The objective of streaming the video in this way is to avoid the losses of a sequence of neighbouring frames in case of a long sequence interruption. We evaluate our approach by using a user panel and mean opinion score (MOS) measurements; where the users observe three levels of frame losses. The results show that our technique significantly improves the smoothness of the video on the mobile device in the presence of frame losses, while the transmitted data are only increased by almost 9% (due to reduced time locality).

Keywords

Streaming video Frozen pictures Interleaving Switching frames MOS 

Notes

Acknowledgments

We would like to thank the staff and students at Blekinge Institute of Technology, Sweden, for participating in the subjective experiments. We also would like to thank the Swedish Knowledge Foundation for sponsoring a part of this work through the project QoEMoS (21601420).

References

  1. 1.
    Apostolopoulos, J.: Reliable video communication over lossy packet networks using multiple state encoding and path diversity. In: Proceedings of Visual Communications and Image Processing, pp. 392–409 (2001)Google Scholar
  2. 2.
    Argyriou, A., Madisetti, V.: Streaming H.264/AVC video over the internet. In: IEEE Consumer Communications and Networking Conference (CCNC’04), pp. 169–174 (2004)Google Scholar
  3. 3.
    Aziz, H.M., Fiedler, M., Grahn H., Lundberg, L.: Streaming video as space-divided sub-frames over wireless networks. In: the Proceedings of the 3rd Joint IFIP Wireless and Mobile Networking Conference, (WMNC’10) (2010)Google Scholar
  4. 4.
    Benslimane, A.: Multimedia multicast on the internet. Wiley-ISTE publisher (2007)Google Scholar
  5. 5.
    Cai, J., Chen, C.W.: FEC-based video streaming over packet loss networks with pre-interleaving. In: Proceeding for the International Conference on Information Technology: Coding and Computing, pp. 10–14 (2001)Google Scholar
  6. 6.
    Chen, L.-J., Sun, T., Sanadidi, M.Y., Gerla, M.: Improving wireless link throughput via interleaved FEC. In: Proceedings of the 9th IEEE Symposium on Computers and Communications, pp. 539–544 (2004)Google Scholar
  7. 7.
    Claypool, M., Zhu, Y.: Using interleaving to ameliorate the effects of packet loss in a video stream. In: Proceedings of the International Workshop on Multimedia Network Systems and Applications (MNSA) (2003)Google Scholar
  8. 8.
    Cranley, N., Davis, M.: Video frame differentiation for streamed multimedia over heavily loaded IEEE 802.11e WLAN using TXOP. In: Proceedings of 18th Annual IEEE International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC’07) (2007)Google Scholar
  9. 9.
    Dapeng, W., Hou, Y.T., Zhu, W., Zhang, Y.-Q., Peha, J.M.: Streaming video over the internet: approaches and directions. IEEE. Tran. Circ. Syst. Video. Tech. 11(3), 282–300 (2001)CrossRefGoogle Scholar
  10. 10.
    International Telecommunication Union. Methodology for the subjective assessment of the quality of television pictures. ITU-R, Rec. BT.500-11, (2002)Google Scholar
  11. 11.
    Jianhua, W., Jianfei, C.: Quality-smoothed encoding for real-time video streaming applications. In: Proceedings of the 9th International Symposium on Consumer Electronics (ISCE’05), pp. 445–449 (2005)Google Scholar
  12. 12.
    Lo, A., Heijenk, G., Niemegeers, I.: Performance evaluation of MPEG-4 video streaming over UMTS networks using an integrated tool environment. In: Proceedings of the International Symposium on Performance Evaluation of Computer and Telecommunication Systems (SPECTS’05), pp. 676–682 (2005)Google Scholar
  13. 13.
    Lei, H., Fan, C., Zhang, X., Yang, D.: QoS aware packet scheduling algorithm for OFDMA systems. In: IEEE 66th Vehicular Technology Conference, pp.1877–1881 (2007)Google Scholar
  14. 14.
    Martinez-Rachm, M., Lopez, O., Pinol, P., Malumbres, M.P., Oliver, J., Calafate, C.T.: Quality assessment metrics vs. PSNR under packet loss scenarios in MANET wireless networks. In: Proceedings of the International Workshop on Mobile Video (MV ‘07), pp. 31–36 (2007)Google Scholar
  15. 15.
    Martinez-Rach, M., Lopez, O., Pinol, P., Malumbres, M.P., Oliver, J., Calafate, C.T.: Behavior of quality assessment metrics under packet losses on wireless networks. XIX Jornadas de Paralelismov (2008)Google Scholar
  16. 16.
    Mancuso, V., Gambardella, M., Bianchi, G.: Improved support for streaming services in vehicular networks. In: Proceedings of ICC 2004 Conference, pp. 4362–4366 (2004)Google Scholar
  17. 17.
    Nafaa, A., Ahmed, T., Mehaoua, A.: Unequal and interleaved FEC protocol for robust MPEG-4 multicasting over wireless LANs. In: Proceedings of the IEEE International Conference on Communications (ICC’04), pp. 1431–1435 (2004)Google Scholar
  18. 18.
    Nafaa, A., Taleb, T., Murphy, L.: Forward error correction strategies for media streaming over wireless networks. IEEE. Commun. Mag. Featur. Top. New. Trends. Mob. Internet. Tech. Appl. 46(1), 72–79 (2008)Google Scholar
  19. 19.
    Ong, E.P., We, S., Loke, M.H., Rahardja, S., Tay, J., Tan, C.K., Huang, L.: Video quality monitoring of streamed videos. In: Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP `09), pp. 1153–1156 (2009)Google Scholar
  20. 20.
    Peng, Y.-C., Chang, H.-A., Chen, C.-K., Kao, L., Kao, H. C.-J.: Integration of image stabilizer with video codec for digital video cameras. In: IEEE international symposium on circuits and systems (ISCAS’05), pp. 4871–4874 (2005)Google Scholar
  21. 21.
    Quan, H.-T., Ghanbari, M.: Asymmetrical temporal masking near video scene change. In: Proceedings of the IEEE International Conference on Image Processing (ICIP’08), pp. 2568–2571 (2008)Google Scholar
  22. 22.
    Richardson, I.E.G.R.: H.264 and MPEG-4 video compression video coding for next-generation multimedia. John Wiley & Sons Ltd (2003)Google Scholar
  23. 23.
    Schierl T., Kampmann M., Wiegand T., 2005. H.264/AVC interleaving for 3G wireless video streaming. In: Proceedings of the IEEE International Conference on Multimedia and Expo (ICME ‘05), pp. 868-871Google Scholar
  24. 24.
    Szymanski, H.T., Gilbert, D.: Internet multicasting of IPTV with essentially-zero delay jitter. IEEE transactions on broadcasting 55(1), 20–30 (2009)CrossRefGoogle Scholar
  25. 25.
    Tsai, M.-F., Ke, C.-H., Kuo, C.-I., Shieh, C.-K.: Path dependent adaptive forward error correction with multipath interleaving control scheme for video streaming over wireless networks. In: IEEE International Conference on Intelligent Information Hiding and Multimedia Signal Processing, pp. 1236–1239 (2009)Google Scholar
  26. 26.
  27. 27.
    http://www.ffmpeg.org (visited, 4/03/2011)

Copyright information

© Springer-Verlag 2011

Authors and Affiliations

  • Hussein Muzahim Aziz
    • 1
    Email author
  • Markus Fiedler
    • 1
  • Håkan Grahn
    • 1
  • Lars Lundberg
    • 1
  1. 1.School of ComputingBlekinge Institute of TechnologyKarlskronaSweden

Personalised recommendations