Journal of Signal Processing Systems

, Volume 62, Issue 3, pp 403–414 | Cite as

A New Dual-bitstream Video Streaming System with VCR Functionalities Using SP/SI-frames

  • Yui-Lam Chan
  • Tak-Piu Ip
  • Ki-Kit Lai
  • Chang-Hong Fu
  • Wan-Chi Siu
Article

Abstract

With the proliferation of digital video and the popularity of video streaming applications, it is highly desirable to find and access video segments of interest by searching through the content of video at a speed that is faster than a normal playback. The key functions that enable quick browsing of video are fast-forward and fast-reverse playbacks. However, motion-compensated prediction adopted in the current video coding standards drastically complicates these operations. One approach to implement the fast-forward/reverse playback is to store an additional reverse-encoded bitstream in the server. Once the client requests a fast-forward/reverse operation, the server can select an appropriate frame for the client from either the forward-encoded bitstream or the reverse-encoded bitstream by considering the cost of network bandwidth and decoder complexity. Unfortunately, these two bitstreams are encoded separately. The frame in one bitstream may not be exactly identical to the frame in another bitstream. If one of these frames is then used as the reference for the requested frame, which is in another bitstream, it induces mismatch errors. In this paper, a novel H.264 dual-bitstream system aiming at providing the fast-forward/reverse playback based on SP/SI-frames is proposed. The proposed system can completely eliminate mismatch errors when the frame in the reverse-encoded bitstream replaces the frame in the forward-encoded bitstream and vice versa. Experimental results confirm that the proposed system is effective in eliminating mismatch errors so as to enhance the performance of the dual-bitstream system.

Keywords

Digital video cassette recording (VCR) MPEG/H.264 Streaming video Dual-bitstream system 

Notes

Acknowledgements

The work described in this paper is partially supported by the Centre for Signal Processing, Department of Electronic and Information Engineering, Hong Kong Polytechnic University and a grant from the Research Grants Council of the Hong Kong Special Administrative Region, China (PolyU 5120/07E). Li-Kit Lai acknowledges the research studentships provided by the University.

References

  1. 1.
    Stockhammer, T., Jenkac, H., & Kuhn, G. (2004). Streaming video over variable bit-rate wireless channels. IEEE Transactions on Multimedia, 6(2), 268–277.CrossRefGoogle Scholar
  2. 2.
    Ganjam, A., & Zhang, H. (2005). Internet multicast video delivery. Proceedings of the IEEE, 93(1), 159–170.CrossRefGoogle Scholar
  3. 3.
    Real Networks RealPlayer [Online]. http://www.real.com/. Accessed 24 December 2009.
  4. 4.
    Microsoft Window Media, Microsoft Corporation Inc. [Online]. http://www.microsoft.com/windows/windowsmedia/. Accessed 24 December 2009.
  5. 5.
    SonicBlue Inc. [Online]. http://www.replay.com/. Accessed 24 December 2009.
  6. 6.
    TiVo Inc. [Online]. http://www.tivo.com/. Accessed 24 December 2009.
  7. 7.
    ISO/IEC 11172-2: ‘Information Technology—Coding of Moving Pictures and Associated Audio for Digital Storage Media at up to about 1.5 Mbit/s—Part 2: Video’, 1993.Google Scholar
  8. 8.
    ISO/IEC 13818-2: ‘Information Technology–Generic Coding of Moving Pictures and Associated Audio Information: Video’, 1996.Google Scholar
  9. 9.
    ISO/IEC 14996-2: ‘Coding of Audio-visual Objects—Part 2: Visual’, 2001.Google Scholar
  10. 10.
    ITU-T Rec. H.263: ‘Video Coding for Low Bitrate Communication’, 1997.Google Scholar
  11. 11.
    ISO/IEC 14996-10 and ITU-T Rec. H.264: ‘Advanced Video Coding’, 2003.Google Scholar
  12. 12.
    Srinivasan, R., & Rao, K. R. (1985). Predictive coding based on efficient motion estimation. IEEE Transactions on Communication, 33(9), 1011–1015.CrossRefGoogle Scholar
  13. 13.
    Hui, K. C., & Siu, W. C. (2007). Extended analysis of motion-compensated frame difference for block-based motion prediction error. IEEE Transactions on Image Processing, 16(5), 1232–1245.MathSciNetCrossRefGoogle Scholar
  14. 14.
    Chan, Y. L., & Siu, W. C. (2001). An efficient search strategy for block motion estimation using image features. IEEE Transactions on Image Processing, 10(8), 1223–1238.MATHCrossRefGoogle Scholar
  15. 15.
    Lin, C. W., Zhou, J., Youn, J., & Sun, M. T. (2001). MPEG video streaming with VCR functionality. IEEE Transactions on Circuits and Systems for Video Technology, 11(3), 415–425.CrossRefGoogle Scholar
  16. 16.
    Huang, S. Y. (2003). Improved techniques for dual-bitstream MPEG video streaming with VCR functionalities. IEEE Transactions on Consumer Electronics, 49(4), 1153–1160.CrossRefGoogle Scholar
  17. 17.
    Ip, T. P., Chan, Y. L., & Siu, W. C. (2008). Redundancy reduction technique for dual-bitstream MPEG video streaming with VCR functionalities. IEEE Transactions on Broadcasting, 54(3), 412–418.CrossRefGoogle Scholar
  18. 18.
    Fu, C. H., Chan, Y. L., & Siu, W. C. (2006). Efficient reverse-play algorithms for MPEG video streaming with VCR support. IEEE Transactions on Circuits and Systems for Video Technology, 16(1), 19–30.CrossRefGoogle Scholar
  19. 19.
    McManus, J. M., & Ross, K. W. (1996). Video-on-demand over ATM: constant-rate transmission and transport’. IEEE Journal on Selected Areas in Communications., 14(6), 1087–1098.CrossRefGoogle Scholar
  20. 20.
    Fung, K. T., Chan, Y. L., & Siu, W. C. (2002). New architecture for dynamic frame-skipping transcoder. IEEE Transactions on Image Processing, 11(8), 886–900.CrossRefGoogle Scholar
  21. 21.
    Tan, Y. P., Liang, Y., & Yu, J. (2002). Video transcoding for fast forward/reverse video playback. Proceedings of International Conference on Image Processing, 713–716.Google Scholar
  22. 22.
    Omoigui, N., He, L., Gupta, A., Grudin, J., & Sanocki, E. (1999). Time-compression: system concerns, usage, and the benefits. Proceedings of ACM SIGHI Conference, 136–143.Google Scholar
  23. 23.
    Karczewicz, M., & Kurceren, R. (2003). The SP- and SI-Frames design for H.264/AVC. IEEE Transactions on Circuits and Systems for Video Technology, 13(7), 637–644.CrossRefGoogle Scholar
  24. 24.
    Kurceren, R., & Karczewicz, M. (2002). Synchronization-predictive coding for video compression: the SP frames design for JVT/H.26L. Proceedings of IEEE International on Conference Image Processing, 2002, 497–500.Google Scholar
  25. 25.
    Lai, K. K., Chan, Y. L., Fu, C. H., & Siu, W. C. (2008). Viewpoint switching in multiview videos using SP-frames. Proceedings of the IEEE International Conference on Image Processing, 1776–1779.Google Scholar
  26. 26.
    Lai, K. K., Chan, Y. L., & Siu, W. C. (2007). A quantized transform-domain motion estimation technique for H.264 secondary SP-Frames. Proceedings of the 8th Pacific Rim Conference on Multimedia, 128–137.Google Scholar
  27. 27.
    JVT Reference Software JM15.1 [Online] http://iphome.hhi.de/suehring/tml/download/. Accessed 24 December 2009.

Copyright information

© Springer Science+Business Media, LLC 2010

Authors and Affiliations

  • Yui-Lam Chan
    • 1
  • Tak-Piu Ip
    • 1
  • Ki-Kit Lai
    • 1
  • Chang-Hong Fu
    • 1
  • Wan-Chi Siu
    • 1
  1. 1.Centre for Signal Processing, Department of Electronic and Information EngineeringThe Hong Kong Polytechnic UniversityKowloonHong Kong

Personalised recommendations