A New Dual-bitstream Video Streaming System with VCR Functionalities Using SP/SI-frames
Abstract
With the proliferation of digital video and the popularity of video streaming applications, it is highly desirable to find and access video segments of interest by searching through the content of video at a speed that is faster than a normal playback. The key functions that enable quick browsing of video are fast-forward and fast-reverse playbacks. However, motion-compensated prediction adopted in the current video coding standards drastically complicates these operations. One approach to implement the fast-forward/reverse playback is to store an additional reverse-encoded bitstream in the server. Once the client requests a fast-forward/reverse operation, the server can select an appropriate frame for the client from either the forward-encoded bitstream or the reverse-encoded bitstream by considering the cost of network bandwidth and decoder complexity. Unfortunately, these two bitstreams are encoded separately. The frame in one bitstream may not be exactly identical to the frame in another bitstream. If one of these frames is then used as the reference for the requested frame, which is in another bitstream, it induces mismatch errors. In this paper, a novel H.264 dual-bitstream system aiming at providing the fast-forward/reverse playback based on SP/SI-frames is proposed. The proposed system can completely eliminate mismatch errors when the frame in the reverse-encoded bitstream replaces the frame in the forward-encoded bitstream and vice versa. Experimental results confirm that the proposed system is effective in eliminating mismatch errors so as to enhance the performance of the dual-bitstream system.
Keywords
Digital video cassette recording (VCR) MPEG/H.264 Streaming video Dual-bitstream systemNotes
Acknowledgements
The work described in this paper is partially supported by the Centre for Signal Processing, Department of Electronic and Information Engineering, Hong Kong Polytechnic University and a grant from the Research Grants Council of the Hong Kong Special Administrative Region, China (PolyU 5120/07E). Li-Kit Lai acknowledges the research studentships provided by the University.
References
- 1.Stockhammer, T., Jenkac, H., & Kuhn, G. (2004). Streaming video over variable bit-rate wireless channels. IEEE Transactions on Multimedia, 6(2), 268–277.CrossRefGoogle Scholar
- 2.Ganjam, A., & Zhang, H. (2005). Internet multicast video delivery. Proceedings of the IEEE, 93(1), 159–170.CrossRefGoogle Scholar
- 3.Real Networks RealPlayer [Online]. http://www.real.com/. Accessed 24 December 2009.
- 4.Microsoft Window Media, Microsoft Corporation Inc. [Online]. http://www.microsoft.com/windows/windowsmedia/. Accessed 24 December 2009.
- 5.SonicBlue Inc. [Online]. http://www.replay.com/. Accessed 24 December 2009.
- 6.TiVo Inc. [Online]. http://www.tivo.com/. Accessed 24 December 2009.
- 7.ISO/IEC 11172-2: ‘Information Technology—Coding of Moving Pictures and Associated Audio for Digital Storage Media at up to about 1.5 Mbit/s—Part 2: Video’, 1993.Google Scholar
- 8.ISO/IEC 13818-2: ‘Information Technology–Generic Coding of Moving Pictures and Associated Audio Information: Video’, 1996.Google Scholar
- 9.ISO/IEC 14996-2: ‘Coding of Audio-visual Objects—Part 2: Visual’, 2001.Google Scholar
- 10.ITU-T Rec. H.263: ‘Video Coding for Low Bitrate Communication’, 1997.Google Scholar
- 11.ISO/IEC 14996-10 and ITU-T Rec. H.264: ‘Advanced Video Coding’, 2003.Google Scholar
- 12.Srinivasan, R., & Rao, K. R. (1985). Predictive coding based on efficient motion estimation. IEEE Transactions on Communication, 33(9), 1011–1015.CrossRefGoogle Scholar
- 13.Hui, K. C., & Siu, W. C. (2007). Extended analysis of motion-compensated frame difference for block-based motion prediction error. IEEE Transactions on Image Processing, 16(5), 1232–1245.MathSciNetCrossRefGoogle Scholar
- 14.Chan, Y. L., & Siu, W. C. (2001). An efficient search strategy for block motion estimation using image features. IEEE Transactions on Image Processing, 10(8), 1223–1238.MATHCrossRefGoogle Scholar
- 15.Lin, C. W., Zhou, J., Youn, J., & Sun, M. T. (2001). MPEG video streaming with VCR functionality. IEEE Transactions on Circuits and Systems for Video Technology, 11(3), 415–425.CrossRefGoogle Scholar
- 16.Huang, S. Y. (2003). Improved techniques for dual-bitstream MPEG video streaming with VCR functionalities. IEEE Transactions on Consumer Electronics, 49(4), 1153–1160.CrossRefGoogle Scholar
- 17.Ip, T. P., Chan, Y. L., & Siu, W. C. (2008). Redundancy reduction technique for dual-bitstream MPEG video streaming with VCR functionalities. IEEE Transactions on Broadcasting, 54(3), 412–418.CrossRefGoogle Scholar
- 18.Fu, C. H., Chan, Y. L., & Siu, W. C. (2006). Efficient reverse-play algorithms for MPEG video streaming with VCR support. IEEE Transactions on Circuits and Systems for Video Technology, 16(1), 19–30.CrossRefGoogle Scholar
- 19.McManus, J. M., & Ross, K. W. (1996). Video-on-demand over ATM: constant-rate transmission and transport’. IEEE Journal on Selected Areas in Communications., 14(6), 1087–1098.CrossRefGoogle Scholar
- 20.Fung, K. T., Chan, Y. L., & Siu, W. C. (2002). New architecture for dynamic frame-skipping transcoder. IEEE Transactions on Image Processing, 11(8), 886–900.CrossRefGoogle Scholar
- 21.Tan, Y. P., Liang, Y., & Yu, J. (2002). Video transcoding for fast forward/reverse video playback. Proceedings of International Conference on Image Processing, 713–716.Google Scholar
- 22.Omoigui, N., He, L., Gupta, A., Grudin, J., & Sanocki, E. (1999). Time-compression: system concerns, usage, and the benefits. Proceedings of ACM SIGHI Conference, 136–143.Google Scholar
- 23.Karczewicz, M., & Kurceren, R. (2003). The SP- and SI-Frames design for H.264/AVC. IEEE Transactions on Circuits and Systems for Video Technology, 13(7), 637–644.CrossRefGoogle Scholar
- 24.Kurceren, R., & Karczewicz, M. (2002). Synchronization-predictive coding for video compression: the SP frames design for JVT/H.26L. Proceedings of IEEE International on Conference Image Processing, 2002, 497–500.Google Scholar
- 25.Lai, K. K., Chan, Y. L., Fu, C. H., & Siu, W. C. (2008). Viewpoint switching in multiview videos using SP-frames. Proceedings of the IEEE International Conference on Image Processing, 1776–1779.Google Scholar
- 26.Lai, K. K., Chan, Y. L., & Siu, W. C. (2007). A quantized transform-domain motion estimation technique for H.264 secondary SP-Frames. Proceedings of the 8th Pacific Rim Conference on Multimedia, 128–137.Google Scholar
- 27.JVT Reference Software JM15.1 [Online] http://iphome.hhi.de/suehring/tml/download/. Accessed 24 December 2009.