Abstract
The problem of side signal frame loss concealment for Mid/Side (M/S) stereo audio is addressed in this paper. The proposed level ratio based inter and intra channel (LRIIC) prediction method is designed to overcome the main challenge due to the diversified stereophonic nature of audio signals. To identify the stereophonic nature, we employ the time varying level ratio between mid (also called monophonic) signal and side signal. In the first phase, one Winer filter is designed from the monophonic signal and side signal of previous frame. And the other one is designed from the side signal of previous two frames. The two filters allow reconstruction of the current loss frame with inter and intra channel prediction respectively. In the second phase, available current frame of monophonic signal is used as the input of inter-channel Winer filter. While long-term prediction filter is employed to find the periodic components of previous frames as the input of intra-channel Winer filter. Finally, a level ratio based linear combination of inter and intra channel prediction output is employed to get the current lost side signal. Objective and subjective evaluation results for the proposed LRIIC approach, in comparison with existing techniques, all incorporated within a 3GPP AMR-WB+ decoder, provide evidence for gains across a variety of stereophonic signals.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Perkins, C., Hodson, O., Hardman, V.: A survey of packet loss recovery techniques for streaming audio. IEEE Network 12(5), 40–48 (1998)
Westerlund, M., Nohlgren, A., Svedberg, J., et al.: Forward error correction in speech coding: U.S. Patent 6,757,654, 29 June 2004
Merazka, F.: Forward error correction concealment method for celp-based coders in packet networks. In: Proceedings of the World Congress on Engineering, vol. 1 (2010)
Midya, A., Ranjan, R., Sengupta, S.: Scene content driven FEC allocation for video streaming. Sig. Process. Image Commun. 29(1), 37–48 (2014)
Carvalho, L.S.G.D., Mota, E.D.S.: Survey on application-layer mechanisms for speech quality adaptation in VoIP. ACM Computing Surv. (CSUR) 45(3), 36 (2013)
Hardman, V., Sasse M.A., Handley, M., et al.: Reliable audio for use over the Internet. In: Proceedings of INET, vol. 95, pp. 171–178 (1995)
Wasem, O.J., Goodman, D.J., Dvorak, C.A., et al.: The effect of waveform substitution on the quality of PCM packet communications. IEEE Trans. Acoust. Speech Signal Process. 36(3), 342–348 (1988)
Ryu, S.U., Choy, E., Rose, K.: Encoder assisted frame loss concealment for MPEG-AAC decoder. In: IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2006 Proceedings, vol. 5, p. V. IEEE (2006)
GPP TS 26 190 V7.0.0, Adaptive Multi-Rate -Wideband (AMR-WB) speech codec: Transcoding functions (Rel. 7), June 2007
Nanjundaswamy, T., Rose, K.: Bidirectional cascaded long term prediction for frame loss concealment in polyphonic audio signals. In: 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 417–420. IEEE (2012)
Yang, Y., Dong, S., Hu, R., et al.: An inter-frame correlation based error concealment of immittance spectral coefficients for mobile speech and audio codecs. In: 2014 IEEE International Conference on High Performance Computing and Communications, 2014 IEEE 6th International Symposium on Cyberspace Safety and Security, 2014 IEEE 11th International Conference on Embedded Software and Systems (HPCC, CSS, ICESS), pp. 436–441. IEEE (2014)
Sinha, R., Papadopoulos, C., Kyriakakis, C.: Loss concealment for multi-channel streaming audio. In: Proceedings of the 13th International Workshop on Network and Operating Systems Support for Digital Audio and Video, pp. 100–109. ACM (2003)
GPP TS 126 290 V10.0.0,Extended Adaptive Multi-Rate -Wideband (AMR-WB+) codec: Transcoding functions (Rel. 7), April 2011
Yoshida, K.: Stereo decoder that conceals a lost frame in one channel using data from another channel: U.S. Patent 8,209,168, 26 June 2012
Yoshida, K.: Stereo sound decoding apparatus, stereo sound encoding apparatus and lost-frame compensating method: U.S. Patent 8,359,196, 22 January 2013
GPP TS 26.274. Audio codec processing functions; Extended Adaptive Multi-Rate - Wideband (AMR-WB+) speech codec; Conformance testing (2005)
Acknowledgement
This work is supported by National Natural Science Foundation of China (No. 61102127, 61231015, 61201340, 61201169, 61272278, 61471271) and National High Technology Research and Development Program of China (863 Program) No. 2015AA016306.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Yang, Y., Wang, Y., Hu, R., Yu, H., Gao, L., Wang, S. (2016). Level Ratio Based Inter and Intra Channel Prediction with Application to Stereo Audio Frame Loss Concealment. In: Tian, Q., Sebe, N., Qi, GJ., Huet, B., Hong, R., Liu, X. (eds) MultiMedia Modeling. MMM 2016. Lecture Notes in Computer Science(), vol 9516. Springer, Cham. https://doi.org/10.1007/978-3-319-27671-7_55
Download citation
DOI: https://doi.org/10.1007/978-3-319-27671-7_55
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-27670-0
Online ISBN: 978-3-319-27671-7
eBook Packages: Computer ScienceComputer Science (R0)