Predicting the Perceptual Service Quality Using a Trace of VoIP Packets
We present an instrumental approach on how to assess the perceptual quality of voice transmissions in IP-based communication networks. Our approach is end-to-end and uses combinations of common codecs, loss concealment algorithms, playout schedulers, and ITU’s quality assessment algorithms E-Model and PESQ. It is the first method that takes the impact of playout rescheduling and non-random packet loss distributions into account. Non-random packet losses occur if a rate-distortion optimized multimedia streaming algorithm forwards packets dependent on the packets’ importance.
Our approach is implemented in open-source software. We have conducted formal listening-only tests to verify the accuracy of our quality model. In the majority of cases, the human test results show a high correlation with the calculated predictions.
KeywordsVoIP quality assessment playout scheduling rate-distortion optimized streaming
Unable to display preview. Download preview PDF.
- 1.ITU-T Recommendation P.862: Perceptual Evaluation of speech quality (PESQ), an Objective Method for End-to-end Speech Quality Assessment of Narrowband Telephone Networks and Speech Codecs (2001) Google Scholar
- 2.ITU-T Recommendation G.107: The E-model, a Computational Model for Use in Transmission Planning (2000) Google Scholar
- 3.Hoene, C., Karl, H., Wolisz, A.: A perceptual quality model for adaptive VoIP applications. In: SPECTS, San Jose, California, USA (2004)Google Scholar
- 4.Hoene, C., Dulamsuren-Lalla, E.: Predicting performance of PESQ in case of single frame losses. In: Measurement of Speech and Audio Quality in Networks Workshop (MESAQIN), Prague, CZ (2004)Google Scholar
- 5.Hoene, C.: Simulating playout schedulers for VoIP - software package (2004), http://www.tkn.tu-berlin.de/research/qofis/
- 7.Martin, J.D.: Source-driven packet marking for speech transmission over differentiated-services networks. In: IEEE ICASSP, vol. 2, pp. 753–756 (2001)Google Scholar
- 8.Sanneck, H., Tuong, N., Le, L., Wolisz, A., Carle, G.: Intra-flow loss recovery and control for VoIP. In: ACM Multimedia, pp. 441–454 (2001)Google Scholar
- 9.Ramjee, R., Kurose, J.F., Towsley, D.F., Schulzrinne, H.: Adaptive playout mechanisms for packetized audio applications in wide-area networks. In: IEEE Infocom, Toronto, Canada, pp. 680–688 (1994)Google Scholar
- 12.ITU-T Recommendation P.800: Methods for subjective determination of transmission quality (1996) Google Scholar
- 14.Hammer, F., Reichl, P., Ziegler, T.: Where packet traces meet speech samples: An instrumental approach to perceptual QoS evaluation of VoIP. In: IEEE IWQoS, Montreal, Canada (2004)Google Scholar
- 15.Sun, L., Ifeachor, E.: New models for perceived voice quality prediction and their applications in playout buffer optimization for VoIP networks. In: IEEE ICC, Paris, France (2004)Google Scholar
- 16.Rix, A.W., Hollier, M.P., Hekstra, A.P., Beerends, J.G.: Perceptual evaluation of speech quality (PESQ), the new ITU standard for end-to-end speech quality assessment, part I - time alignment. Journal of the Audio Engineering Society 50, 755 (2002)Google Scholar