Predicting the Perceptual Service Quality Using a Trace of VoIP Packets

  • Christian Hoene
  • Sven Wiethölter
  • Adam Wolisz
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3266)

Abstract

We present an instrumental approach on how to assess the perceptual quality of voice transmissions in IP-based communication networks. Our approach is end-to-end and uses combinations of common codecs, loss concealment algorithms, playout schedulers, and ITU’s quality assessment algorithms E-Model and PESQ. It is the first method that takes the impact of playout rescheduling and non-random packet loss distributions into account. Non-random packet losses occur if a rate-distortion optimized multimedia streaming algorithm forwards packets dependent on the packets’ importance.

Our approach is implemented in open-source software. We have conducted formal listening-only tests to verify the accuracy of our quality model. In the majority of cases, the human test results show a high correlation with the calculated predictions.

Keywords

VoIP quality assessment playout scheduling rate-distortion optimized streaming 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    ITU-T Recommendation P.862: Perceptual Evaluation of speech quality (PESQ), an Objective Method for End-to-end Speech Quality Assessment of Narrowband Telephone Networks and Speech Codecs (2001) Google Scholar
  2. 2.
    ITU-T Recommendation G.107: The E-model, a Computational Model for Use in Transmission Planning (2000) Google Scholar
  3. 3.
    Hoene, C., Karl, H., Wolisz, A.: A perceptual quality model for adaptive VoIP applications. In: SPECTS, San Jose, California, USA (2004)Google Scholar
  4. 4.
    Hoene, C., Dulamsuren-Lalla, E.: Predicting performance of PESQ in case of single frame losses. In: Measurement of Speech and Audio Quality in Networks Workshop (MESAQIN), Prague, CZ (2004)Google Scholar
  5. 5.
    Hoene, C.: Simulating playout schedulers for VoIP - software package (2004), http://www.tkn.tu-berlin.de/research/qofis/
  6. 6.
    Chou, P., Mohr, A., Wang, A., Mehrotra, S.: Error control for receiver-driven layered multicast of audio and video. IEEE Transactions on Multimedia 3, 108–122 (2001)CrossRefGoogle Scholar
  7. 7.
    Martin, J.D.: Source-driven packet marking for speech transmission over differentiated-services networks. In: IEEE ICASSP, vol. 2, pp. 753–756 (2001)Google Scholar
  8. 8.
    Sanneck, H., Tuong, N., Le, L., Wolisz, A., Carle, G.: Intra-flow loss recovery and control for VoIP. In: ACM Multimedia, pp. 441–454 (2001)Google Scholar
  9. 9.
    Ramjee, R., Kurose, J.F., Towsley, D.F., Schulzrinne, H.: Adaptive playout mechanisms for packetized audio applications in wide-area networks. In: IEEE Infocom, Toronto, Canada, pp. 680–688 (1994)Google Scholar
  10. 10.
    Moon, S.B., Kurose, J., Towsley, D.: Packet audio playout delay adjustments: performance bounds and algorithms. ACM/Springer Multimedia Systems 27, 17–28 (1998)CrossRefGoogle Scholar
  11. 11.
    Liang, Y.J., Färber, N., Girod, B.: Adaptive playout scheduling and loss concealment for voice communication over IP networks. IEEE Transactions on Multimedia 5, 532–543 (2003)CrossRefGoogle Scholar
  12. 12.
    ITU-T Recommendation P.800: Methods for subjective determination of transmission quality (1996) Google Scholar
  13. 13.
    Markopoulou, A., Tobagi, F., Karam, M.: Assessing the quality of voice communications over internet backbones. IEEE/ACM Transactions on Networking 11, 747–760 (2003)CrossRefGoogle Scholar
  14. 14.
    Hammer, F., Reichl, P., Ziegler, T.: Where packet traces meet speech samples: An instrumental approach to perceptual QoS evaluation of VoIP. In: IEEE IWQoS, Montreal, Canada (2004)Google Scholar
  15. 15.
    Sun, L., Ifeachor, E.: New models for perceived voice quality prediction and their applications in playout buffer optimization for VoIP networks. In: IEEE ICC, Paris, France (2004)Google Scholar
  16. 16.
    Rix, A.W., Hollier, M.P., Hekstra, A.P., Beerends, J.G.: Perceptual evaluation of speech quality (PESQ), the new ITU standard for end-to-end speech quality assessment, part I - time alignment. Journal of the Audio Engineering Society 50, 755 (2002)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • Christian Hoene
    • 1
  • Sven Wiethölter
    • 1
  • Adam Wolisz
    • 1
  1. 1.Telecommunication Networks GroupTechnical University BerlinBerlinGermany

Personalised recommendations