How to Build an Objective Model for Packet Loss Effect on High Definition Content Based on SSIM and Subjective Experiments

  • Piotr Romaniak
  • Lucjan Janowski
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6157)


In this paper the authors present a methodology for building a model for packet loss effect on High Definition video content. The goal is achieved using the SSIM video quality metric, temporal pooling techniques and content characteristics. Subjective tests were performed in order to verify proposed models. An influence of several network loss patterns on diverse video content is analyzed. The paper deals also with encountered difficulties and presents intermediate steps to give a better understanding of the final result. The research aims at the perceived evaluation of a network performance for IPTV and video surveillance systems. The final model is generic and shows high correlation with the subjective results....


Packet Loss Video Sequence Video Quality Image Quality Assessment Video Surveillance System 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Greengrass, J., Evans, J., Begen, A.C.: Not all packets are equal, part 2: The impact of network packet loss on video quality. IEEE Internet Computing 13(2), 74–82 (2009)CrossRefGoogle Scholar
  2. 2.
    Verscheure, O., Frossard, P., Hamdi, M.: User-oriented QoS Analysis in MPEG-2 Delivery. Journal of Real-Time Imaging (special issue on Real-Time Digital Video over Multimedia Networks) 5(5), 305–314 (1999)Google Scholar
  3. 3.
    Shengke, Q., Huaxia, R., Le, Z.: No-reference Perceptual Quality Assessment for Streaming Video Based on Simple End-to-end Network Measures. In: International conference on Networking and Services, ICNS ’06, pp. 53–53 (2006)Google Scholar
  4. 4.
    Lopez, D., Gonzalez, F., Bellido, L., Alonso, A.: Adaptive Multimedia Streaming over IP Based on Customer-Oriented Metrics. In: ISCN’06 Bogazici University, Bebek Campus, Istanbul (June 16, 2006)Google Scholar
  5. 5.
    Liang, Y., Apostolopoulos, J., Girod, B.: Analysis of packet loss for compressed video: Effect of burst losses and correlation between error frames. IEEE Transactions on Circuits and Systems for Video Technology 18(7), 861–874 (2008)CrossRefGoogle Scholar
  6. 6.
    Dosselmann, R., Yang, X.D.: A Prototype No-Reference Video Quality System. In: Fourth Canadian Conference on Computer and Robot Vision, CRV ’07, May 2007, pp. 411–417 (2007)Google Scholar
  7. 7.
    Pinson, M., Wolf, S.: A new standardized method for objectively measuring video quality. IEEE Trans. on Broadcasting 50(3), 312–322 (2004)CrossRefGoogle Scholar
  8. 8.
    Wolf, S., Pinson, M.H.: Application of the ntia general video quality metric (vqm) to hdtv quality monitoring. In: Third International Workshop on Video Processing and Quality Metrics for Consumer Electronics (VPQM-07), Scottsdale, Arizona, January 25-26 (2007)Google Scholar
  9. 9.
    Issa, O., Li, W., Liu, H., Speranza, F., Renaud, R.: Quality assessment of high definition tv distribution over ip networks. In: IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, May 13-15, pp. 1–6 (2009)Google Scholar
  10. 10.
    Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image Quality Assessment: From Error Visibility to Structural Similarity. IEEE Transactions on Image Processing 13(4), 600–612 (2004)CrossRefGoogle Scholar
  11. 11.
    Garcia, M., Raake, A., List, P.: Towards content-related features for parametric video quality prediction of iptv services. In: IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2008, pp. 757–760 (April 2008)Google Scholar
  12. 12.
    Wang, Z., Li, Q.: Video quality assessment using a statistical model of human visual speed perception. Journal of the Optical Society of America A 24(12), B61–B69 (2007)CrossRefGoogle Scholar
  13. 13.
    Wang, Z., Bovik, A.C.: Mean squared error: love it or leave it? - a new look at signal fidelity measures. IEEE Signal Processing Magazine 26(1), 98–117 (2009)CrossRefGoogle Scholar
  14. 14.
    VQEG: VQEG HDTV TIA Source Test Sequences,
  15. 15.
    VQEG: The Video Quality Experts Group,
  16. 16.
    Webster, A.A., Jones, C.T., Pinson, M.H., Voran, S.D., Wolf, S.: An objective video quality assessment system based on human perception. In: SPIE Human Vision, Visual Processing, and Digital Display IV, pp. 15–26 (1993)Google Scholar
  17. 17.
    Fenimore, C., Libert, J., Wolf, S.: Perceptual effects of noise in digital video compression. In: 14th SMPTE Technical Conference, Pasadena, CA, October 1998, pp. 28–31 (1998)Google Scholar
  18. 18.
    VQEG: Final Report from the Video Quality Experts Group on the Validation of Objective Models of Video Quality Assessment (March 2000),
  19. 19.
    Wang, Z., Lu, L., Bovik, A.C.: Video Quality Assessment Based on Structural Distortion Measurement. Signal Processing: Image Communication 19(2), 121–131 (2004)CrossRefGoogle Scholar
  20. 20.
    Wang, Z.: Rate Scalable Foveated Image and Video Communications. PhD thesis, Dept. Elect. Comput. Eng. Univ. Texas at Austin, Austin, TX (December 2001)Google Scholar
  21. 21.
    Wang, Z., Bovik, A.C., Lu, L.: Why is Image Quality Assessment so Difficult. In: in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, vol. 4, pp. 3313–3316 (2002)Google Scholar
  22. 22.
    VQEG: Test Plan for Evaluation of Video Quality Models for Use with High Definition TV Content (2009)Google Scholar
  23. 23.
    ITU-T: Subjective Video Quality Assessment Methods for Multimedia Applications. ITU-T (1999)Google Scholar
  24. 24.
    ITU-T: Methods for subjective determination of transmission quality. ITU-T, Geneva, Switzerland (1996)Google Scholar
  25. 25.
    Recommendation 500-10: Methodology for the subjective assessment of the quality of television pictures. ITU-R Rec. BT.500 (2000)Google Scholar
  26. 26.
    Wang, Z., et al.: The SSIM Index for Image Quality Assessment (2003),
  27. 27.
    Janowski, L., Papir, Z.: Modeling subjective tests of quality of experience with a generalized linear model. In: First International Workshop on Quality of Multimedia Experience, California, San Diego (July 2009)Google Scholar
  28. 28.
    NIST/SEMATECH e-Handbook of Statistical Methods (2002),

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Piotr Romaniak
    • 1
  • Lucjan Janowski
    • 1
  1. 1.Department of TelecommunicationsAGH University of Science and Technology 

Personalised recommendations