Skip to main content

Selected Aspects of the New Recommendation on Subjective Methods of Assessing Video Quality in Recognition Tasks

  • Conference paper
  • First Online:
Control, Computer Engineering and Neuroscience (ICBCI 2021)

Abstract

It was once thought that high QoS (Quality of Service) performance solves recurrent problems of low-quality multimedia services. Since then, solutions have been proposed to ensure a high level of QoE (Quality of Experience). In this document, the authors attempt to outline his understanding of an accurate meaning of quality of multimedia services. Starting from QoS and passing through generalised QoE, the authors focus on aspects of subjective and objective quality modelling and optimisation of visual performance for TRV (Target Recognition Video) applications (such as video surveillance), outlining the path of ITU-T standardisation in this area. The authors revised the ITU-T Recommendation P.912 to reflect improved subjective test techniques developed since this Recommendation was approved. The authors also attempt to predict at least some existing errors of reasoning, which are likely to become evident for the industry in the next decade.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 199.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Hoßfeld, T., Hirth, M., Redi, J., Mazza, F., Korshunov, P., Naderi, B., Seufert, M., Gardlo, B., Egger, S., Keimel, C.: Best practices and recommendations for crowdsourced QoE - lessons learned from the qualinet task force “Crowdsourcing”, October 2014. https://hal.archives-ouvertes.fr/hal-01078761, lessons learned from the Qualinet Task Force “Crowdsourcing” COST Action IC1003 European Network on Quality of Experience in Multimedia Systems and Services (QUALINET)

  2. ITU-T: ITU-T P.912, Subjective video quality assessment methods for recognition tasks. https://www.itu.int/rec/T-REC-P.912

  3. ITU-T: ANSI T1.801.01, Digital Transport of Video Teleconferencing/Video Telephony Signals - Video Test Scenes for Subjective and Objective Performance Assessment (1995). http://engineers.ihs.com/document/abstract/POWPBBAAAAAAAAAA

  4. ITU-T: ITU-T P.800, Methods for subjective determination of transmission quality (1996). http://www.itu.int/rec/T-REC-P.800-199608-I

  5. ITU-T: ITU-T P.910, Subjective video quality assessment methods for multimedia applications (1999). http://www.itu.int/rec/T-REC-P.910-200804-I

  6. Janowski, L.: Task-based subject validation: reliability metrics. In: 2012 Fourth International Workshop on Quality of Multimedia Experience, pp. 182–187, July 2012. https://doi.org/10.1109/QoMEX.2012.6263863

  7. Leszczuk, M., Janowski, L.: Database for video quality assessment in license plate recognition. In: Signal Processing: Algorithms, Architectures, Arrangements, and Applications (SPA), vol. 2013, pp. 51–55, September 2013

    Google Scholar 

  8. Leszczuk, M., Stange, I., Ford, C.: Determining image quality requirements for recognition tasks in generalized public safety video applications: definitions, testing, standardization, and current trends. In: 2011 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB), pp. 1–5, June 2011. https://doi.org/10.1109/BMSB.2011.5954938

  9. Leszczuk, M., Janowski, L., Romaniak, P., Głowacz, A., Mirek, R.: Quality assessment for a licence plate recognition task based on a video streamed in limited networking conditions. In: Dziech, A., Czyżewski, A. (eds.) Multimedia Communications, Services and Security, pp. 10–18. Springer, Berlin Heidelberg (2011)

    Chapter  Google Scholar 

  10. Leszczuk, M.: Optimising task-based video quality. Multimedia Tools Appl. 68(1), 41–58 (2014). https://doi.org/10.1007/s11042-012-1161-6, http://dx.doi.org/10.1007/s11042-012-1161-6

  11. Leszczuk, M., Janowski, L., Romaniak, P., Papir, Z.: Assessing quality of experience for high definition video streaming under diverse packet loss patterns. Signal Process. Image Commun. 28(8), 903–916 (2013). http://www.sciencedirect.com/science/article/pii/S0923596512001804

  12. Leszczuk, M., Kon, A., Dumke, J., Janowski, L.: Redefining ITU-T p.912 recommendation requirements for subjects of quality assessments in recognition tasks. In: Dziech, A., Czyzewski, A. (eds.) Multimedia Communications, Services and Security, Communications in Computer and Information Science, vol. 287, pp. 188–199. Springer Berlin Heidelberg (2012). https://doi.org/10.1007/978-3-642-30721-8_19, http://dx.doi.org/10.1007/978-3-642-30721-8_19

  13. Möller, S., Raake, A. (eds.): Quality of Experience: Advanced Concepts, Applications and Methods. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-02681-7

  14. VQiPS: Video quality tests for object recognition applications. Public Safety Communications DHS-TR-PSC-10-09, U.S. Department of Homeland Security’s Office for Interoperability and Compatibility, June 2010

    Google Scholar 

  15. VQiPS: Recorded-video quality tests for object recognition tasks. Public Safety Communications DHS-TR-PSC-11-01, U.S. Department of Homeland Security’s Office for Interoperability and Compatibility, June 2011

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mikołaj Leszczuk .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Leszczuk, M., Janowski, L. (2021). Selected Aspects of the New Recommendation on Subjective Methods of Assessing Video Quality in Recognition Tasks. In: Paszkiel, S. (eds) Control, Computer Engineering and Neuroscience. ICBCI 2021. Advances in Intelligent Systems and Computing, vol 1362. Springer, Cham. https://doi.org/10.1007/978-3-030-72254-8_27

Download citation

Publish with us

Policies and ethics