Abstract
This paper is a technical report, presenting a survey on the state-of-the-art methods for objective video quality assessment in recognition tasks. It bases on the most up-to-date solutions, developed by various research teams. The study considers, among others, solutions developed by the AGH University research team, including the contributions to ITU-T Recommendation P.912 (dealing with video quality assessment methods for recognition tasks) as well as the video quality indicators (available at http://vq.kt.agh.edu.pl/). In particular, we consider evaluation metrics based on a trade-off between computer vision performance and compression efficiency.
Supported by Huawei Innovation Research Program (HIRP).
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bosse, S., Maniry, D., Müller, K., Wiegand, T., Samek, W.: Deep neural networks for no-reference and full-reference image quality assessment. IEEE Trans. Image Process. 27(1), 206–219 (2018). https://doi.org/10.1109/TIP.2017.2760518
Breiman, L.: Random forests. Mach. Learn. 45(1), 5–32 (2001). https://doi.org/10.1023/A:1010933404324
Larson, E.C., Chandler, D.: Most apparent distortion: full-reference image quality assessment and the role of strategy. J. Electron. Imaging 19, 011006 (2010). https://doi.org/10.1117/1.3267105
Cerqueira, E., Janowski, L., Leszczuk, M., Papir, Z., Romaniak, P.: Video artifacts assessment for live mobile streaming applications. In: Mauthe, A., Zeadally, S., Cerqueira, E., Curado, M. (eds.) FMN 2009. LNCS, vol. 5630, pp. 242–247. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-02472-6_26
Chopra, S., Hadsell, R., LeCun, Y.: Learning a similarity metric discriminatively, with application to face verification. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005, vol. 1, pp. 539–546. IEEE (2005)
Garcia-Zapirain, B.: A proposed methodology for subjective evaluation of video and text summarization. In: Choroś, K., Kopel, M., Kukla, E., Siemiński, A. (eds.) MISSI 2018. AISC, vol. 833, pp. 396–404. Springer, Cham (2019). https://doi.org/10.1007/978-3-319-98678-4_40
Grega, M.: An integrated AMIS prototype for automated summarization and translation of newscasts and reports. In: Choroś, K., Kopel, M., Kukla, E., Siemiński, A. (eds.) MISSI 2018. AISC, vol. 833, pp. 415–423. Springer, Cham (2019). https://doi.org/10.1007/978-3-319-98678-4_42
ITU-R: Recommendation 500-10: Methodology for the subjective assessment of the quality of television pictures. ITU-R Rec. BT.500 (2000)
Janowski, L., Leszczuk, M., Larabi, M.-C., Ukhanova, A.: Recognition tasks. In: Möller, S., Raake, A. (eds.) Quality of Experience. TSTS, pp. 383–394. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-02681-7_26
Kang, L., Ye, P., Li, Y., Doermann, D.: Convolutional neural networks for no-reference image quality assessment. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1733–1740 (2014)
Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. Commun. ACM 60(6), 84–90 (2017). https://doi.org/10.1145/3065386
Leszczuk, M., Janowski, L., Barkowsky, M.: Freely available large-scale video quality assessment database in full-hd resolution with h.264 coding. In: 2013 IEEE Globecom Workshops (GC Wkshps), pp. 1162–1167 (December 2013). https://doi.org/10.1109/GLOCOMW.2013.6825150
Leszczuk, M.I., Stange, I., Ford, C.: Determining image quality requirements for recognition tasks in generalized public safety video applications: definitions, testing, standardization, and current trends. In: 2011 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB), pp. 1–5 (June 2011). https://doi.org/10.1109/BMSB.2011.5954938
Leszczuk, M.: Revising and improving the ITU-T recommendation p.912. J. Telecommun. Inf. Technol. 2015, 10–14 (2015)
Ma, C., Yang, C.Y., Yang, X., Yang, M.H.: Learning a no-reference quality metric for single-image super-resolution. Comput. Vis. Image Underst. 158, 1–16 (2017)
Mittal, A., Moorthy, A.K., Bovik, A.C.: No-reference image quality assessment in the spatial domain. IEEE Trans. Image Process. 21(12), 4695–4708 (2012)
Orsolic, I., Pevec, D., Suznjevic, M., Skorin-Kapov, L.: A machine learning approach to classifying YouTube QoE based on encrypted network traffic. Multimedia Tools Appl., 1–35 (2017). https://doi.org/10.1007/s11042-017-4728-4
ITU-T P.910: Subjective video quality assessment methods for recognition tasks (2016)
Pan, D., Shi, P., Hou, M., Ying, Z., Fu, S., Zhang, Y.: Blind predicting similar quality map for image quality assessment. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 6373–6382 (2018)
Ponomarenko, N., et al.: Color image database tid2013: peculiarities and preliminary results. In: European workshop on visual information processing (EUVIP), pp. 106–111. IEEE (2013)
Romaniak, P.: Towards realization of a framework for integrated video quality of experience assessment. In: 2009 IEEE INFOCOM Workshops, pp. 1–2 (2009). https://doi.org/10.1109/INFCOMW.2009.5072201
Russakovsky, O.: Imagenet large scale visual recognition challenge. Int. J. Comput. Vis. 115(3), 211–252 (2015)
Saad, M.A., Bovik, A.C.: Natural motion statistics for no-reference video quality assessment. In: 2009 International Workshop on Quality of Multimedia Experience. pp. 163–167 (July 2009). https://doi.org/10.1109/QOMEX.2009.5246957
Saad, M.A., Bovik, A.C., Charrier, C.: Blind image quality assessment: a natural scene statistics approach in the DCT domain. IEEE Trans. Image Process. 21(8), 3339–3352 (2012)
Samani, A., Panetta, K., Agaian, S.: Transform domain measure of enhancement- TDME - for security imaging applications. In: 2013 IEEE International Conferenceon Technologies for Homeland Security (HST), pp. 265–270 (November 2013). https://doi.org/10.1109/THS.2013.6699012
Sheikh, H.R., Sabir, M.F., Bovik, A.C.: A statistical evaluation of recent full reference image quality assessment algorithms. IEEE Trans. Image Process. 15(11), 3440–3451 (2006)
Siahaan, E., Hanjalic, A.: Visual Quality of Experience: A Metric Driven Perspective. TU Delft (2018). https://books.google.pl/books?id=JrLzwQEACAAJ
Tang, J., Peli, E., Acton, S.: Image enhancement using a contrast measure in the compressed domain. IEEE Sig. Process. Lett. 10(10), 289–292 (2003)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Kawa, K., Leszczuk, M., Boev, A. (2020). Survey on the State-Of-The-Art Methods for Objective Video Quality Assessment in Recognition Tasks. In: Dziech, A., Mees, W., Czyżewski, A. (eds) Multimedia Communications, Services and Security. MCSS 2020. Communications in Computer and Information Science, vol 1284. Springer, Cham. https://doi.org/10.1007/978-3-030-59000-0_25
Download citation
DOI: https://doi.org/10.1007/978-3-030-59000-0_25
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-58999-8
Online ISBN: 978-3-030-59000-0
eBook Packages: Computer ScienceComputer Science (R0)