Skip to main content
SpringerLink
Log in

Photo quality classification using deep learning

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The detection of poor quality images for reasons such as focus, lighting, compression, and encoding is of great importance in the field of computer vision. The ability to quickly and automatically classify an image as poor quality creates opportunities for a multitude of applications such as digital cameras, phones, self-driving cars, and web search technologies. In this paper an end-to-end approach using Convolutional Neural Networks (CNN) is presented to classify images into six categories of bad lighting, Gaussian blur, motion blur, JPEG 2000, white-noise, and high quality reference images. A new dataset of images was produced and used to train and validate the model. Finally, the application of the developed model was evaluated using images from the German Traffic Sign Recognition Benchmark. The results show that the trained CNN can detect and correctly classify images into the aforementioned categories with high accuracy and the model can be easily re-calibrated for other applications with only a small sample of training images.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Aghdam HH, Heravi EJ (2017) Guide to convolutional neural networks. New York, NY: Springer. doi 10:225–226

    Google Scholar 

  2. Ahmed WS et al (2020) The impact of filter size and number of filters on classification accuracy in cnn. In: 2020 International conference on computer science and software engineering (CSASE), pp 88–93. IEEE

  3. Bianco S, Celona L, Napoletano P, Schettini R (2018) On the use of deep learning for blind image quality assessment. SIViP 12(2):355–362

    Article  Google Scholar 

  4. Brinded M (2011) Computer vision methods for detection of blurry photographs. Ph.D. Thesis, University of Leeds, School of Computing Studies

  5. Chung Y-C, Wang J-M, Bailey RR, Chen S-W, Chang S-L (2004) A non-parametric blur measure based on edge analysis for image processing applications. In: Cybernetics and intelligent systems, 2004 IEEE conference on, vol 1, pp 356–360. IEEE

  6. Da Rugna J, Konik H (2003) Automatic blur detection for meta-data extraction in content-based retrieval context. In: Internet imaging V, vol 5304, pp 285–295. International society for optics and photonics

  7. Golchubian A, Marquez O, Nojoumian M (2020) Photo quality classification using deep learning - dataset and programming. https://github.com/agolchub/Photo_Quality_Classification

  8. Golestaneh SA, Karam LJ (2017) Spatially-varying blur detection based on multiscale fused and sorted transform coefficients of gradient magnitudes. In: CVPR, pp 596–605

  9. Gu K, Zhai G, Lin W, Yang X, Zhang W (2015) No-reference image sharpness assessment in autoregressive parameter space. IEEE Trans Image Process 24(10):3218–3231

    Article  MathSciNet  Google Scholar 

  10. Hsu P, Chen B-Y (2008) Blurred image detection and classification. In: International conference on multimedia modeling, pp 277–286. Springer

  11. Liu R, Li Z, Jia J (2008) Image partial blur detection and classification. In: Computer vision and pattern recognition, 2008. CVPR 2008. IEEE Conference on, pp 1–8. IEEE

  12. Liu W, Lin W (2013) Additive white gaussian noise level estimation in svd domain for images. IEEE Transactions on Image processing 22(3):872–883

    Article  MathSciNet  Google Scholar 

  13. Marziliano P, Dufaux F, Winkler S, Ebrahimi T (2002) A no-reference perceptual blur metric. In: Image processing. 2002. Proceedings. 2002 international conference on, vol 3, pp III–III. IEEE

  14. Sheikh HR, Wang Z, Cormack L, Bovik AC (2005) Live image quality assessment database release 2 (2005)

  15. Stallkamp J, Schlipsing M, Salmen J, Igel C (2012) Man vs. computer: Benchmarking machine learning algorithms for traffic sign recognition. Neural networks 32:323–332

    Article  Google Scholar 

  16. Su B, Lu S, Tan CL (2011) Blurred image region detection and classification. In: Proceedings of the 19th ACM international conference on multimedia, pp 1397–1400. ACM

  17. Tang X, Luo W, Wang X (2013) Content-based photo quality assessment. IEEE Transactions on Multimedia 15(8):1930–1943

    Article  Google Scholar 

  18. Tong H, Li M, Zhang H, Zhang C (2004) Blur detection for digital images using wavelet transform. In: Multimedia and Expo, 2004. ICME’04. 2004 IEEE International Conference on, vol 1, pp 17–20. IEEE

  19. Tsomko E, Kim H J, Paik J, Yeo I-K (2008) Efficient method of detecting blurry images. Journal of Ubiquitous Convergence Technology 2(1):pp–27

    Google Scholar 

  20. Yang SJ, Berndl M, Ando DM, Barch M, Narayanaswamy A, Christiansen E, Hoyer S, Roat C, Hung J, Rueden CT et al (2018) Assessing microscope image focus quality with deep learning. BMC bioinformatics 19(1):77

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer & Electrical Engineering and Computer Science, Florida Atlantic University, 777 Glades Road, Boca Raton, FL, 33431-0991, USA

    Arash Golchubian, Oge Marques & Mehrdad Nojoumian

Authors
  1. Arash Golchubian
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Oge Marques
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mehrdad Nojoumian
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Arash Golchubian.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Golchubian, A., Marques, O. & Nojoumian, M. Photo quality classification using deep learning. Multimed Tools Appl 80, 22193–22208 (2021). https://doi.org/10.1007/s11042-021-10766-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-021-10766-7

Keywords

Search

Navigation