Skip to main content
Log in

EIQA: ear image quality assessment using deep convolutional neural network

  • Published:
Sādhanā Aims and scope Submit manuscript

Abstract

It is well established that biometric image quality plays a pivotal role in the overall performance of biometric system. In poor-quality images, detecting true features is complicated and is the main reason for matching errors. The quality of ear images in unconstrained environment conditions poses many challenges to the ear biometric system. To tackle the aforementioned issues, in this work, we have proposed a non-reference based ear image quality assessment (EIQA) network and explored its usage in ear recognition system. The quality assessment of ear images is a challenging task as there doesn’t exist any database that provides quality score of ear images. The quality of ear images in the unconstrained environment is mainly affected by six different distortions such as huge rotation, blurriness, white noise, high occlusion, poor contrast, and low resolution. These distortions are incorporated at five different levels to prepare different bins of image quality. The network is trained to identify the type of distortion and classify the image into five different categories viz. excellent, good, fair, poor, and bad. The proposed method gives an overall classification accuracy of 97.46% on images that include all types of distortions. Afterwards, the experiments are performed for ear recognition, and it has been identified the quality of the ear images highly affects the system’s performance. An overall Correct recognition rate (CRR) is improved from 24.90% to 72.45% by discarding the images with an inferior quality. Thorough experiments are performed on IITK ear recognition database. To the best of our knowledge, this is the our first attempt made to develop self semi supervised network training strategy to identify, quantify and estimate the quality of ear images.This work aims to improve the performance of the ear recognition framework by accurately assessing the quality of images and discarding the low quality images. The results demonstrate the effectiveness of the model and a viable option to be utilised in the improvement of ear recognition methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8

Similar content being viewed by others

References

  1. Chiarella Sforza, Gaia Grandi, Miriam Binelli, Davide G. Tommasi, Riccardo Rosati and Virgilio F Ferrario 2009 Age- and sex-related changes in the normal human ear. Forensic Science International, 187(1): 110.e1–110.e7, 2009

    Google Scholar 

  2. Kyong Chang, Kevin W Bowyer, Sudeep Sarkar and Barnabas Victor 2003 Comparison and combination of ear and face images in appearance-based biometrics. IEEE Transactions on pattern analysis and machine intelligence, 25(9): 1160–1165

    Article  Google Scholar 

  3. David J Hurley, Banafshe Arbab-Zavar and Mark S Nixon 2008 The ear as a biometric, pages 131–150. Springer

  4. Anika Pflug and Christoph Busch 2012 Ear biometrics: a survey of detection, feature extraction and recognition methods. IET biometrics, 1(2): 114–129

  5. Ziga Emersic, Vitomir Struc and Peter Peer 2017 Ear recognition: More than a survey. Neurocomputing, 255: 26 – 39

    Article  Google Scholar 

  6. Aman Kamboj, Rajneesh Rani and Aditya Nigam 2021 A comprehensive survey and deep learning-based approach for human recognition using ear biometric. The Visual Computer

  7. Zhou Wang, A C Bovik, H R Sheikh and E P Simoncelli 2004 Image quality assessment: from error visibility to structural similarity. IEEE Transactions on Image Processing, 13(4): 600–612

    Article  Google Scholar 

  8. Anish Mittal, Anush Krishna Moorthy and Alan Conrad Bovik 2012 No-reference image quality assessment in the spatial domain. IEEE Transactions on Image Processing, 21(12): 4695–4708

    Article  MathSciNet  MATH  Google Scholar 

  9. Anush Krishna Moorthy and Alan Conrad Bovik 2011 Blind image quality assessment: From natural scene statistics to perceptual quality. IEEE Transactions on Image Processing, 20(12): 3350–3364

  10. Anish Mittal, R Soundararajan and A Bovik 2013 Making a “completely blind” image quality analyzer. IEEE Signal Processing Letters, 20: 209–212

  11. Aman Kamboj, Rajneesh Rani and Aditya Nigam 2021 CG-ERNet: a lightweight curvature gabor filtering based ear recognition network for data scarce scenario. Multimedia Tools Applications, 80: 26571–26613

    Article  Google Scholar 

  12. Fernando Alonso-Fernandez, Julian Fierrez, Javier Ortega-Garcia, Joaquin Gonzalez-Rodriguez, Hartwig Fronthaler, Klaus Kollreider and Josef Bigun 2007 A comparative study of fingerprint image-quality estimation methods. IEEE Transactions on Information Forensics and Security, 2(4): 734–743

    Article  Google Scholar 

  13. Elham Tabassi and Patrick Grother 2009 Fingerprint Image Quality, pages 482–490. Springer US, Boston, MA

  14. Kamlesh Tiwari and Phalguni Gupta 2014 No-reference fingerprint image quality assessment. In: International Conference on Intelligent Computing, pages 846–854. Springer

  15. Yi Chen, Sarat C Dass and Anil K Jain 2005 Fingerprint quality indices for predicting authentication performance. In: Takeo Kanade, Anil Jain and Nalini K Ratha, editors, Audio- and Video-Based Biometric Person Authentication, pages 160–170, Berlin, Heidelberg, 2005. Springer Berlin Heidelberg

  16. Sisanda Makinana, Tendani Malumedzha and Fulufhelo V Nelwamondo 2014 Iris image quality assessment based on quality parameters. In: Ngoc Thanh Nguyen, Boonwat Attachoo, Bogdan Trawiński, and Kulwadee Somboonviwat, editors, Intelligent Information and Database Systems, pages 571–580, Cham, 2014. Springer International Publishing.

  17. Mohsen Jenadeleh, Marius Pedersen and Dietmar Saupe 2020 Blind quality assessment of iris images acquired in visible light for biometric recognition. Sensors, 20(5)

  18. Nathan D. Kalka, Jinyu Zuo, Natalia A. Schmid and Bojan Cukic 2006 Image quality assessment for iris biometric. In: Patrick J Flynn and Sharath Pankanti, editors, Biometric Technology for Human Identification III, volume 6202, pages 124 – 134. International Society for Optics and Photonics, SPIE

  19. Debalina Bhattacharjee, Surya Prakash and Phalguni Gupta 2012 No-reference image quality assessment for facial images. In: De-Shuang Huang, Yong Gan, Phalguni Gupta, and M Michael Gromiha, editors, Advanced Intelligent Computing Theories and Applications, pages 594–601, Berlin, Heidelberg, 2012. Springer Berlin Heidelberg

  20. J Hernandez-Ortega, J Galbally, J  Fierrez, R  Haraksim and L  Beslay 2019 Faceqnet: Quality assessment for face recognition based on deep learning. In: 2019 International Conference on Biometrics (ICB), pages 1–8

  21. Qiong Cao, Li Shen, Weidi Xie, Omkar M. Parkhi and Andrew Zisserman 2018 Vggface2: A dataset for recognising faces across pose and age. In: 2018 13th IEEE International Conference on Automatic Face Gesture Recognition (FG 2018), pages 67–74

  22. Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun 2016 Deep residual learning for image recognition. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 770–778

  23. S Bharadwaj, M Vatsa and R Singh 2013 Can holistic representations be used for face biometric quality assessment? In: 2013 IEEE International Conference on Image Processing, pages 2792–2796

  24. N Dalal and B  Triggs 2005 Histograms of oriented gradients for human detection. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), volume 1, pages 886–893 vol. 1

  25. I Toprak and O Toygar 2021 Detection of spoofing attacks for ear biometrics through image quality assessment and deep learning. Expert Systems with Applications, 172: 114600, 2021

  26. Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li and Li Fei-Fei 2009 Imagenet: A large-scale hierarchical image database. In: 2009 IEEE conference on computer vision and pattern recognition, pages 248–255. Ieee, 2009

  27. Surya Prakash and Phalguni Gupta 2012 An efficient ear localization technique. Image Vision Comput., 30(1): 38–50

  28. Jun Yu, Kejia Sun, Fei Gao and Suguo Zhu 2018 Face biometric quality assessment via light cnn.Pattern Recognition Letters, 107: 25–32

    Article  Google Scholar 

  29. S Bharadwaj, Mayank Vatsa and Richa Singh 2013 Can holistic representations be used for face biometric quality assessment?

  30. Gaurav Jaswal, Ravinder Nath, Divyansh Aggarwal and Aditya Nigam 2017 Fkqnet: A biometrie sample quality estimation network using transfer learning. In: Fourth International Conference on Image Information Processing (ICIIP), pages 1–6

  31. Kamlesh Tiwari and Phalguni Gupta 2014 No-reference fingerprint image quality assessment. In: De-Shuang Huang, Kang-Hyun Jo, and Ling Wang, editors, Intelligent Computing Methodologies, pages 846–854, Cham, Springer International Publishing

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Aman Kamboj.

Ethics declarations

Conflict of interest

No potential conflict of interest was reported by the author(s).

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kamboj, A., Rani, R. & Nigam, A. EIQA: ear image quality assessment using deep convolutional neural network. Sādhanā 47, 245 (2022). https://doi.org/10.1007/s12046-022-02017-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s12046-022-02017-8

Keywords

Navigation