Abstract
It is well established that biometric image quality plays a pivotal role in the overall performance of biometric system. In poor-quality images, detecting true features is complicated and is the main reason for matching errors. The quality of ear images in unconstrained environment conditions poses many challenges to the ear biometric system. To tackle the aforementioned issues, in this work, we have proposed a non-reference based ear image quality assessment (EIQA) network and explored its usage in ear recognition system. The quality assessment of ear images is a challenging task as there doesn’t exist any database that provides quality score of ear images. The quality of ear images in the unconstrained environment is mainly affected by six different distortions such as huge rotation, blurriness, white noise, high occlusion, poor contrast, and low resolution. These distortions are incorporated at five different levels to prepare different bins of image quality. The network is trained to identify the type of distortion and classify the image into five different categories viz. excellent, good, fair, poor, and bad. The proposed method gives an overall classification accuracy of 97.46% on images that include all types of distortions. Afterwards, the experiments are performed for ear recognition, and it has been identified the quality of the ear images highly affects the system’s performance. An overall Correct recognition rate (CRR) is improved from 24.90% to 72.45% by discarding the images with an inferior quality. Thorough experiments are performed on IITK ear recognition database. To the best of our knowledge, this is the our first attempt made to develop self semi supervised network training strategy to identify, quantify and estimate the quality of ear images.This work aims to improve the performance of the ear recognition framework by accurately assessing the quality of images and discarding the low quality images. The results demonstrate the effectiveness of the model and a viable option to be utilised in the improvement of ear recognition methods.
Similar content being viewed by others
References
Chiarella Sforza, Gaia Grandi, Miriam Binelli, Davide G. Tommasi, Riccardo Rosati and Virgilio F Ferrario 2009 Age- and sex-related changes in the normal human ear. Forensic Science International, 187(1): 110.e1–110.e7, 2009
Kyong Chang, Kevin W Bowyer, Sudeep Sarkar and Barnabas Victor 2003 Comparison and combination of ear and face images in appearance-based biometrics. IEEE Transactions on pattern analysis and machine intelligence, 25(9): 1160–1165
David J Hurley, Banafshe Arbab-Zavar and Mark S Nixon 2008 The ear as a biometric, pages 131–150. Springer
Anika Pflug and Christoph Busch 2012 Ear biometrics: a survey of detection, feature extraction and recognition methods. IET biometrics, 1(2): 114–129
Ziga Emersic, Vitomir Struc and Peter Peer 2017 Ear recognition: More than a survey. Neurocomputing, 255: 26 – 39
Aman Kamboj, Rajneesh Rani and Aditya Nigam 2021 A comprehensive survey and deep learning-based approach for human recognition using ear biometric. The Visual Computer
Zhou Wang, A C Bovik, H R Sheikh and E P Simoncelli 2004 Image quality assessment: from error visibility to structural similarity. IEEE Transactions on Image Processing, 13(4): 600–612
Anish Mittal, Anush Krishna Moorthy and Alan Conrad Bovik 2012 No-reference image quality assessment in the spatial domain. IEEE Transactions on Image Processing, 21(12): 4695–4708
Anush Krishna Moorthy and Alan Conrad Bovik 2011 Blind image quality assessment: From natural scene statistics to perceptual quality. IEEE Transactions on Image Processing, 20(12): 3350–3364
Anish Mittal, R Soundararajan and A Bovik 2013 Making a “completely blind” image quality analyzer. IEEE Signal Processing Letters, 20: 209–212
Aman Kamboj, Rajneesh Rani and Aditya Nigam 2021 CG-ERNet: a lightweight curvature gabor filtering based ear recognition network for data scarce scenario. Multimedia Tools Applications, 80: 26571–26613
Fernando Alonso-Fernandez, Julian Fierrez, Javier Ortega-Garcia, Joaquin Gonzalez-Rodriguez, Hartwig Fronthaler, Klaus Kollreider and Josef Bigun 2007 A comparative study of fingerprint image-quality estimation methods. IEEE Transactions on Information Forensics and Security, 2(4): 734–743
Elham Tabassi and Patrick Grother 2009 Fingerprint Image Quality, pages 482–490. Springer US, Boston, MA
Kamlesh Tiwari and Phalguni Gupta 2014 No-reference fingerprint image quality assessment. In: International Conference on Intelligent Computing, pages 846–854. Springer
Yi Chen, Sarat C Dass and Anil K Jain 2005 Fingerprint quality indices for predicting authentication performance. In: Takeo Kanade, Anil Jain and Nalini K Ratha, editors, Audio- and Video-Based Biometric Person Authentication, pages 160–170, Berlin, Heidelberg, 2005. Springer Berlin Heidelberg
Sisanda Makinana, Tendani Malumedzha and Fulufhelo V Nelwamondo 2014 Iris image quality assessment based on quality parameters. In: Ngoc Thanh Nguyen, Boonwat Attachoo, Bogdan Trawiński, and Kulwadee Somboonviwat, editors, Intelligent Information and Database Systems, pages 571–580, Cham, 2014. Springer International Publishing.
Mohsen Jenadeleh, Marius Pedersen and Dietmar Saupe 2020 Blind quality assessment of iris images acquired in visible light for biometric recognition. Sensors, 20(5)
Nathan D. Kalka, Jinyu Zuo, Natalia A. Schmid and Bojan Cukic 2006 Image quality assessment for iris biometric. In: Patrick J Flynn and Sharath Pankanti, editors, Biometric Technology for Human Identification III, volume 6202, pages 124 – 134. International Society for Optics and Photonics, SPIE
Debalina Bhattacharjee, Surya Prakash and Phalguni Gupta 2012 No-reference image quality assessment for facial images. In: De-Shuang Huang, Yong Gan, Phalguni Gupta, and M Michael Gromiha, editors, Advanced Intelligent Computing Theories and Applications, pages 594–601, Berlin, Heidelberg, 2012. Springer Berlin Heidelberg
J Hernandez-Ortega, J Galbally, J Fierrez, R Haraksim and L Beslay 2019 Faceqnet: Quality assessment for face recognition based on deep learning. In: 2019 International Conference on Biometrics (ICB), pages 1–8
Qiong Cao, Li Shen, Weidi Xie, Omkar M. Parkhi and Andrew Zisserman 2018 Vggface2: A dataset for recognising faces across pose and age. In: 2018 13th IEEE International Conference on Automatic Face Gesture Recognition (FG 2018), pages 67–74
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun 2016 Deep residual learning for image recognition. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 770–778
S Bharadwaj, M Vatsa and R Singh 2013 Can holistic representations be used for face biometric quality assessment? In: 2013 IEEE International Conference on Image Processing, pages 2792–2796
N Dalal and B Triggs 2005 Histograms of oriented gradients for human detection. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), volume 1, pages 886–893 vol. 1
I Toprak and O Toygar 2021 Detection of spoofing attacks for ear biometrics through image quality assessment and deep learning. Expert Systems with Applications, 172: 114600, 2021
Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li and Li Fei-Fei 2009 Imagenet: A large-scale hierarchical image database. In: 2009 IEEE conference on computer vision and pattern recognition, pages 248–255. Ieee, 2009
Surya Prakash and Phalguni Gupta 2012 An efficient ear localization technique. Image Vision Comput., 30(1): 38–50
Jun Yu, Kejia Sun, Fei Gao and Suguo Zhu 2018 Face biometric quality assessment via light cnn.Pattern Recognition Letters, 107: 25–32
S Bharadwaj, Mayank Vatsa and Richa Singh 2013 Can holistic representations be used for face biometric quality assessment?
Gaurav Jaswal, Ravinder Nath, Divyansh Aggarwal and Aditya Nigam 2017 Fkqnet: A biometrie sample quality estimation network using transfer learning. In: Fourth International Conference on Image Information Processing (ICIIP), pages 1–6
Kamlesh Tiwari and Phalguni Gupta 2014 No-reference fingerprint image quality assessment. In: De-Shuang Huang, Kang-Hyun Jo, and Ling Wang, editors, Intelligent Computing Methodologies, pages 846–854, Cham, Springer International Publishing
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
No potential conflict of interest was reported by the author(s).
Rights and permissions
About this article
Cite this article
Kamboj, A., Rani, R. & Nigam, A. EIQA: ear image quality assessment using deep convolutional neural network. Sādhanā 47, 245 (2022). https://doi.org/10.1007/s12046-022-02017-8
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s12046-022-02017-8