Abstract
Extraction and description of image features is an active research topic and important for several applications of computer vision field. This paper presents a new noise-tolerant and rotation-invariant local feature descriptor called robust local oriented patterns (RLOP). The proposed descriptor extracts local image structures utilizing edge directional information to provide rotation-invariant patterns and to be effective in noise and changing illumination situations. This is achieved by a non-linear amalgamation of two specific strategies; binarizing neighborhood pixels of a patch and assigning binomial weights in the same formula. In the encoding methodology, the neighboring pixels is binarized with respect to the mean value of pixels in an image patch of size 3 × 3 instead of the center pixel. Thus, the obtained codes are rotation-invariant and more robust against noise and other non-monotonic grayscale variations. Ear recognition is considered as the representative problem, where the ear involves localized patterns and textures. The proposed descriptor encodes all images’ pixels and the resulting RLOP-encoded image is divided into several regions. Histograms of the regions are constructed to estimate the distribution of features. Then, all histograms are concatenated together to form the final descriptor. The robustness and effectiveness of the proposed descriptor are evaluated through conducting several identification and verification experiments on four different ear databases: IIT Delhi-I, IIT Delhi-II, AMI, and AWE. It is observed that the proposed descriptor outperforms the state-of-the-art texture based approaches achieving a recognition rate of 98% on the average providing the best performance among the tested descriptors.
Similar content being viewed by others
References
Abaza A, Ross A, Hebert C, Harrison MAF, Nixon MS (2013) A survey on ear biometrics. ACM computing surveys 45(2):22
Al Rahhal MM, Mekhalfi ML, Ali TAM, Bazi Y, Al Zuair M, Rangarajan L (2018) Ear recognition via sparse coding of local features. Journal of Electronic Imaging 27(1):013007
Al Rahhal MM, Mekhalfi ML, Guermoui M, Othman E, Lei B, Mahmood A (2018) A dense phase descriptor for human ear recognition. IEEE Access 6:11883–11887
Alagarsamy SB, Murugan K (2019) Ear recognition system using adaptive approach Runge-Kutta (AARK) threshold segmentation with cart classifier. Multimedia Tools and Applications, 1–15
Alshazly HA, Hassaballah M, Ahmed M, Ali AA (2018) Ear biometric recognition using gradient-based feature descriptors. In: International Conference on Advanced Intelligent Systems and Informatics. Springer, pp 435–445
Awad AI (2016) Hassaballah M, Image feature detectors and descriptors: Foundations and applications. Springer
Benzaoui A, Hadid A, Boukrouche A (2014) Ear biometric recognition using local texture descriptors. Journal of Electronic Imaging 23(5):053008
Cao K, Jain AK (2019) Automated latent fingerprint recognition. IEEE Trans Pattern Anal Mach Intell 41(4):788–800
Chakraborti T, McCane B, Mills S, Pal U (2018) LOOP descriptor: Local optimal oriented pattern. IEEE Signal Processing Letters 25(5):635–639
Chatterjee A, Singh P, Bhatia V, Prakash S (2019) Ear biometrics recognition using laser biospeckled fringe projection profilometry. Optics & Laser Technology 112:368–378
Chen J, Shan S, He C, Zhao G, Pietikainen M, Chen X, Gao W (2010) WLD: A robust local image descriptor. IEEE Trans Pattern Anal Mach Intell 32(9):1705–1720
Chowdhury DP, Bakshi S, Guo G, Sa PK (2018) On applicability of tunable filter bank based feature for ear biometrics: A study from constrained to unconstrained. J Med Syst 42(1):1–20
Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: Computer Vision and Pattern Recognition. IEEE, pp 886–893
Damer N, Führer B (2012) Ear recognition using multi-scale histogram of oriented gradients. In: International Conference on Intelligent Information Hiding and Multimedia Signal Processing. IEEE, pp 21–24
Das A, Pal U, Ferrer MA, Blumenstein M, Štepec D, Rot P, Emeršič V, Peer P, Štruc V, Kumar SA et al (2017) SSERBC 2017: Sclera segmentation and eye recognition benchmarking competition. In: IEEE International Joint Conference on Biometrics. IEEE, pp 742–747
Dodge S, Mounsef J, Karam L (2018) Unconstrained ear recognition using deep neural networks. IET Biometrics 7(3):207–214
Doghmane H, Boukrouche A, Boubchir L (2019) A novel discriminant multiscale representation for ear recognition. International Journal of Biometrics 11 (1):50–66
Dubey SR, Mukherjee S (2020) LDOP: Local directional order pattern for robust face retrieval. Multimed Tools Appl 79:6363–6382
El Naggar S, Abaza A, Bourlai T (2016) On a taxonomy of ear features. In: IEEE Symposium on Technologies for Homeland Security. IEEE, pp 1–6
Emersic Z, Meden B, Peer P, Struc V (2017) Covariate analysis of descriptor-based ear recognition techniques. In: International Conference and Workshop on Bioinspired Intelligence. IEEE, pp 1–9
Emeršič ž, Meden B, Peer P, Štruc V (2019) Evaluation and analysis of ear recognition models: Performance, complexity and resource requirements. Neural Comput and Applic, 1–16
Emeršič ž, Štruc V, Peer P (2017) Ear recognition: More than a survey. Neurocomputing 255:26–39
Fathi A, Naghsh-Nilchi AR (2012) Noise tolerant local binary pattern operator for efficient texture analysis. Pattern Recogn Lett 33(9):1093–1100
Galdámez P L, Raveane W, Arrieta AG (2017) A brief review of the ear recognition process using deep neural networks. J Appl Log 24:62–70
Ghoualmi L, Draa A, Chikhi S (2016) An ear biometric system based on artificial bees and the scale invariant feature transform. Expert Syst Appl 57:49–61
Guei AC, Akhloufi MA (2018) Deep ear biometrics. In: Disruptive technologies in information sciences, international society for optics and photonics, vol 10652, p 106520Q
Guo Y, Xu Z (2008) Ear recognition using a new local matching approach. In: IEEE International Conference on Image Processing. IEEE, pp 289–292
Hansley EE, Segundo MP, Sarkar S (2018) Employing fusion of learned and handcrafted features for unconstrained ear recognition. IET Biometrics 7 (3):215–223
Hassaballah M, Aly S (2015) Face recognition: Challenges, achievements and future directions. IET Comput Vis 9(4):614–626
Hassaballah M, Awad AI (2016) Detection and description of image features: An introduction. In: Image feature detectors and descriptors: Foundations and applications. Springer, pp 1–8
Hassaballah M, Hammam AA, Abdelmgeid AA (2019) Ear recognition using local binary patterns: A comparative experimental study. Expert Systems With Applications 118:182–200
Hassaballah M, Hosny KM (2019) Recent advances in computer vision: theories and applications. Springer
Hezil N, Boukrouche A (2017) Multimodal biometric recognition using human ear and palmprint. IET Biometrics 6(5):351–359
Jabid T, Kabir MH, Chae O (2010) Robust facial expression recognition based on local directional pattern. ETRI J 32(5):784–794
Kumar A, Wu C (2012) Automated human identification using ear imaging. Pattern Recogn 45(3):956–968
Kyrki V, Kamarainen JK, Kälviäinen H (2004) Simple Gabor feature space for invariant object recognition. Pattern Recogn Lett 25(3):311–318
Larrain T, Bernhard JS, Mery D, Bowyer KW (2017) Face recognition using sparse fingerprint classification algorithm. IEEE Transactions on Information Forensics and Security 12(7):1646–1657
Liu L, Chen J, Fieguth P, Zhao G, Chellappa R, Pietikäinen M (2019) From BoW to CNN: Two decades of texture representation for texture classification. Int J Comput Vis 127(1):74–109
Liu L, Fieguth P, Guo Y, Wang X, Pietikäinen M (2017) Local binary features for texture classification: Taxonomy and experimental study. Pattern Recogn 62:135–160
Morales A, Ferrer MA, Diaz-Cabrera M, González E (2013)
Nanni L, Ghidoni S, Brahnam S (2017) Handcrafted vs. non-handcrafted features for computer vision classification. Pattern Recogn 71:158–172
Nejati H, Zhang L, Sim T, Martinez-Marroquin E, Dong G (2012) Wonder ears: Identification of identical twins from ear images. In: International Conference on Pattern Recognition. IEEE, pp 1201–1204
Ojala T, Pietikäinen M, Harwood D (1996) A comparative study of texture measures with classification based on featured distributions. Pattern Recogn 29(1):51–59
Ojala T, Pietikainen M, Maenpaa T (2002) Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell 24(7):971–987
Ojansivu V, Rahtu E, Heikkila J (2008) Rotation invariant local phase quantization for blur insensitive texture analysis. In: International conference on pattern recognition. IEEE, pp 1–4
Omara I, Hagag A, Zuo W (2018) Learning LogDet divergence for ear recognition. In: International Conference on Biometric Engineering and Applications. ACM, 69–73
Omara I, Wu X, Zhang H, Du Y, Zuo W (2018) Learning pairwise SVM on hierarchical deep features for ear recognition. IET Biometrics 7 (6):557–566
Pan Z, Wu X, Li Z (2019) Central pixel selection strategy based on local gray-value distribution by using gradient information to enhance LBP for texture classification. Expert Syst Appl 120:319–334
Pflug A, Busch C (2012) Ear biometrics: A survey of detection, feature extraction and recognition methods. IET Biometrics 1(2):114–129
Pflug A, Busch C, Ross A (2014) 2D ear classification based on unsupervised clustering. In: IEEE International Joint Conference on Biometrics. IEEE, pp 1–8
Pflug A, Paul PN, Busch C (2014) A comparative study on texture and surface descriptors for ear biometrics. In: International Carnahan Conference on Security Technology. IEEE, pp 1–6
Pietikäinen M, Ojala T, Xu Z (2000) Rotation-invariant texture classification using feature distributions. Pattern Recogn 33(1):43–52
Rathgeb C, Pflug A, Wagner J, Busch C (2016) Effects of image compression on ear biometrics. IET Biometrics 5(3):252–261
Regouid M, Touahria M, Benouis M, Costen N (2019) Multimodal biometric system for ECG, ear and iris recognition based on local descriptors. Multimedia Tools and Applications, 1–27
Sarangi PP, Mishra BSP, Dehuri S (2018) Fusion of PHOG and LDP local descriptors for kernel-based ear biometric recognition. Multimedia Tools and Applications, 1–29
Sepas-Moghaddam A, Pereira F, Correia PL (2018) Ear recognition in a light field imaging framework: A new perspective. IET Biometrics 7(3):224–231
Tian L, Mu Z (2016) Ear recognition based on deep convolutional network. In: International congress on image and signal processing, biomedical engineering and informatics. IEEE, pp 437–441
Unar J, Seng WC, Abbasi A (2014) A review of biometric technology along with trends and prospects. Pattern Recogn 47(8):2673–2688
Vu NS, Caplier A (2010) Face recognition with patterns of oriented edge magnitudes. In: European conference on computer vision. Springer, pp 313–326
Wang Z, Yang J, Zhu Y (2019) Review of ear biometrics. Archives of Computational Methods in Engineering, 1–32
Yan P, Bowyer KW (2007) Biometric recognition using 3D ear shape. IEEE Trans Pattern Anal Mach Intell 29(8):1297–1308
Youbi Z, Boubchir L, Boukrouche A (2018) Human ear recognition based on local multi-scale LBP features with city-block distance. Multimedia Tools and Applications, 1–17
Yuan L, chun Mu Z (2012) Ear recognition based on local information fusion. Pattern Recogn Lett 33(2):182–190
Acknowledgment
The authors would like to acknowledge the providers of all used datesets in the experiments of this paper (i.e., IIT Delhi-I, IIT Delhi-II, AMI, and AWE).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Hassaballah, M., Alshazly, H.A. & Ali, A.A. Robust local oriented patterns for ear recognition. Multimed Tools Appl 79, 31183–31204 (2020). https://doi.org/10.1007/s11042-020-09456-7
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-020-09456-7