Abstract
Many content-based image retrieval (CBIR) methods are being developed to store more and more information about images in shorter feature vectors and to improve image retrieval rate. In the proposed method, two-step approach to CBIR has been developed. The first step generates an image mask from local binary pattern (LBP). This LBP mask is then utilized to draw comparison between the centre pixel and the eight surrounding pixels. The second step involves drawing the peak and valley patterns of local directional binary pattern for each image which is then combined with the colour histogram to retrieve similar images. Existing methods suffer from lower average image retrieval accuracy even with larger feature vectors. The proposed method overcomes such problems through shorter feature vectors that can store more information about the image. As illustrated through experimental results, the proposed method produces promising results with shorter feature vector of length 56 and improved image retrieval rate of about 5–10%. Our method outperforms similar techniques when tested with public data sets.
Similar content being viewed by others
References
Müller H, Michoux N, Bandon D, Geissbuhler A (2004) A review of content-based image retrieval systems in medical applications—clinical benefits and future directions. Int J Med Inform 73(1):1–23
Patel JM, Gamit NC (2016) A review on feature extraction techniques in content based image retrieval. In: IEEE WiSPNET
Ojala T, Pietikäinen M, Harwood D (1996) A comparative study of texture measures with classification based on featured distributions. Pattern Recognit 29(1):51–59
Ojala T, Pietikäinen M, Maenpaa T (2002) Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell 24(7):971–987
Heikkilä M, Pietikäinen M, Schmid C (2006) Description of interest regions with center-symmetric local binary patterns. In: Computer vision, graphics and image processing, pp 58–69
Zhang B, Gao Y, Zhao S, Liu J (2010) Local derivative pattern versus local binary pattern: face recognition with high-order local pattern descriptor. IEEE Trans Image Process 19(2):533–544
Guo Z, Zhang L, Zhang D (2010) Rotation invariant texture classification using LBP variance (LBPV) with global matching. Pattern Recognit 43(3):706–719
Yao CH, Chen SY (2003) Retrieval of translated, rotated and scaled color textures. Pattern Recognit 36(4):913–929
Murala S, Wu QJ, Balasubramanian R, Maheshwari RP (2013) Joint histogram between color and local extrema patterns for object tracking. In: IS&T/SPIE electronic imaging, international society for optics and photonics, 86630T
Murala S, Maheshwari RP, Balasubramanian R (2012) Directional local extrema patterns: a new descriptor for content based image retrieval. Int J Multimed Inf Retr 1(3):191–203
Murala S, Wu QM (2013) Peak valley edge patterns: a new descriptor for biomedical image indexing and retrieval. In: IEEE conference on computer vision and pattern recognition workshops, CVPRW, pp 444–449
Tan X, Triggs B (2010) Enhanced local texture feature sets for face recognition under difficult lighting conditions. IEEE Trans Image Process 19(6):1635–1650
Guo Z, Zhang L, Zhang D (2010) A completed modeling of local binary pattern operator for texture classification. IEEE Trans Image Process 9(16):1657–1663
Dey M, Balasubramanian R, Verma M (2016) A novel colour- and texture-based image retrieval technique using multi-resolution local extrema peak valley pattern and RGB colour histogram. Pattern Anal Appl 19:1159–1179
Swain MJ, Ballard DH (1991) Color indexing Int J Comput Vis 7(1):11–32
Schaefer G, Stich M (2003) UCID: an uncompressed color image database. In: Electronic imaging. International society for optics and photonics, pp 472–480
Singh C, Kaur KP (2016) A fast and efficient image retrieval system based on color and texture features. Vis Commun Image Rep 41:225–238
Verma M, Balasubramanian R (2016) Local tri-directional patterns: a new texture feature descriptor for image retrieval. Digit Signal Process 51:62–72
Liu P, Guo JM, Chamnongthai K, Prasetyo H (2017) Fusion of color histogram and LBP-based features for texture image retrieval and classification. Inf Sci 390:95–111
Nanni L, Lumini A, Brahnam S (2010) Local binary patterns variants as texture descriptors for medical image analysis. Artif Intell Med 49(2):117–125
Chakraborty S, Singh SK, Chakraborty P (2015) Local directional gradient pattern: a local descriptor for face recognition. Multimed Tools Appl 76:1201–1216
Srinivasa-Perumal R, Chandra Mouli PVSSR (2016) Dimensionality reduced local directional pattern (DR-LDP) for face recognition. Expert Syst Appl 63:66–73
Subrahmanyam M, Maheshwari RP, Balasubramanian R (2012) Local maximum edge binary patterns: a new descriptor for image retrieval and object tracking. Signal Process 92:1467–1479
Murala S, Maheshwari RP, Balasubramanian R (2012) Local tetra patterns: a new feature descriptor for content-based image retrieval. IEEE Trans Image Process 21(5):2874–2886
Verma M, Raman B, Murala S (2015) Local extrema co-occurrence pattern for color and texture image retrieval. Neurocomputing 165:255–269
Verma M, Raman B (2015) Center symmetric local binary co-occurrence pattern for texture, face and bio-medical image retrieval. J Vis Commun Image Represent 32:224–236
AT&T Laboratories Cambridge (2002) The AT&T database of faces. https://www.uk.research.att.com/facedatabase.html. Accessed 5 Feb 2020
MIT Vision and Modeling Group, Cambridge. Vision texture. https://vismod.media.mit.edu/pub/. Accessed 5 Feb 2020
Safia A, He D (2013) New Brodatz-based image databases for grayscale color and multiband texture analysis. In: ISRN machine vision
Li Z, Liu G, Yang Y, You J (2012) Scale- and rotation-invariant local binary pattern using scale-adaptive texton and subuniform-based circular shift. IEEE Trans Image Process 21(4):2130–2140
Florindo JB, Bruno OM (2016) Local fractal dimension and binary patterns in texture recognition. Pattern Recognit Lett 78:22–27
Nguyen TP, Vu NS, Manzanera A (2016) Statistical binary patterns for rotational invariant texture classification. Neurocomputing 173(3):1565–1577
Zhu C, Wang R (2012) Local multiple patterns based multiresolution gray-scale and rotation invariant texture classification. Inf Sci 187:93–108
Shen F, Shen C, Zhou X, Yang Y, Tao Shen H (2016) Face image classification by pooling raw features. Pattern Recognit 54:94–103
Nima R, Abdullah M, Al-altakchi M, Dlay SS, Woo WL, Chambers JA (2017) Finger texture biometric verification exploiting Multi-scale Sobel Angles Local Binary Pattern features and score-based fusion. Digit Signal Process 70:178–189
Islam SK, Banerjee M, Bhattacharyya S, Chakraborty S (2017) Content-based image retrieval based on multiple extended fuzzy-rough framework. Appl Soft Comput 57:102–117
Alzu'bi A, Amira A, Ramzan N (2017) Content-based image retrieval with compact deep convolutional features. Neurocomputing 249:95–105
Liu H, Li B, Lv X, Huang Y (2017) Image retrieval using fused deep convolutional features. Procedia Comput Sci 107:749–754
Dubey SR, Mukherjee S (2018) LDOP: local directional order pattern for robust face retrieval. In: Computer vision and pattern recognition
Pak M, Kim S (2017) A review of deep learning in image recognition. In: 4th International conference on computer applications and information processing technology (CAIPT), Kuta Bali, pp 1–3. https://doi.org/10.1109/CAIPT.2017.8320684. Accessed 5 Feb 2020
Song J, Gao L, Nie F, Shen HT, Yan Y, Sebe N (2016) Optimized graph learning using partial tags and multiple features for image and video annotation. IEEE Trans Image Process 25(11):4999–5011
Liu P, Guo J, Wu C, Cai D (2017) Fusion of deep learning and compressed domain features for content-based image retrieval. IEEE Trans Image Process 26(12):5706–5717
Zeiler MD, Fergus R (2014) Visualizing and understanding convolutional networks. In: Computer vision—ECCV, pp 818–833
Krizhevsky A, Sutskever I, Hinton GE (2012) ImageNet classification with deep convolutional neural networks. In: Proceedings of NIPS, pp 1097–1105
Szegedy C et al (2015) Going deeper with convolutions. In: Proceedings of IEEE conference on computer vision and pattern recognition, pp 1–9
Simonyan K, Zisserman (2014) A very deep convolutional networks for large-scale image recognition. https://arxiv.org/abs/1409.1556. Accessed 5 Feb 2020
Zareapoor M, Yang J, Jain DK et al (2018) Deep semantic preserving hashing for large scale image retrieval. Multimed Tools Appl. https://doi.org/10.1007/s11042-018-5970-0. Accessed 5 Feb 2020
Tang YY, Xia T, Wei Y, Li H, Li L (2014) Hierarchical kernel-based rotation and scale invariant similarity. Pattern Recognit 47(7):1674–1688
Cataldo SD, Ficarra E (2017) Mining textural knowledge in biological images: applications, methods and trends. Comput Struct Biotechnol J 15:56–67
Georghiades A, Belhumeur P, Kriegman D (2001) From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans Pattern Anal Mach Intell 23:643–660
Kylberg G. The Kylberg Texture Dataset v. 1.0. Centre for Image Analysis, Swedish University of Agricultural Sciences and Uppsala University. External report (Blue series) No. 35. https://www.cb.uu.se/~gustaf/texture/. Accessed 5 Feb 2020
Wang Q, Lin J, Yuan Y (2016) Salient band selection for hyperspectral image classification via manifold ranking. IEEE Trans Neural Netw Learn Syst 27(6):1–11
Wang Q, Wan J, Nie F, Liu B, Yan C, Li X (2019) Hierarchical feature selection for random projection. IEEE Trans Neural Netw Learn Syst 30:1581–1586
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Gupta, S., Roy, P.P., Dogra, D.P. et al. Retrieval of colour and texture images using local directional peak valley binary pattern. Pattern Anal Applic 23, 1569–1585 (2020). https://doi.org/10.1007/s10044-020-00879-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10044-020-00879-4