Skip to main content
SpringerLink
Log in

Evolutionary-based generation of rotation and scale invariant texture descriptors from SIFT keypoints

Evolving Systems Aims and scope Submit manuscript

Cite this article

Abstract

To describe image data, prominent keypoints are commonly detected before running an extraction process to generate a feature vector. However, producing a reliable set of features is difficult and often requires human intervention. Indeed, images can undergo different changes that can affect the result and decrease the classification performance. To overcome these challenges, many approaches focused on constructing image descriptors that are invariant to transformations such as scale, illumination and rotation. These solutions mostly focused on one way to deal with information and faced more problems as they needed human intervention and a large set of data. In this study, we propose a genetic programming-based method with the intention of evolving a rotation and scale-invariant set of image descriptors. The generated vectors are then used for classifying texture images using a limited number of instances. In fact, in order to automatically evolve a descriptor that can handle illumination, scale and rotation changes, the proposed method combines two approaches that can treat information differently. It uses genetic programming with SIFT descriptor in order to extract prominent scale invariant keypoints before generating the feature vector. The performance of the proposed method has been validated on five datasets including scale and rotation variations. Results show that the method significantly outperforms similar low-level and GP-based descriptors.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  • Al-Sahaf H, Song A, Neshatian K, Zhang M (2012) Two-tier genetic programming: towards raw pixel-based image classification. Expert Syst Appl 39(16):12291–12301

    Article  Google Scholar 

  • Al-Sahaf H, Zhang M, Johnston M, Verma B (2015) Image descriptor: a genetic programming approach to multiclass texture classification. In: IEEE Congress on Evolutionary Computation (CEC), IEEE, pp 2460–2467

  • Al-Sahaf H, Al-Sahaf A, Xue B, Johnston M, Zhang M (2016) Automatically evolving rotation-invariant texture image descriptors by genetic programming. IEEE Trans Evol Comput 21(1):83–101. https://doi.org/10.1109/TEVC.2016.2577548

    Article  Google Scholar 

  • Al-Sahaf H, Zhang M, Al-Sahaf A, Johnston M (2017) Keypoints detection and feature extraction: a dynamic genetic programming approach for evolving rotation-invariant texture image descriptors. IEEE Trans Evolut Comput 21(6):825–844

    Article  Google Scholar 

  • Amirolad A, Arashloo SR, Amirani MC (2016) Multi-layer local energy patterns for texture representation and classification. Vis Comput 32(12):1633–1644

    Article  Google Scholar 

  • Arulkumaran K, Cully A, Togelius J (2019) Alphastar: An evolutionary computation perspective. In: Proceedings of the Genetic and Evolutionary Computation Conference Companion, pp 314–315

  • Balntas V, Lenc K, Vedaldi A, Mikolajczyk K (2017) Hpatches: a benchmark and evaluation of handcrafted and learned local descriptors. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 5173–5182

  • Bay H, Tuytelaars T, Van Gool L (2006) Surf: Speeded up robust features. European conference on computer vision. Springer, Berlin, pp 404–417

    Google Scholar 

  • Bejaoui H, Ghazouani H, Barhoumi W (2017) Fully automated facial expression recognition using 3d morphable model and mesh-local binary pattern. Advanced concepts for intelligent vision systems. Springer, Berlin

    Google Scholar 

  • Bejaoui H, Ghazouani H, Barhoumi W (2019) Sparse coding-based representation of lbp difference for 3d/4d facial expression recognition. Multimed Tools Appl 78(16):22773–22796

    Article  Google Scholar 

  • Bell S, Upchurch P, Snavely N, Bala K (2015) Material recognition in the wild with the materials in context database. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 3479-3487. https://doi.org/10.1109/CVPR.2015.7298970

  • Bi Y, Xue B, Zhang M (2018) An automatic feature extraction approach to image classification using genetic programming. In: International Conference on the Applications of Evolutionary Computation, pp 421–438

  • Bu X, Wu Y, Gao Z, Jia Y (2019) Deep convolutional network with locality and sparsity constraints for texture classification. Pattern Recognit 91:34–46

    Article  Google Scholar 

  • Cox DR, Wermuth N (1994) A note on the quadratic exponential binary distribution. Biometrika 81(2):403–408

    Article  MathSciNet  Google Scholar 

  • Crosier M, Griffin L (2010) Using basic image features for texture classification. Int J Comput Vision 88:447–460

    Article  MathSciNet  Google Scholar 

  • De Jong K (2019) Evolutionary computation: a unified approach. In: Proceedings of the Genetic and Evolutionary Computation Conference Companion, pp 507–522

  • Getreuer P (2013) A survey of gaussian convolution algorithms. Image Process Line 2013:286–310

    Article  Google Scholar 

  • Ghazouani H (2021) A genetic programming-based feature selection and fusion for facial expression recognition. Appl Soft Comput 103:107173

    Article  Google Scholar 

  • Ghazouani H, Barhoumi W (2020) Genetic programming-based learning of texture classification descriptors from local edge signature. Expert Syst Appl 161:113667

    Article  Google Scholar 

  • Ghazouani H, Barhoumi W, Antit Y (2020) A genetic programming method for scale-invariant texture classification. Engineering applications of neural networks conference. Springer, Berlin

    Google Scholar 

  • Ghourabi A, Ghazouani H, Barhoumi W (2020) Driver drowsiness detection based on joint monitoring of yawning, blinking and nodding. In: International Conference on Intelligent Computer Communication and Processing, pp 407–414

  • Gu J, Wang Z, Kuen J, Ma L, Shahroudy A, Shuai B, Liu T, Wang X, Wang G, Cai J et al (2018) Recent advances in convolutional neural networks. Pattern Recognit 77:354–377

    Article  Google Scholar 

  • Haralick R, Shanmugam K, Dinstein I (1973) Textural features for image classification. IEEE Trans Syst Man Cybern 3:610–621

    Article  Google Scholar 

  • Hazgui M, Ghazouani H, Barhoumi W (2021) Genetic programming-based fusion of hog and lbp features for fully automated texture classification. Vis Comput. https://doi.org/10.1007/s00371-020-02028-8

    Article  Google Scholar 

  • He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 770–778

  • Iqbal M, Al-Sahaf H, Xue B, Zhang M (2019) Genetic programming with transfer learning for texture image classification. Soft Comput 23(23):12859–12871

    Article  Google Scholar 

  • Jolliffe IT, Cadima J (2016) Principal component analysis: a review and recent developments. Philos Trans R Soc A 374(2065):20150202

    Article  MathSciNet  Google Scholar 

  • Ke Y, Sukthankar R (2004) tpca-sift: a more distinctive representation for local image descriptors. Proc IEEE Comput Soc Conf Comput Vis Pattern Recognit 2:2

    Google Scholar 

  • Lazebnik S, Schmid C, Ponce J (2005) A sparse texture representation using local affine region. IEEE Trans Pattern Anal Mach Intell 27:1265–78

    Article  Google Scholar 

  • Lensen A, Al-Sahaf H, Zhang M, Xue B (2016) Genetic programming for region detection, feature extraction, feature construction and classification in image data. European conference on genetic programming. Springer, Berlin, pp 51–67

    Chapter  Google Scholar 

  • Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110

    Article  Google Scholar 

  • Lubner MG, Smith AD, Sandrasegaran K, Sahani DV, Pickhardt PJ (2017) Ct texture analysis: definitions, applications, biologic correlates, and challenges. Radiographics 37(5):1483–1503

    Article  Google Scholar 

  • Mahmood DY, Hussein MA (2013) Intrusion detection system based on k-star classifier and feature set reduction. Int Organ Sci Res J Comput Eng 15:107–112

    Google Scholar 

  • Mallikarjuna P, Targhi A, Fritz M, Hayman E, Caputo B, Eklundh JO (2006) The KTH-TIPS database. Computational Vision and Active Perception Laboratory, Stockholm, Sweden, 1–10, 2006. Available at www.nada.kth.se/cvap/databases/kth-tips

  • Merabet YE, Ruichek Y, Idrissi AE (2019) Attractive-and-repulsive center-symmetric local binary patterns for texture classification. Eng Appl Artif Intell 78:158–172

    Article  Google Scholar 

  • Montana DJ (1995) Strongly typed genetic programming. Evol Comput 3(2):199–230

    Article  Google Scholar 

  • Ojala T, Maenpaa T, Pietikainen M, Viertola J, Kyllonen J, Huovinen S (2002a) Outex: new framework for empirical evaluation of texture analysis algorithms. Object Recognit Support User Interact Serv Robots 1:701–706

    Article  Google Scholar 

  • Ojala T, Pietikainen M, Maenpaa T (2002b) Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell 24(7):971–987

    Article  Google Scholar 

  • Pang Y, Cao J, Wang J, Han J (2019) Jcs-net: joint classification and super-resolution network for small-scale pedestrian detection in surveillance images. IEEE Trans Inf Forensics Sec 14(12):3322–3331

    Article  Google Scholar 

  • Perez CB, Olague G (2013) Genetic programming as strategy for learning image descriptor operators. Intell Data Anal 17(4):561–583

    Article  Google Scholar 

  • Ramkumar ANK, Venkatraman V, Kadry S (2017) Classification of focal and non focal eeg using entropies. Pattern Recognit Lett 94:112–117

    Article  Google Scholar 

  • Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556

  • Soule T, Foster JA et al (1997) Code size and depth lows in genetic programming. In: Koza JR, Deb K, Dorigo M, Fogel DB, Garzon M, Iba H, Riolo RL (eds) Genetic programming 1997: proceedings of the second annual conference, pp 313–320

  • Suykens JA, Vandewalle J (1999) Least squares support vector machine classifiers. Neural Process Lett 9(3):293–300

    Article  Google Scholar 

  • Van Den Bos A (1994) Complex gradient and hessian. IEE Proc Vis Image Signal Process 141(6):380–382

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Université de Tunis El Manar, Institut Supérieur d’Informatique, Research Team on Intelligent Systems in Imaging and Artificial Vision (SIIVA), LR16ES06 Laboratoire de recherche en Informatique, Modélisation et Traitement de l’Information et de la Connaissance (LIMTIC), 2 Rue Abou Rayhane Bayrouni, 2080, Ariana, Tunisia

    Mohamed Hazgui, Haythem Ghazouani & Walid Barhoumi

  2. Université de Carthage, Ecole Nationale d’Ingénieurs de Carthage, 45 Rue des Entrepreneurs, 2035, Tunis-Carthage, Tunisia

    Haythem Ghazouani & Walid Barhoumi

Authors
  1. Mohamed Hazgui
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Haythem Ghazouani
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Walid Barhoumi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Walid Barhoumi.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and Permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hazgui, M., Ghazouani, H. & Barhoumi, W. Evolutionary-based generation of rotation and scale invariant texture descriptors from SIFT keypoints. Evolving Systems 12, 591–603 (2021). https://doi.org/10.1007/s12530-021-09386-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12530-021-09386-1

Keywords

search

Navigation