Skip to main content
SpringerLink
Log in

Multi-objective whale optimization algorithm for content-based image retrieval

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In the recent years, there are massive digital images collections in many fields of our life, which led the technology to find methods to search and retrieve these images efficiently. The content-based is one of the popular methods used to retrieve images, which depends on the color, texture and shape descriptors to extract features from images. However, the performance of the content-based image retrieval methods depends on the size of features that are extracted from images and the classification accuracy. Therefore, this problem is considered as a multi-objective and there are several methods that used to manipulate it such as NSGA-II and NSMOPSO. However, these methods have drawbacks such as their time and space complexity are large since they used traditional non-dominated sorting methods. In this paper, a new non-dominated sorting based on multi-objective whale optimization algorithm is proposed for content-based image retrieval (NSMOWOA). The proposed method avoids the drawbacks in other non-dominated sorting multi-objective methods that have been used for content-based image retrieval through reducing the space and time complexity. The results of the NSMOWOA showed a good performance in content-based image retrieval problem in terms of recall and precision.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Abd El Aziz M, Hassanien A E (2017) An improved social spider optimization algorithm based on rough sets for solving minimum number attribute reduction problem. Neural Comput Appl 1–12. https://doi.org/10.1007/s00521-016-2473-7

  2. Abd El Aziz M, Hassanien AE (2018) Modified cuckoo search algorithm with rough sets for feature selection. Neural Comput Appl 29(4):925–934

    Article  Google Scholar 

  3. Abd El Aziz M, Khidr W (2015) Nonnegative matrix factorization based on projected hybrid conjugate gradient algorithm. Signal Image Video Process 9(8):1825–1831

    Article  Google Scholar 

  4. Abd Elaziz ME, Ewees AA, Oliva D, Duan P, Xiong S (2017) A hybrid method of sine cosine algorithm and differential evolution for feature selection. In: Neural information processing: 24th international conference. Springer, pp 145–155

  5. Agarwal S, Verma AK, Singh P (2013) Content based image retrieval using discrete wavelet transform and edge histogram descriptor. In: 2013 international conference on information systems and computer networks (ISCON). IEEE, pp 19–23

  6. Arevalillo-Herráez M, Domingo J, Ferri FJ (2008) Combining similarity measures in content-based image retrieval. Pattern Recogn Lett 29(16):2174–2181

    Article  Google Scholar 

  7. Arevalillo-Herráez M, Ferri FJ, Moreno-Picot S (2013) A hybrid multi-objective optimization algorithm for content based image retrieval. Appl Soft Comput 13(11):4358–4369

    Article  Google Scholar 

  8. Ayala G, Domingo J (2001) Spatial size distributions: applications to shape and texture analysis. IEEE Trans Pattern Anal Mach Intell 23(12):1430–1442

    Article  Google Scholar 

  9. Bache K, Lichman M (2013) UCI machine learning repository. University of California, Irvine, School of Information and Computer Sciences. http://archive.ics.uci.edu/ml. Accessed 3 Feb 2017

  10. Balasubbareddy M, Sivanagaraju S, Suresh CV (2015) Multi-objective optimization in the presence of practical constraints using non-dominated sorting hybrid cuckoo search algorithm. Eng Sci Technol Int J 18(4):603–615

    Article  Google Scholar 

  11. Chellappa R, Chatterjee S (1985) Classification of textures using gaussian markov random fields. IEEE Trans Acoust Speech Signal Process 33(4):959–963

    Article  MathSciNet  Google Scholar 

  12. Chen Y, Dougherty ER (1994) Gray-scale morphological granulometric texture classification. Opt Eng 33(8):2713–2722

    Article  Google Scholar 

  13. Chen X, Du W, Qian F (2014) Multi-objective differential evolution with ranking-based mutation operator and its application in chemical process optimization. Chemom Intell Lab Syst 136:85–96

    Article  Google Scholar 

  14. Cherukuri SK, Rayapudi SR (2016) A novel global mpp tracking of photovoltaic system based on whale optimization algorithm. Int J Renew Energy Dev 5(3):225–232

    Article  Google Scholar 

  15. Chun YD, Kim NC, Jang IH (2008) Content-based image retrieval using multiresolution color and texture features. IEEE Trans Multimed 10(6):1073–1084

    Article  Google Scholar 

  16. Coello Coello CA, Pulido GT, Lechuga MS (2004) Handling multiple objectives with particle swarm optimization. IEEE Trans Evol Comput 8(3):256–279

    Article  Google Scholar 

  17. Conners RW, Trivedi MM, Harlow CA (1984) Segmentation of a high-resolution urban scene using texture operators. Comput Vis Graph Image Process 25(3):273–310

    Article  Google Scholar 

  18. Das S, Garg S, Sahoo G (2012) Comparison of content based image retrieval systems using wavelet and curvelet transform. Int J Multimed Appl 4(4):137

    Google Scholar 

  19. de Ves E, Benavent X, Ayala G, Domingo J (2006) Selecting the structuring element for morphological texture classification. Pattern Anal Appl 9(1):48–57

    Article  MathSciNet  Google Scholar 

  20. Deb K, Agrawal S, Pratap A, Meyarivan T (2000) A fast elitist non-dominated sorting genetic algorithm for multi-objective optimization: Nsga-ii. In: International conference on parallel problem solving from nature. Springer, pp 849–858

  21. Eisa MM, Ewees AA, Refaat MM, Elgamal AF (2013) Effective medical image retrieval technique based on texture features. Int J Intell Comput Inf Sci 13(2):19–33

    Google Scholar 

  22. El Aziz MA, Ewees AA, Hassanien AE (2017) Whale optimization algorithm and moth-flame optimization for multilevel thresholding image segmentation. Expert Syst Appl 83:242–256

    Article  Google Scholar 

  23. El-Sayed Waheed M, Abdo Mohamed O, Abd El-Aziz ME (2011) Mixture of generalized gamma density-based score function for fastica. Math Probl Eng 2011:1–14. https://doi.org/10.1155/2011/150294

    MathSciNet  MATH  Google Scholar 

  24. Esmel ElAlami M (2011) A novel image retrieval model based on the most relevant features. Knowl-Based Syst 24(1):23–32

    Article  Google Scholar 

  25. Ewees AA, Abd El Aziz M, Hassanien AE (2017) Chaotic multi-verse optimizer-based feature selection. Neural Comput Appl 1–16. https://doi.org/10.1007/s00521-017-3131-4

  26. Fadaei S, Amirfattahi R, Ahmadzadeh MR (2017) Local derivative radial patterns: a new texture descriptor for content-based image retrieval. Signal Process 137:274–286

    Article  Google Scholar 

  27. Fei-Fei L, Fergus R, Perona P (2007) Learning generative visual models from few training examples: an incremental bayesian approach tested on 101 object categories. Comput Vis Image Underst 106(1): 59–70

    Article  Google Scholar 

  28. Fuad MMM (2015) Applying non-dominated sorting genetic algorithm ii to multi-objective optimization of a weighted multi-metric distance for performing data mining tasks. In: European conference on the applications of evolutionary computation. Springer, pp 579–589

  29. Gahroudi MR, Sarshar MR (2007) Image retrieval based on texture and color method in btc-vq compressed domain. In: 9th international symposium on signal processing and its applications. ISSPA 2007. IEEE, pp 1–4

  30. Girshick R, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 580–587

  31. Gong Y, Wang L, Guo R, Lazebnik S (2014) Multi-scale orderless pooling of deep convolutional activation features. In: European conference on computer vision. Springer, pp 392–407

  32. Grigorova A, De Natale FGB, Dagli C, Huang TS (2007) Content-based image retrieval by feature adaptation and relevance feedback. IEEE Trans Multimed 9(6):1183–1192

    Article  Google Scholar 

  33. Guo J-M, Prasetyo H, Wang N-J (2015) Effective image retrieval system using dot-diffused block truncation coding features. IEEE Trans Multimed 17(9):1576–1590

    Article  Google Scholar 

  34. Hancer E, Xue B, Zhang M, Karaboga D, Akay B (2015) A multi-objective artificial bee colony approach to feature selection using fuzzy mutual information. In: 2015 IEEE congress on evolutionary computation (CEC). IEEE, pp 2420–2427

  35. Jalab HA (2011) Image retrieval system based on color layout descriptor and gabor filters. In: 2011 IEEE conference on open systems (ICOS). IEEE, pp 32–36

  36. Jiji GW, DuraiRaj PJ (2015) Content-based image retrieval techniques for the analysis of dermatological lesions using particle swarm optimization technique. Appl Soft Comput 30:650–662

    Article  Google Scholar 

  37. Jin C, Jin S-W (2015) Automatic image annotation using feature selection based on improving quantum particle swarm optimization. Signal Process 109:172–181

    Article  Google Scholar 

  38. Karegowda AG, Bharathi PT (2016) Enhancing cbir performance using evolutionary algorithm-assisted significant feature selection: a filter approach. Int J Appl Res Inf Technol Comput 7(1):53–59

    Article  Google Scholar 

  39. Kaveh A, Ghazaan MI (2017) Enhanced whale optimization algorithm for sizing optimization of skeletal structures. Mech Based Des Struct Mach 45(3):345–362

    Article  Google Scholar 

  40. Keerthi Vasan K, Surendiran B (2016) Dimensionality reduction using principal component analysis for network intrusion detection. Perspect Sci 8:510–512

    Article  Google Scholar 

  41. Khan A, Baig AR (2015) Multi-objective feature subset selection using non-dominated sorting genetic algorithm. J Appl Res Technol 13(1):145–159

    Article  Google Scholar 

  42. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems, pp 1097–1105

  43. Kundu PP, Mitra Su (2015) Multi-objective optimization of shared nearest neighbor similarity for feature selection. Appl Soft Comput 37:751–762

    Article  Google Scholar 

  44. Lai CC, Chen Y-C (2011) A user-oriented image retrieval system based on interactive genetic algorithm. IEEE Trans Instrum Meas 60(10):3318–3325

    Article  Google Scholar 

  45. Li X (2003) A non-dominated sorting particle swarm optimizer for multiobjective optimization. In: Genetic and evolutionary computation conference. Springer, pp 37–48

  46. Li Y, Kong X, Zheng L, Tian Q (2016) Exploiting hierarchical activations of neural network for image retrieval. In: Proceedings of the 2016 ACM on multimedia conference. ACM, pp 132–136

  47. Liu G-H, Yang J-Y, Li ZY (2015) Content-based image retrieval using computational visual attention model. Pattern Recogn 48(8):2554–2566

    Article  Google Scholar 

  48. Mirjalili S, Lewis A (2016) The whale optimization algorithm. Adv Eng Softw 95:51–67

    Article  Google Scholar 

  49. Moreno-Picot S, Ferri FJ, Arevalillo-Herráez M (2013) A nsga based approach for content based image retrieval. In: Iberoamerican congress on pattern recognition. Springer, pp 359–366

  50. Müller H, Michoux N, Bandon D, Geissbuhler A (2004) A review of content-based image retrieval systems in medical applications—clinical benefits and future directions. Int J Med Inform 73(1):1–23

    Article  Google Scholar 

  51. Pachori RB, Tiwari AK, Kanhangad V (2017) Histogram refinement for texture descriptor based image retrieval. Signal Process Image Commun 53:73–85

    Article  Google Scholar 

  52. Qiu G (2003) Color image indexing using btc. IEEE Trans Image Process 12(1):93–101

    Article  MathSciNet  Google Scholar 

  53. Rashedi E, Nezamabadi-Pour H, Saryazdi S (2013) A simultaneous feature adaptation and feature selection method for content-based image retrieval systems. Knowl-Based Syst 39:85–94

    Article  Google Scholar 

  54. Ren S, He K, Girshick R, Sun J (2015) Faster r-cnn: towards real-time object detection with region proposal networks. In: Advances in neural information processing systems, pp 91–99

  55. Roy K, Mukherjee J (2013) Image similarity measure using color histogram, color coherence vector, and sobel method. Int J Sci Res (IJSR) 2(1):538–543

    Google Scholar 

  56. Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, Karpathy A, Khosla A, Bernstein M et al (2015) Imagenet large scale visual recognition challenge. Int J Comput Vis 115(3):211–252

    Article  MathSciNet  Google Scholar 

  57. Saadatmand TM, Moghaddam HA (2007) A novel evolutionary approach for optimizing content based image retrieval. IEEE Trans Syst Man Cybern 37(1):139–153

    Article  Google Scholar 

  58. Sidhu S, Saxena J (2015) Content based image retrieval a review. Int J Res Comput Appl Robot 3(5):84–88

    Google Scholar 

  59. Singh B, Ahmad W (2014) Content based image retrieval: a review paper. Int J Comput Sci Mob Comput 3(5):769–775

    Google Scholar 

  60. Sivakumar S, Chandrasekar C (2014) Feature selection using abc forthe lung ct scan images. Int J Sci Eng Technol 3(6):781–784

    Google Scholar 

  61. Smith G, Burns I (1997) Measuring texture classification algorithms. Pattern Recogn Lett 18(14):1495–1501

    Article  MATH  Google Scholar 

  62. Soille P (2013) Morphological image analysis: principles and applications. Springer Science & Business Media

  63. Soyel H, Tekguc U, Demirel H (2011) Application of nsga-ii to feature selection for facial expression recognition. Comput Electr Eng 37(6):1232–1240

    Article  Google Scholar 

  64. Talib A, Mahmuddin M, Husni H, George L E (2013) Efficient, compact, and dominant color correlogram descriptors for content-based image retrieval. In: Proceedings of the fifth international conferences on advances in multimedia. Venice, Italy, pp 52–61

  65. Tan CJ, Lim CP, Cheah Y-N (2014) A multi-objective evolutionary algorithm-based ensemble optimizer for feature selection and classification with neural network models. Neurocomputing 125:217–228

    Article  Google Scholar 

  66. Tan M, Pu J, Zheng B (2014) Optimization of breast mass classification using sequential forward floating selection (sffs) and a support vector machine (svm) model. Int J Comput Assist Radiol Surg 9(6):1005–1020

    Article  Google Scholar 

  67. Tiakas E, Rafailidis D, Dimou A, Daras P (2013) Msidx: multi-sort indexing for efficient content-based image search and retrieval. IEEE Trans Multimed 15(6):1415–1430

    Article  Google Scholar 

  68. Tolias G, Sicre R, Jégou H (2016) Particular object retrieval with integral max-pooling of cnn activations. In: Proceedings of international conference on learning representations

  69. Tsai C-W, Huang Y-T, Chiang M-C (2014) A non-dominated sorting firefly algorithm for multi-objective optimization. In: 2014 14th international conference on intelligent systems design and applications. IEEE, pp 62–67

  70. Wan J, Wang D, Hoi SCH, Wu P, Zhu J, Zhang Y, Li J (2014) Deep learning for content-based image retrieval: a comprehensive study. In: Proceedings of the 22nd ACM international conference on multimedia. ACM, pp 157–166

  71. Weiyan L, Wenyan W (2012) The research on video retrieval based on content for industrial applications. IERI Procedia 3:148–155

    Article  Google Scholar 

  72. Wu F, Jing X-Y, You X, Yue D, Hu R, Yang J-Y (2016) Multi-view low-rank dictionary learning for image classification. Pattern Recogn 50:143–154

    Article  Google Scholar 

  73. Xia H, Zhuang J, Yu D (2014) Multi-objective unsupervised feature selection algorithm utilizing redundancy measure and negative epsilon-dominance for fault diagnosis. Neurocomputing 146:113–124

    Article  Google Scholar 

  74. Xue B, Zhang M, Browne WN (2013) Particle swarm optimization for feature selection in classification: a multi-objective approach. IEEE Trans Cybern 43(6):1656–1671

    Article  Google Scholar 

  75. Yan K, Wang Y, Liang D, Huang T, Tian Y (2016) Cnn vs. sift for image retrieval: alternative or complementary? In: Proceedings of the 2016 ACM on multimedia conference. ACM, pp 407–411

  76. You X, Du L, Cheung Y-M, Chen Q (2010) A blind watermarking scheme using new nontensor product wavelet filter banks. IEEE Trans Image Process 19(12):3271–3284

    Article  MathSciNet  MATH  Google Scholar 

  77. Yu K, Zhang T (2010) Improved local coordinate coding using local tangents. In: Proceedings of the 27th international conference on machine learning (ICML-10), pp 1215–1222

  78. Yu F-X, Luo Hao, Lu Z-M (2011) Colour image retrieval using pattern co-occurrence matrices based on btc and vq. Electron Lett 47(2):100–101

    Article  Google Scholar 

  79. Zarchi MS, Monadjemi A, Jamshidi K (2014) A semantic model for general purpose content-based image retrieval systems. Comput Electr Eng 40(7):2062–2071

    Article  Google Scholar 

  80. Zhang Q, Li H (2007) Moea/d: a multiobjective evolutionary algorithm based on decomposition. IEEE Trans Evol Comput 11(6):712–731

    Article  Google Scholar 

  81. Zhang T, Yang B (2016) Big data dimension reduction using pca. In: IEEE international conference on smart cloud (SmartCloud). IEEE, pp 152–157

  82. Zhang X, Tian Y, Cheng R, Jin Y (2015) An efficient approach to nondominated sorting for evolutionary multiobjective optimization. IEEE Trans Evol Comput 19(2):201–213

    Article  Google Scholar 

  83. Zhao L, Hu Q, Wang W (2015) Heterogeneous feature selection with multi-modal deep neural networks and sparse group lasso. IEEE Trans Multimed 17(11):1936–1948

    Article  Google Scholar 

  84. Zheng X, Wang L, Wang S (2014) An enhanced non-dominated sorting based fruit fly optimization algorithm for solving environmental economic dispatch problem. In: 2014 IEEE congress on evolutionary computation (CEC). IEEE, pp 626–633

  85. Zitzler E, Thiele L (1999) Multiobjective evolutionary algorithms: a comparative case study and the strength pareto approach. IEEE Trans Evol Comput 3(4):257–271

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Mathematics, Faculty of Science, Zagazig University, Zagazig, Egypt

    Mohamed Abd El Aziz

  2. Department of Computer, Damietta University, Damietta, Egypt

    Ahmed A. Ewees

  3. University of Bisha, Bisha, Saudi Arabia

    Ahmed A. Ewees

  4. Faculty of Computers and Information, Cairo University, Cairo, Egypt

    Aboul Ella Hassanien

Authors
  1. Mohamed Abd El Aziz
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ahmed A. Ewees
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Aboul Ella Hassanien
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ahmed A. Ewees.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Aziz, M.A.E., Ewees, A.A. & Hassanien, A.E. Multi-objective whale optimization algorithm for content-based image retrieval. Multimed Tools Appl 77, 26135–26172 (2018). https://doi.org/10.1007/s11042-018-5840-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-018-5840-9

Keywords

Search

Navigation