Skip to main content
SpringerLink
Log in

An Optimal Codebook for Content-Based Image Retrieval in JPEG Compressed Domain

  • Research Article - Computer Engineering and Computer Science
  • Published:
Arabian Journal for Science and Engineering Aims and scope Submit manuscript

Abstract

Images in JPEG compressed domain have a widespread use and computationally efficient retrieval of those images is of prime concern. In this paper, a content-based image retrieval system in JPEG compressed domain is presented, which generates an optimal codebook and extract features that only require partial decoding of images. The codebook is generated by selecting an optimum number of training images and feature vector length using an optimization cost based on precision and recall. The cost gives the difference in average precision and average recall, which the retrieval system can tolerate, while reducing the codebook size and feature vector length. The efficiency in retrieval performance is achieved by generating an optimal codebook. Experimental results have shown better performance for the proposed retrieval system in terms of precision, recall and number of operations, when compared with state-of-the-art image retrieval systems in JPEG compressed domain. The proposed retrieval system also shows robustness against compressed query images by using different quantization parameters.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Huu, Q.N.; Thuy, Q.D.T.; Van Phuong, C.; Van, C.N.; Quoc, T.N.: An efficient image retrieval method using adaptive weights. Appl. Intell. 48(10), 1–20 (2018)

    Article  Google Scholar 

  2. Liaqat, M.; Khan, S.; Majid, M.: Fuzzy ontology based model for image retrieval. In: International Conference on Mobile Web and Information Systems, vol. 9847, pp. 108–120. Springer (2016)

  3. Liaqat, M.; Khan, S.; Majid, M.: Image retrieval based on fuzzy ontology. Multimed. Tools Appl. 76(21), 22623–22645 (2017)

    Article  Google Scholar 

  4. Liaqat, M.; Khan, S.; Younis, M.S.; Majid, M.; Rajpoot, K.: Applying uncertain frequent pattern mining to improve ranking of retrieved images, Appl. Intell. 1–20 (Feb, 2019). https://doi.org/10.1007/s10489-019-01412-9

  5. Prasanthi, B.; Pabboju, S.; Vasumathi, D.: A novel indexing and image annotation structure for efficient image retrieval. Arab. J. Sci. Eng. 43(8), 4203–4213 (2018)

    Article  Google Scholar 

  6. Long, F.; Zhang, H.; Feng, D.D.: Fundamentals of content-based image retrieval. In: Multimedia Information Retrieval and Management, pp. 1–26. Springer (2003)

  7. Rafiee, G.; Dlay, S.S.; Woo, W.L.: A review of content-based image retrieval. In: 2010 7th International Symposium on Communication Systems, Networks and Digital Signal Processing (CSNDSP 2010), IEEE, pp. 775–779 (2010)

  8. Norouzi, M.; Akbarizadeh, G.; Eftekhar, F.: A hybrid feature extraction method for SAR image registration. Signal Image Video P. 12(8), 1559–1566 (2018)

    Article  Google Scholar 

  9. Farbod, M.; Akbarizadeh, G.; Kosarian, A.; Rangzan, K.: Optimized fuzzy cellular automata for synthetic aperture radar image edge detection. J. Electron. Imaging 27(1), 013030 (2018)

    Article  Google Scholar 

  10. Akbarizadeh, G.: A new statistical-based kurtosis wavelet energy feature for texture recognition of SAR images. IEEE T. Geosci. Remote 50(11), 4358–4368 (2012)

    Article  Google Scholar 

  11. Akbarizadeh, G.; Moghaddam, A.E.: Detection of lung nodules in CT scans based on unsupervised feature learning and fuzzy inference. J. Med. Imag Health Inform. 6(2), 477–483 (2016)

    Article  Google Scholar 

  12. Nizami, I.F.; Majid, M.; Manzoor, W.; Khurshid, K.; Jeon, B.: Distortion-specific feature selection algorithm for universal blind image quality assessment. EURASIP J. Image Vide. 2019(1), 19 (2019)

    Article  Google Scholar 

  13. Sharifzadeh, F.; Akbarizadeh, G.; Kavian, Y.S.: Ship classification in SAR images using a new hybrid CNN–MLP classifier, J. Indian Soc. Remote 1–12 (Oct, 2018). https://doi.org/10.1007/s12524-018-0891-y

  14. Modava, M.; Akbarizadeh, G.; Soroosh, M.: Integration of spectral histogram and level set for coastline detection in SAR images, IEEE Ttans. Aero. Electron. Syst. 1–1 (Aug, 2018). https://doi.org/10.1109/TAES.2018.2865120

  15. Akbarizadeh, G.; Rangzan, K.; Kabolizadeh, M.; et al.: Effective supervised multiple-feature learning for fused radar and optical data classification. IET Radar Sonar Nav. 11(5), 768–777 (2016)

    Google Scholar 

  16. Raeisi, A.; Akbarizadeh, G.; Mahmoudi, A.: Combined method of an efficient cuckoo search algorithm and nonnegative matrix factorization of different zernike moment features for discrimination between oil spills and lookalikes in SAR images. IEEE J. Sel. Top. Appl. 11(11), 1–13 (2018)

    Google Scholar 

  17. Qayyum, A.; Anwar, S.M.; Awais, M.; Majid, M.: Medical image retrieval using deep convolutional neural network. Neurocomputing 266, 8–20 (2017)

    Article  Google Scholar 

  18. Schaefer, G.: Pixel domain and compressed domain image retrieval features. In: Digital Information Management (ICDIM), 2013 Eighth International Conference on, IEEE, pp. 1–3 (2013)

  19. Chen, X.; Yan, X.; Chu, X.: Research on image content retrieval with color features. In: Computational Intelligence and Natural Computing Proceedings (CINC), 2010 Second International Conference on, vol. 2, IEEE, pp. 141–144 (2010)

  20. Singha, M.; Hemachandran, K.: Content based image retrieval using color and texture. Signal Image Process. 3(1), 39 (2012)

    Google Scholar 

  21. Wang, X.-Y.; Yu, Y.-J.; Yang, H.-Y.: An effective image retrieval scheme using color, texture and shape features. Comput. Stand. Interfaces 33(1), 59–68 (2011)

    Article  Google Scholar 

  22. Tian, X.; Jiao, L.; Liu, X.; Zhang, X.: Feature integration of EODH and Color-SIFT: application to image retrieval based on codebook. Signal Process. Image Commun. 29(4), 530–545 (2014)

    Article  Google Scholar 

  23. Mehrabi, M.; Zargari, F.; Ghanbari, M.; Shayegan, M.A.: Fast content access and retrieval of JPEG compressed images. Signal Process. Image Commun. 46, 54–59 (2016)

    Article  Google Scholar 

  24. Mandal, M.K.; Idris, F.; Panchanathan, S.: A critical evaluation of image and video indexing techniques in the compressed domain. Image Vision Comput. 17(7), 513–529 (1999)

    Article  Google Scholar 

  25. Anwar, S.M.; Arshad, F.; Majid, M.: Fast wavelet based image characterization for content based medical image retrieval. In: 2017 International Conference on Communication, Computing and Digital Systems (C-CODE), IEEE, pp. 351–356 (2017)

  26. Schaefer, G.: Content-based retrieval of compressed images. In: DATESO, Citeseer, pp. 175–185 (2010)

  27. Climer, S.; Bhatia, S.K.: Image database indexing using JPEG coefficients. Pattern Recogn. 35(11), 2479–2488 (2002)

    Article  MATH  Google Scholar 

  28. Idris, F.; Panchanathan, S.: Image and video indexing using vector quantization. Mach. Vision Appl. 10(2), 43–50 (1997)

    Article  Google Scholar 

  29. Schaefer, G.; Lieutaud, S.: CVPIC compressed domain image retrieval by colour and shape. In: International Conference on Image Analysis and Recognition, pp. 778–786. Springer (2004)

  30. Wallace, G.K.: The JPEG still picture compression standard. IEEE Trans. Consum. Electron. 38(1), 18–34 (1992)

    Article  Google Scholar 

  31. Edmundson, D.; Schaefer, G.: An overview and evaluation of JPEG compressed domain retrieval techniques. In: ELMAR, 2012 Proceedings, IEEE, pp. 75–78 (2012)

  32. Shneier, M.; Abdel-Mottaleb, M.: Exploiting the JPEG compression scheme for image retrieval. IEEE Trans. Pattern Anal. 18(8), 849–853 (1996)

    Article  Google Scholar 

  33. Schaefer, G.: JPEG image retrieval by simple operators. In: Second International Workshop on Content Based Multimedia and Indexing, pp. 207–214. Citeseer (2001)

  34. Ngo, C.-W.; Pong, T.-C.; Chin, R.T.: Exploiting image indexing techniques in DCT domain. Pattern Recogn. 34(9), 1841–1851 (2001)

    Article  MATH  Google Scholar 

  35. Feng, G.; Jiang, J.: JPEG compressed image retrieval via statistical features. Pattern Recogn. 36(4), 977–985 (2003)

    Article  Google Scholar 

  36. Suresh, P.; Sundaram, R.; Arumugam, A.: Feature extraction in compressed domain for content based image retrieval. In: Advanced Computer Theory and Engineering, 2008. ICACTE’08. International Conference on, IEEE, pp. 190–194 (2008)

  37. Chang, C.-C.; Chuang, J.-C.; Hu, Y.-S.: Retrieving digital images from a JPEG compressed image database. Image Vision Comput. 22(6), 471–484 (2004)

    Article  Google Scholar 

  38. Jiang, J.; Weng, Y.; Li, P.: Dominant colour extraction in DCT domain. Image Vision Comput. 24(12), 1269–1277 (2006)

    Article  Google Scholar 

  39. Lu, Z.-M.; Li, S.-Z.; Burkhardt, H.: A content-based image retrieval scheme in JPEG compressed domain. Int. J. Innov. Comput. Inf. Control 2(4), 831–839 (2006)

    Google Scholar 

  40. Phadikar, B.S.; Phadikar, A.; Maity, G.K.: Content-based image retrieval in DCT compressed domain with MPEG-7 edge descriptor and genetic algorithm. Pattern Anal. Appl. 21(2), 1–21 (2016)

    MathSciNet  Google Scholar 

  41. Schaefer, G.; Edmundson, D.: DC stream based JPEG compressed domain image retrieval. In: International Conference on Active Media Technology, pp. 318–327. Springer (2012)

  42. Poursistani, P.; Nezamabadi-pour, H.; Moghadam, R.A.; Saeed, M.: Image indexing and retrieval in JPEG compressed domain based on vector quantization. Math Comput. Model 57(5–6), 1005–1017 (2013)

    Article  MathSciNet  Google Scholar 

  43. Liu, P.; Guo, J.-M.; Wu, C.-Y.; Cai, D.: Fusion of deep learning and compressed domain features for content-based image retrieval. IEEE T. Image Process 26(12), 5706–5717 (2017)

    Article  MathSciNet  MATH  Google Scholar 

  44. Yamaghani, M.; Zargari, F.: Classification and retrieval of radiology images in H. 264/AVC compressed domain. Signal Image Video P. 11(3), 573–580 (2017)

    Article  Google Scholar 

  45. Pimentel Filho, C.A.F.; Bustos, B.; de Albuquerque Araújo, A.; Guimarães, S.J.F.: Combining pixel domain and compressed domain index for sketch based image retrieval. Multimed. Tools Appl. 76(21), 22019–22042 (2017)

    Article  Google Scholar 

  46. Wang, J.Z.; Li, J.; Wiederhold, G.: SIMPLIcity semantics-sensitive integrated matching for picture libraries. IEEE Trans. Pattern Anal. 23(9), 947–963 (2001)

    Article  Google Scholar 

  47. Deselaers, T.; Keysers, D.; Ney, H.: Features for image retrieval: an experimental comparison. Inform. Retrieval 11(2), 77–107 (2008)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Engineering, University of Engineering and Technology Taxila, 47050, Taxila, Pakistan

    Afshan Jamil & Muhammad Majid

  2. Department of Software Engineering, University of Engineering and Technology Taxila, 47050, Taxila, Pakistan

    Syed Muhammad Anwar

Authors
  1. Afshan Jamil
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Muhammad Majid
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Syed Muhammad Anwar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Muhammad Majid.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jamil, A., Majid, M. & Anwar, S.M. An Optimal Codebook for Content-Based Image Retrieval in JPEG Compressed Domain. Arab J Sci Eng 44, 9755–9767 (2019). https://doi.org/10.1007/s13369-019-03880-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13369-019-03880-0

Keywords

Search

Navigation