Abstract
The vast majority of images are stored in compressed JPEG format. When performing content-based image retrieval, faster feature extraction is possible when calculating them directly in the compressed domain, avoiding full decompression of the images. Algorithms that operate in this way calculate image features based on DCT coefficients and hence still require partial decoding of the image to arrive at these. In this paper, we introduce a JPEG compressed domain retrieval algorithm that is based not directly on DCT coefficients but on differences of these, which are readily available in a JPEG compression stream. In particular, we utilise solely the DC stream of JPEG files and make direct use of the fact that DC terms are differentially coded. We build histograms of these differences and utilise them as image features, thus eliminating the need to undo the differential coding as in other methods. In combination with a colour histogram, also extracted from DC data, we show our approach to give (to our knowledge) the best retrieval accuracy of a JPEG domain retrieval algorithm, outperforming other compressed domain methods and reaching a performance close to that of the best performing MPEG-7 descriptor.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Jiang, J., Armstrong, A., Feng, G.: Direct content access and extraction from JPEG compressed images. Pattern Recognition 35, 1511–2519 (2002)
Smeulders, A., Worring, M., Santini, S., Gupta, A., Jain, R.: Content-based image retrieval at the end of the early years. IEEE Trans. Pattern Analysis and Machine Intelligence 22, 1249–1380 (2000)
Datta, R., Joshi, D., Li, J., Wang, J.Z.: Image retrieval: Ideas, influences, and trends of the new age. ACM Computing Surveys 40, 1–60 (2008)
Schaefer, G.: Mining Image Databases by Content. In: Fernandes, A.A.A., Gray, A.J.G., Belhajjame, K. (eds.) BNCOD 2011. LNCS, vol. 7051, pp. 66–67. Springer, Heidelberg (2011)
Mandal, M., Idris, F., Panchanathan, S.: A critical evaluation of image and video indexing techniques in the compressed domain. Image and Vision Computing 17, 513–529 (1999)
Wallace, G.: The JPEG still picture compression standard. Communications of the ACM 34, 30–44 (1991)
Edmundson, D., Schaefer, G.: Performance comparison of JPEG compressed domain image retrieval techniques. In: IEEE Int. Conference on Signal Processing, Communications and Computing (2012)
Edmundson, D., Schaefer, G.: An overview and evaluation of JPEG compressed domain retrieval techniques. In: 54th International Symposium ELMAR (2012)
Shneier, M., Abdel-Mottaleb, M.: Exploiting the jpeg compression scheme for image retrieval. IEEE Trans. Pattern Analysis and Machine Intelligence 18, 849–853 (1996)
Lay, J.A., Guan, L.: Image retrieval based on energy histograms of the low frequency DCT coefficients. In: IEEE Int. Conference on Acoustics, Speech and Signal Processing, vol. 6, pp. 3009–3012 (1999)
Schaefer, G.: JPEG image retrieval by simple operators. In: 2nd International Workshop on Content-Based Multimedia Indexing, pp. 207–214 (2001)
Swain, M., Ballard, D.: Color indexing. Int. Journal of Computer Vision 7, 11–32 (1991)
Ojala, T., Pietikäinen, M., Harwood, D.: A comparative study for texture measures with classification based on feature distributions. Pattern Recognition 29, 51–59 (1996)
Feng, G., Jiang, J.: JPEG compressed image retrieval via statistical features. Pattern Recognition 36, 977–985 (2003)
Chang, C., Chuang, J., Hu, Y.: Retrieving digital images from a JPEG compressed image database. Image and Vision Computing 22, 471–484 (2004)
Eom, M., Choe, Y.: Fast extraction of edge histogram in DCT domain based on MPEG7. In: Int. Conference on Enformatika, Systems Sciences and Engineering (2005)
Sikora, T.: The MPEG-7 visual standard for content description - an overview. IEEE Trans. Circuits and Systems for Video Technology 11, 696–702 (2001)
Lu, Z., Li, S., Burkhardt, H.: A content-based image retrieval scheme in JPEG compressed domain. Int. Journal of Innovative Computing, Information and Control 2, 831–839 (2006)
Schaefer, G., Stich, M.: UCID - An Uncompressed Colour Image Database. In: Storage and Retrieval Methods and Applications for Multimedia 2004. Proceedings of SPIE, vol. 5307, pp. 472–480 (2004)
Huiskes, M., Lew, M.: The MIR Flickr retrieval evaluation. In: ACM Int. Conference on Multimedia Information Retrieval (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Schaefer, G., Edmundson, D. (2012). DC Stream Based JPEG Compressed Domain Image Retrieval. In: Huang, R., Ghorbani, A.A., Pasi, G., Yamaguchi, T., Yen, N.Y., Jin, B. (eds) Active Media Technology. AMT 2012. Lecture Notes in Computer Science, vol 7669. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35236-2_32
Download citation
DOI: https://doi.org/10.1007/978-3-642-35236-2_32
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-35235-5
Online ISBN: 978-3-642-35236-2
eBook Packages: Computer ScienceComputer Science (R0)