Multimedia Tools and Applications

, Volume 60, Issue 2, pp 443–453 | Cite as

Compressed domain content based retrieval using H.264 DC-pictures

  • Mahdi Mehrabi
  • Farzad Zargari
  • Mohammad Ghanbari


A fast and simple method for content based retrieval using the DC-pictures of H.264 coded video without full decompression is presented. Compressed domain retrieval is very desirable for content analysis and retrieval of compressed image and video. Even though, DC-pictures are among the most widely used compressed domain indexing and retrieval methods in pre H.264 coded videos, they are not generally used in the H.264 coded video. This is due to two main facts, first, the I-frame in the H.264 standard are spatially predicatively coded and second, the H.264 standard employs Integer Discrete Cosine Transform. In this paper we have applied color histogram indexing method on the DC-pictures derived from H.264 coded I-frames. Since the method is based on independent I-frame coded pictures, it can be used either for video analysis of H.264 coded videos, or image retrieval of the I-frame based coded images such as advanced image coding. The retrieval performance of the proposed algorithm is compared with that the fully decoded images. Simulation results indicate that the performance of the proposed method is very close to the fully decompressed image systems. Moreover the proposed method has much lower computational load.


Compressed domain image indexing and retrieval DC-picture H.264 video coding standard Color histogram 


  1. 1.
    Divakaran A, Vetro A, Asai K, Nishikawa H (2000) Video browsing system based on compressed domain feature extraction. IEEE Trans Consum Electron 46(3):637–644CrossRefGoogle Scholar
  2. 2.
    Feng Y, Fang H, Jiang J (2005) Region growing with automatic seeding for semantic video object segmentation. Lect Notes Comput Sci 3687:542–549CrossRefGoogle Scholar
  3. 3.
    Jiang J, Armstrong A, Feng GC (2002) Direct content access and extraction from JPEG compressed images. Pattern Recognit 35:2511–2519zbMATHCrossRefGoogle Scholar
  4. 4.
    Jiang J, Feng G (2002) The spatial relationship of DCT coefficients between a block and its sub-blocks. IEEE Trans Signal Process 50(5):1160–1169MathSciNetCrossRefGoogle Scholar
  5. 5.
    Jiang J, Weng Y, Jie P, Li C (2006) Dominant colour extraction in DCT domain. Image Vis Comput 24:1269–1277CrossRefGoogle Scholar
  6. 6.
    Joyce RA, Liu B (2000) Temporal segmentation of video using frame and histogram space. Image Processing, Proceedings. 2000 International Conference on, vol. 3, pp. 941–944Google Scholar
  7. 7.
    Kobla V, Doermann D, Lin K-I (1996) Archiving, indexing, and retrieval of video in the compressed domain. In: Proc. SPIE Conf. on Multimedia Storage and Archiving Systems, SPIE 2916:78–89Google Scholar
  8. 8.
    Lee SM, Xin JH, Westland S (2005) Evaluation of image similarity by histogram intersection. Color Res Appl 30(4):265–274CrossRefGoogle Scholar
  9. 9.
    Li X, Zhang M, Zhu Y, Xin J (2009) A novel RS-based key frame representation for video mining in compressed-domain, second international workshop on knowledge discovery and data mining. IEEE Computer Society, pp. 199–201Google Scholar
  10. 10.
    Malvar HS, Hallapuro A, Karczewicz M, Kerofsky L (2003) Low-complexity transform and quantization in H.264/AVC. IEEE Trans Circuits Syst Video Technol 13(7):598–603Google Scholar
  11. 11.
    Manning CD, Raghavan P, Schütze H (2008) Introduction to information retrieval” Cambridge University PressGoogle Scholar
  12. 12.
    Qian X, Liu L, Su R (2006) Effective fades and flashlight detection based on accumulating histogram difference. IEEE Trans Circuits Syst Video Technol 16(10):1245–1258CrossRefGoogle Scholar
  13. 13.
    Seo K-D, Park S, Jung S-H (2009) Wipe scene-change detector based on visual rhythm spectrum. IEEE Trans Consum Electron 55(2):831–838CrossRefGoogle Scholar
  14. 14.
    Shu-long Z, Zhi-sheng Y, Shi-yong L, Xin Z (2007) “An improved video compression algorithm for lane surveillance”, Fourth International Conference on Image and Graphics(ICIG), pp. 224–229Google Scholar
  15. 15.
    Swain M, Ballard D (1997) Color indexing. Int J Comput Vis 7:11–32CrossRefGoogle Scholar
  16. 16.
    Tavanapong W, Zhou J (2004) Shot clustering techniques for story browsing IEEE Trans Multimedia 6(4):517–527Google Scholar
  17. 17.
    Wang H, Divakaran A, Vetro A, Chang S-F, Sunb H (2003) Survey of compressed-domain features used in audio-visual indexing and analysis. J Vis Commun Image Represent 14:150–183CrossRefGoogle Scholar
  18. 18.
    Zhang Z, Veerla R, Rao KR (2008) Modified advanced image coding. In: Proc. international conference on complexity and intelligence of the artificial and natural complex systems, medical applications of the complex systems, biomedical computing, pp. 110–116Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2010

Authors and Affiliations

  • Mahdi Mehrabi
    • 1
  • Farzad Zargari
    • 2
  • Mohammad Ghanbari
    • 3
  1. 1.Department of Computer Engineering, Science and Research BranchIslamic Azad UniversityTehranIran
  2. 2.Information Technology Research Institute of Iran Telecom Research Center (ITRC)TehranIran
  3. 3.School of Computer Science and Electronic EngineeringUniversity of EssexColchesterUK

Personalised recommendations