Multimedia Tools and Applications

, Volume 32, Issue 1, pp 93–113 | Cite as

Compressed domain video retrieval using object and global motion descriptors

  • R. Venkatesh Babu
  • K. R. Ramakrishnan


Video content description has become an important task with the standardization effort of MPEG-7, which aims at easy and efficient access to visual information. In this paper we propose a system to extract object-based and global features from compressed MPEG video using the motion vector information for video retrieval. The reliability of the motion information is enhanced by a motion accumulation process. The global features like motion activity and camera motion parameters are extracted from the above enhanced motion information. The object features such as speed, area and trajectory are then obtained after the proposed object segmentation. The number of objects in a given video shot is determined by the proposed K-means clustering procedure. The object segmentation is done by applying EM algorithm.


Compressed domain Content-based video retrieval Motion descriptors Object trajectory MPEG-7 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Ardizzone E, Casciai ML, Avanzato A, Bruna A (1999 June) Video indexing using MPEG motion compensation vectors. In: IEEE International Conference on Multimedia Computing and Systems, vol 2, pp. 725–729Google Scholar
  2. 2.
    Babu VR, Anantharaman B, Ramakrishnan KR, Srinivasan SH (2002 August) Compressed domain action classification using HMM. Pattern Recogn Lett 23(10):1203–1213CrossRefGoogle Scholar
  3. 3.
    Chang S, Chen W, Horace H, Sundaram H, Zhong D (1998 September) A fully automated content based video search engine supporting spatio-temporal queries. IEEE Trans Circuits Syst Video Technol 8(5):602–615CrossRefGoogle Scholar
  4. 4.
    Courtney JD (1997 April) Automatic video indexing via object motion analysis. Pattern Recogn 30(4):607–625CrossRefGoogle Scholar
  5. 5.
    Davis JW (1998 April) Recognizing movement using motion histograms. Technical Report 487, MIT Media LabGoogle Scholar
  6. 6.
    Deng Y, Mukherjee D, Manjunath BS (1998) NeTra-V: Toward an object-based video representation. In: Storage and Retrieval for Image and Video Databases (SPIE), pp 202–215Google Scholar
  7. 7.
    Dimitrova N, Golshani F (1995 October) Motion recovery for video content classification. ACM Trans Inf Sys 13(4):408–439CrossRefGoogle Scholar
  8. 8.
    Fablet R, Bouthemy P (2000) Statistical motion-based retrieval with partial query. In: Visual Information and Information Systems, pp. 96–107Google Scholar
  9. 9.
    Flickner M, Sawhney H, Niblack W, Aashley J, Huang Q, Dom B, Gorkani M, Hafner J, Lee D, Petkovic D, Steele D, Yanker P (1995 September) Query by image and video content: The QBIC system. IEEE Comput Mag 28:23–32Google Scholar
  10. 10.
    Jeannin S, Divakaran A (2001 June) MPEG-7 visual motion descriptors. IEEE Trans Circuits Syst Video Technol 11(6):720–724CrossRefGoogle Scholar
  11. 11.
    Jeannin S, Jasinschi R, She A, Naveen T, Mory B, Tabatabai A (2000) Motion descriptors for content-based video representation. Signal Process Image Commun 16:59–85CrossRefGoogle Scholar
  12. 12.
    Kobla V, Doermann DS, Lin K-I (1996) Archiving, indexing and retrieval of video in compressed domain. In: SPIE Conference on Multimedia Storage and Archiving Systems, vol 2916, pp. 78–89Google Scholar
  13. 13.
    Kobla V, Doermann DS, Lin K-I, Faloutsos C (1997) Compressed domain video indexing techniques using DCT and motion vector information in MPEG video. In: SPIE Conference on Multimedia Storage and Archiving Systems, vol 3022, pp. 200–211Google Scholar
  14. 14.
    Mandal M, Idris F, Panchanathan S (1999) A critical evaluation of image and video indexing techniques in the compressed domain. J Image Vis Comput 17(7):513–529 (Special issue on Content-based Image Indexing)CrossRefGoogle Scholar
  15. 15.
    Nabil M, Ngu AHH, Shepherd J (2001) Modeling and retrieval of moving objects. Multimedia Tools and Applications 13(1):35–71CrossRefGoogle Scholar
  16. 16.
    Sahouria E, Zakhor A (1999) A trajectory based video indexing system for street surveillance. In: IEEE International Conference on Image ProcessingGoogle Scholar
  17. 17.
    Standard MPEG1: ISO/IEC 11172. Coding of moving pictures and associated audio for digital storage media at up to about 1.5 Mbit/s.Google Scholar
  18. 18.
    Sudhir G, Lee J (1996 December) Video annotation by motion interpretation using optical flow streams. J Vis Commun Image Represent 7(4):354–368CrossRefGoogle Scholar
  19. 19.
    Taşkiran C, Chen J-Y, Bouman CA, Delp EJ (1998 October) A compressed video database structured for active browsing and search. In: IEEE International Conference on Image Processing, vol 3, pp 133–137Google Scholar
  20. 20.
    Tan YP, Saur DD, Kulkarni SR, Ramadge PJ (2000 February) Rapid estimation of camera motion from compresses video with applications to video annotation. IEEE Trans Circuits Syst Video Technol 10(1):133–146CrossRefGoogle Scholar
  21. 21.
    Yoon K, DeMenthon DF, Doermann D (2000) Event detection from MPEG video in the compressed domain. In: International Conference on Pattern Recognition, pp 819–822, Barcelona, SpainGoogle Scholar
  22. 22.
    Zhong D, Chang SF (1999) December) An integrated approach for content-based video object segmentation and retrieval. IEEE Trans Circuits Syst Video Technol 9(8):1259–1268CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2006

Authors and Affiliations

  1. 1.Department of Electrical EngineeringIndian Institute of ScienceBangaloreIndia

Personalised recommendations