Parsing News Video Using Integrated Audio-Video Features

  • S. Kalyan Krishna
  • Raghav Subbarao
  • Santanu Chaudhury
  • Arun Kumar
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3776)


In this paper we have proposed a scheme for parsing News video sequences into their semantic components using integrated aural and visual features. We have explored use of the Token Passing Algorithm with HMM for simultaneous segmentation and characterization of the components. Experimentation with about 100 sequences have shown impressive results.


Video Sequence Visual Feature News Video Audio Feature Semantic Component 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Huang, J., Liu, Z., Wang, Y.: Integration of Audio and Visual Information for Content-based Video Segmentation. In: Proc. of IEEE International Conference on Image Processing (ICIP 1998), Chicago, IL, October 4-7, vol. 3, pp. 526–530 (1998), Invited Paper on Content-based Video Search and RetrievalGoogle Scholar
  2. 2.
    Adams, W.H., Iyengar, G., Lin, C.Y., Naphade, M.R., Neti, C., Nock, H.J., Smith, J.R.: Semantic Indexing of Multimedia using Audio, Text and Visual Cues. EURASIP J. Appl. Signal Processing, 170–185 (2003)Google Scholar
  3. 3.
    Huang, Q., Liu, Z., Rosenberg, A., Gibbon, D., Shahraray, B.: Automated Generation of News Content Hierarchy By Integrating Audio, Video, and Text Information. In: Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (1999)Google Scholar
  4. 4.
    Huang, J., Liu, Z., Wang, Y.: Joint Video Scene Segmentation and Classification based on Hidden Markov Model. In: IEEE International Conference on Multimedia and Expo (ICME 2000), New York (August 2000)Google Scholar
  5. 5.
    Dagtas, S., Abdel-Mottaleb, M.: Multimodal detection of Highlights for Multimedia Content. Multimedia Systems 9, 586–593 (2004)CrossRefGoogle Scholar
  6. 6.
    Wang, J.Z., Wiederhold, G., Firschein, O., Wei Xin, S.: Content Based Image Indexing and Searching using Daubechies Wavelets. Digital Library, 311–328 (1997)Google Scholar
  7. 7.
    Tsekeridou, S., Pitas, I.: Content-based video parsing and indexing based on Audio-visual interaction. IEEE transactions on circuits and systems for video technology 11(4) (April 2001)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • S. Kalyan Krishna
    • 1
  • Raghav Subbarao
    • 1
  • Santanu Chaudhury
    • 1
  • Arun Kumar
    • 2
  1. 1.Department of Electrical Engg.I.I.TNew DelhiIndia
  2. 2.Centre for Applied Research in ElectronicsI.I.TNew DelhiIndia

Personalised recommendations