Advertisement

Content-Based News Video Retrieval with Closed Captions and Time Alignment

  • Young-tae Kim
  • Jae-Gon Kim
  • Hyun Sung Chang
  • Kyeongok Kang
  • Jinwoong Kim
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2195)

Abstract

In this paper, we propose a new method for searching and browsing news videos, based on multi-modal approach. In the proposed scheme, we use closed caption (CC) data to index the contents of TV news articles effectively. To achieve time alignment between the CC texts and video data, which is necessary for multi-modal search and visualization, supervised speech recognition technique is employed. In our implementations, we provide two different mechanisms for news video browsing. One is to use a textual query based search engine, and the other is to use topic based browser which acts as an assistant tool for finding the desired news articles. Compared to other systems mainly dependent on visual features, the proposed scheme could retrieve more semantically relevant articles quite well.

Keywords

News Article News Video Meaningful Unit Time Alignment Shot Boundary Detection 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    MPEG Requirements Group: Introduction to MPEG-7. ISO/IEC JTC1/SC29/WG11 N3751 (2000)Google Scholar
  2. 2.
    Kim, J.-G., Chang, H. S., Kim, M., Kim, J., Kim, H.-M.: Summary Description Schemes for Efficient Video Navigation and Browsing. In: Proc. IS&T/SPIE Visual Communications and Image Processing (2000) 1397–1408Google Scholar
  3. 3.
    Bertini, M., Bimbo, A. D., Pala, P.: Content Based Annotation and Retrieval of News Videos. In: Proc. IEEE International Conference on Multimedia and Expo (2000) 483–486Google Scholar
  4. 4.
    Huang, Q., Liu, Z., Rosenberg, A., Gibbon, D., Shahraray, B.: Automated Generation of News Content Hierarchy by Integrating Audio, Video, and Text Information. In: Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (1999) 3025–3028Google Scholar
  5. 5.
    Huang, Q., Puri, A., Liu, Z.: Multimedia Search and Retrieval: New Concepts, System Implementation, and Application. IEEE Transactions on Circuits and Systems Video Technology, Vol. 10, No. 5 (2000) 679–692CrossRefGoogle Scholar
  6. 6.
    Kuwano, H., Taniguchi, Y., Arai, H., Mori, M., Kurakake, S., Kojima, H.: Telop-on-Demand: Video Structuring and Retrieval Based on Text Recognition. In: Proc. IEEE International Conference on Multimedia and Expo(2000) 483–486Google Scholar
  7. 7.
    Kim, Y.-B., Shibata, M., Ehara, T.: Agent-Based Broadcasting with Video Indexing. IEEE Transactions on Broadcasting, Vol. 42, No. 3 (1996) 215–221CrossRefGoogle Scholar
  8. 8.
    Kim, J.-G., Chang, H. S., Kim, Y., Kim, M., Kang, K., Kim, J.: Multimodal Approach to the News Video Indexing and Summarization. In: Proc. IWAIT (2001) 187–192Google Scholar
  9. 9.
    Son, J., Kim, J., Kang, K., Bae, K.: Application of Speech Recognition with Closed Caption for Content-Based Video Segmentation. In: Proc. IEEE Digital Signal Processing Workshop (2000)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2001

Authors and Affiliations

  • Young-tae Kim
    • 1
  • Jae-Gon Kim
    • 1
  • Hyun Sung Chang
    • 1
  • Kyeongok Kang
    • 1
  • Jinwoong Kim
    • 1
  1. 1.Broadcasting Media Technology DepartmentElectronics and Telecommunications Research InstituteYuseong-Gu, DaejeonKorea

Personalised recommendations