Skip to main content
SpringerLink
Log in

Semantic Video Indexing and Summarization Using Subtitles

  • Conference paper
Advances in Multimedia Information Processing - PCM 2004 (PCM 2004)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 3331))

Included in the following conference series:

Abstract

How to build semantic index for multimedia data is an important and challenging problem for multimedia information systems. In this paper, we present a novel approach to build a semantic video index for digital videos by analyzing the subtitle files of DVD/DivX videos. The proposed approach for building semantic video index consists of 3 stages, viz., script extraction, script partition and script vector representation. First, the scripts are extracted from the subtitle files that are available in the DVD/DivX videos. Then, the extracted scripts are partitioned into segments. Finally, the partitioned script segments are converted into a tfidf vector based representation, which acts as the semantic index. The efficiency of the semantic index is demonstrated through video retrieval and summarization applications. Experimental results demonstrate that the proposed approach is very promising.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. http://www.doom9.org/dvobsub.htm

  2. Berry, M.W., Drmavc, Z., Jessup, E.R.: Matrices, vector spaces, and information retrieval. SIAM Review 41(2), 335–362 (1999)

    Article  MATH  MathSciNet  Google Scholar 

  3. Lin, C.-Y., Tseng, B.L., Smith, J.R.: VideoAnnEx: IBM MPEG-7 annotation tool for multimedia indexing and concept learning. In: IEEE International Conference on Multimedia & Expo, Baltimore, USA (July 2003)

    Google Scholar 

  4. Berry, M.W., Dumais, S.T., O’Brien, G.W.: Using linear algebra for intelligent information retrieval. SIAM Review 37, 301–328 (1995)

    Article  MathSciNet  Google Scholar 

  5. Porter, M.F.: An algorithm for suffix stripping. Program 14(3), 130–137 (1980)

    Google Scholar 

  6. Smoliar, S., Zhang, H.: Content-based video indexing and retrieval. IEEE Multimedia 1, 62–72 (1994)

    Article  Google Scholar 

  7. Sun, X., Manjunath, B.S., Divakaran, A.: Representation of motion activity in hierarchical levels for video indexing and filtering. IEEE International Conference on Image Processing 1, 149–152 (2002)

    Google Scholar 

  8. Wactlar, H.D.: The challanges of continuous capture, contemporaneous analysis and customized summarization of video content. CMU

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Center for Multimedia and Network Technology, School of Computer Engineering, Nanyang Technological University, Singapore, 639798

    Haoran Yi, Deepu Rajan & Liang-Tien Chia

Authors
  1. Haoran Yi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Deepu Rajan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Liang-Tien Chia
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Information and Communication Engineering, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, 113-8656, Tokyo, Japan

    Kiyoharu Aizawa

  2. IBM Research, Tokyo Research Laboratory, 1623-14 Shimo-tsuruma, Yamato, 242-0001, Kanagawa, Japan

    Yuichi Nakamura

  3. National Institute of Informatics, Tokyo, Japan

    Shin’ichi Satoh

Rights and permissions

Reprints and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Yi, H., Rajan, D., Chia, LT. (2004). Semantic Video Indexing and Summarization Using Subtitles. In: Aizawa, K., Nakamura, Y., Satoh, S. (eds) Advances in Multimedia Information Processing - PCM 2004. PCM 2004. Lecture Notes in Computer Science, vol 3331. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30541-5_78

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-30541-5_78

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-23974-1

  • Online ISBN: 978-3-540-30541-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation