Skip to main content
SpringerLink
Log in

Unsupervised story segmentation and indexing of broadcast news video

  • 1209: Recent Advances on Social Media Analytics and Multimedia Systems: Issues and Challenges
  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This paper presents a novel technique for story segmentation of news videos. The visual similarity, silence in the audio and the text in text boxes of a news video are used as parameters to define the story boundaries. Each of these parameters is used to create an index and these three indices are fed to a probabilistic multimodal algorithm which then predicts the story breaks. The multimodal algorithm takes account of the previous state of the indices and predicts the present state. It is then compared with the actual present indices and story breaks are determined. The segmented stories are then indexed for easy retrieval of the stories.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Al Mahmood F (2020) Dictionary. (https://www.mathworks.com/matlabcentral/fileexchange/5408-dictionary ), MATLAB Central File Exchange. Retrieved September 13, 2020

  2. Chaisorn L, Chua T et al (2003) A two-level multi-modal approach for story segmentation of large news video corpus. TRECVID

  3. Chaisorn L, Chua T et al (2004) A hierarchical approach to story segmentation of large broadcast news video corpus. In: 2004 IEEE International conference on multimedia and expo (ICME) (IEEE Cat. No.04TH8763), vol 2, Taipei, pp 1095–1098

  4. Claro TV - T18 (2021) https://www.iball.co.in/core/File/ProductPdf/ClaroTV-T18.pdf. Retrieved June 9, 2021

  5. Dumont É, Quénot G (2012) Automatic story segmentation for TV news video using multiple modalities. Int J Digit Multimed Broadcast 2012:Article ID 732514

    Google Scholar 

  6. Feng H, Zhai X, Fan J, Fang Y (2005) Story segmentation in news video. In: International conference on neural networks and brain, Beijing, pp 831–835

  7. Goyal A, Punitha P et al (2009) Split and merge based story segmentation in news videos. Lect Notes Comput Sci 5478:766–770

    Article  Google Scholar 

  8. Haloi P, Bordoloi AK, Bhuyan MK (2019) Unsupervised broadcast news video shot segmentation and classification. In: 2nd international conference on innovations in electronics, signal processing and communication (IESC), Shillong, India, pp 243–251

  9. Haloi P, Gadde P, Bhuyan MK (2019) News video indexing and story unit segmentation using text cue. In: International conference on wireless communications signal processing and networking (WiSPNET), Chennai, India, pp 501–507

  10. Haloi P, Bhuyan MK, Borah PR, Chatterjee D (2020) A novel algorithm for shot boundary detection and segmentation of broadcast news videos. In: 2020 international conference on computational performance evaluation (ComPE), pp 751–756

  11. Hauptmann AG, Witbrock MJ (1998) Story segmentation and detection of commercials in broadcast news video IEEE international forum on research and technology advances in digital libraries -ADL’98, USA, pp 168–179

  12. Huayong L, Hui Z (2005) The segmentation of news video into story units. In: Advances in web-age information management, WAIM 2005. Lecture notes in computer science, vol 3739. Springer, Berlin, Heidelberg

  13. Hui PY, Tang X et al (2001) Automatic story segmentation for spoken document retrieval. In: 10Th IEEE international conference on fuzzy systems (Cat. No.01CH37297), vol 2, Australia, pp 1319–1322

  14. Image Processing Toolbox User’s Guide (2021) https://in.mathworks.com/help/pdf_doc/images/images_ug.pdf. Retrieved June 9, 2021

  15. Jalil M, Butt A, Malik A (2003) Short-time energy, magnitude, zero crossing rate and autocorrelation measurement for discriminating voiced and unvoiced segments of speech signals. In: 2013 The international conference on technological advances in electrical, electronics and computer engineering (TAEECE), Konya, pp 208–212

  16. Kannao R, Guha P (2016) Story segmentation in TV news broadcast. In: 23rd international conference on pattern recognition (ICPR), pp 2948–2953

  17. Kannao R, Guha P (2019) Segmenting with style: detecting program and story boundaries in TV news broadcast videos. Multimed Tools Appl 78:31925–31957

    Article  Google Scholar 

  18. Liu H, He T (2009) Using multimodal analysis for story segmentation of news video. In: 2009 International joint conference on artificial intelligence, Hainan Island, pp 124–127

  19. Liu H, He T (2009) Content-based story segmentation of news video by multimodal analysis. In: 6Th International conference on fuzzy systems and knowledge discovery, vol 7, Tianjin, pp 423–426

  20. Nagasaka A, Tanaka Y (1992) Automatic video indexing and Full-Video search for object appearances. J Inf Process 15(2):316

    Google Scholar 

  21. O’Connor N, Czirjek C et al (2001) News story segmentation in the Fischlar video indexing system. In: 2001 International conference on image processing (Cat. No.01CH37205), vol 3, Greece, pp 418–421

  22. Parallel Computing Toolbox User’s Guide (2021) https://www.mathworks.com/help/pdf_doc/parallel-computing/parallel-computing.pdfhttps://www.mathworks.com/help/pdf_doc/parallel-computing/parallel-computing.pdf. Retrieved June 9, 2021

  23. Park Y, Li Y (2006) Extracting salient keywords from instructional videos using joint text, audio and visual cues. In: Human language technology conference of the NAACL, Companion, pp 109–112

  24. Rosenberg A, Hirschberg J (2006) Story segmentation of broadcast news in English, Mandarin and Arabic. In: Human language technology conference of the NAACL, Companion, pp 125–128

  25. Song Y, Wang W et al (2009) News story segmentation based on audio-visual features fusion. In: 2009 4th International conference on computer science and education, Nanning, pp 1065–1068

  26. Tapu R, Mocanu B, Zaharia T (2016) TV news retrieval based on story segmentation and concept association. In: 12th International conference on signal-image technology & internet-based systems (SITIS), pp 327–334

  27. Text Analytics Toolbox User’s Guide (2020) https://in.mathworks.com/help/pdf_doc/textanalytics/textanalytics_ug.pdf. Retrieved September 13, 2020

  28. Wang J, Duan L et al (2008) A multimodal scheme for program segmentation and representation in broadcast video streams. IEEE Trans Multimed 10 (3):393–408

    Article  Google Scholar 

  29. Yeh YJ, Chen JC et al (2005) TV Commercial detection in news program videos. In: IEEE Int. Symp. Circuits syst., 005, vol 5, pp 4594–4597

  30. Zedan IA, Elsayed KM, Emary E (2018) News videos segmentation using dominant colors representation. In: Hassanien A, Oliva D (eds) Advances in soft computing and machine learning in image processing. Studies in computational intelligence, vol 730. Springer, Cham

  31. Zhai Y, Yilmaz A, Shah M (2005) Story segmentation in news videos using visual and text cues. In: Leow WK, Lew MS, Chua TS, Ma WY, Chaisorn L, Bakker EM (eds) Image and video retrieval. CIVR 2005. Lecture notes in computer science, vol 3568. Springer, Berlin, Heidelberg

Download references

Author information

Authors and Affiliations

  1. Indian Institute of Technology Guwahati, 781039, Guwahati, India

    Pranabjyoti Haloi & M.K. Bhuyan

  2. Jorhat Engineering College, Jorhat, India

    Dibyajyoti Chatterjee & Pooja Rani Borah

Authors
  1. Pranabjyoti Haloi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. M.K. Bhuyan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Dibyajyoti Chatterjee
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Pooja Rani Borah
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Pranabjyoti Haloi.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Haloi, P., Bhuyan, M., Chatterjee, D. et al. Unsupervised story segmentation and indexing of broadcast news video. Multimed Tools Appl 82, 8645–8664 (2023). https://doi.org/10.1007/s11042-021-11490-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-021-11490-y

Keywords

Search

Navigation