Content-Based Discovery of Multiple Structures from Episodes of Recurrent TV Programs Based on Grammatical Inference

  • Bingqing Qu
  • Félicien Vallet
  • Jean Carrive
  • Guillaume Gravier
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8935)


TV program structuring is essential for program indexing and retrieval. Practically, various types of programs lead to a diversity of program structures. Besides, several episodes of a recurrent program might exhibit different structures. Previous work mostly relies on supervised approaches by adopting prior knowledge about program structures. In this paper, we address the problem of unsupervised program structuring with minimal domain knowledge. We propose an approach to identify multiple structures and infer structural grammars for recurrent TV programs of different types. It involves three sub-problems: i) we determine the structural elements contained in programs with minimal knowledge about which type of elements may be present; ii) we identify multiple structures for the programs if any and model the structures; iii) we generate the structural grammar for each corresponding structure. Finally, we conduct use cases on real recurrent programs of three different types to demonstrate the effectiveness of proposed approach.


Coherent State Time Stamp Program Structure Multiple Structure Distribution Matrix 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Xie, L., Xu, P., Chang, S.F., Divakaran, A., Sun, H.: Structure analysis of soccer video with domain knowledge and hidden Markov models. Pattern Recognition Letters (2004)Google Scholar
  2. 2.
    Bertini, M., Del Bimbo, A., Pala, P.: Content-based indexing and retrieval of TV news. Pattern Recognition Letters (2001)Google Scholar
  3. 3.
    Abduraman, A.E., Berrani, S.A., Merialdo, B.: An unsupervised approach for recurrent TV program structuring. In: European Interactive TV Conference (2011)Google Scholar
  4. 4.
    Qu, B., Vallet, F., Carrive, J., Gravier, G.: Content-based inference of hierarchical structural grammar for recurrent TV programs using multiple sequence alignment. In: IEEE International Conference on Multimedia and Expo (2014)Google Scholar
  5. 5.
    Qu, B., Vallet, F., Carrive, J., Gravier, G.: Using grammar induction to discover the structure of recurrent TV programs. In: International Conferences on Advances in Multimedia (2014)Google Scholar
  6. 6.
    Kijak, E., Gravier, G., Oisel, L., Gros, P.: Audiovisual integration for tennis broadcast structuring. Multimedia Tools and Applications (2006)Google Scholar
  7. 7.
    Eickeler, S., Muller, S.: Content-based video indexing of TV broadcast news using hidden Markov models. In: IEEE International Conference on Acoustics, Speech, and Signal Processing (1999)Google Scholar
  8. 8.
    Hanjalic, A., Lagendijk, R., Biemond, J.: Template-based detection of anchorperson shots in news programs. In: International Conference on Image Processing. IEEE (1998)Google Scholar
  9. 9.
    Gao, X., Tang, X.: Unsupervised video-shot segmentation and model-free anchorperson detection for news video story parsing. IEEE Transactions on Circuits and Systems for Video Technology (2002)Google Scholar
  10. 10.
    Chen, S.C., Shyu, M.L., Chen, M., Zhang, C.: A decision tree-based multimodal data mining framework for soccer goal detection. In: IEEE International Conference on Multimedia and Expo (2004)Google Scholar
  11. 11.
    Ancona, N., Cicirelli, C., Branca, A., Distante, A.: Goal detection in football by using support vector machines for classification. In: IEEE International Joint Conference on Neural Networks (2001)Google Scholar
  12. 12.
    Ben, M., Gravier, G.: Unsupervised mining of audiovisually consistent segments in videos with application to structure analysis. In: IEEE International Conference on Multimedia and Expo (2011)Google Scholar
  13. 13.
    Jacobs, A.: Using self-similarity matrices for structure mining on news video. In: Antoniou, G., Potamias, G., Spyropoulos, C., Plexousakis, D. (eds.) SETN 2006. LNCS (LNAI), vol. 3955, pp. 87–94. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  14. 14.
    Li, Z., Ding, B., Han, J., Kays, R., Nye, P.: Mining periodic behaviors for moving objects. In: ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2010)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Bingqing Qu
    • 1
    • 3
  • Félicien Vallet
    • 3
  • Jean Carrive
    • 3
  • Guillaume Gravier
    • 2
  1. 1.University of Rennes 1 – IRISA and Inria RennesFrance
  2. 2.CNRS – IRISA and Inria RennesFrance
  3. 3.French National Audiovisual InstituteFrance

Personalised recommendations