Automatic Cut Detection in MPEG Movies: A Multi-expert Approach

  • Massimo De Santo
  • Gennaro Percannella
  • Carlo Sansone
  • Roberto Santoro
  • Mario Vento
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2396)

Abstract

In this paper we propose a method to detect abrupt shot changes in MPEG coded videos that operates directly on the compressed domain by using a Multi-Expert approach. Generally, costly analysis for addressing the weakness of a single expert for abrupt shot change detection and the consequent modifications would produce only slight performance improvements. Hence, after a careful analysis of the scientific literature, we selected three techniques for cut detection, which extract complementary features and operate directly in the compressed domain. Then, we combined them into different kinds of Multi-Expert Systems (MES) employing three combination rules: Majority Voting, Weighted Voting and Bayesian rule. In order to assess the performance of the proposed MES, we built up a huge database, much wider than those used in the field. Experimental results demonstrate that the proposed system performs better than each of the three single algorithms.

Keywords

Motion Vector Shot Boundary Video Effect Single Expert Majority Vote Rule 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

References

  1. 1.
    T.K. Ho, J.J. Hull, S.N. Srihari, Decision Combination in Multiple Classifier Systems, IEEE Transactions on Pattern Analysis and Machine Intelligence, 16(1), (1994), 66–75.CrossRefGoogle Scholar
  2. 2.
    J. Kittler, M. Hatef, R.P.W. Duin, J. Matas, On Combining Classifiers, IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(3), (1998), 226–239.CrossRefGoogle Scholar
  3. 3.
    J. Feng, K.T. Lo and H. Mehrpour, “Scene change detection algorithm for MPEG video sequence”, Proc. of the IEEE International Conference on Image Processing, vol. 2, pp. 821–824, Sept. 1996.Google Scholar
  4. 4.
    G. Boccignone, M. De Santo, and G. Percannella, “An algorithm for video cut detection in MPEG sequences,” Proc. of the IS&T/SPIE International Conference on Storage and Retrieval of Media Databases 2000, pp. 523–530, Jan. 2000, San Jose, CA.Google Scholar
  5. 5.
    S.C. Pei, Y.Z. Chou, Efficient MPEG compressed video analysis using macroblock type information, in IEEE Transactions on Multimedia, 1(4), (1999), 321–333.CrossRefGoogle Scholar
  6. 6.
    J. Nang, S. Hong, Y. Ihm, “An efficient video segmentation scheme for MPEG video stream using Macroblock information”, Proc. of the ACM International Conference on Multimedia, pp. 23–26, 1999.Google Scholar
  7. 7.
    S.M. Bhandarkar, A.A. Khombhadia, “Motion-based parsing of compressed video”, Proc. of the IEEE International Workshop on Multimedia Database Management Systems, pp. 80–87, Aug. 1998.Google Scholar
  8. 8.
    B.L. Yeo, B. Liu, Rapid Scene Analysis on Compressed Video, IEEE Transactions on Circuits and Systems for Video Technology, 5(6), (1995), 533–544.CrossRefGoogle Scholar
  9. 9.
    S.W. Lee, Y.M. Kim, S.W. Choi, Fast Scene Change Detection using Direct Features Extraction from MPEG Compressed Videos, IEEE Transactions on Multimedia, 2(4), (2000), 240–254.CrossRefMathSciNetGoogle Scholar
  10. 10.
    N.V. Patel, I.K. Sethi, Compressed video processing for cut detection, IEE Proceedings on Vision, Image and Signal Processing, 143(5), (1996), 315–323.CrossRefGoogle Scholar
  11. 11.
    S.S. Yu, J.R. Liou, W.C. Chen, Computational similarity based on chromatic barycenter algorithm, IEEE Transactions on Consumer Electronics, 42(2), (1996), 216–220.CrossRefGoogle Scholar
  12. 12.
    L. Xu, A. Krzyzak, C.Y. Suen, Methods of Combining Multiple Classifiers and Their Application to Handwritten Numeral Recognition, IEEE Transactions on Systems, Man and Cybernetics 1992; 22(3), (1992), 418–435.CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2002

Authors and Affiliations

  • Massimo De Santo
    • 1
  • Gennaro Percannella
    • 1
  • Carlo Sansone
    • 2
  • Roberto Santoro
    • 1
  • Mario Vento
    • 1
  1. 1.Dipartimento di Ingegneria dell’Informazione e di Ingegneria ElettricaUniversità di SalernoFiscianoItaly
  2. 2.Dipartimento di Informatica e SistemisticaUniversità di Napoli “Federico II”- Via ClaudioNapoliItaly

Personalised recommendations