Video Event Mining via Multimodal Content Analysis and Classification

  • Min Chen
  • Shu-Ching Chen
  • Mei-Ling Shyu
  • Chengcui Zhang

Abstract

As digital video data become more and more pervasive, the issue of mining information from video data becomes increasingly important. In this chapter, we present an effective multimedia data mining framework for event mining with its application in the automatic extraction of goal events in soccer videos. The extracted goal events can be used for high-level indexing and selective browsing of soccer videos.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Aha D. Tolerating noisy, irrelevant, and novel attributes in instance-based learning algorithms. International Journal of Man-Machine Studies 1992;36(2):267–287.CrossRefGoogle Scholar
  2. 2.
    Assfalg J, Bertini M, Bimbo AD, Nunziati W, Pala P. Soccer highlights detection and recognition using HMMs. In: Proceedings of IEEE International Conference on Multimedia and Expo; 2002, pp. 825–828.Google Scholar
  3. 3.
    Babaguchi N, Kawai Y, Kitahashi T. Event based indexing of broadcasted sports video by intermodal collaboration. IEEE Transactions on Multimedia 2002;4(1):68–75. P1: OTE/SPH P2: OTE SVNY295-Petrushin September 19, 2006 17:30 12. Video Event Mining via Multimodal Content Analysis and Classification 257CrossRefGoogle Scholar
  4. 4.
    Cendrowska J. PRISM: An algorithm for inducing modular rules. International Journal of Man-Machine Studies 1987;27(4):349–370.MATHCrossRefGoogle Scholar
  5. 5.
    Chang SF. The holy grail of content-based media analysis. IEEE Multimedia 2002; 9:6–10.CrossRefGoogle Scholar
  6. 6.
    Chen S-C, Shyu M-L, Zhang C, Kashyap RL. Video scene change detection method using unsupervised segmentation and object tracking. In: Proceedings of IEEE International Conference on Multimedia and Expo; 2001. pp. 57–60.Google Scholar
  7. 7.
    Chen S-C, Shyu M-L, Zhang C, Kashyap RL. Identifying overlapped objects for video indexing and modeling in multimedia database systems. International Journal on Artificial Intelligence Tools 2001;10(4):715–734.CrossRefGoogle Scholar
  8. 8.
    Chen S-C, Shyu M-L, Zhang C, Luo L, Chen M. Detection of soccer goal shots using joint multimedia features and classification rules. In: Proceedings of the Fourth International Workshop on Multimedia Data Mining (MDM/KDD2003), in conjunction with the ACMSIGKDD International Conference on Knowledge Discovery&Data Mining; 2003, pp. 36–44.Google Scholar
  9. 9.
    Chen S-C, Shyu M-L, Zhang C. Innovative shot boundary detection for video indexing. In: Sagarmay Deb, editor. Video Data Management and Information Retrieval. Idea Group Publishing, ISBN: 1-59140546-7; 2005, pp. 217–236.Google Scholar
  10. 10.
    Chen S-C, Shyu M-L, Zhang C, Chen M. A multimodal data mining framework for soccer goal detection based on decision tree logic. International Journal of Computer Applications in Technology, Special Issue on Data Mining Applications. In press.Google Scholar
  11. 11.
    Cheng HD, Jiang XH, Sun Y, Wang J. Color image segmentation: advances and prospects. Pattern Recognition 2001;34(12):2259–2281.MATHCrossRefGoogle Scholar
  12. 12.
    Dagtas S, Abdel-Mottaleb M. Extraction of TV highlights using multimedia features. In: Proceedings of IEEE InternationalWorkshop on Multimedia Signal Processing; 2001, pp. 91–96.Google Scholar
  13. 13.
    Deshpande U, Gupta A, Basu A. Performance enhancement of a contract net protocol based system through instance-based learning. IEEE Transactions on System, Man, and Cybernetics, Part B 2005;35(2):345–358.CrossRefGoogle Scholar
  14. 14.
    Duan LY, Xu M, Yu XD, Tian Q. A unified framework for semantic shot classification in sports videos. In: Proceedings of ACM Multimedia; 2002, pp. 419–420.Google Scholar
  15. 15.
    Duan LY, Xu M, Chua TS, Tian Q, Xu CS. A mid-level representation framework for semantic sports video analysis. In: Proceedings of ACM Multimedia; 2003, pp. 33–44.Google Scholar
  16. 16.
    Ekin A. Sports video processing for description, summarization, and search [dissertation]. Department of Electrical and Computer Engineering, School of Engineering and Applied Sciences, University of Rochester; 2003.Google Scholar
  17. 17.
    Ekin A, Tekalp AM, Mehrotra R. Automatic soccer video analysis and summarization. IEEE Transactions on Image Processing 2003;12(7):796–807.CrossRefGoogle Scholar
  18. 18.
    Gong Y, Sin LT, Chuan CH, Zhang H, Sakauchi M. Automatic parsing of TV soccer programs. In: Proceeding of IEEE Multimedia Computing and Systems; 1995, pp. 167–174.Google Scholar
  19. 19.
    Hanjalic A. Shot-boundary detection: unraveled and resolved. IEEE Transactions on Circuits and Systems for Video Technology 2002;12:90–105.CrossRefGoogle Scholar
  20. 20.
    Leonardi R, Migliorati P, Prandini M. Semantic indexing of soccer audio-visual sequences: a multimodal approach based on controlled Markov chains. IEEE Transactions on Circuits and Systems for Video Technology 2004;14(5):634–643.CrossRefGoogle Scholar
  21. 21.
    Li B, Pan H, Sezan I. A general framework for sports video summarization with its application to soccer. In: Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing; 2003, pp. 169–172. P1: OTE/SPH P2: OTE SVNY295-Petrushin September 19, 2006 17:30 258 Min Chen et al.Google Scholar
  22. 22.
    Liu Z, Wang Y, Chen T. Audio feature extraction and analysis for scene segmentation and classification. Journal of VLSI Signal Processing Systems for Signal, Image, and Video Technology 1998;20(1/2):61–80.Google Scholar
  23. 23.
    Martin B. Instance-based learning: nearest neighbor with generalization [thesis]. Department of Computer Science, University of Waikato, New Zealand; 1995.Google Scholar
  24. 24.
    Mitchell T. Machine Learning. New York: McGraw-Hill; 1997.MATHGoogle Scholar
  25. 25.
    Rui Y, Gupta A, Acero A. Automatically extracting highlights for TV baseball programs. In: Proceedings of ACM Multimedia; 2000, pp. 105–115.Google Scholar
  26. 26.
    Tan YP, Saur DD, Kulkarni SR, Ramadge PJ. Rapid estimation of camera motion from compressed video with application to video annotation. IEEE Transactions on Circuits and Systems for Video Technology 2000;10(1):133–146.CrossRefGoogle Scholar
  27. 27.
    Tovinkere V, Qian RJ. Detecting semantic events in soccer games: towards a complete solution. In: Proceedings of IEEE International Conference on Multimedia and Expo; 2001, pp. 1040–1043.Google Scholar
  28. 28.
    Wang Y, Liu Z, Huang J. Multimedia content analysis using both audio and visual clues. Signal Processing Magazine 2000;17:12–36.CrossRefGoogle Scholar
  29. 29.
    Witten IH, Frank E. Data Mining-Practical Machine Learning Tools and Techniques with Java Implementations. San Francisco: Morgan Kaufmann Publishers; 1999.Google Scholar
  30. 30.
    Xie L, Chang SF, Divakaran A, Sun H. Structure analysis of soccer video with Hidden Markov Models. In: Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing; 2002, pp. 13–17.Google Scholar
  31. 31.
    Xie L, Chang SF, Divakaran A, Sun H. Unsupervised discovery of multilevel statistical video structures using Hierarchical Hidden Markov Models. In: Proceedings of the IEEE International Conference on Multimedia and Expo; 2003, pp. 29–32.Google Scholar
  32. 32.
    Xie L, Xu P, Chang SF, Divakaran A, Sun H. Structure analysis of soccer video with domain knowledge and Hidden Markov Models. Pattern Recognition Letters 2003;24(15):767–775.Google Scholar
  33. 33.
    Xu M, Maddage NC, Xu CS, Kankanhalli M, Tian Q. Creating audio keywords for event detection in soccer video. In: Proceedings of IEEE International Conference on Multimedia and Expo; 2003, pp. 281–284.Google Scholar
  34. 34.
    Xu P, Xie L, Chang SF, Divakaran A, Vetro A, Sun H. Algorithms and system for segmentation and structure analysis in soccer video. In: Proceedings of IEEE International Conference on Multimedia and Expo; 2001, pp. 928–931.Google Scholar
  35. 35.
    Yow D, Yeo BL, Yeung M, Liu B. Analysis and presentation of soccer highlights from digital video. In: Proceedings of 2nd Asian Conference on Computer Vision; 1995, pp. 499–503.Google Scholar
  36. 36.
    Zhang C, Chen S-C, Shyu M-L. PixSO:Asystem for video shot detection. In: Proceedings of the Fourth IEEE Pacific-Rim Conference on Multimedia; 2003, pp. 1–5.Google Scholar
  37. 37.
    ZhuW, Toklu C, Liou SP. Automatic news video segmentation and categorization based on closed-captioned text. In: Proceedings of IEEE International Conference on Multimedia and Expo; 2001, pp. 1036–1039.Google Scholar
  38. 38.
    Zhu X, Wu X, Elmagarmid AK, Feng Z, Wu L. Video data mining: Semantic indexing and event detection from the association perspective. IEEE Transactions on Knowledge and Data Engineering 2005;17(5):665–677.CrossRefGoogle Scholar
  39. 39.
    Weka 3: data mining software in Java. Available from: http://www.cs.waikato.ac.nz/ml/weka/.Google Scholar

Copyright information

© Springer 2007

Authors and Affiliations

  • Min Chen
  • Shu-Ching Chen
  • Mei-Ling Shyu
  • Chengcui Zhang

There are no affiliations available

Personalised recommendations