Abstract
Semantic video analysis plays an important role in the field of machine intelligence and pattern recognition. In this paper, based on the Hidden Markov Model (HMM), a semantic recognition framework on compressed videos is proposed to analyze the video events according to six low-level features. After the detailed analysis of video events, the pattern of global motion and five features in foreground—the principal parts of videos, are employed as the observations of the Hidden Markov Model to classify events in videos. The applications of the proposed framework in some video event detections demonstrate the promising success of the proposed framework on semantic video analysis.
Similar content being viewed by others
References
B. L. Yeo, B. Liu. Rapid scene analysis on compressed video. IEEE Trans. on Circuits and Systems for Video Technology, 5(1995)6, 533–544.
A. Ekin, A. M. Tekalp, R. Mehrota. Automatic soccer video analysis and summarization. IEEE Trans. on Image Processing, 12(2003)7, 796–807.
Y. Li, S. Narayanan, C-C J. Kuo. Content-based movie analysis and indexing based on audio visual cues. IEEE Trans. on Circuits and Systems for Video Technology, 14(2004)8, 1073–1085.
F. Wang, Y-F Ma, H-J Zhang, et al. A generic framework for semantic sports video analysis using dynamic Bayesian networks. in Proc. of IEEE Int. Conf. Multimedia Modeling. Melbourne, IEEE, 2005, 115–122.
L. Rabiner. A tutorial on hidden Markov models and selected application in speech recognition. Proc. of IEEE, 77(1989)2, 257–286.
F. Niu, M. A. Mottaled. HMM-based segmentation and recognition of human activities from video sequences. in Proc. of IEEE Int. Conf. Multimedia and Expo. Amsterdam, IEEE, 2005, 804–807.
M. Barnard, J-M Odobez. Sports event recognition using layered HMMs. in Proc. of IEEE Int. Conf. Multimedia and Expo., Amsterdam, IEEE, 2005, 1150–1153.
G. Xu, Y-F Ma, H-J Zhang, et al. An HMM-based framework for video semantic analysis. IEEE Trans. on Circuits and Systems for Video Technology, 15(2005)11, 1422–1433.
L. E. Baum, J. A. Egon. An inequality with application to statistical estimation for probabilistic functions of a Markov process and to a model for ecology. Bull Amer. Meteorol. Soc., 73(1967), 360–363.
L. E. Baum. An inequality and associated maximization technique in statistical estimation for probabilistic functions of Markov processed. Inequalities, 3(1972), 1–8.
G. D. Forney. The Viterbi algorithm. Proc. of IEEE, 61(1973), 268–278.
F. Dufaux, J. Konrad. Efficient, robust, and fast motion estimation for video coding. IEEE Trans. on Image Processing, 9(2000)3, 497–501.
Author information
Authors and Affiliations
Corresponding author
Additional information
Supported in part by the National Natural Science Foundation of China (No. 60572045), the Ministry of Education of China Ph.D. Program Foundation (No.20050698033), and Cooperation Project (2005.7–2007.6) with Microsoft Research Asia.
About this article
Cite this article
You, J., Liu, G. & Zhang, Y. An HMM based analysis framework for semantic video events. J. of Electron.(China) 24, 271–275 (2007). https://doi.org/10.1007/s11767-006-0117-2
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11767-006-0117-2