A Video Shot Boundary Detection Algorithm Based on Feature Tracking
Partitioning a video sequence into shots is the first and key step toward video-content analysis and content-based video browsing and retrieval. A novel video shot boundary detection algorithm is presented based on the feature tracking. First, the proposed algorithm extracts a set of corner-points as features from the first frame of a shot. Then, based on the Kalman filtering, these features are tracked with windows matching method from the subsequent frames. According to the characteristic pattern of pixels intensity changing between corresponding windows, the measure of shot boundary detection can be obtained to confirm the types of transitions and the time interval of gradual transitions. The experimental results illustrate that the proposed algorithm is effective and robust with low computational complexity.
KeywordsContent-based video retrieval shot boundary detection corner detection feature tracking Kalman filter
Unable to display preview. Download preview PDF.
- 1.Lupatini, G., Saraceno, C., Leonardi, R.: Scene break detection: A comparison, Research Issues in Data Engineering. In: Proc. of Workshop on Continuous Media Databases and Applications, pp. 34–41 (1998)Google Scholar
- 2.Hanjalic, A.: Shot-boundary detection: unraveled and resolved? IEEE Trans. on CSVT.12 12(2), 90–105 (2002)Google Scholar
- 4.Nagasaka, A., Tanaka, Y.: Automatic video indexing and full-video search for object appearances. In: Proc. of IFIP TC2/WG2.6 Second Working Conference on Visual Database Systems, pp. 113–127 (1991)Google Scholar
- 5.Shahraray, B.: Scene change detection and content-based sampling of video sequences. In: Proc. of SPIE 1995, Digital. Video Compression: Algorithm and Technologies, San Jose, CA, vol. 2419, pp. 2–13 (1995)Google Scholar
- 7.Lienhart, R.: Comparison of automatic shot boundary detection algorithms. In: Proc. of SPIE Storage and Retrieval for Still Image and Video Databases VII, vol. 3656, pp. 290–301 (1999)Google Scholar
- 8.Gargi, U., Kasturi, R., Strayer, S.H.: Performance characterization of video-shot-change detection methods. IEEE Trans. CSVT 10(1), 1–13 (2000)Google Scholar
- 10.Yeo, B.-L., Liu, B.: Rapid scene change detection on compressed video. IEEE Trans. on CSVT 5(6), 533–544 (1995)Google Scholar
- 11.Meng, J., et al.: Scene change detection in a MPEG compressed video sequence. In: Proc. of IS&T/SPIE Symposium, San Jose, CA, vol. 2419, pp. 1–11 (1995)Google Scholar
- 14.Censi, A., Fusiello, A.: Image stabilization by features tracking. In: Proceedings of the 10th Int. Conf. on image analysis and processing, Venice Italy, pp. 665–667 (1999)Google Scholar
- 16.Su, C.W., Tyan, H.R., Liao, H.Y.M., Chen, L.H.: A motion-tolerant dissolve detection algorithm. In: Proc. of IEEE Int. Conf. on Multimedia and Expo, Lausanne, Switzerland, pp. 225–228 (2002)Google Scholar