A Video Shot Boundary Detection Algorithm Based on Feature Tracking

  • Xinbo Gao
  • Jie Li
  • Yang Shi
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4062)


Partitioning a video sequence into shots is the first and key step toward video-content analysis and content-based video browsing and retrieval. A novel video shot boundary detection algorithm is presented based on the feature tracking. First, the proposed algorithm extracts a set of corner-points as features from the first frame of a shot. Then, based on the Kalman filtering, these features are tracked with windows matching method from the subsequent frames. According to the characteristic pattern of pixels intensity changing between corresponding windows, the measure of shot boundary detection can be obtained to confirm the types of transitions and the time interval of gradual transitions. The experimental results illustrate that the proposed algorithm is effective and robust with low computational complexity.


Content-based video retrieval shot boundary detection corner detection feature tracking Kalman filter 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Lupatini, G., Saraceno, C., Leonardi, R.: Scene break detection: A comparison, Research Issues in Data Engineering. In: Proc. of Workshop on Continuous Media Databases and Applications, pp. 34–41 (1998)Google Scholar
  2. 2.
    Hanjalic, A.: Shot-boundary detection: unraveled and resolved? IEEE Trans. on CSVT.12 12(2), 90–105 (2002)Google Scholar
  3. 3.
    Zhang, H.J., Kankanhalli, A., Smoliar, S.W.: Automatic partitioning of full-motion video. Multimedia Systems 1(1), 10–28 (1993)CrossRefGoogle Scholar
  4. 4.
    Nagasaka, A., Tanaka, Y.: Automatic video indexing and full-video search for object appearances. In: Proc. of IFIP TC2/WG2.6 Second Working Conference on Visual Database Systems, pp. 113–127 (1991)Google Scholar
  5. 5.
    Shahraray, B.: Scene change detection and content-based sampling of video sequences. In: Proc. of SPIE 1995, Digital. Video Compression: Algorithm and Technologies, San Jose, CA, vol. 2419, pp. 2–13 (1995)Google Scholar
  6. 6.
    Zabih, R., Miller, J., Mai, K.: A feature-based algorithm for detecting and classification production effects. Multimedia Systems 7(2), 119–128 (1999)CrossRefGoogle Scholar
  7. 7.
    Lienhart, R.: Comparison of automatic shot boundary detection algorithms. In: Proc. of SPIE Storage and Retrieval for Still Image and Video Databases VII, vol. 3656, pp. 290–301 (1999)Google Scholar
  8. 8.
    Gargi, U., Kasturi, R., Strayer, S.H.: Performance characterization of video-shot-change detection methods. IEEE Trans. CSVT 10(1), 1–13 (2000)Google Scholar
  9. 9.
    Zhang, H.J., Kankanhalli, A., Smoliar, S.W.: Video parsing and browsing using compressed data. Multimedia Tools and applications 1(1), 89–111 (1995)CrossRefGoogle Scholar
  10. 10.
    Yeo, B.-L., Liu, B.: Rapid scene change detection on compressed video. IEEE Trans. on CSVT 5(6), 533–544 (1995)Google Scholar
  11. 11.
    Meng, J., et al.: Scene change detection in a MPEG compressed video sequence. In: Proc. of IS&T/SPIE Symposium, San Jose, CA, vol. 2419, pp. 1–11 (1995)Google Scholar
  12. 12.
    Fusiello, A., Trucco, E., Tommasini, T., Roberto, V.: Improving feature tracking with robust statistics. Pattern Analysis & Applications 2(4), 312–320 (1999)CrossRefGoogle Scholar
  13. 13.
    Smith, S.M., Brady, J.M.: SUSAN-a new approach to low level image processing. Int. Journal Computer Vision. 23(1), 45–78 (1997)CrossRefGoogle Scholar
  14. 14.
    Censi, A., Fusiello, A.: Image stabilization by features tracking. In: Proceedings of the 10th Int. Conf. on image analysis and processing, Venice Italy, pp. 665–667 (1999)Google Scholar
  15. 15.
    Lienhart, R.: Reliable transition detection in videos: A survey and practitioner’s guide. Int. Journal Image Graph (IJIG). 1(3), 469–486 (2001)CrossRefGoogle Scholar
  16. 16.
    Su, C.W., Tyan, H.R., Liao, H.Y.M., Chen, L.H.: A motion-tolerant dissolve detection algorithm. In: Proc. of IEEE Int. Conf. on Multimedia and Expo, Lausanne, Switzerland, pp. 225–228 (2002)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Xinbo Gao
    • 1
  • Jie Li
    • 1
  • Yang Shi
    • 1
  1. 1.School of Electronic EngineeringXidian Univ.Xi’anP.R. China

Personalised recommendations