Multimedia Tools and Applications

, Volume 75, Issue 1, pp 93–113 | Cite as

A shot detection technique using linear regression of shot transition pattern

  • Debabrata Dutta
  • Sanjoy Kumar Saha
  • Bhabatosh Chanda


Video segmentation acts as the fundamental step for various applications like, archiving, content based retrieval, copy detection and summarization of video data. Shot detection is first level of segmentation. In this work, a shot detection methodology is presented that evolves around a simple shot transition model based on the similarity of the frames with respect to a reference frame. Frames in an individual shot are very similar in terms of their visual content. Whenever a shot transition occurs a change in similarity values appears. For an abrupt transition, the rate of change is very high, while for gradual it is not so apparent. To overcome the effect of noise in similarity values, line is fit over a small window using a linear regression. Thus slope of this line exhibits the underlying pattern of transition. A novel algorithm for shot detection, hence, is developed based on the variation pattern of the similarity values of the frames with respect to a reference frame. First an algorithm is proposed, which is direct descendant of the underlying transition model and applies a threshold on the similarity values to detect the transitions. Then this algorithm is improved by utilizing the slope of linear approximation of variation in similarity values rather than the absolute values, following least square regression. Threshold on the slope is determined with a bias towards minimizing false rejection rate at the cost of false acceptance rate. Finally, a simple post-processing technique is adopted to reduce the false detection. Experiment is done with the video sequences taken from TRECVID 2001 database, action type movie video, recorded sports and news video. Comparison with few other systems indicates that the performance of the proposed scheme is quite satisfactory.


Video segmentation Shot detection Shot transition 


  1. 1.
    Adjeroh D, Lee MC, Banda N, Kandaswamy U (2009) Adaptive edge-oriented shot boundary detection. EURASIP J Image Video Process 2009:5:1–5:31CrossRefGoogle Scholar
  2. 2.
    Amel AM, Abdessalem BA, Abdellatif M (2010) Video shot boundary detection using motion activity descriptor. J Telecommun 2(1):54–59Google Scholar
  3. 3.
    Amiri A, Fathy M (2009) Video shot boundary detection using generalized eigenvalue decomposition and gaussian transition detection. In: Proceedings of the international conference on computational science and its applications, pp 780–790Google Scholar
  4. 4.
    Bescos J, Cisneros G, Martinez JM, Menendez JM, Cabrera J (2005) A unified model for techniques on video-shot transition detection. IEEE Trans Multimed 7(2):293–307CrossRefGoogle Scholar
  5. 5.
    Bhattacharyya A (1943) On a measure of divergence between two statistical populations defined by their probability distributions. Bull Calcutta Math Soc 35:99–109MathSciNetMATHGoogle Scholar
  6. 6.
    Cernekova Z, Pitas I, Nikou C (2006) Information theory-based shot cut/fade detection and video summarization. IEEE Trans CSVT 16(1):82–91Google Scholar
  7. 7.
    Chen LH, Lai YC, Liao HYM (2008) Movie scene segmentation using background information. Pattern Recognit 41(3):1056–1068CrossRefMATHGoogle Scholar
  8. 8.
    Cooper M, Foote J (2005) Discriminative techniques for keyframe selection. In: Proceedings of the ICME, The Netherlands, pp 502–505Google Scholar
  9. 9.
    Grana C, Cucchiara R (2007) Linear transition detection as a unified shot detection approach. IEEE Trans CSVT 17(4):483–489Google Scholar
  10. 10.
    Hampapur A, Jain R, Weymouth T (1995) Production model based digital video segmentation. Multimed Tools Appl 1:1–38CrossRefGoogle Scholar
  11. 11.
    Haoran Y, Rajan D, Chia LT (2006) A motion-based scene tree for browsing and retrieval of compressed video. Inf Syst 31(7):638–658CrossRefGoogle Scholar
  12. 12.
    Huan Z, Xiuhuan L, Lilei Y (2008) Shot boundary detection based on mutual information and canny edge detector. In: Proceedings of the international conference on computer science and software engineering, pp 1124–1128Google Scholar
  13. 13.
    Huang C L, Liao B Y (2001) A robust scene-change detection method for video segmentation. IEEE Trans CSVT 11(12):1281–1288Google Scholar
  14. 14.
    Le DD, Satoh S, Ngo TD, Duong DA (2008) A text segmentation based approach to video shot boundary detection. In: Proceedings of multimedia signal processing, pp 702–706Google Scholar
  15. 15.
    Ling X, Chao H, Huan L, Zhang X (2008) A general method for shot boundary detection. In: Proceedings of the international conference on multimedia and ubiquitous engineering, pp 394–397Google Scholar
  16. 16.
    Liu X, Chen T (2002) Shot boundary detection using temporal statistics modelling. In: Proceedings of the ICASSP, pp 3389–3392Google Scholar
  17. 17.
    Mas J, Fernandez G (2003) Video shot boundary detection based on color histogram. Notebook Papers TRECVID2003Google Scholar
  18. 18.
    Mohanta PP, Saha SK, Chanda B (2012) A model-based shot boundary detection technique using frame transition parameters. IEEE Trans Multimed 14(1):223–233CrossRefGoogle Scholar
  19. 19.
    Murai Y, Fujiyoshi H (2008) Shot boundary detection using co-occurrence of global motion in video stream. In: Proceedings of the ICPR, pp 1–4Google Scholar
  20. 20.
    Patel NV, Sethi IK (1997) Video shot detection and characterization for video databases. Pattern Recognit 30(4):583–592CrossRefGoogle Scholar
  21. 21.
    Porter S, Mirmehdi M, Thomas B (2001) Detection and classification of shot transitions. In: Proceedings of the 12th British machine vision conference. BMVA Press, pp 73–82Google Scholar
  22. 22.
    Rees DG (1987) Foundations of statistics. CRC PressGoogle Scholar
  23. 23.
    Smeaton AF, Over P, Doherty AR (2010) Video shot boundary detection: seven years of trecvid activity. Comput Vis Image Underst 114(4):411–418CrossRefGoogle Scholar
  24. 24.
    Tsamoura E, Mezaris V, Kompatsiaris I (2008) Gradual transition detection using color coherence and other criteria in a video shot meta-segmentation framework. In: Proceedings of the ICIP, pp 45–48Google Scholar
  25. 25.
    Yoo HW, Ryoo HJ, Jang DS (2006) Gradual shot boundary detection using localized edge blocks. Multimed Tools Appl 28:283–300CrossRefGoogle Scholar
  26. 26.
    Yuan J, Zheng W, Chen L, Ding D, Wang D, Tong Z, Wang H, Wu J, Li J, Lin F, Zhang B (2004) Tsinghua university at trecvid 2004: shot boundary detection and high-level feature extraction. In: Proceedings of the TREC Video Retrieval Evaluation (TRECVID), pp 84–196Google Scholar
  27. 27.
    Zhang C, Wang W (2012) A robust and efficient shot boundary detection approach based on fisher criterion. In: Proceedings of the ACM international conference on multimedia, pp 701–704CrossRefGoogle Scholar
  28. 28.
    Zhang W, Lin J, Chen X, Huang Q, Liu Y (2006) Video shot detection using hidden markov models with complementary features. In: Proceedings of the international conference on innovative computing, information and control, pp 593–596Google Scholar

Copyright information

© Springer Science+Business Media New York 2014

Authors and Affiliations

  • Debabrata Dutta
    • 1
  • Sanjoy Kumar Saha
    • 2
  • Bhabatosh Chanda
    • 3
  1. 1.Tirthapati InstitutionKolkataIndia
  2. 2.CSE DepartmentJadavpur UniversityKolkataIndia
  3. 3.ECS UnitIndian Statistical InstituteKolkataIndia

Personalised recommendations