Histogram Based Split and Merge Framework for Shot Boundary Detection

  • D. S. Guru
  • Mahamad Suhil
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8284)


In this paper, we propose a non-parametric approach for shot boundary detection in videos. The proposed method exploits the split and merge framework by the use of color histograms. Initially, every frame of the input video sequence undergoes color quantization and subsequently, the color histograms are computed for every quantized frame. The split and merge is driven by the fishers linear discriminant criterion function which results with a set of subsequences after several iterations which are assumed to be the shots present in the given video. The proposed method is experimentally tested on video samples from TrecVid 2002 dataset and YouTube online database. We have obtained overall accuracy of 85.5% Precision, 87.1% Recall and 86.1% F-measure for the dataset used. A comparative study of the proposed approach with the contemporary research works is also carried out.


color quantization color histograms split and merge fishers linear discriminant analysis shot boundary detection 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Idris, F., Panchanathan, S.: Review of image and video indexing techniques. J. Vis. Commun. Image Represent. 8(2), 146–166 (1997)CrossRefGoogle Scholar
  2. 2.
    Brunelli, R., Mich, O., Modena, C.M.: A survey on the automatic indexing of video data. J. Vis. Commun. Image Represent. 10, 78–112 (1999)CrossRefGoogle Scholar
  3. 3.
    Koprinska, I., Carrato, S.: Temporal video segmentation: a survey. Signal Processing: Image Communication 16(5), 477–500 (2001)Google Scholar
  4. 4.
    Lefevre, S., Holler, J., Vincent, N.: A review of real-time segmentation of uncompressed video sequences for content-based search and retrieval. Real-Time Imaging 9(1), 73–98 (2003)CrossRefGoogle Scholar
  5. 5.
    Patel, B.V., Shah, B.B.: Content based video retrieval systems. Int. J. Ubi Comp. 3(2), 13–30 (2012)CrossRefGoogle Scholar
  6. 6.
    Kanagavalli, R., Duraiswamy, K.: A study on techniques used in digital video for shot segmentation and content based video retrieval. European Journal of Scientific Research 69(3), 370–380 (2012)Google Scholar
  7. 7.
    Mittal, A., Cheong, L., Sing, L.: Robust identification of gradual shot-transition types. In: Proceedings of 2002 International Conference on Image Processing, vol. 2, pp. 413–416 (2002)Google Scholar
  8. 8.
    Patel, N.V., Sethi, I.K.: Video shot detection and characterization for video databases. Pattern Recognition 30, 583–592 (1997)CrossRefGoogle Scholar
  9. 9.
    Yuan, J., Wang, H., Xiao, L., Zheng, W., Li, J., Lin, F., Zhang, B.: A formal study of shot boundary detection. IEEE Trans. on Circuits and Systems for Video Technology 17(2), 168–186 (2007)CrossRefGoogle Scholar
  10. 10.
    Zhang, C., Wang, W.A.: Robust and efficient shot boundary detection approach based on fisher criterion. In: Proceedings of the 20th ACM International Conference on Multimedia (MM 2012), pp. 701–704. ACM, New York (2012)Google Scholar
  11. 11.
    Onur, K., Ugur, G., Ozgur, U.: Fuzzy color histogram-based video segmentation. Computer Vision and Image Understanding 114(1), 125–134 (2010)CrossRefGoogle Scholar
  12. 12.
    Abdelati, M.A., Ben, A.A., Mtibaa, A.: Video shot boundary detection using motion activity descriptor. J. Telecommun. 2(1), 54–59 (2010)Google Scholar
  13. 13.
    Chen, W., Zhang, Y.: Parametric model for video content analysis. Pattern Recogn. Lett. 29(3), 181–191 (2008)CrossRefMATHGoogle Scholar
  14. 14.
    Massimiliano, A., Chianese, A., Moscato, V., Sansone, L.: A formal model for video shot segmentation and its application via animate vision. Multimedia Tools Appl. 24(3), 253–272 (2004)CrossRefGoogle Scholar
  15. 15.
    Damnjanovic, U., Izquierdo, E., Grzegorzek, M.: Shot boundary detection using spectral clustering. In: 15th European Signal Processing Conference (EUSIPCO 2007), Poznan, Poland, pp. 1779–1783 (2007)Google Scholar
  16. 16.
    Wang, P., Liu, Z., Yang, S.: Investigation on unsupervised clustering algorithms for video shot categorization. Journal of Soft Comput. 11(4), 355–360 (2006)CrossRefMathSciNetGoogle Scholar
  17. 17.
    Yuchou, C., Lee, D.J., Yi, H., James, A.: Unsupervised video shot detection using clustering ensemble with a color global scale-invariant feature transform descriptor. J. Image Video Proc. 1, 1–10 (2008)Google Scholar
  18. 18.
    Manjunath, S., Guru, D.S., Suraj, M.G., Harish, B.S.: A non-parametric shot boundary detection: an Eigen gap based approach. In: Proceedings of Fourth Annual ACM Bangalore Conference, vol. 1, pp. 1030–1036Google Scholar
  19. 19.
    Wang, H., Divakaran, A., Vetro, A., Chang, S.F., Sun, H.: Survey of compressed-domain features used in audio-visual indexing and analysis. J. Visual. Commun. Image Represent. 14, 150–183 (2003)CrossRefGoogle Scholar
  20. 20.
    Bruyne, S.D., Deursen, D.V., Cock, J.D., Neve, W.D., Lambert, P., Walle, R.V.D.: A compressed-domain approach for shot boundary detection on H.264/AVC bit streams. Signal Processing: Image Communication 23, 473–489 (2008)Google Scholar
  21. 21.
    Chen, J., Ren, J., Jiang, J.: Modelling of content-aware indicators for effective determination of shot boundaries in compressed MPEG videos. Multimedia Tools Appl. 54(2), 219–239 (2011)CrossRefGoogle Scholar
  22. 22.
    Jacobs, A., Miene, A., Ioannidis, G.T., Herzog, O.: Automatic shot boundary detection combining color, edge, and motion features of adjacent frames (2004), www-nlpir.nist.gov/projects/tvpubs/tvpapers04/ubremen.pdf
  23. 23.
    Chang, Y., Lee, D.J., Hong, Y., Archibald, J.: Unsupervised video shot detection using clustering ensemble with a color global scale-invariant feature transform descriptor. J. Image Video Process. 9, 10 (2008)Google Scholar
  24. 24.
    Philips, M., Wolf, W.: A multi-attribute shot segmentation algorithm for video programs. Telecommunication Systems 9(3-4), 393–402 (1998)CrossRefGoogle Scholar
  25. 25.
    Boreczky, J.S., Rowe, L.A.: Comparison of video shot boundary detection techniques. J. Electron Imaging 5(2), 122–128 (1996)CrossRefGoogle Scholar
  26. 26.
    Alan, F.S., Palu, O., Aiden, R.D.: Video shot boundary detection: Seven years of TRECVid activity. Comput. Vis. Image Und. 114(4), 411–418 (2010)CrossRefGoogle Scholar
  27. 27.
    Mishra, R., Singhai, S.: A review on different methods of video shot boundary detection. International Journal of Management IT and Engineering 2(9), 46–57 (2012)Google Scholar
  28. 28.
    Guru, D.S., Suhil, M., Lolika, P.: A novel approach for shot boundary detection in videos. In: Multimedia processing, communication and computing applications. LNEE, vol. 213, pp. 209–220. Springer (2013)Google Scholar
  29. 29.
    Mas, J., Fernandez, G.: Video shot boundary detection using color histogram (2003), http://www-nlpir.nist.gov/projects/tvpubs/tvpapers03/ramonlull.paper.pdf
  30. 30.
    Gonzalez, R.C., Woods, R.E.: Digital Image Processing. PHI Learning Private Limited, New Delhi-110001 (2008)Google Scholar
  31. 31.
    Max Welling.:Fisher linear discriminant analysis. Max welling’s classnotes in machine learning.  16(7), 817–830, http://www.ics.uci.edu/~welling/classnotes/classnotes.html
  32. 32.
    Nagabhushana, P., Guru, D.S., Shekara, B.H. (2D)2 FLD: An efficient approach for appearance based object recognition. Neurocomputing. 69, 934–940 (2006)CrossRefGoogle Scholar
  33. 33.
    Atmel, A.M., Abdessalem, B.A., Abdellatif, M.: Video shot boundary detection using motion activity descriptor. Journal of Telecommunications. 2(1), 54–59 (2010)Google Scholar
  34. 34.
    Zhang, C., Wang, W.: A robust and efficient shot boundary detection approach based on fisher criterion. In: Proceedings of 20th ACM International Conference on Multimedia, vol. 5, pp. 701–704 (2012) ISBN: 978-1-4503-1089-5, doi:10.1145/2393347.2396291Google Scholar

Copyright information

© Springer International Publishing Switzerland 2013

Authors and Affiliations

  • D. S. Guru
    • 1
  • Mahamad Suhil
    • 1
  1. 1.Department of Studies in Computer ScienceMysoreIndia

Personalised recommendations