A Survey on Video Segmentation

  • Dalton Meitei Thounaojam
  • Amit Trivedi
  • Kh. Manglem Singh
  • Sudipta Roy
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 243)


This paper presents a short survey on video segmentation. Due to the growth in multimedia information, an effective video indexing and video retrieval is necessary. This can be achieved when an effective video segmentation tools and algorithms are available. MPEG-compressed videos are mostly used by researchers for video segmentation. Shot boundary detection, color histogram characteristics, DC-images, motion vector and motion compensation, threshold-based detector, etc. are mostly used for video segmentation.


Shot MPEG Fade Dissolve Motons Color histogram 


  1. 1.
    Huang, C.L., Liao, B.Y.: A robust scene-change detection method for video segmentation. IEEE Trans. Circ. Syst. Video Technol. 11(12), 1281–1288 (2001)Google Scholar
  2. 2.
    Hampapur, A., Jain, R., Weymout, T.E.: Production model based digital video segmentation. Multimedia Tools Appl. 1(1), 9–46 (1995)Google Scholar
  3. 3.
    Hauptman, A.G., Smith, M.A.: Text, speech and vision for video segmentation: The Informedia TM Project. In: Proceeding of AAAI Fall Symposium Computational Models for Integrating Language and Vision, Boston (1995)Google Scholar
  4. 4.
    Boreczky, J.S., Wilcox, L.D.: A Hidden Markov model framework for video segmentation using audio and image features. In: IEEE International Conference on Acoustics, Speech and Signal Processing, (1998)Google Scholar
  5. 5.
    Huang, J., Liu, Z., Wang, Y.: Integration of audio and visual information for content-based video segmentation. In: International Conference on Image Processing, ICPI, vol. 3, pp. 526–529 (1998)Google Scholar
  6. 6.
    Fukunaga, K., Hostetler, L.: The estimation of the gradient of a density function, with applications in pattern recognition. IEEE Trans. Inf. Theory 21(1), 32–40 (1975)Google Scholar
  7. 7.
    Black, M.J.: Combining intensity and motion for incremental segmentation and tracking over long image sequences. ECCV (1992)Google Scholar
  8. 8.
    Arman, F., Hsu, A., Chiu, M-Y.: Image processing on compressed data for large video databases. In: Proceedings of ACM Multimedia, pp. 267–272 (1993)Google Scholar
  9. 9.
    Alattar, A.M.: Detecting and compressing dissolve regions in video sequences with DVI multimedia image compression algorithm. ISCAS, pp. 13–16 (1993)Google Scholar
  10. 10.
    Zhang, H.J., Kankanhalli, A., Smoliar, S.W.: Automatic partitioning of full-motion video. Multimedia Syst. 1(1), 10–28 (1993)Google Scholar
  11. 11.
    Hampapur, A., Jain, R., Weymouth, T.: Digital video segmentation. In: Processing of Multimedia, ACM (1994)Google Scholar
  12. 12.
    Tonomura, Y., Akutsu, A., Taniguchi, Y., Suzuki, G.: Structured video computing. IEEE Multimedia 1(3), 34–43 (1994)CrossRefGoogle Scholar
  13. 13.
    Meng, J., Juan, Y., Chang, S-F.: Scene change detection in a MPEG compressed video sequence. IS&T/SPIE Symposium Proceedings, vol. 2419, California (1995)Google Scholar
  14. 14.
    Wang, D.: Unsupervised video segmentation based on watersheds and temporal tracking. IEEE Trans. Circ. Syst. Video Technol. 8(5), 539–546 (1998)Google Scholar
  15. 15.
    Salembier, P., Marques, F.: Region-based representations of image and video: segmentation tools for multimedia services. IEEE Trans. Circ. Syst. Video Technol. 9(8) 1147–1169(1999)Google Scholar
  16. 16.
    Meier, T., Ngan, K.N.: Video segmentation for content-based coding. IEEE Trans. Circ. Syst. Video Technol. 9(8) 1190–1203(1999)Google Scholar
  17. 17.
    Altunbasak, Y.: A statistical approach to threshold selection in temporal video segmentation algorithms. In: IEEE International Conference on ASSP (2000)Google Scholar
  18. 18.
    Truong, B.T., Dorai,C., Venkatesh, S.: New enhancements to cut, fade, and dissolve detection processes in video segmentation. In: Proceedings of the eighth ACM international conference on Multimedia (2000)Google Scholar
  19. 19.
    Jadon, R.S., Chaudhury, S.K., Biswas, KK.: A fuzzy theoretic approach for video segmentation using syntactic features. Pattern Recogn. Lett. 22(13), 1359–1369 (2001)Google Scholar
  20. 20.
    Lo, C.C., Wang, S.J.: Video segmentation using a histogram based fuzzy c-means clustering algorithm. Comput. Stand. Interfaces 23(5), 429–438 (2001)Google Scholar
  21. 21.
    Xu, P., Xie, L., Chang, S.F., Divakaran, A., Vetro, A., Sun H.: Algorithms and system for segmentation and structure analysis in soccer video. In: IEEE International Conference on Multimedia and Expo (ICME) (2001)Google Scholar
  22. 22.
    Khan, S., Shah, M.: Object based segmentation of video using color, motion and spatial information. In: IEEE Proceeding on CVPR, vol. 2 (2001)Google Scholar
  23. 23.
    Patras, I., Hendriks, E.A., Lagendijk, R.L.: Video segmentation by MAP labeling of watershed segments. IEEE Trans. Pattern Anal. Mach. Intell. 23(3), 326–332 (2001)Google Scholar
  24. 24.
    DeMenthon, D.: Spatio-temporal segmentation of video by hierarchical mean shift analysis. Statistical Methods in Video Processing Workshop (2002)Google Scholar
  25. 25.
    Lu, Y., Gao, W., Wu, F.: Automatic video segmentation using a novel background model. In: IEEE International Symposium on Circuits and Systems (2002)Google Scholar
  26. 26.
    Sifakis, E., Grinias, I., Tziritas, G.: Video segmentation using fast marching and region growing algorithms. J. Appl. Sig. Process. 4, 379–388 (2002)Google Scholar
  27. 27.
    Chien, S.Y., Huang, Y.W., Chen, L.G.: Predictive watershed: a fast watershed algorithm for video segmentation. IEEE Trans. Circ. Syst. Video Technol. 13(5), 453–461 (2003)Google Scholar
  28. 28.
    Porter, S., Mirmehdi, M., Thosmas, B.: Temporal video segmentation and classification of edit effects. Image Vis. Comput. 21(13), 1097–1106 (2003)Google Scholar
  29. 29.
    Guimaraes, S.J.F., Couprie, M., Araujo, A.D.A., Leite, N.J.: Video segmentation based on 2D image analysis. Pattern Recogn. Lett. 24(7), 947–957 (2003)Google Scholar
  30. 30.
    Qi, Y., Hauptmann, A., Liu, T.: Supervised classification for video shot segmentation. In: Proceeding IEEE Conference Multimedia Expo, vol. 2, pp. 689–692 (2003)Google Scholar
  31. 31.
    Wang, J., Thiesson, B., Xu, Y., Cohen, M.: Image and Video Segmentation by Anisotropic Kernel Mean Shift. In: Computer Vision-ECCV, pp. 238–249. Springer, Berlin (2004)Google Scholar
  32. 32.
    Fang, H., Yin, Y., Norhashimah, P., Jiang, J.: A hybrid scheme for temporal video segmentation. In: Proceedings of the Third IEEE International Workshop on Electronic Design, Test and Applications, (2005)Google Scholar
  33. 33.
    Boccignone, G., Chianese, A., Moscato, V., Picariello, A.: Foveated shot detection for video segmentation. IEEE Trans. Circ. Syst. Video Technol. 15(3), 365–377 (2005)Google Scholar
  34. 34.
    Apostoloff, N., Fitzgibbon, A.W.: Automatic video segmentation using spatiotemporal T-junctions. British Machine Vision Conference (2006)Google Scholar
  35. 35.
    Joyce, R.A., Liu, B.: Temporal segmentation of video using frame and histogram space. IEEE Trans. Multimedia 8(1) 130–140 (2006)Google Scholar
  36. 36.
    Wang, X., Wang, S., Chen, H.: A fast algorithm for MPEG video segmentation based on macroblock. Fourth International Conference on Fuzzy Systems and Knowledge Discovery (2007)Google Scholar
  37. 37.
    Tan, W., Teng, S., Zhang, W.: Research on video segmentation via active learning. Fourth International Conference on Image and Graphics (2007)Google Scholar
  38. 38.
    Pritch, Y., Rav-Acha, A., Peleg, S.: Non-chronological video synopsis and indexing. IEEE Trans. Pattern Anal. Mach. Intell. 30(11), 1971–1984 (2008)Google Scholar
  39. 39.
    Tziakos, I., Cavallaro, A., Xu, L.Q.: Video event segmentation and visualisation in non-linear subspace. Pattern Recogn. Lett. 30(2), 123–131 (2008)Google Scholar
  40. 40.
    Yin, P., Criminisi, A., Winn, J., Essa, I.: Bilayer segmentation of webcam videos using tree-based classifiers. IEEE Trans. Pattern Anal. Mach. Intell. 33(1), 30–42 (2011)Google Scholar
  41. 41.
    Hong, L., Lu, H., Xue, X.: A segmentation and graph-based video sequence matching method for video copy detection. IEEE Trans. Knowl. Data Eng. 1–1 (2012)Google Scholar

Copyright information

© Springer India 2014

Authors and Affiliations

  • Dalton Meitei Thounaojam
    • 1
    • 3
  • Amit Trivedi
    • 3
  • Kh. Manglem Singh
    • 2
  • Sudipta Roy
    • 1
  1. 1.Assam UniversitySilcharIndia
  2. 2.National Institute of Technology ManipurManipurIndia
  3. 3.National Institute of Technology SilcharSilcharIndia

Personalised recommendations