Skip to main content
Log in

Production model based digital video segmentation

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript


Effective and efficient tools for segmenting and content-based indexing of digital video are essential to allow easy access to video-based information. Most existing segmentation techniques do not use explicit models of video. The approach proposed here is inspired and influenced by well established video production processes. Computational models of these processes are developed. The video models are used to classify the transition effects used in video and to design automatic edit effect detection algorithms. Video segmentation has been formulated as a production model based classification problem. The video models are also used to define segmentation error measures. Experimental results from applying the proposed technique to commercial cable television programming are presented.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others


  1. Farshid Arman, Arding Hsu, and Ming-Yee Chiu. Image processing on compressed data for large video databases. InProceedings of the ACM MultiMedia, pages 267–272, California, USA, June 1993. Association of Computing Machinery.

    Google Scholar 

  2. David Bordwell and Thompson Kristin.Film Art: An Introduction. Addison-Wesley Publishing Company, 1980.

  3. Richard O Duda and Peter E Hart.Pattern Classification and Scene Analysis. A Wiley-Interscience Publication. John Wiley and Sons, 1973.

  4. Claude L Fenema and William B Thompson. Velocity determination in scenes containing several moving objects.Computer Graphics and Image Processing, 9:301–315, 1979.

    Google Scholar 

  5. Foley, vanDam, Feiner, and Hughes.Computer Graphics: Principles and Practice. The Systems Programming Series. Addison Wesley, 1990.

  6. Anderson H Gary.Video Editing and Post Production: A Professional Guide. Knowledge Industry Publications, 1988.

  7. Laurence Goldstein and Jay Kaufman.Into Film. E P Dutton and Co, 1976.

  8. Arun Hampapur.Designing Video Data Management Systems. PhD Thesis, The University of Michigan, 1994.

  9. Arun Hampapur, Ramesh Jain, and Terry Weymouth. Digital video indexing in multimedia systems. InProoceedings of the Workshop on Indexing and Reuse in Multimedia Systems. American Association of Artificial Intelligence, August 1994.

  10. Arun Hampapur, Ramesh Jain, and Terry Weymouth. Digital video segmentation. InProoceedings Second Annual ACM MultiMedia Conference and Exposition. Association of Computing Machinery, October 1994.

  11. Berthold K. P. Horn and Brian G. Schunck. Determining optical flow.Artificial Intelligence, 17:185–203, 1981.

    Google Scholar 

  12. R Jain. Difference and accumulative difference pictures in dynamic scene analysis.Image and Vision Computing, Vol 2(No 2):99–108, May 1984.

    Google Scholar 

  13. R Jain and H H Nagel. On the analysis of accumulative difference pictures from image sequences of real world scenes.IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol 1(No 2):206–214, April 1979.

    Google Scholar 

  14. Ramesh Jain and Arun Hampapur. Metadata in video databases. InTo appear Sigmod Record: Special Issue On Metadata For Digital Media. ACM: SIGMOD, December 1994.

  15. Ramesh Jain, Rangachar Kasturi, and Brian G Schunck.(To be published) Introduction to Machine Vision. McGraw Hill, 1995.

  16. Zvi Kohavi.Switching and Finite Automata Theory. Computer Science Series. McGraw Hill, 1978.

  17. Ira Konigsberg.The Complete Film Dictionary. Penguin Books, 1989.

  18. J O Limb and J A Murphy. Estimating the velocity of moving images in television signals.Computer Graphics and Image Processing, 4:311–327, 1975.

    Google Scholar 

  19. Akio Nagasaka and Yuzuru Tanaka. Automatic video indexing and full-video search for object appearances. In2nd Working Conference on Visual Database Systems, pages 119–133, Budapest, Hungary, October 1991. IFIP WG 2.6.

    Google Scholar 

  20. Azriel Rosenfeld and Avinash C Kak.Digital Picture Processing Vol 1,2. Academic Press, 1976.

  21. Ishwar K Sethi and Ramesh Jain. Finding trajectories of feature points in a monocular image sequence.IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol 9(No 1):56–73, January 1987.

    Google Scholar 

  22. Yoshinobu Tonomura, Akihito Akutsu, Yukinobu Taniguchi, and Gen Suzuki. Structured video computing.IEEE Multimedia, 1(3):34–43, Fall 1994.

    Google Scholar 

  23. George Wolberg.Digital Image Warping. IEEE Computer Society Press, 1992.

  24. H J Zhang, A Kankanhalli, and S W Smoliar. Automatic partitioning of video.Multimedia Systems, 1(1):10–28, 1993.

    Google Scholar 

Download references

Author information

Authors and Affiliations


Rights and permissions

Reprints and permissions

About this article

Cite this article

Hampapur, A., Jain, R. & Weymouth, T.E. Production model based digital video segmentation. Multimed Tools Appl 1, 9–46 (1995).

Download citation

  • Issue Date:

  • DOI: