Abstract
Effective and efficient tools for segmenting and content-based indexing of digital video are essential to allow easy access to video-based information. Most existing segmentation techniques do not use explicit models of video. The approach proposed here is inspired and influenced by well established video production processes. Computational models of these processes are developed. The video models are used to classify the transition effects used in video and to design automatic edit effect detection algorithms. Video segmentation has been formulated as a production model based classification problem. The video models are also used to define segmentation error measures. Experimental results from applying the proposed technique to commercial cable television programming are presented.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Farshid Arman, Arding Hsu, and Ming-Yee Chiu. Image processing on compressed data for large video databases. InProceedings of the ACM MultiMedia, pages 267–272, California, USA, June 1993. Association of Computing Machinery.
David Bordwell and Thompson Kristin.Film Art: An Introduction. Addison-Wesley Publishing Company, 1980.
Richard O Duda and Peter E Hart.Pattern Classification and Scene Analysis. A Wiley-Interscience Publication. John Wiley and Sons, 1973.
Claude L Fenema and William B Thompson. Velocity determination in scenes containing several moving objects.Computer Graphics and Image Processing, 9:301–315, 1979.
Foley, vanDam, Feiner, and Hughes.Computer Graphics: Principles and Practice. The Systems Programming Series. Addison Wesley, 1990.
Anderson H Gary.Video Editing and Post Production: A Professional Guide. Knowledge Industry Publications, 1988.
Laurence Goldstein and Jay Kaufman.Into Film. E P Dutton and Co, 1976.
Arun Hampapur.Designing Video Data Management Systems. PhD Thesis, The University of Michigan, 1994.
Arun Hampapur, Ramesh Jain, and Terry Weymouth. Digital video indexing in multimedia systems. InProoceedings of the Workshop on Indexing and Reuse in Multimedia Systems. American Association of Artificial Intelligence, August 1994.
Arun Hampapur, Ramesh Jain, and Terry Weymouth. Digital video segmentation. InProoceedings Second Annual ACM MultiMedia Conference and Exposition. Association of Computing Machinery, October 1994.
Berthold K. P. Horn and Brian G. Schunck. Determining optical flow.Artificial Intelligence, 17:185–203, 1981.
R Jain. Difference and accumulative difference pictures in dynamic scene analysis.Image and Vision Computing, Vol 2(No 2):99–108, May 1984.
R Jain and H H Nagel. On the analysis of accumulative difference pictures from image sequences of real world scenes.IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol 1(No 2):206–214, April 1979.
Ramesh Jain and Arun Hampapur. Metadata in video databases. InTo appear Sigmod Record: Special Issue On Metadata For Digital Media. ACM: SIGMOD, December 1994.
Ramesh Jain, Rangachar Kasturi, and Brian G Schunck.(To be published) Introduction to Machine Vision. McGraw Hill, 1995.
Zvi Kohavi.Switching and Finite Automata Theory. Computer Science Series. McGraw Hill, 1978.
Ira Konigsberg.The Complete Film Dictionary. Penguin Books, 1989.
J O Limb and J A Murphy. Estimating the velocity of moving images in television signals.Computer Graphics and Image Processing, 4:311–327, 1975.
Akio Nagasaka and Yuzuru Tanaka. Automatic video indexing and full-video search for object appearances. In2nd Working Conference on Visual Database Systems, pages 119–133, Budapest, Hungary, October 1991. IFIP WG 2.6.
Azriel Rosenfeld and Avinash C Kak.Digital Picture Processing Vol 1,2. Academic Press, 1976.
Ishwar K Sethi and Ramesh Jain. Finding trajectories of feature points in a monocular image sequence.IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol 9(No 1):56–73, January 1987.
Yoshinobu Tonomura, Akihito Akutsu, Yukinobu Taniguchi, and Gen Suzuki. Structured video computing.IEEE Multimedia, 1(3):34–43, Fall 1994.
George Wolberg.Digital Image Warping. IEEE Computer Society Press, 1992.
H J Zhang, A Kankanhalli, and S W Smoliar. Automatic partitioning of video.Multimedia Systems, 1(1):10–28, 1993.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Hampapur, A., Jain, R. & Weymouth, T.E. Production model based digital video segmentation. Multimed Tools Appl 1, 9–46 (1995). https://doi.org/10.1007/BF01261224
Issue Date:
DOI: https://doi.org/10.1007/BF01261224