Bridging the Semantic Gap in Content Management Systems

Computational Media Aesthetics
  • Chitra Dorai
  • Svetha Venkatesh
Part of the The Springer International Series in Video Computing book series (VICO, volume 4)


With the explosion of digital media and online services, a key challenge in the area of media management is automation of content annotation, indexing, and organization for efficient media access, search, retrieval, and browsing. A major failing of current media annotation systems is the semantic gap — the incompatibility between the low-level features that can be currently computed automatically to describe media content and the high-level meaning associated with the content by users in media search and retrieval. This inevitably leads to the problem of content management systems returning media clips that are similar to one another in terms of low-level descriptions, but are completely different in terms of semantics sought by the users in their search. This chapter introduces Computational Media Aesthetics as an approach to bridging the semantic gap, outlines its foundations in media production principles, presents a computational framework to deriving high-level semantic constructs from media, and describes the structure of this collection.


Media archives digital content management video indexing content-based search and annotation semantic indexing MPEG-7 Computational Media Aesthetics semantic gap production knowledge film grammar 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    Arijon, D. Grammar of the Film Language. Silman-James Press, 1976.Google Scholar
  2. [2]
    Davis, M. Knowledge representation for video. In Proceedings of the National Conference on Artificial Intelligence (1994), vol. 1, pp. 120–127.Google Scholar
  3. [3]
    Dorai, C. and Venkatesh, S. Computational Media Aesthetics: Finding meaning beautiful. IEEE Multimedia 8, 4 (2001), pp. 10–12.Google Scholar
  4. [4]
    Lindley, C. A computational semiotic framework for interactive cinematic virtual worlds. In Workshop on Computational Semiotics for New Media (Guildford, Surrey, UK, 2000).Google Scholar
  5. [5]
    Smeulders, A., Worring, M., Santini, S., and Gupta, A. Content based image retrieval at the end of the early years. IEEE Transactions on Pattern Analysis and Machine Intelligence 22, 12 (2000), pp. 1349–1380.CrossRefGoogle Scholar
  6. [6]
    Sobchack, T. and Sobchack, V. An Introduction to Film. Scot, Foresman and Company, 1987.Google Scholar
  7. [7]
    Zettl, H. Sight, Sound, Motion: Applied Media Aesthetics. 3rd Edition, Wadsworth Pub Company, 1999.Google Scholar

Copyright information

© Springer Science+Business Media Dordrecht 2002

Authors and Affiliations

  • Chitra Dorai
    • 1
  • Svetha Venkatesh
    • 2
  1. 1.IBM Thomas J. Watson Research CenterYorktown HeightsUSA
  2. 2.Department of Computer ScienceCurtin University of TechnologyPerthAustralia

Personalised recommendations