Dynamic Generation of Intelligent Multimedia Presentations through Semantic Inferencing

  • Suzanne Little
  • Joost Geurts
  • Jane Hunter
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2458)


This paper first proposes a high-level architecture for semiautomatically generating multimedia presentations by combining semantic inferencing with multimedia presentation generation tools. It then describes a system, based on this architecture, which was developed as a service to run over OAI archives— but is applicable to any repositories containing mixed-media resources described using Dublin Core. By applying an iterative sequence of searches across the Dublin Core metadata, published by the OAI data providers, semantic relationships can be inferred between the mixed-media objects which are retrieved. Using predefined mapping rules, these semantic relationships are then mapped to spatial and temporal relationships between the objects. The spatial and temporal relationships are expressed within SMIL files which can be replayed as multimedia presentations. Our underlying hypothesis is that by using automated computer processing of metadata to organize and combine semantically-related objects within multimedia presentations, the system may be able to generate new knowledge by exposing previously unrecognized connections. In addition, the use of multilayered information-rich multimedia to present the results, enables faster and easier information browsing, analysis, interpretation and deduction by the end-user.


Resource Description Framework Semantic Relation Semantic Relationship Media Object Multimedia Presentation 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Tim Berners-Lee, James Hendler, and Ora Lassila. The Semantic Web. Scientific American, May 2001.Google Scholar
  2. 2.
    Dublin Core Community. Dublin Core Element Set, Version 1.1. See, 07/02 1999.
  3. 3.
    OAI Community. OAI Protocol for Metadata Harvesting 2.0. See
  4. 4.
    OAI Community. Open Archives Initiative. See
  5. 5.
    OAI Community. Open Archives Initiative Registered Service Providers. See
  6. 6.
    T. Rist E. Andr. Generating Coherent Presentations Employing Textual and Visual Material. In Artificial Intelligente Review, Special Volume on the Integration of Natura1 Language and Vision Processing, 9(2–3):147–165, 1995.Google Scholar
  7. 7.
    Gregory Karvounarakis et al. RQL: A Declarative Query Language for RDF. In WWW2002 Conference, Honolulu, May 2002.Google Scholar
  8. 8.
    T. Cole et al. Now ThatWe’ve Found the ‘HiddenWeb’ What CanWe DO With It? The Illinois Open Archives Initiative Metadata Harvesting Experience. In Museums on the Web Conference 2002, Boston, April 2002.Google Scholar
  9. 9.
    Jane Hunter. Adding Multimedia to the Semantic Web— Building an Mpeg-7 Ontology. In International Semantic Web Working Symposium (SWWS), Stanford, July 2001.Google Scholar
  10. 10.
    USC Information Science Institute. Webscripter Project Overview. See
  11. 11.
    Intellidimension. Intellidimension’s RDF Gateway. See http://
  12. 13.
    Carl Lagoze and Jane Hunter. The ABC Ontology and Model. Journal of Digital Information, 2(2), 2001.Google Scholar
  13. 14.
    Alberto Reggiori Libby Miller, Andy Seaborne. Three Implernentations of SquishQL, a Simple RDF Query Language. In 1st International Semantic Web Conference ISWC2002, Sardinia, June 9–12 2002.Google Scholar
  14. 15.
    Library of Congress. Library of Congress: American Memory Collection. See
  15. 16.
    University of Illinois Library. University of Illinois Open Archives Collection. See
  16. 17.
    OpenVideo Organisation. OpenVideo. See
  17. 18.
    Gustavo Rossi, Daniel Schwabe, and Alejandra Garrido. Design Reuse in Hypermedia Applications Development. In The Proceedings of the Eighth ACM Conference on Hypertext und Hypermedia, pages 57–66, Southampton, UK, April 1997. ACM, ACM Press.Google Scholar
  18. 19.
    Lloyd Rutledge, Jim Davis, Jacco van Ossenbruggen, and Lynda Hardman. Interdimensional Hypermedia Communicative Devices for Rhetorical Structure. In Proceedings of the International Conference on Multimedia Modeling 2000 (MMM00), pages 89–105, Nagano, Japan, November 13–15, 2000.Google Scholar
  19. 20.
    Michael Sintek and Stefan Decker. TRIPLE— A Query, Inference, and Transformation Language for the Semantic Web. In 1st International Semantic Web Conference ISWC2002, Sardinia, June 9–12 2002.Google Scholar
  20. 21.
    Robert Tansley. The Multimedia Thesaurus: Adding a Semantic Layer to Multimedia Information. PhD thesis, Dept. of Electronics and Computer Science, Uni. of Southhampton, August 2000.Google Scholar
  21. 22.
    Douglas Tudhope and Daniel Cunliffe. Semantically Indexed Hypermedia: Linking Information Disciplines. ACM Computing Surveys, 31(4es), December 1999.Google Scholar
  22. 23.
    Frank van Harmelen, Peter F. Patel-Schneider, and Ian Herrocks. Reference description of the DAML+OIL (March 2001) ontology markup language. Contributors: Tim Berners-Lee, Dan Brickley, Dan Connolly, Mike Dean, Stefan Decker, Pat Hayes, Jeff Heflin, Jim Hendler, Ora Lassila, Deb McGuinness, Lynn Andrea Stein,...
  23. 24.
    Jacco van Ossenbruggen, Joost Geurts, Frank Cornelissen, Lloyd Rutledge, and Lynda Hardman. Towards Second and Third Generation Web-Based Multimedia. In The Tenth International World Wide Web Conference, pages 479–488, Hong Kong, May 1–5, 2001. IW3C2.Google Scholar
  24. 25.
    W3C. Semantic Web Activity. See
  25. 26.
    W3C. Resource Description Framework (RDF) Model and Syntax Specification. W3C Recommendations are available at, February, 22, 1999. Editied by Ora Lassila and Ralph R. Swick.
  26. 27.
    W3C. Synchronized Multimedia Integration Language (SMIL 2.0) Specification. W3C Recommendations are available at http://, August 7, 2001. Edited by Aaron Cohen.
  27. 28.
    W3C. RDF Vocabulary Description Language 1.0: RDF Schema. W3C Candidate Recommendations are available at, 30 April 2002. Edited by Dan Brickley and R.V. Guha.

Copyright information

© Springer-Verlag Berlin Heidelberg 2002

Authors and Affiliations

  • Suzanne Little
    • 1
  • Joost Geurts
    • 2
  • Jane Hunter
    • 3
  1. 1.ITEE Dept.University of QueenslandQueensland
  2. 2.CWIAmsterdam
  3. 3.DSTCBrisbane

Personalised recommendations