Dynamic Generation of Intelligent Multimedia Presentations through Semantic Inferencing
This paper first proposes a high-level architecture for semiautomatically generating multimedia presentations by combining semantic inferencing with multimedia presentation generation tools. It then describes a system, based on this architecture, which was developed as a service to run over OAI archives— but is applicable to any repositories containing mixed-media resources described using Dublin Core. By applying an iterative sequence of searches across the Dublin Core metadata, published by the OAI data providers, semantic relationships can be inferred between the mixed-media objects which are retrieved. Using predefined mapping rules, these semantic relationships are then mapped to spatial and temporal relationships between the objects. The spatial and temporal relationships are expressed within SMIL files which can be replayed as multimedia presentations. Our underlying hypothesis is that by using automated computer processing of metadata to organize and combine semantically-related objects within multimedia presentations, the system may be able to generate new knowledge by exposing previously unrecognized connections. In addition, the use of multilayered information-rich multimedia to present the results, enables faster and easier information browsing, analysis, interpretation and deduction by the end-user.
KeywordsResource Description Framework Semantic Relation Semantic Relationship Media Object Multimedia Presentation
Unable to display preview. Download preview PDF.
- 1.Tim Berners-Lee, James Hendler, and Ora Lassila. The Semantic Web. Scientific American, May 2001.Google Scholar
- 2.Dublin Core Community. Dublin Core Element Set, Version 1.1. See http://www.dublincore.org/documents/dces/, 07/02 1999.
- 3.OAI Community. OAI Protocol for Metadata Harvesting 2.0. See http://www.openarchives.org/OAI/openarchivesprotocol.html.
- 4.OAI Community. Open Archives Initiative. See http://www.openarchives.org/.
- 5.OAI Community. Open Archives Initiative Registered Service Providers. See http://www.openarchives.org/service/listproviders.html.
- 6.T. Rist E. Andr. Generating Coherent Presentations Employing Textual and Visual Material. In Artificial Intelligente Review, Special Volume on the Integration of Natura1 Language and Vision Processing, 9(2–3):147–165, 1995.Google Scholar
- 7.Gregory Karvounarakis et al. RQL: A Declarative Query Language for RDF. In WWW2002 Conference, Honolulu, May 2002.Google Scholar
- 8.T. Cole et al. Now ThatWe’ve Found the ‘HiddenWeb’ What CanWe DO With It? The Illinois Open Archives Initiative Metadata Harvesting Experience. In Museums on the Web Conference 2002, Boston, April 2002.Google Scholar
- 9.Jane Hunter. Adding Multimedia to the Semantic Web— Building an Mpeg-7 Ontology. In International Semantic Web Working Symposium (SWWS), Stanford, July 2001.Google Scholar
- 10.USC Information Science Institute. Webscripter Project Overview. See http://www.isi.edu/webscripter/.
- 11.Intellidimension. Intellidimension’s RDF Gateway. See http:// www.intellidimension.com/RDFGateway/.
- 13.Carl Lagoze and Jane Hunter. The ABC Ontology and Model. Journal of Digital Information, 2(2), 2001.Google Scholar
- 14.Alberto Reggiori Libby Miller, Andy Seaborne. Three Implernentations of SquishQL, a Simple RDF Query Language. In 1st International Semantic Web Conference ISWC2002, Sardinia, June 9–12 2002.Google Scholar
- 15.Library of Congress. Library of Congress: American Memory Collection. See http://memory.loc.gov/.
- 16.University of Illinois Library. University of Illinois Open Archives Collection. See http://bolder.grainger.uiuc.edu/uiLibOAIProvider/OAI.asp.
- 17.OpenVideo Organisation. OpenVideo. See http://www.open-video.org/oai/.
- 18.Gustavo Rossi, Daniel Schwabe, and Alejandra Garrido. Design Reuse in Hypermedia Applications Development. In The Proceedings of the Eighth ACM Conference on Hypertext und Hypermedia, pages 57–66, Southampton, UK, April 1997. ACM, ACM Press.Google Scholar
- 19.Lloyd Rutledge, Jim Davis, Jacco van Ossenbruggen, and Lynda Hardman. Interdimensional Hypermedia Communicative Devices for Rhetorical Structure. In Proceedings of the International Conference on Multimedia Modeling 2000 (MMM00), pages 89–105, Nagano, Japan, November 13–15, 2000.Google Scholar
- 20.Michael Sintek and Stefan Decker. TRIPLE— A Query, Inference, and Transformation Language for the Semantic Web. In 1st International Semantic Web Conference ISWC2002, Sardinia, June 9–12 2002.Google Scholar
- 21.Robert Tansley. The Multimedia Thesaurus: Adding a Semantic Layer to Multimedia Information. PhD thesis, Dept. of Electronics and Computer Science, Uni. of Southhampton, August 2000.Google Scholar
- 22.Douglas Tudhope and Daniel Cunliffe. Semantically Indexed Hypermedia: Linking Information Disciplines. ACM Computing Surveys, 31(4es), December 1999.Google Scholar
- 23.Frank van Harmelen, Peter F. Patel-Schneider, and Ian Herrocks. Reference description of the DAML+OIL (March 2001) ontology markup language. http://www.daml.org/2001/03/reference.html. Contributors: Tim Berners-Lee, Dan Brickley, Dan Connolly, Mike Dean, Stefan Decker, Pat Hayes, Jeff Heflin, Jim Hendler, Ora Lassila, Deb McGuinness, Lynn Andrea Stein,...
- 24.Jacco van Ossenbruggen, Joost Geurts, Frank Cornelissen, Lloyd Rutledge, and Lynda Hardman. Towards Second and Third Generation Web-Based Multimedia. In The Tenth International World Wide Web Conference, pages 479–488, Hong Kong, May 1–5, 2001. IW3C2.Google Scholar
- 25.W3C. Semantic Web Activity. See http://www.w3.org/2001/sw/.
- 26.W3C. Resource Description Framework (RDF) Model and Syntax Specification. W3C Recommendations are available at http://www.w3.org/TR, February, 22, 1999. Editied by Ora Lassila and Ralph R. Swick.
- 27.W3C. Synchronized Multimedia Integration Language (SMIL 2.0) Specification. W3C Recommendations are available at http:// www.wS.org/TR/, August 7, 2001. Edited by Aaron Cohen.
- 28.W3C. RDF Vocabulary Description Language 1.0: RDF Schema. W3C Candidate Recommendations are available at http://www.w3.org/TR, 30 April 2002. Edited by Dan Brickley and R.V. Guha.