Modelling the retrieval of structured documents containing texts and images
We present a model for complex documents possibly consisting of a hierarchically structured set of images or texts. Documents are represented both at the form level (as sets of physical features of the representing objects), at the content level (as sets of properties of the represented entities), and at the structure level. A uniform and powerful query language allows queries to be issued that transparently combine features pertaining to form, content and structure alike. Queries are expressions of a (fuzzy) logical language. While that part of the query that pertains to (medium-independent) content is “directly” processed by an inferential engine, that part that pertains to (medium-dependent) form is entrusted to specialised document processing procedures linked to the logical language by a procedural attachment mechanism. The model thus combines the power of state-of-the-art document processing techniques with the advantages of a clean, logically defined framework for understanding multimedia document retrieval.
KeywordsImage Retrieval Query Language Image Query Content Description Predicate Symbol
Unable to display preview. Download preview PDF.
- 1.S. Abiteboul, R. Hull, and V. Vianu. Foundations of databases. Addison Wesley, Reading, MA, 1995.Google Scholar
- 2.F. Baader and P. Hanschke. A schema for integrating concrete domains into concept languages. In Proceedings of IJCAI-91, International Joint Conference on Artificial Intelligence, pages 452–457, Sydney, 1991.Google Scholar
- 3.J. R. Bach, C. Fuller, A. Gupta, A. Hampapur, B. Horowitz, R. Humphrey, R. Jain, and C.-F. Shu. The Virage image search engine: an open framework for image management. In Storage and Retrieval for Still Image and Video Databases IV, volume 2670 of SPIE Proceedings, pages 76–87, San Jose, CA, February 1996.Google Scholar
- 5.J. Chen and S. Kundu. A sound and complete fuzzy logic system using Zadeh's implication operator. In Z. W. Ras and M. Michalewicz, editors, Proceedings of ISMIS-96, 9th International Symposium on Methodologies for Intelligent Systems, pages 233–242, Zakopane, PL, 1996.Google Scholar
- 6.A. G. Cohn. Calculi for qualitative spatial reasoning. In Proceedings of AISMC-3, Lecture Notes in Computer Science. Springer Verlag, 1996.Google Scholar
- 9.V. N. Gudivada and V. V. Raghavan, editors. IEEE Computer. Special Issue on Content-Based Image Retrieval. IEEE, September 1995.Google Scholar
- 11.C. Meghini. An image retrieval model based on classical logic. In Proceedings of SIGIR-95, pages 300–308, Seattle, WA, 1995.Google Scholar
- 12.C. Meghini, F. Sebastiani, U. Straccia, and C. Thanos. A model of information retrieval based on a terminological logic. In Proceedings of SIGIR-93, pages 298–307, Pittsburgh, PA, July 1993.Google Scholar
- 13.C. Meghini and U. Straccia. A relevance terminological logic for information retrieval. In Proceedings of SIGIR-96, pages 197–205, Zurich, CH, August 1996.Google Scholar
- 14.G. Navarro and R. Baeza-Yates. A language for queries on structure and contents of textual databases. In Proceedings of SIGIR-95, pages 93–101, Seattle, WA, Jul 1995.Google Scholar
- 15.A. Rosenfeld and A. C. Kak. Digital picture processing. Academic Press, New York, 2nd edition, 1982.Google Scholar
- 17.A. F. Smeaton and I. Quigley. Experiments on using semantic distances between words in image caption retrieval. In Proceedings of SIGIR96, pages 174–180, Zurich, CH, August 1996.Google Scholar