Abstract
We present an overview of a large combined querying and retrieval system that performs content-based on-line searches in a large database of multimedia documents (currently text, tables and colour images). Queries are submitted as sentences in natural language and are transformed into the language of the target database. The documents are analyzed semantically for their information content; in a data fusion step the individual pieces of information extracted from these documents are aggregated into cognitively adequate result documents.
There is no pre-indexing necessary when new documents are stored into the system. This retains a high degree of flexibility with respect to the questions that may be asked. It implies, however, that both huge amounts of data must be evaluated rapidly and that intelligent caching strategies must be employed. It is therefore mandatory that the system be equipped with dedicated high-speed hardware processors.
The complete system is currently available as a prototype; the paper outlines its architecture and gives examples of some real sample queries in the knowledge domain of weather data documents.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
A. Del Bimbo, M. Campanai, and P. Nesi. A three-dimensional iconic environment for image database querying. IEEE Trans. on Software Eng., 19(10):997–1011, October 1993.
A. Del Bimbo and P. Pala. Visual image retrieval by elastic matching of user sketches. IEEE Trans. on Patt. Anal. and Mach. Intell., 19(2):121–132, February 1997.
J. Biskup, J. Freitag, Y. Karabulut, and B. Sprick. A mediator for multimedia systems. In Proceedings 3rd International Workshop on Multimedia Information Systems, Como, Italia, Sept. 1997.
J. Biskup, J. Freitag, Y. Karabulut, and B. Sprick. Query evaluation in an object-oriented multimedia mediator. In Proceedings 4th International Conference on Object-Oriented Information Systems, Brisbane, Australia, Berlin, Nov. 1997. Springer.
I. Bloch. Information combination operators for data fusion: a comparative review with classification. IEEE Transactions on Systems, Man, and Cybernetics, 26(1):52–67, 1996.
Norbert Bröker, Udo Hahn, and Susanne Schacht. Concurrent lexicalized dependency parsing: The ParseTalk model. In Proceedings of the 15th International Conference on Computational Linguistics (COLING 94), 1994.
IBM Corp. http://www.software.ibm.com/data/mediaminer/immn0b15.html.
D. Dubois and H. Prade. Fuzzy cardinality and the modelling of imprecise quantification. Fuzzy Sets and Systems, 16:199–230, 1985.
Michael Eimermacher. Wortorientiertes Parsen. PhD thesis, TU Berlin, Berlin, 1988.
M. Flickner, H. Sawhney, W. Niblack, J. Ashley, Q. Huang, B. Dom, M. Gorkhani, J. Hafner, D. Lee, D. Petkovic, D. Steele, and P. Yanker. Query by image and video content: The QBIC system. IEEE Computer, 28(9), September 1995.
Michael Gansen, Frank Richter, Oliver Weiß, and Tobias G. Noll. A datapath generator for full custom macros of iterative logic arrays. Proceedings of the IEEE 1997 International Conference on Application Specific Systems, Architectures, and Processors, pages 438–447, July 1997.
Ingo Glöckner. DFS-an axiomatic approach to fuzzy quantification. Technical Report TR97-06, Technische Fakultät, Universität Bielefeld, 1997.
Sven Hartrumpf. Redundanzarme Lexika durch Vererbung. Master’s thesis, Universität Koblenz-Landau, Koblenz, June 1996.
Sven Hartrumpf. Partial evaluation for efficient access to inheritance lexicons. In Proceedings of the 2nd International Conference on Recent Advances in Natural Language Processing (RANLP-97), pages 43–50, Tzigov Chark, Bulgaria, September 1997.
Hermann Helbig. Syntactic-semantic analysis of natural language by a new word-class controlled functional analysis. Computers and Artificial Intelligence, 5(1):53–59, 1986.
Hermann Helbig. Der MESNET Primer-Die Darstellungsmittel der Mehrschichtigen Erweiterten Semantischen Netze. Technische Dokumentation, FernUniversität Hagen, Hagen, Germany, January 1997.
Hermann Helbig, Carsten Gnörlich, and Dirk Menke. Realization of a user-friendly access to networked information retrieval systems. In Proceedings of the AAAI Spring Symposium on Natural Language Processing for the World Wide Web, pages 62–71, Stanford, CA, 1997.
Hermann Helbig and Sven Hartrumpf. Word class functions for syntactic-semantic analysis. In Proceedings of the 2nd International Conference on Recent Advances in Natural Language Processing (RANLP-97), pages 312–317, Tzigov Chark, Bulgaria, September 1997.
Hermann Helbig and Andreas Mertens. Word Agent Based Natural Language Processing. In Loe Boves and Anton Nijholt, editors, Proceedings of the 8th Twente Workshop on Language Technology-Speech and Language Engineering, Twente, 1 and 2 December 1994, pages 65–74, Enschede, 1994. Universiteit Twente, Fakulteit Informatica.
Hermann Helbig and Marion Schulz. Knowledge representation with MESNET: A multilayered extended semantic network. In Proceedings of the AAAI Spring Symposium on Ontological Engineering, pages 64–72, Stanford, CA, 1997.
Christiane Henning and Tobias G. Noll. Architecture and implementation of a bitserial sorter for weighted median filtering. Proceedings of the 1998 Custom Integrated Circuits Conference, Santa Clatra, CA, May 1998.
T. Hermes, C. Klauck, J. Kreyß, and J. Zhang. Image retrieval for information systems. In Proc. SPIE’s Symp. on Electronic Imaging, San Jose, February 1995.
S. Iyengar and R. Kashyap. Special section on image databases. IEEE Trans. on Software Eng., 14(5):608–688, May 1988.
Jörg Jensch, Reinhard Lüling, and Norbert Sensen. A data layout strategy for parallel web servers. In Proceedings of EuroPar’ 98, 1998.
A. Knoll, R. Schröder, and A. Wolfram. Fusion of data from fuzzy integral-based active and passive colour stereo vision systems for correspondence identification. In Proceedings of the VIII European Signal Processing Conference (EUSIPCO-96), Trieste, Italy, Sept. 10–13 1996.
U. Manber and S. Wu. GLIMPSE: A tool to search through entire file systems. Tr 93-34, Department of Computer Science, University of Arizona, Tucson, Arizona, 1993.
Marion Schulz. Eine Werkbank zur interaktiven Erstellung semantikbasierter Computerlexika. PhD thesis, FernUniversität Hagen, Hagen, 1998.
Marion Schulz and Hermann Helbig. COLEX: Ein Computerlexikon für die automatische Sprachverarbeitung. Informatik-Bericht 210, FernUniversität Hagen, Hagen, Germany, December 1996.
Virage Inc. http://www.virage.com
Stefan Wermter, Ellen Riloff, and Gabriele Scheler, editors. Connectionist, Statistical, and Symbolic Approaches to Learning for Natural Language Processing, volume 1040 of LNAI. Springer, Berlin, 1996.
G. Wiederhold. Mediators in the architecture of future information systems. IEEE Computer, 25(3):38–49, 1992.
Wolfgang Wilhelm and Tobias G. Noll. A new mapping technique for automated design of highly efficient multiplexed fir digital filters. Proceedings of the IEEE International Symposium on Circuits and Systems, pages 2252–2255, June 1997.
L.A. Zadeh. A computational approach to fuzzy quantifiers in natural languages. Comput. and Math., 9:149–184, 1983.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1998 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Knoll, A. et al. (1998). An Integrated Approach to Semantic Evaluation and Content-Based Retrieval of Multimedia Documents. In: Nikolaou, C., Stephanidis, C. (eds) Research and Advanced Technology for Digital Libraries. ECDL 1998. Lecture Notes in Computer Science, vol 1513. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-49653-X_25
Download citation
DOI: https://doi.org/10.1007/3-540-49653-X_25
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-65101-7
Online ISBN: 978-3-540-49653-3
eBook Packages: Springer Book Archive