Abstract
Multimedia documents such as videos, images, or music are characterized by an amount of different qualities that can become relevant during a search task. These qualities are seldom reflected as a whole by retrieval models. Thus, we present a new query model, which fully supports the principle of polyrepresentation by taking advantage of quantum logic. We offer means to model document relevance as a cognitive overlap from various features describing a multimedia document internally. Using our query model, the combination of the aforementioned polyrepresentative features is supported by the mechanisms of a Boolean algebra. In addition, these overlaps can be personalized by user preferences during a machine-based learning supported relevance feedback process. The input for the relevance feedback is based on qualitative judgments between documents, which are known from daily life, to keep the cognitive load on users low.
We further discuss how our model contributes to the unification of different aspects of polyrepresentation into one sound theory.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Aucouturier, J.J., Pachet, F.: Improving Timbre Similarity: How high is the sky? Journal of Negative Results in Speech and Audio Sciences 1(1) (2004)
Larsen, B., Ingwersen, P., Kekäläinen, J.: The polyrepresentation continuum in IR. In: IIiX: Proceedings of the 1st International Conference on Information Interaction in Context, pp. 88–96. ACM, New York (2006)
Ingwersen, P., Järvelin, K.: The Turn: Integration of Information Seeking and Retrieval in Context. [Springer-11645 /Dig. Serial]. Springer, Dordrecht (2005)
Skov, M., Pedersen, H., Larsen, B., Ingwersen, P.: Testing the Principle of Polyrepresentation. In: Ingwersen, P., van Rijsbergen, C., Belkin, N. (eds.) Proceedings of ACM SIGIR 2004 Workshop on ”Information Retrieval in Context”, pp. 47–49 (2004)
Hull, A.D.: Using Structured Queries for Disambiguation in Cross-Language Information Retrieval. In: AAAI Spring Symposium on Cross-Language Text and Speech Retrieval Electronic Working Notes, pp. 24–26 (1997)
Turtle, H., Croft, B.W.: Evaluation of an inference network-based retrieval model. ACM Trans. Inf. Syst. 9(3), 187–222 (1991)
Frommholz, I., van Rijsbergen, C.: Towards a Geometrical Model for Polyrepresentation of Information Objects. In: Proc. of the ”Information Retrieval 2009” Workshop at LWA 2009 (2009)
van Rijsbergen, C.: The Geometry of Information Retrieval. Cambridge University Press, Cambridge (2004)
Rocchio, J.: Relevance Feedback in Information Retrieval. The SMART Retrieval System, 313–323 (1971)
Schmitt, I.: QQL: A DB&IR Query Language. The VLDB Journal 17(1), 39–56 (2008)
Salton, G., Wong, A., Yang, S.C.: A Vector Space Model for Automatic Indexing, Ithaca, NY, USA (1974)
Schmitt, I.: Weighting in CQQL, Cottbus (2007)
Fagin, R., Wimmers, L.E.: A Formula for Incorporating Weights into Scoring Rules. Special Issue of Theoretical Computer Science (239), 309–338 (2000)
Salton, G., Fox, A.E., Wu, H.: Extended Boolean Information Retrieval. Commun. ACM 26(11), 1022–1036 (1983)
Lee, H.J., Kim, Y.W., Kim, H.M., Lee, J.Y.: On the Evaluation of Boolean Operators in the Extended Boolean Retrieval Framework. In: Korfhage, R., Rasmussen, E.M., Willett, P. (eds.) ACM/SIGIR 1993, Proceedings of 16th Annual International Conference on Research and Development in Information Retrieval, Pittsburgh, USA, pp. 291–297 (1993)
Zellhöfer, D., Schmitt, I.: A Preference-based Approach for Interactive Weight Learning: Learning Weights within a Logic-Based Query Language. Distributed and Parallel Databases (2009)
Zellhöfer, D.: Inductive User Preference Manipulation for Multimedia Retrieval. In: Böszörmenyi, L., Burdescu, D., Davies, P., Newell, D. (eds.) Proc. of the Second International Conference on Advances in Multimedia (2010)
White, W.R.: Using searcher simulations to redesign a polyrepresentative implicit feedback interface. Inf. Process. Manage. 42(5), 1185–1202 (2006)
Nelder, A.J., Mead, R.: A Simplex Method for Function Minimization. Computer Journal 7, 308–313 (1965)
Schmitt, I., Zellhöfer, D.: Lernen nutzerspezifischer Gewichte innerhalb einer logikbasierten Anfragesprache. In: Freytag, C.J., Ruf, T., Lehner, W., Vossen, G. (eds.) Datenbanksysteme in Business, Technologie und Web (BTW 2009), 13. Fachtagung des GI-Fachbereichs ”Datenbanken und Informationssysteme (DBIS), Proceedings, Münster, Germany, March 2-6. lni. GI, vol. 44, pp. 137–156 (2009)
Zellhöfer, D.: Eliciting Inductive User Preferences for Multimedia Information Retrieval. In: Balke, W.T., Lofi, C. (eds.) Proceedings of the 22nd Workshop ”Grundlagen von Datenbanken 2010”, vol. 581 (2010)
Campbell, I.: Interactive Evaluation of the Ostensive Model: Using a New Test Collection of Images with Multiple Relevance Assessments. Inf. Retr. 2(1), 89–114 (2000)
Lux, M., Chatzichristofis, A.S.: Lire: Lucene Image Retrieval: An Extensible Java CBIR Library. In: MM 2008: Proceeding of the 16th ACM International Conference on Multimedia, pp. 1085–1088. ACM, New York (2008)
Zellhöfer, D., Schmitt, I.: A Poset Based Approach for Condition Weighting. In: 6th International Workshop on Adaptive Multimedia Retrieval (2008)
Schiela, K.: Ein CQQL-basiertes Musikretrievalsystem f. GlobalMusic2one BTU Cottbus: Master’s Thesis. PhD thesis, Brandenburg University of Technology, Cottbus (2010)
Schmitt, I., Zellhöfer, D., Nürnberger, A.: Towards quantum logic based multimedia retrieval. In: IEEE (ed.) Proceedings of the Fuzzy Information Processing Society (NAFIPS), pp. 1–6. IEEE, Los Alamitos (2008)
Järvelin, K., Kekäläinen, J.: Cumulated gain-based evaluation of IR techniques. ACM Trans. Inf. Syst. 20(4), 422–446 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zellhöfer, D., Schmitt, I. (2011). Approaching Multimedia Retrieval from a Polyrepresentative Perspective. In: Detyniecki, M., Knees, P., Nürnberger, A., Schedl, M., Stober, S. (eds) Adaptive Multimedia Retrieval. Context, Exploration, and Fusion. AMR 2010. Lecture Notes in Computer Science, vol 6817. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-27169-4_4
Download citation
DOI: https://doi.org/10.1007/978-3-642-27169-4_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-27168-7
Online ISBN: 978-3-642-27169-4
eBook Packages: Computer ScienceComputer Science (R0)