Skip to main content

Approaching Multimedia Retrieval from a Polyrepresentative Perspective

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 6817))

Abstract

Multimedia documents such as videos, images, or music are characterized by an amount of different qualities that can become relevant during a search task. These qualities are seldom reflected as a whole by retrieval models. Thus, we present a new query model, which fully supports the principle of polyrepresentation by taking advantage of quantum logic. We offer means to model document relevance as a cognitive overlap from various features describing a multimedia document internally. Using our query model, the combination of the aforementioned polyrepresentative features is supported by the mechanisms of a Boolean algebra. In addition, these overlaps can be personalized by user preferences during a machine-based learning supported relevance feedback process. The input for the relevance feedback is based on qualitative judgments between documents, which are known from daily life, to keep the cognitive load on users low.

We further discuss how our model contributes to the unification of different aspects of polyrepresentation into one sound theory.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   54.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   69.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Aucouturier, J.J., Pachet, F.: Improving Timbre Similarity: How high is the sky? Journal of Negative Results in Speech and Audio Sciences 1(1) (2004)

    Google Scholar 

  2. Larsen, B., Ingwersen, P., Kekäläinen, J.: The polyrepresentation continuum in IR. In: IIiX: Proceedings of the 1st International Conference on Information Interaction in Context, pp. 88–96. ACM, New York (2006)

    Chapter  Google Scholar 

  3. Ingwersen, P., Järvelin, K.: The Turn: Integration of Information Seeking and Retrieval in Context. [Springer-11645 /Dig. Serial]. Springer, Dordrecht (2005)

    MATH  Google Scholar 

  4. Skov, M., Pedersen, H., Larsen, B., Ingwersen, P.: Testing the Principle of Polyrepresentation. In: Ingwersen, P., van Rijsbergen, C., Belkin, N. (eds.) Proceedings of ACM SIGIR 2004 Workshop on ”Information Retrieval in Context”, pp. 47–49 (2004)

    Google Scholar 

  5. Hull, A.D.: Using Structured Queries for Disambiguation in Cross-Language Information Retrieval. In: AAAI Spring Symposium on Cross-Language Text and Speech Retrieval Electronic Working Notes, pp. 24–26 (1997)

    Google Scholar 

  6. Turtle, H., Croft, B.W.: Evaluation of an inference network-based retrieval model. ACM Trans. Inf. Syst. 9(3), 187–222 (1991)

    Article  Google Scholar 

  7. Frommholz, I., van Rijsbergen, C.: Towards a Geometrical Model for Polyrepresentation of Information Objects. In: Proc. of the ”Information Retrieval 2009” Workshop at LWA 2009 (2009)

    Google Scholar 

  8. van Rijsbergen, C.: The Geometry of Information Retrieval. Cambridge University Press, Cambridge (2004)

    Book  MATH  Google Scholar 

  9. Rocchio, J.: Relevance Feedback in Information Retrieval. The SMART Retrieval System, 313–323 (1971)

    Google Scholar 

  10. Schmitt, I.: QQL: A DB&IR Query Language. The VLDB Journal 17(1), 39–56 (2008)

    Article  Google Scholar 

  11. Salton, G., Wong, A., Yang, S.C.: A Vector Space Model for Automatic Indexing, Ithaca, NY, USA (1974)

    Google Scholar 

  12. Schmitt, I.: Weighting in CQQL, Cottbus (2007)

    Google Scholar 

  13. Fagin, R., Wimmers, L.E.: A Formula for Incorporating Weights into Scoring Rules. Special Issue of Theoretical Computer Science (239), 309–338 (2000)

    Article  MathSciNet  MATH  Google Scholar 

  14. Salton, G., Fox, A.E., Wu, H.: Extended Boolean Information Retrieval. Commun. ACM 26(11), 1022–1036 (1983)

    Article  MathSciNet  MATH  Google Scholar 

  15. Lee, H.J., Kim, Y.W., Kim, H.M., Lee, J.Y.: On the Evaluation of Boolean Operators in the Extended Boolean Retrieval Framework. In: Korfhage, R., Rasmussen, E.M., Willett, P. (eds.) ACM/SIGIR 1993, Proceedings of 16th Annual International Conference on Research and Development in Information Retrieval, Pittsburgh, USA, pp. 291–297 (1993)

    Google Scholar 

  16. Zellhöfer, D., Schmitt, I.: A Preference-based Approach for Interactive Weight Learning: Learning Weights within a Logic-Based Query Language. Distributed and Parallel Databases (2009)

    Google Scholar 

  17. Zellhöfer, D.: Inductive User Preference Manipulation for Multimedia Retrieval. In: Böszörmenyi, L., Burdescu, D., Davies, P., Newell, D. (eds.) Proc. of the Second International Conference on Advances in Multimedia (2010)

    Google Scholar 

  18. White, W.R.: Using searcher simulations to redesign a polyrepresentative implicit feedback interface. Inf. Process. Manage. 42(5), 1185–1202 (2006)

    Article  Google Scholar 

  19. Nelder, A.J., Mead, R.: A Simplex Method for Function Minimization. Computer Journal 7, 308–313 (1965)

    Article  MathSciNet  MATH  Google Scholar 

  20. Schmitt, I., Zellhöfer, D.: Lernen nutzerspezifischer Gewichte innerhalb einer logikbasierten Anfragesprache. In: Freytag, C.J., Ruf, T., Lehner, W., Vossen, G. (eds.) Datenbanksysteme in Business, Technologie und Web (BTW 2009), 13. Fachtagung des GI-Fachbereichs ”Datenbanken und Informationssysteme (DBIS), Proceedings, Münster, Germany, March 2-6. lni. GI, vol. 44, pp. 137–156 (2009)

    Google Scholar 

  21. Zellhöfer, D.: Eliciting Inductive User Preferences for Multimedia Information Retrieval. In: Balke, W.T., Lofi, C. (eds.) Proceedings of the 22nd Workshop ”Grundlagen von Datenbanken 2010”, vol. 581 (2010)

    Google Scholar 

  22. Campbell, I.: Interactive Evaluation of the Ostensive Model: Using a New Test Collection of Images with Multiple Relevance Assessments. Inf. Retr. 2(1), 89–114 (2000)

    Article  Google Scholar 

  23. Lux, M., Chatzichristofis, A.S.: Lire: Lucene Image Retrieval: An Extensible Java CBIR Library. In: MM 2008: Proceeding of the 16th ACM International Conference on Multimedia, pp. 1085–1088. ACM, New York (2008)

    Google Scholar 

  24. Zellhöfer, D., Schmitt, I.: A Poset Based Approach for Condition Weighting. In: 6th International Workshop on Adaptive Multimedia Retrieval (2008)

    Google Scholar 

  25. Schiela, K.: Ein CQQL-basiertes Musikretrievalsystem f. GlobalMusic2one BTU Cottbus: Master’s Thesis. PhD thesis, Brandenburg University of Technology, Cottbus (2010)

    Google Scholar 

  26. Schmitt, I., Zellhöfer, D., Nürnberger, A.: Towards quantum logic based multimedia retrieval. In: IEEE (ed.) Proceedings of the Fuzzy Information Processing Society (NAFIPS), pp. 1–6. IEEE, Los Alamitos (2008)

    Google Scholar 

  27. Järvelin, K., Kekäläinen, J.: Cumulated gain-based evaluation of IR techniques. ACM Trans. Inf. Syst. 20(4), 422–446 (2002)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Zellhöfer, D., Schmitt, I. (2011). Approaching Multimedia Retrieval from a Polyrepresentative Perspective. In: Detyniecki, M., Knees, P., Nürnberger, A., Schedl, M., Stober, S. (eds) Adaptive Multimedia Retrieval. Context, Exploration, and Fusion. AMR 2010. Lecture Notes in Computer Science, vol 6817. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-27169-4_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-27169-4_4

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-27168-7

  • Online ISBN: 978-3-642-27169-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics