Skip to main content
SpringerLink
Log in

ADAM pro : Database Support for Big Multimedia Retrieval

  • SCHWERPUNKTBEITRAG
  • Published:
Datenbank-Spektrum Aims and scope Submit manuscript

Abstract

For supporting retrieval tasks within large multimedia collections, not only the sheer size of data but also the complexity of data and their associated metadata pose a challenge. Applications that have to deal with big multimedia collections need to manage the volume of data and to effectively and efficiently search within these data. When providing similarity search, a multimedia retrieval system has to consider the actual multimedia content, the corresponding structured metadata (e.g., content author, creation date, etc.) and—for providing similarity queries—the extracted low-level features stored as densely populated high-dimensional feature vectors. In this paper, we present ADAM pro , a combined database and information retrieval system that is particularly tailored to big multimedia collections. ADAM pro follows a modular architecture for storing structured metadata, as well as the extracted feature vectors and it provides various index structures, i.e., Locality-Sensitive Hashing, Spectral Hashing, and the VA-File, for a fast retrieval in the context of a similarity search. Since similarity queries are often long-running, ADAM pro supports progressive queries that provide the user with streaming result lists by returning (possibly imprecise) results as soon as they become available. We provide the results of an evaluation of ADAM pro on the basis of several collection sizes up to 50 million entries and feature vectors with different numbers of dimensions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Notes

  1. http://www.imotion-project.eu

  2. http://spark.apache.org.

  3. http://www.postgresql.org.

  4. http://cassandra.apache.org.

  5. http://www.mit.edu/~andoni/LSH.

  6. http://www.cs.huji.ac.il/~yweiss/SpectralHashing.

  7. http://www.postgresql.org.

  8. http://www.mongodb.com

Literatur

  1. Alvez CE, Vecchietti AR (2010) Combining Semantic and Content Based Image Retrieval in ORDBMS. In: Rossitza Setchi, Ivan Jordanov, Robert J. Howlett and Lakhmi C. Jain (eds) Knowledge-Based and intelligent information and engineering Systems, 14th International Conference, KES 2010, Cardiff, UK, September 8–10, 2010, Proceedings, Part II, volume 6277 of Lecture notes in computer science. Springer, Berlin, pp 43–55

  2. Boncz PA, Kersten ML (1994) Monet. An impressionist sketch of an advanced database system. In: In Proc. IEEE BIWIT workshop, San Sebastian, Spain

  3. Carey MJ, Haas LM, Schwarz PM, Arya M, Cody WF, Fagin R, Flickner M, Luniewski A, Niblack W, Petkovic D, Thomas J II, Williams JH, Wimmers EL (1995) Towards heterogeneous multimedia information systems: The Garlic Approach. In: RIDEDOM 1995: International workshop on research issues in data engineering - Distributed object management. Taipei, Taiwan, pp 124–131

  4. Datar M, Immorlica N, Indyk P, Mirrokni VS (2004) Locality-sensitive hashing scheme based on p-stable distributions. In: Proceedings of the 20th ACM Symposium on Computational Geometry, Brooklyn, New York, USA, June 8-11, 2004, SCG '04, pp 253–262

  5. de Vries AP, Blanken HM (1998) Database technology and the management of multimedia data in the mirror project. In: Proc. SPIE. International Society for Optics and Photonics, vol 3527, pp 443–453

  6. Giangreco I, Al Kabary I, Schuldt H (2014) ADAM - A database and information retrieval system for big multimedia collections. In: Proceedings of the 2014 IEEE International Congress on Big Data, Anchorage, AK, USA, June/July 2014. IEEE, pp 406–413

  7. Giangreco I, Al Kabary I, Schuldt H (2014) ADAM: a system for jointly providing IR and database queries in large-scale multimedia retrieval. In: Proceedings of the 37th International ACM Conference on Research and Development in Information Retrieval (SIGIR'14), Gold Coast, Australia, July 2014. ACM, pp 1257–1258

  8. Indyk P, Motwani R (1998) Approximate nearest neighbors: towards removing the curse of dimensionality. In: Proceedings of the 13th Annual ACM Symposium on the Theory of Computing, Dallas, Texas, USA, pp 604–613

  9. Karpathy A, Li F-F (2014) Deep visual-semantic alignments for generating image descriptions. CoRR, abs/1412.2306

  10. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Pereira F, Burges CJC, Bottou L, Weinberger KQ (eds) Advances in neural information processing systems 25. Curran Associates, Inc., pp 1097–1105

  11. Moise D, Shestakov D, Gudmundsson GT, Amsaleg L (2013) Indexing and searching 100 m images with map-reduce. In: International Conference on multimedia retrieval, ICMR'13, Dallas, TX, USA, April 16–19, 2013, pp 17–24

  12. Ogle V, Stonebraker M (1995) Chabot: Retrieval from a relational database of images. Computer 28(9):40–48

  13. Oria V, Tamer Özsu M, Iglinski P (2001) Querying images in the DISIMA DBMS. In: MIS 2001: workshop on multimedia information systems, Capri, Italy, pp 89–98

  14. Rossetto L, Giangreco I, Schuldt H, Dupont S, Seddati O, Sezgin M, Sahillioğlu Y (2015) IMOTION - a content-based video retrieval engine. In: Proceedings of the 21st International Conference on multimedia modeling (MMM'15), Part II, Springer, Sydney, Australia, January 2015, pp 255–260

  15. Schek H-J (1980) Methods for the administration of textual data in database systems. In: Oddy RN, Robertson SE, van Rijsbergen CJ, Williams PW (eds) SIGIR 1980: International Conference on Research and development in information retrieval, Cambridge, England. Butterworth & Co, pp 218–235

  16. Weber R, Böhm K, Schek H-J (2000) Interactive-time similarity search for large image collections using parallel VA-files. In: Research and advanced technology for digital libraries, 4th European Conference, ECDL 2000, Lisbon, Portugal, September 18–20, 2000, Proceedings, pp 83–92

  17. Weber R, Schek H-J, Blott S (1998) A quantitative analysis and performance study for similarity-search methods in high-dimensional spaces. In: VLDB 1998: International Conference on very large data bases, New York, USA, pp 194–205

  18. Weiss Y, Torralba A, Fergus R (2008) Spectral hashing. In: Advances in neural information processing systems 21, Proceedings of the Twenty-Second Annual Conference on neural information processing systems, Vancouver, British Columbia, Canada, December 8–11, pp 1753–1760

Download references

Author information

Authors and Affiliations

  1. Department of Mathematics and Computer Science, University of Basel, Basel, Switzerland

    Ivan Giangreco & Heiko Schuldt

Authors
  1. Ivan Giangreco
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Heiko Schuldt
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ivan Giangreco.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Giangreco, I., Schuldt, H. ADAM pro : Database Support for Big Multimedia Retrieval. Datenbank Spektrum 16, 17–26 (2016). https://doi.org/10.1007/s13222-015-0209-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13222-015-0209-y

Keywords

Search

Navigation