AIR: Architecture for Interoperable Retrieval on Distributed and Heterogeneous Multimedia Repositories

  • Florian Stegmaier
  • Mario Döller
  • Harald Kosch
  • Andreas Hutter
  • Thomas Riegel
Part of the Lecture Notes in Electrical Engineering book series (LNEE, volume 158)


Nowadays, multimedia data is produced and consumed at an ever increasing rate. Similarly to this trend, diverse storage approaches for multimedia data have been introduced. These observations lead to the fact that distributed and heterogeneous multimedia repositories exist, whereas an easy and unified access to the stored multimedia data is not given. This chapter presents an architecture, named AIR, that offers the aforementioned retrieval possibilities. To ensure interoperability, AIR makes use of recently issued standards, namely the MPEG Query Format (multimedia query language) and the JPSearch transformation rules (metadata interoperability).


External metasearch Heterogeneous databases Interoperability Standardization 



This work has been partially supported by the THESEUS Program, which is funded by the German Federal Ministry of Economics and Technology. We would like to thank the following students for contributing: Sebastian Freilinger–Huber, Sebastian Unverricht, Wolfgang Hans, Ludwig Bachmeier, Udo Gröbner and Atanas Yakimov.


  1. 1.
    Berretti S, Bimbo AD, Pala P (2003) Merging results of distributed image libraries. In: Proceedings of the international conference on multimedia and expo. Baltimore, Maryland, USA, pp 33–36Google Scholar
  2. 2.
    Craswell N, Hawking D, Thistlewaite PB (1999) Merging results from isolated search engines. In: Proceedings of the Australasian database conference. Auckland, New Zealand, pp 189–200Google Scholar
  3. 3.
    Döller M (2010) Draft of call for JPSearch benchmark requirements. ISO/IEC JTC 1/SC 29/WG1 N5399 (JPEG)Google Scholar
  4. 4.
    Döller M, Bauer K, Kosch H, Gruhne M (2008) Standardized multimedia retrieval based on web service technologies and the MPEG query format. J Digit Inf 6(4):315–331Google Scholar
  5. 5.
    Döller M, Stegmaier F, Kosch H, Tous R, Delgado J (2010) Standardized interoperable image retrieval. In: Proceedings of the ACM symposium on applied computing, track on advances in spatial and image-based information systems. Sierre, Switzerland, pp 881–887Google Scholar
  6. 6.
    Döller M, Tous R, Gruhne M, Yoon K, Sano M, Burnett IS (2008) The MPEG query format: on the way to unify the access to multimedia retrieval systems. IEEE Multimedia 15(4):82–95CrossRefGoogle Scholar
  7. 7.
    Dublin core metadata initiative: dublin core metadata element set—version 1.1: reference description (2008).
  8. 8.
    Dufaux F, Ansorge M, Ebrahimi T (2007) Overview of JPSearch: a standard for image search and retrieval. In: Proceedings of the 5th international workshop on content-based multimedia indexing. Bordeaux, FranceGoogle Scholar
  9. 9.
    Li JZ, özsu MT, Szafron D, Oria V (1997) MOQL: a multimedia object query language. In: Proceedings of the 3rd international workshop on multimedia information systems. Como Italy, pp 19–28Google Scholar
  10. 10.
    Martinez JM, Koenen R, Pereira F (2002) MPEG-7. IEEE Multimedia 9(2):78–87CrossRefGoogle Scholar
  11. 11.
    Melton J, Eisenberg A (2001) SQL multimedia and application packages (SQL/MM). SIGMOD Rec. 30(4):97–102CrossRefGoogle Scholar
  12. 12.
    Möller M, Sintek M (2007) A generic framework for semantic medical image retrieval. In: Proceedings of the 1st knowledge acquisition from multimedia content workshop in conjunction with SAMT, vol 253. Genova, Italy, pp 18–32Google Scholar
  13. 13.
    Montague M, Aslam J (2002) Condorcet fusion for improved retrieval. In: Proceedings of the 11th international conference on information and knowledge management. McLean, Virginia, USA, pp 538–548Google Scholar
  14. 14.
    Müller H, Geissbuhler A (2004) Benchmarking image retrieval applications. In: Proceedings of the 7th international conference on visual information systems. San Francisco, California, USAGoogle Scholar
  15. 15.
    Seifert S, Thoma M, Stegmaier F, Hammon M, Döller M, Kriegel HP, Cavallaro A, Huber M, Comaniciu D (2011) Combined semantic and similarity search in medical image databases. In: Proceedings of the SPIE medical imaging. Lake Buena Vista, Florida, USAGoogle Scholar
  16. 16.
    Smith JR (2008) The search for interoperability. IEEE Multimedia 15(3):84–87CrossRefGoogle Scholar
  17. 17.
    Stegmaier F, Bailer W, Bürger T, Döller M, Höffernig M, Lee W, Malaisé V, Poppe C, Troncy R, Kosch H, de Walle RV (2009) How to align media metadata schemas? design and implementation of the media ontology. In: Proceedings of the 10th international workshop of the multimedia metadata community on semantic multimedia database technologies in conjunction with SAMT, vol 539, Graz, Austria, pp 56–69Google Scholar
  18. 18.
    Stegmaier F, Bürger T, Döller M, Kosch H (2010) Knowledge based multimodal result fusion for distributed and heterogeneous multimedia environments: concept and ideas. In: Proceedings of the 8th international workshop on adaptive multimedia retrievalm. Linz, AustriaGoogle Scholar
  19. 19.
    Stegmaier F, Döller M, Kosch H, Hutter A, Riegel T (2010) AIR: architecture for interoperable retrieval on distributed and heterogeneous multimedia repositories. In: Proceedings of the 11th international workshop on image analysis for multimedia interactive services. Desenzano del Garda, Italy, pp 1–4Google Scholar
  20. 20.
    Tous R, Delgado J (2009) A LEGO-like metadata architecture for image search& retrieval. In: Proceedings of the 3rd workshop on multimedia data mining and management in conjunction with 20th international conference on DEXA. Linz, Austria, pp 246–250Google Scholar
  21. 21.
    World wide web consortium (W3C): media annotations working group. Video in the Web activity. (2008).

Copyright information

© Springer Science+Business Media New York 2013

Authors and Affiliations

  • Florian Stegmaier
    • 1
  • Mario Döller
    • 1
  • Harald Kosch
    • 1
  • Andreas Hutter
    • 2
  • Thomas Riegel
    • 2
  1. 1.Chair of Distributed Information Systems University of PassauPassauGermany
  2. 2.Corporate Technology, Siemens AGMunichGermany

Personalised recommendations