Multimedia Tools and Applications

, Volume 62, Issue 2, pp 427–450 | Cite as

A mediator-based approach for integrating heterogeneous multimedia sources

  • Domenico Beneventano
  • Claudio GennaroEmail author
  • Sonia Bergamaschi
  • Fausto Rabitti


In many applications, the information required by the user cannot be found in just one source, but has to be retrieved from many varying sources. This is true not only of formatted data in database management systems, but also of textual documents and multimedia data, such as images and videos. We propose a mediator system that provides the end-user with a single query interface to an integrated view of multiple heterogeneous data sources. We exploit the capabilities of the MOMIS integration system and the MILOS multimedia data management system. Each multimedia source is managed by an instance of MILOS, in which a collection of multimedia records is made accessible by means of similarity searches employing the query-by-example paradigm. MOMIS provides an integrated virtual view of the underlying multimedia sources, thus offering unified multimedia access services. Two features are that MILOS is flexible—it is not tied to any particular similarity function—and the MOMIS’s mediator query processor only exploits the ranks of the local answers.


Knowledge management Mediator Ontologies Query language Similarity search MPEG-7 


  1. 1.
    Amato G, Gennaro C, Savino P, Rabitti F (2004) Milos: a multimedia content management system for digital library applications. In: Proceedings of the 8th European Conference on research and advanced technology for Digital Libraries (ECDL 2004). Lecture notes in computer science, vol 3232. Springer, pp 14–25Google Scholar
  2. 2.
    Bay H, Tuytelaars T, Gool LJV (2006) Surf: speeded up robust features. In: European conference on computer vision, pp 404–417Google Scholar
  3. 3.
    Beneventano D, Bergamaschi S, Gennaro C, Guerra F, Mordacchini M, Sala A (2008) A mediator system for data and multimedia sources. In: International workshop on data integration through semantic technology at the 3rd Asian semantic web conference, Bangkok, 8–11 Dec 2008Google Scholar
  4. 4.
    Beneventano D, Bergamaschi S, Guerra F, Vincini M (2003) Synthesizing an integrated ontology. IEEE Internet Computing 7(5):42–51CrossRefGoogle Scholar
  5. 5.
    Beneventano D, Gennaro C, Guerra F (2008) A methodology for building and querying an ontology representing data and multimedia sources. In: International VLDB workshop on Ontology-based techniques for DataBases in Information Systems and knowledge systems, ODBIS 2008. Auckland, New Zealand, pp 37–40. Co-located with the 34th international conference on very large data bases, 23 Aug 2008Google Scholar
  6. 6.
    Bergamaschi S, Beneventano D, Guerra F, Orsini M (2011) Data integration. In: Embley DW, Thalheim B (eds) Handbook of conceptual modeling: theory, practice and research challenges. Springer, VerlagGoogle Scholar
  7. 7.
    Bleiholder J, Naumann F (2008) Data fusion. ACM Comput Surv 41(1):1–41CrossRefGoogle Scholar
  8. 8.
    Carey M, Haas L, Schwarz P, Arya M, Cody W, Fagin R, Flickner M, Luniewski A, Niblack W, Petkovic D, Thomas J, Williams J, Wimmers E (1995) Towards heterogeneous multimedia information systems: the garlic approach. In: Proc. RIDE-DOM ’95 (5th Int’l Workshop on Research Issues in Data Engineering: Distributed Object Management), pp 124–131Google Scholar
  9. 9.
    Carlos NM (2011) Query optimization and quality-driven query processing for integration systems. PhD thesis, International Doctorate School in ICT—Università di Modena e Reggio Emilia, Italy. Accessed 18 Feb 2011
  10. 10.
    Chang KC-C, Garcia-Molina H (1999) Mind your vocabulary: query mapping across heterogeneous information sources. In: SIGMOD Conference, pp 335–346Google Scholar
  11. 11.
    Dwork C, Kumar R, Naor M, Sivakumar D (2001) Rank aggregation methods for the web. In: WWW ’01: proceedings of the 10th international conference on World Wide Web. New York, NY, pp 613–622Google Scholar
  12. 12.
    Fagin R, Kumar R, Sivakumar D (2003) Efficient similarity search and classification via rank aggregation. In: Proceedings of the 2003 ACM SIGMOD international conference on management of data, SIGMOD ’03. New York, NY, pp 301–312Google Scholar
  13. 13.
    Galindo-Legaria CA, Rosenthal A (1997) Outerjoin simplification and reordering for query optimization. ACM Trans Database Syst 22(1):43–73CrossRefGoogle Scholar
  14. 14.
    Gennaro C, Amato G, Bolettieri P, Savino P (2010) An approach to content-based image retrieval based on the lucene search engine library. In: Proceedings of the 14th European conference on research and advanced technology for digital libraries, ECDL’10. Springer, Berlin, pp 55–66CrossRefGoogle Scholar
  15. 15.
    Gennaro C, Lenzi R, Mandreoli F, Martoglia R, Mordacchini M, Penzo W, Sassatelli S (2011) A unified multimedia and semantic perspective for data retrieval in the semantic web. Inf Syst 36(2):174–191. Special Issue: Semantic Integration of Data, Multimedia, and ServicesGoogle Scholar
  16. 16.
    Haslhofer B, Klas W (2010) A survey of techniques for achieving metadata interoperability. ACM Comput Surv 42:7:1–7:37Google Scholar
  17. 17.
    Ilyas IF, Beskales G, Soliman MA (2008) A survey of top-k query processing techniques in relational database systems. ACM Comput Surv 40(4):1–58CrossRefGoogle Scholar
  18. 18.
    Knoll A, Altenschmidt C, Biskup J, Blüthgen H-M, Glöckner I, Hartrumpf S, Helbig H, Henning C, Lüling R, Monien B, Noll T, Sensen N (1998) An integrated approach to semantic evaluation and content-based retrieval of multimedia documents. In: Proceedings of the 2nd European Conference on research and advanced technology for Digital Libraries, ECDL ’98. Springer, London, pp 409–428CrossRefGoogle Scholar
  19. 19.
    Lanfranchi V, Ciravegna F, Moore P, Petrelli D (2005) Document editing and browsing in aktivedoc. In: Wiley A, King PR (eds) ACM symposium on document engineering. ACM, pp 237–238Google Scholar
  20. 20.
    Lee S-L, Chun S-J, Kim D-H, Lee J-H, Chung C-W (2000) Similarity search for multidimensional data sequences. In: Proceedings 16th international conference on data engineering, pp 599–608Google Scholar
  21. 21.
    Liao Z, Yang J, Fu C, Zhang G (2010) Integrating web videos for faceted search based on duplicates, contexts and rules. In: Shi Z, Vadera S, Aamodt A, Leake D (eds) Intelligent information processing V. IFIP advances in information and communication technology, vol 340. Springer, Boston, pp 203–212Google Scholar
  22. 22.
    Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110CrossRefGoogle Scholar
  23. 23.
    Mylonas P, Athanasiadis T, Wallace M, Avrithis Y, Kollias S (2008) Semantic representation of multimedia content: knowledge representation and semantic indexing. Multimed Tools Appl 39:293–327. doi: 10.1007/s11042-007-0161-4 CrossRefGoogle Scholar
  24. 24.
    Naumann F, Bilke A, Bleiholder J, Weis M (2006) Data fusion in three steps: resolving schema, tuple, and value inconsistencies. IEEE Data Eng Bull 29(2):21–31Google Scholar
  25. 25.
    Naumann F, Freytag JC, Leser U (2004) Completeness of integrated information sources. Inf Syst 29(7):583–615CrossRefGoogle Scholar
  26. 26.
    Petridis K, Anastasopoulos D, Saathoff C, Timmermann N, Kompatsiaris Y, Staab S (2006) M-ontomat-annotizer: image annotation linking ontologies and multimedia low-level features. In: Gabrys B, Howlett RJ, Jain LC (eds) KES (3), Lecture notes in computer science, vol 4253. Springer, pp 633–640Google Scholar
  27. 27.
    Straccia U, Visco G (2007) Dlmedia: an ontology mediated multimedia information retrieval system. In: Proceeedings DL-2007Google Scholar
  28. 28.
    Wiederhold G (1992) Mediators in the architecture of future information systems. IEEE Computer 25(3):38–49CrossRefGoogle Scholar
  29. 29.
    Zezula P, Amato G, Dohnal V, Batko M (2006) Similarity search—the metric space approach. Advances in database systems, vol 32. SpringerGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2011

Authors and Affiliations

  • Domenico Beneventano
    • 1
  • Claudio Gennaro
    • 2
    Email author
  • Sonia Bergamaschi
    • 1
  • Fausto Rabitti
    • 2
  1. 1.DII - Università di Modena e Reggio EmiliaModenaItaly
  2. 2.ISTI - CNRPisaItaly

Personalised recommendations