Skip to main content

Advertisement

SpringerLink
Log in
Menu
Find a journal Publish with us
Search
Cart
Book cover

The Future Internet Assembly

FIA 2012: The Future Internet pp 130–141Cite as

  1. Home
  2. The Future Internet
  3. Conference paper
I-SEARCH: A Unified Framework for Multimodal Search and Retrieval

I-SEARCH: A Unified Framework for Multimodal Search and Retrieval

  • Apostolos Axenopoulos19,
  • Petros Daras19,
  • Sotiris Malassiotis19,
  • Vincenzo Croce20,
  • Marilena Lazzaro20,
  • Jonas Etzold21,
  • Paul Grimm21,
  • Alberto Massari22,
  • Antonio Camurri22,
  • Thomas Steiner23 &
  • …
  • Dimitrios Tzovaras19 
  • Conference paper
  • Open Access
  • 12k Accesses

  • 7 Citations

Part of the Lecture Notes in Computer Science book series (LNISA,volume 7281)

Abstract

In this article, a unified framework for multimodal search and retrieval is introduced. The framework is an outcome of the research that took place within the I-SEARCH European Project. The proposed system covers all aspects of a search and retrieval process, namely low-level descriptor extraction, indexing, query formulation, retrieval and visualisation of the search results. All I-SEARCH components advance the state of the art in the corresponding scientific fields. The I-SEARCH multimodal search engine is dynamically adapted to end-user’s devices, which can vary from a simple mobile phone to a high-performance PC.

Keywords

  • multimodal search
  • multimodal interfaces
  • adaptive presentation

Download conference paper PDF

References

  1. Daras, P., Axenopoulos, A., Darlagiannis, V., Tzovaras, D., Le Bourdon, X., Joyeux, L., Verroust-Blondet, A., Croce, V., Steiner, T., Massari, A., Camurri, A., Morin, S., Mezaour, A.D., Sutton, L., Spiller, S.: Introducing a Unified Framework for Content Object Description. International Journal of Multimedia Intelligence and Security, Special Issue on “Challenges in Scalable Context Aware Multimedia Computing 2(3-4), 351–375 (2011), doi:10.1504/IJMIS.2011.044765

    CrossRef  Google Scholar 

  2. Daras, P., Alvarez, F.: A Future Perspective on the 3D Media Internet. Towards the Future Internet - A European Research Perspective (January 2009) ISBN: 978-1-60750-007-0

    Google Scholar 

  3. Champeon, S.: Progressive Enhancement and the Future of Web Design, http://www.hesketh.com/thought-leadership/our-publications/progressive-enhancement-and-future-web-design

  4. Etzold, J., Brousseau, A., Grimm, P., Steiner, T.: Context-Aware Querying for Multimodal Search Engines. In: Schoeffmann, K., Merialdo, B., Hauptmann, A.G., Ngo, C.-W., Andreopoulos, Y., Breiteneder, C. (eds.) MMM 2012. LNCS, vol. 7131, pp. 728–739. Springer, Heidelberg (2012)

    CrossRef  Google Scholar 

  5. Steiner, T., Sutton, L., Spiller, S., et al.: I-SEARCH – A Multimodal Search Engine based on Rich Unified Content Description (RUCoD). Submitted to the European Projects Track at the 21st International World Wide Web Conference. Under review, http://www.lsi.upc.edu/~tsteiner/papers/2012/isearch-multimodal-search-www2012.pdf

  6. Zagoris, K., Arampatzis, A., Chatzichristofis, S.A.: www.MMRetrieval.Net: a multimodal search engine. In: Proceedings of the Third International Conference on SImilarity Search and APplications (SISAP 2010), pp. 117–118. ACM, New York (2010)

    CrossRef  Google Scholar 

  7. Bederson, B.B.: PhotoMesa: A Zoomable Image Browser Using Quantum Treemaps and Bubblemaps.. In: ACM Symposium on User Interface Software and Technology, UIST 2001, CHI Letters, vol. 3(2), pp. 71–80 (2001)

    Google Scholar 

  8. Graham, A., Garcia-Molina, H., Paepcke, A., Winograd, T.: Time as essence for photo browsing through personal digital libraries. In: Proceedings of the 2nd ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL 2002), pp. 326–335. ACM, NY (2002)

    CrossRef  Google Scholar 

  9. Platt, J.C., Czerwinski, M., Field, B.A.: PhotoTOC: automatic clustering for browsing personal photographs. In: Proceedings of the 2003 Joint Conference and the Information, Communications and Signal Processing Fourth Pacific Rim Conference on Multimedia, December 15-18, vol. 1, pp. 6–10 (2003)

    Google Scholar 

  10. Zhang, H., Weng, J.: Measuring Multi-modality Similarities Via Subspace Learning for Cross-Media Retrieval. In: Advances in Multimedia Information Processing, PCM (2006)

    Google Scholar 

  11. Yang, Y., Xu, D., Nie, F., Luo, J., Zhuang, Y.: Ranking with Local Regression and Global Alignment for Cross Media Retrieval. ACM MM, Beijing, China (2009)

    CrossRef  Google Scholar 

  12. Axenopoulos, A., Manolopoulou, S., Daras, P.: Multimodal Search and Retrieval using Manifold Learning and Query Formulation. In: ACM International Conference on 3D Web Technology, Paris,France, June 20-22 (2011)

    Google Scholar 

  13. Daras, P., Manolopoulou, S., Axenopoulos, A.: Search and Retrieval of Rich Media Objects Supporting Multiple Multimodal Queries. Accepted on IEEE Transactions on Multimedia

    Google Scholar 

  14. Axenopoulos, A., Manolopoulou, S., Daras, P.: Optimizing Multimedia Retrieval Using Multimodal Fusion and Relevance Feedback Techniques. In: Schoeffmann, K., Merialdo, B., Hauptmann, A.G., Ngo, C.-W., Andreopoulos, Y., Breiteneder, C. (eds.) MMM 2012. LNCS, vol. 7131, pp. 716–727. Springer, Heidelberg (2012)

    CrossRef  Google Scholar 

  15. Gennaro, C., Amato, G., Bolettieri, P., Savino, P.: An Approach to Content-Based Image Retrieval Based on the Lucene Search Engine Library. In: Lalmas, M., Jose, J., Rauber, A., Sebastiani, F., Frommholz, I. (eds.) ECDL 2010. LNCS, vol. 6273, pp. 55–66. Springer, Heidelberg (2010)

    CrossRef  Google Scholar 

  16. Glowinski, D., Dael, N., Camurri, A., Volpe, G., Mortillaro, M., Scherer, K.: Towards a Minimal Representation of Affective Gestures. IEEE Transactions on Affective Computing 2(2), 106–118 (2011)

    CrossRef  Google Scholar 

  17. Varni, G., Volpe, G., Camurri, A.: A System for Real-Time Multimodal Analysis of Nonverbal Affective Social Interaction in User-Centric Media. IEEE Transactions on Multimedia 12(6), 576–590 (2010)

    CrossRef  Google Scholar 

  18. http://www.fi-ware.eu/

  19. http://www.fi-ppp.eu/

Download references

Author information

Authors and Affiliations

  1. Centre for Research and Technology Hellas (CERTH/ITI), 6th Km Charilaou-Thermi, 57001, Thessaloniki, Greece

    Apostolos Axenopoulos, Petros Daras, Sotiris Malassiotis & Dimitrios Tzovaras

  2. Engineering Ingegneria Informatica S.p.a., Viale Regione Siciliana Nord Ovest, 7275, 90146, Palermo, Italy

    Vincenzo Croce & Marilena Lazzaro

  3. Hochschule Fulda, Marquardstrasse 35, 36039, Fulda, Germany

    Jonas Etzold & Paul Grimm

  4. Casa Paganini – InfoMus Research Centre, University of Genoa, Piazza S.Maria in Passione 34, Genoa, Italy

    Alberto Massari & Antonio Camurri

  5. Google Germany GmbH, ABC-Str. 19, 20354, Hamburg, Germany

    Thomas Steiner

Authors
  1. Apostolos Axenopoulos
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Petros Daras
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sotiris Malassiotis
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Vincenzo Croce
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Marilena Lazzaro
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Jonas Etzold
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Paul Grimm
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Alberto Massari
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Antonio Camurri
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Thomas Steiner
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Dimitrios Tzovaras
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. ETS Ingenieros de Telecomunicación, Universidad Politécnica de Madrid, Avenida Complutense 30, 28040, Madrid, Spain

    Federico Álvarez

  2. WIT-TSSG, Ireland

    Frances Cleary

  3. Informatics and Telematics Institute, Centre for Research and Technology Hellas, 1st Km Thermi - Panorama, 57001, Thessaloniki, Greece

    Petros Daras

  4. Knowledge Media Institute, The Open University, Walton Hall, MK7 6AA, Milton Keynes, UK

    John Domingue

  5. Dept. of Electronic and Electrical Engineering, University College London, London, UK

    Alex Galis

  6. ENoLL, Brussels, Belgium

    Ana Garcia

  7. Eurescom GmbH, Heidelberg, Germany

    Anastasius Gavras

  8. SAP Research, Germany

    Stamatis Karnourskos

  9. Ericsson Serbia, Belgrade, Serbia

    Srdjan Krco

  10. IC Focus, London, UK

    Man-Sze Li

  11. SAP Research, Sophia Antipolis, France

    Volkmar Lotz

  12. Business Information Systems, University of Applied Sciences Western Switzerland, Sierre, Switzerland

    Henning Müller

  13. Create-Net, Via Solteri 38, 38100, Trento, Italy

    Elio Salvadori

  14. European Commission, Brussels, Belgium

    Anne-Marie Sassen & Georgios Tselentis & 

  15. ESoCE Net, Dialogic, Aalto University School of Economics (CKIR), Aalto, Finland

    Hans Schaffers

  16. Institut für Informatik (IFI), Universität Zürich, Binzmühlestrasse 14, 8050, Zürich, Switzerland

    Burkhard Stiller

  17. University of Aalto, Finland

    Petra Turkama

  18. Synelixis/TEI of Chalkida, Greece

    Theodore Zahariadis

Rights and permissions

This chapter is published under an open access license. Please check the 'Copyright Information' section either on this page or in the PDF for details of this license and what re-use is permitted. If your intended use exceeds what is permitted by the license or if you are unable to locate the licence and re-use information, please contact the Rights and Permissions team.

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Axenopoulos, A. et al. (2012). I-SEARCH: A Unified Framework for Multimodal Search and Retrieval. In: Álvarez, F., et al. The Future Internet. FIA 2012. Lecture Notes in Computer Science, vol 7281. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-30241-1_12

Download citation

  • .RIS
  • .ENW
  • .BIB
  • DOI: https://doi.org/10.1007/978-3-642-30241-1_12

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-30240-4

  • Online ISBN: 978-3-642-30241-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Share this paper

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

Search

Navigation

  • Find a journal
  • Publish with us

Discover content

  • Journals A-Z
  • Books A-Z

Publish with us

  • Publish your research
  • Open access publishing

Products and services

  • Our products
  • Librarians
  • Societies
  • Partners and advertisers

Our imprints

  • Springer
  • Nature Portfolio
  • BMC
  • Palgrave Macmillan
  • Apress
  • Your US state privacy rights
  • Accessibility statement
  • Terms and conditions
  • Privacy policy
  • Help and support

Not affiliated

Springer Nature

© 2023 Springer Nature