Abstract
In the field of Multimodal Information Retrieval, one of the issue to tackle is how to effectively browse the search result space. In addressing this issue, it is particularly important to take into consideration that, especially nowadays, data is highly semantically interlinked. In this scenario, we present a tool to navigate and visualize the results produced by the evaluation of a query over a set of multiple media objects. The search result space can be represented via a graph-based data model where (i) multiple media objects are represented as nodes with multiple modalities of information associated with them, and (ii) media objects can be connected via different kinds of relationships. Our idea is to give to the user the possibility to navigate the space of the results of a query, constituted by multiple media objects, as s/he was exploring a graph of connected entities. As a preliminary work, in this paper we only deal with textual information for building similarity relationships among media objects and part-of relationships in the case of media objects belonging to a same (multimedia) document. This way, we show how a user can navigate and visualize the result space following different links connecting media objects. We illustrate our navigation and visualization tool with different examples.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Lauer, C.: Contending with terms: Multimodal and Multimedia in the Academic and Public Spheres. J. Computers and Composition 26, 225–239 (2009)
Rafailidis, D., Manolopoulou, S., Daras, P.: A unified framework for multimodal retrieval. J. Pattern Recognition 4, 358–3370 (2013)
Tjondronegoro, D., Spink, A., Jansen, B.J.: A study and comparison of multimedia Web searching: 1997–2006. J. American Society for Information Science and Technology 60, 1756–1768 (2009)
Bozzon, A., Fraternali, P.: Chapter 8: Multimedia and multimodal information retrieval. In: Ceri, S., Brambilla, M. (eds.) Search Computing. LNCS, vol. 5950, pp. 135–155. Springer, Heidelberg (2010)
Sushmita, S., Joho, H., Lalmas, M., Villa, R.: Factors affecting click-through behavior in aggregated search interfaces. In: 19th ACM International Conference on Information and Knowledge Management, pp. 519–528. ACM (2010)
Bron, M., Van Gorp, J., Nack, F., Baltussen, L.B., de Rijke, M.: Aggregated search interface preferences in multi-session search tasks. In: Proceedings of the 36th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 15–20. ACM, Japan (2013)
Mei, T., Rui, Y., Li, S., Tian, Q.: Multimedia search Re-ranking: A literature survey. ACM Computing Surveys 46(38) (2014)
Kalamaras, I., Malassiotis, S., Tzovaras, D., Mademlis, S.: Novel framework for retrieval and interactive visualization of multimodal data. J. Electronic Letters on Computer Vision and Image Analysis 12, 28–29 (2013)
Lauer, C.: Precision-recall is wrong for multimedia. J. IEEE MultiMedia 18, 04–07 (2009)
Kopliku, A., Pinel-Sauvagnat, K., Boughanem, M.: Aggregated search: A new information retrieval paradigm. ACM Computing Surveys 46(41) (2014)
Zavesky, E., Chang, S.F., Yang, C.C.: Visual islands: intuitive browsing of visual search results. In: Proceedings of International Conference on Content-Based Image and Video Retrieval, pp. 617–626. ACM (2008)
Wiesener, S., Kowarschick, W., Bayer, R.: Semalink: an approach for semantic browsing through large distributed document spaces. In: Proceedings of the Third Forum on Research and Technology Advances in Digital Libraries, pp. 86–94. IEEE (1996)
Szegõ, D.: A logical framework for analyzing properties of multimedia web documents. In: Workshop on Multimedia Discovery and Mining, ECML/PKDD, pp. 19–30. (2003)
Rigamonti, M., Lalanne, D., Ingold, R.: Faericworld: browsing multimedia events through static documents and links. In: Baranauskas, C., Abascal, J., Barbosa, S.D.J. (eds.) INTERACT 2007. LNCS, vol. 4662, pp. 102–115. Springer, Heidelberg (2007)
Lazaridis, M., Axenopoulos, A., Rafailidis, D., Daras, P.: Multimedia search and retrieval using multimodal annotation propagation and indexing techniques. Signal Processing: Image Communication 28, 351–367 (2013)
Sabetghadam, S., Lupu, M., Bierig, R., Rauber, A.: Reachability analysis of graph modelled collections. In: Hanbury, A., Kazai, G., Rauber, A., Fuhr, N. (eds.) ECIR 2015. LNCS, vol. 9022, pp. 370–381. Springer, Heidelberg (2015)
Rizzo, G., Steiner, T., Troncy, R., Verborgh, R., Redondo Garcia, J.L.: What fresh media are you looking for?: retrieving media items from multiple social networks. In: Proceedings of International Workshop on Socially-Aware Multimedia, pp. 15–20. ACM, Japan (2012)
Hearst, M.: Search User Interfaces. Cambridge University Press, UK (2009)
Huang, A.: Similarity measures for text document clustering. In: Proceedings of the Sixth New Zealand Computer Science Research Student Conference, pp. 49–56 (2008)
Chim, H., Deng, X.: Efficient phrase-based document similarity for clustering & Retrieval. IEEE Transactions on Knowledge and Data Engineering 29, 1217–1229 (2009). New Zealand
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Rashid, U., Viviani, M., Pasi, G., Bhatti, M.A. (2016). The Browsing Issue in Multimodal Information Retrieval: A Navigation Tool Over a Multiple Media Search Result Space. In: Andreasen, T., et al. Flexible Query Answering Systems 2015. Advances in Intelligent Systems and Computing, vol 400. Springer, Cham. https://doi.org/10.1007/978-3-319-26154-6_21
Download citation
DOI: https://doi.org/10.1007/978-3-319-26154-6_21
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-26153-9
Online ISBN: 978-3-319-26154-6
eBook Packages: Computer ScienceComputer Science (R0)