XML Multimedia Retrieval: From Relevant Textual Information to Relevant Multimedia Fragments

  • Mouna Torjmen
  • Karen Pinel-Sauvagnat
  • Mohand Boughanem
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5478)


In this paper, we are interested in XML multimedia document retrieval, whose aim is to find relevant multimedia components (i.e. XML fragments containing another media than text) that focus on the user needs. The work described here is carried out with images, but can be extended to any other media. We propose an XML multimedia fragment retrieval approach based on two steps. In a first step, we search for relevant images and then we retrieve the best multimedia fragments corresponding to these images. Image retrieval is done using textual and structural information from ascendant, sibling and direct descendant nodes in the XML tree, while multimedia fragment retrieval is done by evaluating the score of ancestors of images retrieved in the first step. Experiments were done on the INEX 2006 and 2007 Multimedia Fragments task and show the interest of our method.


XML information retrieval multimedia fragment image 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Aslandogan, Y.A., Yu, C.T.: Techniques and systems for image and video retrieval. IEEE Trans. on Knowl. and Data Eng., 56–63 (1999)Google Scholar
  2. 2.
    Denoyer, L., Gallinari, P.: The wikipedia XML corpus. In: SIGIR Forum 2006, pp. 64–69 (2006)Google Scholar
  3. 3.
    Fuhr, N., Lalmas, M., Malik, S., Kazai, G. (eds.): INEX 2005. LNCS, vol. 3977. Springer, Heidelberg (2006)Google Scholar
  4. 4.
    Fuhr, N., Lalmas, M., Malik, S., Szlávik, Z. (eds.): INEX 2004. LNCS, vol. 3493. Springer, Heidelberg (2005)Google Scholar
  5. 5.
    Fuhr, N., Lalmas, M., Trotman, A.: INEX 2006 (2006)Google Scholar
  6. 6.
    Fuhr, N., Kamps, J., Lalmas, M., Trotman, A. (eds.): INEX 2007. LNCS, vol. 4862. Springer, Heidelberg (2008)Google Scholar
  7. 7.
    Hlaoua, L., Torjmen, M., Pinel-Sauvagnat, K., Boughanem, M.: XFIRM at INEX 2006. Ad-hoc, Relevance Feedback and MultiMedia Tracks. In: INEX [5], pp. 373–386Google Scholar
  8. 8.
    Iskandar, D.A., Pehcevski, J., Thom, J.A., Tahaghoghi, S.: Combining image and structured text retrieval. In: INEX [3]Google Scholar
  9. 9.
    Iskandar, D.N.F.A., Pehcevski, J., Thom, J.A., Tahaghoghi, S.M.M.: Combining image and structured text retrieval. In: INEX [3], pp. 525–539Google Scholar
  10. 10.
    Iskandar, D.N.F.A., Pehcevski, J., Thom, J.A., Tahaghoghi, S.M.M.: Social media retrieval using image features and structured text. In: INEX [5], pp. 358–372Google Scholar
  11. 11.
    Kamps, J., Pehcevski, J., Kazai, G., Lalmas, M., Robertson, S.: INEX 2007 evaluation measures. In: INEX [6], pp. 24–33Google Scholar
  12. 12.
    Kong, Z., Lalmas, M.: XML multimedia retrieval. In: Consens, M.P., Navarro, G. (eds.) SPIRE 2005. LNCS, vol. 3772, pp. 218–223. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  13. 13.
    Kong, Z., Lalmas, M.: Using XML logical structure to retrieve (Multimedia) objects. In: Kovács, L., Fuhr, N., Meghini, C. (eds.) ECDL 2007. LNCS, vol. 4675, pp. 100–111. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  14. 14.
    Lew, M.S., Sebe, N., Djeraba, C., Jain, R.: Content-based multimedia information retrieval: State of the art and challenges. ACM Trans. Multimedia Comput. Commun. Appl., 1–19 (2006)Google Scholar
  15. 15.
    Mass, Y., Mandelbrod, M.: Experimenting various user models for XML retrieval. In: INEX [3]Google Scholar
  16. 16.
    Pinel-Sauvagnat, K., Boughanem, M., Chrisment, C.: Answering content-and-structure-based queries on XML documents using relevance propagation. In: Information system, Special Issue SPIRE 2004, vol. 31, pp. 621–635 (January 2006)Google Scholar
  17. 17.
    Sauvagnat, K., Boughanem, M., Chrisment, C.: Searching XML documents using relevance propagation. LNCS. Springer, Heidelberg (2004)CrossRefzbMATHGoogle Scholar
  18. 18.
    Sauvagnat, K., Hlaoua, L., Boughanem, M.: XFIRM at INEX 2005: Ad-hoc and relevance feedback tracks. LNCS. Springer, Heidelberg (2006)Google Scholar
  19. 19.
    Smeulders, A., Worring, M., Santini, S., Gupta, A., Jain, R.: Content-based image retrieval at the end of the early years. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1349–1380 (2000)Google Scholar
  20. 20.
    Tjondronegoro, D., Zhang, J., Gu, J., Nguyen, A., Geva, S.: Integrating text retrieval and image retrieval in XML document searching. In: INEX [3], pp. 511–524Google Scholar
  21. 21.
    Tsikrika, T., Serdyukov, P., Rode, H., Westerveld, T., Aly, R., Hiemstra, D., de Vries, A.P.: Structured Document Retrieval, Multimedia Retrieval, and Entity Ranking Using PF/Tijah. In: INEX [6], pp. 273–286.Google Scholar
  22. 22.
    Tsikrika, T., Westerveld, T.: Report on the INEX 2007 multimedia track. In: INEX [6], pp. 410–422Google Scholar
  23. 23.
    van Zwol, R.: Multimedia strategies for \(^{\mbox{3}}\)-sdr, based on principal component analysis. In: INEX [3], pp. 540–553Google Scholar
  24. 24.
    van Zwol, R., Kazai, G., Lalmas, M.: INEX 2005 multimedia track. In: INEX [3]Google Scholar
  25. 25.
    Westerveld, T., van Zwol, R.: The INEX 2006 multimedia track. In: INEX [5], pp. 331–344Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Mouna Torjmen
    • 1
  • Karen Pinel-Sauvagnat
    • 1
  • Mohand Boughanem
    • 1
  1. 1.SIG-RFI, IRITToulouseFrance

Personalised recommendations