Advertisement

Image Retrieval Evaluation in Specific Domains

  • Luca PirasEmail author
  • Barbara Caputo
  • Duc-Tien Dang-Nguyen
  • Michael Riegler
  • Pål Halvorsen
Chapter
Part of the The Information Retrieval Series book series (INRE, volume 41)

Abstract

Image retrieval was, and still is, a hot topic in research. It comes with many challenges that changed over the years with the emergence of more advanced methods for analysis and enormous growth of images created, shared and consumed. This chapter gives an overview of domain-specific image retrieval evaluation approaches, which were part of the ImageCLEF evaluation campaign . Specifically, the robot vision, photo retrieval, scalable image annotation and lifelogging tasks are presented. The ImageCLEF medical activity is described in a separate chapter in this volume. Some of the presented tasks have been available for several years, whereas others are quite new (like lifelogging). This mix of new and old topics has been chosen to give the reader an idea about the development and trends within image retrieval. For each of the tasks, the datasets, participants, techniques used and lessons learned are presented and discussed leading to a comprehensive summary.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Abdallah FB, Feki G, Ezzarka M, Ammar AB, Amar CB (2018) Regim Lab Team at ImageCLEFlifelog LMRT Task 2018. In: Cappellato L, Ferro N, Nie JY, Soulier L (eds) CLEF 2018 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-2125/
  2. Agosti M, Ferro N, Peters C, de Rijke M, Smeaton A (eds) (2010) multilingual and multimodal information access evaluation. In: Proceedings of the international conference of the cross-language evaluation forum (CLEF 2010). Lecture notes in computer science (LNCS), vol 6360. Springer, HeidelbergGoogle Scholar
  3. Arni T, Clough P, Sanderson M, Grubinger M (2009) Overview of the ImageCLEFphoto 2008 photographic retrieval task. In: Peters C, Deselaers T, Ferro N, Gonzalo J, Jones GJF, Kurimo M, Mandl T, Peñas A (eds) Evaluating systems for multilingual and multimodal information access: ninth workshop of the cross–language evaluation forum (CLEF 2008). Revised selected papers. Lecture notes in computer science (LNCS), vol 5706. Springer, Heidelberg, pp 500–511CrossRefGoogle Scholar
  4. Babenko A, Slesarev A, Chigorin A, Lempitsky VS (2014) Neural codes for image retrieval. In: Fleet DJ, Pajdla T, Schiele B, Tuytelaars T (eds) Computer vision - ECCV 2014 - 13th European conference, Zurich, Switzerland, September 6–12, 2014, proceedings, part I. Lecture notes in computer science, vol 8689. Springer, Berlin, pp 584–599. https://doi.org/10.1007/978-3-319-10590-1 Google Scholar
  5. Balog K, Cappellato L, Ferro N, Macdonald C (eds) (2016) CLEF 2016 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1609/
  6. Borgne HL, Popescu A, Znaidia A (2013) CEA list@ImageCLEF 2013: scalable concept image annotation. In: Forner P, Navigli R, Tufis D, Ferro N (eds) CLEF 2013 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1179/
  7. Borgne HL, Gadeski E, Chami I, Tran TQN, Tamaazousti Y, Gînsca A, Popescu A (2016) Image annotation and two paths to text illustration. In: Balog K, Cappellato L, Ferro N, Macdonald C (eds) CLEF 2016 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1609/
  8. Braschler M, Harman DK, Pianta E, Ferro N (eds) (2010) CLEF 2010 Working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1176/
  9. Calfa A, Silion D, Bursuc AC, Acatrinei CP, Lupu RI, Cozma AE, Padurariu C, Iftene A (2015) Using textual and visual processing in scalable concept image annotation challenge. In: Cappellato L, Ferro N, Jones GJF, SanJuan E (eds) CLEF 2015 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1391/
  10. Cappellato L, Ferro N, Halvey M, Kraaij W (eds) (2014) CLEF 2014 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1180/
  11. Cappellato L, Ferro N, Jones GJF, SanJuan E (eds) (2015) CLEF 2015 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1391/
  12. Cappellato L, Ferro N, Goeuriot L, Mandl T (eds) (2017) CLEF 2017 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1866/
  13. Cappellato L, Ferro N, Nie JY, Soulier L (eds) (2018) CLEF 2018 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-2125/
  14. Clough P, Sanderson M (2004) The CLEF 2003 cross language image retrieval track. In: Peters C, Braschler M, Gonzalo J, Kluck M (eds) Comparative evaluation of multilingual information access systems: fourth workshop of the cross–language evaluation forum (CLEF 2003), Revised selected papers. Lecture notes in computer science (LNCS), vol 3237, Springer, Heidelberg, pp 581–593CrossRefGoogle Scholar
  15. Clough P, Müller H, Sanderson M (2005) The CLEF 2004 cross-language image retrieval track. In: Peters C, Clough P, Gonzalo J, Jones GJF, Kluck M, Magnini B (eds) Multilingual information access for text, speech and images: fifth workshop of the cross–language evaluation forum (CLEF 2004), Revised selected papers. Lecture notes in computer science (LNCS), vol 3491. Springer, Heidelberg, pp 597–613CrossRefGoogle Scholar
  16. Clough P, Müller H, Deselaers T, Grubinger M, Lehmann TM, Jensen J, Hersh W (2006) The CLEF 2005 cross–language image retrieval track. In: Peters C, Gey FC, Gonzalo J, Jones GJF, Kluck M, Magnini B, Müller H, de Rijke M (eds) Accessing multilingual information repositories: sixth workshop of the cross–language evaluation forum (CLEF 2005). Revised selected papers. Lecture notes in computer science (LNCS), vol 4022. Springer, Heidelberg, pp 535–557CrossRefGoogle Scholar
  17. Clough P, Grubinger M, Deselaers T, Hanbury A, Müller H (2007) Overview of the ImageCLEF 2006 photographic retrieval and object annotation tasks. In: Peters C, Clough P, Gey FC, Karlgren J, Magnini B, Oard DW, de Rijke M, Stempfhuber M (eds) Evaluation of multilingual and multi-modal information retrieval: seventh workshop of the cross–language evaluation forum (CLEF 2006). Revised selected papers. Lecture notes in computer science (LNCS), vol 4730. Springer, Heidelberg, pp 223–256CrossRefGoogle Scholar
  18. Dang-Nguyen DT, Piras L, Giacinto G, Boato G, Natale FGBD (2017a) Multimodal retrieval with diversification and relevance feedback for tourist attraction images. ACM Trans Multimedia Comput Commun Appl 13(4):49:1–49:24. http://doi.acm.org/10.1145/3103613 CrossRefGoogle Scholar
  19. Dang-Nguyen DT, Piras L, Riegler M, Boato G, Zhou L, Gurrin C (2017b) Overview of ImageCLEFlifelog 2017: lifelog retrieval and summarization. In: Cappellato L, Ferro N, Goeuriot L, Mandl T (eds) CLEF 2017 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1866/
  20. Dang-Nguyen DT, Piras L, Riegler M, Zhou L, Lux M, Gurrin C (2018) Overview of ImageCLEFlifelog 2018: daily living understanding and lifelog moment retrieval. In: Cappellato L, Ferro N, Nie JY, Soulier L (eds) CLEF 2018 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-2125/
  21. Deselaers T, Hanbury A (2009) The visual concept detection task in ImageCLEF 2008. In: Peters C, Deselaers T, Ferro N, Gonzalo J, Jones GJF, Kurimo M, Mandl T, Peñas A (eds) (2009) Evaluating systems for multilingual and multimodal information access: ninth workshop of the cross–language evaluation forum (CLEF 2008). Revised selected papers. Lecture notes in computer science (LNCS), vol 5706. Springer, Heidelberg, pp 531–538CrossRefGoogle Scholar
  22. Deselaers T, Hanbury A, Viitaniemi V, Benczúr AA, Brendel M, Daróczy B, Escalante Balderas HJ, Gevers T, Hernández-Gracidas CA, Hoi SCH, Laaksonen J, Li M, Marín Castro HM, Ney H, Rui X, Sebe N, Stöttinger J, Wu L (2008) Overview of the ImageCLEF 2007 object retrieval task. In: Peters C, Jijkoun V, Mandl T, Müller H, Oard DW, Peñas A, Petras V, Santos D (eds) Advances in multilingual and multimodal information retrieval: eighth workshop of the cross–language evaluation forum (CLEF 2007). Revised selected papers. Lecture notes in computer science (LNCS), vol 5152, Springer, Heidelberg, pp 445–471Google Scholar
  23. Dogariu M, Ionescu B (2017) A textual filtering of HOG-based hierarchical clustering of lifelog data. In: Cappellato L, Ferro N, Goeuriot L, Mandl T (eds) CLEF 2017 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1866/
  24. Dogariu M, Ionescu B (2018) Multimedia lab @ CAMPUS at ImageCLEFlifelog 2018 lifelog moment retrieval. In: Cappellato L, Ferro N, Nie JY, Soulier L (eds) CLEF 2018 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-2125/
  25. Forner P, Karlgren J, Womser-Hacker C, Ferro N (eds) (2012) CLEF 2012 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1178/
  26. Forner P, Navigli R, Tufis D, Ferro N (eds) (2013) CLEF 2013 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1179/
  27. Fornoni M, Martínez-Gómez J, Caputo B (2010) A multi cue discriminative approach to semantic place classification. In: Agosti M, Ferro N, Peters C, de Rijke M, Smeaton A (eds) multilingual and multimodal information access evaluation. In: Proceedings of the international conference of the cross-language evaluation forum (CLEF 2010). Lecture notes in computer science (LNCS), vol 6360. Springer, HeidelbergGoogle Scholar
  28. Fraundorfer F, Wu C, Pollefeys M (2010) Methods for combined monocular and stereo mobile robot localization. In: Ünay D, Çataltepe Z, Aksoy S (eds) Recognizing patterns in signals, speech, images and videos - ICPR 2010 contests, Istanbul, Turkey, August 23–26, 2010, Contest reports. Lecture notes in computer science, vol 6388. Springer, Berlin, pp 180–189. https://doi.org/10.1007/978-3-642-17711-8_19 Google Scholar
  29. Gadeski E, Borgne HL, Popescu A (2015) CEA list’s participation to the scalable concept image annotation task of imageclef 2015. In: Cappellato L, Ferro N, Jones GJF, SanJuan E (eds) CLEF 2015 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1391/
  30. Gilbert A, Piras L, Wang J, Yan F, Dellandréa E, Gaizauskas RJ, Villegas M, Mikolajczyk K (2015) Overview of the ImageCLEF 2015 scalable image annotation, localization and sentence generation task. In: Cappellato L, Ferro N, Jones GJF, SanJuan E (eds) CLEF 2015 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1391/
  31. Gilbert A, Piras L, Wang J, Yan F, Ramisa A, Dellandréa E, Gaizauskas RJ, Villegas M, Mikolajczyk K (2016) Overview of the ImageCLEF 2016 scalable concept image annotation task. In: Balog K, Cappellato L, Ferro N, Macdonald C (eds) CLEF 2016 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1609/
  32. Grana C, Serra G, Manfredi M, Cucchiara R, Martoglia R, Mandreoli F (2013) UNIMORE at imageclef 2013: scalable concept image annotation. In: Forner P, Navigli R, Tufis D, Ferro N (eds) CLEF 2013 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1179/
  33. Grubinger M, Clough P, Hanbury A, Müller H (2008) Overview of the ImageCLEFphoto 2007 photographic retrieval task. In: Peters C, Jijkoun V, Mandl T, Müller H, Oard DW, Peñas A, Petras V, Santos D (eds) Advances in multilingual and multimodal information retrieval: eighth workshop of the cross–language evaluation forum (CLEF 2007). Revised selected papers. Lecture notes in computer science (LNCS), vol 5152, Springer, Heidelberg, pp 433–444Google Scholar
  34. Gurrin C, Joho H, Hopfgartner F, Zhou L, Albatal R (2016) NTCIR lifelog: the first test collection for lifelog research. In: Proceedings of the 12th NTCIR conference on evaluation of information access technologies, pp 705–708Google Scholar
  35. Gurrin C, Joho H, Hopfgartner F, Zhou L, Gupta R, Albatal R, Dang-Nguyen DT (2017) Overview of NTCIR-13 Lifelog-2 task. In: Proceedings of the 13th NTCIR conference on evaluation of information access technologiesGoogle Scholar
  36. Hidaka M, Gunji N, Harada T (2013) MIL at imageclef 2013: scalable system for image annotation. In: Forner P, Navigli R, Tufis D, Ferro N (eds) CLEF 2013 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1179/
  37. Jia Y, Shelhamer E, Donahue J, Karayev S, Long J, Girshick R, Guadarrama S, Darrell T (2014) Caffe: convolutional architecture for fast feature embedding. In: Proceedings of the 22Nd ACM international conference on multimedia, MM‘14. ACM, New York, pp 675–678. http://doi.acm.org/10.1145/2647868.2654889 Google Scholar
  38. Kakar P, Wang X, Chia AY (2015) Automatic image annotation using weakly labelled web data. In: Cappellato L, Ferro N, Jones GJF, SanJuan E (eds) CLEF 2015 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1391/
  39. Kanehira A, Hidaka M, Mukuta Y, Tsuchiya Y, Mano T, Harada T (2014) MIL at imageclef 2014: scalable system for image annotation. In: Cappellato L, Ferro N, Halvey M, Kraaij W (eds) CLEF 2014 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1180/
  40. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Bartlett PL, Pereira FCN, Burges CJC, Bottou L, Weinberger KQ (eds) Advances in neural information processing systems 25: 26th annual conference on neural information processing systems 2012. Proceedings of a meeting held December 3–6, 2012, Lake Tahoe, Nevada, pp 1106–1114. http://papers.nips.cc/book/advances-in-neural-information-processing-systems-25-2012
  41. Lestari Paramita M, Sanderson M, Clough P (2010) Diversity in photo retrieval: overview of the ImageCLEFPhoto task 2009. In: Peters C, Tsikrika T, Müller H, Kalpathy-Cramer J, Jones GJF, Gonzalo J, Caputo B (eds) Multilingual information access evaluation vol. II multimedia experiments – tenth workshop of the cross–language evaluation forum (CLEF 2009). Revised selected papers. Lecture notes in computer science (LNCS). Springer, Heidelberg, pp 45–59Google Scholar
  42. Li X, Jin Q, Liao S, Liang J, He X, Huo Y, Lan W, Xiao B, Lu Y, Xu J (2015a) RUC-Tencent at imageclef 2015: concept detection, localization and sentence generation. In: Cappellato L, Ferro N, Jones GJF, SanJuan E (eds) CLEF 2015 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1391/
  43. Li Y, Liu J, Wang Y, Liu B, Fu J, Gao Y, Wu H, Song H, Ying P, Lu H (2015b) Hybrid learning framework for large-scale web image annotation and localization. In: Cappellato L, Ferro N, Jones GJF, SanJuan E (eds) CLEF 2015 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1391/
  44. Luo J, Pronobis A, Caputo B, Jensfelt P (2007) Incremental learning for place recognition in dynamic environments. In: 2007 IEEE/RSJ international conference on intelligent robots and systems, October 29–November 2, 2007, Sheraton Hotel and Marina, San Diego, pp 721–728Google Scholar
  45. Martínez-Gómez J, Jiménez-Picazo A, García-Varea I (2009) A particle-filter based self-localization method using invariant features as visual information. In: Peters C, Ferro N (eds) Working notes for CLEF 2009 workshop co-located with the 13th European conference on digital libraries (ECDL 2009), Corfù, Greece, September 30–October 2, 2009, CEUR-WS.org, CEUR workshop proceedings, vol 1175. http://ceur-ws.org/Vol-1175/CLEF2009wn-ImageCLEF-MartinezGomezEt2009.pdf
  46. Martínez-Gómez J, Jiménez-Picazo A, Gámez JA, García-Varea I (2010) Combining image invariant features and clustering techniques for visual place classification. In: Ünay D, Çataltepe Z, Aksoy S (eds) Recognizing patterns in signals, speech, images and videos - ICPR 2010 contests, Istanbul, Turkey, August 23–26, 2010, Contest reports. Lecture notes in computer science, vol 6388. Springer, Berlin, pp 200–209. https://doi.org/10.1007/978-3-642-17711-8_21 Google Scholar
  47. Martínez-Gómez J, García-Varea I, Caputo B (2012) Overview of the ImageCLEF 2012 robot vision task. In: Forner P, Karlgren J, Womser-Hacker C, Ferro N (eds) CLEF 2012 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1178/
  48. Martínez-Gómez J, García-Varea I, Cazorla M, Caputo B (2013) Overview of the ImageCLEF 2013 robot vision task. In: Forner P, Navigli R, Tufis D, Ferro N (eds) CLEF 2013 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1179/
  49. Martínez-Gómez J, García-Varea I, Cazorla M, Morell V (2014) Overview of the ImageCLEF 2014 robot vision task. In: Cappellato L, Ferro N, Halvey M, Kraaij W (eds) CLEF 2014 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1180/
  50. Molino AGD, Mandal B, Lin J, Lim JH, Subbaraju V, Chandrasekhar V (2017) VC-I2R@ImageCLEF2017: ensemble of deep learned features for lifelog video summarization. In: Cappellato L, Ferro N, Goeuriot L, Mandl T (eds) CLEF 2017 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1866/
  51. Nilsback M, Caputo B (2004) Cue integration through discriminative accumulation. In: 2004 IEEE computer society conference on computer vision and pattern recognition (CVPR 2004), with CD-ROM, 27 June–2 July 2004, Washington. IEEE Computer Society, Washington, pp 578–585. http://doi.ieeecomputersociety.org/10.1109/CVPR.2004.67
  52. Nowak S, Dunker P (2010) Overview of the CLEF 2009 large-scale visual concept detection and annotation task. In: Peters C, Tsikrika T, Müller H, Kalpathy-Cramer J, Jones GJF, Gonzalo J, Caputo B (eds) Multilingual information access evaluation vol. II multimedia experiments – tenth workshop of the cross–language evaluation forum (CLEF 2009). Revised selected papers. Lecture notes in computer science (LNCS). Springer, Heidelberg, pp 94–109Google Scholar
  53. Nowak S, Huiskes MJ (2010) New strategies for image annotation: overview of the photo annotation task at ImageCLEF 2010. In: Braschler M, Harman DK, Pianta E, Ferro N (eds) CLEF 2010 Working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1176/
  54. Nowak S, Nagel K, Liebetrau J (2011) The CLEF 2011 photo annotation and concept-based retrieval tasks. In: Petras V, Forner P, Clough P, Ferro N (eds) CLEF 2011 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1177/
  55. Pellegrin L, Vanegas JA, Ovalle JEA, Beltrán V, Escalante HJ, Montes-y-Gómez M, González FA (2015) INAOE-UNAL at imageclef 2015: scalable concept image annotation. In: Cappellato L, Ferro N, Jones GJF, SanJuan E (eds) CLEF 2015 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1391/
  56. Peters C, Jijkoun V, Mandl T, Müller H, Oard DW, Peñas A, Petras V, Santos D (eds) (2008) Advances in multilingual and multimodal information retrieval: eighth workshop of the cross–language evaluation forum (CLEF 2007). Revised selected papers. Lecture notes in computer science (LNCS), vol 5152, Springer, HeidelbergGoogle Scholar
  57. Peters C, Deselaers T, Ferro N, Gonzalo J, Jones GJF, Kurimo M, Mandl T, Peñas A (eds) (2009) Evaluating systems for multilingual and multimodal information access: ninth workshop of the cross–language evaluation forum (CLEF 2008). Revised selected papers. Lecture notes in computer science (LNCS), vol 5706. Springer, HeidelbergGoogle Scholar
  58. Peters C, Tsikrika T, Müller H, Kalpathy-Cramer J, Jones GJF, Gonzalo J, Caputo B (eds) (2010) Multilingual information access evaluation vol. II multimedia experiments – tenth workshop of the cross–language evaluation forum (CLEF 2009). Revised selected papers. Lecture notes in computer science (LNCS). Springer, HeidelbergGoogle Scholar
  59. Piras L, Giacinto G (2017) Information fusion in content based image retrieval: a comprehensive overview. Inf Fusion 37:50–60CrossRefGoogle Scholar
  60. Portaz M, Budnik M, Mulhem P, Poignant J (2016) MRIM-LIG at imageclef 2016 scalable concept image annotation task. In: Balog K, Cappellato L, Ferro N, Macdonald C (eds) CLEF 2016 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1609/
  61. Pronobis A, Caputo B (2009) COLD: the cosy localization database. I J Robot Res 28(5):588–594CrossRefGoogle Scholar
  62. Pronobis A, Fornoni M, Christensen HI, Caputo B (2010a) The robot vision track at ImageCLEF 2010. In: Braschler M, Harman DK, Pianta E, Ferro N (eds) CLEF 2010 Working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1176/
  63. Pronobis A, Xing L, Caputo B (2010b) Overview of the CLEF 2009 robot vision track. In: Peters C, Tsikrika T, Müller H, Kalpathy-Cramer J, Jones GJF, Gonzalo J, Caputo B (eds) Multilingual information access evaluation vol. II multimedia experiments – tenth workshop of the cross–language evaluation forum (CLEF 2009). Revised selected papers. Lecture notes in computer science (LNCS). Springer, Heidelberg, pp 110–119Google Scholar
  64. Sahbi H (2013) CNRS - TELECOM ParisTech at ImageCLEF 2013 scalable concept image annotation task: winning annotations with context dependent SVMS. In: Forner P, Navigli R, Tufis D, Ferro N (eds) CLEF 2013 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1179/
  65. Sahbi H (2016) CNRS TELECOM paristech at imageclef 2016 scalable concept image annotation task: overcoming the scarcity of training data. In: Balog K, Cappellato L, Ferro N, Macdonald C (eds) CLEF 2016 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1609/
  66. Sánchez-Oro J, Montalvo S, Montemayor AS, Pantrigo JJ, Duarte A, Fresno V, Martínez-Unanue R (2013) Urjc&uned at imageclef 2013 photo annotation task. In: Forner P, Navigli R, Tufis D, Ferro N (eds) CLEF 2013 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1179/
  67. Saurer O, Fraundorfer F, Pollefeys M (2010) Visual localization using global visual features and vanishing points. In: Agosti M, Ferro N, Peters C, de Rijke M, Smeaton A (eds) multilingual and multimodal information access evaluation. In: Proceedings of the international conference of the cross-language evaluation forum (CLEF 2010). Lecture notes in computer science (LNCS), vol 6360. Springer, HeidelbergGoogle Scholar
  68. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. CoRR abs/1409.1556.Google Scholar
  69. Tang TH, Fu1 MH, Huang HH, Chen KT, Chen HH (2018) NTU NLP-Lab at ImageCLEFlifelog 2018: visual concept selection with textual knowledge for understanding activities of daily living and life moment retrieval. In: Cappellato L, Ferro N, Nie JY, Soulier L (eds) CLEF 2018 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-2125/
  70. Thomee B, Popescu A (2012) Overview of the ImageCLEF 2012 flickr photo annotation and retrieval task. In: Forner P, Karlgren J, Womser-Hacker C, Ferro N (eds) CLEF 2012 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1178/
  71. Tran MT, Truong TD, Dinh-Duy T, Vo-Ho VK, Luong QA, Nguyen VT (2018) Lifelog moment retrieval with visual concept fusion and text-based query expansion. In: Cappellato L, Ferro N, Nie JY, Soulier L (eds) CLEF 2018 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-2125/
  72. Uijlings JRR, van de Sande KEA, Gevers T, Smeulders AWM (2013) Selective search for object recognition. Int J Comput Vis 104(2):154–171CrossRefGoogle Scholar
  73. Ünay D, Çataltepe Z, Aksoy S (eds) (2010) Recognizing patterns in signals, speech, images and videos - ICPR 2010 contests, Istanbul, Turkey, August 23–26, 2010, Contest reports. Lecture notes in computer science, vol 6388. Springer, Berlin. https://doi.org/10.1007/978-3-642-17711-8 Google Scholar
  74. Ushiku Y, Harada T, Kuniyoshi Y (2012a) Efficient image annotation for automatic sentence generation. In: Babaguchi N, Aizawa K, Smith JR, Satoh S, Plagemann T, Hua X, Yan R (eds) Proceedings of the 20th ACM multimedia conference, MM‘12, Nara, Japan, October 29–November 02, 2012. ACM, New York, pp 549–558Google Scholar
  75. Ushiku Y, Muraoka H, Inaba S, Fujisawa T, Yasumoto K, Gunji N, Higuchi T, Hara Y, Harada T, Kuniyoshi Y (2012b) ISI at imageclef 2012: scalable system for image annotation. In: Forner P, Karlgren J, Womser-Hacker C, Ferro N (eds) CLEF 2012 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1178/
  76. Vanegas JA, Ovalle JEA, Montenegro JSO, Páez F, Pérez-Rubiano SA, González FA (2014) Mindlab at imageclef 2014: scalable concept image annotation. In: Cappellato L, Ferro N, Halvey M, Kraaij W (eds) CLEF 2014 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1180/
  77. Villegas M, Paredes R (2012) Overview of the ImageCLEF 2012 scalable web image annotation task. In: Forner P, Karlgren J, Womser-Hacker C, Ferro N (eds) CLEF 2012 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1178/
  78. Villegas M, Paredes R (2014) Overview of the ImageCLEF 2014 scalable concept image annotation task. In: Cappellato L, Ferro N, Halvey M, Kraaij W (eds) CLEF 2014 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1180/
  79. Villegas M, Paredes R, Thomee B (2013) Overview of the ImageCLEF 2013 scalable concept image annotation subtask. In: Forner P, Navigli R, Tufis D, Ferro N (eds) CLEF 2013 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1179/
  80. Xing L, Pronobis A (2009) Multi-cue discriminative place recognition. In: Peters C, Tsikrika T, Müller H, Kalpathy-Cramer J, Jones GJF, Gonzalo J, Caputo B (eds) Multilingual information access evaluation vol. II multimedia experiments – tenth workshop of the cross–language evaluation forum (CLEF 2009). Revised selected papers. Lecture notes in computer science (LNCS). Springer, Heidelberg, pp 315–323Google Scholar
  81. Xu X, Shimada A, Taniguchi R (2014) MLIA at ImageCLFE 2014 scalable concept image annotation challenge. In: Cappellato L, Ferro N, Halvey M, Kraaij W (eds) CLEF 2014 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1180/
  82. Zellhöfer D (2012) Overview of the personal photo retrieval pilot task at ImageCLEF 2012. In: Forner P, Karlgren J, Womser-Hacker C, Ferro N (eds) CLEF 2012 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1178/
  83. Zellhöfer D (2013) Overview of the ImageCLEF 2013 personal photo retrieval subtask. In: Forner P, Navigli R, Tufis D, Ferro N (eds) CLEF 2013 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1179/
  84. Zhou L, Piras L, Riegler M, Boato G, Dang-Nguyen DT, Gurrin C (2017) Organizer team at ImageCLEFlifelog 2017: baseline approaches for lifelog retrieval and summarization. In: Cappellato L, Ferro N, Goeuriot L, Mandl T (eds) CLEF 2017 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-1866/
  85. Zhou L, Piras L, Riegler M, Lux M, Dang-Nguyen1 DT, Gurrin C (2018) An interactive lifelog retrieval system for activities of daily living understanding. In: Cappellato L, Ferro N, Nie JY, Soulier L (eds) CLEF 2018 working notes. CEUR workshop proceedings (CEUR-WS.org). ISSN 1613-0073. http://ceur-ws.org/Vol-2125/

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Luca Piras
    • 1
    • 2
    Email author
  • Barbara Caputo
    • 3
  • Duc-Tien Dang-Nguyen
    • 4
    • 5
  • Michael Riegler
    • 6
  • Pål Halvorsen
    • 7
  1. 1.University of CagliariCagliariItaly
  2. 2.Pluribus OneCagliariItaly
  3. 3.University of Rome La SapienzaRomeItaly
  4. 4.University of BergenBergenNorway
  5. 5.Dublin City UniversityDublinIreland
  6. 6.Simula Metropolitan Center for Digital Engineering and Kristiania Universiy CollegeOsloNorway
  7. 7.Simula Metropolitan Center for Digital EngineeringSimula Research Laboratory and University of OsloOsloNorway

Personalised recommendations