A Test Collection for Interactive Lifelog Retrieval
Conference paper
First Online:
- 14 Citations
- 1.5k Downloads
Abstract
There is a long history of repeatable and comparable evaluation in Information Retrieval (IR). However, thus far, no shared test collection exists that has been designed to support interactive lifelog retrieval. In this paper we introduce the LSC2018 collection, that is designed to evaluate the performance of interactive retrieval systems. We describe the features of the dataset and we report on the outcome of the first Lifelog Search Challenge (LSC), which used the dataset in an interactive competition at ACM ICMR 2018.
Keywords
Interactive retrieval Lifelogging Comparative evaluation Test collection Multimodal datasetNotes
Acknowledgements
We acknowledge the financial support of Science Foundation Ireland (SFI) under grant number SFI/12/RC/2289 and JSPS KAKENHI under Grant Number 18H00974.
References
- 1.Alsina, A., Giró, X., Gurrin, C.: An interactive lifelog search engine for LSC2018. In: ACM Workshop on The Lifelog Search Challenge, LSC 2018, pp. 30–32. ACM, New York (2018)Google Scholar
- 2.Bush, V.: As we may think. Interactions 3(2), 35–46 (1996)CrossRefGoogle Scholar
- 3.Dang-Nguyen, D.-T., Piras, L., Riegler, M., Boato, G., Zhou, L., Gurrin, C.: Overview of ImageCLEFlifelog 2017: lifelog retrieval and summarization. In: CLEF2017 Working Notes, Dublin, Ireland, 11–14 September 2017Google Scholar
- 4.Dang-Nguyen, D.-T., Piras, L., Riegler, M., Zhou, L., Lux, M., Gurrin, C.: Overview of ImageCLEFlifelog 2018: daily living understanding and lifelog moment retrieval. In: CLEF2018 Working Notes, CEUR Workshop Proceedings, Avignon, France, 10–14 September 2018. CEUR-WS.org (2018)Google Scholar
- 5.Dang-Nguyen, D.-T., Zhou, L., Gupta, R., Riegler, M., Gurrin, C.: Building a disclosed lifelog dataset:challenges, principles and processes. In: Content-Based Multimedia Indexing (CBMI) (2017)Google Scholar
- 6.Dodge, M., Kitchin, R.: Outlines of a world coming into existence: pervasive computing and the ethics of forgetting. Environ. Plan. B: Plan. Des. 34(3), 431–445 (2007)CrossRefGoogle Scholar
- 7.Duane, A., Gurrin, C., Huerst, W.: Virtual reality lifelog explorer: lifelog search challenge at ACM ICMR 2018. In: ACM Workshop on The Lifelog Search Challenge, LSC 2018, pp. 20–23. ACM, New York (2018)Google Scholar
- 8.Gurrin, C., Joho, H., Hopfgartner, F., Zhou, L., Albatal, R.: NTCIR lifelog: the first test collection for lifelog research. In: Proceedings of SIGIR 2016 Conference, pp. 705–708. ACM (2016)Google Scholar
- 9.Gurrin, C., Joho, H., Hopfgartner, F., Zhou, L., Albatal, R.: Overview of NTCIR-12 lifelog task. In: Proceedings of the 12th NTCIR Conference, pp. 354–360 (2016)Google Scholar
- 10.Gurrin, C., et al.: Overview of NTCIR-13 lifelog-2 task. In: Proceedings of the 13th NTCIR Conference, pp. 6–11 (2017)Google Scholar
- 11.Gurrin, C., Schoeffmann, K., Joho, H., Dang-Nguyen, D.-T., Riegler, M., Piras, L. (eds.): LSC 2018: Proceedings of the 2018 ACM Workshop on The Lifelog Search Challenge. ACM, New York (2018)Google Scholar
- 12.Jones, W., Teevan, J.: Personal Information Management. University of Washington Press, Seattle (2011)Google Scholar
- 13.Kato, M.P., Liu, Y.: Overview of NTCIR-13, pp. 1–5 (2017)Google Scholar
- 14.Kim, P.H., Giunchiglia, F.: The open platform for personal lifelogging: the elifelog architecture. In: CHI 2013 Extended Abstracts on Human Factors in Computing Systems, CHI EA 2013, pp. 1677–1682. ACM, New York (2013)Google Scholar
- 15.Lee, Y.J., Ghosh, J., Grauman, K.: Discovering important people and objects for egocentric video summarization. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1346–1353. IEEE (2012)Google Scholar
- 16.Lokoc, J., Bailer, W., Schoeffmann, K., Muenzer, B., Awad, G.: On influential trends in interactive video retrieval: video browser showdown 2015–2017. IEEE Trans. Multimed. 20(12), 3361–3376 (2018)CrossRefGoogle Scholar
- 17.Lokoč, J., Kovalčík, G., Souček, T.: Revisiting SIRET video retrieval tool. In: Schoeffmann, K., et al. (eds.) MMM 2018. LNCS, vol. 10705, pp. 419–424. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-73600-6_44CrossRefGoogle Scholar
- 18.Münzer, B., Leibetseder, A., Kletz, S., Primus, M.J., Schoeffmann, K.: lifeXplore at the lifelog search challenge 2018. In: ACM Workshop on The Lifelog Search Challenge, LSC 2018, pp. 3–8. ACM, New York (2018)Google Scholar
- 19.Schoeffmann, K., Münzer, B., Primus, J., Leibetseder, A.: The diveXplore system at the video browser showdown 2018 - final notes. CoRR abs/1804.01863 (2018)Google Scholar
- 20.Sellen, A.J., Whittaker, S.: Beyond total capture. Commun. ACM 53(5), 70–77 (2010)CrossRefGoogle Scholar
- 21.Sole, A.D.: Microsoft Computer Vision APIs Distilled: Getting Started with Cognitive Services. Apress, New York City (2017)Google Scholar
- 22.Song, S., Chandrasekhar, V., Cheung, N.-M., Narayan, S., Li, L., Lim, J.-H.: Activity recognition in egocentric life-logging videos. In: Jawahar, C.V., Shan, S. (eds.) ACCV 2014. LNCS, vol. 9010, pp. 445–458. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-16634-6_33CrossRefGoogle Scholar
- 23.Talavera, E., Dimiccoli, M., Bolaños, M., Aghaei, M., Radeva, P.: R-clustering for egocentric video segmentation. In: Paredes, R., Cardoso, J.S., Pardo, X.M. (eds.) IbPRIA 2015. LNCS, vol. 9117, pp. 327–336. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-19390-8_37CrossRefGoogle Scholar
- 24.Truong, T.-D., Dinh-Duy, T., Nguyen, V.-T., Tran, M.-T.: Lifelogging retrieval based on semantic concepts fusion. In: ACM Workshop on The Lifelog Search Challenge, LSC 2018, pp. 24–29. ACM, New York (2018)Google Scholar
- 25.Zhou, L., Hinbarji, Z., Dang-Nguyen, D.-T., Gurrin, C.: Lifer: an interactive lifelog retrieval system. In: ACM Workshop on The Lifelog Search Challenge, LSC 2018, pp. 9–14. ACM, New York (2018)Google Scholar
Copyright information
© Springer Nature Switzerland AG 2019