Advertisement

Advances in Lifelog Data Organisation and Retrieval at the NTCIR-14 Lifelog-3 Task

Conference paper
First Online:
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11966)

Abstract

Lifelogging refers to the process of digitally capturing a continuous and detailed trace of life activities in a passive manner. In order to assist the research community to make progress in the organisation and retrieval of data from lifelog archives, a lifelog task was organised at NTCIR since edition 12. Lifelog-3 was the third running of the lifelog task (at NTCIR-14) and the Lifelog-3 task explored three different lifelog data access related challenges, the search challenge, the annotation challenge and the insights challenge. In this paper we review the dataset created for this activity, activities of participating teams who took part in these challenges and we highlight learnings for the community from the NTCIR-Lifelog challenges.

Keywords

Lifelog Information retrieval Test collection 
This is a preview of subscription content, log in to check access.

Notes

Acknowledgements

This publication has emanated from research supported in party by research grants from Irish Research Council (IRC) under Grant Number GOIPG/2016/741 and Science Foundation Ireland under grant numbers SFI/12/RC/2289 and SFI/13/RC/2106. We acknowledge the support and input of the DCU ethics committee and the risk & compliance officer.

References

  1. 1.
    Buckley, C.: Treceval IR evaluation package (2004)Google Scholar
  2. 2.
    Dang-Nguyen, D.T., Piras, L., Riegler, M., Zhou, L., Lux, M., Gurrin, C.: Overview of ImageCLEFlifelog 2018: daily living understanding and lifelog moment retrieval. In: CLEF2018 Working Notes. CEUR Workshop Proceedings, 10–14 September 2018. CEURWS, Avignon (2018)Google Scholar
  3. 3.
    Dang-Nguyen, D.T., Zhou, L., Gupta, R., Riegler, M., Gurrin, C.: Building a disclosed lifelog dataset: challenges, principles and processes. In: Content-Based Multimedia Indexing (CBMI) (2017)Google Scholar
  4. 4.
    Dodge, M., Kitchin, R.: ‘Outlines of a world coming into existence’: pervasive computing and the ethics of forgetting. Environ. Plan. 34(3), 431–445 (2007).  https://doi.org/10.1068/b32041tCrossRefGoogle Scholar
  5. 5.
    Duane, A., Zhou, L., Dang-Nguyen, D.T., Gurrin, C.: DCU at the NTCIR-13 lifelog-2 task. In: Proceedings of NTCIR-13, Tokyo, Japan (2017)Google Scholar
  6. 6.
    Everson, B., Mackintosh, K.A., McNarry, M.A., Todd, C., Stratton, G.: Can wearable cameras be used to validate school-aged children’s lifestyle behaviours? Children 6(2), 20 (2019).  https://doi.org/10.3390/children6020020CrossRefGoogle Scholar
  7. 7.
    Fu, M.H., Chia-Chun, C., Huang, G.H., Chen, H.H.: Introducing external textual knowledge for lifelog retrieval and annotation. In: The Fourteenth NTCIR Conference (NTCIR-14) (2019)Google Scholar
  8. 8.
    Gurrin, C., et al.: Overview of the NTCIR-14 lifelog-3 task. In: The Fourteenth NTCIR Conference (NTCIR-14) (06 2019)Google Scholar
  9. 9.
    Gurrin, C., Joho, H., Hopfgartner, F., Zhou, L., Albatal, R.: Overview of NTCIR-12 lifelog task. In: Kando, N., Kishida, K., Kato, M.P., Yamamoto, S. (eds.) Proceedings of the 12th NTCIR Conference on Evaluation of Information Access Technologies, pp. 354–360 (2016)Google Scholar
  10. 10.
    Gurrin, C., et al.: Overview of NTCIR-13 lifelog-2 task. In: The Thirteenth NTCIR conference (NTCIR-13), pp. 6–11 (2017)Google Scholar
  11. 11.
    Gurrin, C., et al.: Comparing approaches to interactive lifelog search at the lifelog search challenge ( LSC2018). ITE Trans. Media Technol. Appl. 7(2), 46–59 (2019)CrossRefGoogle Scholar
  12. 12.
    Gurrin, C., Smeaton, A.F., Doherty, A.R.: LifeLogging: personal big data. Found. Trends® Inform. Retrieval 8(1), 1–125 (2014).  https://doi.org/10.1561/1500000033. http://www.nowpublishers.com/articles/foundations-and-trends-in-information-retrieval/INR-033CrossRefGoogle Scholar
  13. 13.
    Harvey, M., Langheinrich, M., Ward, G.: Remembering through lifelogging: a survey of human memory augmentation. Pervasive Mob. Comput. 27, 14–26 (2016).  https://doi.org/10.1016/j.pmcj.2015.12.002CrossRefGoogle Scholar
  14. 14.
    Hoyle, R., Templeman, R., Armes, S., Anthony, D., Crandall, D., Kapadia, A.: Privacy behaviors of lifeloggers using wearable cameras. In: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp 2014, pp. 571–582. ACM, New York (2014)Google Scholar
  15. 15.
    Kahneman, D., Krueger, A.B., Schkade, D.A., Schwarz, N., Stone, A.A.: A survey method for characterizing daily life experience: the day reconstruction method. Science 306, 1776–1780 (2004)CrossRefGoogle Scholar
  16. 16.
    Lin, H.L., Chiang, T.C., Chen, L.P., Yang, P.C.: Image searching by events with deep learning for NTCIR-12 lifelog. In: Proceedings of NTCIR-12, Tokyo, Japan (2016)Google Scholar
  17. 17.
    Lin, J., del Molino, A.G., Xu, Q., Fang, F., Subbaraju, V., Lim, J.H.: VCI2R at the NTCIR-13 lifelog semantic access task. In: Proceedings of NTCIR-13, Tokyo, Japan (2017)Google Scholar
  18. 18.
    Lin, T., et al.:: Microsoft COCO: common objects in context. CoRR abs/1405.0312 (2014). http://arxiv.org/abs/1405.0312
  19. 19.
    Nguyen, I.V.K., Shrestha, P., Zhang, M., Liu, Y., Ma, S.: THUIR at the NTCIR-14 lifelog-3 task: how does lifelog help the user’s status recognition. In: The Fourteenth NTCIR Conference (NTCIR-14) (2019)Google Scholar
  20. 20.
    Ninh, V.T., et al.: A baseline interactive retrieval engine for the NTICR-14 lifelog-3 semantic access task. In: The Fourteenth NTCIR Conference (NTCIR-14) (2019)Google Scholar
  21. 21.
    de Oliveira Barra, G., et al.: LEMoRe: a lifelog engine for moments retrieval at the NTCIR-lifelog lsat task. In: Proceedings of NTCIR-12, Tokyo, Japan (2016)Google Scholar
  22. 22.
    Ren, S., He, K., Girshick, R.B., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. CoRR abs/1506.01497 (2015). http://arxiv.org/abs/1506.01497
  23. 23.
    Safadi, B., Mulhem, P., Qul’not, G., Chevallet, J.P.: MRIM-LIG at NTCIR lifelog semantic access task. In: Proceedings of NTCIR-12, Tokyo, Japan (2016)Google Scholar
  24. 24.
    Scells, H., Zuccon, G., Kitto, K.: QUT at the NTCIR lifelog semantic access task. In: Proceedings of NTCIR-12, Tokyo, Japan (2016)Google Scholar
  25. 25.
    Signal, L.N., et al.: KidsCam: an objective methodology to study the world in which children live. Am. J. Prevent. Med. 53(3), e89–e95 (2017).  https://doi.org/10.1016/j.amepre.2017.02.016CrossRefGoogle Scholar
  26. 26.
    Suzuki, T., Ikeda, D.: Smart lifelog retrieval system with habit-based concepts and moment visualization. In: The Fourteenth NTCIR Conference (NTCIR-14) (2019)Google Scholar
  27. 27.
    Wilson, G., Jones, D., Schofield, P., Martin, D.J.: The use of a wearable camera to explore daily functioning of older adults living with persistent pain: methodological reflections and recommendations. J. Rehabil. Assist. Technol. Eng. 5, 2055668318765411 (2018).  https://doi.org/10.1177/2055668318765411CrossRefGoogle Scholar
  28. 28.
    Xia, L., Ma, Y., Fan, W.: VTIR at the NTCIR-12 2016 lifelog semantic access task. In: Proceedings of NTCIR-12, Tokyo, Japan (2016)Google Scholar
  29. 29.
    Zhou, B., Lapedriza, A., Khosla, A., Oliva, A., Torralba, A.: Places: a 10million image database for scene recognition. IEEE Trans. Pattern Anal. Mach. Intell. 40, 1452–1464 (2017)CrossRefGoogle Scholar
  30. 30.
    Zhou, Q., et al.: The use of wearable cameras in assessing children’s dietary intake and behaviours in China. Appetite 139, 1–7 (2019)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Dublin City UniversityDublinIreland
  2. 2.University of TsukubaTsukubaJapan
  3. 3.University of SheffieldSheffieldUK
  4. 4.University of BergenBergenNorway

Personalised recommendations

Cite paper

Buy options