Abstract
Efficient retrieval of lifelog information is an ongoing area of research due to the multifaceted nature, and ever increasing size of lifelog datasets. Previous studies have examined lifelog exploration on conventional hardware platforms, but in this paper we describe a novel approach to lifelog retrieval using virtual reality. The focus of this research is to identify what aspects of lifelog retrieval can be effectively translated from a conventional to a virtual environment and if it provides any benefit to the user. The most widely available lifelog datasets for research are primarily image-based and focus on continuous capture from a first-person perspective. These large image corpora are often enhanced by image processing techniques and various other metadata. Despite the rapidly maturing nature of virtual reality as a platform, there has been very little investigation into user interaction within the context of lifelogging. The experiment outlined in this work seeks to evaluate four different virtual reality user interaction approaches to lifelog retrieval. The prototype system used in this experiment also competed at the Lifelog Search Challenge at ACM ICMR 2018 where it ranked first place.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
Alan Kwan’s ‘Bad Trip’ - https://www.kwanalan.com/blank.
- 2.
HTC Vive - https://www.vive.com/eu/product/.
- 3.
SteamVR - http://store.steampowered.com/steamvr.
- 4.
Google Tiltbrush - https://www.tiltbrush.com.
References
Yang, Y., Lee, H., Gurrin, C.: Visualizing lifelog data for different interaction platforms. In: CHI 2013 Extended Abstracts on Human Factors in Computing Systems on - CHI EA 2013, p. 1785 (2013). https://doi.org/10.1145/2468356.2468676
Sellen, A.J., Whittaker, S.: Beyond total capture. Commun. ACM 53(5), 70 (2010). https://doi.org/10.1145/1735223.1735243. ISSN 0001-078
Gurrin, C., et al.: NTCIR lifelog: the first test collection for lifelog research. In: Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 705–708. ACM (2016). ISBN 978-1-4503-4069-4. https://doi.org/10.1145/2911451.2914680
Duane, A., Gurrin, C.: Lifelog exploration prototype in virtual reality. In: Schoeffmann, K., et al. (eds.) MMM 2018. LNCS, vol. 10705, pp. 377–380. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-73600-6_36
Gurrin, C., et al.: Overview of NTCIR-13 lifelog-2 task. In: Proceedings of the 13th NTCIR Conference on Evaluation of Information Access Technologies, NTCIR, pp. 6–11 (2017). ISBN 978-4-86049-075-1
Dale, E.: Audio-Visual Methods in Teaching, 3rd edn, pp. 12–13. Dryden Press, New York (1969)
Krokos, E., Plaisant, C., Varshney, A.: Virtual memory palaces: immersion aids recall. Virtual Reality, 1–15 (2018). https://doi.org/10.1007/s10055-018-0346-3
Nakazato, M., Huang, T.S.: 3D MARS: immersive virtual reality for content-based image retrieval. In: Proceedings of 2001 IEEE International Conference on Multimedia and Expo (ICME2001) (2001)
Gurrin, C., Lee, H., Caprani, N., Zhang, Z.X., O’Connor, N., Carthy, D.: Browsing large personal multimedia archives in a lean-back environment. In: Boll, S., Tian, Q., Zhang, L., Zhang, Z., Chen, Y.-P.P. (eds.) MMM 2010. LNCS, vol. 5916, pp. 98–109. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-11301-7_13
LSC 2018: Proceedings of the 2018 ACM Workshop on the Lifelog Search Challenge. ACM, Yokohama (2018). ISBN 978-1-4503-5796-8
Likert, R.: A Technique for the Measurement of Attitudes, p. 55. The Science Press, New York (1932)
Duane, A., Huerst, W., Gurrin, C.: Virtual reality lifelog explorer. In: Proceedings of the 2018 ACM on International Conference on Multimedia Retrieval. ACM (2018)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Duane, A., Gurrin, C. (2019). User Interaction for Visual Lifelog Retrieval in a Virtual Environment. In: Kompatsiaris, I., Huet, B., Mezaris, V., Gurrin, C., Cheng, WH., Vrochidis, S. (eds) MultiMedia Modeling. MMM 2019. Lecture Notes in Computer Science(), vol 11295. Springer, Cham. https://doi.org/10.1007/978-3-030-05710-7_20
Download citation
DOI: https://doi.org/10.1007/978-3-030-05710-7_20
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-05709-1
Online ISBN: 978-3-030-05710-7
eBook Packages: Computer ScienceComputer Science (R0)