Skip to main content
SpringerLink
Log in

Life Gallery: event detection in a personal media collection

An application, a basic algorithm and a benchmark

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Usage of camera-equipped mobile devices raises the need for automatically organizing large personal media collections. Event detection algorithms have been proposed in the literature to tackle this problem but a shortcoming of these studies resides in the lack of comparison of the different solutions. The goal of this work is then to provide a set of tools for the assessment of an event detection method. Our first contribution is our prototype Life Gallery, which aims to retrieve metadata of a personal media collection in order to facilitate the building of a benchmark. Our second contribution is an event detection algorithm based on successive refinements of an initial temporal partition. Our solution uses a simple algorithm that regroups consecutive similar media or split groups with dissimilar media. The choice to provide a basic solution is to compare in a future work our results with more complex solutions, in order to really assess the benefit of these latter. Finally, our third contribution is a benchmark of 6 different users’ collections obtained thanks to our Life Gallery application.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  1. Barla A, Odone F, Verri A (2003) Old fashioned state-of-the-art image classification. In: Proceedings of the 12th International Conference on Image Analysis and Processing, ser. ICIAP ’03. IEEE Computer Society, Washington, pp 566–571

  2. Carvalho RF, Chapman S, Ciravegna F (2009) Attributing semantics to personal photographs. Multimedia Tools Appl 42(1):73–96

    Article  Google Scholar 

  3. Chen C, Oakes M, Tait J (2006) Browsing personal images using episodic memory (time + location). Advances in Information Retrieval, Lecture Notes in Computer Science 3936/2006:362– 372

    Google Scholar 

  4. Chen C, Oakes M, Tait J (2008) A location data annotation system for personal photograph collections: Evaluation of a searching and browsing tool. In: International Workshop on Content-Based Multimedia Indexing (CBMI), pp 534–541

  5. Cooper ML (2011) Clustering geo-tagged photo collections using dynamic programming. In: Proceedings of the 19th ACM international conference on Multimedia, ser. MM ’11. ACM, New York, pp 1025–1028

  6. Cooper M, Foote J, Girgensohn A, Wilcox L (2005) Temporal event clustering for digital photo collections. In: Proceedings of The ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP), vol 1, pp 269–288

  7. Das M, Loui AC (2009) Detecting significant events in personal image collections. In: Proceedings of the 2009 IEEE International Conference on Semantic Computing, ser. ICSC ’09. IEEE Computer Society, Washington, pp 116–123

  8. Das M, Loui AC (2009) Detecting significant events in personal image collections. In: Proceedings of the 2009 IEEE International Conference on Semantic Computing, ser. ICSC ’09. IEEE Computer Society, Washington, pp 116–123

  9. Ferré S (2007) Camelis: Organizing and browsing a personal photo collection with a logical information system, vol 331. CEUR-WS.org, Montpellier

  10. Graham A, Garcia-Molina H, Paepcke A, Winograd T (2002) Time as essence for photo browsing through personal digital libraries. In: Proceedings of The ACM Joint Conference on Digital Libraries JCDL, pp 326–335

  11. Huang A (2008) Similarity measures for text document clustering. In: Proceedings of the Sixth New Zealand Computer Science Research Student Conference (NZCSRSC2008), Christchurch, pp 49– 56

  12. Jaffe A, Naaman M, Tassa T, Davis M (2006) Generating summaries and visualization for large collections of geo-referenced photographs. In: Proceedings of The 8th ACM SIGMM International Workshop on Multimedia Information Retrieval, pp 853–854

  13. Lacerda YA, de Figueir HF, de Souza Baptista C, Sampaio MC (2008) Photogeo: A self-organizing system for personal photo collections. In: 10th IEEE International Symposium on Multimedia, pp 258–265

  14. Life gallery application, https://sites.google.com/site/myownlifegallery/

  15. Lowe DG (1999) Objec recognition from local scale-invariant features, vol 2

  16. Naaman M, Nair R (2008) Zonetag’s collaborative tag suggestions: What is this person doing in my phone? IEEE MultiMedia 15(3):34–40

    Article  Google Scholar 

  17. Naaman M, Harada S, Wang Q, Garcia-Molina H, Paepcke A (2004) Context data in geo-referenced digital photo collections. In: Proceedings of the 12th ACM International Conference on Multimedia, New York, pp 196–203

  18. Naaman M, Song YJ, Paepcke A, Garcia-Molina H (2004) Automatic organization for digital photographs with geographic coordinates. In: Proceedings of The ACM/IEEE Conference on Digital libraries (JCDL’2004), pp 53–62

  19. Pigeau A, Gelgon M (2005) Building and tracking hierarchical geographical & temporal partitions for image collection management on mobile devices. In: Proceedings of International Conference of ACM Multimedia, Singapore, pp 141–150

  20. Platt JC, Czerwinski BAFM (2002) PhotoTOC: Automatic clustering for browsing personal photographs, Microsoft Research, Tech. Rep. MSR-TR-2002-17

  21. Rodden K (2003) How do people manage their digital photographs?. In: ACM Conference on Human Factors in Computing Systems, Fort Lauderdale, pp 409–416

  22. Strehl A, Ghosh J, Mooney R (2000) Impact of Similarity Measures on Web-page Clustering. In: Proceedings of the 17th National Conference on Artificial Intelligence: Workshop of Artificial Intelligence for Web Search (AAAI 2000), 30-31 July 2000. AAAI, Austin, pp 58– 64

  23. Toyama K, Logan R, Roseway A, Anandan P (2003) Geographic location tags on digital images. In: Proceedings of The eleventh ACM international conference on Multimedia, Berkeley, pp 156– 166

  24. Vega-Pons S, Ruiz-Shulcloper J (2011) A survey of clustering ensemble algorithms. Int J Pattern Recognit Artif Intell 25(03):337–372

    Article  MathSciNet  Google Scholar 

  25. Viana W, Filho JB, Gensel J, Oliver MV, Martin H (2008) Photomap - automatic spatiotemporal annotation for mobile photos. Web and Wireless Geographical Information Systems, Lecture Notes in Computer Science 4857/2007:187–201

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. DUKe research group, LINA (CNRS UMR 6241), cedex 03, 2, rue de la Houssinière, 44322, Nantes, France

    Antoine Pigeau

Authors
  1. Antoine Pigeau
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Antoine Pigeau.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Pigeau, A. Life Gallery: event detection in a personal media collection. Multimed Tools Appl 76, 9713–9734 (2017). https://doi.org/10.1007/s11042-016-3576-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-016-3576-y

Keywords

Search

Navigation