Multimedia Tools and Applications

, Volume 70, Issue 2, pp 1033–1048 | Cite as

With a little help from my friends

Community-based assisted organization of personal photographs
  • Claudio Cusano
  • Simone Santini


In this paper, we propose a content-based method the for semi-automatic organization of photo albums based on the analysis of how different users organize their own pictures. The goal is to help the user in dividing his pictures into groups characterized by a similar semantic content. The method is semi-automatic: the user starts to assign labels to the pictures and unlabeled pictures are tagged with proposed labels. The user can accept the recommendation or made a correction. To formulate the suggestions is exploited the knowledge encoded in how other users have partitioned their images. The method is conceptually articulated in two parts. First, we use a suitable feature representation of the images to model the different classes that the users have collected, second, we look for correspondences between the criteria used by the different users. Boosting is used to integrate the information provided by the analysis of multiple users. A quantitative evaluation of the proposed approach is obtained by simulating the amount of user interaction needed to annotate the albums of a set of members of the flickr® photo-sharing community.


Personal photography Automatic image annotation Content-based image analysis Social image retrieval 


  1. 1.
    Boutell M, Luo J (2004) Bayesian fusion of camera metadata cues in semantic scene classification. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition, vol 2, pp 623–630Google Scholar
  2. 2.
    Chen L, Hu B (2003) Face annotation for family photo album management. Int J Image Graphics 3:1–14CrossRefzbMATHGoogle Scholar
  3. 3.
    Das M, Loui A (2003) Automatic face-based image grouping for albuming. In: Proceedings of the IEEE international conference on systems, man and cybernetics, vol 4, pp 3726–3731Google Scholar
  4. 4.
    Furht B (1998) Content-based image indexing and retrieval. In: Handbook on multimedia computing. CRC Press, Boca RatonGoogle Scholar
  5. 5.
    Grauman K, Darrell T (2005) The pyramid match kernel: discriminative classification with sets of image features. In: Proceedings of the tenth IEEE international conference on computer vision, vol 2, pp 1458–1465Google Scholar
  6. 6.
    Ivory MY, Hearst MA (2001) The state of the art in automating usability evaluation of user interfaces. ACM Comput Surv 33(4):470–516CrossRefGoogle Scholar
  7. 7.
    Jaimes A, Benitez A, Chang S-F, Loui A (2000) Discovering recurrent visual semantics in consumer photographs. In: Proceedings of the international conference on image processing, vol 3, pp 528–531Google Scholar
  8. 8.
    Li J, Lim J, Tian Q (2003) Automatic summarization for personal digital photos. In: Proceedings of the fourth international conference on information, communications and signal processing, vol 3, pp 1536–1540Google Scholar
  9. 9.
    Li X, Snoek C, Worring M (2008) Learning tag relevance by neighbor voting for social image retrieval. In: Proceeding of the first ACM international conference on multimedia information retrieval, pp 180–187Google Scholar
  10. 10.
    Loui A, Savakis A (2003) Automated event clustering and quality screening of consumer pictures for digital albuming. IEEE Trans Multimedia 5(3):390–402CrossRefGoogle Scholar
  11. 11.
    Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vision 60(2):91–110CrossRefGoogle Scholar
  12. 12.
    Mulhem P, Lim J (2003) Home photo retrieval: time matters. In: Proceedings of the international conference on image and video retrieval, pp 308–317Google Scholar
  13. 13.
    Nister D, Stewenius H (2006) Scalable recognition with a vocabulary tree. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition, vol 2, pp 2161–2168Google Scholar
  14. 14.
    Obrador P, de Olivera R, Oliver N (2010) Supporting personal photo storytelling for social albums. In: Proceedings of ACM multimedia 2010. ACM, New York, pp 561–570Google Scholar
  15. 15.
    Platt J (2000) Autoalbum: clustering digital photographs using probabilistic model merging. In: Proceedings of the IEEE workshop on content-based access of image and video libraries, pp 96–100Google Scholar
  16. 16.
    Shevade B, Sundaram H (2003) Vidya: an experiential annotation system. In: Proceedings of the ACM SIGMM workshop on experiential telepresence, pp 91–98Google Scholar
  17. 17.
    Sun Y, Zhang H, Zhang L, Li M (2002) Myphotos: a system for home photo management and processing. In: Proceedings of the tenth ACM international conference on multimedia, pp 81–82Google Scholar
  18. 18.
    Vailaya A, Jain A, Zhang HJ (1998) On image classification: city images vs. landscapes. Pattern Recogn 31(12):1921–1935CrossRefGoogle Scholar
  19. 19.
    Vailaya A, Figueiredo M, Jain A, Zhang H-J (2001) Image classification for content-based indexing. IEEE Trans Image Process 10(1):117–130CrossRefzbMATHGoogle Scholar
  20. 20.
    Vedaldi A (2005) Sift+ + a lightweight c+ + implementation of sift. Accessed 01 Oct 2011
  21. 21.
    Wallraven C, Caputo B, Graf A (2003) Recognition with local features: the kernel recipe. In: Proceedings of the ninth IEEE international conference on computer vision, vol 1, pp 257–264Google Scholar
  22. 22.
    Wenyin L, Sun Y, Zhang H (2000) Mialbum—a system for home photo managemet using the semi-automatic image annotation approach. In: Proceedings of the eighth ACM international conference on multimedia, pp 479–480Google Scholar
  23. 23.
    Zhang L, Chen L, Li M, Zhang H (2003) Automated annotation of human faces in family albums. In: Proceedings of the eleventh ACM international conference on multimedia, pp 355–358Google Scholar
  24. 24.
    Zhang J, Marszalek M, Lazebnik S, Schmid C (2007) Local features and kernels for classification of texture and object categories: a comprehensive study. Int J Comput Vision 73(2):213–238CrossRefGoogle Scholar
  25. 25.
    Zhu J, Rosset S, Zou H, Hastie T (2005) Multiclass adaboost. Technical report, Stanford University. Available at Accessed 01 Oct 2011

Copyright information

© Springer Science+Business Media, LLC 2012

Authors and Affiliations

  1. 1.Department of Informatics, Systems and Communication (DISCo)Università degli Studi di Milano-BicoccaMilanoItaly
  2. 2.Escuela Politécnica SuperiorUniversidad Autónoma de MadridMadridSpain

Personalised recommendations