Personal Media Reunion: Re-collecting Media Content Scattered over Smart Devices and Social Networks

  • Mohamad Rabbath
  • Susanne Boll
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8325)


With the rapidly growing use of smart phones it becomes easier for people to document social events. Parts of the multimedia content are shared on social networks like Facebook, while others stay private on the users’ phones. Friends also add content of the same event to Facebook. The media content of social events is becoming scattered over different accounts and becomes increasingly difficult for the user to re-collect, especially with the absence of the EXIF-header in Facebook. In this paper, we introduce an approach that supports the users in automatically detecting distributed event content after selecting very few photos and videos on the phone. We use the metadata of the content on the phone to increase the initial seeds, and then we exploit a novel face recognition approach using the social context, and a probabilistic fusion model to detect the distributed media content between several social contacts on Facebook to the respective events. Our event content detection significantly outperforms other approaches that give poor result in metadata-unfriendly environment such as Facebook.


social networks Facebook events multimedia retrieval smart phones 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
  2. 2.
  3. 3.
    Chatzichristofis, S.A., Boutalis, Y.S.: CEDD: Color and edge directivity descriptor: A compact descriptor for image indexing and retrieval. In: Gasteratos, A., Vincze, M., Tsotsos, J.K. (eds.) ICVS 2008. LNCS, vol. 5008, pp. 312–322. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  4. 4.
    Chen, L., Hu, B.: Face annotation for family photo album management. Int. Journal of Image and Graphics (2003)Google Scholar
  5. 5.
    Gkalelis, N., Mezaris, V., Kompatsiaris, I.: A joint content-event model for event-centric multimedia indexing. In: ICSC, pp. 79–84. IEEE (2010)Google Scholar
  6. 6.
    Ke, Y., Sukthankar, R., Huston, L., Ke, Y., Sukthankar, R.: Efficient near-duplicate detection and sub-image retrieval. In: ACM Multimedia, pp. 869–876 (2004)Google Scholar
  7. 7.
    Li, Z., Luo, H., Fan, J.: Incorporating camera metadata for attended region detection and consumer photo classification. In: Proc. of the 17th ACM Int. Conf. on Multimedia, MM 2009 (2009)Google Scholar
  8. 8.
    Liu, X., Troncy, R., Huet, B.: Finding media illustrating events. In: Proc. Int. Conf. Multimedia Retrieval, ICMR 2011 (2011)Google Scholar
  9. 9.
    Mavridis, N., Kazmi, W., Toulis, P., Ben-Abdelkader, C.: On the synergies between online social networking, face recognition and interactive robotics. In: Proc. of the 2009 Int. Conf. on Computational Aspects of Social Networks (2009)Google Scholar
  10. 10.
    Petkos, G., Papadopoulos, S., Kompatsiaris, Y.: Social event detection using multimodal clustering and integrating supervisory signals. In: Proceedings of the 2nd ACM International Conference on Multimedia Retrieval, ICMR 2012, pp. 23:1–23:8 (2012)Google Scholar
  11. 11.
    Rabbath, M., Sandhaus, P., Boll, S.: Analysing facebook features to support event detection for photo-based facebook applications. In: Proc. of the ACM Int. Conf. on Multimedia Retrieval, ICMR 2012. ACM (2012)Google Scholar
  12. 12.
    Stone, Z., Zickler, T., Darrell, T.: Toward Large-Scale Face Recognition Using Social network Context. Proceedings of the IEEE 98(8), 1408–1415 (2010)CrossRefGoogle Scholar
  13. 13.
    Troncy, R., Malocha, B., Fialho, A.T.S.: Linking events with media. In: Proc. of the 6th Int. Conf. on Semantic Systems, I-SEMANTICS (2010)Google Scholar
  14. 14.
    Wang, G., Gallagher, A., Luo, J., Forsyth, D.: Seeing people in social context: Recognizing people and social relationships. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part V. LNCS, vol. 6315, pp. 169–182. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  15. 15.
    Wu, Z., Ke, Q., Sun, J., Shum, H.-Y.: Scalable face image retrieval with identity-based quantization and multireference reranking. IEEE Trans. Pattern Anal. Mach. Intell.Google Scholar
  16. 16.
    Zeng, X., Xie, X., Wang, K.: Instant video summarization during shooting with mobile phone. In: Proc. of the 1st ACM Int. Conf. on Multimedia Retrieval, ICMR 2011 (2011)Google Scholar
  17. 17.
    Zhang, L., Chen, L., Li, M., Zhang, H.: Automated annotation of human faces in family albums. In: Proc. of the Eleventh ACM Int. Conf. on Multimedia, MULTIMEDIA 2003 (2003)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Mohamad Rabbath
  • Susanne Boll

There are no affiliations available

Personalised recommendations