Personal Media Reunion: Re-collecting Media Content Scattered over Smart Devices and Social Networks
With the rapidly growing use of smart phones it becomes easier for people to document social events. Parts of the multimedia content are shared on social networks like Facebook, while others stay private on the users’ phones. Friends also add content of the same event to Facebook. The media content of social events is becoming scattered over different accounts and becomes increasingly difficult for the user to re-collect, especially with the absence of the EXIF-header in Facebook. In this paper, we introduce an approach that supports the users in automatically detecting distributed event content after selecting very few photos and videos on the phone. We use the metadata of the content on the phone to increase the initial seeds, and then we exploit a novel face recognition approach using the social context, and a probabilistic fusion model to detect the distributed media content between several social contacts on Facebook to the respective events. Our event content detection significantly outperforms other approaches that give poor result in metadata-unfriendly environment such as Facebook.
Keywordssocial networks Facebook events multimedia retrieval smart phones
Unable to display preview. Download preview PDF.
- 4.Chen, L., Hu, B.: Face annotation for family photo album management. Int. Journal of Image and Graphics (2003)Google Scholar
- 5.Gkalelis, N., Mezaris, V., Kompatsiaris, I.: A joint content-event model for event-centric multimedia indexing. In: ICSC, pp. 79–84. IEEE (2010)Google Scholar
- 6.Ke, Y., Sukthankar, R., Huston, L., Ke, Y., Sukthankar, R.: Efficient near-duplicate detection and sub-image retrieval. In: ACM Multimedia, pp. 869–876 (2004)Google Scholar
- 7.Li, Z., Luo, H., Fan, J.: Incorporating camera metadata for attended region detection and consumer photo classification. In: Proc. of the 17th ACM Int. Conf. on Multimedia, MM 2009 (2009)Google Scholar
- 8.Liu, X., Troncy, R., Huet, B.: Finding media illustrating events. In: Proc. Int. Conf. Multimedia Retrieval, ICMR 2011 (2011)Google Scholar
- 9.Mavridis, N., Kazmi, W., Toulis, P., Ben-Abdelkader, C.: On the synergies between online social networking, face recognition and interactive robotics. In: Proc. of the 2009 Int. Conf. on Computational Aspects of Social Networks (2009)Google Scholar
- 10.Petkos, G., Papadopoulos, S., Kompatsiaris, Y.: Social event detection using multimodal clustering and integrating supervisory signals. In: Proceedings of the 2nd ACM International Conference on Multimedia Retrieval, ICMR 2012, pp. 23:1–23:8 (2012)Google Scholar
- 11.Rabbath, M., Sandhaus, P., Boll, S.: Analysing facebook features to support event detection for photo-based facebook applications. In: Proc. of the ACM Int. Conf. on Multimedia Retrieval, ICMR 2012. ACM (2012)Google Scholar
- 13.Troncy, R., Malocha, B., Fialho, A.T.S.: Linking events with media. In: Proc. of the 6th Int. Conf. on Semantic Systems, I-SEMANTICS (2010)Google Scholar
- 15.Wu, Z., Ke, Q., Sun, J., Shum, H.-Y.: Scalable face image retrieval with identity-based quantization and multireference reranking. IEEE Trans. Pattern Anal. Mach. Intell.Google Scholar
- 16.Zeng, X., Xie, X., Wang, K.: Instant video summarization during shooting with mobile phone. In: Proc. of the 1st ACM Int. Conf. on Multimedia Retrieval, ICMR 2011 (2011)Google Scholar
- 17.Zhang, L., Chen, L., Li, M., Zhang, H.: Automated annotation of human faces in family albums. In: Proc. of the Eleventh ACM Int. Conf. on Multimedia, MULTIMEDIA 2003 (2003)Google Scholar