Knowledge and Information Systems

, Volume 41, Issue 2, pp 251–276 | Cite as

Learning to annotate via social interaction analytics

  • Tong Xu
  • Hengshu Zhu
  • Enhong Chen
  • Baoxing Huai
  • Hui Xiong
  • Jilei Tian
Regular paper

Abstract

Recent years have witnessed increased interests in exploiting automatic annotating techniques for managing and retrieving media contents. Previous studies on automatic annotating usually rely on the metadata which are often unavailable for use. Instead, multimedia contents usually arouse frequent preference-sensitive interactions in the online social networks of public social media platforms, which can be organized in the form of interaction graph for intensive study. Inspired by this observation, we propose a novel media annotating method based on the analytics of streaming social interactions of media content instead of the metadata. The basic assumption of our approach is that different types of social media content may attract latent social group with different preferences, thus generate different preference-sensitive interactions, which could be reflected as localized dense subgraph with clear preferences. To this end, we first iteratively select nodes from streaming records to build the preference-sensitive subgraphs, then uniformly extract several static and topologic features to describe these subgraphs, and finally integrate these features into a learning-to-rank framework for automatic annotating. Extensive experiments on several real-world date sets clearly show that the proposed approach outperforms the baseline methods with a significant margin.

Keywords

Automatic annotating Learning to rank Social media 

References

  1. 1.
    Burges C, Shaked T, Renshaw E, Lazier A, Deeds M, Hamilton N, Hullender G (2005) Learning to rank using gradient descent. In: Proceedings of the 22nd international conference on machine learning (ICML), pp 89–96Google Scholar
  2. 2.
    Cao Y, Xu J, Liu T, Li H, Huang Y, Hon H (2006) Adapting ranking svm to document retrieval. In: Proceedings of the 29th international ACM conference on Research and development in information retrieval (SIGIR), pp 186–193Google Scholar
  3. 3.
    Cao Z, Qin T, Liu T, Tsai M, Li H (2007) Learning to rank: from pairwise approach to listwise approach. In: Proceedings of the 24th international conference on machine learning (ICML), pp 129–136Google Scholar
  4. 4.
    Chen Z, Cao J, Song YC, Guo J, Zhang Y, Li J (2010) Context-oriented web video tag recommendation. In: Proceedings of the 19th international conference on world wide web (WWW), pp 1079–1080Google Scholar
  5. 5.
    Crammer K, Singer Y (2001) Pranking with ranking. In: Advances in neural information processing systems (NIPS), pp 641–647Google Scholar
  6. 6.
    Fortunato S, Barthelemy M (2007) Resolution limit in community detection. Proc Natl Acad Sci (PNAS) 104(1):36–41CrossRefGoogle Scholar
  7. 7.
    Fortunato S (2010) Community detection in graphs. Phys Rep 486(3):75–174MathSciNetCrossRefGoogle Scholar
  8. 8.
    Freund Y, Iyer R, Schapire R, Singer Y (2003) An efficient boosting algorithm for combining preferences. J Mach Learn Res 4:933–969MathSciNetGoogle Scholar
  9. 9.
    Herbrich R, Graepel R, Obermayer K (1999) Large margin rank boundaries for ordinal regression. In: Advances in Neural Information Processing Systems (NIPS), pp 115–132Google Scholar
  10. 10.
    Heymann P, Ramage D, Garcia-Molina H (2008) Social tag prediction. In: Proceedings of the 31st annual international ACM conference on research and development in information retrieval (SIGIR), pp 531–538Google Scholar
  11. 11.
    Kaplan AM, Haenlein M (2010) Users of the world, unite! the challenges and opportunities of social media. Bus Horiz 53(1):59–68CrossRefGoogle Scholar
  12. 12.
    Körner C, Kern R, Grahsl HP, Strohmaier M (2010) Of categorizers and describers: an evaluation of quantitative measures for tagging motivation. In: Proceedings of the 21st ACM conference on Hypertext and hypermedia (ACM HT), pp 157–166Google Scholar
  13. 13.
    Lewis K, Gonzalez M, Kaufman J (2012) Social selection and peer influence in an online social network. Proc Natl Acad Sci (PNAS) 109(1):68–72CrossRefGoogle Scholar
  14. 14.
    Liu D, Hua X, Yang L, Wang M, Zhang H (2009) Tag ranking. In: Proceedings of the 18th international conference on world wide web (WWW), pp 351–360Google Scholar
  15. 15.
    Nallapati R (2004) Discriminative models for information retrieval. In: Proceedings of the 27th international ACM conference on research and development in information retrieval (SIGIR), pp 64–71Google Scholar
  16. 16.
    Noh T, Park S, Yoon H, Lee S, Park S (2009) An automatic translation of tags for multimedia contents using folksonomy networks. In: Proceedings of the 32nd international ACM conference on research and development in information retrieval (SIGIR), pp 492–499Google Scholar
  17. 17.
    Qi G, Hua X, Rui Y, Tang J, Mei T, Zhang H (2007) Correlative multi-label video annotation. In: Proceedings of the 15th international conference on Multimedia (ACM MM), pp 17–26Google Scholar
  18. 18.
    Silva A, Martins B (2011) Tag recommendation for georeferenced photos. In: Proceedings of the 3rd ACM SIGSPATIAL international workshop on location-based social network (LBSN), pp 57–64Google Scholar
  19. 19.
    Song Y, Zhuang Z, Li H, Zhao Q, Li J, Lee W, Giles CL (2008) Real-time automatic tag recommendation. In: Proceedings of the 31st international ACM conference on research and development in information retrieval (SIGIR), pp 515–522Google Scholar
  20. 20.
    Toderici G, Aradhye H, Pasca M, Sbaiz L, Yagnik J (2010) Finding meaning on YouTube: tag recommendation and category discovery. In: IEEE conference on computer vision and pattern recognition (CVPR), pp 3447–3454Google Scholar
  21. 21.
    Wu L, Yang L, Yu N, Hua X (2009) Learning to tag. In: Proceedings of the 18th international conference on world wide web (WWW), pp 361–370Google Scholar
  22. 22.
    Xu J, Li H (2007) Adarank: a boosting algorithm for information retrieval. In: Proceedings of the 30th international ACM conference on research and development in information retrieval (SIGIR), pp 391–398Google Scholar
  23. 23.
    Xu T, Liu D, Chen E, Cao H, Tian J (2012) Adarank: a boosting algorithm for information retrieval. In: Proceedings of proceedings of the 12th IEEE international conference on data mining (ICDM), pp 1158–1163Google Scholar
  24. 24.
    Yang J, Leskovec J (2012) Defining and evaluating network communities based on ground-truth. In: Proceedings of the 12th IEEE international conference on data mining (ICDM), pp 745–754Google Scholar
  25. 25.
    Yin Z, Li R, Mei Q, Han J (2009) Exploring social tagging graph for web object classification. In: Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining (KDD), pp 957–966Google Scholar
  26. 26.
    Yue Y, Finley T, Radlinski F, Joachims T (2007) A support vector method for optimizing average precision. In: Proceedings of the 30th international ACM conference on research and development in information retrieval (SIGIR), pp 271–278Google Scholar
  27. 27.
    Zhu H, Chen E, Cao H (2011) Finding experts in tag based knowledge sharing communities. In: Proceedings of the 2011 international conference on knowledge science, engineering and management (KSEM), pp 183–195Google Scholar
  28. 28.
    Zhu H, Cao H, Chen E, Xiong H (2013) Mobile App Classification with Enriched Contextual Information. IEEE Trans Mobile Comput (TMC) (pre-print). doi:10.1109/TMC.2013.113

Copyright information

© Springer-Verlag London 2013

Authors and Affiliations

  • Tong Xu
    • 1
  • Hengshu Zhu
    • 1
  • Enhong Chen
    • 1
  • Baoxing Huai
    • 1
  • Hui Xiong
    • 2
  • Jilei Tian
    • 3
  1. 1.School of Computer Science and TechnologyUniversity of Science and Technology of ChinaHefeiChina
  2. 2.Management Science and Information Systems Department, Rutgers Business SchoolRutgers UniversityNewarkUSA
  3. 3.NokiaBeijing China

Personalised recommendations