Abstract
The last decades have witnessed the boom of social networks. As a result, discovering user interests from social media has gained increasing attention. While the accumulation of social media presents us great opportunities for a better understanding of the users, the challenge lies in how to build a uniform model for the heterogeneous contents. In this article, we propose a hybrid mixture model for user interests discovery which exploits both the textual and visual content associated with social images. By modeling the features of each content source independently at the latent variable level and unifies them as latent interests, the proposed model allows the semantic interpretation of user interests in both the visual and textual perspectives. Qualitative and quantitative experiments on a Flickr dataset with 2.54 million images have demonstrated its promise for user interest analysis compared with existing methods.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Abel, F., et al.: Twitter-based user modeling for news recommendations. In: Proceedings of the 23rd International Joint Conference on Artificial Intelligence. AAAI Press (2013)
Blei, D.M., et al.: Latent Dirichlet allocation. J. Mach. Learn. Res. (2003)
Campbell, W.M., et al.: Content+ context networks for user classification in Twitter. In: In Frontiers of Network Analysis: Methods, Models, and Applications Workshop at Neural Information Processing Systems (2013)
Crandall, D., Snavely, N., et al.: Modeling people and places with internet photo collections. Commun. ACM (2012). ACM
Elkahky, A.M., et al.: A multi-view deep learning approach for cross domain user modeling in recommendation systems. In: WWW, World Wide Web Consortium (2015)
Farseev, A., et al.: Harvesting multiple sources for user profile learning: a big data study. In: Proceedings of the 5th ACM on International Conference on Multimedia Retrieval (2015)
Huang, S., et al.: Social friend recommendation based on network correlation and feature co-clustering. In: Proceedings of the 5th ACM on International Conference on Multimedia Retrieval (2015)
Ikeda, K., et al.: Twitter user profiling based on text and community mining for market analysis. Knowl.-Based Syst. (2013)
Joshi, D., et al.: Building user profiles from shared photos. In: Proceedings of the 2015 Workshop on Community-Organized Multimodal Mining: Opportunities for Novel Solutions. ACM (2015)
Le, Q.V., Mikolov, T.: Distributed representations of sentences and documents. Comput. Sci. (2014)
Rosen-Zvi, M., et al.: The author-topic model for authors and documents. In: Proceedings of the 21st Conference on Uncertainty in Artificial Intelligence. Morgan Kaufmann Publishers Inc. (2004)
Srivastava, N., Salakhutdinov, R.R.: Multimodal learning with deep Boltzmann machines. In: Frontiers of Network Analysis: Methods, Models, and Applications Workshop at Neural Information Processing Systems (2012)
Niu, T., Zhu, S., Pang, L., Saddik, A.: Sentiment analysis on multi-view social data. In: Tian, Q., Sebe, N., Qi, G.-J., Huet, B., Hong, R., Liu, X. (eds.) MMM 2016. LNCS, vol. 9517, pp. 15–27. Springer, Heidelberg (2016). doi:10.1007/978-3-319-27674-8_2
Pennacchiotti, M., Popescu, A.M.: A machine learning approach to twitter user classification. In: Proceedings of the 21st International Joint Conference on Artificial Intelligence. AAAI Press (2011)
Guntuku, S.C., Roy, S., Weisi, L.: Personality modeling based image recommendation. In: He, X., Luo, S., Tao, D., Xu, C., Yang, J., Hasan, M.A. (eds.) MMM 2015. LNCS, vol. 8936, pp. 171–182. Springer, Heidelberg (2015). doi:10.1007/978-3-319-14442-9_15
Szegedy, C., et al.: Going deeper with convolutions. In: The IEEE Conference on Computer Vision and Pattern Recognition (2015)
Tang, J., et al.: A combination approach to web user profiling. ACM Trans. Knowl. Discov. Data (2010)
Thomee, B., et al.: YFCC100M: the new data in multimedia research. Commun. ACM (2016). ACM
Wang, Z., et al.: Bilateral correspondence model for words-and-pictures association in multimedia-rich microblogs. ACM Trans. Multimedia Comput. Commun. Appl. (2014)
Xie, P., et al.: Mining user interests from personal photos. In: Proceedings of the 29th AAAI Conference on Artificial Intelligence (2015)
Xing, E.P., et al.: A generalized mean field algorithm for variational inference in exponential families. In: Proceedings of the 19th Conference on Uncertainty in Artificial Intelligence. Morgan Kaufmann Publishers Inc. (2002)
Yao, J., et al.: Joint latent Dirichlet allocation for non-iid social tags. In: IEEE International Conference on Multimedia and Expo (2015)
Acknowledgements
The work is partially supported by the High Technology Research and Development Program of China 2015AA015801, NSFC 61521062, STCSM 12DZ2272600.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Yao, J., Zhang, Y., Tsang, I., Sun, J. (2017). Discovering User Interests from Social Images. In: Amsaleg, L., Guðmundsson, G., Gurrin, C., Jónsson, B., Satoh, S. (eds) MultiMedia Modeling. MMM 2017. Lecture Notes in Computer Science(), vol 10133. Springer, Cham. https://doi.org/10.1007/978-3-319-51814-5_14
Download citation
DOI: https://doi.org/10.1007/978-3-319-51814-5_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-51813-8
Online ISBN: 978-3-319-51814-5
eBook Packages: Computer ScienceComputer Science (R0)