Advertisement

Mineral: Multi-modal Network Representation Learning

  • Zekarias T. KefatoEmail author
  • Nasrullah Sheikh
  • Alberto Montresor
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10710)

Abstract

Network representation learning (NRL) is a task of learning an embedding of nodes in a low-dimensional space. Recent advances in this area have achieved interesting results; however, as there is no solution that fits all kind of networks, NRL algorithms need to be specialized to preserve specific aspects of the networks, such as topology, information content, and community structure. One aspect that has been neglected so far is how a network reacts to the diffusion of information. This aspect is particularly relevant in the context of social networks. Studies have found out that diffusion reveals complex patterns in the network structure that are otherwise difficult to be discovered by other means. In this work, we describe a novel algorithm that combines topology, information content and diffusion process, and jointly learns a high quality embedding of nodes. We performed several experiments using multiple datasets and demonstrate that our algorithm performs significantly better in many network analysis tasks over existing studies.

Keywords

NRL Diffusion patterns Cascades 

Notes

Acknowledgements

This research was partially supported by EIT Digital Project Sensemaking Service: Entity Linking for Big Linked Data - Act. #17151 - 2017.

References

  1. 1.
    Perozzi, B., Al-Rfou, R., Skiena, S.: DeepWalk: online learning of social representations. In: Proceedings of the 20th ACM International Conference on Knowledge Discovery and Data Mining (KDD 2014), pp. 701–710. ACM (2014)Google Scholar
  2. 2.
    Grover, A., Leskovec, J.: Node2vec: scalable feature learning for networks. In: Proceedings of the 22nd ACM International Conference on Knowledge Discovery and Data Mining (KDD 2016), pp. 855–864. ACM (2016)Google Scholar
  3. 3.
    Tang, J., Qu, M., Wang, M., Zhang, M., Yan, J., Mei, Q.: LINE: large-scale information network embedding. CoRR, vol. abs/1503.03578 (2015)Google Scholar
  4. 4.
    Huang, X., Li, J., Hu, X.: Label informed attributed network embedding. In: Proceedings of the Tenth ACM International Conference on Web Search and Data Mining (WSDM 2017), pp. 731–739. ACM (2017)Google Scholar
  5. 5.
    Wang, D., Cui, P., Zhu, W.: Structural deep network embedding. In: Proceedings of the 22nd ACM International Conference on Knowledge Discovery and Data Mining (KDD 2016), pp. 1225–1234. ACM (2016)Google Scholar
  6. 6.
    Yang, C., Liu, Z., Zhao, D., Sun, M., Chang, E.Y.: Network representation learning with rich text information. In: Proceedings of the 24th International Conference on Artificial Intelligence (IJCAI 2015), pp. 2111–2117. AAAI Press (2015)Google Scholar
  7. 7.
    Tu, C., Wang, H., Zeng, X., Liu, Z., Sun, M.: Community-enhanced network representation learning for network analysis. CoRR, vol. abs/1611.06645 (2016)Google Scholar
  8. 8.
    Wang, X., Cui, P., Wang, J., Pei, J., Zhu, W., Yang, S.: Community preserving network embedding. In: AAAI (2017)Google Scholar
  9. 9.
    Xie, R., Liu, Z., Jia, J., Luan, H., Sun, M.: Representation learning of knowledge graphs with entity descriptions. In: Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence (AAAI 2016), pp. 2659–2665. AAAI Press (2016)Google Scholar
  10. 10.
    Dahl, G.E., Ranzato, M., Mohamed, A.-R., Hinton, G.: Phone recognition with the mean-covariance restricted Boltzmann machine. In: Proceedings of the 23rd International Conference on Neural Information Processing Systems (NIPS 2010), pp. 469–477. Curran Associates Inc. (2010)Google Scholar
  11. 11.
    Ciregan, D., Meier, U., Schmidhuber, J.: Multi-column deep neural networks for image classification. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp. 3642–3649, June 2012Google Scholar
  12. 12.
    Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., Rabinovich, A.: Going deeper with convolutions. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1–9, June 2015Google Scholar
  13. 13.
    Bengio, Y., Courville, A., Vincent, P.: Representation learning: a review and new perspectives. IEEE Trans. Pattern Anal. Mach. Intell. 35, 1798–1828 (2013)CrossRefGoogle Scholar
  14. 14.
    Weng, L., Menczer, F., Ahn, Y.-Y.: Virality prediction and community structure in social networks. Sci. Rep. 3(2522) (2013)Google Scholar
  15. 15.
    Weng, L., Menczer, F., Ahn, Y.-Y.: Predicting successful memes using network and community structure. In: Adar, E., Resnick, P., Choudhury, M.D., Hogan, B., Oh, A.H. (eds.) ICWSM. The AAAI Press (2014)Google Scholar
  16. 16.
    Kempe, D., Kleinberg, J., Tardos, E.: Maximizing the spread of influence through a social network. In: Proceedings of the Ninth ACM International Conference on Knowledge Discovery and Data Mining (KDD 2003), pp. 137–146. ACM (2003)Google Scholar
  17. 17.
    Mikolov, T., Sutskever, I., Chen, K., Corrado, G., Dean, J.: Distributed representations of words and phrases and their compositionality. In: Proceedings of the 26th International Conference on Neural Information Processing Systems (NIPS 2013), pp. 3111–3119. Curran Associates Inc. (2013)Google Scholar
  18. 18.
    Leskovec, J., Backstrom, L., Kleinberg, J.: Meme-tracking and the dynamics of the news cycle. In: Proceedings of the 15th ACM International Conference on Knowledge Discovery and Data Mining (KDD 2009), pp. 497–506. ACM (2009)Google Scholar
  19. 19.
    Tang, L., Liu, H.: Relational learning via latent social dimensions. In: Proceedings of the 15th ACM International Conference on Knowledge Discovery and Data Mining (KDD 2009), pp. 817–826. ACM (2009)Google Scholar
  20. 20.
    Blondel, V.D., Guillaume, J.-L., Lambiotte, R., Lefebvre, E.: Fast unfolding of communities in large networks. J. Stat. Mech. Theor. Exp. 2008(10), P10008 (2008)CrossRefGoogle Scholar
  21. 21.
    Wang, P., Xu, B., Wu, Y., Zhou, X.: Link prediction in social networks: the state-of-the-art. Sci. China Inf. Sci. 58(1), 1–38 (2015)Google Scholar
  22. 22.
    van der Maaten, L., Hinton, G.: Visualizing high-dimensional data using t-SNE. J. Mach. Learn. Res. 9, 2579–2605 (2008)zbMATHGoogle Scholar

Copyright information

© Springer International Publishing AG 2018

Authors and Affiliations

  • Zekarias T. Kefato
    • 1
    Email author
  • Nasrullah Sheikh
    • 1
  • Alberto Montresor
    • 1
  1. 1.University of TrentoTrentoItaly

Personalised recommendations