Skip to main content
SpringerLink
Log in

Motif-aware diffusion network inference

  • Regular Paper
  • Published:
International Journal of Data Science and Analytics Aims and scope Submit manuscript

Abstract

Diffusion processes over networks are widely encountered in various real-world applications. In many scenarios, however, only the states of nodes can be observed while the underlying diffusion networks are unknown. Many methods have therefore been proposed to infer the underlying networks based on node observations. To enhance the inference performance, structural priors of the networks, such as sparsity, scale-free, and community structures, are often incorporated into the learning procedure. As the building blocks of complex networks, motifs occur frequently in many real-world networks and play a vital role in describing the network structures and functionalities. However, to the best of our knowledge, no existing work has attempted to infer the diffusion network through exploiting network motifs. In order to explore this uncharted yet important issue, in this paper, we propose a novel framework called motif-aware diffusion network inference (MADNI), which aims to mine the motif profile from the node observations and infer the underlying network based on the mined motif profile. The mined motif profile and the inferred network are alternately refined until the learning procedure converges. We derive two network inference models in our framework for inferring the individual-level diffusion network and the meta-population-level diffusion network, respectively. Extensive experiments on both synthetic and real-world datasets validate the effectiveness of the proposed framework. Moreover, we show the generality of MADNI by analyzing the relations between mesoscale motif prior in our framework and other high-level structural priors such as community and scale-free properties in the existing works.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Ahmed, N.K., Neville, J., Rossi, R.A., Duffield, N.: Efficient graphlet counting for large networks. In: Proceedings of the 15th IEEE International Conference on Data Mining, pp. 1–10. IEEE, (2015)

  2. Alon, U.: Network motifs: theory and experimental approaches. Nat. Rev. Genet. 8(6), 450–461 (2007)

    Article  Google Scholar 

  3. Aslan, M.S., Chen, X.W., Cheng, H.: Analyzing and learning sparse and scale-free networks using gaussian graphical models. Int. J. Data Sci. Anal. 1(2), 99–109 (2016)

    Article  Google Scholar 

  4. Benson, A.R., Gleich, D.F., Leskovec, J.: Higher-order organization of complex networks. Science 353(6295), 163–166 (2016)

    Article  Google Scholar 

  5. Chen, X., Lui, J.C.: Mining graphlet counts in online social networks. In: Proceedings of the 16th IEEE International Conference on Data Mining, pp. 71–80. IEEE, (2016)

  6. Farajtabar, M., Rodriguez, M.G., Zamani, M., Du, N., Zha, H., Song, L.: Back to the past: Source identification in diffusion networks from partially observed cascades. In: Proceeding of 18th International Conference on Artificial Intelligence and Statistics, pp. 232–240. (2015)

  7. Goentoro, L., Shoval, O., Kirschner, M.W., Alon, U.: The incoherent feedforward loop can provide fold-change detection in gene regulation. Mol. Cell 36(5), 894–899 (2009)

    Article  Google Scholar 

  8. Gomez Rodriguez, M., Leskovec, J., Krause, A.: Inferring networks of diffusion and influence. In: Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1019–1028. (2010)

  9. Gomez Rodriguez, M., Leskovec, J., Schölkopf, B.: Structure and dynamics of information pathways in online media. In: Proceedings of the 6th ACM International Conference on Web Search and Data Mining, pp. 23–32. (2013)

  10. He, X., Liu, Y.: Not enough data?: joint inferring multiple diffusion networks via network generation priors. In: Proceedings of the 10th ACM International Conference on Web Search and Data Mining, pp. 465–474. (2017)

  11. Hosseini, S.M.J., Lee, S.I.: Learning sparse gaussian graphical models with overlapping blocks. In: Advances in Neural Information Processing Systems, pp. 3801–3809. (2016)

  12. Hu, Q., Xie, S., Lin, S., Wang, S., Philip, S.Y.: Clustering embedded approaches for efficient information network inference. Data Sci. Eng. 1(1), 29–40 (2016)

    Article  Google Scholar 

  13. Itzkovitz, S., Alon, U.: Subgraphs and network motifs in geometric networks. Phys. Rev. E 71(2), 026117 (2005)

    Article  Google Scholar 

  14. Kashtan, N., Alon, U.: Spontaneous evolution of modularity and network motifs. Proc. Natl. Acad. Sci. U. S. A. 102(39), 13773–13778 (2005)

    Article  Google Scholar 

  15. Kimura, M., Saito, K., Ohara, K., Motoda, H.: Speeding-up node influence computation for huge social networks. Int. J. Data Sci. Anal. 1(1), 3–16 (2016)

    Article  Google Scholar 

  16. Leskovec, J., Krevl, A.: SNAP Datasets: Stanford large network dataset collection. (2014) http://snap.stanford.edu/data. 30 Mar 2017

  17. Leskovec, J., Backstrom, L., Kleinberg, J.: Meme-tracking and the dynamics of the news cycle. In: Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 497–506. (2009)

  18. Liu, H., Ioannidis, S., Bhagat, S., Chuah, C.N.: Adding structure: social network inference with graph priors. In: SIGKDD Workshop on Mining and Learning with Graphs (2016)

  19. Liu, K., Cheung, W.K., Liu, J.: Detecting multiple stochastic network motifs in network data. Knowl. Inf. Syst. 42(1), 49–74 (2015)

    Article  Google Scholar 

  20. Liu, Q., Ihler, A.: Learning scale free networks by reweighted l1 regularization. In: Proceedings of the 14th International Conference on Artificial Intelligence and Statistics, pp. 40–48. (2011)

  21. Mandal, S., Sarkar, R.R., Sinha, S.: Mathematical models of malaria-a review. Malar. J. 10, 202 (2011)

    Article  Google Scholar 

  22. Milo, R., Shen-Orr, S., Itzkovitz, S., Kashtan, N., Chklovskii, D., Alon, U.: Network motifs: simple building blocks of complex networks. Science 298(5594), 824–827 (2002)

    Article  Google Scholar 

  23. Milo, R., Itzkovitz, S., Kashtan, N., Levitt, R., Shen-Orr, S., Ayzenshtat, I., Sheffer, M., Alon, U.: Superfamilies of evolved and designed networks. Science 303(5663), 1538–1542 (2004)

    Article  Google Scholar 

  24. Mukherjee, S., Speed, T.P.: Network inference using informative priors. Proc. Natl. Acad. Sci. 105(38), 14313–14318 (2008)

    Article  Google Scholar 

  25. Prill, R.J., Iglesias, P.A., Levchenko, A.: Dynamic properties of network motifs contribute to biological network organization. PLoS Biol. 3(11), e343 (2005)

    Article  Google Scholar 

  26. Rodriguez, M.G., Balduzzi, D., Schölkopf, B.: Uncovering the temporal dynamics of diffusion networks. In: Proceeding of 28th International Conference on Machine Learning, pp. 561–568. (2011)

  27. Rong, Y., Zhu, Q., Cheng, H.: A model-free approach to infer the diffusion network from event cascade. In: Proceeding of 25th Conference on Information and Knowledge Management, pp. 1653–1662. (2016)

  28. Smith, D.L., Perkins, T.A., et al.: Recasting the theory of mosquito-borne pathogen transmission dynamics and control. Trans. R. Soc. Trop. Med. Hyg. 108(4), 185–197 (2014)

    Article  Google Scholar 

  29. Tan, Q., Liu, Y., Liu, J.: Motif-aware diffusion network inference. In: Pacific-Asia Conference on Knowledge Discovery and Data Mining, pp. 638–650. Springer, New York, (2018)

  30. Tang, Q., Sun, S., Xu, J.: Learning scale-free networks by dynamic node specific degree prior. In: Proceeding of 32nd International Conference on Machine Learning, pp. 2247–2255. (2015)

  31. Teunis, P., Heijne, J.C., Sukhrie, F., van Eijkeren, J., Koopmans, M., Kretzschmar, M.: Infectious disease transmission as a forensic problem: who infected whom? J. R. Soc. Interface 10(81), 20120955 (2013)

    Article  Google Scholar 

  32. Wan, X., Liu, J., Cheung, W.K., Tong, T.: Inferring epidemic network topology from surveillance data. PloS One 9(6), e100661 (2014)

    Article  Google Scholar 

  33. Wang, P., Lui, J., Ribeiro, B., Towsley, D., Zhao, J., Guan, X.: Efficiently estimating motif statistics of large networks. ACM Trans. Knowl. Discov. Data 9(2), 8 (2014)

    Article  Google Scholar 

  34. Wesolowski, A., Eagle, N., Tatem, A.J., Smith, D.L., Noor, A.M., Snow, R.W., Buckee, C.O.: Quantifying the impact of human mobility on malaria. Science 338(6104), 267–270 (2012)

    Article  Google Scholar 

  35. Zhang, Y., Cheung, W.K., Liu, J.: A unified framework for epidemic prediction based on poisson regression. IEEE Trans. Knowl. Data Eng. 27(11), 2878–2892 (2015)

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to thank the PAKDD’2018 PC chairs and reviewers for their constructive comments and suggestions. This work was supported in part by the Grants from the Research Grant Council of Hong Kong SAR under Projects RGC/HKBU12202415 and RGC/HKBU12201318, and in part by the Faculty Research Grant of Hong Kong Baptist University (HKBU) under Project FRG2/17-18/027.

Author information

Authors and Affiliations

  1. Department of Computer Science, Hong Kong Baptist University, Hong Kong, China

    Qi Tan, Yang Liu & Jiming Liu

  2. IRACE Research Center, Hong Kong Baptist University, Shenzhen, China

    Yang Liu & Jiming Liu

Authors
  1. Qi Tan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yang Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jiming Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jiming Liu.

Ethics declarations

Conflict of interest

On behalf of all authors, the corresponding author states that there is no conflict of interest.

Additional information

This paper is an extension version of the PAKDD’2018 long presentation paper “Motif-Aware Diffusion Network Inference” [29].

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tan, Q., Liu, Y. & Liu, J. Motif-aware diffusion network inference. Int J Data Sci Anal 9, 375–387 (2020). https://doi.org/10.1007/s41060-018-0156-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s41060-018-0156-4

Keywords

Search

Navigation