Sequential Monte Carlo Inference Based on Activities for Overlapping Community Models
Various kinds of data such as social media can be represented as a network or graph. Latent variable models using Bayesian statistical inference are powerful tools to represent such networks. One such latent variable network model is a Mixed Membership Stochastic Blockmodel (MMSB), which can discover overlapping communities in a network and has high predictive power. Previous inference methods estimate the latent variables and unknown parameters of the MMSB on the basis of the whole observed network. Therefore, dynamic changes in network structure over time are hard to track. Thus, we first present an incremental Gibbs sampler based on node activities that focuses only on observations within a fixed term length for online sequential estimation of the MMSB. We further present a particle filter based on node activities with various term lengths. For instance, in an e-mail communication network, each particle only considers e-mail accounts that sent or received a message within a specific term length, where the length may be different from those of other particles. We show through experiments with two link prediction datasets that our proposed methods achieve both high prediction performance and computational efficiency.
This work was supported in part by the Grant-in-Aid for Scientific Research (#15H02703) from JSPS, Japan.
- 4.Canini, K.R., Shi, L., Griffiths, T.L.: Online inference of topics with latent Dirichlet allocation. In: Proceedings of the 12th International Conference on Artificial Intelligence and Statistics, Clearwater Beach, Florida, USA, pp. 65–72 (2009)Google Scholar
- 6.Ghahramani, Z., Griffiths, T.L.: Infinite latent feature models and the Indian buffet process. In: Advances in Neural Information Processing Systems, vol. 18 (2006)Google Scholar
- 8.Gopalan, P.K., Gerrish, S., Freedman, M., Blei, D.M., Mimno, D.M.: Scalable inference of overlapping communities. In: Advances in Neural Information Processing Systems, vol. 25 (2012)Google Scholar
- 10.Hofmann, T.: Probabilistic latent semantic indexing. In: Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Berkeley, California, USA, pp. 50–57 (1999)Google Scholar
- 13.Kemp, C., Tenenbaum, J.B., Griffiths, T.L., Yamada, T., Ueda, N.: Learning systems of concepts with an infinite relational model. In: Proceedings of the 21st National Conference on Artificial Intelligence, Boston, Massachusetts, USA, vol. 1, pp. 381–388 (2006)Google Scholar
- 14.Klimt, B., Yang, Y.: Introducing the Enron corpus. In: First Conference on Email and Anti-Spam CEAS, Mountain View, California, USA (2004)Google Scholar
- 16.Miller, K.T., Jordan, M.I., Griffiths, T.L.: Nonparametric latent feature models for link prediction. In: Advances in Neural Information Processing Systems, vol. 22, pp. 1276–1284 (2009)Google Scholar