Multi-view Restricted Boltzmann Machines with Posterior Consistency

  • Ding Shifei
  • Zhang NanEmail author
  • Zhang Jian
Conference paper
Part of the IFIP Advances in Information and Communication Technology book series (IFIPAICT, volume 538)


Restricted Boltzmann machines (RBMs) have been proven to be powerful tools in many specific applications, such as representational learning and document modelling. However, the extensions of RBMs are rarely used in the field of multi-view learning. In this paper, we present a new multi-view RBM model, named as the RBM with posterior consistency, for multi-view classification. The RBM with posterior consistency computes multiple representations by regularizing the marginal likelihood function with the consistency among representations from different views. Contrasting with existing multi-view classification methods, such as multi-view Gaussian pro-cess with posterior consistency (MvGP) and consensus and complementarity based maximum entropy discrimination (MED-2C), the RBM with posterior consistency have achieved satisfactory results on two-class and multi-class classification datasets.


Restricted Boltzmann machines Representational learning Multi-view learning 



This work is supported by the National Natural Science Foundation of China under Grant no. 61672522 and no. 61379101.


  1. 1.
    Hinton, G.E., Salakhutdinov, R.R.: Reducing the dimensionality of data with neural networks. Science 313(5786), 504–507 (2006)MathSciNetCrossRefGoogle Scholar
  2. 2.
    Zhang, N., Ding, S., Zhang, J., Xue, Y.: An overview on restricted Boltzmann machines. Neurocomputing 275, 1186–1199 (2018)CrossRefGoogle Scholar
  3. 3.
    Courville, A., Desjardins, G., Bergstra, J., Bengio, Y.: The spike-and-slab RBM and extensions to discrete and sparse data distributions. IEEE Trans. Pattern Anal. Mach. Intell. 36(9), 1874–1887 (2014)CrossRefGoogle Scholar
  4. 4.
    Mittelman, R., Kuipers, B., Savarese, S., Lee, H.: Structured recurrent temporal restricted Boltzmann machines. In: Proceedings of International Conference on Machine Learning, ICML 2014, Beijing, China, pp. 1647–1655, 21–26 June 2014Google Scholar
  5. 5.
    Zhang, N., Ding, S., Zhang, J., Xue, Y.: Research on point-wise gated deep networks. Appl. Soft Comput. 52, 1210–1221 (2017)CrossRefGoogle Scholar
  6. 6.
    Nguyen, T.D., Tran, T., Phung, D., Venkatesh, S.: Graph-induced restricted Boltzmann machines for document modelling. Inf. Sci. 328, 60–75 (2016)CrossRefGoogle Scholar
  7. 7.
    Amer, M.R., Shields, T., Siddiquie, B., Tamrakar, A., Divakaran, A., Chai, S.: Deep multimodal fusion: a hybrid approach. Int. J. Comput. Vis. 126(2–4), 440–456 (2018)MathSciNetCrossRefGoogle Scholar
  8. 8.
    Salakhutdinov, R.R., Hinton, G.E.: Deep Boltzmann machines. In: Proceedings of International Conference on Artificial Intelligence and Statistics, AISTATS 2009, Clearwater Beach, pp. 448–455, 16–18 April 2009Google Scholar
  9. 9.
    Zhao, J., Xie, X., Xu, X., Sun, S.: Multi-view learning overview: recent progress and new challenges. Inf. Fusion 38, 43–54 (2017)CrossRefGoogle Scholar
  10. 10.
    Liu, Q., Sun, S.: Multi-view regularized gaussian processes. In: Kim, J., Shim, K., Cao, L., Lee, J.-G., Lin, X., Moon, Y.-S. (eds.) PAKDD 2017, Part II. LNCS (LNAI), vol. 10235, pp. 655–667. Springer, Cham (2017). Scholar
  11. 11.
    Chao, G., Sun, S.: Consensus and complementarity based maximum entropy discrimination for multi-view classification. Inf. Sci. 367, 296–310 (2016)CrossRefGoogle Scholar
  12. 12.
    Ravanbakhsh, S., Póczos, B., Schneider, J., Schuurmans, D., Greiner, R.: Stochastic neural net-works with monotonic activation functions. In: Proceedings of International Conference on Artificial Intelligence and Statistics, AISTATS 2016, Cadiz, pp. 809–818, 9–11 May 2016Google Scholar
  13. 13.
    Hinton, G.E.: Training products of experts by minimizing contrastive divergence. Neural Comput. 14(8), 1711–1800 (2002)CrossRefGoogle Scholar
  14. 14.
    Ding, S., Zhang, X., An, Y., Xue, Y.: Weighted linear loss multiple birth support vector machine based on information granulation for multi-class classification. Pattern Recogn. 67, 32–46 (2017)CrossRefGoogle Scholar

Copyright information

© IFIP International Federation for Information Processing 2018

Authors and Affiliations

  1. 1.School of Computer Science and TechnologyChina University of Mining and TechnologyXuzhouChina

Personalised recommendations