Learning Features for Tissue Classification with the Classification Restricted Boltzmann Machine
Performance of automated tissue classification in medical imaging depends on the choice of descriptive features. In this paper, we show how restricted Boltzmann machines (RBMs) can be used to learn features that are especially suited for texture-based tissue classification. We introduce the convolutional classification RBM, a combination of the existing convolutional RBM and classification RBM, and use it for discriminative feature learning. We evaluate the classification accuracy of convolutional and non-convolutional classification RBMs on two lung CT problems. We find that RBM-learned features outperform conventional RBM-based feature learning, which is unsupervised and uses only a generative learning objective, as well as often-used filter banks. We show that a mixture of generative and discriminative learning can produce filters that give a higher classification accuracy.
KeywordsClassification Accuracy Hide Node Filter Bank Convolutional Neural Network Feature Learning
This research is financed by the Netherlands Organization for Scientific Research (NWO).
- 1.Bengio, Y., Courville, A., Vincent, P.: Representation learning: a review and new perspectives. Technical report, Université de Montréal (2012)Google Scholar
- 2.Li, Q., Cai, W., Feng, D.D.: Lung image patch classification with automatic feature learning. In: 35th Annual International Conference on Engineering in Medicine and Biology Society (EMBC) (2013)Google Scholar
- 5.Desjardins, G., Bengio, Y.: Empirical evaluation of convolutional RBMs for vision. Technical report, Université de Montréal (2008)Google Scholar
- 6.Norouzi, M., Ranjbar, M., Mori, G.: Stacks of convolutional restricted Boltzmann machines for shift-invariant feature learning. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR) (2009)Google Scholar
- 7.Lee, H., Grosse, R., Ranganath, R., Ng, A.Y.: Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations. In: The 26th International Conference on Machine Learning (ICML) (2009)Google Scholar
- 9.Hinton, G.E.: A practical guide to training restricted Boltzmann machines. Technical report. University of Toronto (2010)Google Scholar
- 16.Schmid, C.: Constructing models for content-based image retrieval. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR) (2001)Google Scholar
- 20.Saxe, A.M., Koh, P.W., Chen, Z., Bhand, M., Suresh, B., Ng, A.Y.: On random weights and unsupervised feature learning. In: The International Conference on Machine Learning (ICML) (2011)Google Scholar