Deep Learning in Textural Medical Image Analysis
One of the characteristics of medical image analysis is that several medical images are not in the structure domain like natural images but in the texture domain. This chapter introduces a new transfer learning method, called “two-stage feature transfer,” to analyze textural medical images by deep convolutional neural networks. In the process of the two-stage feature transfer learning, the models are successively pre-trained with both natural image dataset and textural image dataset to get a better feature representation which cannot be derived from either of these datasets. Experimental results show that the two-stage feature transfer improves the generalization performance of the convolutional neural network on a textural lung CT pattern classification. To explain the mechanism of a transfer learning on convolutional neural networks, this chapter also shows analysis results of the obtained feature representations by an activation visualization method, and by measuring the frequency response of trained neural networks, in both qualitative and quantitative ways, respectively. These results demonstrate that such successive transfer learning enables networks to grasp both structural and textural visual features and be helpful to extracting good features from the textural medical images.
- 1.Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp 1097–1105 (2012)Google Scholar
- 5.Suzuki, A., Sakanashi, H., Kido, S., Hayaru, S.: Feature representation analysis of deep convolutional neural network using two-stage feature transfer - an application for diffuse lung disease classification. IPSJ Trans. Math. Model. Its Appl. 100–110 (2018)Google Scholar
- 6.He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)Google Scholar
- 10.Simonyan, K., Vedaldi, A., Zisserman, A.: Deep inside convolutional networks: visualising image classification models and saliency maps (2013). arXiv preprint arXiv:13126034
- 11.Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., Batra, D.: Grad-cam: Visual explanations from deep networks via gradient-based localization. In: ICCV, pp 618–626 (2017)Google Scholar
- 12.Mahendran, A., Vedaldi, A.: Salient deconvolutional networks. In: European Conference on Computer Vision, pp 120–135. Springer (2016)Google Scholar