Computer-Aided Diagnosis in Chest Radiography with Deep Multi-Instance Learning
The Computer-Aided Diagnosis (CAD) for chest X-ray image has been investigated for many years. However, it has not been widely used since limited accuracy. Deep learning opens a new era for image recognition and classification. We propose a novel framework called Deep Multi-Instance Learning (DMIL) on chest radiographic images diagnosis, which combines deep learning and multi-instance learning. Besides, we preprocess images with the alignment based on the key points. This framework can effectively improve the diagnosis effect in the image level annotation. We quantify the framework on three datasets, respectively with different amounts and different classification tasks. The proposed framework obtained the AUC of 0.986, 0.873, 0.824 respectively in classification tasks of the enlarged heart, the pulmonary nodule, and the abnormal. The experiments we implement demonstrate that the proposed framework outperforms the other methods in various evaluation criteria.
KeywordsChest radiograph Deep learning Multi-Instance Learning Medical image
This work is supported by the National Natural Science Foundation of China (No. 61472023) and the State Key Laboratory of Software Development Environment (No. SKLSDE-2016ZX-24).
- 3.Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)Google Scholar
- 5.Bar, Y., Diamant, I., Wolf, L., Greenspan, H.: Deep learning with non-medical training used for chest pathology identification. In: SPIE Medical Imaging, pp. 94140V. International Society for Optics and Photonics (2015)Google Scholar
- 6.Bar, Y., Diamant, I., Wolf, L., Lieberman, S., Konen, E., Greenspan, H.: Chest pathology detection using deep learning with non-medical training. In: 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI), pp. 294–297. IEEE (2015)Google Scholar
- 8.Wu, J., Yu, Y., Huang, C., Yu, K.: Deep multiple instance learning for image classification and auto-annotation, pp. 3460–3469 (2015)Google Scholar
- 9.Zeng, T., Ji, S.: Deep convolutional neural networks for multi-instance multi-task learning. In: 2015 IEEE International Conference on Data Mining (ICDM), pp. 579–588. IEEE (2015)Google Scholar
- 10.Ren, S., Cao, X., Wei, Y., Sun, J.: Face alignment at 3000 FPS via regressing local binary features. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1685–1692 (2014)Google Scholar
- 12.He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)Google Scholar
- 13.Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)
- 14.Melendez, J., van Ginneken, B., Maduskar, P., Philipsen, R.H., Reither, K., Breuninger, M., Adetifa, I.M., Maane, R., Ayles, H., Sánchez, C.I.: A novel multiple-instance learning-based approach to computer-aided detection of Tuberculosis on chest X-rays. IEEE Trans. Med. Imag. 34(1), 179–192 (2015)CrossRefGoogle Scholar
- 15.Ciompi, F., de Hoop, B., van Riel, S.J., Chung, K., Scholten, E.T., Oudkerk, M., de Jong, P.A., Prokop, M., van Ginneken, B.: Automatic classification of pulmonary peri-fissural nodules in Computed Tomography using an ensemble of 2D views and a convolutional neural network out-of-the-box. Med. Image Anal. 26(1), 195–202 (2015)CrossRefGoogle Scholar