Skin Lesion Classification in Dermoscopy Images Using Synergic Deep Learning

  • Jianpeng Zhang
  • Yutong Xie
  • Qi Wu
  • Yong XiaEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11071)


Automated skin lesion classification in the dermoscopy images is an essential way to improve diagnostic performance and reduce melanoma deaths. Although deep learning has shown proven advantages over traditional methods, which rely on handcrafted features, in image classification, it remains challenging to classify skin lesions due to the significant intra-class variation and inter-class similarity. In this paper, we propose a synergic deep learning (SDL) model to address this issue, which not only uses dual deep convolutional neural networks (DCNNs) but also enables them to mutually learn from each other. Specifically, we concatenate the image representation learned by both DCNNs as the input of a synergic network, which has a fully connected structure and predicts whether the pair of input images belong to the same class. We train the SDL model in the end-to-end manner under the supervision of the classification error in each DCNN and the synergic error. We evaluated our SDL model on the ISIC 2016 Skin Lesion Classification dataset and achieved the state-of-the-art performance.



This work was supported in part by the National Natural Science Foundation of China under Grants 61771397 and 61471297.


  1. 1.
    Siegel, R.L., Miller, K.D., Jemal, A.: Cancer statistics, 2016. CA Cancer J. Clin. 66(1), 7–30 (2016)CrossRefGoogle Scholar
  2. 2.
    Gutman, D., et al.: Skin Lesion Analysis toward Melanoma Detection: A Challenge at the International Symposium on Biomedical Imaging (ISBI) (2016). arXiv:1605.01397
  3. 3.
    Ge, Z., Demyanov, S., Chakravorty, R., Bowling, A., Garnavi, R.: Skin disease recognition using deep saliency features and multimodal learning of dermoscopy and clinical images. In: Descoteaux, M., Maier-Hein, L., Franz, A., Jannin, P., Collins, D.L., Duchesne, S. (eds.) MICCAI 2017. LNCS, vol. 10435, pp. 250–258. Springer, Cham (2017). Scholar
  4. 4.
    Yu, L., Chen, H., Dou, Q., Qin, J., Heng, P.A.: Automated melanoma recognition in dermoscopy images via very deep residual networks. IEEE Trans. Med. Imaging 36(4), 994–1004 (2017)CrossRefGoogle Scholar
  5. 5.
    Esteva, A.: Dermatologist-level classification of skin cancer with deep neural networks. Nat. Res. 542(7639), 115–118 (2017)Google Scholar
  6. 6.
    Weese, J., Lorenz, C.: Four challenges in medical image analysis from an industrial perspective. Med. Image Anal. 33, 44–49 (2016)CrossRefGoogle Scholar
  7. 7.
    Oquab, M., Bottou, L., Laptev, I., Sivic, J.: Learning and transfering mid-level image representations using convolutional neural networks. In: CVPR, pp. 1717–1724 (2014)Google Scholar
  8. 8.
    Zhou, Z., Shin, J., Zhang, L., Liang J.: Fine-tuning convolutional neural networks for biomedical image analysis: actively and incrementally. In: CVPR, pp. 4761–4772 (2017)Google Scholar
  9. 9.
    Xie, Y., Xia, Y., Zhang, J., Feng, D.D., Fulham, M., Cai, W.: Transferable multi-model ensemble for benign-malignant lung nodule classification on chest CT. In: Descoteaux, M., Maier-Hein, L., Franz, A., Jannin, P., Collins, D.L., Duchesne, S. (eds.) MICCAI 2017. LNCS, vol. 10435, pp. 656–664. Springer, Cham (2017). Scholar
  10. 10.
    Song, Y., et al.: Large margin local estimate with applications to medical image classification. IEEE Trans. Med. Imaging 34(6), 1362–1377 (2015)CrossRefGoogle Scholar
  11. 11.
    Bengio, Y., Collobert, R., Weston, J.: Curriculum learning. In: ICML, pp. 41–48 (2016)Google Scholar
  12. 12.
    He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: CVPR, pp. 770–778 (2016)Google Scholar
  13. 13.
    Yuan, Y., Su, W., Zhu, M.: Threshold-free measures for assessing the performance of medical screening tests. Front. Public Health 3, 57 (2015)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  1. 1.School of Computer Science and EngineeringNorthwestern Polytechnical UniversityXi’anPeople’s Republic of China
  2. 2.School of Computer ScienceUniversity of AdelaideAdelaideAustralia

Personalised recommendations