Multi-resolution-Tract CNN with Hybrid Pretrained and Skin-Lesion Trained Layers

  • Jeremy KawaharaEmail author
  • Ghassan Hamarneh
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10019)


Correctly classifying a skin lesion is one of the first steps towards treatment. We propose a novel convolutional neural network (CNN) architecture for skin lesion classification designed to learn based on information from multiple image resolutions while leveraging pretrained CNNs. While traditional CNNs are generally trained on a single resolution image, our CNN is composed of multiple tracts, where each tract analyzes the image at a different resolution simultaneously and learns interactions across multiple image resolutions using the same field-of-view. We convert a CNN, pretrained on a single resolution, to work for multi-resolution input. The entire network is fine-tuned in a fully learned end-to-end optimization with auxiliary loss functions. We show how our proposed novel multi-tract network yields higher classification accuracy, outperforming state-of-the-art multi-scale approaches when compared over a public skin lesion dataset.


Actinic Keratosis Convolutional Neural Network Nonmelanoma Skin Cancer Lower Tract Convolutional Layer 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.



Thanks to the Natural Sciences and Engineering Research Council (NSERC) of Canada for funding and to the NVIDIA Corporation for the donation of a Titan X GPU used in this research.


  1. 1.
    Ballerini, L., Fisher, R.B., Aldridge, B., Rees, J.: A color and texture based hierarchical K-NN approach to the classification of non-melanoma skin lesions. In: Celebi, M.E., Schaefer, G. (eds.) Color Medical Image Analysis, vol. 6, pp. 63–86. Springer Netherlands, New York (2013)CrossRefGoogle Scholar
  2. 2.
    Bao, S., Chung, A.C.S.: Multi-scale structured CNN with label consistency for brain MR image segmentation. Comput. Methods Biomech. Biomed. Eng.: Imaging Visual. 1–5 (2016). doi: 10.1080/21681163.2016.1182072
  3. 3.
    Chopra, S., Hadsell, R., LeCun, Y.: Learning a similiarty metric discriminatively, with application to face verification. In: IEEE CVPR, pp. 349–356 (2005)Google Scholar
  4. 4.
    Donahue, J., et al.: DeCAF: a deep convolutional activation feature for generic visual recognition. ICML 32, 647–655 (2014)Google Scholar
  5. 5.
    He, K., Zhang, X., Ren, S., Sun, J.: Spatial pyramid pooling in deep convolutional networks for visual recognition. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8691, pp. 346–361. Springer, Heidelberg (2014)Google Scholar
  6. 6.
    Jia, Y., et al.: Caffe: convolutional architecture for fast feature embedding. In: ACM Conference on Multimedia, pp. 675–678 (2014)Google Scholar
  7. 7.
    Kamnitsas, K., et al.: Multi-scale 3D convolutional neural networks for lesion segmentation in brain MRI. In: ISLES Challenge (2015)Google Scholar
  8. 8.
    Kawahara, J., BenTaieb, A., Hamarneh, G.: Deep features to classify skin lesions. In: IEEE ISBI, pp. 1397–1400 (2016)Google Scholar
  9. 9.
    Korotkov, K., Garcia, R.: Computerized analysis of pigmented skin lesions: a review. Artif. Intell. Med. 56(2), 69–90 (2012)CrossRefGoogle Scholar
  10. 10.
    Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: NIPS, pp. 1097–1105 (2012)Google Scholar
  11. 11.
    Lee, C.Y., Xie, S., Gallagher, P.W., Zhang, Z., Tu, Z.: Deeply-supervised nets. AISTATS 38, 562–570 (2015)Google Scholar
  12. 12.
    Leo, C.D., et al.: Hierarchical classification of ten skin lesion classes. In: Proceedings SICSA Dundee Medical Image Analysis Workshop (2015)Google Scholar
  13. 13.
    Russakovsky, O., et al.: ImageNet large scale visual recognition challenge. IJCV 115(3), 211–252 (2015)MathSciNetCrossRefGoogle Scholar
  14. 14.
    Sermanet, P., et al.: OverFeat: integrated recognition, localization and detection using convolutional networks. In: ICLR (2014)Google Scholar
  15. 15.
    Shin, H.C., et al.: Deep convolutional neural networks for computer-aided detection. IEEE TMI 35(5), 1285–1298 (2016)Google Scholar
  16. 16.
    World Health Organization: INTERSUN: the global UV project (2003). Accessed 13 Feb 2016

Copyright information

© Springer International Publishing AG 2016

Authors and Affiliations

  1. 1.Medical Image Analysis LabSimon Fraser UniversityBurnabyCanada

Personalised recommendations