Few-Shot Learning with Deep Triplet Networks for Brain Imaging Modality Recognition

  • Santi PuchEmail author
  • Irina Sánchez
  • Matt Rowe
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11795)


Image modality recognition is essential for efficient imaging workflows in current clinical environments, where multiple imaging modalities are used to better comprehend complex diseases. Emerging biomarkers from novel, rare modalities are being developed to aid in such understanding, however the availability of these images is often limited. This scenario raises the necessity of recognising new imaging modalities without them being collected and annotated in large amounts. In this work, we present a few-shot learning model for limited training examples based on Deep Triplet Networks. We show that the proposed model is more accurate in distinguishing different modalities than a traditional Convolutional Neural Network classifier when limited samples are available. Furthermore, we evaluate the performance of both classifiers when presented with noisy samples and provide an initial inspection of how the proposed model can incorporate measures of uncertainty to be more robust against out-of-sample examples.


Brain imaging Modality recognition Few-shot learning Triplet loss Uncertainty Noise 


  1. 1.
    He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. CoRR abs/1512.03385 (2015).
  2. 2.
    He, K., Zhang, X., Ren, S., Sun, J.: Delving deep into rectifiers: surpassing human-level performance on imagenet classification. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1026–1034 (2015)Google Scholar
  3. 3.
    Hermans, A., Beyer, L., Leibe, B.: In defense of the triplet loss for person re-identification. ArXiv arXiv:1703.07737 (2017)
  4. 4.
    Hoffer, E., Ailon, N.: Deep metric learning using triplet network. In: ICLR (2014)Google Scholar
  5. 5.
    Schroff, F., Kalenichenko, D., Philbin, J.: Facenet: a unified embedding for face recognition and clustering. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 815–823 (2015)Google Scholar
  6. 6.
    Wang, W., Carreira-Perpinan, M.A.: The role of dimensionality reduction in classification. In: Twenty-Eighth AAAI Conference on Artificial Intelligence (2014)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.QMENTABostonUSA

Personalised recommendations