International Workshop on Machine Learning in Medical Imaging

MICCAI 2015: Machine Learning in Medical Imaging pp 194-202 | Cite as

Longitudinal Patch-Based Segmentation of Multiple Sclerosis White Matter Lesions

  • Snehashis Roy
  • Aaron Carass
  • Jerry L. Prince
  • Dzung L. Pham
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9352)


Segmenting \(T_2\)-weighted white matter lesions from longitudinal MR images is essential in understanding progression of multiple sclerosis. Most lesion segmentation techniques find lesions independently at each time point, even though there are different noise and image contrast variations at each point in the time series. In this paper, we present a patch based 4D lesion segmentation method that takes advantage of the temporal component of longitudinal data. For each subject with multiple time-points, 4D patches are constructed from the \(T_1\)-w and FLAIR scans of all time-points. For every 4D patch from a subject, a few relevant matching 4D patches are found from a reference, such that their convex combination reconstructs the subject’s 4D patch. Then corresponding manual segmentation patches of the reference are combined in a similar manner to generate a 4D membership of lesions of the subject patch. We compare our 4D patch-based segmentation with independent 3D voxel-based and patch-based lesion segmentation algorithms. Based on ground truth segmentations from 30 data sets, we show that the mean Dice coefficients between manual and automated segmentations improve after using the 4D approach compared to two state-of-the-art 3D segmentation algorithms.


Multiple Sclerosis Lesion Ground Truth Segmentation Lesion Segmentation Reference Patch Center Voxels 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Garcia-Lorenzo, D., Francis, S., Narayanan, S., Arnold, D.L., Collins, D.L.: Review of automatic segmentation methods of multiple sclerosis white matter lesions on conventional magnetic resonance imaging. Med. Image Anal. 17(1), 1–18 (2013)CrossRefGoogle Scholar
  2. 2.
    Geremia, E., Clatz, O., Menze, B.H., Konukoglu, E., Criminisi, A., Ayache, N.: Spatial decision forests for MS lesion segmentation in multi-channel magnetic resonance images. NeuroImage 57(2), 378–390 (2011)CrossRefGoogle Scholar
  3. 3.
    Shiee, N., Bazin, P.L., Ozturk, A., Reich, D.S., Calabresi, P.A., Pham, D.L.: A Topology-Preserving Approach to the Segmentation of Brain Images with Multiple Sclerosis Lesions. NeuroImage 49(2), 1524–1535 (2009)CrossRefGoogle Scholar
  4. 4.
    Roy, S., He, Q., Carass, A., Jog, A., Cuzzocreo, J.L., Reich, D.S., Prince, J.L., Pham, D.L.: Example based lesion segmentation. In: Proc. of SPIE, vol. 9034, p. 90341Y (2014)Google Scholar
  5. 5.
    Ganiler, O., Oliver, A., Diez, Y., Freixenet, J., Vilanova, J.C., Beltran, B., Ramio-Torrenta, L., Rovira, A., Llado, X.: A subtraction pipeline for automatic detection of new appearing multiple sclerosis lesions in longitudinal studies. Neuroradiology 56(5), 363–374 (2014)CrossRefGoogle Scholar
  6. 6.
    Gerig, G., Welti, D., Guttmann, C.R.G., Colchester, A.C.F., Szekely, G.: Exploring the discrimination power of the time domain for segmentation and characterization of active lesions in serial MR data. Med. Image Anal. 4(1), 31–42 (2000)CrossRefGoogle Scholar
  7. 7.
    Roy, S., Carass, A., Prince, J.L.: Magnetic resonance image example based contrast synthesis. IEEE Trans. Med. Imag. 32(12), 2348–2363 (2013)CrossRefGoogle Scholar
  8. 8.
    Roy, S., Carass, A., Prince, J.L.: Synthesizing MR contrast and resolution through a patch matching technique. In: Proc. of SPIE, vol. 7263, p. 76230j (2010)Google Scholar
  9. 9.
    Wang, L., Shi, F., Gao, Y., Li, G., Gilmore, J.H., Lin, W., Shen, D.: Integration of sparse multi-modality representation and anatomical constraint for isointense infant brain MR image segmentation. NeuroImage 16(1), 152–164 (2014)CrossRefGoogle Scholar
  10. 10.
    Weiss, N., Rueckert, D., Rao, A.: Multiple sclerosis lesion segmentation using dictionary learning and sparse coding. In: Mori, K., Sakuma, I., Sato, Y., Barillot, C., Navab, N. (eds.) MICCAI 2013, Part I. LNCS, vol. 8149, pp. 735–742. Springer, Heidelberg (2013) CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Snehashis Roy
    • 1
  • Aaron Carass
    • 2
  • Jerry L. Prince
    • 2
  • Dzung L. Pham
    • 1
  1. 1.Center for Neuroscience and Regenerative MedicineHenry Jackson FoundationBethesdaUSA
  2. 2.Department of Electrical and Computer EngineeringThe Johns Hopkins UniversityBaltimoreUSA

Personalised recommendations