Longitudinal Patch-Based Segmentation of Multiple Sclerosis White Matter Lesions

  • Snehashis RoyEmail author
  • Aaron Carass
  • Jerry L. Prince
  • Dzung L. Pham
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9352)


Segmenting \(T_2\)-weighted white matter lesions from longitudinal MR images is essential in understanding progression of multiple sclerosis. Most lesion segmentation techniques find lesions independently at each time point, even though there are different noise and image contrast variations at each point in the time series. In this paper, we present a patch based 4D lesion segmentation method that takes advantage of the temporal component of longitudinal data. For each subject with multiple time-points, 4D patches are constructed from the \(T_1\)-w and FLAIR scans of all time-points. For every 4D patch from a subject, a few relevant matching 4D patches are found from a reference, such that their convex combination reconstructs the subject’s 4D patch. Then corresponding manual segmentation patches of the reference are combined in a similar manner to generate a 4D membership of lesions of the subject patch. We compare our 4D patch-based segmentation with independent 3D voxel-based and patch-based lesion segmentation algorithms. Based on ground truth segmentations from 30 data sets, we show that the mean Dice coefficients between manual and automated segmentations improve after using the 4D approach compared to two state-of-the-art 3D segmentation algorithms.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Garcia-Lorenzo, D., Francis, S., Narayanan, S., Arnold, D.L., Collins, D.L.: Review of automatic segmentation methods of multiple sclerosis white matter lesions on conventional magnetic resonance imaging. Med. Image Anal. 17(1), 1–18 (2013)CrossRefGoogle Scholar
  2. 2.
    Geremia, E., Clatz, O., Menze, B.H., Konukoglu, E., Criminisi, A., Ayache, N.: Spatial decision forests for MS lesion segmentation in multi-channel magnetic resonance images. NeuroImage 57(2), 378–390 (2011)CrossRefGoogle Scholar
  3. 3.
    Shiee, N., Bazin, P.L., Ozturk, A., Reich, D.S., Calabresi, P.A., Pham, D.L.: A Topology-Preserving Approach to the Segmentation of Brain Images with Multiple Sclerosis Lesions. NeuroImage 49(2), 1524–1535 (2009)CrossRefGoogle Scholar
  4. 4.
    Roy, S., He, Q., Carass, A., Jog, A., Cuzzocreo, J.L., Reich, D.S., Prince, J.L., Pham, D.L.: Example based lesion segmentation. In: Proc. of SPIE, vol. 9034, p. 90341Y (2014)Google Scholar
  5. 5.
    Ganiler, O., Oliver, A., Diez, Y., Freixenet, J., Vilanova, J.C., Beltran, B., Ramio-Torrenta, L., Rovira, A., Llado, X.: A subtraction pipeline for automatic detection of new appearing multiple sclerosis lesions in longitudinal studies. Neuroradiology 56(5), 363–374 (2014)CrossRefGoogle Scholar
  6. 6.
    Gerig, G., Welti, D., Guttmann, C.R.G., Colchester, A.C.F., Szekely, G.: Exploring the discrimination power of the time domain for segmentation and characterization of active lesions in serial MR data. Med. Image Anal. 4(1), 31–42 (2000)CrossRefGoogle Scholar
  7. 7.
    Roy, S., Carass, A., Prince, J.L.: Magnetic resonance image example based contrast synthesis. IEEE Trans. Med. Imag. 32(12), 2348–2363 (2013)CrossRefGoogle Scholar
  8. 8.
    Roy, S., Carass, A., Prince, J.L.: Synthesizing MR contrast and resolution through a patch matching technique. In: Proc. of SPIE, vol. 7263, p. 76230j (2010)Google Scholar
  9. 9.
    Wang, L., Shi, F., Gao, Y., Li, G., Gilmore, J.H., Lin, W., Shen, D.: Integration of sparse multi-modality representation and anatomical constraint for isointense infant brain MR image segmentation. NeuroImage 16(1), 152–164 (2014)CrossRefGoogle Scholar
  10. 10.
    Weiss, N., Rueckert, D., Rao, A.: Multiple sclerosis lesion segmentation using dictionary learning and sparse coding. In: Mori, K., Sakuma, I., Sato, Y., Barillot, C., Navab, N. (eds.) MICCAI 2013, Part I. LNCS, vol. 8149, pp. 735–742. Springer, Heidelberg (2013) Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial 2.5 International License (, which permits any noncommercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.

The images or other third party material in this chapter are included in the chapter's Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the chapter's Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.

Authors and Affiliations

  • Snehashis Roy
    • 1
    Email author
  • Aaron Carass
    • 2
  • Jerry L. Prince
    • 2
  • Dzung L. Pham
    • 1
  1. 1.Center for Neuroscience and Regenerative MedicineHenry Jackson FoundationBethesdaUSA
  2. 2.Department of Electrical and Computer EngineeringThe Johns Hopkins UniversityBaltimoreUSA

Personalised recommendations