Multi-frame Super-resolution with Quality Self-assessment for Retinal Fundus Videos
This paper proposes a novel super-resolution framework to reconstruct high-resolution fundus images from multiple low-resolution video frames in retinal fundus imaging. Natural eye movements during an examination are used as a cue for super-resolution in a robust maximum a-posteriori scheme. In order to compensate heterogeneous illumination on the fundus, we integrate retrospective illumination correction for photometric registration to the underlying imaging model. Our method utilizes quality self-assessment to provide objective quality scores for reconstructed images as well as to select regularization parameters automatically. In our evaluation on real data acquired from six human subjects with a low-cost video camera, the proposed method achieved considerable enhancements of low-resolution frames and improved noise and sharpness characteristics by 74%. In terms of image analysis, we demonstrate the importance of our method for the improvement of automatic blood vessel segmentation as an example application, where the sensitivity was increased by 13% using super-resolution reconstruction.
Unable to display preview. Download preview PDF.
- 1.Tornow, R., Kopp, O., Schultheiss, B.: Time course of fundus reflection changes according to the cardiac cycle. Invest. Ophthalmol. Vis. Sci. 44, 1296 (2003)Google Scholar
- 2.Köhler, T., Hornegger, J., Mayer, M., Michelson, G.: Quality-guided denoising for low-cost fundus imaging. In: Proceedings BVM 2012, pp. 292–297 (2012)Google Scholar
- 3.Marrugo, A.G., Sorel, M., Sroubek, F., Millán, M.S.: Retinal image restoration by means of blind deconvolution. J. Biomed. Opt. 16(11), 116016 (2011)Google Scholar
- 4.Milanfar, P.: Super-resolution imaging. CRC Press (2010)Google Scholar
- 5.Pickup, L.C., Capel, D.P., Roberts, S.J., Zisserman, A.: Overcoming Registration Uncertainty in Image Super-Resolution: Maximize or Marginalize? EURASIP J. Adv. Signal Process., 1–15 (2007)Google Scholar
- 8.Murillo, S., Echegaray, S., Zamora, G., Soliz, P., Bauman, W.: Quantitative and qualitative image quality analysis of super resolution images from a low cost scanning laser ophthalmoscope. In: Proc. SPIE Medical Imaging, pp. 79624T (2011)Google Scholar
- 9.Kolar, R., Odstrcilik, J., Jan, J., Harabis, V.: Illumination Correction and Contrast Equalization in Colour Fundus Images. In: Proc. EUSIPCO 2011, pp. 298–302 (2011)Google Scholar
- 11.Köhler, T., Budai, A., Kraus, M.F., Odstrcilik, J., Michelson, G., Hornegger, J.: Automatic no-reference quality assessment for retinal fundus images using vessel segmentation. In: Proceedings CBMS 2013, pp. 95–100 (2013)Google Scholar
- 13.Budai, A., Bock, R., Maier, A., Hornegger, J., Michelson, G.: Robust vessel segmentation in fundus images. Int. J. Biomed. Imaging, 154860 (2013)Google Scholar