Fine-Scale Vessel Extraction in Fundus Images by Registration with Fluorescein Angiography
We present a new framework for fine-scale vessel segmentation from fundus images through registration and segmentation of corresponding fluorescein angiography (FA) images. In FA, fluorescent dye is used to highlight the vessels and increase their contrast. Since these highlights are temporally dispersed among multiple FA frames, we first register the FA frames and aggregate the per-frame segmentations to construct a detailed vessel mask. The constructed FA vessel mask is then registered to the fundus image based on an initial fundus vessel mask. Postprocessing is performed to refine the final vessel mask. Registration of FA frames, as well as registration of FA vessel mask to the fundus image, are done by similar hierarchical coarse-to-fine frameworks, both comprising rigid and non-rigid registration. Two CNNs with identical network structures, both trained on public datasets but with different settings, are used for vessel segmentation. The resulting final vessel segmentation contains fine-scale, filamentary vessels extracted from FA and corresponding to the fundus image. We provide quantitative evaluation as well as qualitative examples which support the robustness and the accuracy of the proposed method.
KeywordsFundus images Fine-scale vessel segmentation Fluorescein angiography Registration Filamentary vessels
- 2.Bradski, G.: The OpenCV library. Dr. Dobb’s J. Softw. Tools 25, 120–125 (2000)Google Scholar
- 7.Galdran, A., Costa, P., Bria, A., Araújo, T., Mendonça, A.M., Campilho, A.: A no-reference quality metric for retinal vessel tree segmentation. In: Frangi, A.F., Schnabel, J.A., Davatzikos, C., Alberola-López, C., Fichtinger, G. (eds.) MICCAI 2018. LNCS, vol. 11070, pp. 82–90. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00928-1_10CrossRefGoogle Scholar
- 10.Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004). https://doi.org/10.1023/B:VISI.0000029664.99615.94CrossRefGoogle Scholar
- 12.Perez-Rovira, A., Trucco, E., Wilson, P., Liu, J.: Deformable registration of retinal fluorescein angiogram sequences using vasculature structures. In: International Conference of the IEEE Engineering in Medicine and Biology (EMBS), pp. 4383–4386, August 2010. https://doi.org/10.1109/IEMBS.2010.5627094