EyeSAM: graph-based localization and mapping of retinal vasculature during intraocular microsurgery
- 74 Downloads
Robot-assisted intraocular microsurgery can improve performance by aiding the surgeon in operating on delicate micron-scale anatomical structures of the eye. In order to account for the eyeball motion that is typical in intraocular surgery, there is a need for fast and accurate algorithms that map the retinal vasculature and localize the retina with respect to the microscope.
This work extends our previous work by a graph-based SLAM formulation using a sparse incremental smoothing and mapping (iSAM) algorithm.
The resulting technique, “EyeSAM,” performs SLAM for intraoperative vitreoretinal surgical use while avoiding spurious duplication of structures as with the previous simpler technique. The technique also yields reduction in average pixel error in the camera motion estimation.
This work provides techniques to improve intraoperative tracking of retinal vasculature by handling loop closures and achieving increased robustness to quick shaky motions and drift due to uncertainties in the motion estimation.
KeywordsSurgical robotics Simultaneous localization and mapping Retinal surgery Factor graphs
This study was partially funded by the U.S. National Institutes of Health (Grant No. R01EB000526). This article does not contain any studies with human participants or animals performed by any of the authors.
Compliance with ethical standards
Conflict of interest
The authors declare that they have no conflict of interest.
- 5.Nasseri MA, Eder M, Eberts D, Nair S, Maier M, Zapp D, Lohmann CP, Knoll A (2013) Kinematics and dynamics analysis of a hybrid parallel-serial micromanipulator designed for biomedical applications. In: Proceedings of the IEEE/ASME international conference on advanced intelligent mechatronics, pp 293–299Google Scholar
- 8.Üneri A, Balicki MA, Handa J, Gehlbach P, Taylor RH, Iordachita I (2010) New steady-hand eye robot with micro-force sensing for vitreoretinal surgery. In: Proceedings of the 3rd IEEE RAS and EMBS international conference on biomedical robotics and biomechatronics, pp 814–9Google Scholar
- 13.Mukherjee S, Yang S, Maclachlan RA, Lobes LA, Martel JN, Riviere CN (2017) Toward monocular camera-guided retinal vein cannulation with an actively stabilized handheld robot. In: Proceedings of the IEEE international conference on robotics and automation, pp 2951–2956Google Scholar
- 14.Becker BC, Riviere CN (2013) Real-time retinal vessel mapping and localization for intraocular surgery. In: Proceedings of the IEEE international conference on robotics and automation, pp 5346–5351Google Scholar
- 16.Olson EB (2009) Real-time correlative scan matching. In: Proceedings of the IEEE international conference on robotics and automation, pp 4387–4393Google Scholar
- 17.Dellaert F, Kaess M (2017) Factor graphs for robot perception. Found Trends Robot 6(1–2):1–139Google Scholar
- 19.Engel J, Sturm J, Cremers D (2013) Semi-dense visual odometry for a monocular camera. In: Proceedings of the IEEE international conference on computer vision, pp 1449–1456Google Scholar
- 20.Engel J, Schöps T, Cremers D (2014) LSD-SLAM: large-scale direct monocular SLAM. In: Proceedings of the European conference on computer vision, pp 834–849Google Scholar
- 21.Lowe DG (1999) Object recognition from local scale-invariant features. In: Proceedings of the international conference on computer vision, vol 2, pp 1150–1157Google Scholar
- 24.Newman P, Ho K (2005) SLAM-loop closing with visually salient features. In: Proceedings of the IEEE international conference on robotics and automation, pp 635–642Google Scholar