Experimental Setup

  • Emilio Garcia-Fidalgo
  • Alberto Ortiz
Part of the Springer Tracts in Advanced Robotics book series (STAR, volume 122)


The topological mapping algorithms presented in this book have been validated using a common framework, featuring several criteria for performance evaluation and a number of relevant public datasets representing different scenarios of operation. The algorithms have as well been compared against some state-of-the-art solutions. The goal of this chapter is to summarize this experimental framework, which will be used to evaluate the solutions proposed in the rest of the book.


  1. 1.
    Ortiz, A., Oliver, G.: On the use of the overlapping area matrix for image segmentation evaluation: a survey and new performance measures. Pattern Recognit. Lett. 27(16), 1916–1926 (2006)Google Scholar
  2. 2.
    Davis, J., Goadrich, M.: The relationship between precision-recall and ROC curves. In: ICMLA, pp. 233–240 (2006)Google Scholar
  3. 3.
    Angeli, A., Filliat, D., Doncieux, S., Meyer, J.A.: A fast and incremental method for loop-closure detection using bags of visual words. IEEE Trans. Robot. 24(5), 1027–1037 (2008)Google Scholar
  4. 4.
    Cummins, M., Newman, P.: FAB-MAP: probabilistic localization and mapping in the space of appearance. Int. J. Robot. Res. 27(6), 647–665 (2008)Google Scholar
  5. 5.
    Geiger, A., Lenz, P., Urtasun, R.: Are we ready for autonomous driving? The KITTI vision benchmark suite. In: IEEE Conference on Computer Vision Pattern Recognition, pp. 3354–3361 (2012)Google Scholar
  6. 6.
    Garcia-Fidalgo, E., Ortiz, A.: Vision-based topological mapping and localization by means of local invariant features and map refinement. Robotica 33(7), 1446–1470 (2015)Google Scholar
  7. 7.
    Arroyo, R., Alcantarilla, P.F., Bergasa, L.M., Yebes, J.J., Bronte, S.: Fast and effective visual place recognition using binary codes and disparity information. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (2014)Google Scholar
  8. 8.
    Cummins, M., Newman, P.: Appearance-only SLAM at large scale with FAB-MAP 2.0. Int. J. Robot. Res. 30(9), 1100–1123 (2011)Google Scholar
  9. 9.
    Milford, M., Wyeth, G.: SeqSLAM: visual route-based navigation for sunny summer days and stormy winter nights. In: IEEE International Conference on Robotics and Automation, pp. 1643–1649 (2012)Google Scholar
  10. 10.
    Sünderhauf, N., Neubert, P., Protzel, P.: Are we there yet? challenging SeqSLAM on a 3000 km journey across all four seasons. In: Workshop on Long-Term Autonomy, ICRA (2013)Google Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Department of Mathematics and Computer ScienceUniversity of the Balearic IslandsPalma de MallorcaSpain

Personalised recommendations