Interactive Semantic Mapping: Experimental Evaluation

  • Guglielmo GemignaniEmail author
  • Daniele Nardi
  • Domenico Daniele Bloisi
  • Roberto Capobianco
  • Luca Iocchi
Part of the Springer Tracts in Advanced Robotics book series (STAR, volume 109)


Robots that are launched in the consumer market need to provide more effective human robot interaction, and, in particular, spoken language interfaces. However, in order to support the execution of high level commands as they are specified in natural language, a semantic map is required. Such a map is a representation that enables the robot to ground the commands into the actual places and objects located in the environment. In this paper, we present the experimental evaluation of a system specifically designed to build semantically rich maps, through the interaction with the user. The results of the experiments not only provide the basis for a discussion of the features of the proposed approach, but also highlight the manifold issues that arise in the evaluation of semantic mapping.


Cognitive robotics Human robot interaction Knowledge representation and reasoning Semantic mapping 



We would like to thank Joachim Hertzberg for insightful discussions on the experimental evaluation of semantic mapping. Moreover, we acknowledge the contribution of Emanuele Bastianelli and Taigo M. Bonnani to the implementation of the system. This work is part of the activities in the RoCKIn Coordination Action\(^{4}\), which is focussing on benchmarking of home robots through competitions.


  1. 1.
    Nüchter, A., Hertzberg, J.: Towards semantic maps for mobile robots. Robot. Auton. Syst. 56(11), 915–926 (2008)CrossRefGoogle Scholar
  2. 2.
    Rosenthal, S., Biswas, J., Veloso, M.: An effective personal mobile robot agent through symbiotic human-robot interaction. In: Proceedings of 9th International Joint Conference on Autonomous Agents and Multi-Agent Systems (AAMAS), pp. 915–922 (2010)Google Scholar
  3. 3.
    Randelli, G., Bonanni, T.M., Iocchi, L., Nardi, D.: Knowledge acquisition through human robot multimodal interaction. Intell. Serv. Robot. 6, 19–31 (2013)CrossRefGoogle Scholar
  4. 4.
    Bastianelli, E., Bloisi, D.D., Capobianco, R., Cossu, F., Gemignani, G., Iocchi, L., Nardi, D.: On-line semantic mapping. In: 16th International Conference on Advanced Robotics (ICAR), Nov 2013, pp. 1–6Google Scholar
  5. 5.
    Hertzberg, J., Saffiotti, A.: Using semantic knowledge in robotics. Robot. Auton. Syst. 56(11), 875–877 (Semantic Knowledge in Robotics)Google Scholar
  6. 6.
    Galindo, C., Saffiotti, A., Coradeschi, S., Buschka, P., Fernández-Madrigal, J., González, J.: Multi-hierarchical semantic maps for mobile robotics. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 3492–3497 (2005)Google Scholar
  7. 7.
    Goerke, N., Braun, S.: Building semantic annotated maps by mobile robots. In: Proceedings of the Conference Towards Autonomous Robotic Systems, pp. 149–156 (2009)Google Scholar
  8. 8.
    Brunskill, E., Kollar, T., Roy, N.: Topological mapping using spectral clustering and classification. In: Proceedings of IEEE/RSJ Conference on Robots and Systems (IROS), pp. 3491–3496 (2007)Google Scholar
  9. 9.
    Friedman, S., Pasula, H., Fox, D.: Voronoi random fields: Extracting the topological structure of indoor environments via place labeling. In: Proceedings of 19th International Joint Conference on Artificial Intelligence (IJCAI), pp. 2109–2114 (2007)Google Scholar
  10. 10.
    Mozos, O.M., Mizutani, H., Kurazume, R., Hasegawa, T.: Categorization of indoor places using the kinect sensor. Sensors 12(5), 6695–6711 (2012)CrossRefGoogle Scholar
  11. 11.
    Gunther, M., Wiemann, T., Albrecht, S., Hertzberg, J.: Building semantic object maps from sparse and noisy 3D data. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, pp. 2228–2233 (2013)Google Scholar
  12. 12.
    Zender, H., Martínez, M.O., Jensfelt, P., Kruijff, G., Burgard, W.: Conceptual spatial representations for indoor mobile robots. Robot. Auton. Syst. 56(6), 493–502 (2008)CrossRefGoogle Scholar
  13. 13.
    Pronobis, A., Jensfelt, P.: Large-scale semantic mapping and reasoning with heterogeneous modalities. In: Proceedings of the 2012 IEEE International Conference on Robotics and Automation (ICRA’12), pp. 3515–3522 (2012)Google Scholar
  14. 14.
    Grisetti, G., Kuemmerle, R., Stachniss, C., Burgard, W.: A tutorial on graph-based SLAM. Intell. Transp. Syst. Mag. IEEE 2(4), 31–43 (2010)CrossRefGoogle Scholar
  15. 15.
    Guivant, J.E., Masson, F.R., Nebot, E.M.: Simultaneous localization and map building using natural features and absolute information. Robot. Auton. Syst. 40(2), 79–90 (2002)CrossRefGoogle Scholar
  16. 16.
    Nüchter, A., Wulf, O., Lingemann, K., Hertzberg, J., Wagner, B., Surmann, H.: 3D mapping with semantic knowledge. In: Robot Soccer World Cup IX RoboCup 2005, pp. 335–346 (2005)Google Scholar
  17. 17.
    Bastianelli, E., Castellucci, G., Croce, D., Basili, R., Nardi, D.: Effective and robust natural language understanding for human robot interaction. In: 21st European Conference on Artificial Intelligence, ECAI 2014 (2014)Google Scholar
  18. 18.
    Capobianco, R., Gemignani, G., Bloisi, D.D., Nardi, D., Iocchi, L.: Automatic extraction of structural representations of environmentss. In: Proceedings of the 13th Intelligent Autonomous System conference (2014)Google Scholar
  19. 19.
    Popović, M., Ney, H.: Word error rates: Decomposition over pos classes and applications for error analysis. In: Proceedings of the Second Workshop on Statistical Machine Translation, StatMT’07, Stroudsburg, PA, USA, Association for Computational Linguistics, pp. 48–55 (2007)Google Scholar
  20. 20.
    Croce, D., Castellucci, G., Bastianelli, E.: Structured learning for semantic role labeling. Intelligenza Artificiale 6(2), 163–176 (2012)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Guglielmo Gemignani
    • 1
    Email author
  • Daniele Nardi
    • 1
  • Domenico Daniele Bloisi
    • 1
  • Roberto Capobianco
    • 1
  • Luca Iocchi
    • 1
  1. 1.Department of Computer, Control, and Management EngineeringSapienza University of RomeRomeItaly

Personalised recommendations